-- Logs begin at Sat 2022-09-10 09:50:17 UTC, end at Sat 2022-09-10 12:13:58 UTC. -- Sep 10 10:23:17.851429 n-d-856894-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 10 10:23:17.859919 n-d-856894-1 devstack@n-api.service[106288]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 10 10:23:17.861947 n-d-856894-1 devstack@n-api.service[106288]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 10 10:23:17 2022] *** Sep 10 10:23:17.861947 n-d-856894-1 devstack@n-api.service[106288]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 10 10:23:17.861947 n-d-856894-1 devstack@n-api.service[106288]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 10 10:23:17.861947 n-d-856894-1 devstack@n-api.service[106288]: nodename: n-d-856894-1 Sep 10 10:23:17.861947 n-d-856894-1 devstack@n-api.service[106288]: machine: x86_64 Sep 10 10:23:17.861947 n-d-856894-1 devstack@n-api.service[106288]: clock source: unix Sep 10 10:23:17.861947 n-d-856894-1 devstack@n-api.service[106288]: pcre jit disabled Sep 10 10:23:17.861947 n-d-856894-1 devstack@n-api.service[106288]: detected number of CPU cores: 4 Sep 10 10:23:17.861947 n-d-856894-1 devstack@n-api.service[106288]: current working directory: / Sep 10 10:23:17.861947 n-d-856894-1 devstack@n-api.service[106288]: detected binary path: /usr/bin/uwsgi-core Sep 10 10:23:17.862732 n-d-856894-1 devstack@n-api.service[106288]: your processes number limit is 47680 Sep 10 10:23:17.862732 n-d-856894-1 devstack@n-api.service[106288]: your memory page size is 4096 bytes Sep 10 10:23:17.862732 n-d-856894-1 devstack@n-api.service[106288]: detected max file descriptor number: 2048 Sep 10 10:23:17.862732 n-d-856894-1 devstack@n-api.service[106288]: lock engine: pthread robust mutexes Sep 10 10:23:17.862732 n-d-856894-1 devstack@n-api.service[106288]: thunder lock: enabled Sep 10 10:23:17.862732 n-d-856894-1 devstack@n-api.service[106288]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 10 10:23:17.862732 n-d-856894-1 devstack@n-api.service[106288]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 10 10:23:17.901407 n-d-856894-1 devstack@n-api.service[106288]: Python main interpreter initialized at 0x560922eb69c0 Sep 10 10:23:17.901407 n-d-856894-1 devstack@n-api.service[106288]: python threads support enabled Sep 10 10:23:17.901407 n-d-856894-1 devstack@n-api.service[106288]: your server socket listen backlog is limited to 100 connections Sep 10 10:23:17.901407 n-d-856894-1 devstack@n-api.service[106288]: your mercy for graceful operations on workers is 90 seconds Sep 10 10:23:17.901724 n-d-856894-1 devstack@n-api.service[106288]: mapped 403077 bytes (393 KB) for 2 cores Sep 10 10:23:17.901796 n-d-856894-1 devstack@n-api.service[106288]: *** Operational MODE: preforking *** Sep 10 10:23:17.902067 n-d-856894-1 devstack@n-api.service[106288]: *** uWSGI is running in multiple interpreter mode *** Sep 10 10:23:17.902067 n-d-856894-1 devstack@n-api.service[106288]: spawned uWSGI master process (pid: 106288) Sep 10 10:23:17.902246 n-d-856894-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 10 10:23:17.903900 n-d-856894-1 devstack@n-api.service[106288]: spawned uWSGI worker 1 (pid: 106289, cores: 1) Sep 10 10:23:17.903900 n-d-856894-1 devstack@n-api.service[106288]: spawned uWSGI worker 2 (pid: 106290, cores: 1) Sep 10 10:23:17.903900 n-d-856894-1 devstack@n-api.service[106288]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 10 10:23:18.559639 n-d-856894-1 devstack@n-api.service[106290]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 10:23:18.568002 n-d-856894-1 devstack@n-api.service[106289]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 10:23:19.635690 n-d-856894-1 devstack@n-api.service[106290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 10:23:19.635690 n-d-856894-1 devstack@n-api.service[106290]: from cryptography.utils import int_from_bytes Sep 10 10:23:19.636284 n-d-856894-1 devstack@n-api.service[106290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 10:23:19.636284 n-d-856894-1 devstack@n-api.service[106290]: from cryptography.utils import int_from_bytes Sep 10 10:23:19.638532 n-d-856894-1 devstack@n-api.service[106289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 10:23:19.638532 n-d-856894-1 devstack@n-api.service[106289]: from cryptography.utils import int_from_bytes Sep 10 10:23:19.638979 n-d-856894-1 devstack@n-api.service[106289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 10:23:19.638979 n-d-856894-1 devstack@n-api.service[106289]: from cryptography.utils import int_from_bytes Sep 10 10:23:22.143321 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 10:23:22.143886 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 10:23:22.144093 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 10:23:22.144452 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 10:23:22.144707 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 10:23:22.145108 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.145431 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.145748 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.146060 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.146386 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.146693 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.146856 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 10:23:22.147247 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.147330 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 10:23:22.147422 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.147625 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.147712 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 10:23:22.147881 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.147994 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 10:23:22.148193 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.148280 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 10:23:22.148512 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-856894-1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.148629 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.148829 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.148958 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.149154 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.149302 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.149460 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.149624 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.149775 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.149955 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.150073 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.150268 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.150386 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.150589 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.150676 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.150909 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.151161 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.151323 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.151486 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.151651 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.151803 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.151959 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.152130 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-856894-1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.152251 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.152452 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.152567 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.152765 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.152882 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.153089 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.153213 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.153421 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.153531 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.153724 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.153855 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.154652 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.154757 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.154965 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.155059 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.155369 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-856894-1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.155515 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.155681 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.155794 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.155991 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.156090 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.156299 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.156393 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.156682 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.156790 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.156996 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.157100 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.157328 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.157418 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.157644 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.157743 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.157954 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.158040 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.158520 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.158611 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.158842 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.158941 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.159155 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.159241 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-856894-1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.159466 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.159553 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.159780 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.159865 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.160077 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.160164 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.160380 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.160541 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.160682 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.160854 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.160995 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.161187 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.161320 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.161512 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.161621 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.161836 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.161935 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.162147 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.162289 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.162462 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.162549 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.162777 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.162864 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.163094 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.163190 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.163341 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.163429 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.163587 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.163701 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.163898 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.164012 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.164213 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.164308 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.164537 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.164639 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.164820 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.164913 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.165151 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.165259 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.165457 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.165560 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.165759 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.165853 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.166065 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.166208 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.166369 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.166468 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.166668 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.166755 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.166920 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.167011 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.167168 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.167280 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.167486 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.167595 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.167807 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.167902 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.168117 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.168209 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.168426 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.168575 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.168733 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.168825 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.169041 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.169168 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.169372 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.169473 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.169706 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.169794 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.170013 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.170131 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.170360 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.170465 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.170680 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.170779 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.170998 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.171085 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.171314 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.171408 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.171617 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.171707 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.171933 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.172018 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.172259 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.172356 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.172561 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.172654 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.172808 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.172894 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.173124 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.173229 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.173427 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.173520 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.173739 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.173825 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.174039 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.174138 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.174338 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.174425 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.174637 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.174723 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.174932 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.175019 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.175234 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.175321 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.175535 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.175622 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.175834 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.175953 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.176140 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.176248 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.176441 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.176545 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.176741 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.176840 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.177038 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.177169 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.177372 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.177526 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.177674 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.177761 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.177974 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.178059 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.178284 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.178378 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.178585 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.178671 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.178882 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.178967 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.179182 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.179278 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.179484 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.179571 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.179785 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.179877 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.180089 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.180184 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.180388 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.180473 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.180688 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.180780 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.180993 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.181105 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.181318 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.181404 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.181621 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.181708 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.181932 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.182035 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.182233 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.182319 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.182534 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.182628 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.182844 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.182932 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.183138 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.183238 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.183438 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.183524 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.183747 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.183835 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.184046 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.184132 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.184345 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.184430 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.184642 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.184729 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.184942 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.185028 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.185773 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.185871 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.186077 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.186164 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.186391 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.186496 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.186697 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.186784 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.187016 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.187104 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.187317 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.187399 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.187625 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.187713 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.187941 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.188034 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.188244 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.188337 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.188546 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.188640 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.188850 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.188935 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.189178 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.189268 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.189486 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.189583 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.189793 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.189881 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.190099 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.190191 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.190406 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.190502 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.190708 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.190806 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.191026 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.191120 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.191348 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.191436 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.191657 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.191749 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.191964 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.192053 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.192271 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.192357 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.192580 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.192673 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:23:22.192891 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.192986 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.193231 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.193330 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.193544 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.193631 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.193870 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.193956 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.194184 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.194279 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.194497 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.194582 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.194810 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.194905 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.195118 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.195224 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.195430 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.195518 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.195750 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.195854 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.196067 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.196161 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.196387 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.196531 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.196689 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.196785 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.197013 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.197115 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.197359 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.197448 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.197683 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.197777 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.198000 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.198086 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.198306 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.198392 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.198616 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.198719 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.198923 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.199009 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.199242 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.199334 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.199563 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.199658 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.199872 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.199958 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.200186 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.200272 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.200492 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.200588 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.201447 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.201546 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.201766 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.201852 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.202081 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.202170 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.202392 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.202486 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.202703 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.202789 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.203013 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.203101 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.203332 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.203420 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.203644 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.203736 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.203963 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.204059 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.204275 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.204361 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.204587 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.204672 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.204899 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.204985 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.205230 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.205324 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.205538 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.205638 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.205846 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.205932 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.206148 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.206234 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.206448 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.206544 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.206750 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.206843 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.207056 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.207143 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.207356 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.207454 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.207672 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.207760 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.208000 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.208084 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.208303 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.208396 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.208621 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.208715 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.208920 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.209014 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.209254 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.209345 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.209563 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.209650 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.209867 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.209952 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.210170 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.210270 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.210473 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.210558 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.210779 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.210867 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.211082 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.211169 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.211400 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.211497 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.211705 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.211790 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.212007 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.212097 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.212328 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.212414 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.212630 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.212725 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.212933 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.213021 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.213274 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.213362 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.213590 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.213689 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.213897 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.213984 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.214212 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.214310 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.214517 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.214612 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.214822 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.214909 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.215130 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.215215 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.215435 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.215529 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.215741 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.215833 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.216065 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.216152 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.216398 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.216485 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.216709 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.216796 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.217027 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.217147 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.217364 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.217452 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.217666 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.217752 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.217978 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.218064 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.218277 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.218362 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.218576 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.218661 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.218878 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.218963 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.219182 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.219276 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.219481 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.219568 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.219779 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.219875 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.220079 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.220167 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.220378 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.220465 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.220677 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.220818 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.220997 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.221103 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.221330 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.221432 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.221629 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.221728 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.221928 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.222059 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.222228 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.222315 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.222544 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.222643 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.222851 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.222937 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.223156 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.223241 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.223467 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.223562 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.223771 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.223857 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.224077 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.224163 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.224383 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.224470 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.224706 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.224793 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.225010 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.225122 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.225342 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.225430 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.225648 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.225732 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.225951 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.226035 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.226264 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.226358 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.226572 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.226659 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.226886 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.226981 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.227193 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.227279 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.227514 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.227601 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.227826 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.227921 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.228140 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.228226 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.228440 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.228538 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.228750 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.228846 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.229060 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.229164 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.229397 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.229483 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.229710 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.229809 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.230024 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.230109 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.230332 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.230425 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.230646 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.230746 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.230953 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.231043 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.231260 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.231346 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.231565 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.231654 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.231869 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.231955 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.232208 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.232329 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.232515 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.232653 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.232828 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.232995 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.233157 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.233354 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.233477 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.233677 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.233766 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.234001 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.234087 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.234315 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.234412 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.234632 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.234718 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.234947 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.235033 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.235261 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.235348 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.235570 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.235655 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.235879 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.235965 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.236197 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.236320 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.236500 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.236586 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.236806 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.236948 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.237134 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.237226 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.237435 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.237521 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.237741 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.237827 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.238049 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.238137 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.238355 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.238439 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.238659 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.238744 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.238966 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.239055 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.239267 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.239354 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.239577 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.239677 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.239881 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.239974 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.240179 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.240265 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.240479 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.240573 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.240785 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.240871 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.241119 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.241208 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.241430 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.241526 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.241736 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.241829 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.242050 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.242145 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.242350 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.242454 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.242652 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.242738 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.242969 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.243063 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.243277 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.243363 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.243574 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.243666 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.243874 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.243960 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.244175 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.244263 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.244481 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.244566 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.244795 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.244881 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.245121 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.245222 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.245440 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.245527 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.245760 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.245848 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.246069 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.246158 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.246375 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.246461 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.246682 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.246778 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.246989 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.247074 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.247306 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.247393 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.248117 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.248223 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.248429 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.248516 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.248733 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.248826 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.249040 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.249164 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.249373 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.249468 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.249682 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.249777 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.250002 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.250101 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.250308 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.250396 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.250616 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.250702 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.250922 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.251010 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.251223 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.251318 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.251534 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.251629 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.251851 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.251938 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.252163 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.252415 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.252503 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.252746 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.252844 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.253058 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.253216 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.253406 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.253504 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.253721 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.253818 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.254050 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.254146 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.254361 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.254455 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.254679 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.254810 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.254992 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.255094 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.255295 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.255394 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.255600 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.255705 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.255904 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.256000 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.256205 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.256469 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.256577 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.256800 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.256888 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.257120 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.257224 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.257423 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.257510 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.257732 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.257826 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.258031 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.258127 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.258337 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.258423 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.258638 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.258738 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.258939 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.259027 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.259247 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.259341 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.259547 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.259642 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.259854 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.259940 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.260155 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.260241 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.260473 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.260568 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.260780 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.260873 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.261096 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.261231 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.261400 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.261497 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.261698 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.261784 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.262008 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.262093 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.262316 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.262440 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.262624 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.262711 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.262929 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.263016 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.263291 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.263876 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.264099 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.264194 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.264413 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.264500 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.264721 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.264809 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.265046 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.265212 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.265376 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.265472 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.265676 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.265763 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.265980 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.266065 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.266283 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.266378 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.266582 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.266669 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.266888 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.266983 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.267195 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.267290 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.267501 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.267595 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.267807 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.267893 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.268105 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.268204 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.268414 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.268500 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.268713 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.268799 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.269023 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.269129 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.269353 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.269440 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.269653 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.269752 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.269952 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.270040 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.270258 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.270345 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.270563 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.270649 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.270861 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.270950 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.271168 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.271292 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.271470 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.271557 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.271779 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.271873 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.272075 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.272205 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.272375 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.272471 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.272674 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.272761 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.272980 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.273066 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.273310 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.273411 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.273610 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.273704 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.273919 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.274012 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.274223 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.274317 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.274521 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.274608 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.274819 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.274913 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.275124 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.275224 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.275423 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.275510 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.275723 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.275811 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.276028 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.276121 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.276333 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.276420 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.276639 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.276770 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.276936 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.277024 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.277272 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.277360 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.277578 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.277671 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.277901 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.277990 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.278211 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.278296 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.278513 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.278604 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.278811 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.278898 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.279130 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.279216 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.279430 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.279524 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.279731 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.279817 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.280030 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.280116 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.280347 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.280441 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.280653 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.280746 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.280954 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.281040 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.281281 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.281416 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.281580 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.281667 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.281884 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.281969 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.282190 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.282329 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.282502 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.282602 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.282808 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.282896 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.283112 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.283474 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.283681 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.283768 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.283990 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.284083 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.284291 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.284389 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.284600 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.284692 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.284899 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.284986 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.285228 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.285317 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.285534 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.285620 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.285835 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.285922 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.286132 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.286219 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.286432 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.286520 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.286748 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.286888 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.287057 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.287145 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.287409 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.287496 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.287730 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.287830 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.288041 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.288135 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.288353 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.288440 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.288656 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.288749 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.288962 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.289056 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.289304 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.289391 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.289607 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.289706 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.289913 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.290008 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.290218 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.290303 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.290522 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.290616 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.290831 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.290917 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.291137 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.291223 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.291445 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.291549 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.291752 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.291840 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.292053 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.292146 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.292360 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.292448 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.292666 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.292796 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.292966 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.293060 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.293300 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.293388 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.293605 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.293698 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.293906 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.293999 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.294210 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.294298 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.294536 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.294624 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.294844 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.294938 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.295146 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.295233 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.295458 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.295567 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.295789 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.295890 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.296082 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.296169 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.296398 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.296485 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.296712 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.296808 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.297019 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.297123 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.297359 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.297447 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.297671 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.297771 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.297972 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.298060 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.298284 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.298381 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.298594 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.298682 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.298908 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.298995 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.299216 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.299303 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.299552 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.299647 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.299851 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.299939 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.300154 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.300240 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.300472 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.300559 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.300772 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.300859 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.301105 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.301196 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.301392 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.301480 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.301709 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.301807 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.302009 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.302113 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.302323 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.302480 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.302734 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.302858 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.303041 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.303142 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.303392 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.303478 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.303700 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.303892 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.304011 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.304209 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.304324 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.304519 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.304651 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.304837 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.304958 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.305179 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.305293 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.305502 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.305598 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.305806 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.305903 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.306117 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.306205 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.306424 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.306536 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.306744 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.306919 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.307064 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.307234 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.307369 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.307542 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.307680 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.307957 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.308045 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.308272 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.308361 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.308586 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.308673 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.308892 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.308977 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.309235 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.309327 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.309564 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.309649 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.309872 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.310035 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.310703 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.310792 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.311021 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.311108 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.311352 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.311453 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.311661 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.311747 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.311962 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.312050 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.312269 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.312369 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.312572 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.312660 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.312873 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.312960 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.313219 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.313323 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.313522 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.313610 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.313829 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.313928 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.314136 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.314257 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.314443 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.314586 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.314746 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.314901 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.315047 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.315227 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.315365 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.315556 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.315665 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.315865 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.315970 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.316174 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.316268 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.316488 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.316577 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.316795 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.316895 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.317122 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.317213 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.317452 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.317541 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.317763 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.317859 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.318078 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.318165 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.318377 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.318464 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.318685 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.318781 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.318989 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.319075 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.319295 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.319382 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.319621 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.319716 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.319929 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.320016 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.320252 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.320339 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.320559 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.320646 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.320881 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.320974 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.321228 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.321330 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.321537 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.321623 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.321847 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.321933 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.322161 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.322261 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.322465 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.322551 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.322773 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.322862 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.323075 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.323171 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.323385 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.323473 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.323686 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.323776 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.323987 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.324083 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.324288 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.324376 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.324593 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.324688 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.324893 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.324982 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.325221 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.325310 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.325524 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.325611 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.326382 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.326482 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.326684 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.326771 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.327001 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.327089 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.327307 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.327396 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.327607 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.327733 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.327909 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.328007 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.328209 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.328342 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.328551 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.328646 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.328851 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.328954 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.329186 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.329278 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.329497 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.329583 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.329800 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.329899 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.330105 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.330204 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.330410 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.330572 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.330717 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.330813 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.331028 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.331122 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.331339 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.331433 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.331649 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.331744 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.331957 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.332052 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.332261 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.332350 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.332567 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.332656 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.332877 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.332964 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.333216 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.333325 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.333545 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.333729 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.333859 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.334051 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.334189 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.334364 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.334506 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.334674 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.334822 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.334982 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.335139 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.335292 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.335456 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.335600 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.335772 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.335908 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.336089 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.336216 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.336404 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.336523 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.336718 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.336830 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.337037 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.337186 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.337382 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.337470 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.337705 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.337793 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.338102 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.338227 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.338414 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.338558 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.338729 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.338864 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.339040 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.339179 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.339350 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.339495 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.339699 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.339812 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.340009 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.340126 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.340310 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.340442 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.340618 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.340755 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.340931 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.341086 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.341354 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.341458 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.341662 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.341768 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.341969 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.342057 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.342278 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.342373 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.342587 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.342689 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.342897 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.342998 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.343202 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.343312 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.343510 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.343631 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.343819 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.343948 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.344138 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.344309 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.344456 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.344626 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.344768 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.344934 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.345101 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.345280 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.345407 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.345596 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.345718 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.345913 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.346225 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.346320 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.346533 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.346626 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.346845 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.346932 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.347159 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.347260 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.347473 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.347561 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.347779 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.347872 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.348091 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.348192 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.348403 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.348490 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.348709 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.348795 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.349008 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.349130 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.349340 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.349429 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.349647 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.349734 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.349947 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.350043 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.350265 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.350352 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.350571 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.350799 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.350896 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.351118 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.351213 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.351453 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.351541 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.351780 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.351979 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.352168 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.352321 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.352491 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.352637 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.352814 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.352971 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.353179 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.353337 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.353487 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.353622 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.353770 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.353906 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.354050 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.354212 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.354362 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.354515 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.354671 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.354829 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.355021 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.355127 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.355313 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.355434 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.355620 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.355734 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.355944 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.356039 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.356256 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.356352 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.356627 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.356795 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.356926 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.357198 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.357292 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.357526 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.357662 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.357861 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.358061 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.358174 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.358251 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.358477 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.358601 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.358783 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.358871 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.359091 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.359177 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.359391 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.359494 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.359689 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.359818 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.359986 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.360139 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.360270 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.360341 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.360598 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.360717 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.360866 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.360963 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.361194 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.361286 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.361496 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.361583 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.361802 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.361902 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.362114 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.362241 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.362422 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.362517 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.362724 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.362824 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.363045 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.363159 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.363347 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.363448 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.363644 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.363733 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.363954 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.364041 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.364258 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.364351 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.364561 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.364649 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.364867 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.364956 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.365194 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.365285 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.365510 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.365598 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.365816 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.365913 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.366129 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.366341 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.366438 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.366670 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.366758 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.366988 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.367075 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.367319 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.367407 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.367646 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.367780 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.367951 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.368041 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.368253 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.368341 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.368557 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.368642 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.368875 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.368971 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.369206 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.369293 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.369505 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.369593 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.369814 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.369910 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.370122 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.370211 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.370429 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.370524 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.370735 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.370832 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.371041 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.371293 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.371380 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.371628 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.371715 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.371931 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.372028 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.372236 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.372363 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.372540 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.373208 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.373434 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.373522 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.373745 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.373832 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.374052 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.374148 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.374379 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.374465 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.374694 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.374779 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.375009 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.375108 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.375322 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.375416 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.375634 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.375719 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.375938 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.376034 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.376244 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.376331 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.376549 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.376642 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.376855 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.376957 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.377189 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.377327 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.377503 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.377608 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.377812 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.377903 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.378114 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.378201 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.378426 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.378738 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.378838 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.379054 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.379188 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.379386 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.379472 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.379704 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.379791 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.380010 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.380096 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.380328 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.380414 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.380644 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.380731 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.380952 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.381040 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.381292 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.381380 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.381599 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.381687 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.381908 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.381994 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.382225 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.382313 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.382555 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.382645 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.382870 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.382956 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.383171 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.383304 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.383474 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.383774 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.383869 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.384080 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.384169 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.384394 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.384482 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.384700 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.384786 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.384999 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.385104 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.385341 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.385430 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.385650 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.385736 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.385949 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.386054 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.386249 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.386343 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.386548 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.386634 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.386846 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.386943 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.387152 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.387283 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.387448 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.387617 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.387746 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.387949 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.388037 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.388801 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.388984 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.389142 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.389323 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.389454 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.389627 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.389769 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.389937 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.390092 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.390239 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.390405 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.390540 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.390711 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.390837 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.391018 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.391124 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.391332 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.391419 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.391638 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.391724 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.391943 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.392039 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.392249 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.392336 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.392554 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.392640 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.392865 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.392960 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.393198 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.393290 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.393570 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.393668 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.393829 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.393918 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.394134 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.394227 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.394439 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.394527 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.394749 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.394837 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.395060 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.395148 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.395365 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.395452 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.395670 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.395757 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.395976 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.396062 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.396279 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.396374 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.396583 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.396670 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.396889 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.396976 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.397234 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.397337 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.397559 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.397647 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.397862 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.397949 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.398184 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.398283 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.398495 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.398582 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.398806 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.398893 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.399118 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.399279 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.399431 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.399519 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.399745 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.399843 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.400061 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.400148 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.400364 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.400449 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.400671 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.400759 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.400977 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.401065 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.401306 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.401394 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.401618 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.401704 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.401925 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.402012 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.402232 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.402318 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.402544 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.402679 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.402855 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.402942 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.403168 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.403253 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.403486 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.403581 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.403795 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.403909 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.404137 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.404430 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.404516 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.404754 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.404843 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.405167 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.405260 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.405433 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.405540 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.405752 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.405840 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.406059 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.406146 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.406368 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.406464 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.406670 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.406765 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.406908 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 10:23:22.407004 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.407302 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.407619 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.407935 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.408528 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.408848 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.409203 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.409536 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.409852 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.410182 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.410513 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.410864 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.411183 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.411531 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.411864 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.412183 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.412499 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.412810 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:23:22.413056 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 10:23:22.559292 n-d-856894-1 devstack@n-api.service[106290]: INFO dbcounter [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Registered counter for database nova_api Sep 10 10:23:22.567200 n-d-856894-1 devstack@n-api.service[106289]: INFO dbcounter [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Registered counter for database nova_api Sep 10 10:23:22.580329 n-d-856894-1 devstack@n-api.service[106290]: DEBUG oslo_db.sqlalchemy.engines [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:23:22.586717 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_db.sqlalchemy.engines [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:23:22.586918 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writer thread running {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:23:22.593190 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writer thread running {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:23:22.644182 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.context [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) {{(pid=106290) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 10:23:22.648148 n-d-856894-1 devstack@n-api.service[106290]: DEBUG oslo_concurrency.lockutils [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:23:22.648617 n-d-856894-1 devstack@n-api.service[106290]: DEBUG oslo_concurrency.lockutils [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:23:22.650140 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.context [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) {{(pid=106289) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 10:23:22.650269 n-d-856894-1 devstack@n-api.service[106290]: DEBUG oslo_concurrency.lockutils [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:23:22.650913 n-d-856894-1 devstack@n-api.service[106290]: DEBUG oslo_concurrency.lockutils [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:23:22.651353 n-d-856894-1 devstack@n-api.service[106290]: DEBUG oslo_concurrency.lockutils [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:23:22.653342 n-d-856894-1 devstack@n-api.service[106290]: DEBUG oslo_concurrency.lockutils [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:23:22.654044 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:23:22.654526 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:23:22.655356 n-d-856894-1 devstack@n-api.service[106290]: INFO dbcounter [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Registered counter for database nova_cell0 Sep 10 10:23:22.656108 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:23:22.656827 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:23:22.657306 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:23:22.659548 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:23:22.659650 n-d-856894-1 devstack@n-api.service[106290]: INFO dbcounter [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Registered counter for database nova_cell1 Sep 10 10:23:22.661582 n-d-856894-1 devstack@n-api.service[106289]: INFO dbcounter [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Registered counter for database nova_cell0 Sep 10 10:23:22.665577 n-d-856894-1 devstack@n-api.service[106289]: INFO dbcounter [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Registered counter for database nova_cell1 Sep 10 10:23:22.667696 n-d-856894-1 devstack@n-api.service[106290]: DEBUG oslo_db.sqlalchemy.engines [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:23:22.670496 n-d-856894-1 devstack@n-api.service[106290]: DEBUG oslo_db.sqlalchemy.engines [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:23:22.672995 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_db.sqlalchemy.engines [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:23:22.675139 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_db.sqlalchemy.engines [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:23:22.676219 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writer thread running {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:23:22.680616 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writer thread running {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:23:22.813115 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writer thread running {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:23:22.818098 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writer thread running {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:23:22.822822 n-d-856894-1 devstack@n-api.service[106290]: INFO dbcounter [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Registered counter for database nova_cell0 Sep 10 10:23:22.828061 n-d-856894-1 devstack@n-api.service[106289]: INFO dbcounter [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Registered counter for database nova_cell0 Sep 10 10:23:22.831503 n-d-856894-1 devstack@n-api.service[106290]: DEBUG oslo_db.sqlalchemy.engines [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:23:22.835086 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_db.sqlalchemy.engines [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:23:22.836509 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writer thread running {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:23:22.839742 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writer thread running {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:23:23.175443 n-d-856894-1 devstack@n-api.service[106290]: WARNING keystonemiddleware.auth_token [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 10:23:23.177877 n-d-856894-1 devstack@n-api.service[106289]: WARNING keystonemiddleware.auth_token [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 10:23:23.182688 n-d-856894-1 devstack@n-api.service[106290]: WARNING keystonemiddleware.auth_token [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 10:23:23.185193 n-d-856894-1 devstack@n-api.service[106289]: WARNING keystonemiddleware.auth_token [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 10:23:23.529556 n-d-856894-1 devstack@n-api.service[106290]: WARNING keystonemiddleware.auth_token [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 10:23:23.530965 n-d-856894-1 devstack@n-api.service[106289]: WARNING keystonemiddleware.auth_token [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 10:23:23.536136 n-d-856894-1 devstack@n-api.service[106290]: WARNING keystonemiddleware.auth_token [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 10:23:23.537234 n-d-856894-1 devstack@n-api.service[106289]: WARNING keystonemiddleware.auth_token [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 10:23:23.541500 n-d-856894-1 devstack@n-api.service[106290]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560922eb69c0 pid: 106290 (default app) Sep 10 10:23:23.542545 n-d-856894-1 devstack@n-api.service[106289]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560922eb69c0 pid: 106289 (default app) Sep 10 10:23:23.543578 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:23:23.544789 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-7ca0dafe-4ceb-425e-a1b1-d5fb4f82aeb1 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001721 Sep 10 10:23:23.545202 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Sat Sep 10 10:23:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:24:45.003955 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:24:45.005238 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Sep 10 10:24:45.005632 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:24:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:24:45.017679 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writing DB stats nova_api:SELECT=3 {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:24:45.018802 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writing DB stats nova_cell0:SELECT=3 {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:24:45.019926 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writing DB stats nova_cell1:SELECT=3 {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:24:45.022098 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:24:45.882393 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-ac5f702a-9e78-4579-960f-d4ceccb6bc62 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:24:45.915165 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-ac5f702a-9e78-4579-960f-d4ceccb6bc62 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.903453 Sep 10 10:24:45.915955 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Sep 10 10:24:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:24:48.561629 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:24:48.562661 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-5157ffb6-8689-4859-84f8-f51b34a707a6 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 10 10:24:48.563207 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:24:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:24:49.027999 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-c9cfae4a-a6a0-4e96-87a5-c0a54f339ad9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1}} {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:24:49.074659 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-c9cfae4a-a6a0-4e96-87a5-c0a54f339ad9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505571 Sep 10 10:24:49.075221 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Sep 10 10:24:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 10:24:49.088861 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writing DB stats nova_api:SELECT=3 {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:24:49.089717 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writing DB stats nova_cell0:SELECT=3 {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:24:49.092623 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writing DB stats nova_cell1:SELECT=3 {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:24:49.093383 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:24:49.299278 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-37c647e0-1733-4378-9e33-f4a7d940aa2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:24:49.367796 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-37c647e0-1733-4378-9e33-f4a7d940aa2f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284213 Sep 10 10:24:49.368579 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1336 bytes} [Sat Sep 10 10:24:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:24:52.029545 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-c9cfae4a-a6a0-4e96-87a5-c0a54f339ad9 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:24:52.030703 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-c9cfae4a-a6a0-4e96-87a5-c0a54f339ad9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Sep 10 10:24:52.031200 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:24:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:24:52.874843 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-3b193b28-4586-464e-a1db-01188bd287e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "id": "d1", "swap": 0}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:24:52.931893 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-3b193b28-4586-464e-a1db-01188bd287e6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.894165 Sep 10 10:24:52.933281 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Sep 10 10:24:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:24:52.945732 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-bb102031-5acb-42ad-aa63-fe225e5970bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:24:52.994708 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-bb102031-5acb-42ad-aa63-fe225e5970bd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053385 Sep 10 10:24:53.002635 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1336 bytes} [Sat Sep 10 10:24:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:24:55.963667 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-3b193b28-4586-464e-a1db-01188bd287e6 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:24:55.964722 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-3b193b28-4586-464e-a1db-01188bd287e6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 10 10:24:55.965140 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:24:56.460399 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-8b7c68d4-6e1b-49e4-9522-f78e13d0c042 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "vcpus": 1, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:24:56.482961 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-8b7c68d4-6e1b-49e4-9522-f78e13d0c042 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509954 Sep 10 10:24:56.483796 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Sep 10 10:24:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:24:56.496309 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-3a774edb-f1c9-4690-a777-7aff8f9f6640 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:24:56.526802 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-3a774edb-f1c9-4690-a777-7aff8f9f6640 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034641 Sep 10 10:24:56.527398 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1336 bytes} [Sat Sep 10 10:24:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:24:59.165243 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-8b7c68d4-6e1b-49e4-9522-f78e13d0c042 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:24:59.166272 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-8b7c68d4-6e1b-49e4-9522-f78e13d0c042 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 10 10:24:59.169161 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:24:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:24:59.641748 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-01beb966-9451-4911-a13b-96ce4dd604ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:24:59.662549 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-01beb966-9451-4911-a13b-96ce4dd604ff admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489522 Sep 10 10:24:59.663199 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Sep 10 10:24:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:24:59.681546 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-3094fa0d-e5b5-4301-b5d0-9be29816ab58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:24:59.723130 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-3094fa0d-e5b5-4301-b5d0-9be29816ab58 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045502 Sep 10 10:24:59.723836 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1336 bytes} [Sat Sep 10 10:24:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:25:02.565740 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-01beb966-9451-4911-a13b-96ce4dd604ff admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:02.567531 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-01beb966-9451-4911-a13b-96ce4dd604ff admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002270 Sep 10 10:25:02.578546 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:25:02 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:03.075477 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-9069d78f-6943-4292-b404-1b3201160eaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:03.100948 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-9069d78f-6943-4292-b404-1b3201160eaa admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.526539 Sep 10 10:25:03.101925 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Sep 10 10:25:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:25:03.115587 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-c0b11f37-a668-4151-9cd3-f4dd07e2fe05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:03.148654 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-c0b11f37-a668-4151-9cd3-f4dd07e2fe05 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037097 Sep 10 10:25:03.167388 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1336 bytes} [Sat Sep 10 10:25:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:25:05.897561 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-9069d78f-6943-4292-b404-1b3201160eaa admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:05.898512 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-9069d78f-6943-4292-b404-1b3201160eaa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 10 10:25:05.898927 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:25:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:06.324294 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-b1ac0767-7f9e-4b57-834d-489984e84622 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:06.348283 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-b1ac0767-7f9e-4b57-834d-489984e84622 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.442540 Sep 10 10:25:06.348831 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Sep 10 10:25:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:25:09.277679 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-9069d78f-6943-4292-b404-1b3201160eaa admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:09.278669 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-9069d78f-6943-4292-b404-1b3201160eaa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Sep 10 10:25:09.279090 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:25:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:09.696825 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-478d4b66-ed43-472a-92e5-a8610d04a8ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "swap": 0, "id": "1", "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:09.718625 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-478d4b66-ed43-472a-92e5-a8610d04a8ad admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.433368 Sep 10 10:25:09.719195 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Sep 10 10:25:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:25:09.732695 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-20c68524-bcdd-45f1-a30a-dea24221f165 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:09.759974 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-20c68524-bcdd-45f1-a30a-dea24221f165 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032168 Sep 10 10:25:09.760679 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1333 bytes} [Sat Sep 10 10:25:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:25:12.558489 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-478d4b66-ed43-472a-92e5-a8610d04a8ad admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:12.559496 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-478d4b66-ed43-472a-92e5-a8610d04a8ad admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 10 10:25:12.560008 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:25:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:12.996702 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-10e9628c-012f-48f6-ba2e-4f6fec72b001 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:13.018265 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-10e9628c-012f-48f6-ba2e-4f6fec72b001 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452102 Sep 10 10:25:13.019115 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Sep 10 10:25:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:25:13.033031 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-12cb188a-10d9-44bd-b31e-7b8333c2e0d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:13.058145 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-12cb188a-10d9-44bd-b31e-7b8333c2e0d3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030207 Sep 10 10:25:13.067815 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1333 bytes} [Sat Sep 10 10:25:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:25:15.673832 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-10e9628c-012f-48f6-ba2e-4f6fec72b001 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:15.675571 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-10e9628c-012f-48f6-ba2e-4f6fec72b001 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002511 Sep 10 10:25:15.675977 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:25:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:16.049845 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-582ee9d2-607b-4221-a078-131a2c2234be admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:16.074732 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-582ee9d2-607b-4221-a078-131a2c2234be admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.391453 Sep 10 10:25:16.075295 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Sep 10 10:25:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:25:16.087447 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-db337b33-cc3e-4e8c-9c03-8bcc07aed288 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:16.093202 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:25:16.120933 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-db337b33-cc3e-4e8c-9c03-8bcc07aed288 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037205 Sep 10 10:25:16.121575 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1333 bytes} [Sat Sep 10 10:25:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:25:18.753617 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-582ee9d2-607b-4221-a078-131a2c2234be admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:18.754825 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-582ee9d2-607b-4221-a078-131a2c2234be admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Sep 10 10:25:18.755539 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:25:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:19.190817 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-857873a7-75a7-41c1-abf0-a115437dfc99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "swap": 0, "id": "4", "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:19.213010 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-857873a7-75a7-41c1-abf0-a115437dfc99 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450414 Sep 10 10:25:19.213935 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Sep 10 10:25:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:25:19.225781 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-7065433a-2eee-4d7a-8d74-b945088d9f3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:19.251785 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-7065433a-2eee-4d7a-8d74-b945088d9f3c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029755 Sep 10 10:25:19.252668 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1333 bytes} [Sat Sep 10 10:25:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:25:21.878612 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-857873a7-75a7-41c1-abf0-a115437dfc99 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:21.879646 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-857873a7-75a7-41c1-abf0-a115437dfc99 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 10 10:25:21.880056 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:22.330002 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-5a057cc0-7c2f-4c12-9a9f-fc4d8c579528 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "id": "5"}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:22.338118 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:25:22.352750 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-5a057cc0-7c2f-4c12-9a9f-fc4d8c579528 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465823 Sep 10 10:25:22.353828 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1283 bytes} [Sat Sep 10 10:25:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:25:22.365960 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-3551bf42-d93f-4859-aa0d-ecde7adb6778 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:22.396670 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-3551bf42-d93f-4859-aa0d-ecde7adb6778 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034471 Sep 10 10:25:22.397731 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1333 bytes} [Sat Sep 10 10:25:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:25:42.877214 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-5a057cc0-7c2f-4c12-9a9f-fc4d8c579528 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:42.878263 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-5a057cc0-7c2f-4c12-9a9f-fc4d8c579528 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 10 10:25:42.878669 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:25:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:42.889212 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:25:43.266915 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-0ae751c2-3023-4ca6-ad87-f461e2901c0a admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:43.285428 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-0ae751c2-3023-4ca6-ad87-f461e2901c0a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400701 Sep 10 10:25:43.285973 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Sep 10 10:25:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:25:44.614086 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-5a057cc0-7c2f-4c12-9a9f-fc4d8c579528 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:44.615095 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-5a057cc0-7c2f-4c12-9a9f-fc4d8c579528 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 10 10:25:44.615503 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Sep 10 10:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:45.291219 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-07a976f4-de96-4541-ba47-a189eeecd201 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:45.296494 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.wsgi [None req-07a976f4-de96-4541-ba47-a189eeecd201 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-07a976f4-de96-4541-ba47-a189eeecd201 admin admin] Request method failure captured: Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: Accept: application/json Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: Accept-Encoding: gzip, deflate Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: Connection: keep-alive Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: Content-Length: 0 Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: Host: 10.222.0.20 Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: Openstack-Api-Version: compute 2.92 Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: Openstack-System-Scope: None Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: User-Agent: python-novaclient Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Auth-Token: gAAAAABjHGYoMj9InGoZG-5Ngf1Mcde_FEXOAObV8evEhO9y4s32neNc_T3XLVboW0ctt_zNQfcPaBTAUwQfQ13jT6N6GGMQdBhKyFR99R3_yKRvNlaHLX_82ZdZcPXlY96CfpgEry4RSHbkPCLdQJvCJfpXWME4UcmQknat69GjpxotxzDfTgg Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Domain-Id: None Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Domain-Name: None Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Identity-Status: Confirmed Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Is-Admin-Project: True Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Domain-Id: default Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Domain-Name: Default Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Name: admin Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Role: member,admin,reader Sep 10 10:25:45.299727 n-d-856894-1 devstack@n-api.service[106290]: X-Roles: member,admin,reader Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cbf851c5bbb74ad091efb7d37d9ec443", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: X-Tenant: admin Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: X-Tenant-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: X-Tenant-Name: admin Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: X-User: admin Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: X-User-Domain-Id: default Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: X-User-Domain-Name: Default Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: X-User-Id: 9e1c19a16dcb45d3be6a190c36463b94 Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: X-User-Name: admin Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: method: > Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: exception: Flavor 42 could not be found. Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: action_args: {'id': '42'} Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:25:45.301435 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:45.302620 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:45.304095 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-07a976f4-de96-4541-ba47-a189eeecd201 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:25:45.305459 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-07a976f4-de96-4541-ba47-a189eeecd201 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.519149 Sep 10 10:25:45.305459 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Sep 10 10:25:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 520 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:25:45.311228 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-43883b42-a6c4-4de7-947b-b612389b504e admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:45.333467 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-43883b42-a6c4-4de7-947b-b612389b504e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026152 Sep 10 10:25:45.333985 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Sep 10 10:25:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:25:45.349285 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-51bc13ff-f7eb-4308-a13f-fa287aca90aa admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:45.371089 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-51bc13ff-f7eb-4308-a13f-fa287aca90aa admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026399 Sep 10 10:25:45.371640 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Sep 10 10:25:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:25:45.381044 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-4a7a376f-56c4-47bb-8a5e-d7e2ed5b1a1c admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:45.386784 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.wsgi [None req-4a7a376f-56c4-47bb-8a5e-d7e2ed5b1a1c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-4a7a376f-56c4-47bb-8a5e-d7e2ed5b1a1c admin admin] Request method failure captured: Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: Accept: application/json Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: Accept-Encoding: gzip, deflate Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: Connection: keep-alive Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: Content-Length: 0 Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: Host: 10.222.0.20 Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: Openstack-Api-Version: compute 2.92 Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: Openstack-System-Scope: None Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: User-Agent: python-novaclient Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Auth-Token: gAAAAABjHGYoMj9InGoZG-5Ngf1Mcde_FEXOAObV8evEhO9y4s32neNc_T3XLVboW0ctt_zNQfcPaBTAUwQfQ13jT6N6GGMQdBhKyFR99R3_yKRvNlaHLX_82ZdZcPXlY96CfpgEry4RSHbkPCLdQJvCJfpXWME4UcmQknat69GjpxotxzDfTgg Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Domain-Id: None Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Domain-Name: None Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Identity-Status: Confirmed Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Is-Admin-Project: True Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Domain-Id: default Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Domain-Name: Default Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Name: admin Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Role: member,admin,reader Sep 10 10:25:45.390014 n-d-856894-1 devstack@n-api.service[106289]: X-Roles: member,admin,reader Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cbf851c5bbb74ad091efb7d37d9ec443", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: X-Tenant: admin Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: X-Tenant-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: X-Tenant-Name: admin Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: X-User: admin Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: X-User-Domain-Id: default Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: X-User-Domain-Name: Default Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: X-User-Id: 9e1c19a16dcb45d3be6a190c36463b94 Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: X-User-Name: admin Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: method: > Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: exception: Flavor 42 could not be found. Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: action_args: {'id': '42'} Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:25:45.391556 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:45.392429 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:45.393913 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-4a7a376f-56c4-47bb-8a5e-d7e2ed5b1a1c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:25:45.395172 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-4a7a376f-56c4-47bb-8a5e-d7e2ed5b1a1c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013926 Sep 10 10:25:45.395172 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Sep 10 10:25:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 10 10:25:46.603819 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-51bc13ff-f7eb-4308-a13f-fa287aca90aa admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:46.604841 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-51bc13ff-f7eb-4308-a13f-fa287aca90aa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 10 10:25:46.605282 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Sep 10 10:25:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:47.122715 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-162ead9f-946a-4663-80fb-d204dde5ac6a admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:47.128170 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.wsgi [None req-162ead9f-946a-4663-80fb-d204dde5ac6a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-162ead9f-946a-4663-80fb-d204dde5ac6a admin admin] Request method failure captured: Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: Accept: application/json Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: Accept-Encoding: gzip, deflate Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: Connection: keep-alive Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: Content-Length: 0 Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: Host: 10.222.0.20 Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: Openstack-Api-Version: compute 2.92 Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: Openstack-System-Scope: None Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: User-Agent: python-novaclient Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Auth-Token: gAAAAABjHGYqczwM8Y6wbDh3SdYza4LUWbcabJY9rolHkyB-r8nPIwOSM0v2oLuxlOd0UOGmf18fzYJqI5EhJDK18NGZGYIAzVlwqzCEj16yE1dzs8FzbO73jnYS7Gbo4bDkCLe304gM78NpNObdgG-3VKdlPECpmod5_3U3gW-kkP9wrmAJ6FM Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Domain-Id: None Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Domain-Name: None Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Identity-Status: Confirmed Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Is-Admin-Project: True Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Domain-Id: default Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Domain-Name: Default Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Name: admin Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Role: member,admin,reader Sep 10 10:25:47.129693 n-d-856894-1 devstack@n-api.service[106289]: X-Roles: member,admin,reader Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cbf851c5bbb74ad091efb7d37d9ec443", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: X-Tenant: admin Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: X-Tenant-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: X-Tenant-Name: admin Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: X-User: admin Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: X-User-Domain-Id: default Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: X-User-Domain-Name: Default Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: X-User-Id: 9e1c19a16dcb45d3be6a190c36463b94 Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: X-User-Name: admin Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: method: > Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: exception: Flavor 84 could not be found. Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: action_args: {'id': '84'} Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:25:47.131236 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:47.132157 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:47.134355 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-162ead9f-946a-4663-80fb-d204dde5ac6a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:25:47.136511 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-162ead9f-946a-4663-80fb-d204dde5ac6a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386966 Sep 10 10:25:47.136511 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Sep 10 10:25:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 10 10:25:47.141440 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-f9f1fb99-88fc-43c3-b50c-d1dd28479642 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:47.156082 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-f9f1fb99-88fc-43c3-b50c-d1dd28479642 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018201 Sep 10 10:25:47.156794 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Sep 10 10:25:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:25:47.165931 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-b6dd55f3-240a-4280-9b9b-7a6c1d69f947 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:47.182938 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-b6dd55f3-240a-4280-9b9b-7a6c1d69f947 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020372 Sep 10 10:25:47.183501 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Sep 10 10:25:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:25:47.193224 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-a169b85b-2d9b-4d21-b6e5-0491792db819 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:47.200218 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.wsgi [None req-a169b85b-2d9b-4d21-b6e5-0491792db819 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-a169b85b-2d9b-4d21-b6e5-0491792db819 admin admin] Request method failure captured: Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: Accept: application/json Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: Accept-Encoding: gzip, deflate Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: Connection: keep-alive Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: Content-Length: 0 Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: Host: 10.222.0.20 Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: Openstack-Api-Version: compute 2.92 Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: Openstack-System-Scope: None Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: User-Agent: python-novaclient Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Auth-Token: gAAAAABjHGYqczwM8Y6wbDh3SdYza4LUWbcabJY9rolHkyB-r8nPIwOSM0v2oLuxlOd0UOGmf18fzYJqI5EhJDK18NGZGYIAzVlwqzCEj16yE1dzs8FzbO73jnYS7Gbo4bDkCLe304gM78NpNObdgG-3VKdlPECpmod5_3U3gW-kkP9wrmAJ6FM Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Domain-Id: None Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Domain-Name: None Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Identity-Status: Confirmed Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Is-Admin-Project: True Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Domain-Id: default Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Domain-Name: Default Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Name: admin Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Role: member,admin,reader Sep 10 10:25:47.201839 n-d-856894-1 devstack@n-api.service[106290]: X-Roles: member,admin,reader Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cbf851c5bbb74ad091efb7d37d9ec443", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: X-Tenant: admin Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: X-Tenant-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: X-Tenant-Name: admin Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: X-User: admin Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: X-User-Domain-Id: default Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: X-User-Domain-Name: Default Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: X-User-Id: 9e1c19a16dcb45d3be6a190c36463b94 Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: X-User-Name: admin Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: method: > Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: exception: Flavor 84 could not be found. Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: action_args: {'id': '84'} Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:25:47.203461 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:47.204417 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:47.205789 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-a169b85b-2d9b-4d21-b6e5-0491792db819 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:25:47.207195 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-a169b85b-2d9b-4d21-b6e5-0491792db819 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013661 Sep 10 10:25:47.207195 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Sep 10 10:25:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:25:48.423115 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-b6dd55f3-240a-4280-9b9b-7a6c1d69f947 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:48.424120 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-b6dd55f3-240a-4280-9b9b-7a6c1d69f947 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 10 10:25:48.424512 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Sep 10 10:25:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:48.956851 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-1412c957-c4f4-44d8-8eb7-9c9e6e0685c1 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:48.963292 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.wsgi [None req-1412c957-c4f4-44d8-8eb7-9c9e6e0685c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-1412c957-c4f4-44d8-8eb7-9c9e6e0685c1 admin admin] Request method failure captured: Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: Accept: application/json Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: Accept-Encoding: gzip, deflate Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: Connection: keep-alive Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: Content-Length: 0 Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: Host: 10.222.0.20 Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: Openstack-Api-Version: compute 2.92 Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: Openstack-System-Scope: None Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: User-Agent: python-novaclient Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Auth-Token: gAAAAABjHGYsKRmTrEjNQGYalCO3HV1p_R0v-eeYnGbDJTZwULL2ubz0Shj8l9RrP5L73ykSjwvz2A5-3RvCkEXduev67dKgYa8TRURW9q2eF0zuzzPGdDqo-WERb2VLOTmtCAQk_vvVlcZVkt3ahgdfh2ukpnKkZqNGEIkCf5C4v7-DdUkPYNs Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Domain-Id: None Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Domain-Name: None Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Identity-Status: Confirmed Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Is-Admin-Project: True Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Domain-Id: default Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Domain-Name: Default Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Project-Name: admin Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Role: member,admin,reader Sep 10 10:25:48.964812 n-d-856894-1 devstack@n-api.service[106290]: X-Roles: member,admin,reader Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cbf851c5bbb74ad091efb7d37d9ec443", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: X-Tenant: admin Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: X-Tenant-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: X-Tenant-Name: admin Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: X-User: admin Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: X-User-Domain-Id: default Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: X-User-Domain-Name: Default Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: X-User-Id: 9e1c19a16dcb45d3be6a190c36463b94 Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: X-User-Name: admin Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: method: > Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: exception: Flavor 451 could not be found. Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: action_args: {'id': '451'} Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:25:48.966349 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:48.967323 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: ERROR nova.api.openstack.wsgi Sep 10 10:25:48.968382 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-1412c957-c4f4-44d8-8eb7-9c9e6e0685c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:25:48.969393 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-1412c957-c4f4-44d8-8eb7-9c9e6e0685c1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.405302 Sep 10 10:25:48.969393 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Sep 10 10:25:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:25:48.976030 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-02f6b172-5aa7-4d12-8b1d-1d3db1300d02 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:48.991605 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-02f6b172-5aa7-4d12-8b1d-1d3db1300d02 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019209 Sep 10 10:25:48.992125 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Sep 10 10:25:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:25:49.001472 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:49.016635 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018720 Sep 10 10:25:49.017182 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Sep 10 10:25:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:25:49.026742 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-77d4ec28-4fe4-4fed-8b57-7bb72ededf39 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:49.031630 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.wsgi [None req-77d4ec28-4fe4-4fed-8b57-7bb72ededf39 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-77d4ec28-4fe4-4fed-8b57-7bb72ededf39 admin admin] Request method failure captured: Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: Accept: application/json Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: Accept-Encoding: gzip, deflate Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: Connection: keep-alive Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: Content-Length: 0 Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: Host: 10.222.0.20 Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: Openstack-Api-Version: compute 2.92 Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: Openstack-System-Scope: None Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: User-Agent: python-novaclient Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Auth-Token: gAAAAABjHGYsKRmTrEjNQGYalCO3HV1p_R0v-eeYnGbDJTZwULL2ubz0Shj8l9RrP5L73ykSjwvz2A5-3RvCkEXduev67dKgYa8TRURW9q2eF0zuzzPGdDqo-WERb2VLOTmtCAQk_vvVlcZVkt3ahgdfh2ukpnKkZqNGEIkCf5C4v7-DdUkPYNs Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Domain-Id: None Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Domain-Name: None Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Identity-Status: Confirmed Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Is-Admin-Project: True Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Domain-Id: default Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Domain-Name: Default Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Project-Name: admin Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Role: member,admin,reader Sep 10 10:25:49.033405 n-d-856894-1 devstack@n-api.service[106289]: X-Roles: member,admin,reader Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbf851c5bbb74ad091efb7d37d9ec443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cbf851c5bbb74ad091efb7d37d9ec443", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: X-Tenant: admin Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: X-Tenant-Id: cbf851c5bbb74ad091efb7d37d9ec443 Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: X-Tenant-Name: admin Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: X-User: admin Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: X-User-Domain-Id: default Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: X-User-Domain-Name: Default Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: X-User-Id: 9e1c19a16dcb45d3be6a190c36463b94 Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: X-User-Name: admin Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: method: > Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: exception: Flavor 451 could not be found. Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: action_args: {'id': '451'} Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:25:49.035032 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:49.035997 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: ERROR nova.api.openstack.wsgi Sep 10 10:25:49.037051 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-77d4ec28-4fe4-4fed-8b57-7bb72ededf39 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:25:49.038082 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-77d4ec28-4fe4-4fed-8b57-7bb72ededf39 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012138 Sep 10 10:25:49.038082 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Sep 10 10:25:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 10 10:25:50.228913 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:50.229946 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 10 10:25:50.230340 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Sep 10 10:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:50.758112 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-4fd408fd-de88-479b-a4bf-019c842a3592 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:50.778559 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-4fd408fd-de88-479b-a4bf-019c842a3592 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.413978 Sep 10 10:25:50.779170 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Sep 10 10:25:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:25:51.995177 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:51.996181 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 10 10:25:51.996573 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Sep 10 10:25:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:52.512029 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-16003c45-c32b-4586-8345-21cfc64ba81d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:52.530615 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-16003c45-c32b-4586-8345-21cfc64ba81d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.397129 Sep 10 10:25:52.531163 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Sep 10 10:25:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:25:53.738884 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:53.739888 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 10 10:25:53.740280 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Sep 10 10:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:54.254160 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-56b90b66-4dba-42e2-bbc8-b9df47143bc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:54.272182 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-56b90b66-4dba-42e2-bbc8-b9df47143bc8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.395905 Sep 10 10:25:54.272745 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Sep 10 10:25:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:25:55.488678 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:55.489830 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 10 10:25:55.490219 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Sep 10 10:25:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:56.014220 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-449952eb-0841-4107-8a78-9f9d62cbe423 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:25:56.033227 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-449952eb-0841-4107-8a78-9f9d62cbe423 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.406063 Sep 10 10:25:56.033765 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Sep 10 10:25:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 10:25:57.236588 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:57.237649 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 10 10:25:57.238079 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Sep 10 10:25:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:25:57.752351 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-c90c6717-e210-4577-973e-e191cbf74f01 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:25:57.772700 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-c90c6717-e210-4577-973e-e191cbf74f01 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397673 Sep 10 10:25:57.773256 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Sat Sep 10 10:25:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:26:54.192880 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:26:54.193845 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-ec7025ec-5adc-49e4-be31-3e1d97ebb652 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 10 10:26:54.194248 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 931 bytes} [Sat Sep 10 10:26:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:26:54.204822 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:26:54.583506 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-89bbf642-80b9-487a-8b47-e500a5a2f81d admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:26:54.603720 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-89bbf642-80b9-487a-8b47-e500a5a2f81d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403335 Sep 10 10:26:54.604258 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Sep 10 10:26:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:26:54.625341 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writing DB stats nova_api:SELECT=14 {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:26:54.629945 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-c308daab-4b3b-4d63-9d27-f3d46c06f30b admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:26:54.637171 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-c308daab-4b3b-4d63-9d27-f3d46c06f30b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013331 Sep 10 10:26:54.637691 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1283 bytes} [Sat Sep 10 10:26:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:26:54.649713 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-8113f361-aa25-48d9-a4ba-ba9517159bda admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:26:54.657383 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-8113f361-aa25-48d9-a4ba-ba9517159bda admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011275 Sep 10 10:26:54.657895 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1286 bytes} [Sat Sep 10 10:26:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:26:54.669567 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-01245e77-52c7-431c-9e67-34eafb2b4061 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:26:54.676905 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-01245e77-52c7-431c-9e67-34eafb2b4061 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010895 Sep 10 10:26:54.677475 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1286 bytes} [Sat Sep 10 10:26:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:26:54.688746 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-b4178694-2a1f-4294-add4-1eb4ce6c7c87 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:26:54.696108 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-b4178694-2a1f-4294-add4-1eb4ce6c7c87 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010934 Sep 10 10:26:54.696625 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1283 bytes} [Sat Sep 10 10:26:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:32:18.295664 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-01245e77-52c7-431c-9e67-34eafb2b4061 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:32:18.296674 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-01245e77-52c7-431c-9e67-34eafb2b4061 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 10 10:32:18.297578 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Sep 10 10:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:32:18.439375 n-d-856894-1 devstack@n-api.service[106289]: DEBUG dbcounter [-] [106289] Writing DB stats nova_api:SELECT=6 {{(pid=106289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:32:18.587755 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-922b8e65-5f04-4343-977f-6eec2e338b83 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:32:18.592468 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-922b8e65-5f04-4343-977f-6eec2e338b83 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:32:18.592943 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-922b8e65-5f04-4343-977f-6eec2e338b83 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:32:18.593409 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-922b8e65-5f04-4343-977f-6eec2e338b83 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:32:18.594144 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-922b8e65-5f04-4343-977f-6eec2e338b83 admin admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:32:18.594589 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-922b8e65-5f04-4343-977f-6eec2e338b83 admin admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:32:18.595006 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-922b8e65-5f04-4343-977f-6eec2e338b83 admin admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:32:18.633081 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-922b8e65-5f04-4343-977f-6eec2e338b83 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.195446 Sep 10 10:32:18.633653 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Sep 10 10:32:18 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:32:19.702949 n-d-856894-1 devstack@n-api.service[106290]: DEBUG nova.api.openstack.wsgi [None req-01245e77-52c7-431c-9e67-34eafb2b4061 admin admin] Calling method '>' {{(pid=106290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:32:19.703990 n-d-856894-1 devstack@n-api.service[106290]: INFO nova.api.openstack.requestlog [None req-01245e77-52c7-431c-9e67-34eafb2b4061 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 10 10:32:19.704418 n-d-856894-1 devstack@n-api.service[106290]: [pid: 106290|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Sep 10 10:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:32:19.894449 n-d-856894-1 devstack@n-api.service[106289]: DEBUG nova.api.openstack.wsgi [None req-e37e496a-e224-4411-9e36-774f85c75690 admin admin] Calling method '>' {{(pid=106289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:32:19.897898 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-e37e496a-e224-4411-9e36-774f85c75690 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:32:19.898377 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-e37e496a-e224-4411-9e36-774f85c75690 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:32:19.898806 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-e37e496a-e224-4411-9e36-774f85c75690 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:32:19.899519 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-e37e496a-e224-4411-9e36-774f85c75690 admin admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:32:19.899965 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-e37e496a-e224-4411-9e36-774f85c75690 admin admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:32:19.900381 n-d-856894-1 devstack@n-api.service[106289]: DEBUG oslo_concurrency.lockutils [None req-e37e496a-e224-4411-9e36-774f85c75690 admin admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:32:19.923856 n-d-856894-1 devstack@n-api.service[106289]: INFO nova.api.openstack.requestlog [None req-e37e496a-e224-4411-9e36-774f85c75690 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.079878 Sep 10 10:32:19.924335 n-d-856894-1 devstack@n-api.service[106289]: [pid: 106289|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Sep 10 10:32:19 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:33:04.898958 n-d-856894-1 devstack@n-api.service[106288]: Sat Sep 10 10:33:04 2022 - graceful shutdown triggered... Sep 10 10:33:04.899101 n-d-856894-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 10 10:33:04.899922 n-d-856894-1 devstack@n-api.service[106289]: Gracefully killing worker 1 (pid: 106289)... Sep 10 10:33:04.900318 n-d-856894-1 devstack@n-api.service[106290]: Gracefully killing worker 2 (pid: 106290)... Sep 10 10:33:05.031438 n-d-856894-1 devstack@n-api.service[106290]: DEBUG dbcounter [-] [106290] Writing DB stats nova_api:SELECT=4 {{(pid=106290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:33:05.900803 n-d-856894-1 devstack@n-api.service[106288]: worker 1 buried after 1 seconds Sep 10 10:33:05.901267 n-d-856894-1 devstack@n-api.service[106288]: worker 2 buried after 1 seconds Sep 10 10:33:05.901267 n-d-856894-1 devstack@n-api.service[106288]: goodbye to uWSGI. Sep 10 10:33:05.902433 n-d-856894-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 10 10:33:05.903029 n-d-856894-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 10 10:33:05.906126 n-d-856894-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 10 10:33:05.919265 n-d-856894-1 devstack@n-api.service[128776]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 10 10:33:05 2022] *** Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: nodename: n-d-856894-1 Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: machine: x86_64 Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: clock source: unix Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: pcre jit disabled Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: detected number of CPU cores: 4 Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: current working directory: / Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: detected binary path: /usr/bin/uwsgi-core Sep 10 10:33:05.939231 n-d-856894-1 devstack@n-api.service[128776]: your processes number limit is 47680 Sep 10 10:33:05.940103 n-d-856894-1 devstack@n-api.service[128776]: your memory page size is 4096 bytes Sep 10 10:33:05.940103 n-d-856894-1 devstack@n-api.service[128776]: detected max file descriptor number: 2048 Sep 10 10:33:05.940103 n-d-856894-1 devstack@n-api.service[128776]: lock engine: pthread robust mutexes Sep 10 10:33:05.940103 n-d-856894-1 devstack@n-api.service[128776]: thunder lock: enabled Sep 10 10:33:05.940103 n-d-856894-1 devstack@n-api.service[128776]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 10 10:33:05.940103 n-d-856894-1 devstack@n-api.service[128776]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 10 10:33:05.979292 n-d-856894-1 devstack@n-api.service[128776]: Python main interpreter initialized at 0x55cf3b5e99c0 Sep 10 10:33:05.979292 n-d-856894-1 devstack@n-api.service[128776]: python threads support enabled Sep 10 10:33:05.979292 n-d-856894-1 devstack@n-api.service[128776]: your server socket listen backlog is limited to 100 connections Sep 10 10:33:05.979292 n-d-856894-1 devstack@n-api.service[128776]: your mercy for graceful operations on workers is 90 seconds Sep 10 10:33:05.979706 n-d-856894-1 devstack@n-api.service[128776]: mapped 403077 bytes (393 KB) for 2 cores Sep 10 10:33:05.979706 n-d-856894-1 devstack@n-api.service[128776]: *** Operational MODE: preforking *** Sep 10 10:33:05.979872 n-d-856894-1 devstack@n-api.service[128776]: *** uWSGI is running in multiple interpreter mode *** Sep 10 10:33:05.979872 n-d-856894-1 devstack@n-api.service[128776]: spawned uWSGI master process (pid: 128776) Sep 10 10:33:05.980083 n-d-856894-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 10 10:33:05.980668 n-d-856894-1 devstack@n-api.service[128776]: spawned uWSGI worker 1 (pid: 128787, cores: 1) Sep 10 10:33:05.981254 n-d-856894-1 devstack@n-api.service[128776]: spawned uWSGI worker 2 (pid: 128788, cores: 1) Sep 10 10:33:05.981586 n-d-856894-1 devstack@n-api.service[128776]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 10 10:33:06.661636 n-d-856894-1 devstack@n-api.service[128788]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 10:33:06.663660 n-d-856894-1 devstack@n-api.service[128787]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 10:33:07.829209 n-d-856894-1 devstack@n-api.service[128787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 10:33:07.829209 n-d-856894-1 devstack@n-api.service[128787]: from cryptography.utils import int_from_bytes Sep 10 10:33:07.830002 n-d-856894-1 devstack@n-api.service[128788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 10:33:07.830002 n-d-856894-1 devstack@n-api.service[128788]: from cryptography.utils import int_from_bytes Sep 10 10:33:07.830443 n-d-856894-1 devstack@n-api.service[128787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 10:33:07.830443 n-d-856894-1 devstack@n-api.service[128787]: from cryptography.utils import int_from_bytes Sep 10 10:33:07.830596 n-d-856894-1 devstack@n-api.service[128788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 10:33:07.830596 n-d-856894-1 devstack@n-api.service[128788]: from cryptography.utils import int_from_bytes Sep 10 10:33:10.257184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 10:33:10.257946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 10:33:10.258051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 10:33:10.258358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 10:33:10.258617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 10:33:10.259014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.259346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.259675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.260001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.260338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.260656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.260986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.261354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.261691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.261956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.262281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.262779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-856894-1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.263110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.263428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.263747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.264078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.264386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.264715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.265026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.265575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.266030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.266922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.267286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.267589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.267914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.268232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.268560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.268875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.269236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.269553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.269972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-856894-1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.270301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.270621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.270944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.271382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.271699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.272018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.272347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.272717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.273034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.273391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.273721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.274047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.274374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.274702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.274998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.275317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.275647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.275961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.276276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.276532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.276847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.277200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.277533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.277864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.278123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.278377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.278701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.279028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.279344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.279657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.280223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.280536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.280846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.281183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.281495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.281851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.282182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.282505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.282833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.283147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.283471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.283891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.284145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.284459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.284809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.285154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.285468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.285798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.286124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.286436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.286749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.287059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.287385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.287729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.288056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.288298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.288608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.288920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.289269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.289579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.289890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.290201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.290507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.290819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.291130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.291441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.291751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.292065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.292381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.292691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.293000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.293337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.293646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.293976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.294299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.294612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.294920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.295230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.295543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.295867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.296178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.296488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.296815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.297147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.297514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.297842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.298155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.298466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.298790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.299096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.299409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.299732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.300044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.300356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.300666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.300974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.301312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.301621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.301928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.302237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.302543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.302867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.303193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.303509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.303821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.304127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.304449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.304799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.305158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.305508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.305831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.306168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.306501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.306824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.307142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.307461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.307797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.308112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.308428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.308745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.309098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.309410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.309746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.310068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.310386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.310708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.311024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.311348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.311681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.312010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.312327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.312674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.313655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.313984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.314317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.314652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.315021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.315286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.315603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.315807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 10:33:10.316243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.316340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 10:33:10.316434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.316575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 10:33:10.316696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.316901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.316994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 10:33:10.317200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 10:33:10.317294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.317560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.317665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.317880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.317974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.318198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.318291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.318513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.318624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.318829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.318921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.319138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.319241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.319458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.319552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.319777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.319870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.320102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.320194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.320360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.320454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.320673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.320777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.321038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.321169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-856894-1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.321380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.321474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.321696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.321800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.322013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.322105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.322324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.322426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.322635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.322781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.322944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.323051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.323246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.323346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.323556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.323757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.323867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.324070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.324201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.324376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.324513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.324685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.324854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.325022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.325204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.325364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.325495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.325671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.325812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.326009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.326153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.326298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.326431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.326617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.326795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.326925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.327060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.327322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-856894-1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.327414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.327637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.327740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.327948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.328042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.328262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.328354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.328638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.329306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.329490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.329588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.329806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.329916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.330128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.330231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.330447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.330546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.330765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.330871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.331083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.331183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.331398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.331499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.331714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.331823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.332034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.332134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.332335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.332434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.332641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.332747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.332950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.333045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.333290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.333397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.333595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.333700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.333901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.333999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.334149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.334248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.334455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.334556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.334774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.334873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.335110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.335343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.335509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.335608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.335694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.335778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.335884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.336053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.336201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.336363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.336518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.336674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.336828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.336986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.337156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.337325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.337462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.337634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.337768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.337960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.338073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.338275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.338382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.338586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.338679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.338896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.338997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.339205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.339355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.339554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.339654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.339865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.339966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.340167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.340267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.340484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.340576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.340854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.340954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.341140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.341250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.341449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.341548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.341785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.341885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.342100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.342194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.342407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.342508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.342723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.342828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.343039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.343136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.343344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.343444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.343650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.343743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.343955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.344056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.344301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.344402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.344629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.344737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.344934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.345034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.345207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.345384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.345592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.345688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.345797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.345890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.346113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.346215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.346466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.346561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.346773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.346874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.347077 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.347183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.347375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.347499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.347680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.347818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.347983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.348132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.348286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.348449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.348709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.348817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.348978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.349095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.349914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.350107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.350268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.350423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.350619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.350767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.350917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.351060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.351209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.351353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.351503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.351655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.351798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.351951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.352093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.352261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.352414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.352557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.352698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.352854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.353006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.353191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.353345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.353495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.353719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.353874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.354044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.354150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.354237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.354321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.354430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.354430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.354613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.354901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.355038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.355211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.355356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.355581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.355732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.355905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.355999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.356237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.356340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.356566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.356670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.356875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.356967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.357213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.357323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.357519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.357613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.357823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.357921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.358127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.358230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.358431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.358524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.358733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.358871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.359035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.359130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.359335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.359426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.359653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.359756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.360002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.360098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.360312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.360404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.360618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.360723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.360927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.361018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.361280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 10:33:10.361388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.361595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.361695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.361909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.362009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.362221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.362323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.362531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.362638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.362884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.362985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.363202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.363296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.363514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.363616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.363825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.363962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.364142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.364269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.364457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.364559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.364769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.364860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.365111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.365207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.365411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.365555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.365764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.365876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.366041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.366141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.366357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.366450 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.366673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.366763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.366988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.367079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.367301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.367400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.367609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.367701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.367927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.368032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.368240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.368389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.368558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.368653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.368867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.369007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.369198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.369292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.369519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.369658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.369846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.369949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.370172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.370434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.370526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.370776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.370876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.371097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.371191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.371405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.371496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.371749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.371850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.372061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.372168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.372372 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.372509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.372692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.372786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.373002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.373146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.373350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.373460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.373663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.373766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.373973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.374104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.374285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.374389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.374597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.374690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.374908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.375008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.375222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.375314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.376064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.376203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.376379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.376475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.376691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.376792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.377000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.377186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.377339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.377648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.381111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.381280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.381394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.381486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.381574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.381675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.381763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.381854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.381939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.382972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.383067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.383159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.383251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.383345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.383437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.383533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.383626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.383718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.383865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.383954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.384943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.385037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.385142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.385241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.385381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.385504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.385504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.385718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.385840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.385958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.386098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.386299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.386424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.386542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.386667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.386779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.386902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.387014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.387131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.387248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.387523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.387664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.387786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.387898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.388048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.388169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.388364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.388494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.388686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.388808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.388999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.389149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.389341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.389501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.389651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.389791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.389974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.390118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.390286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.390445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.390596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.390764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.390906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.391094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.391768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.391994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.392095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.392305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.392399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.392612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.392712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.392963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.393057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.393405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.393500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.393718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.394060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.394195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.394472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.394689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.394796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.395006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.395119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.395318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.395647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.395735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.395963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.396115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.396343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.396446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.396587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.396846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.397170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.397381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.397716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.397874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.398022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.398163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.398395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.398541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.398762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.398959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.399347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.399555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.399896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.400054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.400229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.400558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.400651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.400881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.400982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.401226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.401332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.401548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.401642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.401872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.401975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.402201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.402304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.402517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.402610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.402834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.402941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.403149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.403242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.403482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.403584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.403799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.403906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.404123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.404216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.404470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.404576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.405057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.405192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.405399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.405529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.405721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.405868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.406053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.406194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.406385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.406534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.406719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.406852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.407045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.407171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.407370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.407502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.407685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.407813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.407999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.408102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.408326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.408422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.408649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.408743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.408969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.409064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.409327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.409424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.409637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.409740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.409963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.410102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.410274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.410374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.410591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.410696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.410898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.410999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.411212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.411305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.411531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.411638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.411850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.411951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.412166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.412266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.412482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.412591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.412799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.412891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.413208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.413309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.413442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.413549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.413755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.413848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.414061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.414161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.414369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.414463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.414680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.414811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.415013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.415116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.415332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.415477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.415646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.415780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.415961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.416089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.416350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.416482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.416595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.416705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.416892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.417018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.417258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.417389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.417575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.417702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.417899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.418034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.418211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.418340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.418536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.418656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.418858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.418989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.419165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.419295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.419471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.419593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.419795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.419926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.420169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.420302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.420414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.420525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.420699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.420830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.421004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.421146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.421376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.421506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.421691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.421829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.421996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.422117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.422329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.422460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.422751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.422861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.422956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.423058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.423280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.423374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.423594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.423691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.423903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.424003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.424232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.424326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.424563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.424664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.424873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.424967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.425282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.425396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.425600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.425695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.425915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.426009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.426271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.426376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.426599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.426700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.426912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.427006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.427224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.427329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.427536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.427630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.427843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.427945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.428156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.428263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.428476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.428578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.428803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.429065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.429192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.429457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.429553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.429770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.429872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.430102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.430232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.430434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.430539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.430752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.430904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.431111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.431247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.431473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.431568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.431798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.431900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.432127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.432224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.432455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.432602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.432790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.432924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.433122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.433233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.433437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.433539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.433756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.433855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.434070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.434180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.434382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.434711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.434817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.435023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.435124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.435342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.435444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.435661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.435801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.435975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.436112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.436283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.436375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.436593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.436725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.436925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.437238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.437349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.437566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.437686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.437879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.438513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.438724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.438855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.439052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.439183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.439363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.439468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.439692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.439799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.440008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.440121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.440319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.440414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.440630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.440939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.441374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.441639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.441742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.441829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.441929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.442017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.442200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.442306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.442454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.442549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.442764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.442857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.443098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.443352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.443538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.443635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.443721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.443853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.444007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.444121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.444294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.444446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.444606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.444778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.444910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.445107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.445255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.445421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.445571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.445738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.445885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.446049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.446200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.446359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.446507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.446677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.446817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.446991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.447123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.447299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.447440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.447607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.447754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.447915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.448062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.448240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.448369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.448548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.448681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.448875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.448976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.449222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.449337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.449536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.449631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.449845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.449938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.450152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.450255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.450500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.450664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.450804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.450897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.451113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.451206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.451428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.451532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.451738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.451843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.452045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.452147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.452367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.452474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.452679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.452772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.452987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.453126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.453320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.453414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.453697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.454306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.454544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.454649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.454862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.454957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.455184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.455286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.455504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.455607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.455823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.455929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.456132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.456388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.456490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.456730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.456835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.457036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.457231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.457368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.457462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.457678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.457772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.457983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.458085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.458287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.458387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.458593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.458687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.458897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.458998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.459201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.459303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.459516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.459609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.459824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.459917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.460130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.460236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.460437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.460540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.460740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.460834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.461108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.461254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.461421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.461533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.461769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.461872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.462084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.462187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.462409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.462516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.462735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.462856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.463051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.463152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.463365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.463467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.463685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.463778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.463992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.464092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.464307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.464408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.464621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.464714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.464937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.465031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.465278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.465380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.465594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.465688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.465907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.466001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.466225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.466368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.466550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.466654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.466880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.467026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.467927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.468071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.468193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.468306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.468422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.468543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.468656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.468766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.468877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.468987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.468987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.469373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.469507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.469644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.469783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.469922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.470065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.470314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.470454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.470721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.470872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.471004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.471278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.471421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.471590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.471820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.471970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.472197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.472343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.472509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.472645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.472818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.472951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.473285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.473423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.473604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.473701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.473915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.474020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.474240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.474357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.474546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.474642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.474933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.475084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.475245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.475439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.475563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.475759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.475874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.476091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.476312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.476406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.476628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.476730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.476942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.477044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.477277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.477375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.477592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.477685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.477906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.478008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.478223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.478318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.478539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.478641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.478844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.478946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.479167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.479259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.479482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.479582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.479793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.479897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.480100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.480193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.480416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.480509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.480724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.481048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.481220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.481335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.481430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.481529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.481674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.481779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.481987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.482128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.482295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.482424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.482603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.482741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.482912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.483004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.483219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.483312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.483525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.483627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.483842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.483936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.484150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.484252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.484557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.484651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.484894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.485000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.485237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.485352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.485602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.485697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.485919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.486021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.486229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.486333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.486551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.486644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.486859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.486952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.487168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.487271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.487487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.487579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.487802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.487903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.488112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.488213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.488429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.488524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.488737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.488840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.489062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.489184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.489407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.489512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.489726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.489945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.490055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.490285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.490457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.490608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.490781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.490945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.491095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.491281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.491419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.491593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.491747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.491893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.492054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.492185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.492368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.492513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.492679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.492829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.492986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.493184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.493330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.493502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.493655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.493819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.493962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.494135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.494277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.494449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.494588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.494765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.494927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.495081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.495239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.495378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.495546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.495678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.495911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.496045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.496217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.496338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.496538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.496855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.497207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.497364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.497532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.497760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.497870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.498120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.498227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.498442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.498547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.498748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.498860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.499052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.499173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.499352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.499524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.499874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.509980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.510942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.511942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.512019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.512091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.512170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.512265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.512363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.513007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.513215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.513300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.513393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.539165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.539525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.539760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.540381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.547576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.547576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.547896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.548034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.548182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.548313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.548453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.548585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.548713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.548857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.548987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.549158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.549295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.549424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.549551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.549679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.549807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.549954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.550085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.550213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.550433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.550571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.550812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.550953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.551083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.551383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.551532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.551671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.551846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.552021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.552153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.552281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.552409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.552544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.552674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.552824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.552955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.553117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.553270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.553450 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.553625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.553761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.553902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.554032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.554171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.554303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.554472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.554602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.554731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.554860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.554999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.555289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.555592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.555802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.555939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.556080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.556288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.556673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.556814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.556945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.557092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.557292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.557292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.557958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.558091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.558221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.558352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.558352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.558622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.558864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.559038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.559185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.559330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.559461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.559591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.559721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.559851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.559990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.560122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.560252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.560393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.560682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.560825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.560990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.561164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.561300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.561492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.561676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.561808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.561938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.562068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.562198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.562347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.562481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.562610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.562740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.562869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.563516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.563708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.563887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.564140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.564239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.564318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.564387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.564512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.564662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.564795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.564947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.565175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.565425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.565823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.566035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.566173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.566353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.566489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.566900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.567066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.567202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.567334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.567465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.567596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.567927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.568071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.568203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.568334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.568334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.568334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.568707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.568842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.568984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.569144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.569283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.569414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.569556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.569689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.569822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.569953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.570083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.570214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.570353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.570486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.570631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.570851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.570990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.571131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.571263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.571263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.571522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.571654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.571785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.571925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.572059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.572190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.572321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.572462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.572593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.572741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.572875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.573134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.573279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 10:33:10.573412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.573412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.573412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.573412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.573412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.573412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.573412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.573412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.574393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.574393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.574393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.574393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.574393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.574393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.574393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.574393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.575413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.575413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.575413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.575413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.575413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.575413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.575413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.575413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.577032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.577032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.577032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.577032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.577032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.577032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.577032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.577032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.578288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.578288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.578288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.578288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.578288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.578288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.578288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.578288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.579814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.579814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.579814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.579814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.579814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.579814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.579814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.579814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.580793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.580793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.580793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.580793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.580793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.580793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.580793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.580793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.581881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.581881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.581881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.581881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.581881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.581881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.581881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.581881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.582849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.582849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.582849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.582849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.582849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.582849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.582849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.582849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.583981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.583981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.583981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.583981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.583981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.583981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.583981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.583981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.584939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.584939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.584939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.584939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.584939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.584939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.584939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.584939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.586302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.586302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.586302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.586302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.586302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.586302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.586302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.586302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.587729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.587729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.587729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.587729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.587729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.587729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.587729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.587729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.588913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.588913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.588913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.588913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.588913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.588913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.588913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.588913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.589974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.589974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.589974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.589974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.589974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.589974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.589974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.589974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.590934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.590934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.590934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.590934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.590934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.590934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.590934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.590934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.592637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.592637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.592637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.592637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.592637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.592637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.592637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.592637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.593661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.593661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.593661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.593661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.593661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.593661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.593661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.593661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.594657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.594657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.594657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.594657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.594657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.594657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.594657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.594657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.595696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.595696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.595696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.595696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.595696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.595696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.595696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.595696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.597048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.597048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.597048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.597048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.597048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.597048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.597048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.597048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.598595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.598595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.598595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.598595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.598595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 10:33:10.598595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 10:33:10.602605 n-d-856894-1 devstack@n-api.service[128788]: INFO dbcounter [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Registered counter for database nova_api Sep 10 10:33:10.624832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_db.sqlalchemy.engines [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:33:10.633598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writer thread running {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:33:10.661861 n-d-856894-1 devstack@n-api.service[128787]: INFO dbcounter [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Registered counter for database nova_api Sep 10 10:33:10.682687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_db.sqlalchemy.engines [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:33:10.690456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writer thread running {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:33:10.692398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.context [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) {{(pid=128788) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 10:33:10.697431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:10.698055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:10.699571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:10.700351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:10.700761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:10.702803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:10.704911 n-d-856894-1 devstack@n-api.service[128788]: INFO dbcounter [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Registered counter for database nova_cell0 Sep 10 10:33:10.709235 n-d-856894-1 devstack@n-api.service[128788]: INFO dbcounter [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Registered counter for database nova_cell1 Sep 10 10:33:10.717135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_db.sqlalchemy.engines [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:33:10.718803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_db.sqlalchemy.engines [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:33:10.724415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writer thread running {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:33:10.727036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writer thread running {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:33:10.748850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.context [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) {{(pid=128787) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 10:33:10.753538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:10.754017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:10.755580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:10.756326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:10.756775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:10.758854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:10.760892 n-d-856894-1 devstack@n-api.service[128787]: INFO dbcounter [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Registered counter for database nova_cell0 Sep 10 10:33:10.764909 n-d-856894-1 devstack@n-api.service[128787]: INFO dbcounter [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Registered counter for database nova_cell1 Sep 10 10:33:10.773333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_db.sqlalchemy.engines [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:33:10.775579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_db.sqlalchemy.engines [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:33:10.781412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writer thread running {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:33:10.783613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writer thread running {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:33:10.876262 n-d-856894-1 devstack@n-api.service[128788]: INFO dbcounter [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Registered counter for database nova_cell0 Sep 10 10:33:10.883146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_db.sqlalchemy.engines [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:33:10.887835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writer thread running {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:33:10.930686 n-d-856894-1 devstack@n-api.service[128787]: INFO dbcounter [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Registered counter for database nova_cell0 Sep 10 10:33:10.937450 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_db.sqlalchemy.engines [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 10:33:10.942566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writer thread running {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 10:33:11.210891 n-d-856894-1 devstack@n-api.service[128788]: WARNING keystonemiddleware.auth_token [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 10:33:11.218230 n-d-856894-1 devstack@n-api.service[128788]: WARNING keystonemiddleware.auth_token [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 10:33:11.268753 n-d-856894-1 devstack@n-api.service[128787]: WARNING keystonemiddleware.auth_token [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 10:33:11.276023 n-d-856894-1 devstack@n-api.service[128787]: WARNING keystonemiddleware.auth_token [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 10:33:11.562973 n-d-856894-1 devstack@n-api.service[128788]: WARNING keystonemiddleware.auth_token [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 10:33:11.568990 n-d-856894-1 devstack@n-api.service[128788]: WARNING keystonemiddleware.auth_token [None req-8b7005c0-03fb-45ef-aa85-589fbb14e27a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 10:33:11.574417 n-d-856894-1 devstack@n-api.service[128788]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cf3b5e99c0 pid: 128788 (default app) Sep 10 10:33:11.623696 n-d-856894-1 devstack@n-api.service[128787]: WARNING keystonemiddleware.auth_token [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 10:33:11.629785 n-d-856894-1 devstack@n-api.service[128787]: WARNING keystonemiddleware.auth_token [None req-96529b8e-4434-4f40-8820-159bb4ded049 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 10:33:11.635093 n-d-856894-1 devstack@n-api.service[128787]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cf3b5e99c0 pid: 128787 (default app) Sep 10 10:33:51.923241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:33:51.924191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:33:51.925024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:33:51.926025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:33:52.194236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:33:52.195029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:33:52.196271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:33:52.197199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:33:53.210959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Calling method '.version_select at 0x7efcb04e3430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:53.220850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) {{(pid=128788) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 10 10:33:53.221751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:53.222297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:53.222807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:53.248625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:53.249156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:53.250139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:53.262602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:53.263199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:53.263790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:53.270611 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-327a836a-bee5-4943-b5ac-28138efed169 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.357799 Sep 10 10:33:53.271529 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1208 bytes} [Sat Sep 10 10:33:51 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:33:53.310214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '.version_select at 0x7efcb04e2430>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:53.316922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) {{(pid=128787) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 10 10:33:53.317916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:53.318606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:53.319392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:53.344855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:53.345355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:53.345788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:53.357728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:53.358201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:53.358648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:53.364805 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2a747c45-286a-441e-b971-32e0e7c75582 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.181521 Sep 10 10:33:53.365403 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1167 bytes} [Sat Sep 10 10:33:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:33:53.442205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b15b57b-3705-4be0-a66c-5343441b3062 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-385886635", "id": 1371412991, "os-flavor-access:is_public": "False"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:53.475835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-37ac22f0-a997-47e1-b407-63ba229beaeb tempest-FlavorsV261TestJSON-1176222559 tempest-FlavorsV261TestJSON-1176222559-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1641964213", "id": 1968490084, "os-flavor-access:is_public": "True"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:53.491627 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b15b57b-3705-4be0-a66c-5343441b3062 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.218791 Sep 10 10:33:53.492227 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:33:53 2022] POST /compute/v2.1/flavors => generated 430 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:33:53.527850 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-37ac22f0-a997-47e1-b407-63ba229beaeb tempest-FlavorsV261TestJSON-1176222559 tempest-FlavorsV261TestJSON-1176222559-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.161353 Sep 10 10:33:53.528423 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2/4] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:33:53 2022] POST /compute/v2.1/flavors => generated 468 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:33:53.602824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-860ac1c2-5db6-4a08-84d0-9824cb589cd1 tempest-FlavorMetadataValidation-931937676 tempest-FlavorMetadataValidation-931937676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-231225443", "id": 1655926970, "os-flavor-access:is_public": "True"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:53.622902 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-860ac1c2-5db6-4a08-84d0-9824cb589cd1 tempest-FlavorMetadataValidation-931937676 tempest-FlavorMetadataValidation-931937676-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.129666 Sep 10 10:33:53.623490 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3/5] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:33:53 2022] POST /compute/v2.1/flavors => generated 470 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:33:53.645099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1a6fb5b8-8d3d-4ec5-83bf-a0e086323025 tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:53.646724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a6fb5b8-8d3d-4ec5-83bf-a0e086323025 tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:53.647294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a6fb5b8-8d3d-4ec5-83bf-a0e086323025 tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:53.647628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a6fb5b8-8d3d-4ec5-83bf-a0e086323025 tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:53.648434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a6fb5b8-8d3d-4ec5-83bf-a0e086323025 tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:53.648783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a6fb5b8-8d3d-4ec5-83bf-a0e086323025 tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:53.649214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a6fb5b8-8d3d-4ec5-83bf-a0e086323025 tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:53.688969 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1a6fb5b8-8d3d-4ec5-83bf-a0e086323025 tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.158761 Sep 10 10:33:53.689819 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1164 bytes} [Sat Sep 10 10:33:53 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:33:53.694465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-943151e6-60e7-450d-a0c1-c153e96a33c6 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1009808888"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:53.697926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-943151e6-60e7-450d-a0c1-c153e96a33c6 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Generated uuid 9ca537b5-f462-4b09-bee4-ccbb8ac79ba2 for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:33:53.737605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f58da2f-c216-4309-b6d5-117166e8dda4 tempest-AZAdminNegativeTestJSON-418912928 tempest-AZAdminNegativeTestJSON-418912928-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:53.739474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f58da2f-c216-4309-b6d5-117166e8dda4 tempest-AZAdminNegativeTestJSON-418912928 tempest-AZAdminNegativeTestJSON-418912928-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '00f5aa2388244d3dac021fd5e8c96024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aff34ffd46424fb56cfd65246ad00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f58da2f-c216-4309-b6d5-117166e8dda4 tempest-AZAdminNegativeTestJSON-418912928 tempest-AZAdminNegativeTestJSON-418912928-project] Request method failure captured: Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgOvu152AapjmB02XxRmnDdOmvVk5fOdT15DpAdXi9wBVEuVNCxJUXXD6RcPOCXQBUMw8tK2wXmGcMhKIGR0-RjwSYM5yq751vQCHBvIF71t2hllpoNSQ-GpFXShiKVJqY6PWu4QgGaVn7f4dMmiRMK2suyeResCTH0peSObx0HGLg Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 81aff34ffd46424fb56cfd65246ad00c Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AZAdminNegativeTestJSON-418912928 Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:33:53.743174 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81aff34ffd46424fb56cfd65246ad00c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/81aff34ffd46424fb56cfd65246ad00c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81aff34ffd46424fb56cfd65246ad00c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_81aff34ffd46424fb56cfd65246ad00c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AZAdminNegativeTestJSON-418912928 Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 81aff34ffd46424fb56cfd65246ad00c Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-418912928 Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AZAdminNegativeTestJSON-418912928-project Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 00f5aa2388244d3dac021fd5e8c96024 Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AZAdminNegativeTestJSON-418912928-project Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 10 10:33:53.744478 n-d-856894-1 devstack@n-api.service[128788]: action_args: {} Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:33:53.745251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:53.746212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f58da2f-c216-4309-b6d5-117166e8dda4 tempest-AZAdminNegativeTestJSON-418912928 tempest-AZAdminNegativeTestJSON-418912928-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:33:53.747026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f58da2f-c216-4309-b6d5-117166e8dda4 tempest-AZAdminNegativeTestJSON-418912928 tempest-AZAdminNegativeTestJSON-418912928-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.120142 Sep 10 10:33:53.747026 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1185 bytes} [Sat Sep 10 10:33:53 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 121 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:33:53.764558 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-943151e6-60e7-450d-a0c1-c153e96a33c6 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.073562 Sep 10 10:33:53.772777 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 4/8] 10.222.0.20 () {62 vars in 1205 bytes} [Sat Sep 10 10:33:53 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:33:53.772777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2fca6156-62ac-4428-9945-8faa0f64f2a9 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f08a2986300843a6a2aff348682757c7"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:53.873153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb309628-7f34-4d69-be57-d412f7b696fe tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1366105473", "id": 855322365, "os-flavor-access:is_public": "False"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:53.899647 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb309628-7f34-4d69-be57-d412f7b696fe tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.153477 Sep 10 10:33:53.900648 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 5/9] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:33:53 2022] POST /compute/v2.1/flavors => generated 436 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:33:53.942910 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2fca6156-62ac-4428-9945-8faa0f64f2a9 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1371412991/action" status: 200 len: 97 microversion: 2.1 time: 0.175083 Sep 10 10:33:53.943824 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 5/10] 10.222.0.20 () {60 vars in 1200 bytes} [Sat Sep 10 10:33:53 2022] POST /compute/v2.1/flavors/1371412991/action => generated 97 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:33:53.949747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d9ab0c6c-3ceb-460c-a885-c1ea45adfa46 tempest-FlavorMetadataValidation-931937676 tempest-FlavorMetadataValidation-931937676-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:54.102817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-68f8c83a-b93c-47ef-8b92-73686dfe7c6e tempest-FlavorsV261TestJSON-779453350 tempest-FlavorsV261TestJSON-779453350-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:54.125485 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-68f8c83a-b93c-47ef-8b92-73686dfe7c6e tempest-FlavorsV261TestJSON-779453350 tempest-FlavorsV261TestJSON-779453350-project] 10.222.0.20 "GET /compute/v2.1/flavors/1968490084" status: 200 len: 468 microversion: 2.61 time: 0.223048 Sep 10 10:33:54.126555 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 6/11] 10.222.0.20 () {60 vars in 1199 bytes} [Sat Sep 10 10:33:53 2022] GET /compute/v2.1/flavors/1968490084 => generated 468 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:33:54.131769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d38f434e-59eb-47d2-9d7d-ca229b3525ed tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:54.133894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d38f434e-59eb-47d2-9d7d-ca229b3525ed tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:54.134612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d38f434e-59eb-47d2-9d7d-ca229b3525ed tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:54.135238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d38f434e-59eb-47d2-9d7d-ca229b3525ed tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:54.136072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d38f434e-59eb-47d2-9d7d-ca229b3525ed tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:54.136554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d38f434e-59eb-47d2-9d7d-ca229b3525ed tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:54.136974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d38f434e-59eb-47d2-9d7d-ca229b3525ed tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:54.141041 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d9ab0c6c-3ceb-460c-a885-c1ea45adfa46 tempest-FlavorMetadataValidation-931937676 tempest-FlavorMetadataValidation-931937676-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1655926970/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.195880 Sep 10 10:33:54.146947 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 6/12] 10.222.0.20 () {62 vars in 1265 bytes} [Sat Sep 10 10:33:53 2022] POST /compute/v2.1/flavors/1655926970/os-extra_specs => generated 62 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:33:54.152460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0752ce7e-5a29-4683-a5e6-626233c4489e tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-617301891"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:54.188280 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d38f434e-59eb-47d2-9d7d-ca229b3525ed tempest-AZAdminV2TestJSON-952904847 tempest-AZAdminV2TestJSON-952904847-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.060550 Sep 10 10:33:54.188879 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1185 bytes} [Sat Sep 10 10:33:54 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:33:54.199234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ecdf29e6-f77b-484a-bbd1-65f976935a8a tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f1bf2660846a4a2581f2040ea9aa8345"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:54.276662 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0752ce7e-5a29-4683-a5e6-626233c4489e tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.128057 Sep 10 10:33:54.278609 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 7/14] 10.222.0.20 () {62 vars in 1210 bytes} [Sat Sep 10 10:33:54 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:33:54.379738 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ecdf29e6-f77b-484a-bbd1-65f976935a8a tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/855322365/action" status: 200 len: 96 microversion: 2.1 time: 0.188746 Sep 10 10:33:54.380858 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 8/15] 10.222.0.20 () {60 vars in 1197 bytes} [Sat Sep 10 10:33:54 2022] POST /compute/v2.1/flavors/855322365/action => generated 96 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:33:54.386413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1b0edc2-9f87-4ec1-9b16-376a3564dfdf tempest-FlavorsV261TestJSON-1176222559 tempest-FlavorsV261TestJSON-1176222559-project-admin] Action: 'update', calling method: .version_select at 0x7efcb08a2af0>, body: {"flavor": {"description": "new"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:54.444346 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1b0edc2-9f87-4ec1-9b16-376a3564dfdf tempest-FlavorsV261TestJSON-1176222559 tempest-FlavorsV261TestJSON-1176222559-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1968490084" status: 200 len: 469 microversion: 2.61 time: 0.061693 Sep 10 10:33:54.444999 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 9/16] 10.222.0.20 () {62 vars in 1219 bytes} [Sat Sep 10 10:33:54 2022] PUT /compute/v2.1/flavors/1968490084 => generated 469 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:33:54.453507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cedf7120-f72c-412e-b72f-8b585fa76bda tempest-FlavorMetadataValidation-931937676 tempest-FlavorMetadataValidation-931937676-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:54.491122 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cedf7120-f72c-412e-b72f-8b585fa76bda tempest-FlavorMetadataValidation-931937676 tempest-FlavorMetadataValidation-931937676-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1655926970" status: 202 len: 0 microversion: 2.86 time: 0.044793 Sep 10 10:33:54.492706 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 10/17] 10.222.0.20 () {60 vars in 1202 bytes} [Sat Sep 10 10:33:54 2022] DELETE /compute/v2.1/flavors/1655926970 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:33:54.500028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d8e98711-a39b-43c9-bada-a1fe7edefe81 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:54.505511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0a7b4e30-618d-4b5d-b3bb-43f5a50b0ece tempest-FlavorsAccessTestJSON-617805255 tempest-FlavorsAccessTestJSON-617805255-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:54.521785 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d8e98711-a39b-43c9-bada-a1fe7edefe81 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.025787 Sep 10 10:33:54.523676 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 11/18] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Sep 10 10:33:54 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:33:54.535232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6c449a2-80a3-4188-ab67-68cb073b0c0c tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f1bf2660846a4a2581f2040ea9aa8345"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:54.542563 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0a7b4e30-618d-4b5d-b3bb-43f5a50b0ece tempest-FlavorsAccessTestJSON-617805255 tempest-FlavorsAccessTestJSON-617805255-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5829 microversion: 2.1 time: 0.262135 Sep 10 10:33:54.543419 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 8/19] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:33:54 2022] GET /compute/v2.1/flavors/detail => generated 5829 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:33:54.549223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7ce4b8ec-3de8-49da-b690-ef1a8d34d70d tempest-FlavorsV261TestJSON-779453350 tempest-FlavorsV261TestJSON-779453350-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:54.575335 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7ce4b8ec-3de8-49da-b690-ef1a8d34d70d tempest-FlavorsV261TestJSON-779453350 tempest-FlavorsV261TestJSON-779453350-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.030413 Sep 10 10:33:54.576371 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 9/20] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:33:54 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:33:54.581616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c35eabda-a9f2-46a2-bb0e-0f35abc7093c tempest-FlavorMetadataValidation-931937676 tempest-FlavorMetadataValidation-931937676-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:54.614537 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c35eabda-a9f2-46a2-bb0e-0f35abc7093c tempest-FlavorMetadataValidation-931937676 tempest-FlavorMetadataValidation-931937676-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.86 time: 0.036814 Sep 10 10:33:54.615019 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 10/21] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:33:54 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:33:54.619414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-902d96f6-a33d-4621-adb6-1dc57db88ed8 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:54.630186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-902d96f6-a33d-4621-adb6-1dc57db88ed8 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:54.630680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-902d96f6-a33d-4621-adb6-1dc57db88ed8 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:54.631191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-902d96f6-a33d-4621-adb6-1dc57db88ed8 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:54.995183 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c6c449a2-80a3-4188-ab67-68cb073b0c0c tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project f1bf2660846a4a2581f2040ea9aa8345 combination. Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6c449a2-80a3-4188-ab67-68cb073b0c0c tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Request method failure captured: Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/flavors/855322365/action HTTP/1.1 Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 67 Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgPjFfrlsuTYUfL7YouRzJts7Zss0D14trhxl3bjQ7AJ73f5gJ_efnzmiKqLlAjJn-etO4qRE2yLsPlmcwm8zv9HTcbnNgZ6xGd-_YV5FaEWt6T7-NSLADwaDZVU0i65AtChDRHXwB0lJ-XsU3hdgI7cTTmNlFsjPL64Nypwzml3JU Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: d1318e652b9246dc9cd5fd41faacbfa1 Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1766035728 Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:33:55.014131 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1318e652b9246dc9cd5fd41faacbfa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1318e652b9246dc9cd5fd41faacbfa1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1318e652b9246dc9cd5fd41faacbfa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1318e652b9246dc9cd5fd41faacbfa1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1766035728 Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: d1318e652b9246dc9cd5fd41faacbfa1 Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1766035728 Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 311c25503860405cabd651732aa3ecf2 Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: {"addTenantAccess": {"tenant": "f1bf2660846a4a2581f2040ea9aa8345"}} Sep 10 10:33:55.015314 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: exception: Flavor access already exists for flavor 18 and project f1bf2660846a4a2581f2040ea9aa8345 combination. Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '855322365', 'body': {'addTenantAccess': {'tenant': 'f1bf2660846a4a2581f2040ea9aa8345'}}} Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result.read() Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 10:33:55.015910 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-f1bf2660846a4a2581f2040ea9aa8345' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi session.flush() Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 10:33:55.016765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 10:33:55.018282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 10:33:55.019432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result.read() Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-f1bf2660846a4a2581f2040ea9aa8345' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 10, 10, 33, 54, 988364), 'updated_at': None, 'flavor_id': 18, 'project_id': 'f1bf2660846a4a2581f2040ea9aa8345'}] Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:33:55.021681 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project f1bf2660846a4a2581f2040ea9aa8345 combination. Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:33:55.023561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project f1bf2660846a4a2581f2040ea9aa8345 combination. Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:33:55.025017 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:33:55.026960 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project f1bf2660846a4a2581f2040ea9aa8345 combination. Sep 10 10:33:55.026960 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:33:55.026960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6c449a2-80a3-4188-ab67-68cb073b0c0c tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project f1bf2660846a4a2581f2040ea9aa8345 combination. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:33:55.026960 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c6c449a2-80a3-4188-ab67-68cb073b0c0c tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/855322365/action" status: 409 len: 152 microversion: 2.1 time: 0.491547 Sep 10 10:33:55.026960 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 12/22] 10.222.0.20 () {60 vars in 1197 bytes} [Sat Sep 10 10:33:54 2022] POST /compute/v2.1/flavors/855322365/action => generated 152 bytes in 496 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:33:55.026960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a93ff4f8-6319-4b29-a2d9-7b087779146b tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f08a2986300843a6a2aff348682757c7"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:55.634661 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-902d96f6-a33d-4621-adb6-1dc57db88ed8 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.017706 Sep 10 10:33:55.636412 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 11/23] 10.222.0.20 () {62 vars in 1232 bytes} [Sat Sep 10 10:33:54 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:33:55.655564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-79958c5a-f53c-4c1c-8dcb-06d254334191 tempest-FlavorsV261TestJSON-779453350 tempest-FlavorsV261TestJSON-779453350-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:55.699958 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-79958c5a-f53c-4c1c-8dcb-06d254334191 tempest-FlavorsV261TestJSON-779453350 tempest-FlavorsV261TestJSON-779453350-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.051106 Sep 10 10:33:55.700945 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 12/24] 10.222.0.20 () {60 vars in 1166 bytes} [Sat Sep 10 10:33:55 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:33:55.710923 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a93ff4f8-6319-4b29-a2d9-7b087779146b tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1371412991/action" status: 200 len: 21 microversion: 2.1 time: 0.689203 Sep 10 10:33:55.712432 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 13/25] 10.222.0.20 () {60 vars in 1200 bytes} [Sat Sep 10 10:33:55 2022] POST /compute/v2.1/flavors/1371412991/action => generated 21 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:33:55.721551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a15566f8-c0cb-4a47-bacb-865e7047723b tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f1bf2660846a4a2581f2040ea9aa8345"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:55.730562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-da4e0fca-efc7-483d-b4a7-83a8c7f1074a tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-856894-1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:55.790836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da4e0fca-efc7-483d-b4a7-83a8c7f1074a tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:55.791329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da4e0fca-efc7-483d-b4a7-83a8c7f1074a tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:55.791760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da4e0fca-efc7-483d-b4a7-83a8c7f1074a tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:56.060768 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a15566f8-c0cb-4a47-bacb-865e7047723b tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/855322365/action" status: 200 len: 21 microversion: 2.1 time: 0.353526 Sep 10 10:33:56.063213 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 13/26] 10.222.0.20 () {60 vars in 1197 bytes} [Sat Sep 10 10:33:55 2022] POST /compute/v2.1/flavors/855322365/action => generated 21 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:33:56.075841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1548f26e-f9e7-4da5-8f20-9d49a4d26732 tempest-FlavorsV261TestJSON-1176222559 tempest-FlavorsV261TestJSON-1176222559-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.108654 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1548f26e-f9e7-4da5-8f20-9d49a4d26732 tempest-FlavorsV261TestJSON-1176222559 tempest-FlavorsV261TestJSON-1176222559-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1968490084" status: 202 len: 0 microversion: 2.61 time: 0.037953 Sep 10 10:33:56.110052 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 14/27] 10.222.0.20 () {60 vars in 1202 bytes} [Sat Sep 10 10:33:56 2022] DELETE /compute/v2.1/flavors/1968490084 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:33:56.115930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fd8a87d1-66ad-4cb5-8b0e-016a61794d52 tempest-FlavorsAccessTestJSON-617805255 tempest-FlavorsAccessTestJSON-617805255-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.140890 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fd8a87d1-66ad-4cb5-8b0e-016a61794d52 tempest-FlavorsAccessTestJSON-617805255 tempest-FlavorsAccessTestJSON-617805255-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028754 Sep 10 10:33:56.141506 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 15/28] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:33:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:33:56.147829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-011d38bd-b88b-41b4-be33-652a045d7a95 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.170000 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-011d38bd-b88b-41b4-be33-652a045d7a95 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/855322365" status: 202 len: 0 microversion: 2.1 time: 0.027093 Sep 10 10:33:56.181569 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 16/29] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:33:56 2022] DELETE /compute/v2.1/flavors/855322365 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:33:56.181569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d68c6a5-fda9-4781-a94b-cba7af05c318 tempest-FlavorsV261TestJSON-1176222559 tempest-FlavorsV261TestJSON-1176222559-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.197743 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d68c6a5-fda9-4781-a94b-cba7af05c318 tempest-FlavorsV261TestJSON-1176222559 tempest-FlavorsV261TestJSON-1176222559-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.025878 Sep 10 10:33:56.198484 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 17/30] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:33:56 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:33:56.214186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-85390dee-9ab6-4d15-b508-2f817e808b20 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.239638 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-85390dee-9ab6-4d15-b508-2f817e808b20 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1371412991" status: 202 len: 0 microversion: 2.1 time: 0.033060 Sep 10 10:33:56.240376 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 18/31] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:33:56 2022] DELETE /compute/v2.1/flavors/1371412991 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:33:56.246623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f1668c60-eb07-4ecb-8e54-4a6e0a852bf0 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.268713 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f1668c60-eb07-4ecb-8e54-4a6e0a852bf0 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026997 Sep 10 10:33:56.269542 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 19/32] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:33:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:33:56.273805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9e1906e7-d877-4e6b-a2ad-f2a99314fe37 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.299208 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9e1906e7-d877-4e6b-a2ad-f2a99314fe37 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028387 Sep 10 10:33:56.300204 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 20/33] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:33:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:33:56.307042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-78ce4ecb-522c-4083-9f6a-e6ea59a95f71 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1593544728", "id": 928308538, "os-flavor-access:is_public": "True"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:56.364691 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-78ce4ecb-522c-4083-9f6a-e6ea59a95f71 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.063004 Sep 10 10:33:56.366239 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 21/34] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:33:56 2022] POST /compute/v2.1/flavors => generated 435 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:33:56.370695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4105109d-776b-423b-9f70-98c50a3f7841 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-293429600", "id": 1890359074, "os-flavor-access:is_public": "False"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:56.387890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=10 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:33:56.392709 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4105109d-776b-423b-9f70-98c50a3f7841 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.025396 Sep 10 10:33:56.393954 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 22/35] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:33:56 2022] POST /compute/v2.1/flavors => generated 430 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:33:56.398831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a7f45a54-ff37-472c-8b9e-efc9d5bf58e5 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.406599 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-a7f45a54-ff37-472c-8b9e-efc9d5bf58e5 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a7f45a54-ff37-472c-8b9e-efc9d5bf58e5 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Request method failure captured: Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/flavors/928308538/os-flavor-access HTTP/1.1 Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgPjFfrlsuTYUfL7YouRzJts7Zss0D14trhxl3bjQ7AJ73f5gJ_efnzmiKqLlAjJn-etO4qRE2yLsPlmcwm8zv9HTcbnNgZ6xGd-_YV5FaEWt6T7-NSLADwaDZVU0i65AtChDRHXwB0lJ-XsU3hdgI7cTTmNlFsjPL64Nypwzml3JU Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: d1318e652b9246dc9cd5fd41faacbfa1 Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1766035728 Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:33:56.408779 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1318e652b9246dc9cd5fd41faacbfa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1318e652b9246dc9cd5fd41faacbfa1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1318e652b9246dc9cd5fd41faacbfa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1318e652b9246dc9cd5fd41faacbfa1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1766035728 Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: d1318e652b9246dc9cd5fd41faacbfa1 Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1766035728 Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 311c25503860405cabd651732aa3ecf2 Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: exception: Access list not available for public flavors. Sep 10 10:33:56.410048 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'flavor_id': '928308538'} Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 10 10:33:56.410642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:33:56.412771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a7f45a54-ff37-472c-8b9e-efc9d5bf58e5 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:33:56.413836 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a7f45a54-ff37-472c-8b9e-efc9d5bf58e5 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/928308538/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.018962 Sep 10 10:33:56.414682 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 23/36] 10.222.0.20 () {58 vars in 1206 bytes} [Sat Sep 10 10:33:56 2022] GET /compute/v2.1/flavors/928308538/os-flavor-access => generated 91 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:33:56.423975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-37350017-5f88-4ce4-a427-44f4022d01b4 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.438867 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-37350017-5f88-4ce4-a427-44f4022d01b4 tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1890359074/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.022963 Sep 10 10:33:56.439725 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 24/37] 10.222.0.20 () {58 vars in 1209 bytes} [Sat Sep 10 10:33:56 2022] GET /compute/v2.1/flavors/1890359074/os-flavor-access => generated 21 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:33:56.445359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1f664d6a-548e-4001-9d2b-0dcfdc2a437f tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.466645 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1f664d6a-548e-4001-9d2b-0dcfdc2a437f tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/928308538" status: 202 len: 0 microversion: 2.1 time: 0.025582 Sep 10 10:33:56.468783 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 25/38] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:33:56 2022] DELETE /compute/v2.1/flavors/928308538 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:33:56.477957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2a31e07c-1fce-48f9-9eeb-a71c20e58dbe tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.500370 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2a31e07c-1fce-48f9-9eeb-a71c20e58dbe tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1890359074" status: 202 len: 0 microversion: 2.1 time: 0.026779 Sep 10 10:33:56.501851 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 26/39] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:33:56 2022] DELETE /compute/v2.1/flavors/1890359074 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:33:56.507580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d754cdec-fe3a-4333-81b5-a39de17c768f tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.542717 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d754cdec-fe3a-4333-81b5-a39de17c768f tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039358 Sep 10 10:33:56.543326 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 27/40] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:33:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:33:56.549043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3affd86e-2532-4418-8230-d8352a9f6c3a tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.569492 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3affd86e-2532-4418-8230-d8352a9f6c3a tempest-FlavorsAccessTestJSON-988348452 tempest-FlavorsAccessTestJSON-988348452-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024957 Sep 10 10:33:56.570075 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 28/41] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:33:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:33:56.575248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6e95c84c-680a-4869-a0f6-124f4467870e tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-822265961", "id": 1801718903, "os-flavor-access:is_public": "False"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:56.601564 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6e95c84c-680a-4869-a0f6-124f4467870e tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.030112 Sep 10 10:33:56.610328 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 29/42] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:33:56 2022] POST /compute/v2.1/flavors => generated 438 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:33:56.840988 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-da4e0fca-efc7-483d-b4a7-83a8c7f1074a tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 1.117448 Sep 10 10:33:56.843170 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 14/43] 10.222.0.20 () {62 vars in 1232 bytes} [Sat Sep 10 10:33:55 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:33:56.863303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b1e4b96-fd41-4989-9f84-04e001e02f32 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:56.901890 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b1e4b96-fd41-4989-9f84-04e001e02f32 tempest-AggregatesAdminTestV241-787717595 tempest-AggregatesAdminTestV241-787717595-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.047768 Sep 10 10:33:56.902994 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 15/44] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Sep 10 10:33:56 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:33:56.943248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-11c93d8a-8767-4baa-a4a5-38fc906863cc tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1657548286", "name": "tempest-test_aggregate-1055378117"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:56.966118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.aggregate [None req-11c93d8a-8767-4baa-a4a5-38fc906863cc tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Generated uuid e58eb45f-6fb4-4505-bb3a-2ce05d929518 for aggregate {{(pid=128788) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:33:56.966895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5ae662d-b1a5-49b2-835b-b033bd94b63f tempest-FlavorsAccessNegativeTestJSON-825360200 tempest-FlavorsAccessNegativeTestJSON-825360200-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f1bf2660846a4a2581f2040ea9aa8345"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:56.971834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a5ae662d-b1a5-49b2-835b-b033bd94b63f tempest-FlavorsAccessNegativeTestJSON-825360200 tempest-FlavorsAccessNegativeTestJSON-825360200-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '6ad087db44754500a6470455096e973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf2660846a4a2581f2040ea9aa8345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5ae662d-b1a5-49b2-835b-b033bd94b63f tempest-FlavorsAccessNegativeTestJSON-825360200 tempest-FlavorsAccessNegativeTestJSON-825360200-project] Request method failure captured: Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/flavors/1801718903/action HTTP/1.1 Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 67 Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgNXVvJ-QmE_gT10_I4eDvwzVlPc4M9X2qCnH6lYNWJ_TTMoDSROv8I_za1SimzOCy5tz5-eZSM-RGDP2k5sbPyaSfk5rDc85Y4GZI5f99dERWPpwq_ZXSCXtnnfThH1dxN1ivQUA2dU1WL6fuHHHrG48VDEfqpNYIVAApK9y4Grg4 Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: f1bf2660846a4a2581f2040ea9aa8345 Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-825360200 Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:33:56.975790 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1bf2660846a4a2581f2040ea9aa8345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f1bf2660846a4a2581f2040ea9aa8345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1bf2660846a4a2581f2040ea9aa8345"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f1bf2660846a4a2581f2040ea9aa8345", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-825360200 Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: f1bf2660846a4a2581f2040ea9aa8345 Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-825360200 Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FlavorsAccessNegativeTestJSON-825360200-project Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 6ad087db44754500a6470455096e973a Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-825360200-project Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: {"addTenantAccess": {"tenant": "f1bf2660846a4a2581f2040ea9aa8345"}} Sep 10 10:33:56.977103 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '1801718903', 'body': {'addTenantAccess': {'tenant': 'f1bf2660846a4a2581f2040ea9aa8345'}}} Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:33:56.977699 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 10 10:33:56.978597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:33:56.981003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5ae662d-b1a5-49b2-835b-b033bd94b63f tempest-FlavorsAccessNegativeTestJSON-825360200 tempest-FlavorsAccessNegativeTestJSON-825360200-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:33:56.982859 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a5ae662d-b1a5-49b2-835b-b033bd94b63f tempest-FlavorsAccessNegativeTestJSON-825360200 tempest-FlavorsAccessNegativeTestJSON-825360200-project] 10.222.0.20 "POST /compute/v2.1/flavors/1801718903/action" status: 403 len: 130 microversion: 2.1 time: 0.369135 Sep 10 10:33:56.983726 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 30/45] 10.222.0.20 () {60 vars in 1200 bytes} [Sat Sep 10 10:33:56 2022] POST /compute/v2.1/flavors/1801718903/action => generated 130 bytes in 373 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:33:56.993919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b5f18e27-cbed-4715-aa9d-01ca4019981e tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:57.012030 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-11c93d8a-8767-4baa-a4a5-38fc906863cc tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.072148 Sep 10 10:33:57.012678 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 16/46] 10.222.0.20 () {60 vars in 1165 bytes} [Sat Sep 10 10:33:56 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:33:57.025025 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b5f18e27-cbed-4715-aa9d-01ca4019981e tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1801718903" status: 202 len: 0 microversion: 2.1 time: 0.036444 Sep 10 10:33:57.026013 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 31/47] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:33:56 2022] DELETE /compute/v2.1/flavors/1801718903 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:33:57.028388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cbb58f8-3320-4f68-bcee-66f6fd50810d tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:57.035320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-29304b9c-0b64-44e2-b7eb-f15dce2ea7f7 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:57.047410 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cbb58f8-3320-4f68-bcee-66f6fd50810d tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.025443 Sep 10 10:33:57.049226 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 17/48] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:33:57 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:33:57.060864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d41f2e6c-973e-4de8-b19b-f749132bcfd6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-856894-1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:57.071063 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-29304b9c-0b64-44e2-b7eb-f15dce2ea7f7 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040807 Sep 10 10:33:57.072218 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 32/49] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:33:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:33:57.074841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d41f2e6c-973e-4de8-b19b-f749132bcfd6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:57.075426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d41f2e6c-973e-4de8-b19b-f749132bcfd6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:57.075932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d41f2e6c-973e-4de8-b19b-f749132bcfd6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:57.091468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-60231406-321f-45ff-8360-ba046d2ac81e tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2133861055", "id": 299195221, "os-flavor-access:is_public": "False"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:57.116632 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-60231406-321f-45ff-8360-ba046d2ac81e tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.025315 Sep 10 10:33:57.118463 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 33/50] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:33:57 2022] POST /compute/v2.1/flavors => generated 436 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:33:57.131782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea1f011f-b85d-4eff-b977-d68bd69dd87f tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f1bf2660846a4a2581f2040ea9aa8345"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:57.245178 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d41f2e6c-973e-4de8-b19b-f749132bcfd6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.188148 Sep 10 10:33:57.245896 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 18/51] 10.222.0.20 () {60 vars in 1191 bytes} [Sat Sep 10 10:33:57 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:33:57.914663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-42876671", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "availability_zone": "tempest-test_az-1657548286"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:57.930073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:57.930571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:57.931501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:57.931751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:33:57.932172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:33:57.932593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:33:57.974640 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ea1f011f-b85d-4eff-b977-d68bd69dd87f tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/299195221/action" status: 200 len: 96 microversion: 2.1 time: 0.847480 Sep 10 10:33:57.976770 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 34/52] 10.222.0.20 () {60 vars in 1197 bytes} [Sat Sep 10 10:33:57 2022] POST /compute/v2.1/flavors/299195221/action => generated 96 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 10:33:57.987352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a49bb8b4-369c-4b35-a45e-488c685179e2 tempest-FlavorsAccessNegativeTestJSON-825360200 tempest-FlavorsAccessNegativeTestJSON-825360200-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f1bf2660846a4a2581f2040ea9aa8345"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:57.994970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a49bb8b4-369c-4b35-a45e-488c685179e2 tempest-FlavorsAccessNegativeTestJSON-825360200 tempest-FlavorsAccessNegativeTestJSON-825360200-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '6ad087db44754500a6470455096e973a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf2660846a4a2581f2040ea9aa8345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a49bb8b4-369c-4b35-a45e-488c685179e2 tempest-FlavorsAccessNegativeTestJSON-825360200 tempest-FlavorsAccessNegativeTestJSON-825360200-project] Request method failure captured: Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/flavors/299195221/action HTTP/1.1 Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 70 Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgNXVvJ-QmE_gT10_I4eDvwzVlPc4M9X2qCnH6lYNWJ_TTMoDSROv8I_za1SimzOCy5tz5-eZSM-RGDP2k5sbPyaSfk5rDc85Y4GZI5f99dERWPpwq_ZXSCXtnnfThH1dxN1ivQUA2dU1WL6fuHHHrG48VDEfqpNYIVAApK9y4Grg4 Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: f1bf2660846a4a2581f2040ea9aa8345 Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-825360200 Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:33:57.996575 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1bf2660846a4a2581f2040ea9aa8345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f1bf2660846a4a2581f2040ea9aa8345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f1bf2660846a4a2581f2040ea9aa8345"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f1bf2660846a4a2581f2040ea9aa8345", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-825360200 Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: f1bf2660846a4a2581f2040ea9aa8345 Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-825360200 Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FlavorsAccessNegativeTestJSON-825360200-project Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 6ad087db44754500a6470455096e973a Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-825360200-project Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: {"removeTenantAccess": {"tenant": "f1bf2660846a4a2581f2040ea9aa8345"}} Sep 10 10:33:57.997989 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '299195221', 'body': {'removeTenantAccess': {'tenant': 'f1bf2660846a4a2581f2040ea9aa8345'}}} Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can( Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:33:57.998693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 10 10:33:58.000453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:33:58.001541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a49bb8b4-369c-4b35-a45e-488c685179e2 tempest-FlavorsAccessNegativeTestJSON-825360200 tempest-FlavorsAccessNegativeTestJSON-825360200-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:33:58.001541 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a49bb8b4-369c-4b35-a45e-488c685179e2 tempest-FlavorsAccessNegativeTestJSON-825360200 tempest-FlavorsAccessNegativeTestJSON-825360200-project] 10.222.0.20 "POST /compute/v2.1/flavors/299195221/action" status: 403 len: 133 microversion: 2.1 time: 0.015278 Sep 10 10:33:58.008907 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 35/53] 10.222.0.20 () {60 vars in 1197 bytes} [Sat Sep 10 10:33:57 2022] POST /compute/v2.1/flavors/299195221/action => generated 133 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:33:58.013564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-91dd1a25-ba55-4cb8-acf2-5ed9c6ea6d36 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f1bf2660846a4a2581f2040ea9aa8345"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:58.932197 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-91dd1a25-ba55-4cb8-acf2-5ed9c6ea6d36 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/299195221/action" status: 200 len: 21 microversion: 2.1 time: 0.921992 Sep 10 10:33:58.934025 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 36/54] 10.222.0.20 () {60 vars in 1197 bytes} [Sat Sep 10 10:33:58 2022] POST /compute/v2.1/flavors/299195221/action => generated 21 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:33:58.946407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6bbeeacb-6cb7-4929-98db-8ab34f60391b tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:58.973259 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6bbeeacb-6cb7-4929-98db-8ab34f60391b tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/299195221" status: 202 len: 0 microversion: 2.1 time: 0.032562 Sep 10 10:33:58.974517 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 37/55] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:33:58 2022] DELETE /compute/v2.1/flavors/299195221 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:33:58.984658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-57d99a70-3b5e-47f0-8921-1b5f9c78302e tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:33:59.013357 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-57d99a70-3b5e-47f0-8921-1b5f9c78302e tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033863 Sep 10 10:33:59.015393 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 38/56] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:33:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:33:59.035358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1611d149-bd7f-4c0b-9b5d-8001379aafa1 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-639358483", "id": 920352456, "os-flavor-access:is_public": "False"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:59.054034 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1611d149-bd7f-4c0b-9b5d-8001379aafa1 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022251 Sep 10 10:33:59.055067 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 39/57] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:33:59 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:33:59.069855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-03b7f420-72ba-4505-8913-e5a8e018d435 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "48ca859c1ecc458ea5b9389a4e177afc"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:33:59.544351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:33:59.961684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:33:59.962307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:33:59.962881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:33:59.963433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:33:59.963937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:34:00.005927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:00.008770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:00.009550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:00.010934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:00.011497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:00.012128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:00.045278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Getting quotas for project 4bfda1adb59b4b56927f590ad0345d9a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:00.051362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:00.056028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Getting quotas for user 787948efda9644269a83ee97c4dde350 and project 4bfda1adb59b4b56927f590ad0345d9a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:00.072458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:34:00.075769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:34:00.145496 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a4a29acf-54e3-427c-a554-1b39bbb51365 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.516286 Sep 10 10:34:00.148025 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 19/58] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:33:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 10:34:00.160172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49dd7eec-2d5d-4a89-b81a-78d8002b4845 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:00.160802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-49dd7eec-2d5d-4a89-b81a-78d8002b4845 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:00.285506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-49dd7eec-2d5d-4a89-b81a-78d8002b4845 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:00.297505 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-03b7f420-72ba-4505-8913-e5a8e018d435 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] HTTP exception thrown: Flavor access not found for 23 / 48ca859c1ecc458ea5b9389a4e177afc combination. Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-03b7f420-72ba-4505-8913-e5a8e018d435 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Request method failure captured: Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/flavors/920352456/action HTTP/1.1 Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 70 Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgPjFfrlsuTYUfL7YouRzJts7Zss0D14trhxl3bjQ7AJ73f5gJ_efnzmiKqLlAjJn-etO4qRE2yLsPlmcwm8zv9HTcbnNgZ6xGd-_YV5FaEWt6T7-NSLADwaDZVU0i65AtChDRHXwB0lJ-XsU3hdgI7cTTmNlFsjPL64Nypwzml3JU Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: d1318e652b9246dc9cd5fd41faacbfa1 Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1766035728 Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:34:00.301629 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1318e652b9246dc9cd5fd41faacbfa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1318e652b9246dc9cd5fd41faacbfa1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1318e652b9246dc9cd5fd41faacbfa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1318e652b9246dc9cd5fd41faacbfa1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1766035728 Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: d1318e652b9246dc9cd5fd41faacbfa1 Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1766035728 Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 311c25503860405cabd651732aa3ecf2 Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: {"removeTenantAccess": {"tenant": "48ca859c1ecc458ea5b9389a4e177afc"}} Sep 10 10:34:00.303019 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: exception: Flavor access not found for 23 / 48ca859c1ecc458ea5b9389a4e177afc combination. Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '920352456', 'body': {'removeTenantAccess': {'tenant': '48ca859c1ecc458ea5b9389a4e177afc'}}} Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 10 10:34:00.303748 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 23 / 48ca859c1ecc458ea5b9389a4e177afc combination. Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 23 / 48ca859c1ecc458ea5b9389a4e177afc combination. Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:00.306286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:00.307521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:00.307521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:00.307521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:00.307521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:00.307521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 23 / 48ca859c1ecc458ea5b9389a4e177afc combination. Sep 10 10:34:00.307521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:00.307888 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-49dd7eec-2d5d-4a89-b81a-78d8002b4845 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1241 microversion: 2.1 time: 0.148251 Sep 10 10:34:00.307888 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 20/59] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:00 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1241 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:00.308810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-03b7f420-72ba-4505-8913-e5a8e018d435 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Returning 404 to user: Flavor access not found for 23 / 48ca859c1ecc458ea5b9389a4e177afc combination. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:00.309738 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-03b7f420-72ba-4505-8913-e5a8e018d435 tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/920352456/action" status: 404 len: 124 microversion: 2.1 time: 1.243754 Sep 10 10:34:00.313097 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 40/60] 10.222.0.20 () {60 vars in 1197 bytes} [Sat Sep 10 10:33:59 2022] POST /compute/v2.1/flavors/920352456/action => generated 124 bytes in 1245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:34:00.320887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33529974-df89-445d-80dd-c8e2792690aa tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:00.340499 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-33529974-df89-445d-80dd-c8e2792690aa tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/920352456" status: 202 len: 0 microversion: 2.1 time: 0.024629 Sep 10 10:34:00.341823 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 21/61] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:34:00 2022] DELETE /compute/v2.1/flavors/920352456 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:34:00.351277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-86db627c-32b5-40cc-9857-c2c8e82e134d tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:00.375357 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-86db627c-32b5-40cc-9857-c2c8e82e134d tempest-FlavorsAccessNegativeTestJSON-1766035728 tempest-FlavorsAccessNegativeTestJSON-1766035728-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028428 Sep 10 10:34:00.376235 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 41/62] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:34:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:01.332352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eded0240-bd88-4a35-9125-720b27bd1a1f tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:01.333998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eded0240-bd88-4a35-9125-720b27bd1a1f tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:01.457830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eded0240-bd88-4a35-9125-720b27bd1a1f tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:01.468512 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eded0240-bd88-4a35-9125-720b27bd1a1f tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1241 microversion: 2.1 time: 0.144374 Sep 10 10:34:01.470664 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 22/63] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:01 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1241 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:02.359285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Calling method '.version_select at 0x7efcb0d11940>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:02.361924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.362604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.363205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.384684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.385375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.385959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.398318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.399026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.399615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.407521 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-90b2c863-1cf3-4de1-ae8e-7e08e0fefcb2 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.495522 Sep 10 10:34:02.408572 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 42/64] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:34:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:02.421397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Calling method '.version_select at 0x7efcaf6ce8b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:02.423738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.424385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.425019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.447021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.447618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.448406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.495974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f98dbd7d-55d5-4d3b-9ac0-0fa010faf861 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:02.496972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f98dbd7d-55d5-4d3b-9ac0-0fa010faf861 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:02.507210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.507913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.508445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.511720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f98dbd7d-55d5-4d3b-9ac0-0fa010faf861 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.512149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f98dbd7d-55d5-4d3b-9ac0-0fa010faf861 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.512738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f98dbd7d-55d5-4d3b-9ac0-0fa010faf861 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.513738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f98dbd7d-55d5-4d3b-9ac0-0fa010faf861 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.514360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f98dbd7d-55d5-4d3b-9ac0-0fa010faf861 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.515470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f98dbd7d-55d5-4d3b-9ac0-0fa010faf861 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.515953 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e87c6d8-5239-4c8f-bd3d-ab7613614832 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-856894-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.098725 Sep 10 10:34:02.523640 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 23/65] 10.222.0.20 () {58 vars in 1212 bytes} [Sat Sep 10 10:34:02 2022] GET /compute/v2.1/os-hypervisors/n-h1-856894-1/servers => generated 196 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:02.533363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Calling method '.version_select at 0x7efcaf736310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:02.535659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.536278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.536809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.556191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.556896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.557681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.570485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.571429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.572140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.579184 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa757217-76a8-431c-b372-f3acd5e18d65 tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052809 Sep 10 10:34:02.580293 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 24/66] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:34:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:02.592292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bad4a0b3-62c6-4947-9ddc-a24c16ae962b tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Calling method '.version_select at 0x7efcaf6f3160>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:02.594741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad4a0b3-62c6-4947-9ddc-a24c16ae962b tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.595277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad4a0b3-62c6-4947-9ddc-a24c16ae962b tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.595717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad4a0b3-62c6-4947-9ddc-a24c16ae962b tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.613105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad4a0b3-62c6-4947-9ddc-a24c16ae962b tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:02.614040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad4a0b3-62c6-4947-9ddc-a24c16ae962b tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:02.615096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad4a0b3-62c6-4947-9ddc-a24c16ae962b tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:02.625005 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bad4a0b3-62c6-4947-9ddc-a24c16ae962b tempest-HypervisorAdminUnderV252Test-64433062 tempest-HypervisorAdminUnderV252Test-64433062-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-856894-1/search" status: 200 len: 104 microversion: 2.1 time: 0.036119 Sep 10 10:34:02.625885 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 25/67] 10.222.0.20 () {58 vars in 1209 bytes} [Sat Sep 10 10:34:02 2022] GET /compute/v2.1/os-hypervisors/n-h1-856894-1/search => generated 104 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:03.371348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-870442883", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:03.444370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:34:03.659619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:03.858882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:34:03.859648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:34:03.862198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:34:03.864277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:34:03.864911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:34:03.907413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:03.908891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:03.909918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:03.911335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:03.912524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:03.922694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:03.953582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Getting quotas for project 5fd93ef10e524fbc9e7097521db75920. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:03.958251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Getting quotas for user 4c1c3bd16a894700a9766beae6c604ed and project 5fd93ef10e524fbc9e7097521db75920. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:03.973568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:34:03.975863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:34:04.035960 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1de2a8f-8794-4623-a30e-ec1aafafa00d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311075 Sep 10 10:34:04.036852 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 26/68] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 10:34:04.975349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f98dbd7d-55d5-4d3b-9ac0-0fa010faf861 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:05.022501 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f98dbd7d-55d5-4d3b-9ac0-0fa010faf861 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 2.530567 Sep 10 10:34:05.027743 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 43/69] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:02 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 2536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:05.039130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ef75ca56-3476-4f4a-be32-d8c62adb4dea tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:05.048794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ef75ca56-3476-4f4a-be32-d8c62adb4dea tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:05.106876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d99bda71-aa96-49ce-820c-41f98110b3ca tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-191620596", "ram": 512, "vcpus": 1, "disk": 10, "id": 1908483279, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:05.162665 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d99bda71-aa96-49ce-820c-41f98110b3ca tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 1.124881 Sep 10 10:34:05.171566 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 27/70] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:04 2022] POST /compute/v2.1/flavors => generated 415 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:05.184262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f923e018-1b16-48b1-a335-cbc9212eea71 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:05.321210 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f923e018-1b16-48b1-a335-cbc9212eea71 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1908483279/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.145786 Sep 10 10:34:05.321528 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 28/71] 10.222.0.20 () {60 vars in 1224 bytes} [Sat Sep 10 10:34:05 2022] POST /compute/v2.1/flavors/1908483279/os-extra_specs => generated 66 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 10:34:05.357766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ef75ca56-3476-4f4a-be32-d8c62adb4dea tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:05.410878 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ef75ca56-3476-4f4a-be32-d8c62adb4dea tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1219 microversion: 2.1 time: 0.381583 Sep 10 10:34:05.445514 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 44/72] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:05 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1219 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:06.052734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:06.056291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:06.076307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:06.078469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:06.079397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:06.080332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:06.083181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:06.085332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:06.108376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8146938d-68bf-40b4-b895-5a09dc5eda16 tempest-FlavorsExtraSpecsTestJSON-2103630832 tempest-FlavorsExtraSpecsTestJSON-2103630832-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:06.128577 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8146938d-68bf-40b4-b895-5a09dc5eda16 tempest-FlavorsExtraSpecsTestJSON-2103630832 tempest-FlavorsExtraSpecsTestJSON-2103630832-project] 10.222.0.20 "GET /compute/v2.1/flavors/1908483279/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.798072 Sep 10 10:34:06.129214 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 29/73] 10.222.0.20 () {58 vars in 1203 bytes} [Sat Sep 10 10:34:05 2022] GET /compute/v2.1/flavors/1908483279/os-extra_specs => generated 66 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:34:06.177651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32592541-7086-4cd0-9f24-7caaae2cb07a tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:06.265593 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-32592541-7086-4cd0-9f24-7caaae2cb07a tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1908483279/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.124620 Sep 10 10:34:06.268043 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 30/74] 10.222.0.20 () {60 vars in 1224 bytes} [Sat Sep 10 10:34:06 2022] POST /compute/v2.1/flavors/1908483279/os-extra_specs => generated 66 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:34:06.308739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f41bb1a3-dcfc-4bbe-b519-6ed457cccb17 tempest-FlavorsExtraSpecsTestJSON-2103630832 tempest-FlavorsExtraSpecsTestJSON-2103630832-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:06.350908 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f41bb1a3-dcfc-4bbe-b519-6ed457cccb17 tempest-FlavorsExtraSpecsTestJSON-2103630832 tempest-FlavorsExtraSpecsTestJSON-2103630832-project] 10.222.0.20 "GET /compute/v2.1/flavors/1908483279/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.065406 Sep 10 10:34:06.355560 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 31/75] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:34:06 2022] GET /compute/v2.1/flavors/1908483279/os-extra_specs/hw:numa_nodes => generated 22 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:34:06.368539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c60450aa-543d-4449-ba72-d88a931cf171 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:06.481099 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c60450aa-543d-4449-ba72-d88a931cf171 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1908483279/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.114506 Sep 10 10:34:06.492232 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 32/76] 10.222.0.20 () {60 vars in 1224 bytes} [Sat Sep 10 10:34:06 2022] POST /compute/v2.1/flavors/1908483279/os-extra_specs => generated 66 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 10:34:06.505343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-800e6f23-ccf2-4cee-96e4-03935de62f00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:06.506132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-800e6f23-ccf2-4cee-96e4-03935de62f00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:06.526118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-800e6f23-ccf2-4cee-96e4-03935de62f00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:06.527383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-800e6f23-ccf2-4cee-96e4-03935de62f00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:06.528755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-800e6f23-ccf2-4cee-96e4-03935de62f00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:06.532943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-800e6f23-ccf2-4cee-96e4-03935de62f00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:06.533589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-800e6f23-ccf2-4cee-96e4-03935de62f00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:06.534184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-800e6f23-ccf2-4cee-96e4-03935de62f00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:06.721086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:06.744778 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.700809 Sep 10 10:34:06.751395 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 45/77] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:06 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:06.754552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:06.758963 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ee36ba18-6af6-47d3-8dbc-628d93d47900 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004751 Sep 10 10:34:06.773034 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 46/78] 10.222.0.20 () {56 vars in 886 bytes} [Sat Sep 10 10:34:06 2022] GET /compute/ => generated 377 bytes in 20 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 10:34:06.789221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aeec5ab9-f7ad-4eff-b6cc-e6c1ed9dc510 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:06.840454 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aeec5ab9-f7ad-4eff-b6cc-e6c1ed9dc510 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1908483279/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064556 Sep 10 10:34:06.843672 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 47/79] 10.222.0.20 () {58 vars in 1203 bytes} [Sat Sep 10 10:34:06 2022] GET /compute/v2.1/flavors/1908483279/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:34:06.860546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-93a3ab9f-5c31-4394-b147-9533257593bf tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:06.910229 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-93a3ab9f-5c31-4394-b147-9533257593bf tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1908483279/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.061470 Sep 10 10:34:06.920546 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 48/80] 10.222.0.20 () {60 vars in 1265 bytes} [Sat Sep 10 10:34:06 2022] PUT /compute/v2.1/flavors/1908483279/os-extra_specs/hw:numa_nodes => generated 22 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:34:06.930667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5f8b3449-1eff-4758-b63c-28ff8fba71f3 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:06.931708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-800e6f23-ccf2-4cee-96e4-03935de62f00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:06.958695 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-800e6f23-ccf2-4cee-96e4-03935de62f00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1271 microversion: 2.1 time: 0.465020 Sep 10 10:34:06.964694 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5f8b3449-1eff-4758-b63c-28ff8fba71f3 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1908483279/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035831 Sep 10 10:34:06.966823 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 49/81] 10.222.0.20 () {58 vars in 1203 bytes} [Sat Sep 10 10:34:06 2022] GET /compute/v2.1/flavors/1908483279/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:34:06.967302 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 33/82] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:06 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1271 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:06.982827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27ea96c8-e6da-4e86-af46-b9924cf22bfe tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:07.046591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=9,nova_api:DELETE=4,nova_api:SAVEPOINT=7,nova_api:RELEASE=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:07.082035 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27ea96c8-e6da-4e86-af46-b9924cf22bfe tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1908483279/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.109411 Sep 10 10:34:07.085083 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 34/83] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:34:06 2022] DELETE /compute/v2.1/flavors/1908483279/os-extra_specs/hw:numa_nodes => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:34:07.097223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=14,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:07.102688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ddfac958-75e9-4195-a484-36a4cf54d647 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:07.231191 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ddfac958-75e9-4195-a484-36a4cf54d647 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1908483279/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.134583 Sep 10 10:34:07.241206 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 50/84] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:34:07 2022] DELETE /compute/v2.1/flavors/1908483279/os-extra_specs/hw:cpu_policy => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:34:07.258309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c0e8a8d-3b41-49fa-9333-2707c40bde31 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:07.292261 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c0e8a8d-3b41-49fa-9333-2707c40bde31 tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1908483279/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.043348 Sep 10 10:34:07.296217 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 35/85] 10.222.0.20 () {58 vars in 1203 bytes} [Sat Sep 10 10:34:07 2022] GET /compute/v2.1/flavors/1908483279/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:34:07.317292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4aa31f1-e3e9-45bb-bd41-b65aaef48a6f tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:07.375224 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b4aa31f1-e3e9-45bb-bd41-b65aaef48a6f tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1908483279" status: 202 len: 0 microversion: 2.1 time: 0.068470 Sep 10 10:34:07.388191 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 51/86] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:34:07 2022] DELETE /compute/v2.1/flavors/1908483279 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:34:07.397261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ba6ab37-f274-4228-93fe-848a3766554b tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:07.511572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ba6ab37-f274-4228-93fe-848a3766554b tempest-FlavorsExtraSpecsTestJSON-501309504 tempest-FlavorsExtraSpecsTestJSON-501309504-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.119979 Sep 10 10:34:07.518146 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 36/87] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:34:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:07.777325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ddfb9a56-d616-4dff-a312-410315536b32 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:07.778160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ddfb9a56-d616-4dff-a312-410315536b32 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:07.813647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a56-d616-4dff-a312-410315536b32 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:07.817870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a56-d616-4dff-a312-410315536b32 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:07.818508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a56-d616-4dff-a312-410315536b32 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:07.820233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a56-d616-4dff-a312-410315536b32 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:07.824693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a56-d616-4dff-a312-410315536b32 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:07.827855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddfb9a56-d616-4dff-a312-410315536b32 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:08.330379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Calling method '.version_select at 0x7efcaf65c0d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:08.332079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:08.332633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:08.333092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:08.383195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:08.384748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:08.387418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:08.418386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:08.420887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:08.421673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:08.436192 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e435f52f-034a-4809-9e2f-1841d2b4dd7d tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.523077 Sep 10 10:34:08.442903 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 37/88] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:34:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 10:34:08.447285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f14427e8-7b8d-47ba-909c-8ac7927e21d8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:08.447928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f14427e8-7b8d-47ba-909c-8ac7927e21d8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:08.466481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f14427e8-7b8d-47ba-909c-8ac7927e21d8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:08.467236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f14427e8-7b8d-47ba-909c-8ac7927e21d8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:08.468412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f14427e8-7b8d-47ba-909c-8ac7927e21d8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:08.470850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f14427e8-7b8d-47ba-909c-8ac7927e21d8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:08.480482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f14427e8-7b8d-47ba-909c-8ac7927e21d8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:08.481354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f14427e8-7b8d-47ba-909c-8ac7927e21d8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:09.088683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ddfb9a56-d616-4dff-a312-410315536b32 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:09.100193 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ddfb9a56-d616-4dff-a312-410315536b32 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 1.330685 Sep 10 10:34:09.101631 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 52/89] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:07 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:09.116573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e69bb25a-db42-4823-b9e5-1251b746d7e1 tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Calling method '.version_select at 0x7efcaf840af0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:09.118855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69bb25a-db42-4823-b9e5-1251b746d7e1 tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:09.119480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69bb25a-db42-4823-b9e5-1251b746d7e1 tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:09.127598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69bb25a-db42-4823-b9e5-1251b746d7e1 tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:09.187257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69bb25a-db42-4823-b9e5-1251b746d7e1 tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:09.187920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69bb25a-db42-4823-b9e5-1251b746d7e1 tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:09.189218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69bb25a-db42-4823-b9e5-1251b746d7e1 tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:09.211598 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e69bb25a-db42-4823-b9e5-1251b746d7e1 tempest-HypervisorAdminV228Test-627594769 tempest-HypervisorAdminV228Test-627594769-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.107689 Sep 10 10:34:09.224183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f14427e8-7b8d-47ba-909c-8ac7927e21d8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:09.229450 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 53/90] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Sep 10 10:34:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:09.242762 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f14427e8-7b8d-47ba-909c-8ac7927e21d8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1277 microversion: 2.1 time: 0.799007 Sep 10 10:34:09.259130 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 38/91] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:08 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1277 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:09.935954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7cfcc899-2e0a-4ac4-97e7-a03e46b77f5e req-b2db6cd1-da34-4b37-83cc-695026a5f2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fde3838-50ca-4b70-8740-85058a89e99d", "tag": "83038be3-1f2e-4e9e-af93-64515b7bbf06"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:09.970840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7cfcc899-2e0a-4ac4-97e7-a03e46b77f5e req-b2db6cd1-da34-4b37-83cc-695026a5f2e0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:09.977236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7cfcc899-2e0a-4ac4-97e7-a03e46b77f5e req-b2db6cd1-da34-4b37-83cc-695026a5f2e0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:09.979454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7cfcc899-2e0a-4ac4-97e7-a03e46b77f5e req-b2db6cd1-da34-4b37-83cc-695026a5f2e0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:10.053833 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7cfcc899-2e0a-4ac4-97e7-a03e46b77f5e req-b2db6cd1-da34-4b37-83cc-695026a5f2e0 service nova] Creating event network-changed:83038be3-1f2e-4e9e-af93-64515b7bbf06 for instance 0fde3838-50ca-4b70-8740-85058a89e99d on n-h1-856894-1 Sep 10 10:34:10.054732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7cfcc899-2e0a-4ac4-97e7-a03e46b77f5e req-b2db6cd1-da34-4b37-83cc-695026a5f2e0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:34:10.055291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7cfcc899-2e0a-4ac4-97e7-a03e46b77f5e req-b2db6cd1-da34-4b37-83cc-695026a5f2e0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:34:10.056613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb0dfb6-ec7b-4f81-89d1-31c0600651ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:10.062453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb0dfb6-ec7b-4f81-89d1-31c0600651ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:10.063141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb0dfb6-ec7b-4f81-89d1-31c0600651ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:10.066130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb0dfb6-ec7b-4f81-89d1-31c0600651ce None None] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:10.067439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb0dfb6-ec7b-4f81-89d1-31c0600651ce None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:10.069387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb0dfb6-ec7b-4f81-89d1-31c0600651ce None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:10.097165 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.compute.rpcapi [None req-dcb0dfb6-ec7b-4f81-89d1-31c0600651ce None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 10 10:34:10.104605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb0dfb6-ec7b-4f81-89d1-31c0600651ce None None] Releasing lock "compute-rpcapi-router" {{(pid=128787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:34:10.130336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3acb47dd-d042-4184-b3d1-a9149ea8e8c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:10.131750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3acb47dd-d042-4184-b3d1-a9149ea8e8c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:10.147223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3acb47dd-d042-4184-b3d1-a9149ea8e8c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:10.151055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3acb47dd-d042-4184-b3d1-a9149ea8e8c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:10.152080 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dcb0dfb6-ec7b-4f81-89d1-31c0600651ce None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.592950 Sep 10 10:34:10.153165 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 54/92] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:10.153835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3acb47dd-d042-4184-b3d1-a9149ea8e8c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:10.154703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3acb47dd-d042-4184-b3d1-a9149ea8e8c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:10.158682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3acb47dd-d042-4184-b3d1-a9149ea8e8c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:10.159869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3acb47dd-d042-4184-b3d1-a9149ea8e8c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:10.276060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1839c5dc-bac8-4ff0-b08a-0077242ec97d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:10.276787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1839c5dc-bac8-4ff0-b08a-0077242ec97d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:10.295140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1839c5dc-bac8-4ff0-b08a-0077242ec97d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:10.303012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1839c5dc-bac8-4ff0-b08a-0077242ec97d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:10.303490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1839c5dc-bac8-4ff0-b08a-0077242ec97d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:10.304256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1839c5dc-bac8-4ff0-b08a-0077242ec97d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:10.304728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1839c5dc-bac8-4ff0-b08a-0077242ec97d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:10.305183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1839c5dc-bac8-4ff0-b08a-0077242ec97d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:10.728082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1839c5dc-bac8-4ff0-b08a-0077242ec97d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:10.754201 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1839c5dc-bac8-4ff0-b08a-0077242ec97d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1277 microversion: 2.1 time: 0.472212 Sep 10 10:34:10.766764 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 55/93] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:10 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1277 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:11.789861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ffd49b90-c7ae-4f52-ab77-b373bb59802d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:11.792130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ffd49b90-c7ae-4f52-ab77-b373bb59802d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:11.815696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffd49b90-c7ae-4f52-ab77-b373bb59802d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:11.817128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffd49b90-c7ae-4f52-ab77-b373bb59802d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:11.817884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffd49b90-c7ae-4f52-ab77-b373bb59802d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:11.819919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffd49b90-c7ae-4f52-ab77-b373bb59802d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:11.821249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffd49b90-c7ae-4f52-ab77-b373bb59802d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:11.822081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffd49b90-c7ae-4f52-ab77-b373bb59802d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:12.213569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3acb47dd-d042-4184-b3d1-a9149ea8e8c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:12.224761 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3acb47dd-d042-4184-b3d1-a9149ea8e8c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 2.099427 Sep 10 10:34:12.236373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 39/94] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:10 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:12.663266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ffd49b90-c7ae-4f52-ab77-b373bb59802d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:12.679409 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ffd49b90-c7ae-4f52-ab77-b373bb59802d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.899270 Sep 10 10:34:12.707304 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 56/95] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:11 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:12.982413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Calling method '.version_select at 0x7efcaf6ceb80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:12.984519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:12.985128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:12.985691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.018798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.019754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.020399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.043947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.048829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.049632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.059658 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-939672e7-25d2-4570-8463-18830750423b tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.604252 Sep 10 10:34:13.073130 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 40/96] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:34:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:13.084905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Calling method '.version_select at 0x7efcaf78ea60>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:13.087800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.088496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.089172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.120751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.125951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.129627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.155005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.157406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.158229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.179727 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-031e0e59-8612-4666-887a-f33a99afda5e tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.098643 Sep 10 10:34:13.183170 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 57/97] 10.222.0.20 () {58 vars in 1167 bytes} [Sat Sep 10 10:34:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:13.202486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Calling method '.version_select at 0x7efcaf6721f0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:13.205347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.206074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.206901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.260783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-90707257-48ab-4064-b495-f0f0ffb0aa27 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:13.262059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-90707257-48ab-4064-b495-f0f0ffb0aa27 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:13.275504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.276807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.281047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.283198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90707257-48ab-4064-b495-f0f0ffb0aa27 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.290332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90707257-48ab-4064-b495-f0f0ffb0aa27 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.292912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90707257-48ab-4064-b495-f0f0ffb0aa27 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.295978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90707257-48ab-4064-b495-f0f0ffb0aa27 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.296865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90707257-48ab-4064-b495-f0f0ffb0aa27 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.302719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90707257-48ab-4064-b495-f0f0ffb0aa27 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.339006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.339533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.343013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.378144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15af1e74-0117-4960-b2ab-b56e42b347a8 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.175320 Sep 10 10:34:13.380151 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 41/98] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:34:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:13.404796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a612aa9c-dac8-4c9e-b12f-caf89ab20683 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Calling method '.version_select at 0x7efcaf5ef1f0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:13.416500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a612aa9c-dac8-4c9e-b12f-caf89ab20683 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.417648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a612aa9c-dac8-4c9e-b12f-caf89ab20683 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.418428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a612aa9c-dac8-4c9e-b12f-caf89ab20683 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.477833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a612aa9c-dac8-4c9e-b12f-caf89ab20683 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.481366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a612aa9c-dac8-4c9e-b12f-caf89ab20683 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.483508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a612aa9c-dac8-4c9e-b12f-caf89ab20683 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.508517 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a612aa9c-dac8-4c9e-b12f-caf89ab20683 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.119361 Sep 10 10:34:13.510455 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 42/99] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:13.535793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b6ee87c-0229-444d-a96a-b1049913c971 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Calling method '.version_select at 0x7efcaf672c10>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:13.540910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b6ee87c-0229-444d-a96a-b1049913c971 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.548724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b6ee87c-0229-444d-a96a-b1049913c971 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.552784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b6ee87c-0229-444d-a96a-b1049913c971 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.629272 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b6ee87c-0229-444d-a96a-b1049913c971 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.098157 Sep 10 10:34:13.630849 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 43/100] 10.222.0.20 () {58 vars in 1179 bytes} [Sat Sep 10 10:34:13 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:13.657669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Calling method '.version_select at 0x7efcaf736700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:13.667907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.668871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.672076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.712431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.714735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.720029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.756732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.758776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.760746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.781052 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71040309-8483-4f22-b87f-f004fe2f857a tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.140289 Sep 10 10:34:13.782696 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 44/101] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:34:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:13.799194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51a1deea-cc1f-42e4-a2f0-fe54b6c081d3 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:13.801258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51a1deea-cc1f-42e4-a2f0-fe54b6c081d3 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:13.820845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51a1deea-cc1f-42e4-a2f0-fe54b6c081d3 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.822720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51a1deea-cc1f-42e4-a2f0-fe54b6c081d3 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.823377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51a1deea-cc1f-42e4-a2f0-fe54b6c081d3 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.826428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51a1deea-cc1f-42e4-a2f0-fe54b6c081d3 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:13.827611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51a1deea-cc1f-42e4-a2f0-fe54b6c081d3 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:13.829272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51a1deea-cc1f-42e4-a2f0-fe54b6c081d3 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:13.942173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:13.969289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=16 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:14.294201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-90707257-48ab-4064-b495-f0f0ffb0aa27 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:14.322464 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-90707257-48ab-4064-b495-f0f0ffb0aa27 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 1.066449 Sep 10 10:34:14.325154 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 58/102] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:13 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:14.356119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d1cd4094-1c0c-4220-873a-6c0fc1f38c7f tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Calling method '.version_select at 0x7efcaf83ac10>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:14.370206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1cd4094-1c0c-4220-873a-6c0fc1f38c7f tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:14.375161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1cd4094-1c0c-4220-873a-6c0fc1f38c7f tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:14.379796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1cd4094-1c0c-4220-873a-6c0fc1f38c7f tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:14.439561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1cd4094-1c0c-4220-873a-6c0fc1f38c7f tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:14.442217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1cd4094-1c0c-4220-873a-6c0fc1f38c7f tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:14.443512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1cd4094-1c0c-4220-873a-6c0fc1f38c7f tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:14.471780 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d1cd4094-1c0c-4220-873a-6c0fc1f38c7f tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.134387 Sep 10 10:34:14.476953 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 59/103] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:14 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:15.254979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fdd26f10-fdbf-4373-a80f-521c4723a412 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Calling method '.version_select at 0x7efcaf83ab80>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:15.257106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fdd26f10-fdbf-4373-a80f-521c4723a412 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '292026e9014042d8b3df31ab4fbf43be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac009e85133f4fb88fed416d738b4cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fdd26f10-fdbf-4373-a80f-521c4723a412 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Request method failure captured: Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgkvum-PZGWr6_aq0knaHxiYis7Mt6dfaLv0voQvdiJ2mjvIN7L-4Qm7uSw8DvoKN02blH10oajyj5D4gQR8mcoRfOqHHMYd8xiKwWcPy1ZKkb8r3Uar2FJJMZNr8a7ezXQDvdCdd9UMxjh-YIKJbEef6ev1gKzazI0qqC2cAfkDig Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: ac009e85133f4fb88fed416d738b4cd6 Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:15.262334 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac009e85133f4fb88fed416d738b4cd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: ac009e85133f4fb88fed416d738b4cd6 Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HypervisorAdminNegativeTestJSON-771518973-project Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 292026e9014042d8b3df31ab4fbf43be Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-771518973-project Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: action_args: {} Sep 10 10:34:15.263808 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:15.265223 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 10 10:34:15.266435 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:15.270260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fdd26f10-fdbf-4373-a80f-521c4723a412 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:15.272582 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fdd26f10-fdbf-4373-a80f-521c4723a412 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.794235 Sep 10 10:34:15.281222 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 60/104] 10.222.0.20 () {58 vars in 1167 bytes} [Sat Sep 10 10:34:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 803 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:15.294520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-14a664f7-aae5-4ab3-98ca-003173fd8433 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Calling method '.version_select at 0x7efcafa6e550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:15.300970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14a664f7-aae5-4ab3-98ca-003173fd8433 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:15.303772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14a664f7-aae5-4ab3-98ca-003173fd8433 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:15.306156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14a664f7-aae5-4ab3-98ca-003173fd8433 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:15.353572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14a664f7-aae5-4ab3-98ca-003173fd8433 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:15.354288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14a664f7-aae5-4ab3-98ca-003173fd8433 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:15.354928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14a664f7-aae5-4ab3-98ca-003173fd8433 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:15.374622 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-14a664f7-aae5-4ab3-98ca-003173fd8433 tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.091059 Sep 10 10:34:15.388334 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 61/105] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:15 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:15.400811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0d876bf4-30ac-48bb-b414-5cd34ff3a56e tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Calling method '.version_select at 0x7efcaf83a1f0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:15.406959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0d876bf4-30ac-48bb-b414-5cd34ff3a56e tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '292026e9014042d8b3df31ab4fbf43be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac009e85133f4fb88fed416d738b4cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0d876bf4-30ac-48bb-b414-5cd34ff3a56e tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Request method failure captured: Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgkvum-PZGWr6_aq0knaHxiYis7Mt6dfaLv0voQvdiJ2mjvIN7L-4Qm7uSw8DvoKN02blH10oajyj5D4gQR8mcoRfOqHHMYd8xiKwWcPy1ZKkb8r3Uar2FJJMZNr8a7ezXQDvdCdd9UMxjh-YIKJbEef6ev1gKzazI0qqC2cAfkDig Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: ac009e85133f4fb88fed416d738b4cd6 Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:15.412794 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac009e85133f4fb88fed416d738b4cd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: ac009e85133f4fb88fed416d738b4cd6 Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HypervisorAdminNegativeTestJSON-771518973-project Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 292026e9014042d8b3df31ab4fbf43be Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-771518973-project Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: action_args: {} Sep 10 10:34:15.413956 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:15.414611 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 10 10:34:15.415552 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:15.419545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0d876bf4-30ac-48bb-b414-5cd34ff3a56e tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:15.420749 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0d876bf4-30ac-48bb-b414-5cd34ff3a56e tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.029084 Sep 10 10:34:15.428408 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 62/106] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:34:15 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:15.441263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d169df08-1c48-4c45-8699-7b7245961323 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:15.442221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d169df08-1c48-4c45-8699-7b7245961323 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:15.456859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:15.462250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d169df08-1c48-4c45-8699-7b7245961323 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:15.463013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d169df08-1c48-4c45-8699-7b7245961323 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:15.464763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d169df08-1c48-4c45-8699-7b7245961323 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:15.466013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d169df08-1c48-4c45-8699-7b7245961323 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:15.468925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d169df08-1c48-4c45-8699-7b7245961323 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:15.469734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d169df08-1c48-4c45-8699-7b7245961323 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:15.681583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-51a1deea-cc1f-42e4-a2f0-fe54b6c081d3 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:15.697486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51a1deea-cc1f-42e4-a2f0-fe54b6c081d3 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 1.913308 Sep 10 10:34:15.705606 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 45/107] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:13 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:15.711060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Calling method '.version_select at 0x7efcaf65cca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:15.714433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:15.716752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:15.718715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:15.750958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:15.751848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:15.752516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:15.792823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:15.793392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:15.796246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:15.808244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:15.827379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:34:15.827798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91c8a516-6875-405c-9072-72953e3c68ae tempest-HypervisorAdminTestJSON-1480830357 tempest-HypervisorAdminTestJSON-1480830357-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:34:15.828917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ca6b7e2-2bd1-4f80-89e5-e1616e58be1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:15.841630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ca6b7e2-2bd1-4f80-89e5-e1616e58be1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:15.842211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ca6b7e2-2bd1-4f80-89e5-e1616e58be1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:15.843712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ca6b7e2-2bd1-4f80-89e5-e1616e58be1b None None] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:15.844242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ca6b7e2-2bd1-4f80-89e5-e1616e58be1b None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:15.844753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ca6b7e2-2bd1-4f80-89e5-e1616e58be1b None None] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:15.882756 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.compute.rpcapi [None req-7ca6b7e2-2bd1-4f80-89e5-e1616e58be1b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 10 10:34:15.884462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ca6b7e2-2bd1-4f80-89e5-e1616e58be1b None None] Releasing lock "compute-rpcapi-router" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:34:15.952480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d169df08-1c48-4c45-8699-7b7245961323 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:15.962482 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d169df08-1c48-4c45-8699-7b7245961323 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.532448 Sep 10 10:34:15.965562 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7ca6b7e2-2bd1-4f80-89e5-e1616e58be1b None None] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.258093 Sep 10 10:34:15.966117 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 46/108] 10.222.0.20 () {58 vars in 1173 bytes} [Sat Sep 10 10:34:15 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:15.981698 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 63/109] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:15 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:15.986935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4eff2461-0e3e-4de3-93f6-1674821488b9 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Calling method '.version_select at 0x7efcaf65c820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:16.006214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4eff2461-0e3e-4de3-93f6-1674821488b9 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '292026e9014042d8b3df31ab4fbf43be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac009e85133f4fb88fed416d738b4cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4eff2461-0e3e-4de3-93f6-1674821488b9 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Request method failure captured: Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgkvum-PZGWr6_aq0knaHxiYis7Mt6dfaLv0voQvdiJ2mjvIN7L-4Qm7uSw8DvoKN02blH10oajyj5D4gQR8mcoRfOqHHMYd8xiKwWcPy1ZKkb8r3Uar2FJJMZNr8a7ezXQDvdCdd9UMxjh-YIKJbEef6ev1gKzazI0qqC2cAfkDig Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ac009e85133f4fb88fed416d738b4cd6 Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:34:16.009515 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac009e85133f4fb88fed416d738b4cd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ac009e85133f4fb88fed416d738b4cd6 Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HypervisorAdminNegativeTestJSON-771518973-project Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 292026e9014042d8b3df31ab4fbf43be Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-771518973-project Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: action_args: {} Sep 10 10:34:16.010931 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:16.011766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 10 10:34:16.012964 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:16.031238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4eff2461-0e3e-4de3-93f6-1674821488b9 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:16.032413 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4eff2461-0e3e-4de3-93f6-1674821488b9 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.054074 Sep 10 10:34:16.034807 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 47/110] 10.222.0.20 () {58 vars in 1179 bytes} [Sat Sep 10 10:34:15 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:16.825351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5d5abe05-64ac-4464-a135-ea336f046d63 req-d9771fcb-0081-4d65-89de-354dcbab2a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "386253a1-3a4d-4a5f-8ca2-1177b1ff7df7", "tag": "85cc248c-852d-4826-ae94-5dfd332eabec"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:16.857398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Calling method '.version_select at 0x7efcafa6e550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:16.861364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5d5abe05-64ac-4464-a135-ea336f046d63 req-d9771fcb-0081-4d65-89de-354dcbab2a47 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:16.861849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5d5abe05-64ac-4464-a135-ea336f046d63 req-d9771fcb-0081-4d65-89de-354dcbab2a47 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:16.861985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:16.862375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5d5abe05-64ac-4464-a135-ea336f046d63 req-d9771fcb-0081-4d65-89de-354dcbab2a47 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:16.862480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:16.864070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:16.889579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:16.890419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:16.891309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:16.905762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:16.906497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:16.907490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:16.921307 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e567584c-21f6-4856-bd1e-b72e68658e7f tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.880088 Sep 10 10:34:16.922240 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 64/111] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:34:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:16.930304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b874ae08-4282-4579-9a4e-e63ad8a7a8eb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:16.931149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b874ae08-4282-4579-9a4e-e63ad8a7a8eb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:16.941149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b874ae08-4282-4579-9a4e-e63ad8a7a8eb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:16.941887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b874ae08-4282-4579-9a4e-e63ad8a7a8eb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:16.942758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b874ae08-4282-4579-9a4e-e63ad8a7a8eb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:16.944255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b874ae08-4282-4579-9a4e-e63ad8a7a8eb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:16.945361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b874ae08-4282-4579-9a4e-e63ad8a7a8eb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:16.945941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b874ae08-4282-4579-9a4e-e63ad8a7a8eb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:16.957054 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5d5abe05-64ac-4464-a135-ea336f046d63 req-d9771fcb-0081-4d65-89de-354dcbab2a47 service nova] Creating event network-changed:85cc248c-852d-4826-ae94-5dfd332eabec for instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 on n-h2-856894-1 Sep 10 10:34:16.970921 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5d5abe05-64ac-4464-a135-ea336f046d63 req-d9771fcb-0081-4d65-89de-354dcbab2a47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.765736 Sep 10 10:34:16.977252 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 48/112] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:16.998306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32a6509c-a3d1-4b75-8078-bff6cbe9a2e5 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Calling method '.version_select at 0x7efcaf51c9d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:17.029312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-32a6509c-a3d1-4b75-8078-bff6cbe9a2e5 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '292026e9014042d8b3df31ab4fbf43be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac009e85133f4fb88fed416d738b4cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32a6509c-a3d1-4b75-8078-bff6cbe9a2e5 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Request method failure captured: Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgkvum-PZGWr6_aq0knaHxiYis7Mt6dfaLv0voQvdiJ2mjvIN7L-4Qm7uSw8DvoKN02blH10oajyj5D4gQR8mcoRfOqHHMYd8xiKwWcPy1ZKkb8r3Uar2FJJMZNr8a7ezXQDvdCdd9UMxjh-YIKJbEef6ev1gKzazI0qqC2cAfkDig Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ac009e85133f4fb88fed416d738b4cd6 Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:34:17.032269 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac009e85133f4fb88fed416d738b4cd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ac009e85133f4fb88fed416d738b4cd6 Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HypervisorAdminNegativeTestJSON-771518973-project Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 292026e9014042d8b3df31ab4fbf43be Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-771518973-project Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '1'} Sep 10 10:34:17.033425 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:17.034089 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 10 10:34:17.037940 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.040508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32a6509c-a3d1-4b75-8078-bff6cbe9a2e5 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:17.040508 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-32a6509c-a3d1-4b75-8078-bff6cbe9a2e5 tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.055177 Sep 10 10:34:17.040508 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 49/113] 10.222.0.20 () {58 vars in 1173 bytes} [Sat Sep 10 10:34:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:17.042077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b0b37b5-1027-4fcd-91bf-07f0a69c811a tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:17.042952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b0b37b5-1027-4fcd-91bf-07f0a69c811a tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:17.101615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0b37b5-1027-4fcd-91bf-07f0a69c811a tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:17.102199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0b37b5-1027-4fcd-91bf-07f0a69c811a tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:17.102748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0b37b5-1027-4fcd-91bf-07f0a69c811a tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:17.103581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0b37b5-1027-4fcd-91bf-07f0a69c811a tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:17.104036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0b37b5-1027-4fcd-91bf-07f0a69c811a tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:17.104474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0b37b5-1027-4fcd-91bf-07f0a69c811a tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:17.409392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b874ae08-4282-4579-9a4e-e63ad8a7a8eb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:17.424173 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b874ae08-4282-4579-9a4e-e63ad8a7a8eb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.500324 Sep 10 10:34:17.425035 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 65/114] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:16 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:17.446946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cc4f83cf-cd8d-46a4-9bae-0c01a1fc1100 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Calling method '.version_select at 0x7efcaf840ca0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:17.448900 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-cc4f83cf-cd8d-46a4-9bae-0c01a1fc1100 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] HTTP exception thrown: Hypervisor with ID 'f705bf50-616b-4731-bd70-ed0fafcec415' could not be found. Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cc4f83cf-cd8d-46a4-9bae-0c01a1fc1100 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Request method failure captured: Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-hypervisors/f705bf50-616b-4731-bd70-ed0fafcec415/uptime HTTP/1.1 Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgl1MXswpHNEA4uUm_eejVWaBz-XosGbjCsoPwM1ZmCRlMVi4VQY_vpSK3Ml2vfgeT3js-93QgCIx4XB-ISOq3DxTol-IuJckiKjARp1wcFAXq1NhInbCN7jS-9tXx_lHwGwTZcM-bPqQTFTlW8Yhq9Pgwf99fJKGm7LXbS3lLmmhM Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 05360309564f4354a2b0d8d729872a6a Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-61930287 Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:34:17.457616 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05360309564f4354a2b0d8d729872a6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05360309564f4354a2b0d8d729872a6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05360309564f4354a2b0d8d729872a6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05360309564f4354a2b0d8d729872a6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-61930287 Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 05360309564f4354a2b0d8d729872a6a Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-61930287 Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 64b0e558135440ceb2e7169641183084 Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: exception: Hypervisor with ID 'f705bf50-616b-4731-bd70-ed0fafcec415' could not be found. Sep 10 10:34:17.459713 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f705bf50-616b-4731-bd70-ed0fafcec415'} Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f705bf50-616b-4731-bd70-ed0fafcec415' Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 10 10:34:17.460841 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f705bf50-616b-4731-bd70-ed0fafcec415' could not be found. Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:17.463622 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.465580 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.465580 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:17.465580 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:17.465580 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:17.465580 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:17.465580 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f705bf50-616b-4731-bd70-ed0fafcec415' could not be found. Sep 10 10:34:17.465580 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.467533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cc4f83cf-cd8d-46a4-9bae-0c01a1fc1100 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Returning 404 to user: Hypervisor with ID 'f705bf50-616b-4731-bd70-ed0fafcec415' could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:17.469823 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cc4f83cf-cd8d-46a4-9bae-0c01a1fc1100 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/f705bf50-616b-4731-bd70-ed0fafcec415/uptime" status: 404 len: 123 microversion: 2.1 time: 0.042608 Sep 10 10:34:17.475385 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 66/115] 10.222.0.20 () {58 vars in 1278 bytes} [Sat Sep 10 10:34:17 2022] GET /compute/v2.1/os-hypervisors/f705bf50-616b-4731-bd70-ed0fafcec415/uptime => generated 123 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:17.495344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Calling method '.version_select at 0x7efcaf83a5e0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:17.502945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:17.503813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:17.504697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:17.554354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:17.557842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:17.558474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:17.591471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:17.598055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:17.600472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:17.618012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:17.621346 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4e3caff1-6d36-4b20-8025-a9171d75bb62 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.144350 Sep 10 10:34:17.625745 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 67/116] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:34:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:17.635563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6ecbb2c4-2284-4f98-a21a-b099dea27edd tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Calling method '.version_select at 0x7efcaf81ff70>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:17.639112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6ecbb2c4-2284-4f98-a21a-b099dea27edd tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '292026e9014042d8b3df31ab4fbf43be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac009e85133f4fb88fed416d738b4cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6ecbb2c4-2284-4f98-a21a-b099dea27edd tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Request method failure captured: Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgkvum-PZGWr6_aq0knaHxiYis7Mt6dfaLv0voQvdiJ2mjvIN7L-4Qm7uSw8DvoKN02blH10oajyj5D4gQR8mcoRfOqHHMYd8xiKwWcPy1ZKkb8r3Uar2FJJMZNr8a7ezXQDvdCdd9UMxjh-YIKJbEef6ev1gKzazI0qqC2cAfkDig Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: ac009e85133f4fb88fed416d738b4cd6 Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:17.642017 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac009e85133f4fb88fed416d738b4cd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac009e85133f4fb88fed416d738b4cd6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: ac009e85133f4fb88fed416d738b4cd6 Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-771518973 Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HypervisorAdminNegativeTestJSON-771518973-project Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 292026e9014042d8b3df31ab4fbf43be Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-771518973-project Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '1'} Sep 10 10:34:17.643103 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:17.643739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 10 10:34:17.644666 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.649984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6ecbb2c4-2284-4f98-a21a-b099dea27edd tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:17.655242 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6ecbb2c4-2284-4f98-a21a-b099dea27edd tempest-HypervisorAdminNegativeTestJSON-771518973 tempest-HypervisorAdminNegativeTestJSON-771518973-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.021760 Sep 10 10:34:17.658390 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 68/117] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:17.678603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-53c46842-15bb-4d47-a559-9b70344a5a15 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Calling method '.version_select at 0x7efcaf83ac10>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:17.680916 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-53c46842-15bb-4d47-a559-9b70344a5a15 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] HTTP exception thrown: Hypervisor with ID '9306fbbc-a4e0-45c7-bce1-562c3bded8cc' could not be found. Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-53c46842-15bb-4d47-a559-9b70344a5a15 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Request method failure captured: Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-hypervisors/9306fbbc-a4e0-45c7-bce1-562c3bded8cc HTTP/1.1 Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgl1MXswpHNEA4uUm_eejVWaBz-XosGbjCsoPwM1ZmCRlMVi4VQY_vpSK3Ml2vfgeT3js-93QgCIx4XB-ISOq3DxTol-IuJckiKjARp1wcFAXq1NhInbCN7jS-9tXx_lHwGwTZcM-bPqQTFTlW8Yhq9Pgwf99fJKGm7LXbS3lLmmhM Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 05360309564f4354a2b0d8d729872a6a Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-61930287 Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:34:17.682901 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05360309564f4354a2b0d8d729872a6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05360309564f4354a2b0d8d729872a6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05360309564f4354a2b0d8d729872a6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05360309564f4354a2b0d8d729872a6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-61930287 Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 05360309564f4354a2b0d8d729872a6a Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-61930287 Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 64b0e558135440ceb2e7169641183084 Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: exception: Hypervisor with ID '9306fbbc-a4e0-45c7-bce1-562c3bded8cc' could not be found. Sep 10 10:34:17.685011 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '9306fbbc-a4e0-45c7-bce1-562c3bded8cc'} Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9306fbbc-a4e0-45c7-bce1-562c3bded8cc' Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 10 10:34:17.685658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:34:17.687279 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9306fbbc-a4e0-45c7-bce1-562c3bded8cc' could not be found. Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9306fbbc-a4e0-45c7-bce1-562c3bded8cc' could not be found. Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-53c46842-15bb-4d47-a559-9b70344a5a15 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] Returning 404 to user: Hypervisor with ID '9306fbbc-a4e0-45c7-bce1-562c3bded8cc' could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-53c46842-15bb-4d47-a559-9b70344a5a15 tempest-HypervisorAdminNegativeTestJSON-61930287 tempest-HypervisorAdminNegativeTestJSON-61930287-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/9306fbbc-a4e0-45c7-bce1-562c3bded8cc" status: 404 len: 123 microversion: 2.1 time: 0.023873 Sep 10 10:34:17.688235 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 69/118] 10.222.0.20 () {58 vars in 1257 bytes} [Sat Sep 10 10:34:17 2022] GET /compute/v2.1/os-hypervisors/9306fbbc-a4e0-45c7-bce1-562c3bded8cc => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:18.063061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b0b37b5-1027-4fcd-91bf-07f0a69c811a tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:18.077915 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b0b37b5-1027-4fcd-91bf-07f0a69c811a tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 1.039837 Sep 10 10:34:18.083088 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 50/119] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:17 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:18.458699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5e2bf762-b2c8-4e40-9c6a-dbb002e3fb51 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:18.459314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5e2bf762-b2c8-4e40-9c6a-dbb002e3fb51 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:18.469906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2bf762-b2c8-4e40-9c6a-dbb002e3fb51 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:18.471567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2bf762-b2c8-4e40-9c6a-dbb002e3fb51 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:18.473217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2bf762-b2c8-4e40-9c6a-dbb002e3fb51 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:18.474304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2bf762-b2c8-4e40-9c6a-dbb002e3fb51 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:18.474929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2bf762-b2c8-4e40-9c6a-dbb002e3fb51 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:18.475495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2bf762-b2c8-4e40-9c6a-dbb002e3fb51 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:19.107675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7cb12652-21a6-41ae-b579-9e4daea878ad tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:19.108854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7cb12652-21a6-41ae-b579-9e4daea878ad tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:19.126898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cb12652-21a6-41ae-b579-9e4daea878ad tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:19.128832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cb12652-21a6-41ae-b579-9e4daea878ad tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:19.129856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cb12652-21a6-41ae-b579-9e4daea878ad tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:19.131590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cb12652-21a6-41ae-b579-9e4daea878ad tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:19.135223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cb12652-21a6-41ae-b579-9e4daea878ad tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:19.137285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cb12652-21a6-41ae-b579-9e4daea878ad tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:19.349505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5e2bf762-b2c8-4e40-9c6a-dbb002e3fb51 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:19.360943 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5e2bf762-b2c8-4e40-9c6a-dbb002e3fb51 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.907778 Sep 10 10:34:19.375259 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 70/120] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:18 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:19.775117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7cb12652-21a6-41ae-b579-9e4daea878ad tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:19.797311 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7cb12652-21a6-41ae-b579-9e4daea878ad tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.681152 Sep 10 10:34:19.816354 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 51/121] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:19 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:20.388534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e9dca4e8-fcc8-4906-985a-3733a7bd424f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:20.389484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e9dca4e8-fcc8-4906-985a-3733a7bd424f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:20.398519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:20.404942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9dca4e8-fcc8-4906-985a-3733a7bd424f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:20.407601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9dca4e8-fcc8-4906-985a-3733a7bd424f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:20.410631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9dca4e8-fcc8-4906-985a-3733a7bd424f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:20.414432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9dca4e8-fcc8-4906-985a-3733a7bd424f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:20.415077 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9dca4e8-fcc8-4906-985a-3733a7bd424f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:20.415724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9dca4e8-fcc8-4906-985a-3733a7bd424f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:20.728443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e9dca4e8-fcc8-4906-985a-3733a7bd424f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:20.742070 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e9dca4e8-fcc8-4906-985a-3733a7bd424f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.357694 Sep 10 10:34:20.746232 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 71/122] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:20 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:20.824119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f8a4bbd-d348-4c83-b694-e51a50040778 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:20.825412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f8a4bbd-d348-4c83-b694-e51a50040778 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:20.846274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8a4bbd-d348-4c83-b694-e51a50040778 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:20.847881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8a4bbd-d348-4c83-b694-e51a50040778 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:20.849633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8a4bbd-d348-4c83-b694-e51a50040778 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:20.853984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8a4bbd-d348-4c83-b694-e51a50040778 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:20.854767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8a4bbd-d348-4c83-b694-e51a50040778 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:20.857433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8a4bbd-d348-4c83-b694-e51a50040778 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:21.706000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f8a4bbd-d348-4c83-b694-e51a50040778 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:21.717352 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f8a4bbd-d348-4c83-b694-e51a50040778 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.897214 Sep 10 10:34:21.730187 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 52/123] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:20 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:21.771444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ea36195-4ab5-4a67-a4c1-d3264279dbb8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:21.772117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ea36195-4ab5-4a67-a4c1-d3264279dbb8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:21.782026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ea36195-4ab5-4a67-a4c1-d3264279dbb8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:21.783035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ea36195-4ab5-4a67-a4c1-d3264279dbb8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:21.783781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ea36195-4ab5-4a67-a4c1-d3264279dbb8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:21.785658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ea36195-4ab5-4a67-a4c1-d3264279dbb8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:21.786467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ea36195-4ab5-4a67-a4c1-d3264279dbb8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:21.787198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ea36195-4ab5-4a67-a4c1-d3264279dbb8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:22.335224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ea36195-4ab5-4a67-a4c1-d3264279dbb8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:22.345844 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ea36195-4ab5-4a67-a4c1-d3264279dbb8 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.578971 Sep 10 10:34:22.356234 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 72/124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:21 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:22.748053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ca7d5df-bb6b-48f2-b6fe-26467332d0ed tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:22.750418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ca7d5df-bb6b-48f2-b6fe-26467332d0ed tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:22.770658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ca7d5df-bb6b-48f2-b6fe-26467332d0ed tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:22.771149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ca7d5df-bb6b-48f2-b6fe-26467332d0ed tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:22.774512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ca7d5df-bb6b-48f2-b6fe-26467332d0ed tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:22.776248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ca7d5df-bb6b-48f2-b6fe-26467332d0ed tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:22.777223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ca7d5df-bb6b-48f2-b6fe-26467332d0ed tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:22.777862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ca7d5df-bb6b-48f2-b6fe-26467332d0ed tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:22.883521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e77366d5-94d3-4236-bc7b-379a44ab64c2 tempest-NetworksTest-858338266 tempest-NetworksTest-858338266-project-admin] Calling method '.version_select at 0x7efcaf51c550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:23.254817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ca7d5df-bb6b-48f2-b6fe-26467332d0ed tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:23.270799 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ca7d5df-bb6b-48f2-b6fe-26467332d0ed tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.526378 Sep 10 10:34:23.271340 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 73/125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:22 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:23.387364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1fcd8849-60ad-4643-b899-127d8dd8fe0d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:23.390221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1fcd8849-60ad-4643-b899-127d8dd8fe0d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:23.404260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fcd8849-60ad-4643-b899-127d8dd8fe0d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:23.405369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fcd8849-60ad-4643-b899-127d8dd8fe0d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:23.406301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fcd8849-60ad-4643-b899-127d8dd8fe0d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:23.408742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fcd8849-60ad-4643-b899-127d8dd8fe0d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:23.409781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fcd8849-60ad-4643-b899-127d8dd8fe0d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:23.411081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fcd8849-60ad-4643-b899-127d8dd8fe0d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:23.506957 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e77366d5-94d3-4236-bc7b-379a44ab64c2 tempest-NetworksTest-858338266 tempest-NetworksTest-858338266-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 2633 microversion: 2.1 time: 1.385906 Sep 10 10:34:23.507546 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 53/126] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:34:22 2022] GET /compute/v2.1/os-networks => generated 2633 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:23.516366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aedaa99f-bf94-4821-a636-9d51cf40ba15 tempest-NetworksTest-858338266 tempest-NetworksTest-858338266-project-admin] Calling method '.version_select at 0x7efcaf688310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:23.694050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1fcd8849-60ad-4643-b899-127d8dd8fe0d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:23.707983 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1fcd8849-60ad-4643-b899-127d8dd8fe0d tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.330097 Sep 10 10:34:23.710201 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 74/127] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:23 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:23.829177 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aedaa99f-bf94-4821-a636-9d51cf40ba15 tempest-NetworksTest-858338266 tempest-NetworksTest-858338266-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks/be469d3d-0481-4230-a0e7-ee870dd27e19" status: 200 len: 652 microversion: 2.1 time: 0.316727 Sep 10 10:34:23.829855 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 54/128] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:34:23 2022] GET /compute/v2.1/os-networks/be469d3d-0481-4230-a0e7-ee870dd27e19 => generated 652 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:23.840835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1b82e26f-14a3-425e-817e-135f38e99029 tempest-NetworksTest-858338266 tempest-NetworksTest-858338266-project-admin] Calling method '.version_select at 0x7efcaf78e670>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:24.084167 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1b82e26f-14a3-425e-817e-135f38e99029 tempest-NetworksTest-858338266 tempest-NetworksTest-858338266-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 2633 microversion: 2.1 time: 0.249007 Sep 10 10:34:24.084938 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 75/129] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:34:23 2022] GET /compute/v2.1/os-networks => generated 2633 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:24.293149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6b6f9347-482a-4af6-b880-a4ecd06faba6 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:24.294037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6b6f9347-482a-4af6-b880-a4ecd06faba6 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:24.300011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f9347-482a-4af6-b880-a4ecd06faba6 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.300747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f9347-482a-4af6-b880-a4ecd06faba6 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.301225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f9347-482a-4af6-b880-a4ecd06faba6 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.302090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f9347-482a-4af6-b880-a4ecd06faba6 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.302706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f9347-482a-4af6-b880-a4ecd06faba6 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.303132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f9347-482a-4af6-b880-a4ecd06faba6 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.452668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6b6f9347-482a-4af6-b880-a4ecd06faba6 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:24.462205 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6b6f9347-482a-4af6-b880-a4ecd06faba6 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.173368 Sep 10 10:34:24.462788 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 76/130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:24 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:24.527187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Calling method '.version_select at 0x7efcaf594dc0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:24.531389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.531882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.532329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.546664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.547151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.547595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.568242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.569032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.569645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.588274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.588856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.589422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.619868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.620496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.620940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.629199 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6aaef3d-ec56-42e3-9318-f865e73d657e tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.460413 Sep 10 10:34:24.630450 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 55/131] 10.222.0.20 () {60 vars in 1243 bytes} [Sat Sep 10 10:34:24 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:34:24.648340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Calling method '.version_select at 0x7efcaf81f430>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:24.652160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.652950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.653544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.676327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.676914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.677512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.723735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.724269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.724882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.739566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b205ff94-bec2-47b6-88f4-c5a2a0f8ef55 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:24.740801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.741402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.741512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b205ff94-bec2-47b6-88f4-c5a2a0f8ef55 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:24.742002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.752293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b205ff94-bec2-47b6-88f4-c5a2a0f8ef55 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.754409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b205ff94-bec2-47b6-88f4-c5a2a0f8ef55 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.754867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b205ff94-bec2-47b6-88f4-c5a2a0f8ef55 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.755586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b205ff94-bec2-47b6-88f4-c5a2a0f8ef55 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.756056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b205ff94-bec2-47b6-88f4-c5a2a0f8ef55 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.756488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b205ff94-bec2-47b6-88f4-c5a2a0f8ef55 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.778762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.779460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.780648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.788854 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-32fabf3b-66e5-451b-a214-76a664adac43 tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.144292 Sep 10 10:34:24.789874 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 77/132] 10.222.0.20 () {60 vars in 1222 bytes} [Sat Sep 10 10:34:24 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:24.816195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b3f5e2d1-3053-4310-940b-3657a93eff8d tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Calling method '.version_select at 0x7efcaf78e550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:24.828905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f5e2d1-3053-4310-940b-3657a93eff8d tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.829458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f5e2d1-3053-4310-940b-3657a93eff8d tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.829902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f5e2d1-3053-4310-940b-3657a93eff8d tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.861985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f5e2d1-3053-4310-940b-3657a93eff8d tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:24.863235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f5e2d1-3053-4310-940b-3657a93eff8d tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:24.863989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f5e2d1-3053-4310-940b-3657a93eff8d tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:24.872008 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b3f5e2d1-3053-4310-940b-3657a93eff8d tempest-HypervisorAdminV253TestBase-2007928895 tempest-HypervisorAdminV253TestBase-2007928895-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/348c2cdc-0ced-4ef3-941f-6b1465d36a65" status: 200 len: 792 microversion: 2.53 time: 0.073785 Sep 10 10:34:24.873090 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 78/133] 10.222.0.20 () {60 vars in 1298 bytes} [Sat Sep 10 10:34:24 2022] GET /compute/v2.1/os-hypervisors/348c2cdc-0ced-4ef3-941f-6b1465d36a65 => generated 792 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 10:34:24.951881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b205ff94-bec2-47b6-88f4-c5a2a0f8ef55 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:24.961655 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b205ff94-bec2-47b6-88f4-c5a2a0f8ef55 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.230411 Sep 10 10:34:24.962324 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 56/134] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:24 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:25.488346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e60d73f1-32d3-40d3-ac16-75f73ac9fabb tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:25.489056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e60d73f1-32d3-40d3-ac16-75f73ac9fabb tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:25.500567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e60d73f1-32d3-40d3-ac16-75f73ac9fabb tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:25.503213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e60d73f1-32d3-40d3-ac16-75f73ac9fabb tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:25.503950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e60d73f1-32d3-40d3-ac16-75f73ac9fabb tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:25.504959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e60d73f1-32d3-40d3-ac16-75f73ac9fabb tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:25.507451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e60d73f1-32d3-40d3-ac16-75f73ac9fabb tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:25.508128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e60d73f1-32d3-40d3-ac16-75f73ac9fabb tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:25.681815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e60d73f1-32d3-40d3-ac16-75f73ac9fabb tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:25.702283 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e60d73f1-32d3-40d3-ac16-75f73ac9fabb tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.217062 Sep 10 10:34:25.718062 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 79/135] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:25 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:25.871097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:25.984713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-48ec1e83-e4c9-4851-8adc-36c5f6269bde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:25.986270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-48ec1e83-e4c9-4851-8adc-36c5f6269bde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:25.995697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48ec1e83-e4c9-4851-8adc-36c5f6269bde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:25.996312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48ec1e83-e4c9-4851-8adc-36c5f6269bde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:25.997762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48ec1e83-e4c9-4851-8adc-36c5f6269bde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:25.999696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48ec1e83-e4c9-4851-8adc-36c5f6269bde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:26.000946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48ec1e83-e4c9-4851-8adc-36c5f6269bde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:26.001524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48ec1e83-e4c9-4851-8adc-36c5f6269bde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:26.444330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78b3fd7d-5265-4dcb-a7fb-368b0c1ffd10 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Calling method '.version_select at 0x7efcaf688ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:26.451841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78b3fd7d-5265-4dcb-a7fb-368b0c1ffd10 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:26.453497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78b3fd7d-5265-4dcb-a7fb-368b0c1ffd10 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:26.455936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78b3fd7d-5265-4dcb-a7fb-368b0c1ffd10 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:26.457402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78b3fd7d-5265-4dcb-a7fb-368b0c1ffd10 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:26.458177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78b3fd7d-5265-4dcb-a7fb-368b0c1ffd10 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:26.459228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78b3fd7d-5265-4dcb-a7fb-368b0c1ffd10 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:26.497525 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78b3fd7d-5265-4dcb-a7fb-368b0c1ffd10 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.778061 Sep 10 10:34:26.499526 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 57/136] 10.222.0.20 () {58 vars in 1128 bytes} [Sat Sep 10 10:34:25 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:26.574387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-48ec1e83-e4c9-4851-8adc-36c5f6269bde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:26.585665 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-48ec1e83-e4c9-4851-8adc-36c5f6269bde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.605723 Sep 10 10:34:26.586255 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 80/137] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:25 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:26.728239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e890ba2e-34ec-43cb-a638-a15701760fe5 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:26.728928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e890ba2e-34ec-43cb-a638-a15701760fe5 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:26.742736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e890ba2e-34ec-43cb-a638-a15701760fe5 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:26.744550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e890ba2e-34ec-43cb-a638-a15701760fe5 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:26.744996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e890ba2e-34ec-43cb-a638-a15701760fe5 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:26.745735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e890ba2e-34ec-43cb-a638-a15701760fe5 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:26.746193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e890ba2e-34ec-43cb-a638-a15701760fe5 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:26.746612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e890ba2e-34ec-43cb-a638-a15701760fe5 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:27.067071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e890ba2e-34ec-43cb-a638-a15701760fe5 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:27.079281 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e890ba2e-34ec-43cb-a638-a15701760fe5 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.355142 Sep 10 10:34:27.095166 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 81/138] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:26 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:27.254287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dcf4ee0b-29ff-4224-9ca5-139ffbd59ed2 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Calling method '.version_select at 0x7efcaf5788b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:27.258968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dcf4ee0b-29ff-4224-9ca5-139ffbd59ed2 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '56bbe890c3c446ce80d9341ccc475136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a0182a27324d7ea7eddbbd020a7a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dcf4ee0b-29ff-4224-9ca5-139ffbd59ed2 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Request method failure captured: Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgvpBbNieBqlFq9z2ethuwbZ37Ahbju939KJprkZuLAz_H4NZVeT-0NBraSGbIpayE4Kkbx3j7wSQXwQifDEQOUc061WE_LotQfQ_vc492xrYg3Yo57fVBFrzGcthSgbGyfhhuu3FEVY6agrb4rmLBkagW0iu97sPWTDKHXQGuFMM4 Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:34:27.263164 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4a0182a27324d7ea7eddbbd020a7a48", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 56bbe890c3c446ce80d9341ccc475136 Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: action_args: {} Sep 10 10:34:27.264966 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:27.265781 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 10 10:34:27.266803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.271676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dcf4ee0b-29ff-4224-9ca5-139ffbd59ed2 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.271676 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dcf4ee0b-29ff-4224-9ca5-139ffbd59ed2 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.758422 Sep 10 10:34:27.276123 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 58/139] 10.222.0.20 () {58 vars in 1128 bytes} [Sat Sep 10 10:34:26 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 769 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:27.276234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-db8f4934-0de0-4098-b829-58f102717c31 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Calling method '.version_select at 0x7efcaf83aa60>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:27.278089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-db8f4934-0de0-4098-b829-58f102717c31 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '56bbe890c3c446ce80d9341ccc475136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a0182a27324d7ea7eddbbd020a7a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-db8f4934-0de0-4098-b829-58f102717c31 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Request method failure captured: Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-hosts/n-d-856894-1/reboot HTTP/1.1 Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgvpBbNieBqlFq9z2ethuwbZ37Ahbju939KJprkZuLAz_H4NZVeT-0NBraSGbIpayE4Kkbx3j7wSQXwQifDEQOUc061WE_LotQfQ_vc492xrYg3Yo57fVBFrzGcthSgbGyfhhuu3FEVY6agrb4rmLBkagW0iu97sPWTDKHXQGuFMM4 Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:27.281609 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4a0182a27324d7ea7eddbbd020a7a48", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 56bbe890c3c446ce80d9341ccc475136 Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'n-d-856894-1'} Sep 10 10:34:27.282723 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:27.283468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 10 10:34:27.284464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.285387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-db8f4934-0de0-4098-b829-58f102717c31 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.285387 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-db8f4934-0de0-4098-b829-58f102717c31 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-856894-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.011062 Sep 10 10:34:27.285387 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 82/140] 10.222.0.20 () {58 vars in 1188 bytes} [Sat Sep 10 10:34:27 2022] GET /compute/v2.1/os-hosts/n-d-856894-1/reboot => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:34:27.294114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5233f3a5-8883-4a65-af49-27378b3c7bf1 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Calling method '.version_select at 0x7efcaf4a8790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:27.313230 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5233f3a5-8883-4a65-af49-27378b3c7bf1 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5233f3a5-8883-4a65-af49-27378b3c7bf1 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Request method failure captured: Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgxU4L1YOxxcoEWvyyd7kVzWcWTgw60J1QcZoTaaLNSTMIPr_L3wSvYMgLdL_G3stD9DT3_t-qqkaYaBMbcGIxRi-5IbGrCVyUfjb_6MeSEuMs1_MZgoPFV1QmjlVD6yjY0S1pLhZp8ztiynXgl9dB5iw13Ixz8qe0lukq1EwKsEJI Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:34:27.319334 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f649f7106ad474d99c8e258aca117e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c33cea7fb8a142ce8c969da35e7eec24 Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'nonexistent_hostname'} Sep 10 10:34:27.320491 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:34:27.321405 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 10 10:34:27.322638 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5233f3a5-8883-4a65-af49-27378b3c7bf1 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5233f3a5-8883-4a65-af49-27378b3c7bf1 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.030770 Sep 10 10:34:27.330906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 59/141] 10.222.0.20 () {58 vars in 1212 bytes} [Sat Sep 10 10:34:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:34:27.334188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3cb6b1c6-b961-46f0-b9b5-a08b875af4af tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Calling method '.version_select at 0x7efcaf7873a0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:27.335968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3cb6b1c6-b961-46f0-b9b5-a08b875af4af tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '56bbe890c3c446ce80d9341ccc475136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a0182a27324d7ea7eddbbd020a7a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3cb6b1c6-b961-46f0-b9b5-a08b875af4af tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Request method failure captured: Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-hosts/n-d-856894-1 HTTP/1.1 Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgvpBbNieBqlFq9z2ethuwbZ37Ahbju939KJprkZuLAz_H4NZVeT-0NBraSGbIpayE4Kkbx3j7wSQXwQifDEQOUc061WE_LotQfQ_vc492xrYg3Yo57fVBFrzGcthSgbGyfhhuu3FEVY6agrb4rmLBkagW0iu97sPWTDKHXQGuFMM4 Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:27.342790 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4a0182a27324d7ea7eddbbd020a7a48", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 56bbe890c3c446ce80d9341ccc475136 Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'n-d-856894-1'} Sep 10 10:34:27.344094 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:27.344806 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 10 10:34:27.345862 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.352823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3cb6b1c6-b961-46f0-b9b5-a08b875af4af tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.352823 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3cb6b1c6-b961-46f0-b9b5-a08b875af4af tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-856894-1" status: 403 len: 109 microversion: 2.1 time: 0.014024 Sep 10 10:34:27.352823 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 83/142] 10.222.0.20 () {58 vars in 1167 bytes} [Sat Sep 10 10:34:27 2022] GET /compute/v2.1/os-hosts/n-d-856894-1 => generated 109 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:27.360686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bdfd2a96-bf66-43d6-b275-748e1ca970e2 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Calling method '.version_select at 0x7efcaf440940>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:27.376029 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-bdfd2a96-bf66-43d6-b275-748e1ca970e2 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bdfd2a96-bf66-43d6-b275-748e1ca970e2 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Request method failure captured: Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgxU4L1YOxxcoEWvyyd7kVzWcWTgw60J1QcZoTaaLNSTMIPr_L3wSvYMgLdL_G3stD9DT3_t-qqkaYaBMbcGIxRi-5IbGrCVyUfjb_6MeSEuMs1_MZgoPFV1QmjlVD6yjY0S1pLhZp8ztiynXgl9dB5iw13Ixz8qe0lukq1EwKsEJI Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:34:27.378711 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f649f7106ad474d99c8e258aca117e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c33cea7fb8a142ce8c969da35e7eec24 Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'nonexistent_hostname'} Sep 10 10:34:27.379889 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.380591 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.381655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.382892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bdfd2a96-bf66-43d6-b275-748e1ca970e2 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.382892 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bdfd2a96-bf66-43d6-b275-748e1ca970e2 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025872 Sep 10 10:34:27.382892 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 60/143] 10.222.0.20 () {58 vars in 1191 bytes} [Sat Sep 10 10:34:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:34:27.393853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6bc7fcaa-63c8-46a5-9d91-603b160de46c tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Calling method '.version_select at 0x7efcaf7a4d30>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:27.395860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6bc7fcaa-63c8-46a5-9d91-603b160de46c tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '56bbe890c3c446ce80d9341ccc475136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a0182a27324d7ea7eddbbd020a7a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6bc7fcaa-63c8-46a5-9d91-603b160de46c tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Request method failure captured: Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-hosts/n-d-856894-1/shutdown HTTP/1.1 Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgvpBbNieBqlFq9z2ethuwbZ37Ahbju939KJprkZuLAz_H4NZVeT-0NBraSGbIpayE4Kkbx3j7wSQXwQifDEQOUc061WE_LotQfQ_vc492xrYg3Yo57fVBFrzGcthSgbGyfhhuu3FEVY6agrb4rmLBkagW0iu97sPWTDKHXQGuFMM4 Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:27.401105 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4a0182a27324d7ea7eddbbd020a7a48", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 56bbe890c3c446ce80d9341ccc475136 Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'n-d-856894-1'} Sep 10 10:34:27.402292 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:27.403209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 10 10:34:27.404207 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.407339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6bc7fcaa-63c8-46a5-9d91-603b160de46c tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.407339 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6bc7fcaa-63c8-46a5-9d91-603b160de46c tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-856894-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016859 Sep 10 10:34:27.407339 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 84/144] 10.222.0.20 () {58 vars in 1194 bytes} [Sat Sep 10 10:34:27 2022] GET /compute/v2.1/os-hosts/n-d-856894-1/shutdown => generated 113 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:27.416562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e0bcbd0-92c0-41ef-abd8-6c64fa24fb4f tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Calling method '.version_select at 0x7efcaf3d6160>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:27.458035 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9e0bcbd0-92c0-41ef-abd8-6c64fa24fb4f tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e0bcbd0-92c0-41ef-abd8-6c64fa24fb4f tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Request method failure captured: Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgxU4L1YOxxcoEWvyyd7kVzWcWTgw60J1QcZoTaaLNSTMIPr_L3wSvYMgLdL_G3stD9DT3_t-qqkaYaBMbcGIxRi-5IbGrCVyUfjb_6MeSEuMs1_MZgoPFV1QmjlVD6yjY0S1pLhZp8ztiynXgl9dB5iw13Ixz8qe0lukq1EwKsEJI Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:34:27.463332 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f649f7106ad474d99c8e258aca117e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c33cea7fb8a142ce8c969da35e7eec24 Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'nonexistent_hostname'} Sep 10 10:34:27.464783 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:34:27.465741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 10 10:34:27.466687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.469207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e0bcbd0-92c0-41ef-abd8-6c64fa24fb4f tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.470906 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9e0bcbd0-92c0-41ef-abd8-6c64fa24fb4f tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.057898 Sep 10 10:34:27.487513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-16b97f14-a7ea-4e0f-89b3-4a20f59f6d82 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Calling method '.version_select at 0x7efcaf83a670>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:27.493292 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 61/145] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Sep 10 10:34:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:34:27.494105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-16b97f14-a7ea-4e0f-89b3-4a20f59f6d82 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '56bbe890c3c446ce80d9341ccc475136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a0182a27324d7ea7eddbbd020a7a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-16b97f14-a7ea-4e0f-89b3-4a20f59f6d82 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Request method failure captured: Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-hosts/n-d-856894-1/startup HTTP/1.1 Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgvpBbNieBqlFq9z2ethuwbZ37Ahbju939KJprkZuLAz_H4NZVeT-0NBraSGbIpayE4Kkbx3j7wSQXwQifDEQOUc061WE_LotQfQ_vc492xrYg3Yo57fVBFrzGcthSgbGyfhhuu3FEVY6agrb4rmLBkagW0iu97sPWTDKHXQGuFMM4 Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:27.496353 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4a0182a27324d7ea7eddbbd020a7a48", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 56bbe890c3c446ce80d9341ccc475136 Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'n-d-856894-1'} Sep 10 10:34:27.497754 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:27.499645 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 10 10:34:27.500643 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.504438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-16b97f14-a7ea-4e0f-89b3-4a20f59f6d82 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.504438 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-16b97f14-a7ea-4e0f-89b3-4a20f59f6d82 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-856894-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.024537 Sep 10 10:34:27.504438 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 85/146] 10.222.0.20 () {58 vars in 1191 bytes} [Sat Sep 10 10:34:27 2022] GET /compute/v2.1/os-hosts/n-d-856894-1/startup => generated 110 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:34:27.513225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ad23bc6-a43a-467b-afd9-0ecf52131be6 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Calling method '.version_select at 0x7efcaf4a8280>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:27.553693 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-6ad23bc6-a43a-467b-afd9-0ecf52131be6 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ad23bc6-a43a-467b-afd9-0ecf52131be6 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Request method failure captured: Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgxU4L1YOxxcoEWvyyd7kVzWcWTgw60J1QcZoTaaLNSTMIPr_L3wSvYMgLdL_G3stD9DT3_t-qqkaYaBMbcGIxRi-5IbGrCVyUfjb_6MeSEuMs1_MZgoPFV1QmjlVD6yjY0S1pLhZp8ztiynXgl9dB5iw13Ixz8qe0lukq1EwKsEJI Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:34:27.556508 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f649f7106ad474d99c8e258aca117e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c33cea7fb8a142ce8c969da35e7eec24 Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'nonexistent_hostname'} Sep 10 10:34:27.557682 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:34:27.558394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 10 10:34:27.559358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ad23bc6-a43a-467b-afd9-0ecf52131be6 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ad23bc6-a43a-467b-afd9-0ecf52131be6 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.052011 Sep 10 10:34:27.560335 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 62/147] 10.222.0.20 () {58 vars in 1215 bytes} [Sat Sep 10 10:34:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:34:27.568866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9439b1d2-786f-4bca-a59e-d164b1c9206c tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf7870d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9439b1d2-786f-4bca-a59e-d164b1c9206c tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Request method failure captured: Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: request: PUT /compute/v2.1/os-hosts/n-d-856894-1 HTTP/1.1 Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 51 Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgxU4L1YOxxcoEWvyyd7kVzWcWTgw60J1QcZoTaaLNSTMIPr_L3wSvYMgLdL_G3stD9DT3_t-qqkaYaBMbcGIxRi-5IbGrCVyUfjb_6MeSEuMs1_MZgoPFV1QmjlVD6yjY0S1pLhZp8ztiynXgl9dB5iw13Ixz8qe0lukq1EwKsEJI Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:34:27.588598 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f649f7106ad474d99c8e258aca117e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: c33cea7fb8a142ce8c969da35e7eec24 Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: {"status": "enable", "maintenance_mode": "invalid"} Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:27.589830 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'n-d-856894-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'disable', Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'Enable', Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'Disable', Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance: Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.591105 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.596460 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.597743 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.597743 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:34:27.597743 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:34:27.597743 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 10:34:27.597743 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.597743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9439b1d2-786f-4bca-a59e-d164b1c9206c tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.597743 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9439b1d2-786f-4bca-a59e-d164b1c9206c tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-856894-1" status: 400 len: 199 microversion: 2.1 time: 0.025996 Sep 10 10:34:27.597743 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 86/148] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:34:27 2022] PUT /compute/v2.1/os-hosts/n-d-856894-1 => generated 199 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 10:34:27.603263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-313b6ea8-2746-434f-b0c1-2903f9a76429 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf3d61f0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:27.614813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-22179512-51b2-409b-8252-b53cd53b2a5a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:27.619662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-22179512-51b2-409b-8252-b53cd53b2a5a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-313b6ea8-2746-434f-b0c1-2903f9a76429 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Request method failure captured: Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/os-hosts/n-d-856894-1 HTTP/1.1 Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 51 Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgxU4L1YOxxcoEWvyyd7kVzWcWTgw60J1QcZoTaaLNSTMIPr_L3wSvYMgLdL_G3stD9DT3_t-qqkaYaBMbcGIxRi-5IbGrCVyUfjb_6MeSEuMs1_MZgoPFV1QmjlVD6yjY0S1pLhZp8ztiynXgl9dB5iw13Ixz8qe0lukq1EwKsEJI Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:34:27.621377 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f649f7106ad474d99c8e258aca117e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c33cea7fb8a142ce8c969da35e7eec24 Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: {"status": "invalid", "maintenance_mode": "enable"} Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:27.622918 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'n-d-856894-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'disable', Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'Enable', Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'Disable', Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance: Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.623792 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.625371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.626514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.626514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:34:27.626514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:34:27.626514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 10:34:27.626514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.627295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-313b6ea8-2746-434f-b0c1-2903f9a76429 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.631256 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-313b6ea8-2746-434f-b0c1-2903f9a76429 tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-856894-1" status: 400 len: 189 microversion: 2.1 time: 0.032012 Sep 10 10:34:27.635986 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 63/149] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:34:27 2022] PUT /compute/v2.1/os-hosts/n-d-856894-1 => generated 189 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:34:27.644098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22179512-51b2-409b-8252-b53cd53b2a5a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:27.653874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22179512-51b2-409b-8252-b53cd53b2a5a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:27.654450 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22179512-51b2-409b-8252-b53cd53b2a5a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:27.656278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edde10a2-d512-4679-bc61-5e20d2932114 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Action: 'update', calling method: .version_select at 0x7efcaf4408b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:27.662270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22179512-51b2-409b-8252-b53cd53b2a5a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:27.662775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22179512-51b2-409b-8252-b53cd53b2a5a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:27.663222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22179512-51b2-409b-8252-b53cd53b2a5a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:27.665291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-edde10a2-d512-4679-bc61-5e20d2932114 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '56bbe890c3c446ce80d9341ccc475136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a0182a27324d7ea7eddbbd020a7a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edde10a2-d512-4679-bc61-5e20d2932114 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Request method failure captured: Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/os-hosts/n-d-856894-1 HTTP/1.1 Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 50 Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgvpBbNieBqlFq9z2ethuwbZ37Ahbju939KJprkZuLAz_H4NZVeT-0NBraSGbIpayE4Kkbx3j7wSQXwQifDEQOUc061WE_LotQfQ_vc492xrYg3Yo57fVBFrzGcthSgbGyfhhuu3FEVY6agrb4rmLBkagW0iu97sPWTDKHXQGuFMM4 Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:34:27.667980 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4a0182a27324d7ea7eddbbd020a7a48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4a0182a27324d7ea7eddbbd020a7a48", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: d4a0182a27324d7ea7eddbbd020a7a48 Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-386081004 Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 56bbe890c3c446ce80d9341ccc475136 Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HostsAdminNegativeTestJSON-386081004-project Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: {"status": "enable", "maintenance_mode": "enable"} Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 10 10:34:27.669274 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'n-d-856894-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:27.670040 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 10 10:34:27.671697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.675116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edde10a2-d512-4679-bc61-5e20d2932114 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.675116 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-edde10a2-d512-4679-bc61-5e20d2932114 tempest-HostsAdminNegativeTestJSON-386081004 tempest-HostsAdminNegativeTestJSON-386081004-project] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-856894-1" status: 403 len: 111 microversion: 2.1 time: 0.029424 Sep 10 10:34:27.675116 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 64/150] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:34:27 2022] PUT /compute/v2.1/os-hosts/n-d-856894-1 => generated 111 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:27.695023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-46c298df-e09a-4a05-b9bb-64ba8b89d6da tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf3f6160>, body: {"status": null, "maintenance_mode": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-46c298df-e09a-4a05-b9bb-64ba8b89d6da tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Request method failure captured: Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/os-hosts/n-d-856894-1 HTTP/1.1 Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 42 Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgxU4L1YOxxcoEWvyyd7kVzWcWTgw60J1QcZoTaaLNSTMIPr_L3wSvYMgLdL_G3stD9DT3_t-qqkaYaBMbcGIxRi-5IbGrCVyUfjb_6MeSEuMs1_MZgoPFV1QmjlVD6yjY0S1pLhZp8ztiynXgl9dB5iw13Ixz8qe0lukq1EwKsEJI Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:34:27.703347 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f649f7106ad474d99c8e258aca117e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c33cea7fb8a142ce8c969da35e7eec24 Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: {"status": null, "maintenance_mode": null} Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 10 10:34:27.704725 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'n-d-856894-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'disable', Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'Enable', Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'Disable', Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance: Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi None Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.705826 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.707071 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.708102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:34:27.708102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:34:27.708102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 10 10:34:27.708102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.712166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-46c298df-e09a-4a05-b9bb-64ba8b89d6da tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.714714 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-46c298df-e09a-4a05-b9bb-64ba8b89d6da tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-856894-1" status: 400 len: 127 microversion: 2.1 time: 0.035336 Sep 10 10:34:27.717772 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 65/151] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:34:27 2022] PUT /compute/v2.1/os-hosts/n-d-856894-1 => generated 127 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:34:27.730421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ada2054-440c-4f34-9798-aaf5c73a8a7b tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf3f6d30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:27.744084 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.hosts [None req-2ada2054-440c-4f34-9798-aaf5c73a8a7b tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Enabling host nonexistent_hostname. Sep 10 10:34:27.766267 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2ada2054-440c-4f34-9798-aaf5c73a8a7b tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ada2054-440c-4f34-9798-aaf5c73a8a7b tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Request method failure captured: Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 50 Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgxU4L1YOxxcoEWvyyd7kVzWcWTgw60J1QcZoTaaLNSTMIPr_L3wSvYMgLdL_G3stD9DT3_t-qqkaYaBMbcGIxRi-5IbGrCVyUfjb_6MeSEuMs1_MZgoPFV1QmjlVD6yjY0S1pLhZp8ztiynXgl9dB5iw13Ixz8qe0lukq1EwKsEJI Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:34:27.768048 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f649f7106ad474d99c8e258aca117e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f649f7106ad474d99c8e258aca117e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9f649f7106ad474d99c8e258aca117e0 Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1956283067 Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c33cea7fb8a142ce8c969da35e7eec24 Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1956283067-project-admin Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: {"status": "enable", "maintenance_mode": "enable"} Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.769790 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 10:34:27.770563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:27.771527 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:27.772548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ada2054-440c-4f34-9798-aaf5c73a8a7b tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:27.773361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ada2054-440c-4f34-9798-aaf5c73a8a7b tempest-HostsAdminNegativeTestJSON-1956283067 tempest-HostsAdminNegativeTestJSON-1956283067-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.046685 Sep 10 10:34:27.775558 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 66/152] 10.222.0.20 () {60 vars in 1211 bytes} [Sat Sep 10 10:34:27 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 10:34:28.090322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-22179512-51b2-409b-8252-b53cd53b2a5a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:28.104645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69b69e8a-dce1-45f2-a665-440a36b968c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:28.105309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69b69e8a-dce1-45f2-a665-440a36b968c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:28.106993 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-22179512-51b2-409b-8252-b53cd53b2a5a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.499928 Sep 10 10:34:28.107587 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 87/153] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:27 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:28.114841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b69e8a-dce1-45f2-a665-440a36b968c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:28.115338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b69e8a-dce1-45f2-a665-440a36b968c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:28.115777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b69e8a-dce1-45f2-a665-440a36b968c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:28.116479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b69e8a-dce1-45f2-a665-440a36b968c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:28.116935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b69e8a-dce1-45f2-a665-440a36b968c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:28.117396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b69e8a-dce1-45f2-a665-440a36b968c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:28.766779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-69b69e8a-dce1-45f2-a665-440a36b968c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:28.788063 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69b69e8a-dce1-45f2-a665-440a36b968c2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.687203 Sep 10 10:34:28.796835 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 67/154] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:28 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:29.131699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1c757fa7-febb-4670-93fe-93c8d79de8b4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:29.132512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1c757fa7-febb-4670-93fe-93c8d79de8b4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:29.146070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c757fa7-febb-4670-93fe-93c8d79de8b4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:29.146773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c757fa7-febb-4670-93fe-93c8d79de8b4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:29.147172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c757fa7-febb-4670-93fe-93c8d79de8b4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:29.147877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c757fa7-febb-4670-93fe-93c8d79de8b4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:29.148329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c757fa7-febb-4670-93fe-93c8d79de8b4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:29.148752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c757fa7-febb-4670-93fe-93c8d79de8b4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:29.565837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1c757fa7-febb-4670-93fe-93c8d79de8b4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:29.578983 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1c757fa7-febb-4670-93fe-93c8d79de8b4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.452531 Sep 10 10:34:29.582195 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 88/155] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:29 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:30.095252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4aa9b948-1363-458f-b5b9-81301cb1dc2a req-b7d617b8-e33b-4abd-aa3e-29c75c74ce4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386253a1-3a4d-4a5f-8ca2-1177b1ff7df7", "name": "network-vif-plugged", "status": "completed", "tag": "85cc248c-852d-4826-ae94-5dfd332eabec"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:30.127727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4aa9b948-1363-458f-b5b9-81301cb1dc2a req-b7d617b8-e33b-4abd-aa3e-29c75c74ce4a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:30.128238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4aa9b948-1363-458f-b5b9-81301cb1dc2a req-b7d617b8-e33b-4abd-aa3e-29c75c74ce4a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:30.132547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4aa9b948-1363-458f-b5b9-81301cb1dc2a req-b7d617b8-e33b-4abd-aa3e-29c75c74ce4a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:30.175342 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4aa9b948-1363-458f-b5b9-81301cb1dc2a req-b7d617b8-e33b-4abd-aa3e-29c75c74ce4a service nova] Creating event network-vif-plugged:85cc248c-852d-4826-ae94-5dfd332eabec for instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 on n-h2-856894-1 Sep 10 10:34:30.187301 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4aa9b948-1363-458f-b5b9-81301cb1dc2a req-b7d617b8-e33b-4abd-aa3e-29c75c74ce4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.632015 Sep 10 10:34:30.192065 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 68/156] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:34:30.208257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5c61f3d5-5f5d-4f5f-923f-dfb5427402dc tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:30.209188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5c61f3d5-5f5d-4f5f-923f-dfb5427402dc tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:30.231980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c61f3d5-5f5d-4f5f-923f-dfb5427402dc tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:30.232581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c61f3d5-5f5d-4f5f-923f-dfb5427402dc tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:30.233626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c61f3d5-5f5d-4f5f-923f-dfb5427402dc tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:30.234346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c61f3d5-5f5d-4f5f-923f-dfb5427402dc tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:30.234803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c61f3d5-5f5d-4f5f-923f-dfb5427402dc tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:30.235233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c61f3d5-5f5d-4f5f-923f-dfb5427402dc tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:30.351257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-728927914", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:30.513666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] validate_networks() for None {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:34:30.705061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5c61f3d5-5f5d-4f5f-923f-dfb5427402dc tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:30.718664 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5c61f3d5-5f5d-4f5f-923f-dfb5427402dc tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.525136 Sep 10 10:34:30.719860 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 69/157] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:30 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:31.022191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:34:31.022616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:34:31.023088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:34:31.023491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:34:31.023896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:34:31.059110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:31.064611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:31.065087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:31.065961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:31.073141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:31.073544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:31.128387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Getting quotas for project 394e48c362f340eb91dbd10c72c186f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:31.136339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Getting quotas for user 480aa0631c1846b480f072613b7e38a1 and project 394e48c362f340eb91dbd10c72c186f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:31.158841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:34:31.161788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:34:31.176654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b46aca6d-ad66-4f06-8938-7da0cdcaf591 tempest-InstanceUsageAuditLogTestJSON-1024607310 tempest-InstanceUsageAuditLogTestJSON-1024607310-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:31.239874 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b46aca6d-ad66-4f06-8938-7da0cdcaf591 tempest-InstanceUsageAuditLogTestJSON-1024607310 tempest-InstanceUsageAuditLogTestJSON-1024607310-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10 10:34:30" status: 200 len: 318 microversion: 2.1 time: 0.512457 Sep 10 10:34:31.242880 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 70/158] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Sep 10 10:34:30 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10%2010%3A34%3A30 => generated 318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:31.258083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2785806a-7093-43ce-b425-76660c53f183 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:31.258917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2785806a-7093-43ce-b425-76660c53f183 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:31.271117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2785806a-7093-43ce-b425-76660c53f183 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:31.272984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2785806a-7093-43ce-b425-76660c53f183 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:31.274258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2785806a-7093-43ce-b425-76660c53f183 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:31.276326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2785806a-7093-43ce-b425-76660c53f183 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:31.276954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2785806a-7093-43ce-b425-76660c53f183 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:31.278194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2785806a-7093-43ce-b425-76660c53f183 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:31.296388 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-978bf317-3cdf-4695-b197-ab26ba98a96f tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.674667 Sep 10 10:34:31.305451 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 89/159] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 10:34:31.319735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5c26580a-df0b-42c5-b9c5-b298717620e3 tempest-InstanceUsageAuditLogTestJSON-1024607310 tempest-InstanceUsageAuditLogTestJSON-1024607310-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:31.358396 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5c26580a-df0b-42c5-b9c5-b298717620e3 tempest-InstanceUsageAuditLogTestJSON-1024607310 tempest-InstanceUsageAuditLogTestJSON-1024607310-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.049152 Sep 10 10:34:31.367212 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 90/160] 10.222.0.20 () {58 vars in 1185 bytes} [Sat Sep 10 10:34:31 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:31.377096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f5b7a0c6-40d5-4f5e-8d0a-302fe5f12280 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:31.383851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f5b7a0c6-40d5-4f5e-8d0a-302fe5f12280 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:31.644982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f5b7a0c6-40d5-4f5e-8d0a-302fe5f12280 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:31.655808 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f5b7a0c6-40d5-4f5e-8d0a-302fe5f12280 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1218 microversion: 2.1 time: 0.286011 Sep 10 10:34:31.663129 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 91/161] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:31 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1218 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:31.745749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ac7d7c2f-62ef-4762-ba72-460b47f9e502 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:31.746535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ac7d7c2f-62ef-4762-ba72-460b47f9e502 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:31.755427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac7d7c2f-62ef-4762-ba72-460b47f9e502 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:31.755928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac7d7c2f-62ef-4762-ba72-460b47f9e502 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:31.756359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac7d7c2f-62ef-4762-ba72-460b47f9e502 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:31.757150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac7d7c2f-62ef-4762-ba72-460b47f9e502 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:31.757605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac7d7c2f-62ef-4762-ba72-460b47f9e502 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:31.758027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac7d7c2f-62ef-4762-ba72-460b47f9e502 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:31.828036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2785806a-7093-43ce-b425-76660c53f183 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:31.850727 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2785806a-7093-43ce-b425-76660c53f183 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.600151 Sep 10 10:34:31.856700 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 71/162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:31 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:32.197411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ac7d7c2f-62ef-4762-ba72-460b47f9e502 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:32.211911 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ac7d7c2f-62ef-4762-ba72-460b47f9e502 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 0.469024 Sep 10 10:34:32.212511 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 92/163] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:31 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:32.682558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-04eb1b08-859f-4329-9bfc-9d60f956589e tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:32.683768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-04eb1b08-859f-4329-9bfc-9d60f956589e tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:32.710273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04eb1b08-859f-4329-9bfc-9d60f956589e tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:32.713250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04eb1b08-859f-4329-9bfc-9d60f956589e tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:32.713853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04eb1b08-859f-4329-9bfc-9d60f956589e tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:32.719068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04eb1b08-859f-4329-9bfc-9d60f956589e tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:32.724565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04eb1b08-859f-4329-9bfc-9d60f956589e tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:32.725108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04eb1b08-859f-4329-9bfc-9d60f956589e tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:32.840895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-fd3c7e3c-b958-42c6-98ad-825723489f10 req-56789583-33ec-40b3-a62d-e89f8e0cf7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fde3838-50ca-4b70-8740-85058a89e99d", "name": "network-vif-plugged", "status": "completed", "tag": "83038be3-1f2e-4e9e-af93-64515b7bbf06"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:32.849774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:32.862529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fd3c7e3c-b958-42c6-98ad-825723489f10 req-56789583-33ec-40b3-a62d-e89f8e0cf7d0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:32.868978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fd3c7e3c-b958-42c6-98ad-825723489f10 req-56789583-33ec-40b3-a62d-e89f8e0cf7d0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:32.869687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fd3c7e3c-b958-42c6-98ad-825723489f10 req-56789583-33ec-40b3-a62d-e89f8e0cf7d0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:32.897553 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-fd3c7e3c-b958-42c6-98ad-825723489f10 req-56789583-33ec-40b3-a62d-e89f8e0cf7d0 service nova] Creating event network-vif-plugged:83038be3-1f2e-4e9e-af93-64515b7bbf06 for instance 0fde3838-50ca-4b70-8740-85058a89e99d on n-h1-856894-1 Sep 10 10:34:32.908757 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-fd3c7e3c-b958-42c6-98ad-825723489f10 req-56789583-33ec-40b3-a62d-e89f8e0cf7d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072800 Sep 10 10:34:32.912421 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 93/164] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:34:32.934814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ef8e957-2cbc-4491-91c2-d4facf9e6d63 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:32.937904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ef8e957-2cbc-4491-91c2-d4facf9e6d63 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:32.955935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ef8e957-2cbc-4491-91c2-d4facf9e6d63 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:32.956676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ef8e957-2cbc-4491-91c2-d4facf9e6d63 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:32.962163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ef8e957-2cbc-4491-91c2-d4facf9e6d63 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:32.963349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ef8e957-2cbc-4491-91c2-d4facf9e6d63 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:32.964702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-04eb1b08-859f-4329-9bfc-9d60f956589e tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:32.965465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ef8e957-2cbc-4491-91c2-d4facf9e6d63 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:32.968137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ef8e957-2cbc-4491-91c2-d4facf9e6d63 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:33.004264 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-04eb1b08-859f-4329-9bfc-9d60f956589e tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1214 microversion: 2.1 time: 0.329048 Sep 10 10:34:33.011900 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 72/165] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:32 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1214 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:33.236652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c027aad-6800-4332-a9bb-f85e7966df86 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:33.237720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c027aad-6800-4332-a9bb-f85e7966df86 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:33.263067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c027aad-6800-4332-a9bb-f85e7966df86 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:33.263666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c027aad-6800-4332-a9bb-f85e7966df86 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:33.264631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c027aad-6800-4332-a9bb-f85e7966df86 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:33.265384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c027aad-6800-4332-a9bb-f85e7966df86 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:33.272482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c027aad-6800-4332-a9bb-f85e7966df86 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:33.276208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c027aad-6800-4332-a9bb-f85e7966df86 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:33.354287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ef8e957-2cbc-4491-91c2-d4facf9e6d63 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:33.358459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:33.391206 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ef8e957-2cbc-4491-91c2-d4facf9e6d63 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1319 microversion: 2.1 time: 0.465918 Sep 10 10:34:33.393974 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 94/166] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:32 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:34.037385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-57c28f38-9365-4c47-ae35-795dd3f555f1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:34.039600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-57c28f38-9365-4c47-ae35-795dd3f555f1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:34.056099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c28f38-9365-4c47-ae35-795dd3f555f1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:34.057033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c28f38-9365-4c47-ae35-795dd3f555f1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:34.058704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c28f38-9365-4c47-ae35-795dd3f555f1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:34.061272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c28f38-9365-4c47-ae35-795dd3f555f1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:34.064105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c28f38-9365-4c47-ae35-795dd3f555f1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:34.064785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c28f38-9365-4c47-ae35-795dd3f555f1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:34.258220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c027aad-6800-4332-a9bb-f85e7966df86 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:34.271228 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c027aad-6800-4332-a9bb-f85e7966df86 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1337 microversion: 2.1 time: 1.039615 Sep 10 10:34:34.272382 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 73/167] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:33 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1337 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:34.298492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-57c28f38-9365-4c47-ae35-795dd3f555f1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:34.310329 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-57c28f38-9365-4c47-ae35-795dd3f555f1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1276 microversion: 2.1 time: 0.276837 Sep 10 10:34:34.314436 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 95/168] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:34 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:34.422786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-907ad66a-5f36-496e-b9e5-36c9f76d2eb7 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:34.423402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-907ad66a-5f36-496e-b9e5-36c9f76d2eb7 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:34.429691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-907ad66a-5f36-496e-b9e5-36c9f76d2eb7 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:34.430174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-907ad66a-5f36-496e-b9e5-36c9f76d2eb7 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:34.430898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-907ad66a-5f36-496e-b9e5-36c9f76d2eb7 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:34.431510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-907ad66a-5f36-496e-b9e5-36c9f76d2eb7 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:34.432110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-907ad66a-5f36-496e-b9e5-36c9f76d2eb7 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:34.436459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-907ad66a-5f36-496e-b9e5-36c9f76d2eb7 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:34.542337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb117160-ac29-41d7-b26c-6eb1c2c2367c tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Calling method '.version_select at 0x7efcaf3d8ca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:34.747880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-907ad66a-5f36-496e-b9e5-36c9f76d2eb7 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:34.783645 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-907ad66a-5f36-496e-b9e5-36c9f76d2eb7 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1469 microversion: 2.1 time: 0.365026 Sep 10 10:34:34.787680 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 96/169] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:34 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:35.227550 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb117160-ac29-41d7-b26c-6eb1c2c2367c tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043" status: 200 len: 371 microversion: 2.1 time: 0.953638 Sep 10 10:34:35.229805 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 74/170] 10.222.0.20 () {58 vars in 1242 bytes} [Sat Sep 10 10:34:34 2022] GET /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 => generated 371 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:35.519985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7d2bef4e-590a-4c4b-a7d6-797d407e8c3f tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Action: 'create', calling method: .version_select at 0x7efcaf67f4c0>, body: {"keypair": {"name": "tempest-keypair-307561346", "type": "ssh", "user_id": "c9395eb4bd2844859b6f0810e41a5b2a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKLb3LJtSGyb3s8yXNtHPPAZkNmSWWhEWXozziXXgiSkl+elIzXpJojBxwSDmbkFu/nA5PUHaDih9sjzYfFXKfkZidhgLLpvPswIZ3aMBwPMtnSIN3r3uv9ZrHFAtbSzg=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:35.539021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e9524f5b-e96e-4485-9033-1daaf5d92ab9 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:35.539849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e9524f5b-e96e-4485-9033-1daaf5d92ab9 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:35.549859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9524f5b-e96e-4485-9033-1daaf5d92ab9 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:35.550356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9524f5b-e96e-4485-9033-1daaf5d92ab9 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:35.550798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9524f5b-e96e-4485-9033-1daaf5d92ab9 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:35.551514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9524f5b-e96e-4485-9033-1daaf5d92ab9 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:35.551981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9524f5b-e96e-4485-9033-1daaf5d92ab9 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:35.552397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9524f5b-e96e-4485-9033-1daaf5d92ab9 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:35.591605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-7d2bef4e-590a-4c4b-a7d6-797d407e8c3f tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Getting quotas for project dfbf75e9603749b7a3f5dbcba7cd5c57. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:35.604919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-7d2bef4e-590a-4c4b-a7d6-797d407e8c3f tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Getting quotas for user a3e4ccba8daa4c0db757aeb812c236fd and project dfbf75e9603749b7a3f5dbcba7cd5c57. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:35.660219 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7d2bef4e-590a-4c4b-a7d6-797d407e8c3f tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.870137 Sep 10 10:34:35.662500 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 97/171] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Sep 10 10:34:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 873 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 10:34:35.671962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-787b7fcf-87af-4786-a6ae-4b43634d74a9 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf60b790>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:35.750090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e9524f5b-e96e-4485-9033-1daaf5d92ab9 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:34:35.866857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-787b7fcf-87af-4786-a6ae-4b43634d74a9 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:35.868714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-787b7fcf-87af-4786-a6ae-4b43634d74a9 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:35.869342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-787b7fcf-87af-4786-a6ae-4b43634d74a9 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:35.880392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-787b7fcf-87af-4786-a6ae-4b43634d74a9 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:35.881007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-787b7fcf-87af-4786-a6ae-4b43634d74a9 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:35.881569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-787b7fcf-87af-4786-a6ae-4b43634d74a9 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:36.103201 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-787b7fcf-87af-4786-a6ae-4b43634d74a9 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043" status: 200 len: 328 microversion: 2.1 time: 0.439313 Sep 10 10:34:36.112156 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 98/172] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 10:34:35 2022] PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 => generated 328 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:36.121317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-704c1d09-7a41-43bb-b67a-5863483761e2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:36.135071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-704c1d09-7a41-43bb-b67a-5863483761e2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:36.163105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-704c1d09-7a41-43bb-b67a-5863483761e2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:36.166048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-704c1d09-7a41-43bb-b67a-5863483761e2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:36.167578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-704c1d09-7a41-43bb-b67a-5863483761e2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:36.176587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-704c1d09-7a41-43bb-b67a-5863483761e2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:36.181008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-704c1d09-7a41-43bb-b67a-5863483761e2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:36.182461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-704c1d09-7a41-43bb-b67a-5863483761e2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:36.461720 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e9524f5b-e96e-4485-9033-1daaf5d92ab9 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 204 len: 0 microversion: 2.1 time: 1.229989 Sep 10 10:34:36.462869 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 75/173] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:34:35 2022] DELETE /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 0 bytes in 1232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:34:36.470141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-995c600f-f66c-4d74-9809-ac5dae39ee6c tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:36.471238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-995c600f-f66c-4d74-9809-ac5dae39ee6c tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:36.480228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:36.483812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-995c600f-f66c-4d74-9809-ac5dae39ee6c tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:36.484768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-995c600f-f66c-4d74-9809-ac5dae39ee6c tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:36.485544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-995c600f-f66c-4d74-9809-ac5dae39ee6c tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:36.486520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-995c600f-f66c-4d74-9809-ac5dae39ee6c tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:36.487187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-995c600f-f66c-4d74-9809-ac5dae39ee6c tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:36.487920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-995c600f-f66c-4d74-9809-ac5dae39ee6c tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:36.852436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-995c600f-f66c-4d74-9809-ac5dae39ee6c tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:36.864429 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-995c600f-f66c-4d74-9809-ac5dae39ee6c tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1318 microversion: 2.1 time: 0.399925 Sep 10 10:34:36.865046 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 76/174] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:36 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:36.873339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bbd58876-efc2-4a62-9439-a9709eaeb03a tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Action: 'create', calling method: .version_select at 0x7efcaf440b80>, body: {"keypair": {"name": "tempest-keypair-1608249910", "type": "ssh", "user_id": "c9395eb4bd2844859b6f0810e41a5b2a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYjEGIfT9Y/Wsc3cbLDbHo/iYbtQ9+LdTgWNr5xjNxLcDcVfZbQh0Qvt1sv4oMaD7vDKKt1rPY1y2uYKbVI2GuCtwx9f9N7EQZZVHp1viqQ8XyqwW8SRXcanjbenc6krQ=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:36.902609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-704c1d09-7a41-43bb-b67a-5863483761e2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:36.913839 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-704c1d09-7a41-43bb-b67a-5863483761e2 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1487 microversion: 2.1 time: 0.800004 Sep 10 10:34:36.918021 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 99/175] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:36 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1487 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:36.932411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-bbd58876-efc2-4a62-9439-a9709eaeb03a tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Getting quotas for project dfbf75e9603749b7a3f5dbcba7cd5c57. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:36.937976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-bbd58876-efc2-4a62-9439-a9709eaeb03a tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Getting quotas for user a3e4ccba8daa4c0db757aeb812c236fd and project dfbf75e9603749b7a3f5dbcba7cd5c57. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:36.940808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:36.999159 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bbd58876-efc2-4a62-9439-a9709eaeb03a tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.132953 Sep 10 10:34:37.011608 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 77/176] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Sep 10 10:34:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 10:34:37.301539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aa97e574-edfa-4856-9b89-f2ebd9d1944e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:37.327775 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aa97e574-edfa-4856-9b89-f2ebd9d1944e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.405650 Sep 10 10:34:37.337457 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 100/177] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:34:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:37.339032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2082336118", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:37.343060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fa2a592c-b566-4839-8148-8056d772faf6 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:37.343754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fa2a592c-b566-4839-8148-8056d772faf6 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:37.372969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa2a592c-b566-4839-8148-8056d772faf6 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:37.374187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa2a592c-b566-4839-8148-8056d772faf6 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:37.377323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa2a592c-b566-4839-8148-8056d772faf6 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:37.378267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa2a592c-b566-4839-8148-8056d772faf6 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:37.379533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa2a592c-b566-4839-8148-8056d772faf6 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:37.380163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa2a592c-b566-4839-8148-8056d772faf6 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:37.451235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:34:37.733407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fa2a592c-b566-4839-8148-8056d772faf6 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:37.746610 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fa2a592c-b566-4839-8148-8056d772faf6 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1475 microversion: 2.1 time: 0.413347 Sep 10 10:34:37.747367 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 101/178] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:37 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1475 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:37.767806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-213884e3-131b-4f8a-8f4b-1b88e7599bd5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:37.768506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-213884e3-131b-4f8a-8f4b-1b88e7599bd5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:37.787872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-213884e3-131b-4f8a-8f4b-1b88e7599bd5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:37.789091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-213884e3-131b-4f8a-8f4b-1b88e7599bd5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:37.789538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-213884e3-131b-4f8a-8f4b-1b88e7599bd5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:37.793110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-213884e3-131b-4f8a-8f4b-1b88e7599bd5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:37.793608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-213884e3-131b-4f8a-8f4b-1b88e7599bd5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:37.794064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-213884e3-131b-4f8a-8f4b-1b88e7599bd5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:38.015981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:34:38.016980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:34:38.017747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:34:38.018414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:34:38.019306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:34:38.031817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:38.032927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:38.033697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:38.035131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:38.035635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:38.036168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:38.047004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:38.062649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Getting quotas for project 1eee1d2624314096a668cccbaaa7a043. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:38.067516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Getting quotas for user a169765d4b92465988bbeffab04bdbbc and project 1eee1d2624314096a668cccbaaa7a043. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:38.085957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.utils [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] cores quota exceeded for 1eee1d2624314096a668cccbaaa7a043, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128788) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 10 10:34:38.087094 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Request method failure captured: Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 145 Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGg3UNVC28Sves8XB9HSffRD0tGnKAG-04m1ai3_xJYoSnqwtBl8iauZUJRxmtM3a2O652j10fayjJPE4iNQgv67WBjQTI80NcWEBMd1l4ZD5ptLF_J_WH6i56nvEovfscK6m7ESuunOAklCwiiCKWp_xX-sfbO7epAGCMndLJvrKPA Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1eee1d2624314096a668cccbaaa7a043 Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:34:38.092705 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1eee1d2624314096a668cccbaaa7a043", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1eee1d2624314096a668cccbaaa7a043 Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-QuotasAdminNegativeTest-2112368182-project Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: a169765d4b92465988bbeffab04bdbbc Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-QuotasAdminNegativeTest-2112368182-project Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2082336118", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} Sep 10 10:34:38.094297 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2082336118', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452'}}} Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 10:34:38.095290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:38.096549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:38.098344 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:38.099717 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:38.099717 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:38.099717 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:38.099717 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:38.099717 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 10:34:38.099717 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:38.101558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:38.102608 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-659cf646-02a4-41e4-a173-330c28970e9b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.089955 Sep 10 10:34:38.104538 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 78/179] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:37 2022] POST /compute/v2.1/servers => generated 111 bytes in 1092 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:38.112408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5bda4148-48c0-4057-af53-da775d90f227 req-f3de6a73-1de6-4f91-9c7a-e47a7a32f01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72fde4e4-6f64-4a11-9eca-5b0a88ceb970", "tag": "893c6ce2-ca67-4c25-913e-f6537631463d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:38.125911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5bda4148-48c0-4057-af53-da775d90f227 req-f3de6a73-1de6-4f91-9c7a-e47a7a32f01d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:38.126547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5bda4148-48c0-4057-af53-da775d90f227 req-f3de6a73-1de6-4f91-9c7a-e47a7a32f01d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:38.127183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5bda4148-48c0-4057-af53-da775d90f227 req-f3de6a73-1de6-4f91-9c7a-e47a7a32f01d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:38.143488 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5bda4148-48c0-4057-af53-da775d90f227 req-f3de6a73-1de6-4f91-9c7a-e47a7a32f01d service nova] Creating event network-changed:893c6ce2-ca67-4c25-913e-f6537631463d for instance 72fde4e4-6f64-4a11-9eca-5b0a88ceb970 on n-h2-856894-1 Sep 10 10:34:38.149186 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5bda4148-48c0-4057-af53-da775d90f227 req-f3de6a73-1de6-4f91-9c7a-e47a7a32f01d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043112 Sep 10 10:34:38.150544 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 79/180] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:38.157766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b83cd6bc-265e-4af5-86c0-6377deb67b59 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Calling method '.version_select at 0x7efcaf2c7040>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:38.172404 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b83cd6bc-265e-4af5-86c0-6377deb67b59 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-307561346?user_id=c9395eb4bd2844859b6f0810e41a5b2a" status: 200 len: 511 microversion: 2.10 time: 0.020325 Sep 10 10:34:38.173494 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 80/181] 10.222.0.20 () {60 vars in 1337 bytes} [Sat Sep 10 10:34:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-307561346?user_id=c9395eb4bd2844859b6f0810e41a5b2a => generated 511 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:38.682588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-beae86c6-24f9-47b5-a4de-6d93b2ea3b24 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-2117259024", "id": 1817948937, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:38.718175 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-beae86c6-24f9-47b5-a4de-6d93b2ea3b24 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.542673 Sep 10 10:34:38.721778 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 81/182] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:38 2022] POST /compute/v2.1/flavors => generated 425 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:38.729817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4eed15ba-1d88-421e-bea5-3a2464fc96e8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:38.731621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4eed15ba-1d88-421e-bea5-3a2464fc96e8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:38.741180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eed15ba-1d88-421e-bea5-3a2464fc96e8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:38.745464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eed15ba-1d88-421e-bea5-3a2464fc96e8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:38.746526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eed15ba-1d88-421e-bea5-3a2464fc96e8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:38.747810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eed15ba-1d88-421e-bea5-3a2464fc96e8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:38.751498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eed15ba-1d88-421e-bea5-3a2464fc96e8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:38.752158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eed15ba-1d88-421e-bea5-3a2464fc96e8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:38.843333 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-213884e3-131b-4f8a-8f4b-1b88e7599bd5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1638 microversion: 2.1 time: 1.093291 Sep 10 10:34:38.857886 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 102/183] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:37 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1638 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:38.873031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3a9c8a9a-c4d6-40e8-923c-ddab6ad2c9db tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf67fa60>, body: {"quota_set": {"cores": 20}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:39.102368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4eed15ba-1d88-421e-bea5-3a2464fc96e8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:39.119053 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4eed15ba-1d88-421e-bea5-3a2464fc96e8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1318 microversion: 2.1 time: 0.395730 Sep 10 10:34:39.121105 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 82/184] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:38 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:39.125726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d3427c25-04a1-4364-b36e-cd363a049802 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Action: 'create', calling method: .version_select at 0x7efcaf2c7f70>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1093159915", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcaQ5aK2UvROG2UAnSglNTaPbfsUc5a7fzop6n/puId/9I/gO8rQS6damPgGeiLPk3d/G5XNW7ZAzTNYid6BDOk+rIsmKIi8rkLyWToiybRWx9aliw7jIyM69Cl+oIvTw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:39.160953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d3427c25-04a1-4364-b36e-cd363a049802 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Getting quotas for project dfbf75e9603749b7a3f5dbcba7cd5c57. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:39.165609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d3427c25-04a1-4364-b36e-cd363a049802 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Getting quotas for user a3e4ccba8daa4c0db757aeb812c236fd and project dfbf75e9603749b7a3f5dbcba7cd5c57. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:39.244663 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d3427c25-04a1-4364-b36e-cd363a049802 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.122451 Sep 10 10:34:39.245331 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 83/185] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Sep 10 10:34:39 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 10:34:39.261278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-25e3f2b6-d6fa-46ed-b235-2cc088389370 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:39.282455 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-25e3f2b6-d6fa-46ed-b235-2cc088389370 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035852 Sep 10 10:34:39.288834 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 84/186] 10.222.0.20 () {58 vars in 1182 bytes} [Sat Sep 10 10:34:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:34:39.296124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:39.296916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:39.308479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:39.309283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:39.309894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:39.312387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:39.313030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:39.313822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:39.361029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:39.362075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:39.364380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:39.365409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lazy-loading 'fault' on Instance uuid 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:34:39.426251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a9c8a9a-c4d6-40e8-923c-ddab6ad2c9db tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:39.426980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a9c8a9a-c4d6-40e8-923c-ddab6ad2c9db tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:39.427911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a9c8a9a-c4d6-40e8-923c-ddab6ad2c9db tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:39.429063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a9c8a9a-c4d6-40e8-923c-ddab6ad2c9db tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:39.429814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a9c8a9a-c4d6-40e8-923c-ddab6ad2c9db tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:39.430579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a9c8a9a-c4d6-40e8-923c-ddab6ad2c9db tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:39.439709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:39.449399 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4da2598-3b75-4a9a-9be3-5a0fac697670 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1309 microversion: 2.1 time: 0.159037 Sep 10 10:34:39.450376 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 85/187] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:39 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:39.456392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-47c48d02-9a6b-45bd-b75b-7c87b912cf73 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:39.456902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47c48d02-9a6b-45bd-b75b-7c87b912cf73 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:39.462851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c48d02-9a6b-45bd-b75b-7c87b912cf73 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:39.463328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c48d02-9a6b-45bd-b75b-7c87b912cf73 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:39.463765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c48d02-9a6b-45bd-b75b-7c87b912cf73 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:39.464445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c48d02-9a6b-45bd-b75b-7c87b912cf73 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:39.464896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c48d02-9a6b-45bd-b75b-7c87b912cf73 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:39.465357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c48d02-9a6b-45bd-b75b-7c87b912cf73 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:39.495025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47c48d02-9a6b-45bd-b75b-7c87b912cf73 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:34:39.522745 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3a9c8a9a-c4d6-40e8-923c-ddab6ad2c9db tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043" status: 200 len: 329 microversion: 2.1 time: 0.663411 Sep 10 10:34:39.536841 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 103/188] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 10:34:38 2022] PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 => generated 329 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:39.549291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-86a30d73-711e-42fd-b6c6-354533631ebe req-5c5b6c7f-cde8-4611-97ed-1672c96e6e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386253a1-3a4d-4a5f-8ca2-1177b1ff7df7", "name": "network-vif-deleted", "tag": "85cc248c-852d-4826-ae94-5dfd332eabec"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:39.645211 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-47c48d02-9a6b-45bd-b75b-7c87b912cf73 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 204 len: 0 microversion: 2.1 time: 0.192556 Sep 10 10:34:39.648923 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 86/189] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:34:39 2022] DELETE /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:34:39.654572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0033d121-a56a-4cd0-81e7-72499d4295f3 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Calling method '.version_select at 0x7efcb0b9d0d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:39.663376 n-d-856894-1 devstack@n-api.service[128788]: WARNING oslo_db.sqlalchemy.utils [None req-0033d121-a56a-4cd0-81e7-72499d4295f3 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 10:34:39.672707 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0033d121-a56a-4cd0-81e7-72499d4295f3 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs?user_id=c9395eb4bd2844859b6f0810e41a5b2a" status: 200 len: 725 microversion: 2.10 time: 0.025048 Sep 10 10:34:39.673741 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 87/190] 10.222.0.20 () {60 vars in 1259 bytes} [Sat Sep 10 10:34:39 2022] GET /compute/v2.1/os-keypairs?user_id=c9395eb4bd2844859b6f0810e41a5b2a => generated 725 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:39.678197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f9ed83f-ece9-429f-9543-8c348afcdcc6 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1533189217", "id": 1983811351, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:39.706774 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f9ed83f-ece9-429f-9543-8c348afcdcc6 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.032087 Sep 10 10:34:39.715147 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 88/191] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:39 2022] POST /compute/v2.1/flavors => generated 425 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:39.764868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-86a30d73-711e-42fd-b6c6-354533631ebe req-5c5b6c7f-cde8-4611-97ed-1672c96e6e2c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:39.765511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-86a30d73-711e-42fd-b6c6-354533631ebe req-5c5b6c7f-cde8-4611-97ed-1672c96e6e2c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:39.766137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-86a30d73-711e-42fd-b6c6-354533631ebe req-5c5b6c7f-cde8-4611-97ed-1672c96e6e2c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:39.782891 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-86a30d73-711e-42fd-b6c6-354533631ebe req-5c5b6c7f-cde8-4611-97ed-1672c96e6e2c service nova] Creating event network-vif-deleted:85cc248c-852d-4826-ae94-5dfd332eabec for instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 on n-h2-856894-1 Sep 10 10:34:39.788626 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-86a30d73-711e-42fd-b6c6-354533631ebe req-5c5b6c7f-cde8-4611-97ed-1672c96e6e2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250006 Sep 10 10:34:39.789771 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 104/192] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:39.796353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-efa55c6f-6517-4856-ae9a-77e7ae463c28 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Calling method '.version_select at 0x7efcaf6c4dc0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:39.918757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-475935f5-15ef-4928-9931-9e13cc87103d tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf3f4820>, body: {"quota_set": {"ram": "5120"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:40.047401 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-efa55c6f-6517-4856-ae9a-77e7ae463c28 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043" status: 200 len: 371 microversion: 2.1 time: 0.254949 Sep 10 10:34:40.049714 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 105/193] 10.222.0.20 () {58 vars in 1242 bytes} [Sat Sep 10 10:34:39 2022] GET /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 => generated 371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:40.062963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-475935f5-15ef-4928-9931-9e13cc87103d tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.064401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ddbfcadf-48e2-4faa-89ab-3338254360e9 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:40.064936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-475935f5-15ef-4928-9931-9e13cc87103d tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.065183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ddbfcadf-48e2-4faa-89ab-3338254360e9 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:40.065849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-475935f5-15ef-4928-9931-9e13cc87103d tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.066864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-475935f5-15ef-4928-9931-9e13cc87103d tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.067597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-475935f5-15ef-4928-9931-9e13cc87103d tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.068319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-475935f5-15ef-4928-9931-9e13cc87103d tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.080662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddbfcadf-48e2-4faa-89ab-3338254360e9 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.081480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddbfcadf-48e2-4faa-89ab-3338254360e9 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.082077 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddbfcadf-48e2-4faa-89ab-3338254360e9 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.082958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddbfcadf-48e2-4faa-89ab-3338254360e9 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.083568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddbfcadf-48e2-4faa-89ab-3338254360e9 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.084145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddbfcadf-48e2-4faa-89ab-3338254360e9 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.167423 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-475935f5-15ef-4928-9931-9e13cc87103d tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/9fdf9a73f9af4da5b24df730aee14275" status: 200 len: 148 microversion: 2.57 time: 0.455218 Sep 10 10:34:40.174674 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 89/194] 10.222.0.20 () {62 vars in 1303 bytes} [Sat Sep 10 10:34:39 2022] PUT /compute/v2.1/os-quota-sets/9fdf9a73f9af4da5b24df730aee14275 => generated 148 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:40.174674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c9403372-7100-49f3-866c-5bd89ad638b8 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Calling method '.version_select at 0x7efcaf4ce790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:40.196901 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c9403372-7100-49f3-866c-5bd89ad638b8 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1093159915" status: 204 len: 0 microversion: 2.10 time: 0.026645 Sep 10 10:34:40.198034 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 90/195] 10.222.0.20 () {60 vars in 1325 bytes} [Sat Sep 10 10:34:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1093159915 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:34:40.206025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38ec0bc0-0b7d-4db1-b87c-37d60d73d911 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:40.215207 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38ec0bc0-0b7d-4db1-b87c-37d60d73d911 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015983 Sep 10 10:34:40.215984 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 91/196] 10.222.0.20 () {58 vars in 1182 bytes} [Sat Sep 10 10:34:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:34:40.221093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6ffc05c-cbdd-4808-9729-dba2fb239477 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf23df70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:40.298196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6ffc05c-cbdd-4808-9729-dba2fb239477 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.299273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6ffc05c-cbdd-4808-9729-dba2fb239477 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.299931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6ffc05c-cbdd-4808-9729-dba2fb239477 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.300893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6ffc05c-cbdd-4808-9729-dba2fb239477 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.301605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6ffc05c-cbdd-4808-9729-dba2fb239477 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.303202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6ffc05c-cbdd-4808-9729-dba2fb239477 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.386155 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6ffc05c-cbdd-4808-9729-dba2fb239477 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043" status: 200 len: 328 microversion: 2.1 time: 0.169070 Sep 10 10:34:40.400275 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 92/197] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 10:34:40 2022] PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 => generated 328 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:40.400275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ad54a87-795a-49d9-951e-93230873bf0d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:40.400275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ad54a87-795a-49d9-951e-93230873bf0d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:40.400630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ddbfcadf-48e2-4faa-89ab-3338254360e9 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:40.405275 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ddbfcadf-48e2-4faa-89ab-3338254360e9 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1493 microversion: 2.1 time: 0.345037 Sep 10 10:34:40.412893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ad54a87-795a-49d9-951e-93230873bf0d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.414459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ad54a87-795a-49d9-951e-93230873bf0d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.415128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ad54a87-795a-49d9-951e-93230873bf0d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.415848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ad54a87-795a-49d9-951e-93230873bf0d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.416306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ad54a87-795a-49d9-951e-93230873bf0d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.416730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ad54a87-795a-49d9-951e-93230873bf0d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.421671 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 106/198] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:40 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1493 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:40.432324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dca43e36-4609-4cf1-b56d-f3f71e6b4abc tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Calling method '.version_select at 0x7efcb02f1c10>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:40.565773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dca43e36-4609-4cf1-b56d-f3f71e6b4abc tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.567104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dca43e36-4609-4cf1-b56d-f3f71e6b4abc tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.568470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dca43e36-4609-4cf1-b56d-f3f71e6b4abc tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.571593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dca43e36-4609-4cf1-b56d-f3f71e6b4abc tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.572289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dca43e36-4609-4cf1-b56d-f3f71e6b4abc tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.573042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dca43e36-4609-4cf1-b56d-f3f71e6b4abc tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.633994 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dca43e36-4609-4cf1-b56d-f3f71e6b4abc tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/9fdf9a73f9af4da5b24df730aee14275/detail" status: 200 len: 463 microversion: 2.57 time: 0.208725 Sep 10 10:34:40.635355 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 107/199] 10.222.0.20 () {60 vars in 1304 bytes} [Sat Sep 10 10:34:40 2022] GET /compute/v2.1/os-quota-sets/9fdf9a73f9af4da5b24df730aee14275/detail => generated 463 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:40.649837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bcf57dce-455b-45e2-a1f5-96d93facff18 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Calling method '.version_select at 0x7efcaf6383a0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:40.695975 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bcf57dce-455b-45e2-a1f5-96d93facff18 tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608249910?user_id=c9395eb4bd2844859b6f0810e41a5b2a" status: 204 len: 0 microversion: 2.10 time: 0.057803 Sep 10 10:34:40.696894 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 108/200] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 10:34:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608249910?user_id=c9395eb4bd2844859b6f0810e41a5b2a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:34:40.709563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-72b02cff-07e9-41fa-a5f8-170044e539ad tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Action: 'create', calling method: .version_select at 0x7efcafa5c1f0>, body: {"keypair": {"name": "tempest-keypair-237547689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYgueuVWu8qVROpBmgnyxIkoG/PwXns1jajwU9WjV7OyfjF7KlbVpbB+Y1mcf/VxlTYVYfk0vdjhvjlkORBdB6avSmWZNWW4RS6E3Vca4H7dzRf6CNEFGP6I12D26dilw=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:40.761649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-72b02cff-07e9-41fa-a5f8-170044e539ad tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Getting quotas for project 66c9f6e01abe44fe91a53705322fd55f. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:40.770849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-72b02cff-07e9-41fa-a5f8-170044e539ad tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Getting quotas for user 7204a4162d974d978837f0605301a735 and project 66c9f6e01abe44fe91a53705322fd55f. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:40.840355 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-72b02cff-07e9-41fa-a5f8-170044e539ad tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135305 Sep 10 10:34:40.855874 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 109/201] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:34:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:40.862384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:40.863015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:40.889500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.890035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.890482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.891223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.892280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.892741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.987311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:40.987843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:40.990763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:40.991305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lazy-loading 'fault' on Instance uuid 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:34:41.132848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:41.145664 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3b4de55b-5912-497e-95f4-42f154c602d9 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 200 len: 1309 microversion: 2.1 time: 0.293000 Sep 10 10:34:41.149397 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 110/202] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:40 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 1309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:41.160875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-451112017", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:41.272558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] validate_networks() for None {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:34:41.838737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ad54a87-795a-49d9-951e-93230873bf0d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:41.848144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ad54a87-795a-49d9-951e-93230873bf0d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1318 microversion: 2.1 time: 1.457569 Sep 10 10:34:41.849303 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 93/203] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:40 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1318 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:41.853737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50a48e11-91d9-4aea-8e3a-626c20cb00aa tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] Calling method '.version_select at 0x7efcaf23d670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:41.901647 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50a48e11-91d9-4aea-8e3a-626c20cb00aa tempest-KeyPairsV210TestJSON-1363632590 tempest-KeyPairsV210TestJSON-1363632590-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-307561346?user_id=c9395eb4bd2844859b6f0810e41a5b2a" status: 204 len: 0 microversion: 2.10 time: 0.051275 Sep 10 10:34:41.907105 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 94/204] 10.222.0.20 () {60 vars in 1340 bytes} [Sat Sep 10 10:34:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-307561346?user_id=c9395eb4bd2844859b6f0810e41a5b2a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:34:41.914725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf1da430>, body: {"quota_set": {"ram": "2048"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:41.987029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:34:41.987459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:34:41.988231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:34:41.988804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:34:41.989409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:34:42.007293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:42.010840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:42.011278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:42.012068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:42.012532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:42.012965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:42.070646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:42.076795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Getting quotas for project 1eee1d2624314096a668cccbaaa7a043. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:42.081884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Getting quotas for user a169765d4b92465988bbeffab04bdbbc and project 1eee1d2624314096a668cccbaaa7a043. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:42.083828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:42.084263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:42.084694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:42.085453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:42.085912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:42.086238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:42.086352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:42.101263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.utils [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] instances quota exceeded for 1eee1d2624314096a668cccbaaa7a043, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128787) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 10 10:34:42.102462 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Request method failure captured: Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 144 Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGg3UNVC28Sves8XB9HSffRD0tGnKAG-04m1ai3_xJYoSnqwtBl8iauZUJRxmtM3a2O652j10fayjJPE4iNQgv67WBjQTI80NcWEBMd1l4ZD5ptLF_J_WH6i56nvEovfscK6m7ESuunOAklCwiiCKWp_xX-sfbO7epAGCMndLJvrKPA Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 1eee1d2624314096a668cccbaaa7a043 Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:42.110364 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1eee1d2624314096a668cccbaaa7a043", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 1eee1d2624314096a668cccbaaa7a043 Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-QuotasAdminNegativeTest-2112368182-project Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: a169765d4b92465988bbeffab04bdbbc Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-QuotasAdminNegativeTest-2112368182-project Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-451112017", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} Sep 10 10:34:42.111847 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-451112017', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452'}}} Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 10:34:42.112780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:42.114305 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.116161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:42.117529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:42.117529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:42.117529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:42.117529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:42.117529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 10:34:42.117529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.119757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:42.121109 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aa808466-66e5-43c7-b21e-cd5aaa146747 tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.970301 Sep 10 10:34:42.122213 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 111/205] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:41 2022] POST /compute/v2.1/servers => generated 119 bytes in 972 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:42.127156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-772be013-4d16-4784-b670-4ec527b2e5d8 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:42.128495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-772be013-4d16-4784-b670-4ec527b2e5d8 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:42.138256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-772be013-4d16-4784-b670-4ec527b2e5d8 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:42.140036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-772be013-4d16-4784-b670-4ec527b2e5d8 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:42.141373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-772be013-4d16-4784-b670-4ec527b2e5d8 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:42.142476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-772be013-4d16-4784-b670-4ec527b2e5d8 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:42.143285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-772be013-4d16-4784-b670-4ec527b2e5d8 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:42.143937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-772be013-4d16-4784-b670-4ec527b2e5d8 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:42.248611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:42.249471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:42.250171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:42.251114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:42.251843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:42.252553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:42.376834 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2660e24f-de93-4dce-8f37-dae2d83e2dee tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/9fdf9a73f9af4da5b24df730aee14275?user_id=0e601a3d5f074830abe73ccf9b16956f" status: 200 len: 148 microversion: 2.57 time: 0.468161 Sep 10 10:34:42.378928 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 95/206] 10.222.0.20 () {62 vars in 1384 bytes} [Sat Sep 10 10:34:41 2022] PUT /compute/v2.1/os-quota-sets/9fdf9a73f9af4da5b24df730aee14275?user_id=0e601a3d5f074830abe73ccf9b16956f => generated 148 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:42.397638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-511c5126-7b37-45df-8bf8-d9b4faa8c1f0 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf1f3d30>, body: {"quota_set": {"instances": 10}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:42.567875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-772be013-4d16-4784-b670-4ec527b2e5d8 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787948efda9644269a83ee97c4dde350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bfda1adb59b4b56927f590ad0345d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:42.577345 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-772be013-4d16-4784-b670-4ec527b2e5d8 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 200 len: 1493 microversion: 2.1 time: 0.453809 Sep 10 10:34:42.598982 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 112/207] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:42 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 1493 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:42.609965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:42.624323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:42.656506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:42.659557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:42.660985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:42.661930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:42.681175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:42.682966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:42.720184 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] HTTP exception thrown: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Request method failure captured: Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 HTTP/1.1 Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgXBn-N_1w9xT_EcJhdNORdFBDFmsOVHEslj4KRn41iE7abMfZIijLh70NOIfv0U7ZsOefM6Rvalqtf1Sj4r3J5vcGll3SMy_GmpN15d31iUZ6jp2br5YX274yqaIuG3CDC9N0kOP0sHUDSEJEifuBzWsOz8C0bLzv6UhtolpcQUV8 Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:42.722808 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fd93ef10e524fbc9e7097521db75920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 4c1c3bd16a894700a9766beae6c604ed Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:34:42.724283 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '386253a1-3a4d-4a5f-8ca2-1177b1ff7df7'} Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:42.725089 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:34:42.726246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:42.727722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Returning 404 to user: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:42.728931 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-41a862e6-d6f4-410e-885f-24afb757be3b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 404 len: 111 microversion: 2.1 time: 0.123591 Sep 10 10:34:42.744327 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 113/208] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:42 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:42.755834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-33e11546-145d-46cb-824b-9555ad91c917 tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] Calling method '.version_select at 0x7efcaf461550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:43.091631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-511c5126-7b37-45df-8bf8-d9b4faa8c1f0 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:43.092660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-511c5126-7b37-45df-8bf8-d9b4faa8c1f0 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:43.093127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-511c5126-7b37-45df-8bf8-d9b4faa8c1f0 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:43.094278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-511c5126-7b37-45df-8bf8-d9b4faa8c1f0 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:43.096633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-511c5126-7b37-45df-8bf8-d9b4faa8c1f0 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:43.097200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-511c5126-7b37-45df-8bf8-d9b4faa8c1f0 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:43.226459 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-511c5126-7b37-45df-8bf8-d9b4faa8c1f0 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043" status: 200 len: 329 microversion: 2.1 time: 0.845661 Sep 10 10:34:43.232815 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 96/209] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 10:34:42 2022] PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 => generated 329 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:43.255295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e03266c-4a3c-477c-b5f5-a7d689b85374 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:43.260944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e03266c-4a3c-477c-b5f5-a7d689b85374 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:43.280396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e03266c-4a3c-477c-b5f5-a7d689b85374 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:43.281819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e03266c-4a3c-477c-b5f5-a7d689b85374 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:43.282267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e03266c-4a3c-477c-b5f5-a7d689b85374 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:43.283980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e03266c-4a3c-477c-b5f5-a7d689b85374 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:43.284639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e03266c-4a3c-477c-b5f5-a7d689b85374 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:43.288052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e03266c-4a3c-477c-b5f5-a7d689b85374 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:43.429341 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-33e11546-145d-46cb-824b-9555ad91c917 tempest-QuotasAdminTestV257-862261575 tempest-QuotasAdminTestV257-862261575-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/9fdf9a73f9af4da5b24df730aee14275?user_id=0e601a3d5f074830abe73ccf9b16956f" status: 200 len: 190 microversion: 2.57 time: 0.683645 Sep 10 10:34:43.431872 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 114/210] 10.222.0.20 () {60 vars in 1364 bytes} [Sat Sep 10 10:34:42 2022] GET /compute/v2.1/os-quota-sets/9fdf9a73f9af4da5b24df730aee14275?user_id=0e601a3d5f074830abe73ccf9b16956f => generated 190 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:43.450608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-b26d53e9-2d8f-4573-af67-98f7056f26d0 req-242cb2d5-bbe1-4155-bc07-642d856e11b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fde3838-50ca-4b70-8740-85058a89e99d", "name": "network-vif-deleted", "tag": "83038be3-1f2e-4e9e-af93-64515b7bbf06"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:43.472752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b26d53e9-2d8f-4573-af67-98f7056f26d0 req-242cb2d5-bbe1-4155-bc07-642d856e11b8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:43.473268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b26d53e9-2d8f-4573-af67-98f7056f26d0 req-242cb2d5-bbe1-4155-bc07-642d856e11b8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:43.473697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b26d53e9-2d8f-4573-af67-98f7056f26d0 req-242cb2d5-bbe1-4155-bc07-642d856e11b8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:43.496585 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-b26d53e9-2d8f-4573-af67-98f7056f26d0 req-242cb2d5-bbe1-4155-bc07-642d856e11b8 service nova] Creating event network-vif-deleted:83038be3-1f2e-4e9e-af93-64515b7bbf06 for instance 0fde3838-50ca-4b70-8740-85058a89e99d on n-h1-856894-1 Sep 10 10:34:43.520918 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-b26d53e9-2d8f-4573-af67-98f7056f26d0 req-242cb2d5-bbe1-4155-bc07-642d856e11b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087752 Sep 10 10:34:43.525504 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 115/211] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:43.535068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9944f470-6468-4c87-9a6e-d1b1cabd5836 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Calling method '.version_select at 0x7efcaf461160>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:43.791353 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9944f470-6468-4c87-9a6e-d1b1cabd5836 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043" status: 200 len: 371 microversion: 2.1 time: 0.264535 Sep 10 10:34:43.792257 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 116/212] 10.222.0.20 () {58 vars in 1242 bytes} [Sat Sep 10 10:34:43 2022] GET /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 => generated 371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:43.833756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1460917781", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:43.936555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] validate_networks() for None {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:34:44.290212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e03266c-4a3c-477c-b5f5-a7d689b85374 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:44.303153 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e03266c-4a3c-477c-b5f5-a7d689b85374 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1318 microversion: 2.1 time: 1.068478 Sep 10 10:34:44.319349 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 97/213] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:43 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1318 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:44.342688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:44.343357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:44.353964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:44.354462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:44.354897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:44.355600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:44.356042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:44.362098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:44.398181 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] HTTP exception thrown: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Request method failure captured: Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d HTTP/1.1 Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgNxsXBPqqHQVMKaaBXmRSh_ZDMNrLzXEn5hhD-zbuXV-V_xnNcZ6QAXUZAKnBZHXpXbtzmo7NVUSIVH6ymNX5_f2sYLlztKVcBROYXdKGq6qWdk2Po8_rezFAHmOSht6nfkUQasQIqEM2i9WBOx31KyVa8eAb8E-_u7__yzgwCmwo Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 4bfda1adb59b4b56927f590ad0345d9a Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AggregatesAdminTestJSON-976893167 Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:34:44.406736 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4bfda1adb59b4b56927f590ad0345d9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4bfda1adb59b4b56927f590ad0345d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4bfda1adb59b4b56927f590ad0345d9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4bfda1adb59b4b56927f590ad0345d9a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AggregatesAdminTestJSON-976893167 Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 4bfda1adb59b4b56927f590ad0345d9a Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-976893167 Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AggregatesAdminTestJSON-976893167-project Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 787948efda9644269a83ee97c4dde350 Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AggregatesAdminTestJSON-976893167-project Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:44.408165 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '0fde3838-50ca-4b70-8740-85058a89e99d'} Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:44.408982 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:44.410208 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:44.414991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Returning 404 to user: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:44.416790 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a32194a3-3f90-4741-bc7b-d616da94f302 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 404 len: 111 microversion: 2.1 time: 0.096145 Sep 10 10:34:44.420497 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 98/214] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:44 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:44.428951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0331f1a6-b9b2-4706-80c3-a6cf22dd2854 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf19e940>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:44.492513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:34:44.493012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:34:44.493427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:34:44.494299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:34:44.494727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:34:44.511498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:44.518544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:44.519012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:44.519836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:44.520303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:44.520739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:44.569457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Getting quotas for project 5fd93ef10e524fbc9e7097521db75920. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:44.579212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Getting quotas for user 4c1c3bd16a894700a9766beae6c604ed and project 5fd93ef10e524fbc9e7097521db75920. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:44.596393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:34:44.615326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:34:44.720811 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ca920b4b-70ab-47b9-a3c9-ac65758f7523 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927460 Sep 10 10:34:44.733058 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 117/215] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:34:44.753414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a2596e47-c97c-49dd-a340-ea2c23bfd608 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:44.789567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2596e47-c97c-49dd-a340-ea2c23bfd608 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:44.790066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2596e47-c97c-49dd-a340-ea2c23bfd608 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:44.790507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2596e47-c97c-49dd-a340-ea2c23bfd608 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:45.102056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331f1a6-b9b2-4706-80c3-a6cf22dd2854 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:45.103319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331f1a6-b9b2-4706-80c3-a6cf22dd2854 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:45.105836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331f1a6-b9b2-4706-80c3-a6cf22dd2854 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:45.108893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331f1a6-b9b2-4706-80c3-a6cf22dd2854 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:45.111524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331f1a6-b9b2-4706-80c3-a6cf22dd2854 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:45.113508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331f1a6-b9b2-4706-80c3-a6cf22dd2854 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:45.160490 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a2596e47-c97c-49dd-a340-ea2c23bfd608 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 300 microversion: 2.1 time: 0.424408 Sep 10 10:34:45.162340 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 118/216] 10.222.0.20 () {60 vars in 1191 bytes} [Sat Sep 10 10:34:44 2022] POST /compute/v2.1/os-aggregates/2/action => generated 300 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:45.177498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e956a537-3e57-4520-b36c-d64388dbf3d4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:45.179954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e956a537-3e57-4520-b36c-d64388dbf3d4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:45.285744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0331f1a6-b9b2-4706-80c3-a6cf22dd2854 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043" status: 200 len: 325 microversion: 2.1 time: 0.862495 Sep 10 10:34:45.290458 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 99/217] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 10:34:44 2022] PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 => generated 325 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:45.297484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90203551-67a5-476b-9ae8-808f0794657a tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:45.369927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e956a537-3e57-4520-b36c-d64388dbf3d4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:45.378511 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90203551-67a5-476b-9ae8-808f0794657a tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.086249 Sep 10 10:34:45.386995 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 100/218] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:45 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:34:45.396720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2746e02c-eaa6-44e8-81c2-ab4a99f5461d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:45.400266 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e956a537-3e57-4520-b36c-d64388dbf3d4 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1220 microversion: 2.1 time: 0.235873 Sep 10 10:34:45.401965 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 119/219] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:45 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1220 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:45.414234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-afe478db-2553-4da8-a9cd-df3d48ea8b3a tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-938479418"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:45.421287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2746e02c-eaa6-44e8-81c2-ab4a99f5461d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:45.425991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-afe478db-2553-4da8-a9cd-df3d48ea8b3a tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Generated uuid 1cfbf101-c95d-4e22-b957-d875cef53197 for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:34:45.437792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2746e02c-eaa6-44e8-81c2-ab4a99f5461d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:45.438729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2746e02c-eaa6-44e8-81c2-ab4a99f5461d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:45.441770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2746e02c-eaa6-44e8-81c2-ab4a99f5461d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:45.442705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2746e02c-eaa6-44e8-81c2-ab4a99f5461d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:45.445293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2746e02c-eaa6-44e8-81c2-ab4a99f5461d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:45.447915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2746e02c-eaa6-44e8-81c2-ab4a99f5461d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:45.488987 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-afe478db-2553-4da8-a9cd-df3d48ea8b3a tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.084959 Sep 10 10:34:45.489742 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 120/220] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:34:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:45.510695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b75796f0-13aa-4c5f-88ba-2744ac0b0cc8 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:45.552333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b75796f0-13aa-4c5f-88ba-2744ac0b0cc8 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:45.554208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b75796f0-13aa-4c5f-88ba-2744ac0b0cc8 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:45.554686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b75796f0-13aa-4c5f-88ba-2744ac0b0cc8 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:45.848833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2746e02c-eaa6-44e8-81c2-ab4a99f5461d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:45.861436 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2746e02c-eaa6-44e8-81c2-ab4a99f5461d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1318 microversion: 2.1 time: 0.473177 Sep 10 10:34:45.863069 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 101/221] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:45 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:45.874089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-123724758", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:45.916751 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b75796f0-13aa-4c5f-88ba-2744ac0b0cc8 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.418114 Sep 10 10:34:45.917824 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 121/222] 10.222.0.20 () {60 vars in 1191 bytes} [Sat Sep 10 10:34:45 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:45.932373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ad52ec1d-d624-4e9f-970b-27daa7c1c7c5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:45.952181 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ad52ec1d-d624-4e9f-970b-27daa7c1c7c5 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.025388 Sep 10 10:34:45.953525 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 122/223] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:34:45 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:45.969293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-459b9169-e7a6-47ac-b815-86fed68af7f3 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:46.000216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-459b9169-e7a6-47ac-b815-86fed68af7f3 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:46.005638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-459b9169-e7a6-47ac-b815-86fed68af7f3 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:46.006631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:34:46.008629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-459b9169-e7a6-47ac-b815-86fed68af7f3 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:46.252719 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-459b9169-e7a6-47ac-b815-86fed68af7f3 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.290883 Sep 10 10:34:46.254026 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 123/224] 10.222.0.20 () {60 vars in 1191 bytes} [Sat Sep 10 10:34:45 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:46.268577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b857d20-97dc-4f73-8b0e-eec673e525a7 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:46.340143 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0b857d20-97dc-4f73-8b0e-eec673e525a7 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.059334 Sep 10 10:34:46.341498 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 124/225] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:46 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:34:46.350425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2032505750", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "1983811351", "adminPass": "***", "networks": [{"uuid": "c2a9898f-5cdf-40ea-bbee-06d824e8c5d7"}], "security_groups": [{"name": "tempest-securitygroup--427678951"}], "key_name": "tempest-keypair-237547689", "user_data": "}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:46.645752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:34:46.646284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:34:46.646967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:34:46.647533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:34:46.648192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:34:46.663499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:46.666254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] validate_networks() for [('c2a9898f-5cdf-40ea-bbee-06d824e8c5d7', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:34:46.667321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:46.669506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:46.671834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:46.673901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:46.674538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:46.720087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Getting quotas for project 1eee1d2624314096a668cccbaaa7a043. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:46.726600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Getting quotas for user a169765d4b92465988bbeffab04bdbbc and project 1eee1d2624314096a668cccbaaa7a043. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:46.746901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.utils [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] ram quota exceeded for 1eee1d2624314096a668cccbaaa7a043, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128788) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 10 10:34:46.747678 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Request method failure captured: Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 144 Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGg3UNVC28Sves8XB9HSffRD0tGnKAG-04m1ai3_xJYoSnqwtBl8iauZUJRxmtM3a2O652j10fayjJPE4iNQgv67WBjQTI80NcWEBMd1l4ZD5ptLF_J_WH6i56nvEovfscK6m7ESuunOAklCwiiCKWp_xX-sfbO7epAGCMndLJvrKPA Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1eee1d2624314096a668cccbaaa7a043 Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:34:46.750611 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1eee1d2624314096a668cccbaaa7a043", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1eee1d2624314096a668cccbaaa7a043 Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-QuotasAdminNegativeTest-2112368182-project Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: a169765d4b92465988bbeffab04bdbbc Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-QuotasAdminNegativeTest-2112368182-project Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-123724758", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} Sep 10 10:34:46.751747 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-123724758', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452'}}} Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 10:34:46.752485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:46.753523 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:46.755286 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:46.757755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:46.757755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:46.757755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:46.757755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:46.757755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 10:34:46.757755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:46.757755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:46.757755 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a89a82b-69ec-4cb3-ae57-57c41d9ad4eb tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.892005 Sep 10 10:34:46.759545 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 102/226] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:45 2022] POST /compute/v2.1/servers => generated 110 bytes in 895 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:46.776522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-70b38cab-08ff-463e-a7d5-7da8f9ec4aeb tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1028293896"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:46.781129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.aggregate [None req-70b38cab-08ff-463e-a7d5-7da8f9ec4aeb tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Generated uuid 9863db0d-7ef4-43a7-9a3c-7a1e3b8bbb5f for aggregate {{(pid=128788) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:34:46.826917 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-70b38cab-08ff-463e-a7d5-7da8f9ec4aeb tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066678 Sep 10 10:34:46.829508 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 103/227] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:34:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:46.839292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94da3f9f-3530-4aac-a886-6bbeb2c1e3ca tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:46.840255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-94da3f9f-3530-4aac-a886-6bbeb2c1e3ca tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:46.848891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94da3f9f-3530-4aac-a886-6bbeb2c1e3ca tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:46.849715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94da3f9f-3530-4aac-a886-6bbeb2c1e3ca tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:46.850373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94da3f9f-3530-4aac-a886-6bbeb2c1e3ca tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:46.851274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94da3f9f-3530-4aac-a886-6bbeb2c1e3ca tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:46.851921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94da3f9f-3530-4aac-a886-6bbeb2c1e3ca tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:46.852535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94da3f9f-3530-4aac-a886-6bbeb2c1e3ca tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:47.014971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-94da3f9f-3530-4aac-a886-6bbeb2c1e3ca tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:47.030115 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94da3f9f-3530-4aac-a886-6bbeb2c1e3ca tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1290 microversion: 2.1 time: 0.199133 Sep 10 10:34:47.034970 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 104/228] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:46 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1290 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:47.048404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c8eabbf2-9d8b-43be-8698-d23e679066e0 req-da8f40ba-76ed-47a2-99f7-78559c14ebd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72fde4e4-6f64-4a11-9eca-5b0a88ceb970", "name": "network-vif-plugged", "status": "completed", "tag": "893c6ce2-ca67-4c25-913e-f6537631463d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:47.093253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c8eabbf2-9d8b-43be-8698-d23e679066e0 req-da8f40ba-76ed-47a2-99f7-78559c14ebd3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:47.094801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c8eabbf2-9d8b-43be-8698-d23e679066e0 req-da8f40ba-76ed-47a2-99f7-78559c14ebd3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:47.095956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c8eabbf2-9d8b-43be-8698-d23e679066e0 req-da8f40ba-76ed-47a2-99f7-78559c14ebd3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:47.118443 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c8eabbf2-9d8b-43be-8698-d23e679066e0 req-da8f40ba-76ed-47a2-99f7-78559c14ebd3 service nova] Creating event network-vif-plugged:893c6ce2-ca67-4c25-913e-f6537631463d for instance 72fde4e4-6f64-4a11-9eca-5b0a88ceb970 on n-h2-856894-1 Sep 10 10:34:47.135582 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c8eabbf2-9d8b-43be-8698-d23e679066e0 req-da8f40ba-76ed-47a2-99f7-78559c14ebd3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098150 Sep 10 10:34:47.136826 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 105/229] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:47.158605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28ef9002-c44c-40b2-9ead-d22c982a9283 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf2c0940>, body: {"quota_set": {"ram": 51200}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:47.652375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28ef9002-c44c-40b2-9ead-d22c982a9283 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:47.655162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28ef9002-c44c-40b2-9ead-d22c982a9283 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:47.656988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28ef9002-c44c-40b2-9ead-d22c982a9283 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:47.657817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28ef9002-c44c-40b2-9ead-d22c982a9283 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:47.658556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28ef9002-c44c-40b2-9ead-d22c982a9283 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:47.660067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28ef9002-c44c-40b2-9ead-d22c982a9283 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:47.738216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-28ef9002-c44c-40b2-9ead-d22c982a9283 tempest-QuotasAdminNegativeTest-708170958 tempest-QuotasAdminNegativeTest-708170958-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043" status: 200 len: 329 microversion: 2.1 time: 0.600129 Sep 10 10:34:47.738967 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 106/230] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 10:34:47 2022] PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 => generated 329 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:47.758973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-39211907-b48f-4edf-90a7-15cd2b4a8d23 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-856894-1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:47.781739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:47.788300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39211907-b48f-4edf-90a7-15cd2b4a8d23 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:47.788739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39211907-b48f-4edf-90a7-15cd2b4a8d23 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:47.789279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39211907-b48f-4edf-90a7-15cd2b4a8d23 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:48.019074 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-39211907-b48f-4edf-90a7-15cd2b4a8d23 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.268044 Sep 10 10:34:48.019852 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 107/231] 10.222.0.20 () {60 vars in 1191 bytes} [Sat Sep 10 10:34:47 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:48.032294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5893eff-5f3e-4a13-8527-5bd869e0c174 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:48.034286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e5893eff-5f3e-4a13-8527-5bd869e0c174 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:48.045471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5893eff-5f3e-4a13-8527-5bd869e0c174 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:48.046197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5893eff-5f3e-4a13-8527-5bd869e0c174 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:48.046895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5893eff-5f3e-4a13-8527-5bd869e0c174 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:48.049240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5893eff-5f3e-4a13-8527-5bd869e0c174 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:48.049992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5893eff-5f3e-4a13-8527-5bd869e0c174 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:48.050689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5893eff-5f3e-4a13-8527-5bd869e0c174 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:48.331646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e5893eff-5f3e-4a13-8527-5bd869e0c174 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:48.347475 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e5893eff-5f3e-4a13-8527-5bd869e0c174 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1318 microversion: 2.1 time: 0.325814 Sep 10 10:34:48.358642 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 108/232] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:48 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:48.369538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56fd91de-8bbb-4f21-8474-ca5f2c29717b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Action: 'update', calling method: .version_select at 0x7efcaf2c00d0>, body: {"quota_set": {"ram": 0}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:48.376770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56fd91de-8bbb-4f21-8474-ca5f2c29717b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'a169765d4b92465988bbeffab04bdbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eee1d2624314096a668cccbaaa7a043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56fd91de-8bbb-4f21-8474-ca5f2c29717b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Request method failure captured: Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 HTTP/1.1 Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 25 Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGg3UNVC28Sves8XB9HSffRD0tGnKAG-04m1ai3_xJYoSnqwtBl8iauZUJRxmtM3a2O652j10fayjJPE4iNQgv67WBjQTI80NcWEBMd1l4ZD5ptLF_J_WH6i56nvEovfscK6m7ESuunOAklCwiiCKWp_xX-sfbO7epAGCMndLJvrKPA Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1eee1d2624314096a668cccbaaa7a043 Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:34:48.385901 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1eee1d2624314096a668cccbaaa7a043"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1eee1d2624314096a668cccbaaa7a043", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1eee1d2624314096a668cccbaaa7a043 Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2112368182 Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-QuotasAdminNegativeTest-2112368182-project Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: a169765d4b92465988bbeffab04bdbbc Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-QuotasAdminNegativeTest-2112368182-project Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: {"quota_set": {"ram": 0}} Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 10 10:34:48.387237 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '1eee1d2624314096a668cccbaaa7a043', 'body': {'quota_set': {'ram': 0}}} Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:48.387979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:48.389585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:48.390649 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:48.390649 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:48.390649 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:48.390649 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:48.390649 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 10 10:34:48.390649 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:48.390649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56fd91de-8bbb-4f21-8474-ca5f2c29717b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:48.390649 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56fd91de-8bbb-4f21-8474-ca5f2c29717b tempest-QuotasAdminNegativeTest-2112368182 tempest-QuotasAdminNegativeTest-2112368182-project] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043" status: 403 len: 116 microversion: 2.1 time: 0.037711 Sep 10 10:34:48.396023 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 109/233] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 10:34:48 2022] PUT /compute/v2.1/os-quota-sets/1eee1d2624314096a668cccbaaa7a043 => generated 116 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:48.401678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-140fccbc-5ba4-4cd5-925f-6b850dab485c tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:48.427655 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-140fccbc-5ba4-4cd5-925f-6b850dab485c tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.028047 Sep 10 10:34:48.435858 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 110/234] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:34:48 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:48.448871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8d4c88d3-3b10-47c2-bb62-945c8637a1fc tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:48.450673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8d4c88d3-3b10-47c2-bb62-945c8637a1fc tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:48.469004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d4c88d3-3b10-47c2-bb62-945c8637a1fc tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:48.469568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d4c88d3-3b10-47c2-bb62-945c8637a1fc tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:48.469997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d4c88d3-3b10-47c2-bb62-945c8637a1fc tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:48.470730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d4c88d3-3b10-47c2-bb62-945c8637a1fc tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:48.471184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d4c88d3-3b10-47c2-bb62-945c8637a1fc tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:48.475635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d4c88d3-3b10-47c2-bb62-945c8637a1fc tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:48.498643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:34:48.499433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:34:48.499923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:34:48.500348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:34:48.500767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:34:48.518766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:48.519381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:48.519819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:48.520819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:48.524109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:48.524590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:48.576692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Getting quotas for project 66c9f6e01abe44fe91a53705322fd55f. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:48.583609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Getting quotas for user 7204a4162d974d978837f0605301a735 and project 66c9f6e01abe44fe91a53705322fd55f. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:48.621363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:34:48.631394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:34:48.795871 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d5da7be6-c134-4856-a229-65fc0d4e0683 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.451771 Sep 10 10:34:48.796520 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 125/235] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:34:48.825411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-24cbc142-54cb-4e94-915d-292b66e37585 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:48.859858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24cbc142-54cb-4e94-915d-292b66e37585 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:48.860642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24cbc142-54cb-4e94-915d-292b66e37585 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:48.861395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24cbc142-54cb-4e94-915d-292b66e37585 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:48.861769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d4c88d3-3b10-47c2-bb62-945c8637a1fc tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:48.878550 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8d4c88d3-3b10-47c2-bb62-945c8637a1fc tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1320 microversion: 2.1 time: 0.438102 Sep 10 10:34:48.882533 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 111/236] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:48 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:48.903363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9fdaa031-a02c-4dd7-9e72-c043dda4c1b9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:48.904790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9fdaa031-a02c-4dd7-9e72-c043dda4c1b9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:49.066664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9fdaa031-a02c-4dd7-9e72-c043dda4c1b9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:49.075675 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9fdaa031-a02c-4dd7-9e72-c043dda4c1b9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1264 microversion: 2.1 time: 0.191708 Sep 10 10:34:49.078844 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 112/237] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:48 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:49.133759 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-24cbc142-54cb-4e94-915d-292b66e37585 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.335001 Sep 10 10:34:49.136238 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 126/238] 10.222.0.20 () {60 vars in 1191 bytes} [Sat Sep 10 10:34:48 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:49.147228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de3889ab-68cf-4dc3-8ccf-9f2d78e876eb tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:49.222361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de3889ab-68cf-4dc3-8ccf-9f2d78e876eb tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.075518 Sep 10 10:34:49.224293 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 113/239] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:49 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:34:49.237059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5374cf71-b3d0-4cb9-923c-d6cf3e68cf00 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-515403127"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:49.245243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-5374cf71-b3d0-4cb9-923c-d6cf3e68cf00 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Generated uuid eece1fc3-2c18-4b6b-846b-4f3328dd1002 for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:34:49.254941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:DELETE=5 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:49.305203 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5374cf71-b3d0-4cb9-923c-d6cf3e68cf00 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.074944 Sep 10 10:34:49.308505 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 127/240] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:34:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:49.320339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c7c968c-16a0-458d-a294-48dee9dffdb0 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-856894-1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:49.348508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c7c968c-16a0-458d-a294-48dee9dffdb0 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:49.351652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c7c968c-16a0-458d-a294-48dee9dffdb0 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:49.355002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c7c968c-16a0-458d-a294-48dee9dffdb0 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:49.377246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-557d0e5f-06d2-4934-a72d-a720c0501765 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:49.378248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-557d0e5f-06d2-4934-a72d-a720c0501765 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:49.390871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-557d0e5f-06d2-4934-a72d-a720c0501765 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:49.401370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-557d0e5f-06d2-4934-a72d-a720c0501765 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:49.401862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-557d0e5f-06d2-4934-a72d-a720c0501765 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:49.402613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-557d0e5f-06d2-4934-a72d-a720c0501765 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:49.403084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-557d0e5f-06d2-4934-a72d-a720c0501765 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:49.403511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-557d0e5f-06d2-4934-a72d-a720c0501765 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:49.698594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-557d0e5f-06d2-4934-a72d-a720c0501765 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:49.718228 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-557d0e5f-06d2-4934-a72d-a720c0501765 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1467 microversion: 2.1 time: 0.343836 Sep 10 10:34:49.719832 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 128/241] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:49 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1467 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:49.761616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c7c968c-16a0-458d-a294-48dee9dffdb0 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.445184 Sep 10 10:34:49.764703 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 114/242] 10.222.0.20 () {60 vars in 1191 bytes} [Sat Sep 10 10:34:49 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:49.779838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-066f3212-7e1c-4c55-98e8-fa8c2178c625 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-856894-1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:49.804478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-066f3212-7e1c-4c55-98e8-fa8c2178c625 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:49.805443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-066f3212-7e1c-4c55-98e8-fa8c2178c625 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:49.806696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-066f3212-7e1c-4c55-98e8-fa8c2178c625 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:49.843762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:50.078268 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-066f3212-7e1c-4c55-98e8-fa8c2178c625 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.306647 Sep 10 10:34:50.080968 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 115/243] 10.222.0.20 () {60 vars in 1191 bytes} [Sat Sep 10 10:34:49 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:34:50.110516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53e48e77-c829-421c-a857-5b351f1b1081 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:50.114718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53e48e77-c829-421c-a857-5b351f1b1081 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:50.137115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53e48e77-c829-421c-a857-5b351f1b1081 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:50.137921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53e48e77-c829-421c-a857-5b351f1b1081 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:50.140121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53e48e77-c829-421c-a857-5b351f1b1081 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:50.141120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53e48e77-c829-421c-a857-5b351f1b1081 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:50.142071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53e48e77-c829-421c-a857-5b351f1b1081 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:50.142757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53e48e77-c829-421c-a857-5b351f1b1081 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:50.612604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53e48e77-c829-421c-a857-5b351f1b1081 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:50.639524 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53e48e77-c829-421c-a857-5b351f1b1081 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1320 microversion: 2.1 time: 0.552176 Sep 10 10:34:50.640396 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 116/244] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:50 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1320 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:50.652283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-514b4175-55df-400c-a037-30251ad91364 req-3a591b8e-b74b-40dc-a36d-99d11bc2de39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17757b29-4e02-42eb-960e-9bb0ad14f1fb", "tag": "c7282c3a-0c4b-4dc7-89d9-0120e96702d2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:50.664060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-776030503", "block_migration": true, "disk_over_commit": false}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:50.667302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:50.683012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:50.683779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:50.684377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:50.685864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:50.686482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:50.686775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-514b4175-55df-400c-a037-30251ad91364 req-3a591b8e-b74b-40dc-a36d-99d11bc2de39 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:50.687231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:50.687487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-514b4175-55df-400c-a037-30251ad91364 req-3a591b8e-b74b-40dc-a36d-99d11bc2de39 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:50.688025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-514b4175-55df-400c-a037-30251ad91364 req-3a591b8e-b74b-40dc-a36d-99d11bc2de39 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:50.715782 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-514b4175-55df-400c-a037-30251ad91364 req-3a591b8e-b74b-40dc-a36d-99d11bc2de39 service nova] Creating event network-changed:c7282c3a-0c4b-4dc7-89d9-0120e96702d2 for instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb on n-h1-856894-1 Sep 10 10:34:50.733948 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-514b4175-55df-400c-a037-30251ad91364 req-3a591b8e-b74b-40dc-a36d-99d11bc2de39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088751 Sep 10 10:34:50.734867 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 117/245] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:50.745963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-91b8bbd0-d189-4f69-ab84-aa1f78383eba tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:50.812421 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-91b8bbd0-d189-4f69-ab84-aa1f78383eba tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.076058 Sep 10 10:34:50.814975 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 118/246] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:50 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:34:50.820439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d25bfca2-cccd-45fa-a10a-4ad639505067 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:50.821304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d25bfca2-cccd-45fa-a10a-4ad639505067 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:50.829278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d25bfca2-cccd-45fa-a10a-4ad639505067 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:50.829772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d25bfca2-cccd-45fa-a10a-4ad639505067 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:50.830208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d25bfca2-cccd-45fa-a10a-4ad639505067 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:50.830912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d25bfca2-cccd-45fa-a10a-4ad639505067 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:50.831359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d25bfca2-cccd-45fa-a10a-4ad639505067 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:50.832122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d25bfca2-cccd-45fa-a10a-4ad639505067 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:50.863332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lazy-loading 'flavor' on Instance uuid 72fde4e4-6f64-4a11-9eca-5b0a88ceb970 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:34:50.972788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Going to try to live migrate instance to tempest-host-776030503 {{(pid=128787) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 10:34:50.985128 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] HTTP exception thrown: Compute host tempest-host-776030503 could not be found. Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Request method failure captured: Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970/action HTTP/1.1 Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 106 Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGg1QGmRmSBxiKyX73v1p63rMu5vgG1_4BPxAeiVEOZqW1hLe-n3mNXujMn9nvfu7j1WIEVdFyD9ads79OKZbYm802vxFY_37JUIEDLUDpgn7MMiv512Dkzjoh0_enoSn3Pz8n5NFiw-fr-WBjltjVzbTyZzmsUZ29GaV92RH6jmw-E Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: daa0e4c358364459bda622a451f491df Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-LiveMigrationNegativeTest-500309977 Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:34:50.991610 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/daa0e4c358364459bda622a451f491df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/daa0e4c358364459bda622a451f491df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/daa0e4c358364459bda622a451f491df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_daa0e4c358364459bda622a451f491df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-LiveMigrationNegativeTest-500309977 Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: daa0e4c358364459bda622a451f491df Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-500309977 Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-LiveMigrationNegativeTest-500309977-project-admin Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 3561120e4640418f9570974b60e7c781 Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-LiveMigrationNegativeTest-500309977-project-admin Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: {"os-migrateLive": {"host": "tempest-host-776030503", "block_migration": true, "disk_over_commit": false}} Sep 10 10:34:50.992805 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: exception: Compute host tempest-host-776030503 could not be found. Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '72fde4e4-6f64-4a11-9eca-5b0a88ceb970', 'body': {'os-migrateLive': {'host': 'tempest-host-776030503', 'block_migration': True, 'disk_over_commit': False}}} Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:34:50.993739 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-776030503 could not be found. Sep 10 10:34:50.994735 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-776030503 could not be found. Sep 10 10:34:50.995726 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:50.996747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:50.996747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:50.996747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:50.996747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:50.996747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:50.996747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:50.996747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:50.996747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-776030503 could not be found. Sep 10 10:34:50.996747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:50.999838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Returning 400 to user: Compute host tempest-host-776030503 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:51.002163 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4c114933-f17e-48ac-be02-4dc81255695a tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970/action" status: 400 len: 99 microversion: 2.1 time: 1.260729 Sep 10 10:34:51.003372 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 129/247] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Sep 10 10:34:49 2022] POST /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970/action => generated 99 bytes in 1263 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:34:51.033727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d25bfca2-cccd-45fa-a10a-4ad639505067 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:51.052008 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d25bfca2-cccd-45fa-a10a-4ad639505067 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1316 microversion: 2.1 time: 0.235365 Sep 10 10:34:51.063020 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 119/248] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:50 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:51.076598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42a163f2-61fb-493f-a280-29f2f36087c3 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-13615188"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:51.087157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.aggregate [None req-42a163f2-61fb-493f-a280-29f2f36087c3 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Generated uuid 1e5456c2-922d-4cf0-8373-5e2014e7636f for aggregate {{(pid=128788) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:34:51.147530 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42a163f2-61fb-493f-a280-29f2f36087c3 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.082937 Sep 10 10:34:51.156301 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 120/249] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:34:51 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:51.174077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be9c12ba-c6ca-4076-b347-c263b005f5a4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:51.175937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be9c12ba-c6ca-4076-b347-c263b005f5a4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:51.195185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be9c12ba-c6ca-4076-b347-c263b005f5a4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:51.196027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be9c12ba-c6ca-4076-b347-c263b005f5a4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:51.196510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be9c12ba-c6ca-4076-b347-c263b005f5a4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:51.197304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be9c12ba-c6ca-4076-b347-c263b005f5a4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:51.197791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be9c12ba-c6ca-4076-b347-c263b005f5a4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:51.203570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be9c12ba-c6ca-4076-b347-c263b005f5a4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:51.485168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a43efb0f-0e5c-477e-83b9-ae67dd2c7dc7 tempest-QuotaClassesAdmin257Test-20060749 tempest-QuotaClassesAdmin257Test-20060749-project-admin] Calling method '.version_select at 0x7efcb045df70>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:51.543796 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a43efb0f-0e5c-477e-83b9-ae67dd2c7dc7 tempest-QuotaClassesAdmin257Test-20060749 tempest-QuotaClassesAdmin257Test-20060749-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.538943 Sep 10 10:34:51.546732 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 130/250] 10.222.0.20 () {60 vars in 1226 bytes} [Sat Sep 10 10:34:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:51.557119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4c95d9fb-e095-46c9-bc6e-95de1bf714a4 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:51.604858 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4c95d9fb-e095-46c9-bc6e-95de1bf714a4 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.056243 Sep 10 10:34:51.609737 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 131/251] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:51 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:34:51.614891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-30a5b55e-7c58-4091-b542-23f87e22494b tempest-QuotaClassesAdmin257Test-20060749 tempest-QuotaClassesAdmin257Test-20060749-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf3d2dc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:52.046124 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-30a5b55e-7c58-4091-b542-23f87e22494b tempest-QuotaClassesAdmin257Test-20060749 tempest-QuotaClassesAdmin257Test-20060749-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.434845 Sep 10 10:34:52.054360 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 132/252] 10.222.0.20 () {62 vars in 1247 bytes} [Sat Sep 10 10:34:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:52.059993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2fbae24f-d134-4c40-bbd0-6a2bada8d48e tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:52.069944 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-2fbae24f-d134-4c40-bbd0-6a2bada8d48e tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2fbae24f-d134-4c40-bbd0-6a2bada8d48e tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Request method failure captured: Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgQdpnrkifidH0hD1hXqO5a2Egnt6VTldoR1Bxl1Ybt0Rwj4swzDglP1qo1OBvXHRouPhX43o4EQhTzTF5uMhBrwmiNKVN33W8uSmrXRIaxMJvhi_dy62R4VhGJLs9I5IZ8sZqxo-mZkBaf4Dh0F1HWan1z6EZ0dlvYSj028yCALNE Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: c5b2b598089a4971b4793ffbec947a2a Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:34:52.078752 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c5b2b598089a4971b4793ffbec947a2a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: c5b2b598089a4971b4793ffbec947a2a Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminTestJSON-1990650471-project-admin Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 0f44ec1b918f468a97ca5768b3d79549 Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminTestJSON-1990650471-project-admin Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: exception: Aggregate 6 could not be found. Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '6'} Sep 10 10:34:52.079989 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:52.080698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Sep 10 10:34:52.085533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:52.086646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2fbae24f-d134-4c40-bbd0-6a2bada8d48e tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:52.086646 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2fbae24f-d134-4c40-bbd0-6a2bada8d48e tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.024585 Sep 10 10:34:52.094344 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 133/253] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:34:52 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:34:52.108879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1929da48-fa11-43b5-8e7a-3f328f0f0e93 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:52.109533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1929da48-fa11-43b5-8e7a-3f328f0f0e93 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:52.136353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1929da48-fa11-43b5-8e7a-3f328f0f0e93 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:52.137697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1929da48-fa11-43b5-8e7a-3f328f0f0e93 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:52.138178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1929da48-fa11-43b5-8e7a-3f328f0f0e93 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:52.139992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1929da48-fa11-43b5-8e7a-3f328f0f0e93 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:52.141713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1929da48-fa11-43b5-8e7a-3f328f0f0e93 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:52.142227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1929da48-fa11-43b5-8e7a-3f328f0f0e93 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:52.155550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be9c12ba-c6ca-4076-b347-c263b005f5a4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:52.171348 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be9c12ba-c6ca-4076-b347-c263b005f5a4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1467 microversion: 2.1 time: 1.010533 Sep 10 10:34:52.173470 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 121/254] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:51 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1467 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:52.179904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-31a12198-610d-4093-aab5-f332c7b7ddd9 tempest-QuotaClassesAdmin257Test-20060749 tempest-QuotaClassesAdmin257Test-20060749-project-admin] Calling method '.version_select at 0x7efcaf1c7f70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:52.211213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:52.227906 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-31a12198-610d-4093-aab5-f332c7b7ddd9 tempest-QuotaClassesAdmin257Test-20060749 tempest-QuotaClassesAdmin257Test-20060749-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.052006 Sep 10 10:34:52.236643 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 122/255] 10.222.0.20 () {60 vars in 1226 bytes} [Sat Sep 10 10:34:52 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:52.258071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36d6c742-6abb-4407-b692-c719c7e92e6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:52.258992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36d6c742-6abb-4407-b692-c719c7e92e6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:52.276807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36d6c742-6abb-4407-b692-c719c7e92e6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:52.277697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36d6c742-6abb-4407-b692-c719c7e92e6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:52.278368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36d6c742-6abb-4407-b692-c719c7e92e6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:52.279335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36d6c742-6abb-4407-b692-c719c7e92e6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:52.280992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36d6c742-6abb-4407-b692-c719c7e92e6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:52.282827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36d6c742-6abb-4407-b692-c719c7e92e6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:52.405183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36d6c742-6abb-4407-b692-c719c7e92e6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:52.416053 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36d6c742-6abb-4407-b692-c719c7e92e6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1322 microversion: 2.1 time: 0.177770 Sep 10 10:34:52.419330 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 123/256] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:52 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:52.435942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed7b777a-00c0-4826-8582-2d1709415131 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:52.485700 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-ed7b777a-00c0-4826-8582-2d1709415131 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed7b777a-00c0-4826-8582-2d1709415131 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Request method failure captured: Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgQdpnrkifidH0hD1hXqO5a2Egnt6VTldoR1Bxl1Ybt0Rwj4swzDglP1qo1OBvXHRouPhX43o4EQhTzTF5uMhBrwmiNKVN33W8uSmrXRIaxMJvhi_dy62R4VhGJLs9I5IZ8sZqxo-mZkBaf4Dh0F1HWan1z6EZ0dlvYSj028yCALNE Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: c5b2b598089a4971b4793ffbec947a2a Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:34:52.491337 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c5b2b598089a4971b4793ffbec947a2a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: c5b2b598089a4971b4793ffbec947a2a Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AggregatesAdminTestJSON-1990650471-project-admin Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0f44ec1b918f468a97ca5768b3d79549 Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AggregatesAdminTestJSON-1990650471-project-admin Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: exception: Aggregate 6 could not be found. Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '6'} Sep 10 10:34:52.492546 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:34:52.493292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:52.494276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:52.495332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:52.495332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:52.495332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:52.495332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Sep 10 10:34:52.495332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:52.495332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed7b777a-00c0-4826-8582-2d1709415131 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:52.495332 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed7b777a-00c0-4826-8582-2d1709415131 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.073861 Sep 10 10:34:52.495332 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 124/257] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:52 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:34:52.517503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6af68756-06e8-44bb-9ccc-d4c95c17e11a tempest-QuotaClassesAdmin257Test-20060749 tempest-QuotaClassesAdmin257Test-20060749-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf1ade50>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:52.641780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6af68756-06e8-44bb-9ccc-d4c95c17e11a tempest-QuotaClassesAdmin257Test-20060749 tempest-QuotaClassesAdmin257Test-20060749-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.145765 Sep 10 10:34:52.649536 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 125/258] 10.222.0.20 () {62 vars in 1247 bytes} [Sat Sep 10 10:34:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:34:52.664452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-764374833", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:52.761117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:34:52.876031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1929da48-fa11-43b5-8e7a-3f328f0f0e93 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:52.884551 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1929da48-fa11-43b5-8e7a-3f328f0f0e93 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1320 microversion: 2.1 time: 0.788633 Sep 10 10:34:52.900567 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 134/259] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:52 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1320 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:52.900567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-db95f681-0bb3-4798-9789-c17874b26f58 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-39019450", "name": "tempest-test_aggregate-900182393"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:52.950459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-db95f681-0bb3-4798-9789-c17874b26f58 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Generated uuid 9afc3b83-ce4d-496e-baed-8daf799889c4 for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:34:53.021577 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-db95f681-0bb3-4798-9789-c17874b26f58 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.130896 Sep 10 10:34:53.024310 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 135/260] 10.222.0.20 () {60 vars in 1165 bytes} [Sat Sep 10 10:34:52 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:53.474054 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8f44cd59-9f6c-4829-a6fd-5e526ef7a811 tempest-TenantUsagesNegativeTestJSON-457920371 tempest-TenantUsagesNegativeTestJSON-457920371-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-09T10%3A34%3A52.515581&end=2022-09-11T10%3A34%3A52.515581" status: 404 len: 112 microversion: - time: 0.447685 Sep 10 10:34:53.474761 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 136/261] 10.222.0.20 () {58 vars in 1316 bytes} [Sat Sep 10 10:34:53 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-09T10%3A34%3A52.515581&end=2022-09-11T10%3A34%3A52.515581 => generated 112 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 10:34:53.480864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0959ba7c-7243-466d-a503-e0b546337bcb tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:53.540848 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0959ba7c-7243-466d-a503-e0b546337bcb tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.064298 Sep 10 10:34:53.553879 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 137/262] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:53 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:34:53.559368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6170d1d1-e5e0-423c-b602-e114b4af1799 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:53.560307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6170d1d1-e5e0-423c-b602-e114b4af1799 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:53.571731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6170d1d1-e5e0-423c-b602-e114b4af1799 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:53.572872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6170d1d1-e5e0-423c-b602-e114b4af1799 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:53.573453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6170d1d1-e5e0-423c-b602-e114b4af1799 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:53.574295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6170d1d1-e5e0-423c-b602-e114b4af1799 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:53.574878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6170d1d1-e5e0-423c-b602-e114b4af1799 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:53.575382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6170d1d1-e5e0-423c-b602-e114b4af1799 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:53.807762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6170d1d1-e5e0-423c-b602-e114b4af1799 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:53.825212 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6170d1d1-e5e0-423c-b602-e114b4af1799 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1322 microversion: 2.1 time: 0.268584 Sep 10 10:34:53.826715 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 138/263] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:53 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:53.836278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-358c1276-2286-4db9-86c5-802d0e4173f4 tempest-TenantUsagesNegativeTestJSON-457920371 tempest-TenantUsagesNegativeTestJSON-457920371-project-admin] Calling method '.version_select at 0x7efcaf344940>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:53.854316 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-358c1276-2286-4db9-86c5-802d0e4173f4 tempest-TenantUsagesNegativeTestJSON-457920371 tempest-TenantUsagesNegativeTestJSON-457920371-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-358c1276-2286-4db9-86c5-802d0e4173f4 tempest-TenantUsagesNegativeTestJSON-457920371 tempest-TenantUsagesNegativeTestJSON-457920371-project-admin] Request method failure captured: Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-simple-tenant-usage/4278c1b645514968bdd38555a02f6d61?start=2022-09-11T10%3A34%3A52.515581&end=2022-09-09T10%3A34%3A52.515581 HTTP/1.1 Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhM0JdRY0qUOhEe2tPPIYJ6kg5PKth_y2s56yG8S1h2CAr7bBwqbAbxwxLJZ8DAmchR_KQNlbRMlNlEypzhodrM6SdFPigzkUk-maURnmEzS2qML_DLczForgR2bdxRKDjG-X_sfM0wBruSv6bBAw0J9vsHeBDOpcDI0_KRM3UHNv8 Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: ff7ab3b36a3f405f8aa949412d652408 Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-457920371 Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:34:53.856242 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff7ab3b36a3f405f8aa949412d652408"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff7ab3b36a3f405f8aa949412d652408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff7ab3b36a3f405f8aa949412d652408"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff7ab3b36a3f405f8aa949412d652408", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-457920371 Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: ff7ab3b36a3f405f8aa949412d652408 Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-457920371 Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TenantUsagesNegativeTestJSON-457920371-project-admin Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 4e1a820bbd964a37b002e17a7ae57e10 Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-457920371-project-admin Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid start time. The start time cannot occur after the end time. Sep 10 10:34:53.857731 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '4278c1b645514968bdd38555a02f6d61'} Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 10:34:53.858455 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 10 10:34:53.859592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:53.859592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:53.859592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:53.859592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:53.859592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:53.859592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:53.859592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:53.859592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:53.859592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 10 10:34:53.859592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:53.862064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-358c1276-2286-4db9-86c5-802d0e4173f4 tempest-TenantUsagesNegativeTestJSON-457920371 tempest-TenantUsagesNegativeTestJSON-457920371-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:53.864940 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-358c1276-2286-4db9-86c5-802d0e4173f4 tempest-TenantUsagesNegativeTestJSON-457920371 tempest-TenantUsagesNegativeTestJSON-457920371-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/4278c1b645514968bdd38555a02f6d61?start=2022-09-11T10%3A34%3A52.515581&end=2022-09-09T10%3A34%3A52.515581" status: 400 len: 111 microversion: 2.1 time: 0.035409 Sep 10 10:34:53.873319 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 139/264] 10.222.0.20 () {58 vars in 1412 bytes} [Sat Sep 10 10:34:53 2022] GET /compute/v2.1/os-simple-tenant-usage/4278c1b645514968bdd38555a02f6d61?start=2022-09-11T10%3A34%3A52.515581&end=2022-09-09T10%3A34%3A52.515581 => generated 111 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:34:53.883771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0c94b21d-fb6c-4ba7-b950-4997f5a1755d tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:53.895501 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-0c94b21d-fb6c-4ba7-b950-4997f5a1755d tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0c94b21d-fb6c-4ba7-b950-4997f5a1755d tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Request method failure captured: Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgQdpnrkifidH0hD1hXqO5a2Egnt6VTldoR1Bxl1Ybt0Rwj4swzDglP1qo1OBvXHRouPhX43o4EQhTzTF5uMhBrwmiNKVN33W8uSmrXRIaxMJvhi_dy62R4VhGJLs9I5IZ8sZqxo-mZkBaf4Dh0F1HWan1z6EZ0dlvYSj028yCALNE Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: c5b2b598089a4971b4793ffbec947a2a Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:34:53.897681 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c5b2b598089a4971b4793ffbec947a2a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: c5b2b598089a4971b4793ffbec947a2a Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminTestJSON-1990650471-project-admin Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 0f44ec1b918f468a97ca5768b3d79549 Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminTestJSON-1990650471-project-admin Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: exception: Aggregate 7 could not be found. Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '7'} Sep 10 10:34:53.898875 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:53.899693 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 10 10:34:53.900734 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:53.906377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0c94b21d-fb6c-4ba7-b950-4997f5a1755d tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:53.907621 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0c94b21d-fb6c-4ba7-b950-4997f5a1755d tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.032778 Sep 10 10:34:53.912202 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 140/265] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:34:53 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:34:54.039801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:34:54.043186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:34:54.043998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:34:54.044615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:34:54.045350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:34:54.056188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:54.058410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:54.059024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:54.064167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:54.064798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:54.067008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:54.128922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Getting quotas for project 394e48c362f340eb91dbd10c72c186f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:34:54.141295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Getting quotas for user 480aa0631c1846b480f072613b7e38a1 and project 394e48c362f340eb91dbd10c72c186f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:34:54.188074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:34:54.193801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:34:54.288691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6b0b43cf-25a5-4fff-add4-8d329904f3ca tempest-TenantUsagesNegativeTestJSON-114873150 tempest-TenantUsagesNegativeTestJSON-114873150-project] Calling method '.version_select at 0x7efcaf31e310>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:54.297641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6b0b43cf-25a5-4fff-add4-8d329904f3ca tempest-TenantUsagesNegativeTestJSON-114873150 tempest-TenantUsagesNegativeTestJSON-114873150-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '31b22b41a0dc400eb4b9e801e676b00f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4278c1b645514968bdd38555a02f6d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6b0b43cf-25a5-4fff-add4-8d329904f3ca tempest-TenantUsagesNegativeTestJSON-114873150 tempest-TenantUsagesNegativeTestJSON-114873150-project] Request method failure captured: Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T10%3A34%3A52.515581&end=2022-09-11T10%3A34%3A52.515581&detailed=1 HTTP/1.1 Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhK75CmbUnXAqlEdJmhg3mkTg4Uv_ZQnnHQfc2ngkuaMPRNRiExd5nLaFOyqbFD9W_uLm1JArx8QFz6UzMjb_aGNRk42-KgA1JIM6CTYYN6zWXEt67qiZOEBeX7hedCRxl2GyZDVuQVxbKi3q8s9FkPERiBMEuJECIpPgVF_tqKn5M Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 4278c1b645514968bdd38555a02f6d61 Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-114873150 Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:54.300877 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4278c1b645514968bdd38555a02f6d61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4278c1b645514968bdd38555a02f6d61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4278c1b645514968bdd38555a02f6d61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4278c1b645514968bdd38555a02f6d61", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-114873150 Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 4278c1b645514968bdd38555a02f6d61 Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-114873150 Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TenantUsagesNegativeTestJSON-114873150-project Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 31b22b41a0dc400eb4b9e801e676b00f Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-114873150-project Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: action_args: {} Sep 10 10:34:54.302235 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:34:54.302985 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:34:54.304132 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:34:54.305513 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 10 10:34:54.305513 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:54.320066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6b0b43cf-25a5-4fff-add4-8d329904f3ca tempest-TenantUsagesNegativeTestJSON-114873150 tempest-TenantUsagesNegativeTestJSON-114873150-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:54.321477 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6b0b43cf-25a5-4fff-add4-8d329904f3ca tempest-TenantUsagesNegativeTestJSON-114873150 tempest-TenantUsagesNegativeTestJSON-114873150-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T10%3A34%3A52.515581&end=2022-09-11T10%3A34%3A52.515581&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.408051 Sep 10 10:34:54.323309 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 141/266] 10.222.0.20 () {58 vars in 1335 bytes} [Sat Sep 10 10:34:53 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T10%3A34%3A52.515581&end=2022-09-11T10%3A34%3A52.515581&detailed=1 => generated 123 bytes in 411 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:54.331279 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c276601d-ef31-4c41-a731-cfbc7d9b7cc4 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.687291 Sep 10 10:34:54.331988 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 126/267] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:34:54.334678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4bf2bc17-b818-4890-9a6c-6e8172258ed2 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:54.335528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4bf2bc17-b818-4890-9a6c-6e8172258ed2 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:54.344934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7db83c1a-a8c3-4cd1-b403-066935b816d6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:54.365337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4bf2bc17-b818-4890-9a6c-6e8172258ed2 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:54.366794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4bf2bc17-b818-4890-9a6c-6e8172258ed2 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:54.369300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4bf2bc17-b818-4890-9a6c-6e8172258ed2 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:54.374612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4bf2bc17-b818-4890-9a6c-6e8172258ed2 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:54.375500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4bf2bc17-b818-4890-9a6c-6e8172258ed2 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:54.377272 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-7db83c1a-a8c3-4cd1-b403-066935b816d6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 10 10:34:54.377561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4bf2bc17-b818-4890-9a6c-6e8172258ed2 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7db83c1a-a8c3-4cd1-b403-066935b816d6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Request method failure captured: Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgQdpnrkifidH0hD1hXqO5a2Egnt6VTldoR1Bxl1Ybt0Rwj4swzDglP1qo1OBvXHRouPhX43o4EQhTzTF5uMhBrwmiNKVN33W8uSmrXRIaxMJvhi_dy62R4VhGJLs9I5IZ8sZqxo-mZkBaf4Dh0F1HWan1z6EZ0dlvYSj028yCALNE Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: c5b2b598089a4971b4793ffbec947a2a Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:34:54.379648 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c5b2b598089a4971b4793ffbec947a2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c5b2b598089a4971b4793ffbec947a2a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: c5b2b598089a4971b4793ffbec947a2a Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1990650471 Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AggregatesAdminTestJSON-1990650471-project-admin Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0f44ec1b918f468a97ca5768b3d79549 Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AggregatesAdminTestJSON-1990650471-project-admin Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: exception: Aggregate 7 could not be found. Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7'} Sep 10 10:34:54.381221 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:34:54.382115 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:54.383530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:54.384883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:54.384883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:54.384883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:54.384883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 10 10:34:54.384883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:54.403399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7db83c1a-a8c3-4cd1-b403-066935b816d6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:54.404524 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7db83c1a-a8c3-4cd1-b403-066935b816d6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.071326 Sep 10 10:34:54.411938 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 127/268] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:54 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:34:54.419048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a053e3ea-5ead-4c27-a179-67247a809a0a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:54.426879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a053e3ea-5ead-4c27-a179-67247a809a0a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:54.623732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a053e3ea-5ead-4c27-a179-67247a809a0a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:54.626943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=91 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:54.634484 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a053e3ea-5ead-4c27-a179-67247a809a0a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1218 microversion: 2.1 time: 0.221252 Sep 10 10:34:54.652024 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 128/269] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:54 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:54.674418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f17175e-bc01-4a99-8d41-9e943822c4bf tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1681144201"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:54.684843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.aggregate [None req-6f17175e-bc01-4a99-8d41-9e943822c4bf tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Generated uuid 334212d6-e58f-4de1-98d0-e9e34f2e98f0 for aggregate {{(pid=128788) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:34:54.718478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=5,nova_api:UPDATE=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:54.735493 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f17175e-bc01-4a99-8d41-9e943822c4bf tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076641 Sep 10 10:34:54.737326 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 129/270] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:34:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:54.759965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-643c8d92-2f40-477e-9ba8-fb99644df829 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:54.782488 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-643c8d92-2f40-477e-9ba8-fb99644df829 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.033711 Sep 10 10:34:54.790684 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 130/271] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:34:54 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:54.800497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-98cdf7ce-aaeb-4195-9aac-950774442d27 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:54.902457 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-98cdf7ce-aaeb-4195-9aac-950774442d27 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.105228 Sep 10 10:34:54.903290 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 131/272] 10.222.0.20 () {60 vars in 1191 bytes} [Sat Sep 10 10:34:54 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:54.935668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6811eadd-0f87-4b36-a093-5e1648ea87ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:54.936515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6811eadd-0f87-4b36-a093-5e1648ea87ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:54.976868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811eadd-0f87-4b36-a093-5e1648ea87ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:54.977456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811eadd-0f87-4b36-a093-5e1648ea87ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:54.979524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811eadd-0f87-4b36-a093-5e1648ea87ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:54.980259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811eadd-0f87-4b36-a093-5e1648ea87ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:54.980715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811eadd-0f87-4b36-a093-5e1648ea87ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:54.981179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811eadd-0f87-4b36-a093-5e1648ea87ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:55.008931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4bf2bc17-b818-4890-9a6c-6e8172258ed2 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:55.021657 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4bf2bc17-b818-4890-9a6c-6e8172258ed2 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1320 microversion: 2.1 time: 0.694325 Sep 10 10:34:55.027293 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 142/273] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:54 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1320 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:55.037253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9d6cb4a7-35a5-4ef0-b391-aea5ab7f7021 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:55.062575 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9d6cb4a7-35a5-4ef0-b391-aea5ab7f7021 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.030995 Sep 10 10:34:55.065648 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 143/274] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:34:55 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:55.079477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dc0007fc-8497-49f4-ab22-2cd7fd092494 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:55.144229 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dc0007fc-8497-49f4-ab22-2cd7fd092494 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.070923 Sep 10 10:34:55.150279 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 144/275] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:55 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:34:55.164496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e74a4ead-fa99-4c75-bb56-33df69eaf992 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1351470265", "availability_zone": "tempest-test_az-2103347964"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:55.170949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-e74a4ead-fa99-4c75-bb56-33df69eaf992 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Generated uuid 7ed254e2-bab8-441f-98a2-063615329871 for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:34:55.212246 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e74a4ead-fa99-4c75-bb56-33df69eaf992 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.051038 Sep 10 10:34:55.222259 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 145/276] 10.222.0.20 () {60 vars in 1165 bytes} [Sat Sep 10 10:34:55 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:55.228571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1fbcb053-abae-4df9-bafe-f0bc591d4668 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1351470265_new", "availability_zone": "tempest-test_az-2103347964_new"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:55.329106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fbcb053-abae-4df9-bafe-f0bc591d4668 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:55.332989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fbcb053-abae-4df9-bafe-f0bc591d4668 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:55.333634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fbcb053-abae-4df9-bafe-f0bc591d4668 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:55.365885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=12,nova_api:DELETE=6,nova_api:UPDATE=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:34:55.396400 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1fbcb053-abae-4df9-bafe-f0bc591d4668 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.170948 Sep 10 10:34:55.398790 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 146/277] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:34:55 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:55.411020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8bdcc2d7-8ed5-473e-94da-3e75a89fb9f6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:55.446724 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8bdcc2d7-8ed5-473e-94da-3e75a89fb9f6 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.040643 Sep 10 10:34:55.447843 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 147/278] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:34:55 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:55.460674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-062fb447-29f5-42e6-a72e-f6845f72f509 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:55.527694 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-062fb447-29f5-42e6-a72e-f6845f72f509 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.071302 Sep 10 10:34:55.531828 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 148/279] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:34:55 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 10:34:55.555324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d2c31f64-970e-4fac-8262-b0b473a274b2 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1566162570"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:55.574123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-d2c31f64-970e-4fac-8262-b0b473a274b2 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Generated uuid 2db6ee6c-58e9-4fe2-b371-8a9c91f623bf for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:34:55.645154 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d2c31f64-970e-4fac-8262-b0b473a274b2 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.105369 Sep 10 10:34:55.649494 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 149/280] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:34:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:55.663056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4c5f836a-99df-4aaf-8c36-8ea96164ed06 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:55.688012 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4c5f836a-99df-4aaf-8c36-8ea96164ed06 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.027716 Sep 10 10:34:55.691355 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 150/281] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:34:55 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:55.706565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f47032aa-4708-4aac-9ef1-290f3a039be6 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:55.709442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f47032aa-4708-4aac-9ef1-290f3a039be6 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:55.720124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f47032aa-4708-4aac-9ef1-290f3a039be6 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:55.720438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f47032aa-4708-4aac-9ef1-290f3a039be6 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:55.720947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f47032aa-4708-4aac-9ef1-290f3a039be6 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:55.721699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f47032aa-4708-4aac-9ef1-290f3a039be6 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:55.722261 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f47032aa-4708-4aac-9ef1-290f3a039be6 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:55.722937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f47032aa-4708-4aac-9ef1-290f3a039be6 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:55.848884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6811eadd-0f87-4b36-a093-5e1648ea87ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:55.868622 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6811eadd-0f87-4b36-a093-5e1648ea87ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1389 microversion: 2.1 time: 0.950944 Sep 10 10:34:55.878314 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 132/282] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:54 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1389 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:55.894624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f9dee0f-1622-4e25-83f1-11be62d24520 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:55.960195 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f9dee0f-1622-4e25-83f1-11be62d24520 tempest-AggregatesAdminTestJSON-1990650471 tempest-AggregatesAdminTestJSON-1990650471-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.075953 Sep 10 10:34:55.963508 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 133/283] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:34:55 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:34:55.990601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:55.996700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:56.014317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:56.015590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:56.018019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:56.019852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:56.022501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:56.023053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:56.061005 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] HTTP exception thrown: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Request method failure captured: Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d HTTP/1.1 Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgNxsXBPqqHQVMKaaBXmRSh_ZDMNrLzXEn5hhD-zbuXV-V_xnNcZ6QAXUZAKnBZHXpXbtzmo7NVUSIVH6ymNX5_f2sYLlztKVcBROYXdKGq6qWdk2Po8_rezFAHmOSht6nfkUQasQIqEM2i9WBOx31KyVa8eAb8E-_u7__yzgwCmwo Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 4bfda1adb59b4b56927f590ad0345d9a Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AggregatesAdminTestJSON-976893167 Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:34:56.070026 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4bfda1adb59b4b56927f590ad0345d9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4bfda1adb59b4b56927f590ad0345d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4bfda1adb59b4b56927f590ad0345d9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4bfda1adb59b4b56927f590ad0345d9a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AggregatesAdminTestJSON-976893167 Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 4bfda1adb59b4b56927f590ad0345d9a Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-976893167 Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AggregatesAdminTestJSON-976893167-project Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 787948efda9644269a83ee97c4dde350 Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AggregatesAdminTestJSON-976893167-project Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:56.071210 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '0fde3838-50ca-4b70-8740-85058a89e99d'} Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:56.072021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:56.073103 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:34:56.077400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Returning 404 to user: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:56.080743 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dca51198-5241-4b7d-a1a7-0681f4a77626 tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 404 len: 111 microversion: 2.1 time: 0.109332 Sep 10 10:34:56.083999 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 134/284] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:34:55 2022] DELETE /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:56.095012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3485ad86-60fb-4f29-991e-742b5ce57dde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:56.098000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3485ad86-60fb-4f29-991e-742b5ce57dde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:56.118312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3485ad86-60fb-4f29-991e-742b5ce57dde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:56.119056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3485ad86-60fb-4f29-991e-742b5ce57dde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:56.121273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3485ad86-60fb-4f29-991e-742b5ce57dde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:56.122129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3485ad86-60fb-4f29-991e-742b5ce57dde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:56.124468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3485ad86-60fb-4f29-991e-742b5ce57dde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:56.125051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3485ad86-60fb-4f29-991e-742b5ce57dde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:56.196288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f47032aa-4708-4aac-9ef1-290f3a039be6 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:56.215362 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f47032aa-4708-4aac-9ef1-290f3a039be6 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1214 microversion: 2.1 time: 0.520344 Sep 10 10:34:56.217888 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 151/285] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:55 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1214 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:56.226455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:56.235257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] [instance: 0fde3838-50ca-4b70-8740-85058a89e99d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:56.250467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:56.253138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:56.256572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:56.257800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:56.258570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:56.261105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:56.318730 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] HTTP exception thrown: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Request method failure captured: Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d HTTP/1.1 Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgNxsXBPqqHQVMKaaBXmRSh_ZDMNrLzXEn5hhD-zbuXV-V_xnNcZ6QAXUZAKnBZHXpXbtzmo7NVUSIVH6ymNX5_f2sYLlztKVcBROYXdKGq6qWdk2Po8_rezFAHmOSht6nfkUQasQIqEM2i9WBOx31KyVa8eAb8E-_u7__yzgwCmwo Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 4bfda1adb59b4b56927f590ad0345d9a Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminTestJSON-976893167 Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:34:56.322279 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4bfda1adb59b4b56927f590ad0345d9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4bfda1adb59b4b56927f590ad0345d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4bfda1adb59b4b56927f590ad0345d9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4bfda1adb59b4b56927f590ad0345d9a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminTestJSON-976893167 Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 4bfda1adb59b4b56927f590ad0345d9a Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-976893167 Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminTestJSON-976893167-project Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 787948efda9644269a83ee97c4dde350 Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminTestJSON-976893167-project Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:56.323544 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '0fde3838-50ca-4b70-8740-85058a89e99d'} Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:34:56.324214 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. Sep 10 10:34:56.325267 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:34:56.326806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] Returning 404 to user: Instance 0fde3838-50ca-4b70-8740-85058a89e99d could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:34:56.326806 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-acf72cfb-2fc9-4fc2-badb-ab1ca35348cf tempest-AggregatesAdminTestJSON-976893167 tempest-AggregatesAdminTestJSON-976893167-project] 10.222.0.20 "GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d" status: 404 len: 111 microversion: 2.1 time: 0.103565 Sep 10 10:34:56.330260 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 152/286] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:56 2022] GET /compute/v2.1/servers/0fde3838-50ca-4b70-8740-85058a89e99d => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:34:56.718551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3485ad86-60fb-4f29-991e-742b5ce57dde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:56.743316 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3485ad86-60fb-4f29-991e-742b5ce57dde tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1320 microversion: 2.1 time: 0.651883 Sep 10 10:34:56.767501 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 135/287] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:56 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1320 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:56.895046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5d385f95-9d93-4612-8f2a-de74a8845e0c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:56.897443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5d385f95-9d93-4612-8f2a-de74a8845e0c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:56.914125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d385f95-9d93-4612-8f2a-de74a8845e0c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:56.915789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d385f95-9d93-4612-8f2a-de74a8845e0c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:56.916590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d385f95-9d93-4612-8f2a-de74a8845e0c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:56.918628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d385f95-9d93-4612-8f2a-de74a8845e0c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:56.921541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d385f95-9d93-4612-8f2a-de74a8845e0c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:56.923403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d385f95-9d93-4612-8f2a-de74a8845e0c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.243889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e4b1f9dd-b549-4ada-810b-38d637bda8fb tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:57.245105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e4b1f9dd-b549-4ada-810b-38d637bda8fb tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:57.259733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4b1f9dd-b549-4ada-810b-38d637bda8fb tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.264263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4b1f9dd-b549-4ada-810b-38d637bda8fb tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.265028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4b1f9dd-b549-4ada-810b-38d637bda8fb tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.266799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4b1f9dd-b549-4ada-810b-38d637bda8fb tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.268682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4b1f9dd-b549-4ada-810b-38d637bda8fb tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.271972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4b1f9dd-b549-4ada-810b-38d637bda8fb tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.306705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5d385f95-9d93-4612-8f2a-de74a8845e0c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:57.319464 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5d385f95-9d93-4612-8f2a-de74a8845e0c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1389 microversion: 2.1 time: 0.428393 Sep 10 10:34:57.321604 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 153/288] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:56 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1389 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:57.531235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e4b1f9dd-b549-4ada-810b-38d637bda8fb tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:57.539387 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e4b1f9dd-b549-4ada-810b-38d637bda8fb tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1276 microversion: 2.1 time: 0.299966 Sep 10 10:34:57.542890 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 136/289] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:57 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1276 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:57.584374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7ff16752-5809-4ddd-ae73-dacbe54cf691 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:57.588055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ff16752-5809-4ddd-ae73-dacbe54cf691 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.592729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ff16752-5809-4ddd-ae73-dacbe54cf691 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.593431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ff16752-5809-4ddd-ae73-dacbe54cf691 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.594373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ff16752-5809-4ddd-ae73-dacbe54cf691 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.594991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ff16752-5809-4ddd-ae73-dacbe54cf691 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.595566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ff16752-5809-4ddd-ae73-dacbe54cf691 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.665741 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7ff16752-5809-4ddd-ae73-dacbe54cf691 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.291550 Sep 10 10:34:57.672546 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 154/290] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:34:57 2022] GET /compute/v2.1/os-services => generated 944 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:57.687151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db4eecfa-e730-412f-a143-4651e14ba6da tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:57.691157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db4eecfa-e730-412f-a143-4651e14ba6da tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.691842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db4eecfa-e730-412f-a143-4651e14ba6da tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.694825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db4eecfa-e730-412f-a143-4651e14ba6da tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.695576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db4eecfa-e730-412f-a143-4651e14ba6da tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.696036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db4eecfa-e730-412f-a143-4651e14ba6da tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.696459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db4eecfa-e730-412f-a143-4651e14ba6da tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.769922 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db4eecfa-e730-412f-a143-4651e14ba6da tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-856894-1" status: 200 len: 578 microversion: 2.1 time: 0.087576 Sep 10 10:34:57.771241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0961f5ba-6b44-4dcb-aa15-44ae30f7d156 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:57.771869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0961f5ba-6b44-4dcb-aa15-44ae30f7d156 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:57.778495 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 137/291] 10.222.0.20 () {58 vars in 1172 bytes} [Sat Sep 10 10:34:57 2022] GET /compute/v2.1/os-services?host=n-d-856894-1 => generated 578 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:57.784258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4430014-cba1-413e-aeb8-1846f73ab667 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:57.787898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4430014-cba1-413e-aeb8-1846f73ab667 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.788081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0961f5ba-6b44-4dcb-aa15-44ae30f7d156 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.788386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4430014-cba1-413e-aeb8-1846f73ab667 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.788821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4430014-cba1-413e-aeb8-1846f73ab667 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.789174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0961f5ba-6b44-4dcb-aa15-44ae30f7d156 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.789572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4430014-cba1-413e-aeb8-1846f73ab667 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.790024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4430014-cba1-413e-aeb8-1846f73ab667 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.790436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4430014-cba1-413e-aeb8-1846f73ab667 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.792206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0961f5ba-6b44-4dcb-aa15-44ae30f7d156 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.793219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0961f5ba-6b44-4dcb-aa15-44ae30f7d156 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.793691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0961f5ba-6b44-4dcb-aa15-44ae30f7d156 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.794127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0961f5ba-6b44-4dcb-aa15-44ae30f7d156 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.864135 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4430014-cba1-413e-aeb8-1846f73ab667 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065461 Sep 10 10:34:57.864991 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 138/292] 10.222.0.20 () {58 vars in 1176 bytes} [Sat Sep 10 10:34:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:57.879284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-942e3a5b-4454-4a61-a322-b4d6240436f3 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:57.885034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-942e3a5b-4454-4a61-a322-b4d6240436f3 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.891736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-942e3a5b-4454-4a61-a322-b4d6240436f3 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.892505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-942e3a5b-4454-4a61-a322-b4d6240436f3 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.893530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-942e3a5b-4454-4a61-a322-b4d6240436f3 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:57.907232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-942e3a5b-4454-4a61-a322-b4d6240436f3 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:57.908112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-942e3a5b-4454-4a61-a322-b4d6240436f3 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:57.943379 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-942e3a5b-4454-4a61-a322-b4d6240436f3 tempest-ServicesAdminTestJSON-1865086999 tempest-ServicesAdminTestJSON-1865086999-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.067285 Sep 10 10:34:57.961357 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 139/293] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:34:57 2022] GET /compute/v2.1/os-services => generated 944 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:34:58.162953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0961f5ba-6b44-4dcb-aa15-44ae30f7d156 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:58.179299 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0961f5ba-6b44-4dcb-aa15-44ae30f7d156 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1320 microversion: 2.1 time: 0.412606 Sep 10 10:34:58.181743 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 155/294] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:57 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1320 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:58.352792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc8b7cbf-fedf-4270-9678-508db1937817 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:58.353797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc8b7cbf-fedf-4270-9678-508db1937817 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:58.361786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc8b7cbf-fedf-4270-9678-508db1937817 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:58.362283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc8b7cbf-fedf-4270-9678-508db1937817 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:58.363129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc8b7cbf-fedf-4270-9678-508db1937817 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:58.363842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc8b7cbf-fedf-4270-9678-508db1937817 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:58.364388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc8b7cbf-fedf-4270-9678-508db1937817 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:58.365172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc8b7cbf-fedf-4270-9678-508db1937817 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:58.567803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-27488ccd-db4d-4ee5-868c-a95ed83b11cd tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:58.569037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-27488ccd-db4d-4ee5-868c-a95ed83b11cd tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:58.580936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27488ccd-db4d-4ee5-868c-a95ed83b11cd tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:58.584462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27488ccd-db4d-4ee5-868c-a95ed83b11cd tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:58.586881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27488ccd-db4d-4ee5-868c-a95ed83b11cd tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:58.587955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27488ccd-db4d-4ee5-868c-a95ed83b11cd tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:58.590452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27488ccd-db4d-4ee5-868c-a95ed83b11cd tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:58.591197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27488ccd-db4d-4ee5-868c-a95ed83b11cd tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:58.795259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-27488ccd-db4d-4ee5-868c-a95ed83b11cd tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:58.809163 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-27488ccd-db4d-4ee5-868c-a95ed83b11cd tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1276 microversion: 2.1 time: 0.244292 Sep 10 10:34:58.810289 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 156/295] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:58 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:34:59.157434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-6cb4bea2-db0a-4cb2-8b62-42588ff26bac req-3451f64a-38ff-4918-b9a4-1750291810fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066e1684-136a-40a9-90b1-dec10869b975", "tag": "4a00ca77-e930-48ea-9732-09baa58dfd34"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:34:59.177820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6cb4bea2-db0a-4cb2-8b62-42588ff26bac req-3451f64a-38ff-4918-b9a4-1750291810fc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:59.179596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6cb4bea2-db0a-4cb2-8b62-42588ff26bac req-3451f64a-38ff-4918-b9a4-1750291810fc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:59.180602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6cb4bea2-db0a-4cb2-8b62-42588ff26bac req-3451f64a-38ff-4918-b9a4-1750291810fc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:59.211641 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-6cb4bea2-db0a-4cb2-8b62-42588ff26bac req-3451f64a-38ff-4918-b9a4-1750291810fc service nova] Creating event network-changed:4a00ca77-e930-48ea-9732-09baa58dfd34 for instance 066e1684-136a-40a9-90b1-dec10869b975 on n-h2-856894-1 Sep 10 10:34:59.223782 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-6cb4bea2-db0a-4cb2-8b62-42588ff26bac req-3451f64a-38ff-4918-b9a4-1750291810fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071521 Sep 10 10:34:59.225846 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 157/296] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:34:59.236460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c7d170b6-9bb7-4e31-92e2-cc81bcd5f11b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:59.237812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c7d170b6-9bb7-4e31-92e2-cc81bcd5f11b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:59.245828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7d170b6-9bb7-4e31-92e2-cc81bcd5f11b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:59.246934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7d170b6-9bb7-4e31-92e2-cc81bcd5f11b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:59.248144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7d170b6-9bb7-4e31-92e2-cc81bcd5f11b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:59.249226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7d170b6-9bb7-4e31-92e2-cc81bcd5f11b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:59.249901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7d170b6-9bb7-4e31-92e2-cc81bcd5f11b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:59.250547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7d170b6-9bb7-4e31-92e2-cc81bcd5f11b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:59.891409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c7d170b6-9bb7-4e31-92e2-cc81bcd5f11b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:59.914588 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c7d170b6-9bb7-4e31-92e2-cc81bcd5f11b tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1320 microversion: 2.1 time: 0.684077 Sep 10 10:34:59.919053 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 158/297] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:59 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1320 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:59.942051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1cbc890c-a0e1-4872-a18b-09ce262a4a7a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:34:59.944073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1cbc890c-a0e1-4872-a18b-09ce262a4a7a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:34:59.952218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc8b7cbf-fedf-4270-9678-508db1937817 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:34:59.961780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc8b7cbf-fedf-4270-9678-508db1937817 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1389 microversion: 2.1 time: 1.613307 Sep 10 10:34:59.967086 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 140/298] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:58 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1389 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:34:59.972772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cbc890c-a0e1-4872-a18b-09ce262a4a7a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:59.975926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cbc890c-a0e1-4872-a18b-09ce262a4a7a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:59.976828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cbc890c-a0e1-4872-a18b-09ce262a4a7a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:34:59.980167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cbc890c-a0e1-4872-a18b-09ce262a4a7a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:34:59.981445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cbc890c-a0e1-4872-a18b-09ce262a4a7a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:34:59.985197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cbc890c-a0e1-4872-a18b-09ce262a4a7a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:00.604823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1cbc890c-a0e1-4872-a18b-09ce262a4a7a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:00.640342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5ace9929-3010-44ea-a076-820f71235c5d req-42f04495-ce0e-4aec-b0c3-5b95780fb166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17757b29-4e02-42eb-960e-9bb0ad14f1fb", "name": "network-vif-plugged", "status": "completed", "tag": "c7282c3a-0c4b-4dc7-89d9-0120e96702d2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:00.645128 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1cbc890c-a0e1-4872-a18b-09ce262a4a7a tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1318 microversion: 2.1 time: 0.724097 Sep 10 10:35:00.649732 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 159/299] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:34:59 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1318 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:00.661287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5ace9929-3010-44ea-a076-820f71235c5d req-42f04495-ce0e-4aec-b0c3-5b95780fb166 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:00.666635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5ace9929-3010-44ea-a076-820f71235c5d req-42f04495-ce0e-4aec-b0c3-5b95780fb166 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:00.667237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5ace9929-3010-44ea-a076-820f71235c5d req-42f04495-ce0e-4aec-b0c3-5b95780fb166 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:00.703673 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5ace9929-3010-44ea-a076-820f71235c5d req-42f04495-ce0e-4aec-b0c3-5b95780fb166 service nova] Creating event network-vif-plugged:c7282c3a-0c4b-4dc7-89d9-0120e96702d2 for instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb on n-h1-856894-1 Sep 10 10:35:00.714845 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5ace9929-3010-44ea-a076-820f71235c5d req-42f04495-ce0e-4aec-b0c3-5b95780fb166 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079088 Sep 10 10:35:00.721595 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 141/300] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:00.942249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bcffee2f-82da-47b9-b7d3-5ce4e3f65f91 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:00.943239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bcffee2f-82da-47b9-b7d3-5ce4e3f65f91 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:00.958866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcffee2f-82da-47b9-b7d3-5ce4e3f65f91 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:00.963447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcffee2f-82da-47b9-b7d3-5ce4e3f65f91 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:00.964031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcffee2f-82da-47b9-b7d3-5ce4e3f65f91 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:00.968940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcffee2f-82da-47b9-b7d3-5ce4e3f65f91 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:00.969510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcffee2f-82da-47b9-b7d3-5ce4e3f65f91 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:00.974728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcffee2f-82da-47b9-b7d3-5ce4e3f65f91 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:00.990873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43d0e019-a896-4af8-a20f-5c069c5e52fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:00.992220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-43d0e019-a896-4af8-a20f-5c069c5e52fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:01.002531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d0e019-a896-4af8-a20f-5c069c5e52fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:01.005940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d0e019-a896-4af8-a20f-5c069c5e52fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:01.006390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d0e019-a896-4af8-a20f-5c069c5e52fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:01.007119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d0e019-a896-4af8-a20f-5c069c5e52fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:01.007570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d0e019-a896-4af8-a20f-5c069c5e52fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:01.017848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d0e019-a896-4af8-a20f-5c069c5e52fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:01.288984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-43d0e019-a896-4af8-a20f-5c069c5e52fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:01.297340 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43d0e019-a896-4af8-a20f-5c069c5e52fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1389 microversion: 2.1 time: 0.312242 Sep 10 10:35:01.313113 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 142/301] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:00 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1389 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:01.381085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bcffee2f-82da-47b9-b7d3-5ce4e3f65f91 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:01.388893 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bcffee2f-82da-47b9-b7d3-5ce4e3f65f91 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1320 microversion: 2.1 time: 0.452345 Sep 10 10:35:01.389509 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 160/302] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:00 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1320 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:01.680819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d695306-ccef-47a6-9d37-c384debd4482 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:01.681727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d695306-ccef-47a6-9d37-c384debd4482 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:01.703910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d695306-ccef-47a6-9d37-c384debd4482 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:01.704810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d695306-ccef-47a6-9d37-c384debd4482 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:01.705440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d695306-ccef-47a6-9d37-c384debd4482 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:01.706320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d695306-ccef-47a6-9d37-c384debd4482 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:01.706934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d695306-ccef-47a6-9d37-c384debd4482 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:01.707515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d695306-ccef-47a6-9d37-c384debd4482 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:02.122165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-b0ae28f4-7905-4778-95eb-58eb9f7c1a79 req-b0dba2e8-c0aa-4cf8-bd61-ea7bf3315140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0679e8c1-9eee-4c6f-880e-5ccb97a6777d", "tag": "ccaaf8d2-2052-4cb1-92a2-c73657a458b7"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:02.135817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=91,nova_cell0:UPDATE=7 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:02.142159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b0ae28f4-7905-4778-95eb-58eb9f7c1a79 req-b0dba2e8-c0aa-4cf8-bd61-ea7bf3315140 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:02.143996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b0ae28f4-7905-4778-95eb-58eb9f7c1a79 req-b0dba2e8-c0aa-4cf8-bd61-ea7bf3315140 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:02.144923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b0ae28f4-7905-4778-95eb-58eb9f7c1a79 req-b0dba2e8-c0aa-4cf8-bd61-ea7bf3315140 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:02.173128 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-b0ae28f4-7905-4778-95eb-58eb9f7c1a79 req-b0dba2e8-c0aa-4cf8-bd61-ea7bf3315140 service nova] Creating event network-changed:ccaaf8d2-2052-4cb1-92a2-c73657a458b7 for instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d on n-h1-856894-1 Sep 10 10:35:02.185568 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-b0ae28f4-7905-4778-95eb-58eb9f7c1a79 req-b0dba2e8-c0aa-4cf8-bd61-ea7bf3315140 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066887 Sep 10 10:35:02.188411 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 161/303] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:02.306275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d695306-ccef-47a6-9d37-c384debd4482 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:02.324088 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d695306-ccef-47a6-9d37-c384debd4482 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1318 microversion: 2.1 time: 0.650211 Sep 10 10:35:02.328522 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 143/304] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:01 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:02.329254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a271c3d4-c2ba-4231-96ba-0fe0bcbacfb1 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:02.329964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a271c3d4-c2ba-4231-96ba-0fe0bcbacfb1 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:02.344650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a271c3d4-c2ba-4231-96ba-0fe0bcbacfb1 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:02.346673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a271c3d4-c2ba-4231-96ba-0fe0bcbacfb1 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:02.347265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a271c3d4-c2ba-4231-96ba-0fe0bcbacfb1 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:02.348844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a271c3d4-c2ba-4231-96ba-0fe0bcbacfb1 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:02.356621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a271c3d4-c2ba-4231-96ba-0fe0bcbacfb1 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:02.358655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a271c3d4-c2ba-4231-96ba-0fe0bcbacfb1 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:02.416076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4ad71cb4-93c9-40e3-a53a-7189aea3bab1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:02.417000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4ad71cb4-93c9-40e3-a53a-7189aea3bab1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:02.435725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ad71cb4-93c9-40e3-a53a-7189aea3bab1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:02.436535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ad71cb4-93c9-40e3-a53a-7189aea3bab1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:02.437213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ad71cb4-93c9-40e3-a53a-7189aea3bab1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:02.438171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ad71cb4-93c9-40e3-a53a-7189aea3bab1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:02.438834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ad71cb4-93c9-40e3-a53a-7189aea3bab1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:02.439527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ad71cb4-93c9-40e3-a53a-7189aea3bab1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:02.871551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ad71cb4-93c9-40e3-a53a-7189aea3bab1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:02.885786 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4ad71cb4-93c9-40e3-a53a-7189aea3bab1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1468 microversion: 2.1 time: 0.471626 Sep 10 10:35:02.888073 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 144/305] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:02 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1468 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:02.918400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4006c2f1-9cd2-4420-97e8-4f9134c31e57 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:02.921344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4006c2f1-9cd2-4420-97e8-4f9134c31e57 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:02.933986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4006c2f1-9cd2-4420-97e8-4f9134c31e57 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:02.938966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4006c2f1-9cd2-4420-97e8-4f9134c31e57 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:02.940652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4006c2f1-9cd2-4420-97e8-4f9134c31e57 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:02.946092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4006c2f1-9cd2-4420-97e8-4f9134c31e57 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:02.947409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4006c2f1-9cd2-4420-97e8-4f9134c31e57 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:02.948054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4006c2f1-9cd2-4420-97e8-4f9134c31e57 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:03.130686 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4006c2f1-9cd2-4420-97e8-4f9134c31e57 tempest-DeleteServersAdminTestJSON-1766103678 tempest-DeleteServersAdminTestJSON-1766103678-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb/action" status: 202 len: 0 microversion: 2.1 time: 0.217451 Sep 10 10:35:03.131670 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 145/306] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:35:02 2022] POST /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:03.140944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:03.141969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:03.155021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:03.157397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:03.160280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:03.161333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:03.162467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:03.163254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:03.209248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:03.256135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:03.256730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:03.257399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:03.258057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lazy-loading 'fault' on Instance uuid 17757b29-4e02-42eb-960e-9bb0ad14f1fb {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:35:03.388957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a271c3d4-c2ba-4231-96ba-0fe0bcbacfb1 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:03.397944 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a271c3d4-c2ba-4231-96ba-0fe0bcbacfb1 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1389 microversion: 2.1 time: 1.073581 Sep 10 10:35:03.418223 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 162/307] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:02 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1389 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:03.424902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3ad06db1-b2c9-4b96-aff3-9e802acdc6b1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:03.425754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3ad06db1-b2c9-4b96-aff3-9e802acdc6b1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:03.432169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ad06db1-b2c9-4b96-aff3-9e802acdc6b1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:03.432855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ad06db1-b2c9-4b96-aff3-9e802acdc6b1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:03.433589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ad06db1-b2c9-4b96-aff3-9e802acdc6b1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:03.434465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ad06db1-b2c9-4b96-aff3-9e802acdc6b1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:03.434946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ad06db1-b2c9-4b96-aff3-9e802acdc6b1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:03.436067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ad06db1-b2c9-4b96-aff3-9e802acdc6b1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:03.697954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:03.719546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e14cea40-2058-4b00-bcc7-5e33405ec7ba tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1451 microversion: 2.1 time: 0.582734 Sep 10 10:35:03.721056 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 146/308] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:03 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1451 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:03.747101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-507ef6f8-d59f-4cf6-9d05-0688b047d116 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:03.748345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-507ef6f8-d59f-4cf6-9d05-0688b047d116 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:03.754961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-507ef6f8-d59f-4cf6-9d05-0688b047d116 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:03.755733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-507ef6f8-d59f-4cf6-9d05-0688b047d116 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:03.756350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-507ef6f8-d59f-4cf6-9d05-0688b047d116 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:03.759116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-507ef6f8-d59f-4cf6-9d05-0688b047d116 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:03.759773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-507ef6f8-d59f-4cf6-9d05-0688b047d116 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:03.760466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-507ef6f8-d59f-4cf6-9d05-0688b047d116 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:03.795879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-507ef6f8-d59f-4cf6-9d05-0688b047d116 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:35:03.945909 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-507ef6f8-d59f-4cf6-9d05-0688b047d116 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 204 len: 0 microversion: 2.1 time: 0.202669 Sep 10 10:35:03.948316 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 147/309] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:35:03 2022] DELETE /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:35:03.962194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:03.965296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:03.982497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:03.984116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:03.986530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:03.989054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:03.989579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:03.990018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:04.020727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3ad06db1-b2c9-4b96-aff3-9e802acdc6b1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:04.042556 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3ad06db1-b2c9-4b96-aff3-9e802acdc6b1 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1318 microversion: 2.1 time: 0.622822 Sep 10 10:35:04.058528 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 163/310] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:03 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:04.104534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:04.105175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:04.106248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:04.109250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lazy-loading 'fault' on Instance uuid 17757b29-4e02-42eb-960e-9bb0ad14f1fb {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:35:04.288139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:04.299059 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-96344a97-644f-47a5-91c5-a90d033cd34f tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1457 microversion: 2.1 time: 0.345533 Sep 10 10:35:04.300352 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 148/311] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:03 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1457 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:04.426258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87ac8897-8598-4a27-ba2c-e88ebfd5618b tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:04.426880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87ac8897-8598-4a27-ba2c-e88ebfd5618b tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:04.438252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87ac8897-8598-4a27-ba2c-e88ebfd5618b tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:04.438752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87ac8897-8598-4a27-ba2c-e88ebfd5618b tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:04.446967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87ac8897-8598-4a27-ba2c-e88ebfd5618b tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:04.450935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87ac8897-8598-4a27-ba2c-e88ebfd5618b tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:04.452824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87ac8897-8598-4a27-ba2c-e88ebfd5618b tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:04.453329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87ac8897-8598-4a27-ba2c-e88ebfd5618b tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:04.721995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:04.786623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-87ac8897-8598-4a27-ba2c-e88ebfd5618b tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:04.796947 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87ac8897-8598-4a27-ba2c-e88ebfd5618b tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1389 microversion: 2.1 time: 0.374440 Sep 10 10:35:04.798045 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 149/312] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:04 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1389 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:04.925881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-82bd4eaa-e36b-4c8a-b314-4cceec35c02d tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf339d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:05.069600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-952b6f12-937d-4d1b-9dd8-9f3f6150d473 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:05.073755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-952b6f12-937d-4d1b-9dd8-9f3f6150d473 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:05.081723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952b6f12-937d-4d1b-9dd8-9f3f6150d473 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:05.082219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952b6f12-937d-4d1b-9dd8-9f3f6150d473 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:05.082655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952b6f12-937d-4d1b-9dd8-9f3f6150d473 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:05.083354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952b6f12-937d-4d1b-9dd8-9f3f6150d473 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:05.083812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952b6f12-937d-4d1b-9dd8-9f3f6150d473 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:05.084419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952b6f12-937d-4d1b-9dd8-9f3f6150d473 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:05.496994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-952b6f12-937d-4d1b-9dd8-9f3f6150d473 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:05.517760 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-952b6f12-937d-4d1b-9dd8-9f3f6150d473 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1318 microversion: 2.1 time: 0.454789 Sep 10 10:35:05.520205 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 150/313] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:05 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:05.529594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82bd4eaa-e36b-4c8a-b314-4cceec35c02d tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:05.532905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82bd4eaa-e36b-4c8a-b314-4cceec35c02d tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:05.533511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82bd4eaa-e36b-4c8a-b314-4cceec35c02d tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:05.538236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:05.538950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82bd4eaa-e36b-4c8a-b314-4cceec35c02d tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:05.539665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82bd4eaa-e36b-4c8a-b314-4cceec35c02d tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:05.541377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82bd4eaa-e36b-4c8a-b314-4cceec35c02d tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:05.543032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:05.564774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=17 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:05.565974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:05.566699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:05.567157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:05.579169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:05.581017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:05.583389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:05.683091 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-82bd4eaa-e36b-4c8a-b314-4cceec35c02d tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/cad521720465432aa6801fd7f2196fe2" status: 200 len: 240 microversion: 2.36 time: 1.486743 Sep 10 10:35:05.706379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:05.706570 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 164/314] 10.222.0.20 () {62 vars in 1303 bytes} [Sat Sep 10 10:35:04 2022] PUT /compute/v2.1/os-quota-sets/cad521720465432aa6801fd7f2196fe2 => generated 240 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 10:35:05.706666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:05.707070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:05.707530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lazy-loading 'fault' on Instance uuid 17757b29-4e02-42eb-960e-9bb0ad14f1fb {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:35:05.719048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dab579ca-d386-480a-9e58-a11c4126ffa7 tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Calling method '.version_select at 0x7efcaf307700>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:06.225514 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab579ca-d386-480a-9e58-a11c4126ffa7 tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:06.226800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab579ca-d386-480a-9e58-a11c4126ffa7 tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:06.227476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab579ca-d386-480a-9e58-a11c4126ffa7 tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:06.232460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab579ca-d386-480a-9e58-a11c4126ffa7 tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:06.233302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab579ca-d386-480a-9e58-a11c4126ffa7 tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:06.233964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab579ca-d386-480a-9e58-a11c4126ffa7 tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:06.261308 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dab579ca-d386-480a-9e58-a11c4126ffa7 tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/cad521720465432aa6801fd7f2196fe2/detail" status: 200 len: 672 microversion: 2.36 time: 0.553396 Sep 10 10:35:06.273570 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 165/315] 10.222.0.20 () {60 vars in 1304 bytes} [Sat Sep 10 10:35:05 2022] GET /compute/v2.1/os-quota-sets/cad521720465432aa6801fd7f2196fe2/detail => generated 672 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:35:06.551901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b8acb105-c6ef-4c47-9d63-c5d368d0c35c tempest-FlavorsV2NegativeTest-844409761 tempest-FlavorsV2NegativeTest-844409761-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:06.564692 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b8acb105-c6ef-4c47-9d63-c5d368d0c35c tempest-FlavorsV2NegativeTest-844409761 tempest-FlavorsV2NegativeTest-844409761-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.289493 Sep 10 10:35:06.566119 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 166/316] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:35:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:06.570707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-749ec8da-3753-4043-8ca5-66c01dcf1ffc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:06.571512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-749ec8da-3753-4043-8ca5-66c01dcf1ffc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:06.587785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-749ec8da-3753-4043-8ca5-66c01dcf1ffc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:06.588408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-749ec8da-3753-4043-8ca5-66c01dcf1ffc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:06.588922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-749ec8da-3753-4043-8ca5-66c01dcf1ffc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:06.589898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-749ec8da-3753-4043-8ca5-66c01dcf1ffc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:06.590429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-749ec8da-3753-4043-8ca5-66c01dcf1ffc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:06.590929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-749ec8da-3753-4043-8ca5-66c01dcf1ffc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:06.637502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:06.650843 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-55592b80-d64a-4f8d-ab99-d6f4551563a0 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1457 microversion: 2.1 time: 1.127945 Sep 10 10:35:06.651953 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 151/317] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:05 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1457 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:06.792278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-09f70d75-5e52-4926-ac95-0ac994be8bd1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:06.799234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09f70d75-5e52-4926-ac95-0ac994be8bd1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:06.799823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09f70d75-5e52-4926-ac95-0ac994be8bd1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:06.800584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09f70d75-5e52-4926-ac95-0ac994be8bd1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:06.801934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09f70d75-5e52-4926-ac95-0ac994be8bd1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:06.802698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09f70d75-5e52-4926-ac95-0ac994be8bd1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:06.803486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09f70d75-5e52-4926-ac95-0ac994be8bd1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:06.818088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=28 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:06.867716 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-09f70d75-5e52-4926-ac95-0ac994be8bd1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.214436 Sep 10 10:35:06.868313 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 152/318] 10.222.0.20 () {58 vars in 1176 bytes} [Sat Sep 10 10:35:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:06.882494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-891052a8-ad69-4b11-831d-589a9e99734f req-0dd10023-d680-462d-a0ac-1865b7a72eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066e1684-136a-40a9-90b1-dec10869b975", "name": "network-vif-plugged", "status": "completed", "tag": "4a00ca77-e930-48ea-9732-09baa58dfd34"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:06.894535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-891052a8-ad69-4b11-831d-589a9e99734f req-0dd10023-d680-462d-a0ac-1865b7a72eda service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:06.895536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-891052a8-ad69-4b11-831d-589a9e99734f req-0dd10023-d680-462d-a0ac-1865b7a72eda service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:06.896062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-891052a8-ad69-4b11-831d-589a9e99734f req-0dd10023-d680-462d-a0ac-1865b7a72eda service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:06.924429 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-891052a8-ad69-4b11-831d-589a9e99734f req-0dd10023-d680-462d-a0ac-1865b7a72eda service nova] Creating event network-vif-plugged:4a00ca77-e930-48ea-9732-09baa58dfd34 for instance 066e1684-136a-40a9-90b1-dec10869b975 on n-h2-856894-1 Sep 10 10:35:06.938897 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-891052a8-ad69-4b11-831d-589a9e99734f req-0dd10023-d680-462d-a0ac-1865b7a72eda service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068694 Sep 10 10:35:06.940702 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 153/319] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:06.959295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9f83e4f6-b0ad-42c1-b649-3a84bc1ea726 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:06.959792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9f83e4f6-b0ad-42c1-b649-3a84bc1ea726 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:06.979958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f83e4f6-b0ad-42c1-b649-3a84bc1ea726 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:06.987542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f83e4f6-b0ad-42c1-b649-3a84bc1ea726 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:06.988348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f83e4f6-b0ad-42c1-b649-3a84bc1ea726 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:06.989914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f83e4f6-b0ad-42c1-b649-3a84bc1ea726 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:06.996069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f83e4f6-b0ad-42c1-b649-3a84bc1ea726 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:06.999695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f83e4f6-b0ad-42c1-b649-3a84bc1ea726 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:07.015285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-749ec8da-3753-4043-8ca5-66c01dcf1ffc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:07.023730 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-749ec8da-3753-4043-8ca5-66c01dcf1ffc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1389 microversion: 2.1 time: 0.456469 Sep 10 10:35:07.024258 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 167/320] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:06 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1389 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:07.045313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf307d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:07.162336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:07.162838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:07.163276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:07.164017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:07.164478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:07.164916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:07.218615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:07.220260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:07.221326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:07.224108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:07.225487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:07.227704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:07.352183 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7dce3772-d94f-498a-8cde-0739753c104c tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/cad521720465432aa6801fd7f2196fe2?user_id=7f8bcc4a2d254e17a99a357cefc91571" status: 200 len: 240 microversion: 2.36 time: 0.321933 Sep 10 10:35:07.353198 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 168/321] 10.222.0.20 () {62 vars in 1384 bytes} [Sat Sep 10 10:35:07 2022] PUT /compute/v2.1/os-quota-sets/cad521720465432aa6801fd7f2196fe2?user_id=7f8bcc4a2d254e17a99a357cefc91571 => generated 240 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:35:07.361244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dbf7aab9-76a9-454d-929c-4930bbf555d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1955689432"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:07.370975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-dbf7aab9-76a9-454d-929c-4930bbf555d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Generated uuid d5e34983-d8ea-4253-8bfc-87068a261d09 for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:35:07.398688 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dbf7aab9-76a9-454d-929c-4930bbf555d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.044090 Sep 10 10:35:07.407209 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 169/322] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:07.415175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-35aec1b2-be39-4e0c-b8ea-37a18daabdf8 tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] Calling method '.version_select at 0x7efcaf339e50>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:07.514120 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:07.515924 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-35aec1b2-be39-4e0c-b8ea-37a18daabdf8 tempest-QuotasAdminTestV236-1674730003 tempest-QuotasAdminTestV236-1674730003-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/cad521720465432aa6801fd7f2196fe2?user_id=7f8bcc4a2d254e17a99a357cefc91571" status: 200 len: 282 microversion: 2.36 time: 0.107094 Sep 10 10:35:07.516820 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 170/323] 10.222.0.20 () {60 vars in 1364 bytes} [Sat Sep 10 10:35:07 2022] GET /compute/v2.1/os-quota-sets/cad521720465432aa6801fd7f2196fe2?user_id=7f8bcc4a2d254e17a99a357cefc91571 => generated 282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:35:07.523309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e2bfbb8f-7bfb-4ec4-8860-0ae33c1c10b1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:07.557505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2bfbb8f-7bfb-4ec4-8860-0ae33c1c10b1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:07.559131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2bfbb8f-7bfb-4ec4-8860-0ae33c1c10b1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:07.560143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2bfbb8f-7bfb-4ec4-8860-0ae33c1c10b1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:07.649130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9f83e4f6-b0ad-42c1-b649-3a84bc1ea726 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:07.662567 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9f83e4f6-b0ad-42c1-b649-3a84bc1ea726 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1318 microversion: 2.1 time: 0.719813 Sep 10 10:35:07.663178 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 154/324] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:06 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:07.694332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:07.694956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:07.703836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:07.704364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:07.704810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:07.705555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:07.706035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:07.706495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:07.798539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:07.801958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:07.802611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:07.803783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lazy-loading 'fault' on Instance uuid 17757b29-4e02-42eb-960e-9bb0ad14f1fb {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:35:07.941519 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e2bfbb8f-7bfb-4ec4-8860-0ae33c1c10b1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.423275 Sep 10 10:35:07.942988 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 171/325] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 10:35:07 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:07.947319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d58de226-2d12-4dba-8c2e-5dabeabe0d7d tempest-FlavorsV2NegativeTest-844409761 tempest-FlavorsV2NegativeTest-844409761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-52821525", "imageRef": "7f2024f9-15ab-4991-be62-e01d98e88a7a", "flavorRef": "452"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:08.045709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-d58de226-2d12-4dba-8c2e-5dabeabe0d7d tempest-FlavorsV2NegativeTest-844409761 tempest-FlavorsV2NegativeTest-844409761-project] validate_networks() for None {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:35:08.277785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:08.298823 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-25e7d1fc-1307-43ed-966e-be2057f25d29 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1457 microversion: 2.1 time: 0.623130 Sep 10 10:35:08.317493 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 155/326] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:07 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1457 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:08.322709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af893a12-67f1-46ab-b6ec-9ad06c927d6d tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-856894-1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:08.343965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af893a12-67f1-46ab-b6ec-9ad06c927d6d tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:08.345476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af893a12-67f1-46ab-b6ec-9ad06c927d6d tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:08.346201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af893a12-67f1-46ab-b6ec-9ad06c927d6d tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:08.377726 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-af893a12-67f1-46ab-b6ec-9ad06c927d6d tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-856894-1. Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af893a12-67f1-46ab-b6ec-9ad06c927d6d tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Request method failure captured: Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 39 Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhZEMCB3HJTaVnNPbTgK4HpmZUB5S3ZhYCljI7rKGHJfwjsDJVX23o9VMZ731qAAelXMEq_9piqVtVaBBx5OnxrNPgIDDLzZluT1G6ej4SR4jNaLBZw-H6QLM1l439Y13ev49Q6ob9VfUUrb-nTw0g1BASUMR8S8WX9hnVQrRdXQyY Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:35:08.386250 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f40f0adb854cf6989f938887571847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f40f0adb854cf6989f938887571847", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 83c5879f96d64906a35a60f3ac9d0653 Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: {"add_host": {"host": "n-h1-856894-1"}} Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:35:08.387382 n-d-856894-1 devstack@n-api.service[128788]: exception: Aggregate 11 already has host n-h1-856894-1. Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-856894-1'}}} Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result.read() Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 10:35:08.388585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-856894-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi session.flush() Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 10:35:08.390187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 10:35:08.392114 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 10:35:08.394362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result.read() Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-856894-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 10, 10, 35, 8, 365346), 'updated_at': None, 'host': 'n-h1-856894-1', 'aggregate_id': 11}] Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:08.397004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-856894-1. Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.399586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-856894-1. Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:08.404512 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:08.407894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-856894-1. Sep 10 10:35:08.407894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.407894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af893a12-67f1-46ab-b6ec-9ad06c927d6d tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-856894-1. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:08.407894 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af893a12-67f1-46ab-b6ec-9ad06c927d6d tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.072417 Sep 10 10:35:08.407894 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 156/327] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 10:35:08 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 10 10:35:08.413466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07332f4b-b4e9-43cc-ad64-8088747eccd5 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:08.414105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07332f4b-b4e9-43cc-ad64-8088747eccd5 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:08.426349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07332f4b-b4e9-43cc-ad64-8088747eccd5 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:08.427117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07332f4b-b4e9-43cc-ad64-8088747eccd5 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:08.427768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07332f4b-b4e9-43cc-ad64-8088747eccd5 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:08.429548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07332f4b-b4e9-43cc-ad64-8088747eccd5 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:08.430557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07332f4b-b4e9-43cc-ad64-8088747eccd5 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:08.431183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07332f4b-b4e9-43cc-ad64-8088747eccd5 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:08.710755 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-d58de226-2d12-4dba-8c2e-5dabeabe0d7d tempest-FlavorsV2NegativeTest-844409761 tempest-FlavorsV2NegativeTest-844409761-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d58de226-2d12-4dba-8c2e-5dabeabe0d7d tempest-FlavorsV2NegativeTest-844409761 tempest-FlavorsV2NegativeTest-844409761-project] Request method failure captured: Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 141 Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhZWPoONDRQMgnORl32AtI6ihepjBmLr9ocU_zrthoqlL-vicrt-guBUv6gUbur3W7bJaSCLsbekUN-t_gWtUi53LZzSuRBECvKg9kWG6HjbgwZDK37a0lURFCCvGE7xHA-FfBMduhz8g-ysYjnALi0hhIIuXjTsihu8jgUdTlKuU4 Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 73639637d9ca4caaa6985fe391dfead4 Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FlavorsV2NegativeTest-844409761 Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:08.713364 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73639637d9ca4caaa6985fe391dfead4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73639637d9ca4caaa6985fe391dfead4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73639637d9ca4caaa6985fe391dfead4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73639637d9ca4caaa6985fe391dfead4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FlavorsV2NegativeTest-844409761 Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 73639637d9ca4caaa6985fe391dfead4 Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-844409761 Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FlavorsV2NegativeTest-844409761-project Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: f4dce962f3bb4d2cb7e0f89dbd7a40cb Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FlavorsV2NegativeTest-844409761-project Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-52821525", "imageRef": "7f2024f9-15ab-4991-be62-e01d98e88a7a", "flavorRef": "452"}} Sep 10 10:35:08.714830 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: exception: Flavor's memory is too small for requested image. Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-52821525', 'imageRef': '7f2024f9-15ab-4991-be62-e01d98e88a7a', 'flavorRef': '452'}}} Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:08.715760 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.717797 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:08.719161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:08.719161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:08.719161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:08.719161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:08.719161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 10 10:35:08.719161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:08.720520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d58de226-2d12-4dba-8c2e-5dabeabe0d7d tempest-FlavorsV2NegativeTest-844409761 tempest-FlavorsV2NegativeTest-844409761-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:08.721570 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d58de226-2d12-4dba-8c2e-5dabeabe0d7d tempest-FlavorsV2NegativeTest-844409761 tempest-FlavorsV2NegativeTest-844409761-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.778126 Sep 10 10:35:08.722612 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 172/328] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:07 2022] POST /compute/v2.1/servers => generated 93 bytes in 779 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:35:08.743440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-820867a0-d730-4704-9819-3f235eef01d5 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:08.786072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-820867a0-d730-4704-9819-3f235eef01d5 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:08.795498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-820867a0-d730-4704-9819-3f235eef01d5 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:08.795960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-820867a0-d730-4704-9819-3f235eef01d5 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:08.798330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:08.803369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-07332f4b-b4e9-43cc-ad64-8088747eccd5 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:08.825383 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07332f4b-b4e9-43cc-ad64-8088747eccd5 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1389 microversion: 2.1 time: 0.421221 Sep 10 10:35:08.826429 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 157/329] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:08 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1389 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:08.876305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6d025a5e-4d22-4fae-a103-3d6054616ab0 req-b419a9c1-a7fe-4920-b3ed-1db0e4c7f8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17757b29-4e02-42eb-960e-9bb0ad14f1fb", "name": "network-vif-deleted", "tag": "c7282c3a-0c4b-4dc7-89d9-0120e96702d2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:08.923022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d025a5e-4d22-4fae-a103-3d6054616ab0 req-b419a9c1-a7fe-4920-b3ed-1db0e4c7f8b1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:08.923521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d025a5e-4d22-4fae-a103-3d6054616ab0 req-b419a9c1-a7fe-4920-b3ed-1db0e4c7f8b1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:08.923951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d025a5e-4d22-4fae-a103-3d6054616ab0 req-b419a9c1-a7fe-4920-b3ed-1db0e4c7f8b1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:08.985934 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6d025a5e-4d22-4fae-a103-3d6054616ab0 req-b419a9c1-a7fe-4920-b3ed-1db0e4c7f8b1 service nova] Creating event network-vif-deleted:c7282c3a-0c4b-4dc7-89d9-0120e96702d2 for instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb on n-h1-856894-1 Sep 10 10:35:08.996095 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6d025a5e-4d22-4fae-a103-3d6054616ab0 req-b419a9c1-a7fe-4920-b3ed-1db0e4c7f8b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159885 Sep 10 10:35:08.999324 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 158/330] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:09.015437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eccd0955-fd73-4290-a0e7-4a0b0c731574 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:09.018315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eccd0955-fd73-4290-a0e7-4a0b0c731574 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:09.032348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccd0955-fd73-4290-a0e7-4a0b0c731574 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:09.033943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccd0955-fd73-4290-a0e7-4a0b0c731574 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:09.034907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccd0955-fd73-4290-a0e7-4a0b0c731574 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:09.037908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccd0955-fd73-4290-a0e7-4a0b0c731574 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:09.040881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccd0955-fd73-4290-a0e7-4a0b0c731574 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:09.043860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccd0955-fd73-4290-a0e7-4a0b0c731574 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:09.118127 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-820867a0-d730-4704-9819-3f235eef01d5 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.394241 Sep 10 10:35:09.120781 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 173/331] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 10:35:08 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:09.132910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-d1f4bb5a-3e26-4567-a19c-56914df5fefc req-0d73f7be-51af-4cd1-8c8b-a82c9eeeb214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0679e8c1-9eee-4c6f-880e-5ccb97a6777d", "name": "network-vif-plugged", "status": "completed", "tag": "ccaaf8d2-2052-4cb1-92a2-c73657a458b7"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:09.173589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d1f4bb5a-3e26-4567-a19c-56914df5fefc req-0d73f7be-51af-4cd1-8c8b-a82c9eeeb214 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:09.174497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d1f4bb5a-3e26-4567-a19c-56914df5fefc req-0d73f7be-51af-4cd1-8c8b-a82c9eeeb214 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:09.175147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d1f4bb5a-3e26-4567-a19c-56914df5fefc req-0d73f7be-51af-4cd1-8c8b-a82c9eeeb214 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:09.195576 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-d1f4bb5a-3e26-4567-a19c-56914df5fefc req-0d73f7be-51af-4cd1-8c8b-a82c9eeeb214 service nova] Creating event network-vif-plugged:ccaaf8d2-2052-4cb1-92a2-c73657a458b7 for instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d on n-h1-856894-1 Sep 10 10:35:09.206995 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-d1f4bb5a-3e26-4567-a19c-56914df5fefc req-0d73f7be-51af-4cd1-8c8b-a82c9eeeb214 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082758 Sep 10 10:35:09.207958 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 174/332] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:09.215862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7bb8171d-f512-4da6-a2ce-3b76d04406d1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:09.275269 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7bb8171d-f512-4da6-a2ce-3b76d04406d1 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.065846 Sep 10 10:35:09.276641 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 175/333] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:09 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:35:09.286745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e1f17b1b-13b0-4c4f-b490-2e223808ae50 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-862567165"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:09.290572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-e1f17b1b-13b0-4c4f-b490-2e223808ae50 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Generated uuid f2e8214d-c12f-4966-bc43-fa9762f491ea for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:35:09.340384 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e1f17b1b-13b0-4c4f-b490-2e223808ae50 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057494 Sep 10 10:35:09.341039 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 176/334] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:09.346995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:09.349974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:09.363147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:09.369145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:09.369795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:09.371307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:09.371953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:09.372601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:09.474117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:09.474941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:09.476512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:09.479527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lazy-loading 'fault' on Instance uuid 17757b29-4e02-42eb-960e-9bb0ad14f1fb {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:35:09.790362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1c3bd16a894700a9766beae6c604ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd93ef10e524fbc9e7097521db75920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:09.805110 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f2c15735-4c67-48a7-9fe2-4d4e3ca15d78 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 200 len: 1310 microversion: 2.1 time: 0.462223 Sep 10 10:35:09.805717 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 177/335] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:09 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 1310 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:09.912590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eccd0955-fd73-4290-a0e7-4a0b0c731574 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:09.921198 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eccd0955-fd73-4290-a0e7-4a0b0c731574 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1318 microversion: 2.1 time: 0.918655 Sep 10 10:35:09.926040 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 159/336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:09 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1318 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:09.934851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-da8c3629-df1b-4666-8eef-3b46d08138cc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:09.939604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-da8c3629-df1b-4666-8eef-3b46d08138cc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:09.951852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da8c3629-df1b-4666-8eef-3b46d08138cc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:09.957569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da8c3629-df1b-4666-8eef-3b46d08138cc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:09.958134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da8c3629-df1b-4666-8eef-3b46d08138cc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:09.958966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da8c3629-df1b-4666-8eef-3b46d08138cc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:09.959521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da8c3629-df1b-4666-8eef-3b46d08138cc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:09.960035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da8c3629-df1b-4666-8eef-3b46d08138cc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:10.205332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea7f54ea-517a-445d-9694-b9c8d325df2a tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:10.208848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ea7f54ea-517a-445d-9694-b9c8d325df2a tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'd15dfe57d5c84b0593104708325234a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80333d7676a45fa88b1db47f04609a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea7f54ea-517a-445d-9694-b9c8d325df2a tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Request method failure captured: Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 39 Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhYXcgDluiR96IdtEWWZ11PA78esIYJ77gdsj5INvWGmkp6T2_Qhy52GOGZJaK38-zA3TcKQTtFfvXSu16aHq-x7HPc1A_se52pzcbckUw-aucTXuJOW4bZgJQAyQUMmwTzqdSDVMm5sS4lYjMNQG2RiFxflCmJCCY8V08glRVPKEo Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:10.210831 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b80333d7676a45fa88b1db47f04609a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: d15dfe57d5c84b0593104708325234a7 Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: {"add_host": {"host": "n-h1-856894-1"}} Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:10.212017 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-856894-1'}}} Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:10.212756 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 10 10:35:10.213814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.226100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea7f54ea-517a-445d-9694-b9c8d325df2a tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:10.227375 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ea7f54ea-517a-445d-9694-b9c8d325df2a tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.420655 Sep 10 10:35:10.228187 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 178/337] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 10:35:09 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 422 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:10.239238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7b19fb87-86e5-4e57-bf33-bdadefd4b1f9 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:10.294308 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7b19fb87-86e5-4e57-bf33-bdadefd4b1f9 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.060922 Sep 10 10:35:10.295854 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 179/338] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:10 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 10:35:10.307124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-801691b1-7234-446e-a717-86d5cc6daa65 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1888038589"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:10.313967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-801691b1-7234-446e-a717-86d5cc6daa65 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Generated uuid 3fb8be5d-cb3c-4eda-94c7-465d94867609 for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:35:10.352486 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-801691b1-7234-446e-a717-86d5cc6daa65 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046201 Sep 10 10:35:10.354712 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 180/339] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:10.381247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1097832538"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:10.420159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:10.420671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:10.421147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:10.438911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:10.439399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:10.439839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:10.442690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-da8c3629-df1b-4666-8eef-3b46d08138cc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:10.451580 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-da8c3629-df1b-4666-8eef-3b46d08138cc tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1588 microversion: 2.1 time: 0.524216 Sep 10 10:35:10.461888 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 160/340] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:09 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1588 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:10.489875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f49ba43d-aa1c-4e55-b342-844f8a54778e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:10.490586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f49ba43d-aa1c-4e55-b342-844f8a54778e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:10.496309 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1097832538 could not be found. Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Request method failure captured: Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 58 Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhZEMCB3HJTaVnNPbTgK4HpmZUB5S3ZhYCljI7rKGHJfwjsDJVX23o9VMZ731qAAelXMEq_9piqVtVaBBx5OnxrNPgIDDLzZluT1G6ej4SR4jNaLBZw-H6QLM1l439Y13ev49Q6ob9VfUUrb-nTw0g1BASUMR8S8WX9hnVQrRdXQyY Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:35:10.505248 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f40f0adb854cf6989f938887571847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f40f0adb854cf6989f938887571847", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 83c5879f96d64906a35a60f3ac9d0653 Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: {"add_host": {"host": "tempest-nonexist_host-1097832538"}} Sep 10 10:35:10.506598 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: exception: Compute host tempest-nonexist_host-1097832538 could not be found. Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1097832538'}}} Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1097832538' is not mapped to any cell Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.507254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 10 10:35:10.509061 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1097832538 could not be found. Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1097832538 could not be found. Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.514389 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.515695 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.515695 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.515695 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.515695 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:10.515695 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:10.515695 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1097832538 could not be found. Sep 10 10:35:10.515695 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.515695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1097832538 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:10.515695 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-17017aff-db10-402b-954d-ecaa4a24b3d3 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.145323 Sep 10 10:35:10.515695 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 181/341] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 10:35:10 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:10.516352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f49ba43d-aa1c-4e55-b342-844f8a54778e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:10.516352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f49ba43d-aa1c-4e55-b342-844f8a54778e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:10.516352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f49ba43d-aa1c-4e55-b342-844f8a54778e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:10.516352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f49ba43d-aa1c-4e55-b342-844f8a54778e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:10.517974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f49ba43d-aa1c-4e55-b342-844f8a54778e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:10.517974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f49ba43d-aa1c-4e55-b342-844f8a54778e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:10.525117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4f0a6a68-3c9d-43ee-bdcd-18ff43482605 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:10.577650 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4f0a6a68-3c9d-43ee-bdcd-18ff43482605 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055716 Sep 10 10:35:10.586073 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 182/342] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:10 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:35:10.596803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-16aa8c63-e1dc-49eb-92c1-3709e00eb116 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-16aa8c63-e1dc-49eb-92c1-3709e00eb116 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Request method failure captured: Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 283 Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhZEMCB3HJTaVnNPbTgK4HpmZUB5S3ZhYCljI7rKGHJfwjsDJVX23o9VMZ731qAAelXMEq_9piqVtVaBBx5OnxrNPgIDDLzZluT1G6ej4SR4jNaLBZw-H6QLM1l439Y13ev49Q6ob9VfUUrb-nTw0g1BASUMR8S8WX9hnVQrRdXQyY Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:35:10.606351 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:35:10.608335 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f40f0adb854cf6989f938887571847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f40f0adb854cf6989f938887571847", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:10.608335 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.608335 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:10.608335 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.608335 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:10.608335 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:10.608335 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:10.608335 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 83c5879f96d64906a35a60f3ac9d0653 Sep 10 10:35:10.608335 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:10.608335 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:35:10.608912 n-d-856894-1 devstack@n-api.service[128787]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 10 10:35:10.608912 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:10.608912 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:35:10.608912 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 10 10:35:10.608912 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:10.608912 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.608912 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:35:10.608912 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:35:10.608912 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:35:10.608912 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:10.612654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.614536 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.618070 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:35:10.618070 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:35:10.618070 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:35:10.618070 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.629130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-16aa8c63-e1dc-49eb-92c1-3709e00eb116 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:10.634639 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-16aa8c63-e1dc-49eb-92c1-3709e00eb116 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.045937 Sep 10 10:35:10.641396 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 183/343] 10.222.0.20 () {60 vars in 1165 bytes} [Sat Sep 10 10:35:10 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:35:10.647575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c92eaa7e-4dbf-4a6f-801c-62f56cb5eac7 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c92eaa7e-4dbf-4a6f-801c-62f56cb5eac7 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Request method failure captured: Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 27 Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhZEMCB3HJTaVnNPbTgK4HpmZUB5S3ZhYCljI7rKGHJfwjsDJVX23o9VMZ731qAAelXMEq_9piqVtVaBBx5OnxrNPgIDDLzZluT1G6ej4SR4jNaLBZw-H6QLM1l439Y13ev49Q6ob9VfUUrb-nTw0g1BASUMR8S8WX9hnVQrRdXQyY Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:35:10.652250 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f40f0adb854cf6989f938887571847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f40f0adb854cf6989f938887571847", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 83c5879f96d64906a35a60f3ac9d0653 Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: {"aggregate": {"name": ""}} Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:10.654444 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi '' Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:10.655247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 10:35:10.656857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.658233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c92eaa7e-4dbf-4a6f-801c-62f56cb5eac7 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:10.658233 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c92eaa7e-4dbf-4a6f-801c-62f56cb5eac7 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.010858 Sep 10 10:35:10.659659 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 184/344] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:10 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:35:10.665801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e6a58a9c-69f0-438b-8f88-1942a03394f9 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1822360006"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:10.669250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e6a58a9c-69f0-438b-8f88-1942a03394f9 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'd15dfe57d5c84b0593104708325234a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80333d7676a45fa88b1db47f04609a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e6a58a9c-69f0-438b-8f88-1942a03394f9 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Request method failure captured: Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 60 Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhYXcgDluiR96IdtEWWZ11PA78esIYJ77gdsj5INvWGmkp6T2_Qhy52GOGZJaK38-zA3TcKQTtFfvXSu16aHq-x7HPc1A_se52pzcbckUw-aucTXuJOW4bZgJQAyQUMmwTzqdSDVMm5sS4lYjMNQG2RiFxflCmJCCY8V08glRVPKEo Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:10.673131 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b80333d7676a45fa88b1db47f04609a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: d15dfe57d5c84b0593104708325234a7 Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: {"aggregate": {"name": "tempest-test_aggregate-1822360006"}} Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:10.674367 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1822360006'}}} Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:35:10.675110 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:35:10.676156 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 10 10:35:10.678402 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.678402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e6a58a9c-69f0-438b-8f88-1942a03394f9 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:10.678402 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e6a58a9c-69f0-438b-8f88-1942a03394f9 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.014017 Sep 10 10:35:10.678402 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 185/345] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:10 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:10.692441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cbb6bb4e-d9a1-4436-84a7-b8e953bb1c67 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1040821472"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:10.698675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-cbb6bb4e-d9a1-4436-84a7-b8e953bb1c67 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Generated uuid 427e97d9-1f89-49b7-9017-39a8438c265c for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:35:10.729775 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cbb6bb4e-d9a1-4436-84a7-b8e953bb1c67 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049434 Sep 10 10:35:10.734373 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 186/346] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:35:10.738385 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f49ba43d-aa1c-4e55-b342-844f8a54778e tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252688 Sep 10 10:35:10.740101 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 161/347] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:35:10 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975/os-interface => generated 284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:10.751042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ccffe70c-3a8a-4b43-8e6d-8068287f6067 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1040821472"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:10.756343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-ccffe70c-3a8a-4b43-8e6d-8068287f6067 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Generated uuid b6c8c149-f0db-4aae-8acd-b0d21f8565d2 for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:35:10.768015 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-ccffe70c-3a8a-4b43-8e6d-8068287f6067 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1040821472 already exists. Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ccffe70c-3a8a-4b43-8e6d-8068287f6067 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Request method failure captured: Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 60 Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhZEMCB3HJTaVnNPbTgK4HpmZUB5S3ZhYCljI7rKGHJfwjsDJVX23o9VMZ731qAAelXMEq_9piqVtVaBBx5OnxrNPgIDDLzZluT1G6ej4SR4jNaLBZw-H6QLM1l439Y13ev49Q6ob9VfUUrb-nTw0g1BASUMR8S8WX9hnVQrRdXQyY Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:35:10.770784 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f40f0adb854cf6989f938887571847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f40f0adb854cf6989f938887571847", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 83c5879f96d64906a35a60f3ac9d0653 Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: {"aggregate": {"name": "tempest-test_aggregate-1040821472"}} Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:10.772170 n-d-856894-1 devstack@n-api.service[128787]: exception: Aggregate tempest-test_aggregate-1040821472 already exists. Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1040821472'}}} Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 10 10:35:10.772891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1040821472 already exists. Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:10.773941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1040821472 already exists. Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1040821472 already exists. Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ccffe70c-3a8a-4b43-8e6d-8068287f6067 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1040821472 already exists. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:10.778686 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ccffe70c-3a8a-4b43-8e6d-8068287f6067 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.034426 Sep 10 10:35:10.779692 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 187/348] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:10 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 36 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:35:10.782596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-47959b48-8078-4fde-8e16-841bea2b7b30 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:10.792581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:10.810875 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-47959b48-8078-4fde-8e16-841bea2b7b30 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.031875 Sep 10 10:35:10.811488 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 162/349] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:10 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:35:10.821143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-839a30d8-3f4c-4e39-8a59-f38f60e51803 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1774627329"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:10.824169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-839a30d8-3f4c-4e39-8a59-f38f60e51803 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Generated uuid 0d0c3850-0b92-435d-b7fb-fffcb711315a for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:35:10.838661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:10.839284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:10.855581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:10.857124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:10.857749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:10.858687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:10.859344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:10.866833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:10.879455 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-839a30d8-3f4c-4e39-8a59-f38f60e51803 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060607 Sep 10 10:35:10.885322 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 188/350] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] HTTP exception thrown: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Request method failure captured: Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb HTTP/1.1 Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGgXBn-N_1w9xT_EcJhdNORdFBDFmsOVHEslj4KRn41iE7abMfZIijLh70NOIfv0U7ZsOefM6Rvalqtf1Sj4r3J5vcGll3SMy_GmpN15d31iUZ6jp2br5YX274yqaIuG3CDC9N0kOP0sHUDSEJEifuBzWsOz8C0bLzv6UhtolpcQUV8 Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:35:10.892841 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fd93ef10e524fbc9e7097521db75920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 4c1c3bd16a894700a9766beae6c604ed Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:10.894436 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '17757b29-4e02-42eb-960e-9bb0ad14f1fb'} Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:10.895258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:10.896526 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.898447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Returning 404 to user: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:10.898447 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-927dd894-7170-483a-a0b9-7801cbc1514a tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 404 len: 111 microversion: 2.1 time: 0.061013 Sep 10 10:35:10.898447 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 163/351] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:10 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:10.903024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd208150-c6a8-4e53-8f50-2ea7310c0cc1 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:10.905321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd208150-c6a8-4e53-8f50-2ea7310c0cc1 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'd15dfe57d5c84b0593104708325234a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80333d7676a45fa88b1db47f04609a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd208150-c6a8-4e53-8f50-2ea7310c0cc1 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Request method failure captured: Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhYXcgDluiR96IdtEWWZ11PA78esIYJ77gdsj5INvWGmkp6T2_Qhy52GOGZJaK38-zA3TcKQTtFfvXSu16aHq-x7HPc1A_se52pzcbckUw-aucTXuJOW4bZgJQAyQUMmwTzqdSDVMm5sS4lYjMNQG2RiFxflCmJCCY8V08glRVPKEo Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:35:10.907536 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b80333d7676a45fa88b1db47f04609a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d15dfe57d5c84b0593104708325234a7 Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 10 10:35:10.908696 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '15'} Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:10.909416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 10 10:35:10.910765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.913236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd208150-c6a8-4e53-8f50-2ea7310c0cc1 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:10.914734 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd208150-c6a8-4e53-8f50-2ea7310c0cc1 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.020746 Sep 10 10:35:10.915253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:10.916222 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 164/352] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:10 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:10.920857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:10.925726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-908dd9d5-3595-4eab-8f80-7b319f07e036 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:10.936536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:10.945930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:10.947075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:10.948136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:10.948877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:10.949768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:10.957702 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-908dd9d5-3595-4eab-8f80-7b319f07e036 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.037391 Sep 10 10:35:10.958681 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 165/353] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:10 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 10:35:10.971335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9ebfea05-be70-4c3f-a9b0-19869d2ada08 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:10.973928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9ebfea05-be70-4c3f-a9b0-19869d2ada08 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:10.988371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebfea05-be70-4c3f-a9b0-19869d2ada08 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:10.990220 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] HTTP exception thrown: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:10.990918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebfea05-be70-4c3f-a9b0-19869d2ada08 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Request method failure captured: Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb HTTP/1.1 Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgXBn-N_1w9xT_EcJhdNORdFBDFmsOVHEslj4KRn41iE7abMfZIijLh70NOIfv0U7ZsOefM6Rvalqtf1Sj4r3J5vcGll3SMy_GmpN15d31iUZ6jp2br5YX274yqaIuG3CDC9N0kOP0sHUDSEJEifuBzWsOz8C0bLzv6UhtolpcQUV8 Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:10.992760 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fd93ef10e524fbc9e7097521db75920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 4c1c3bd16a894700a9766beae6c604ed Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:10.994048 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '17757b29-4e02-42eb-960e-9bb0ad14f1fb'} Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:10.994712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:10.996462 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:10.999475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebfea05-be70-4c3f-a9b0-19869d2ada08 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:11.001939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Returning 404 to user: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:11.002535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebfea05-be70-4c3f-a9b0-19869d2ada08 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:11.003405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebfea05-be70-4c3f-a9b0-19869d2ada08 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:11.004563 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b12756da-c608-49a9-bf14-a31a0ea957f1 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 404 len: 111 microversion: 2.1 time: 0.103673 Sep 10 10:35:11.005263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebfea05-be70-4c3f-a9b0-19869d2ada08 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:11.009789 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 189/354] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:35:10 2022] DELETE /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:11.019460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-61570f11-42ec-4882-baa3-3797c9da489c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:11.047422 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-61570f11-42ec-4882-baa3-3797c9da489c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-61570f11-42ec-4882-baa3-3797c9da489c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Request method failure captured: Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhZEMCB3HJTaVnNPbTgK4HpmZUB5S3ZhYCljI7rKGHJfwjsDJVX23o9VMZ731qAAelXMEq_9piqVtVaBBx5OnxrNPgIDDLzZluT1G6ej4SR4jNaLBZw-H6QLM1l439Y13ev49Q6ob9VfUUrb-nTw0g1BASUMR8S8WX9hnVQrRdXQyY Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:35:11.049420 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f40f0adb854cf6989f938887571847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f40f0adb854cf6989f938887571847", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 83c5879f96d64906a35a60f3ac9d0653 Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: exception: Aggregate -1 could not be found. Sep 10 10:35:11.050839 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '-1'} Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 10:35:11.051619 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.052867 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.055607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.055607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.055607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:11.055607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:11.055607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 10 10:35:11.055607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.055607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-61570f11-42ec-4882-baa3-3797c9da489c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:11.058619 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-61570f11-42ec-4882-baa3-3797c9da489c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.043396 Sep 10 10:35:11.060324 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 190/355] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:11 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:35:11.068315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:11.072581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 17757b29-4e02-42eb-960e-9bb0ad14f1fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:11.086036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:11.086871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:11.087644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:11.088571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:11.089364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:11.090078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:11.105280 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] HTTP exception thrown: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Request method failure captured: Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb HTTP/1.1 Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgXBn-N_1w9xT_EcJhdNORdFBDFmsOVHEslj4KRn41iE7abMfZIijLh70NOIfv0U7ZsOefM6Rvalqtf1Sj4r3J5vcGll3SMy_GmpN15d31iUZ6jp2br5YX274yqaIuG3CDC9N0kOP0sHUDSEJEifuBzWsOz8C0bLzv6UhtolpcQUV8 Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:11.107473 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fd93ef10e524fbc9e7097521db75920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 4c1c3bd16a894700a9766beae6c604ed Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:11.108736 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '17757b29-4e02-42eb-960e-9bb0ad14f1fb'} Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:11.109594 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. Sep 10 10:35:11.110673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.111711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Returning 404 to user: Instance 17757b29-4e02-42eb-960e-9bb0ad14f1fb could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:11.111711 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-242a2e15-00c6-4825-bab1-4694a01e1554 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb" status: 404 len: 111 microversion: 2.1 time: 0.049906 Sep 10 10:35:11.112201 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 191/356] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:11 2022] GET /compute/v2.1/servers/17757b29-4e02-42eb-960e-9bb0ad14f1fb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:11.125579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-00918585-24ca-4e17-90e6-31245e3324ec tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-120619426"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:11.128997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-00918585-24ca-4e17-90e6-31245e3324ec tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Generated uuid 5931d283-f744-43a8-97ac-4e8b8e532fed for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:35:11.159319 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-00918585-24ca-4e17-90e6-31245e3324ec tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038016 Sep 10 10:35:11.160231 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 192/357] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:11.166131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:11.167802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:11.175229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:11.175942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:11.176534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:11.177291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:11.177900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:11.178480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:11.194870 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] HTTP exception thrown: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Request method failure captured: Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 HTTP/1.1 Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgXBn-N_1w9xT_EcJhdNORdFBDFmsOVHEslj4KRn41iE7abMfZIijLh70NOIfv0U7ZsOefM6Rvalqtf1Sj4r3J5vcGll3SMy_GmpN15d31iUZ6jp2br5YX274yqaIuG3CDC9N0kOP0sHUDSEJEifuBzWsOz8C0bLzv6UhtolpcQUV8 Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:11.196722 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fd93ef10e524fbc9e7097521db75920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 4c1c3bd16a894700a9766beae6c604ed Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:35:11.197973 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '386253a1-3a4d-4a5f-8ca2-1177b1ff7df7'} Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:11.198648 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:35:11.199687 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.202193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Returning 404 to user: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:11.205048 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c77a0228-7946-4a97-b0ca-c0b8341b8b00 tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "DELETE /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 404 len: 111 microversion: 2.1 time: 0.043421 Sep 10 10:35:11.205647 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 193/358] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:35:11 2022] DELETE /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:11.210879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e2b2a6a9-bb68-403b-bf6d-b3dee2086e33 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:11.213844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e2b2a6a9-bb68-403b-bf6d-b3dee2086e33 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'd15dfe57d5c84b0593104708325234a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80333d7676a45fa88b1db47f04609a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e2b2a6a9-bb68-403b-bf6d-b3dee2086e33 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Request method failure captured: Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhYXcgDluiR96IdtEWWZ11PA78esIYJ77gdsj5INvWGmkp6T2_Qhy52GOGZJaK38-zA3TcKQTtFfvXSu16aHq-x7HPc1A_se52pzcbckUw-aucTXuJOW4bZgJQAyQUMmwTzqdSDVMm5sS4lYjMNQG2RiFxflCmJCCY8V08glRVPKEo Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:11.215849 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b80333d7676a45fa88b1db47f04609a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: d15dfe57d5c84b0593104708325234a7 Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 10 10:35:11.217375 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '16'} Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:11.218198 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 10 10:35:11.219419 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.221266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e2b2a6a9-bb68-403b-bf6d-b3dee2086e33 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:11.222323 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e2b2a6a9-bb68-403b-bf6d-b3dee2086e33 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.015673 Sep 10 10:35:11.223413 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 194/359] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:35:11 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:11.228782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:11.229677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] [instance: 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:11.237878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:11.240489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:11.241050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:11.242430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:11.243168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:11.243713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:11.260860 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] HTTP exception thrown: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Request method failure captured: Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 HTTP/1.1 Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgXBn-N_1w9xT_EcJhdNORdFBDFmsOVHEslj4KRn41iE7abMfZIijLh70NOIfv0U7ZsOefM6Rvalqtf1Sj4r3J5vcGll3SMy_GmpN15d31iUZ6jp2br5YX274yqaIuG3CDC9N0kOP0sHUDSEJEifuBzWsOz8C0bLzv6UhtolpcQUV8 Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:11.263852 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fd93ef10e524fbc9e7097521db75920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fd93ef10e524fbc9e7097521db75920", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 5fd93ef10e524fbc9e7097521db75920 Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1262079638 Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 4c1c3bd16a894700a9766beae6c604ed Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-DeleteServersAdminTestJSON-1262079638-project Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:35:11.265097 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '386253a1-3a4d-4a5f-8ca2-1177b1ff7df7'} Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:11.265762 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. Sep 10 10:35:11.266826 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.270127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] Returning 404 to user: Instance 386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:11.271369 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-12beab93-3d84-4b31-b4fc-5d5b6428aabb tempest-DeleteServersAdminTestJSON-1262079638 tempest-DeleteServersAdminTestJSON-1262079638-project] 10.222.0.20 "GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7" status: 404 len: 111 microversion: 2.1 time: 0.046823 Sep 10 10:35:11.272449 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 195/360] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:11 2022] GET /compute/v2.1/servers/386253a1-3a4d-4a5f-8ca2-1177b1ff7df7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:11.277497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ca434ad3-b960-43cd-8653-3ca089c30101 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:11.321810 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ca434ad3-b960-43cd-8653-3ca089c30101 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.047975 Sep 10 10:35:11.322551 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 196/361] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:11 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:35:11.333291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-05a60dd3-0729-455f-8f43-66059302b446 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:11.357707 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-05a60dd3-0729-455f-8f43-66059302b446 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-05a60dd3-0729-455f-8f43-66059302b446 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Request method failure captured: Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhZEMCB3HJTaVnNPbTgK4HpmZUB5S3ZhYCljI7rKGHJfwjsDJVX23o9VMZ731qAAelXMEq_9piqVtVaBBx5OnxrNPgIDDLzZluT1G6ej4SR4jNaLBZw-H6QLM1l439Y13ev49Q6ob9VfUUrb-nTw0g1BASUMR8S8WX9hnVQrRdXQyY Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:35:11.361469 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f40f0adb854cf6989f938887571847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f40f0adb854cf6989f938887571847", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 83c5879f96d64906a35a60f3ac9d0653 Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: exception: Aggregate -1 could not be found. Sep 10 10:35:11.362714 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '-1'} Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.363459 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 10 10:35:11.364579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.365622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-05a60dd3-0729-455f-8f43-66059302b446 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:11.367143 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-05a60dd3-0729-455f-8f43-66059302b446 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036497 Sep 10 10:35:11.368662 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 197/362] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:35:11 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:35:11.379470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bd84aa80-a69b-4d3c-8ffa-0ab1e9b34f10 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:11.381035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bd84aa80-a69b-4d3c-8ffa-0ab1e9b34f10 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'd15dfe57d5c84b0593104708325234a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80333d7676a45fa88b1db47f04609a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bd84aa80-a69b-4d3c-8ffa-0ab1e9b34f10 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Request method failure captured: Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhYXcgDluiR96IdtEWWZ11PA78esIYJ77gdsj5INvWGmkp6T2_Qhy52GOGZJaK38-zA3TcKQTtFfvXSu16aHq-x7HPc1A_se52pzcbckUw-aucTXuJOW4bZgJQAyQUMmwTzqdSDVMm5sS4lYjMNQG2RiFxflCmJCCY8V08glRVPKEo Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:11.382599 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b80333d7676a45fa88b1db47f04609a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: d15dfe57d5c84b0593104708325234a7 Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 10 10:35:11.383913 n-d-856894-1 devstack@n-api.service[128787]: action_args: {} Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:11.384568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.385629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bd84aa80-a69b-4d3c-8ffa-0ab1e9b34f10 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:11.386542 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bd84aa80-a69b-4d3c-8ffa-0ab1e9b34f10 tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.011399 Sep 10 10:35:11.386542 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 198/363] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:35:11 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:35:11.398248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-934ada38-c536-457c-8a76-dc7a37b8ed88 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1834175377"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:11.402208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-934ada38-c536-457c-8a76-dc7a37b8ed88 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Generated uuid 4c929c1e-0e88-4fd2-ab94-0c53349267dd for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:35:11.428482 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-934ada38-c536-457c-8a76-dc7a37b8ed88 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.035337 Sep 10 10:35:11.431467 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 199/364] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:11 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:35:11.442762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-69ca1f09-4efb-46b6-bb66-096d2dbc2563 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:11.454785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69ca1f09-4efb-46b6-bb66-096d2dbc2563 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:11.455802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69ca1f09-4efb-46b6-bb66-096d2dbc2563 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:11.456850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69ca1f09-4efb-46b6-bb66-096d2dbc2563 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:11.475024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9ebfea05-be70-4c3f-a9b0-19869d2ada08 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:11.481491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:11.516258 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9ebfea05-be70-4c3f-a9b0-19869d2ada08 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1318 microversion: 2.1 time: 0.550341 Sep 10 10:35:11.518467 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 166/365] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:10 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:11.845275 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-69ca1f09-4efb-46b6-bb66-096d2dbc2563 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.404743 Sep 10 10:35:11.847252 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 200/366] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 10:35:11 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:11.864188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df87d309-db68-4823-9e4a-c58c36fd686f tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-856894-1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:11.869663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-df87d309-db68-4823-9e4a-c58c36fd686f tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'd15dfe57d5c84b0593104708325234a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80333d7676a45fa88b1db47f04609a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df87d309-db68-4823-9e4a-c58c36fd686f tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Request method failure captured: Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 42 Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhYXcgDluiR96IdtEWWZ11PA78esIYJ77gdsj5INvWGmkp6T2_Qhy52GOGZJaK38-zA3TcKQTtFfvXSu16aHq-x7HPc1A_se52pzcbckUw-aucTXuJOW4bZgJQAyQUMmwTzqdSDVMm5sS4lYjMNQG2RiFxflCmJCCY8V08glRVPKEo Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:35:11.872088 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b80333d7676a45fa88b1db47f04609a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b80333d7676a45fa88b1db47f04609a2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b80333d7676a45fa88b1db47f04609a2 Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757 Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d15dfe57d5c84b0593104708325234a7 Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1949081757-project Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: {"remove_host": {"host": "n-h1-856894-1"}} Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:35:11.873428 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-856894-1'}}} Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:11.874146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 10 10:35:11.875219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:11.876225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df87d309-db68-4823-9e4a-c58c36fd686f tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:11.876225 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-df87d309-db68-4823-9e4a-c58c36fd686f tempest-AggregatesAdminNegativeTestJSON-1949081757 tempest-AggregatesAdminNegativeTestJSON-1949081757-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.018751 Sep 10 10:35:11.876225 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 167/367] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 10:35:11 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:11.883131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9f87a338-b1bf-43f2-ac82-4a7179c8de81 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:11.896656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f87a338-b1bf-43f2-ac82-4a7179c8de81 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:11.897903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f87a338-b1bf-43f2-ac82-4a7179c8de81 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:11.898891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f87a338-b1bf-43f2-ac82-4a7179c8de81 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:11.909493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:12.130365 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9f87a338-b1bf-43f2-ac82-4a7179c8de81 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.251149 Sep 10 10:35:12.131653 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 201/368] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 10:35:11 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:12.144211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3a36b4f-a730-4dd0-ad87-b87181069764 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:12.207981 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f3a36b4f-a730-4dd0-ad87-b87181069764 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.068187 Sep 10 10:35:12.209199 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 168/369] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:12 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:35:12.220621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5e794999-4a79-4faf-89e5-0f06c0f881a6 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-955873883"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:12.224676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-5e794999-4a79-4faf-89e5-0f06c0f881a6 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Generated uuid bfd6fa39-2a89-43b5-bf8f-d744f438be0f for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 10:35:12.270032 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5e794999-4a79-4faf-89e5-0f06c0f881a6 tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055435 Sep 10 10:35:12.283479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:12.288486 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 202/370] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 10:35:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:35:12.304611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:12.308632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:12.309329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:12.321171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:12.322214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:12.323991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:12.368183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.compute.aggregates [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 10 10:35:12.369299 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Request method failure captured: Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 42 Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhZEMCB3HJTaVnNPbTgK4HpmZUB5S3ZhYCljI7rKGHJfwjsDJVX23o9VMZ731qAAelXMEq_9piqVtVaBBx5OnxrNPgIDDLzZluT1G6ej4SR4jNaLBZw-H6QLM1l439Y13ev49Q6ob9VfUUrb-nTw0g1BASUMR8S8WX9hnVQrRdXQyY Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:35:12.380092 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13f40f0adb854cf6989f938887571847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13f40f0adb854cf6989f938887571847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13f40f0adb854cf6989f938887571847", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 13f40f0adb854cf6989f938887571847 Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206 Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 83c5879f96d64906a35a60f3ac9d0653 Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: {"remove_host": {"host": "nonexist_host"}} Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:35:12.381705 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot remove host nonexist_host in aggregate 18 Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 10 10:35:12.382733 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 10 10:35:12.384213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:12.386174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:12.389765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:12.389765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:12.389765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:12.389765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:12.389765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Sep 10 10:35:12.389765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:12.392145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:12.393340 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c3d5003-ab75-486d-9fa8-180b8d1a902c tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.114477 Sep 10 10:35:12.394514 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 169/371] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 10:35:12 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:35:12.405564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-485f7955-706a-42b4-a289-5807b5b7bdbf tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:12.466887 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-485f7955-706a-42b4-a289-5807b5b7bdbf tempest-AggregatesAdminNegativeTestJSON-1154274206 tempest-AggregatesAdminNegativeTestJSON-1154274206-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.067567 Sep 10 10:35:12.477395 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 203/372] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:12 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 10:35:12.543674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-731f5986-332b-498d-9e86-2a453d7a2f33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:12.544831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-731f5986-332b-498d-9e86-2a453d7a2f33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:12.577785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-731f5986-332b-498d-9e86-2a453d7a2f33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:12.578332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-731f5986-332b-498d-9e86-2a453d7a2f33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:12.580529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-731f5986-332b-498d-9e86-2a453d7a2f33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:12.583583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-731f5986-332b-498d-9e86-2a453d7a2f33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:12.586575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-731f5986-332b-498d-9e86-2a453d7a2f33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:12.588099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-731f5986-332b-498d-9e86-2a453d7a2f33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:13.260476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-731f5986-332b-498d-9e86-2a453d7a2f33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:13.274411 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-731f5986-332b-498d-9e86-2a453d7a2f33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1468 microversion: 2.1 time: 0.736638 Sep 10 10:35:13.276987 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 170/373] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:12 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1468 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:13.299382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-74addb36-5f9e-4103-8f85-b44dfc7dabd1 tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:13.299916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-74addb36-5f9e-4103-8f85-b44dfc7dabd1 tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:13.306494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74addb36-5f9e-4103-8f85-b44dfc7dabd1 tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:13.306984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74addb36-5f9e-4103-8f85-b44dfc7dabd1 tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:13.318460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74addb36-5f9e-4103-8f85-b44dfc7dabd1 tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:13.319372 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74addb36-5f9e-4103-8f85-b44dfc7dabd1 tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:13.319848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74addb36-5f9e-4103-8f85-b44dfc7dabd1 tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:13.320453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74addb36-5f9e-4103-8f85-b44dfc7dabd1 tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:13.400114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-74addb36-5f9e-4103-8f85-b44dfc7dabd1 tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lazy-loading 'flavor' on Instance uuid 0679e8c1-9eee-4c6f-880e-5ccb97a6777d {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:35:13.525762 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-74addb36-5f9e-4103-8f85-b44dfc7dabd1 tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d/action" status: 202 len: 0 microversion: 2.1 time: 0.229530 Sep 10 10:35:13.533191 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 204/374] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:35:13 2022] POST /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:13.539893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-740f06e8-d7dc-4eab-9a95-6cdd31c68ac2 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:13.540583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-740f06e8-d7dc-4eab-9a95-6cdd31c68ac2 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:13.558722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740f06e8-d7dc-4eab-9a95-6cdd31c68ac2 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:13.559338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740f06e8-d7dc-4eab-9a95-6cdd31c68ac2 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:13.563238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740f06e8-d7dc-4eab-9a95-6cdd31c68ac2 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:13.564205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740f06e8-d7dc-4eab-9a95-6cdd31c68ac2 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:13.564679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740f06e8-d7dc-4eab-9a95-6cdd31c68ac2 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:13.565162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740f06e8-d7dc-4eab-9a95-6cdd31c68ac2 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:14.107673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-740f06e8-d7dc-4eab-9a95-6cdd31c68ac2 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:14.117915 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-740f06e8-d7dc-4eab-9a95-6cdd31c68ac2 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1476 microversion: 2.1 time: 0.584335 Sep 10 10:35:14.135589 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 171/375] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:13 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1476 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:14.371158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-360535039", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:14.494551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] validate_networks() for None {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:35:15.144512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ba5ee3d-5f38-4a32-9751-523a4c329aa7 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:15.145845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7ba5ee3d-5f38-4a32-9751-523a4c329aa7 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:15.154098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ba5ee3d-5f38-4a32-9751-523a4c329aa7 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:15.159372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ba5ee3d-5f38-4a32-9751-523a4c329aa7 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:15.162260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ba5ee3d-5f38-4a32-9751-523a4c329aa7 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:15.163327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ba5ee3d-5f38-4a32-9751-523a4c329aa7 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:15.165181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ba5ee3d-5f38-4a32-9751-523a4c329aa7 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:15.168436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ba5ee3d-5f38-4a32-9751-523a4c329aa7 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:15.568873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7ba5ee3d-5f38-4a32-9751-523a4c329aa7 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:15.578125 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7ba5ee3d-5f38-4a32-9751-523a4c329aa7 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1459 microversion: 2.1 time: 0.437394 Sep 10 10:35:15.590430 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 172/376] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:15 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1459 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:15.615516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-061a7eb2-560e-4d89-8cc0-07bde80bfc1f tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:15.617912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-061a7eb2-560e-4d89-8cc0-07bde80bfc1f tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:15.640053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-061a7eb2-560e-4d89-8cc0-07bde80bfc1f tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:15.640881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-061a7eb2-560e-4d89-8cc0-07bde80bfc1f tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:15.641569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-061a7eb2-560e-4d89-8cc0-07bde80bfc1f tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:15.643327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-061a7eb2-560e-4d89-8cc0-07bde80bfc1f tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:15.644517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-061a7eb2-560e-4d89-8cc0-07bde80bfc1f tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:15.645990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-061a7eb2-560e-4d89-8cc0-07bde80bfc1f tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:15.899130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:35:15.899737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:35:15.900207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:35:15.900644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:35:15.901114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:35:15.935566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:15.937591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:15.939243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:15.942910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:15.953660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:15.955447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:16.031727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Getting quotas for project 3a85977a2f5a4870b65488cf83cce911. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:35:16.041753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Getting quotas for user 3ae584a919844c5584e066606c9efd36 and project 3a85977a2f5a4870b65488cf83cce911. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:35:16.087922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:35:16.096146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:35:16.276494 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0f685973-3575-405b-accc-3d1ea78e06d6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.689599 Sep 10 10:35:16.277176 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 205/377] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:35:16.284761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-34ec9a2a-5799-4449-b6c8-9cb236457675 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:16.287527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-34ec9a2a-5799-4449-b6c8-9cb236457675 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:16.313977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34ec9a2a-5799-4449-b6c8-9cb236457675 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:16.325856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34ec9a2a-5799-4449-b6c8-9cb236457675 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:16.327605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34ec9a2a-5799-4449-b6c8-9cb236457675 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:16.329251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34ec9a2a-5799-4449-b6c8-9cb236457675 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:16.332067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34ec9a2a-5799-4449-b6c8-9cb236457675 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:16.335085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34ec9a2a-5799-4449-b6c8-9cb236457675 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:16.708703 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-061a7eb2-560e-4d89-8cc0-07bde80bfc1f tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1610 microversion: 2.1 time: 1.097646 Sep 10 10:35:16.711464 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 173/378] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:15 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1610 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:16.741591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6b80ca97-14b2-415c-8a6a-694012c42b42 req-28fd3519-7353-4edc-811f-737fc141a41a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066e1684-136a-40a9-90b1-dec10869b975", "tag": "4a00ca77-e930-48ea-9732-09baa58dfd34"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:16.758517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6b80ca97-14b2-415c-8a6a-694012c42b42 req-28fd3519-7353-4edc-811f-737fc141a41a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:16.761185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6b80ca97-14b2-415c-8a6a-694012c42b42 req-28fd3519-7353-4edc-811f-737fc141a41a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:16.761803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6b80ca97-14b2-415c-8a6a-694012c42b42 req-28fd3519-7353-4edc-811f-737fc141a41a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:16.792007 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6b80ca97-14b2-415c-8a6a-694012c42b42 req-28fd3519-7353-4edc-811f-737fc141a41a service nova] Creating event network-changed:4a00ca77-e930-48ea-9732-09baa58dfd34 for instance 066e1684-136a-40a9-90b1-dec10869b975 on n-h2-856894-1 Sep 10 10:35:16.807821 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6b80ca97-14b2-415c-8a6a-694012c42b42 req-28fd3519-7353-4edc-811f-737fc141a41a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078011 Sep 10 10:35:16.811162 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 174/379] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:16.822323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-40a73efe-bec9-47bf-a0d0-73e19fb71f2d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:16.822957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-40a73efe-bec9-47bf-a0d0-73e19fb71f2d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:17.174010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-34ec9a2a-5799-4449-b6c8-9cb236457675 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:17.187724 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-34ec9a2a-5799-4449-b6c8-9cb236457675 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 200 len: 1588 microversion: 2.1 time: 0.907639 Sep 10 10:35:17.203024 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 206/380] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:16 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 1588 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:17.206866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-40a73efe-bec9-47bf-a0d0-73e19fb71f2d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:17.214646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ef32a052-44a6-4df9-9c66-1307092ac5bb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:17.214828 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-40a73efe-bec9-47bf-a0d0-73e19fb71f2d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1216 microversion: 2.1 time: 0.402188 Sep 10 10:35:17.216944 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 175/381] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:16 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1216 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:17.230930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef32a052-44a6-4df9-9c66-1307092ac5bb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:17.232122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef32a052-44a6-4df9-9c66-1307092ac5bb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:17.233754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef32a052-44a6-4df9-9c66-1307092ac5bb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:17.234757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef32a052-44a6-4df9-9c66-1307092ac5bb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:17.237536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef32a052-44a6-4df9-9c66-1307092ac5bb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:17.239529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef32a052-44a6-4df9-9c66-1307092ac5bb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:17.329384 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ef32a052-44a6-4df9-9c66-1307092ac5bb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.125135 Sep 10 10:35:17.332044 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 207/382] 10.222.0.20 () {58 vars in 1176 bytes} [Sat Sep 10 10:35:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:17.342522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-856894-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:17.349724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:17.366631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:17.367141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:17.367585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:17.368299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:17.368754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:17.370160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:18.123935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1671931691", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:18.240336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] validate_networks() for None {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:35:18.443188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Lazy-loading 'flavor' on Instance uuid 0679e8c1-9eee-4c6f-880e-5ccb97a6777d {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:35:18.547313 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d while it is in vm_state suspended Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Request method failure captured: Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d/action HTTP/1.1 Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 97 Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGg1QGmRmSBxiKyX73v1p63rMu5vgG1_4BPxAeiVEOZqW1hLe-n3mNXujMn9nvfu7j1WIEVdFyD9ads79OKZbYm802vxFY_37JUIEDLUDpgn7MMiv512Dkzjoh0_enoSn3Pz8n5NFiw-fr-WBjltjVzbTyZzmsUZ29GaV92RH6jmw-E Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: daa0e4c358364459bda622a451f491df Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-LiveMigrationNegativeTest-500309977 Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:35:18.551137 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/daa0e4c358364459bda622a451f491df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/daa0e4c358364459bda622a451f491df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/daa0e4c358364459bda622a451f491df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_daa0e4c358364459bda622a451f491df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-LiveMigrationNegativeTest-500309977 Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: daa0e4c358364459bda622a451f491df Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-500309977 Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-LiveMigrationNegativeTest-500309977-project-admin Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3561120e4640418f9570974b60e7c781 Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-LiveMigrationNegativeTest-500309977-project-admin Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: {"os-migrateLive": {"host": "n-h2-856894-1", "block_migration": true, "disk_over_commit": false}} Sep 10 10:35:18.552499 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'os-migrateLive' instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d while it is in vm_state suspended Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '0679e8c1-9eee-4c6f-880e-5ccb97a6777d', 'body': {'os-migrateLive': {'host': 'n-h2-856894-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 10 10:35:18.553408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:18.554934 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d while it is in vm_state suspended Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d while it is in vm_state suspended Sep 10 10:35:18.556010 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:18.562320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d while it is in vm_state suspended {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:18.562320 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5740cc1a-3349-4618-a17f-cf54fa49dfdb tempest-LiveMigrationNegativeTest-500309977 tempest-LiveMigrationNegativeTest-500309977-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d/action" status: 409 len: 155 microversion: 2.1 time: 1.215261 Sep 10 10:35:18.562320 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 176/383] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:35:17 2022] POST /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d/action => generated 155 bytes in 1218 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:35:18.568190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-81bd1ed0-fca2-44a1-b636-d965cc64f11a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:18.568903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-81bd1ed0-fca2-44a1-b636-d965cc64f11a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:18.576040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81bd1ed0-fca2-44a1-b636-d965cc64f11a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:18.576552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81bd1ed0-fca2-44a1-b636-d965cc64f11a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:18.576996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81bd1ed0-fca2-44a1-b636-d965cc64f11a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:18.577741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81bd1ed0-fca2-44a1-b636-d965cc64f11a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:18.578190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81bd1ed0-fca2-44a1-b636-d965cc64f11a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:18.578656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81bd1ed0-fca2-44a1-b636-d965cc64f11a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:18.843962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-81bd1ed0-fca2-44a1-b636-d965cc64f11a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:18.853365 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-81bd1ed0-fca2-44a1-b636-d965cc64f11a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1276 microversion: 2.1 time: 0.295270 Sep 10 10:35:18.855554 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 177/384] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:18 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1276 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:18.863071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8eba2c5e-7444-4647-a8a3-5f45a1c3fd89 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:18.863843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8eba2c5e-7444-4647-a8a3-5f45a1c3fd89 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:18.880184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eba2c5e-7444-4647-a8a3-5f45a1c3fd89 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:18.880700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eba2c5e-7444-4647-a8a3-5f45a1c3fd89 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:18.881165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eba2c5e-7444-4647-a8a3-5f45a1c3fd89 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:18.881860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eba2c5e-7444-4647-a8a3-5f45a1c3fd89 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:18.882311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eba2c5e-7444-4647-a8a3-5f45a1c3fd89 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:18.882752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eba2c5e-7444-4647-a8a3-5f45a1c3fd89 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:18.932725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8eba2c5e-7444-4647-a8a3-5f45a1c3fd89 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:35:19.085221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:35:19.085756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:35:19.086478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:35:19.087209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:35:19.087849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:35:19.100796 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8eba2c5e-7444-4647-a8a3-5f45a1c3fd89 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 204 len: 0 microversion: 2.1 time: 0.240975 Sep 10 10:35:19.101827 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 178/385] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:35:18 2022] DELETE /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:35:19.113430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf88cdb1-1fe5-4828-8fea-665defcb7265 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:19.114494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf88cdb1-1fe5-4828-8fea-665defcb7265 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:19.126086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88cdb1-1fe5-4828-8fea-665defcb7265 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:19.127041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88cdb1-1fe5-4828-8fea-665defcb7265 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:19.128765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88cdb1-1fe5-4828-8fea-665defcb7265 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:19.131409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88cdb1-1fe5-4828-8fea-665defcb7265 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:19.132458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88cdb1-1fe5-4828-8fea-665defcb7265 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:19.133058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88cdb1-1fe5-4828-8fea-665defcb7265 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:19.134650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:19.144983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:19.148505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:19.153925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:19.163316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:19.163959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:19.235110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:35:19.255977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:35:19.287446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:35:19.294130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:35:19.411960 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dfbfe6b2-70d2-4f02-8170-ae2b8be12010 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.021404 Sep 10 10:35:19.414856 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 208/386] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 10:35:19.693155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cf88cdb1-1fe5-4828-8fea-665defcb7265 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:19.716827 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf88cdb1-1fe5-4828-8fea-665defcb7265 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1465 microversion: 2.1 time: 0.607772 Sep 10 10:35:19.717829 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 179/387] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:19 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1465 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:19.736088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a640d5fd-41ba-4f86-b019-9c61f13ae19a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:19.736718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a640d5fd-41ba-4f86-b019-9c61f13ae19a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:19.936108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a640d5fd-41ba-4f86-b019-9c61f13ae19a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:19.944547 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a640d5fd-41ba-4f86-b019-9c61f13ae19a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1217 microversion: 2.1 time: 0.225238 Sep 10 10:35:19.959724 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 180/388] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:19 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:19.975557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7dcb5471-88fd-4f62-84c6-421479f9f2b2 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:19.977562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7dcb5471-88fd-4f62-84c6-421479f9f2b2 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:19.996809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcb5471-88fd-4f62-84c6-421479f9f2b2 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:19.997549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcb5471-88fd-4f62-84c6-421479f9f2b2 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:19.998333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcb5471-88fd-4f62-84c6-421479f9f2b2 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:20.001916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcb5471-88fd-4f62-84c6-421479f9f2b2 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:20.003011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcb5471-88fd-4f62-84c6-421479f9f2b2 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:20.004618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcb5471-88fd-4f62-84c6-421479f9f2b2 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:20.086902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fab124ea-c28e-42c0-95a9-5c14e6ccadfd tempest-FlavorsV255TestJSON-117415527 tempest-FlavorsV255TestJSON-117415527-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1676600320", "id": 763249025, "os-flavor-access:is_public": "True"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:20.140535 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fab124ea-c28e-42c0-95a9-5c14e6ccadfd tempest-FlavorsV255TestJSON-117415527 tempest-FlavorsV255TestJSON-117415527-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.722117 Sep 10 10:35:20.144170 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 209/389] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:35:19 2022] POST /compute/v2.1/flavors => generated 446 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:35:20.381175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7dcb5471-88fd-4f62-84c6-421479f9f2b2 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:20.395856 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7dcb5471-88fd-4f62-84c6-421479f9f2b2 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1274 microversion: 2.1 time: 0.434475 Sep 10 10:35:20.398082 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 181/390] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:19 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1274 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:20.533183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3c0d4f3e-6ae0-4846-be37-3d784a59cee5 tempest-FlavorsV255TestJSON-1803558073 tempest-FlavorsV255TestJSON-1803558073-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:20.545950 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3c0d4f3e-6ae0-4846-be37-3d784a59cee5 tempest-FlavorsV255TestJSON-1803558073 tempest-FlavorsV255TestJSON-1803558073-project] 10.222.0.20 "GET /compute/v2.1/flavors/763249025" status: 200 len: 446 microversion: 2.55 time: 0.394822 Sep 10 10:35:20.547863 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 210/391] 10.222.0.20 () {60 vars in 1196 bytes} [Sat Sep 10 10:35:20 2022] GET /compute/v2.1/flavors/763249025 => generated 446 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:35:20.564869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41fa5b79-59f5-4790-895a-7f10124e9447 tempest-FlavorsV255TestJSON-117415527 tempest-FlavorsV255TestJSON-117415527-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:20.615452 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41fa5b79-59f5-4790-895a-7f10124e9447 tempest-FlavorsV255TestJSON-117415527 tempest-FlavorsV255TestJSON-117415527-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/763249025" status: 200 len: 447 microversion: 2.55 time: 0.059050 Sep 10 10:35:20.617830 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 182/392] 10.222.0.20 () {62 vars in 1216 bytes} [Sat Sep 10 10:35:20 2022] PUT /compute/v2.1/flavors/763249025 => generated 447 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:35:20.641767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b9820a32-b72a-4ca6-932c-ae7dff8d29e9 tempest-FlavorsV255TestJSON-1803558073 tempest-FlavorsV255TestJSON-1803558073-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:20.679681 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b9820a32-b72a-4ca6-932c-ae7dff8d29e9 tempest-FlavorsV255TestJSON-1803558073 tempest-FlavorsV255TestJSON-1803558073-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6594 microversion: 2.55 time: 0.050438 Sep 10 10:35:20.680937 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 211/393] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:35:20 2022] GET /compute/v2.1/flavors/detail => generated 6594 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:35:20.705171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8468fba-01c3-40aa-ab40-484301f70ee3 tempest-FlavorsV255TestJSON-1803558073 tempest-FlavorsV255TestJSON-1803558073-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:20.740570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2993be9e-2228-4806-8cc1-bcaae395b577 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:20.742478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2993be9e-2228-4806-8cc1-bcaae395b577 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:20.759149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2993be9e-2228-4806-8cc1-bcaae395b577 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:20.760555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2993be9e-2228-4806-8cc1-bcaae395b577 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:20.761264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2993be9e-2228-4806-8cc1-bcaae395b577 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:20.764815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2993be9e-2228-4806-8cc1-bcaae395b577 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:20.765580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2993be9e-2228-4806-8cc1-bcaae395b577 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:20.767192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2993be9e-2228-4806-8cc1-bcaae395b577 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:20.795600 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8468fba-01c3-40aa-ab40-484301f70ee3 tempest-FlavorsV255TestJSON-1803558073 tempest-FlavorsV255TestJSON-1803558073-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3684 microversion: 2.55 time: 0.097077 Sep 10 10:35:20.797475 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 183/394] 10.222.0.20 () {60 vars in 1166 bytes} [Sat Sep 10 10:35:20 2022] GET /compute/v2.1/flavors => generated 3684 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:35:20.815183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85ebfac0-37d9-40d2-ae4d-f144a81000d3 tempest-FlavorsV255TestJSON-117415527 tempest-FlavorsV255TestJSON-117415527-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:20.865315 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85ebfac0-37d9-40d2-ae4d-f144a81000d3 tempest-FlavorsV255TestJSON-117415527 tempest-FlavorsV255TestJSON-117415527-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/763249025" status: 202 len: 0 microversion: 2.55 time: 0.055323 Sep 10 10:35:20.866920 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 184/395] 10.222.0.20 () {60 vars in 1199 bytes} [Sat Sep 10 10:35:20 2022] DELETE /compute/v2.1/flavors/763249025 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:35:20.886952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c95df0b9-bd8f-4a06-a99d-a825cd727e9d tempest-FlavorsV255TestJSON-117415527 tempest-FlavorsV255TestJSON-117415527-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:20.918011 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c95df0b9-bd8f-4a06-a99d-a825cd727e9d tempest-FlavorsV255TestJSON-117415527 tempest-FlavorsV255TestJSON-117415527-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6157 microversion: 2.55 time: 0.039937 Sep 10 10:35:20.920344 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 185/396] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:35:20 2022] GET /compute/v2.1/flavors/detail => generated 6157 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:35:20.973861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6096bc54-90d4-4846-9e35-55a4eabe0621 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:20.975933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6096bc54-90d4-4846-9e35-55a4eabe0621 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:20.989804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6096bc54-90d4-4846-9e35-55a4eabe0621 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:20.991246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6096bc54-90d4-4846-9e35-55a4eabe0621 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:20.991975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6096bc54-90d4-4846-9e35-55a4eabe0621 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:20.993151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6096bc54-90d4-4846-9e35-55a4eabe0621 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:20.994151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6096bc54-90d4-4846-9e35-55a4eabe0621 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:20.994845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6096bc54-90d4-4846-9e35-55a4eabe0621 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:21.132016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6096bc54-90d4-4846-9e35-55a4eabe0621 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:21.142776 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6096bc54-90d4-4846-9e35-55a4eabe0621 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1269 microversion: 2.1 time: 0.175754 Sep 10 10:35:21.146172 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 186/397] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:20 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:21.197780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2993be9e-2228-4806-8cc1-bcaae395b577 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:21.207529 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2993be9e-2228-4806-8cc1-bcaae395b577 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1465 microversion: 2.1 time: 0.471522 Sep 10 10:35:21.213040 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 212/398] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:20 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1465 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:21.421022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a27c15fa-7705-4b16-9cb1-cfc66f15d86d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:21.421683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a27c15fa-7705-4b16-9cb1-cfc66f15d86d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:21.434756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27c15fa-7705-4b16-9cb1-cfc66f15d86d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:21.435493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27c15fa-7705-4b16-9cb1-cfc66f15d86d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:21.436072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27c15fa-7705-4b16-9cb1-cfc66f15d86d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:21.436910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27c15fa-7705-4b16-9cb1-cfc66f15d86d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:21.437529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27c15fa-7705-4b16-9cb1-cfc66f15d86d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:21.438092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27c15fa-7705-4b16-9cb1-cfc66f15d86d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:21.792599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a27c15fa-7705-4b16-9cb1-cfc66f15d86d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:21.801999 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a27c15fa-7705-4b16-9cb1-cfc66f15d86d tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1274 microversion: 2.1 time: 0.385511 Sep 10 10:35:21.805385 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 187/399] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:21 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1274 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:22.171503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-70ba537d-12e9-4c83-ae8a-5814a5971971 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:22.172756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-70ba537d-12e9-4c83-ae8a-5814a5971971 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:22.186820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70ba537d-12e9-4c83-ae8a-5814a5971971 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:22.187529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70ba537d-12e9-4c83-ae8a-5814a5971971 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:22.188236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70ba537d-12e9-4c83-ae8a-5814a5971971 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:22.189134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70ba537d-12e9-4c83-ae8a-5814a5971971 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:22.189744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70ba537d-12e9-4c83-ae8a-5814a5971971 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:22.191600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70ba537d-12e9-4c83-ae8a-5814a5971971 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:22.240381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-359924e0-94ce-47b1-baaa-e35155866104 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:22.241376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-359924e0-94ce-47b1-baaa-e35155866104 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:22.252474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359924e0-94ce-47b1-baaa-e35155866104 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:22.253561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359924e0-94ce-47b1-baaa-e35155866104 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:22.254991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359924e0-94ce-47b1-baaa-e35155866104 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:22.259784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359924e0-94ce-47b1-baaa-e35155866104 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:22.260483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359924e0-94ce-47b1-baaa-e35155866104 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:22.261139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359924e0-94ce-47b1-baaa-e35155866104 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:22.332102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:22.422443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-70ba537d-12e9-4c83-ae8a-5814a5971971 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:22.435642 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-70ba537d-12e9-4c83-ae8a-5814a5971971 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1275 microversion: 2.1 time: 0.269439 Sep 10 10:35:22.439280 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 213/400] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:22 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:22.545784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-359924e0-94ce-47b1-baaa-e35155866104 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:22.576696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-d0657686-849e-48ed-8371-bef853cd39f6 req-40ae16fd-6183-459f-86d1-9de0915d5c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0679e8c1-9eee-4c6f-880e-5ccb97a6777d", "name": "network-vif-deleted", "tag": "ccaaf8d2-2052-4cb1-92a2-c73657a458b7"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:22.587656 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-359924e0-94ce-47b1-baaa-e35155866104 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 200 len: 1423 microversion: 2.1 time: 0.324605 Sep 10 10:35:22.625770 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 188/401] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:22 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 1423 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:22.638872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d0657686-849e-48ed-8371-bef853cd39f6 req-40ae16fd-6183-459f-86d1-9de0915d5c77 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:22.644830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d0657686-849e-48ed-8371-bef853cd39f6 req-40ae16fd-6183-459f-86d1-9de0915d5c77 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:22.646582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d0657686-849e-48ed-8371-bef853cd39f6 req-40ae16fd-6183-459f-86d1-9de0915d5c77 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:22.687230 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-d0657686-849e-48ed-8371-bef853cd39f6 req-40ae16fd-6183-459f-86d1-9de0915d5c77 service nova] Creating event network-vif-deleted:ccaaf8d2-2052-4cb1-92a2-c73657a458b7 for instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d on n-h1-856894-1 Sep 10 10:35:22.702116 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-d0657686-849e-48ed-8371-bef853cd39f6 req-40ae16fd-6183-459f-86d1-9de0915d5c77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130000 Sep 10 10:35:22.706779 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 214/402] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:22.834399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af3ffe7a-46f0-42c7-b8dd-02b63097d2e1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:22.835724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-af3ffe7a-46f0-42c7-b8dd-02b63097d2e1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:22.850585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af3ffe7a-46f0-42c7-b8dd-02b63097d2e1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:22.851080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af3ffe7a-46f0-42c7-b8dd-02b63097d2e1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:22.851747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af3ffe7a-46f0-42c7-b8dd-02b63097d2e1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:22.852453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af3ffe7a-46f0-42c7-b8dd-02b63097d2e1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:22.852894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af3ffe7a-46f0-42c7-b8dd-02b63097d2e1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:22.853392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af3ffe7a-46f0-42c7-b8dd-02b63097d2e1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:23.464754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e9745149-2e4c-4cd6-ae07-3b6cb114a92e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:23.465615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e9745149-2e4c-4cd6-ae07-3b6cb114a92e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:23.486041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9745149-2e4c-4cd6-ae07-3b6cb114a92e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:23.488681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9745149-2e4c-4cd6-ae07-3b6cb114a92e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:23.489386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9745149-2e4c-4cd6-ae07-3b6cb114a92e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:23.490263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9745149-2e4c-4cd6-ae07-3b6cb114a92e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:23.494148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9745149-2e4c-4cd6-ae07-3b6cb114a92e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:23.495047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9745149-2e4c-4cd6-ae07-3b6cb114a92e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:23.718765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e9745149-2e4c-4cd6-ae07-3b6cb114a92e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:23.729462 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e9745149-2e4c-4cd6-ae07-3b6cb114a92e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1275 microversion: 2.1 time: 0.269886 Sep 10 10:35:23.730923 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 215/403] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:23 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1275 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:23.739312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:23.741400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 0679e8c1-9eee-4c6f-880e-5ccb97a6777d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:23.750568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:23.752196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:23.753325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:23.755399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:23.758889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:23.758889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:23.778066 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] HTTP exception thrown: Instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d could not be found. Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Request method failure captured: Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d HTTP/1.1 Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgxZ-RXhkB9jeqs4NMBaAIqyYniqrhuF-dkbs4zAdyIu3gGFFXqAGNYcUn3hPC-VUe8FX25veu3_emAXRi71y1SU2ikuwuKrZ2sYqDilPUQmWcWkJzM_1FXPL3oaN5jBc0HLotJ7ns8WkHR7wL4qvA90XQjegFApCXlj1R7dCSS4Sk Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 394e48c362f340eb91dbd10c72c186f7 Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-LiveMigrationNegativeTest-1692642929 Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:23.782023 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/394e48c362f340eb91dbd10c72c186f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/394e48c362f340eb91dbd10c72c186f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/394e48c362f340eb91dbd10c72c186f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_394e48c362f340eb91dbd10c72c186f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-LiveMigrationNegativeTest-1692642929 Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 394e48c362f340eb91dbd10c72c186f7 Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1692642929 Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-LiveMigrationNegativeTest-1692642929-project Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 480aa0631c1846b480f072613b7e38a1 Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-LiveMigrationNegativeTest-1692642929-project Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d could not be found. Sep 10 10:35:23.783367 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '0679e8c1-9eee-4c6f-880e-5ccb97a6777d'} Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d could not be found. Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:23.784104 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d could not be found. Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d could not be found. Sep 10 10:35:23.788172 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:23.794795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Returning 404 to user: Instance 0679e8c1-9eee-4c6f-880e-5ccb97a6777d could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:23.796091 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-98fac521-26a5-44ef-ae89-dd63e89026d5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d" status: 404 len: 111 microversion: 2.1 time: 0.062850 Sep 10 10:35:23.797565 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 216/404] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:23 2022] GET /compute/v2.1/servers/0679e8c1-9eee-4c6f-880e-5ccb97a6777d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:23.812719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-47a98bb8-1d4e-4bb2-a465-957d2e2e5d33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:23.815874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-47a98bb8-1d4e-4bb2-a465-957d2e2e5d33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:23.828419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47a98bb8-1d4e-4bb2-a465-957d2e2e5d33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:23.829415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47a98bb8-1d4e-4bb2-a465-957d2e2e5d33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:23.830677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47a98bb8-1d4e-4bb2-a465-957d2e2e5d33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:23.832405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47a98bb8-1d4e-4bb2-a465-957d2e2e5d33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:23.833285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47a98bb8-1d4e-4bb2-a465-957d2e2e5d33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:23.834149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47a98bb8-1d4e-4bb2-a465-957d2e2e5d33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:23.930623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-47a98bb8-1d4e-4bb2-a465-957d2e2e5d33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:35:23.961050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-af3ffe7a-46f0-42c7-b8dd-02b63097d2e1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:23.970541 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af3ffe7a-46f0-42c7-b8dd-02b63097d2e1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1316 microversion: 2.1 time: 1.145023 Sep 10 10:35:23.972489 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 189/405] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:22 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1316 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:24.329393 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-47a98bb8-1d4e-4bb2-a465-957d2e2e5d33 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 204 len: 0 microversion: 2.1 time: 0.526177 Sep 10 10:35:24.334654 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 217/406] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:35:23 2022] DELETE /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:35:24.345644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cf774d5-6b74-4cc1-8292-fa8823de0462 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:24.347879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6cf774d5-6b74-4cc1-8292-fa8823de0462 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:24.368953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf774d5-6b74-4cc1-8292-fa8823de0462 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:24.369771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf774d5-6b74-4cc1-8292-fa8823de0462 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:24.370551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf774d5-6b74-4cc1-8292-fa8823de0462 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:24.374037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf774d5-6b74-4cc1-8292-fa8823de0462 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:24.374980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf774d5-6b74-4cc1-8292-fa8823de0462 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:24.375597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf774d5-6b74-4cc1-8292-fa8823de0462 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:24.762220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b96b2aad-1b63-4c81-b03e-a18e1d6e732b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:24.764065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b96b2aad-1b63-4c81-b03e-a18e1d6e732b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:24.782583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b96b2aad-1b63-4c81-b03e-a18e1d6e732b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:24.784771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b96b2aad-1b63-4c81-b03e-a18e1d6e732b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:24.786318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b96b2aad-1b63-4c81-b03e-a18e1d6e732b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:24.787275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b96b2aad-1b63-4c81-b03e-a18e1d6e732b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:24.789392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b96b2aad-1b63-4c81-b03e-a18e1d6e732b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:24.790112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b96b2aad-1b63-4c81-b03e-a18e1d6e732b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:24.817000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:25.063928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6cf774d5-6b74-4cc1-8292-fa8823de0462 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:25.078396 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cf774d5-6b74-4cc1-8292-fa8823de0462 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1473 microversion: 2.1 time: 0.739085 Sep 10 10:35:25.081906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 190/407] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:24 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1473 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:25.100877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53b2c707-cd25-4057-b722-7159f5edc67b tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:25.100877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53b2c707-cd25-4057-b722-7159f5edc67b tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:25.108270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b2c707-cd25-4057-b722-7159f5edc67b tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:25.108763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b2c707-cd25-4057-b722-7159f5edc67b tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:25.117363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b2c707-cd25-4057-b722-7159f5edc67b tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:25.118289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b2c707-cd25-4057-b722-7159f5edc67b tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:25.118780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b2c707-cd25-4057-b722-7159f5edc67b tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:25.119236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b2c707-cd25-4057-b722-7159f5edc67b tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:25.124632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:25.149386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b96b2aad-1b63-4c81-b03e-a18e1d6e732b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:25.167863 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b96b2aad-1b63-4c81-b03e-a18e1d6e732b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1317 microversion: 2.1 time: 0.411807 Sep 10 10:35:25.168416 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 218/408] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:24 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:25.862629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53b2c707-cd25-4057-b722-7159f5edc67b tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:25.883169 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53b2c707-cd25-4057-b722-7159f5edc67b tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1316 microversion: 2.1 time: 0.798162 Sep 10 10:35:25.887899 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 191/409] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:25 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1316 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:26.109584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72a36860-a6c7-45bf-aee0-8c8743d229d8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:26.110349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-72a36860-a6c7-45bf-aee0-8c8743d229d8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:26.125966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72a36860-a6c7-45bf-aee0-8c8743d229d8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:26.131942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72a36860-a6c7-45bf-aee0-8c8743d229d8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:26.135009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72a36860-a6c7-45bf-aee0-8c8743d229d8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:26.136587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72a36860-a6c7-45bf-aee0-8c8743d229d8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:26.138836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72a36860-a6c7-45bf-aee0-8c8743d229d8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:26.143410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72a36860-a6c7-45bf-aee0-8c8743d229d8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:26.243949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-de5258fe-4dca-42a9-b039-f95543c554b9 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Calling method '.version_select at 0x7efcaf20eaf0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:26.597851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-72a36860-a6c7-45bf-aee0-8c8743d229d8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:26.610187 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72a36860-a6c7-45bf-aee0-8c8743d229d8 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1473 microversion: 2.1 time: 0.504683 Sep 10 10:35:26.613211 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 192/410] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:26 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1473 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:26.630807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56fb52ef-d12e-4263-a159-f3d6473d7038 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:26.631836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56fb52ef-d12e-4263-a159-f3d6473d7038 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:26.643758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56fb52ef-d12e-4263-a159-f3d6473d7038 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:26.644546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56fb52ef-d12e-4263-a159-f3d6473d7038 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:26.649540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56fb52ef-d12e-4263-a159-f3d6473d7038 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:26.650478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56fb52ef-d12e-4263-a159-f3d6473d7038 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:26.651103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56fb52ef-d12e-4263-a159-f3d6473d7038 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:26.651866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56fb52ef-d12e-4263-a159-f3d6473d7038 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:26.964633 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-de5258fe-4dca-42a9-b039-f95543c554b9 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/10cd441433624b8b9e9a72361a5cf92a" status: 200 len: 371 microversion: 2.1 time: 1.309183 Sep 10 10:35:26.967632 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 219/411] 10.222.0.20 () {58 vars in 1242 bytes} [Sat Sep 10 10:35:25 2022] GET /compute/v2.1/os-quota-sets/10cd441433624b8b9e9a72361a5cf92a => generated 371 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:35:26.976318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-209db21b-d56d-40da-8e9a-4deec0fdba08 req-b52795d4-6b80-40f7-a425-c00f3f03ed9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2c8aaac-8fb1-4334-a972-492a119fc8d5", "tag": "0269a13f-cff8-4c12-b6cc-739e948a57b0"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:27.004877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-209db21b-d56d-40da-8e9a-4deec0fdba08 req-b52795d4-6b80-40f7-a425-c00f3f03ed9e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:27.005664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-209db21b-d56d-40da-8e9a-4deec0fdba08 req-b52795d4-6b80-40f7-a425-c00f3f03ed9e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:27.006430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-209db21b-d56d-40da-8e9a-4deec0fdba08 req-b52795d4-6b80-40f7-a425-c00f3f03ed9e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:27.034777 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-209db21b-d56d-40da-8e9a-4deec0fdba08 req-b52795d4-6b80-40f7-a425-c00f3f03ed9e service nova] Creating event network-changed:0269a13f-cff8-4c12-b6cc-739e948a57b0 for instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 on n-h1-856894-1 Sep 10 10:35:27.042594 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-209db21b-d56d-40da-8e9a-4deec0fdba08 req-b52795d4-6b80-40f7-a425-c00f3f03ed9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073562 Sep 10 10:35:27.044015 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 220/412] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:27.049801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bb57d855-d13d-42aa-a247-eed877367960 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:27.050735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bb57d855-d13d-42aa-a247-eed877367960 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:27.058337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb57d855-d13d-42aa-a247-eed877367960 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:27.059137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb57d855-d13d-42aa-a247-eed877367960 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:27.060531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb57d855-d13d-42aa-a247-eed877367960 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:27.061457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb57d855-d13d-42aa-a247-eed877367960 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:27.062093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb57d855-d13d-42aa-a247-eed877367960 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:27.062672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb57d855-d13d-42aa-a247-eed877367960 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:27.497591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56fb52ef-d12e-4263-a159-f3d6473d7038 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:27.507700 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56fb52ef-d12e-4263-a159-f3d6473d7038 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1317 microversion: 2.1 time: 0.893049 Sep 10 10:35:27.511314 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 193/413] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:26 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1317 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:27.531096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86de1dd9-50ef-493b-9b9f-375bbb382449 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf1da1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:27.573275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bb57d855-d13d-42aa-a247-eed877367960 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:27.584056 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bb57d855-d13d-42aa-a247-eed877367960 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1316 microversion: 2.1 time: 0.538444 Sep 10 10:35:27.587036 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 221/414] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:27 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:27.641608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-641457a8-8875-4bcb-b04a-2d80994f2b6d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:27.642645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-641457a8-8875-4bcb-b04a-2d80994f2b6d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:27.651676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-641457a8-8875-4bcb-b04a-2d80994f2b6d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:27.652174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-641457a8-8875-4bcb-b04a-2d80994f2b6d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:27.652710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-641457a8-8875-4bcb-b04a-2d80994f2b6d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:27.670748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-641457a8-8875-4bcb-b04a-2d80994f2b6d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:27.674924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-641457a8-8875-4bcb-b04a-2d80994f2b6d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:27.675738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-641457a8-8875-4bcb-b04a-2d80994f2b6d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:28.035101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-641457a8-8875-4bcb-b04a-2d80994f2b6d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480aa0631c1846b480f072613b7e38a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394e48c362f340eb91dbd10c72c186f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:28.058339 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-641457a8-8875-4bcb-b04a-2d80994f2b6d tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 200 len: 1431 microversion: 2.1 time: 0.409312 Sep 10 10:35:28.059407 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 222/415] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:27 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 1431 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:28.330674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86de1dd9-50ef-493b-9b9f-375bbb382449 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:28.332593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86de1dd9-50ef-493b-9b9f-375bbb382449 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:28.336086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86de1dd9-50ef-493b-9b9f-375bbb382449 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:28.345153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86de1dd9-50ef-493b-9b9f-375bbb382449 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:28.347802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86de1dd9-50ef-493b-9b9f-375bbb382449 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:28.349925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86de1dd9-50ef-493b-9b9f-375bbb382449 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:28.504266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:28.564241 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86de1dd9-50ef-493b-9b9f-375bbb382449 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/10cd441433624b8b9e9a72361a5cf92a" status: 200 len: 328 microversion: 2.1 time: 1.046349 Sep 10 10:35:28.573003 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 194/416] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 10:35:27 2022] PUT /compute/v2.1/os-quota-sets/10cd441433624b8b9e9a72361a5cf92a => generated 328 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:28.588184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1eb9e858-d19f-4d15-9c20-aee3c84b5c60 req-d234f6fe-6625-4d11-b5ae-4009644d2772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72fde4e4-6f64-4a11-9eca-5b0a88ceb970", "name": "network-vif-deleted", "tag": "893c6ce2-ca67-4c25-913e-f6537631463d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:28.610319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94ee1f20-ed2a-4ff3-8277-ec8d2d1f80f0 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-416387641", "id": 2013920197, "os-flavor-access:is_public": "True"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:28.610798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1eb9e858-d19f-4d15-9c20-aee3c84b5c60 req-d234f6fe-6625-4d11-b5ae-4009644d2772 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:28.611211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1eb9e858-d19f-4d15-9c20-aee3c84b5c60 req-d234f6fe-6625-4d11-b5ae-4009644d2772 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:28.611653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1eb9e858-d19f-4d15-9c20-aee3c84b5c60 req-d234f6fe-6625-4d11-b5ae-4009644d2772 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:28.653666 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-94ee1f20-ed2a-4ff3-8277-ec8d2d1f80f0 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.590208 Sep 10 10:35:28.654703 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 223/417] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:28 2022] POST /compute/v2.1/flavors => generated 429 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:28.659545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a441c694-3372-499b-a6b2-d998bf01a981 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:28.665445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a441c694-3372-499b-a6b2-d998bf01a981 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:28.667783 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1eb9e858-d19f-4d15-9c20-aee3c84b5c60 req-d234f6fe-6625-4d11-b5ae-4009644d2772 service nova] Creating event network-vif-deleted:893c6ce2-ca67-4c25-913e-f6537631463d for instance 72fde4e4-6f64-4a11-9eca-5b0a88ceb970 on n-h2-856894-1 Sep 10 10:35:28.678724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a441c694-3372-499b-a6b2-d998bf01a981 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:28.680663 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1eb9e858-d19f-4d15-9c20-aee3c84b5c60 req-d234f6fe-6625-4d11-b5ae-4009644d2772 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103074 Sep 10 10:35:28.681489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a441c694-3372-499b-a6b2-d998bf01a981 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:28.682906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 195/418] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:28.683618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a441c694-3372-499b-a6b2-d998bf01a981 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:28.685241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a441c694-3372-499b-a6b2-d998bf01a981 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:28.693674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a441c694-3372-499b-a6b2-d998bf01a981 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:28.694358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a441c694-3372-499b-a6b2-d998bf01a981 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:28.698529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c158b35-a2fe-43ec-b40b-4f0a16a34269 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:28.735333 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c158b35-a2fe-43ec-b40b-4f0a16a34269 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-quota-sets/10cd441433624b8b9e9a72361a5cf92a" status: 202 len: 0 microversion: 2.1 time: 0.051107 Sep 10 10:35:28.740271 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 196/419] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:35:28 2022] DELETE /compute/v2.1/os-quota-sets/10cd441433624b8b9e9a72361a5cf92a => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:28.752307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43f2e713-cb25-4ba5-92d3-7d37337fe366 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:28.770969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-43f2e713-cb25-4ba5-92d3-7d37337fe366 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:28.803211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43f2e713-cb25-4ba5-92d3-7d37337fe366 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:28.803906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43f2e713-cb25-4ba5-92d3-7d37337fe366 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:28.804502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43f2e713-cb25-4ba5-92d3-7d37337fe366 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:28.805384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43f2e713-cb25-4ba5-92d3-7d37337fe366 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:28.805984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43f2e713-cb25-4ba5-92d3-7d37337fe366 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:28.806553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43f2e713-cb25-4ba5-92d3-7d37337fe366 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:29.194430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=16 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:29.226959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a441c694-3372-499b-a6b2-d998bf01a981 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:29.242974 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a441c694-3372-499b-a6b2-d998bf01a981 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1317 microversion: 2.1 time: 0.587062 Sep 10 10:35:29.248411 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 224/420] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:28 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:29.250788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-43f2e713-cb25-4ba5-92d3-7d37337fe366 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:29.261776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dc49a1a3-add1-4e52-86fb-b41e402c2a60 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:29.268727 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43f2e713-cb25-4ba5-92d3-7d37337fe366 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1316 microversion: 2.1 time: 0.527115 Sep 10 10:35:29.279404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=4,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:29.282093 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 197/421] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:28 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:29.290491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf13f6f6-490f-404a-9e4d-c41eec6d4c1e tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Calling method '.version_select at 0x7efcaf0f79d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:29.312158 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dc49a1a3-add1-4e52-86fb-b41e402c2a60 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2013920197" status: 202 len: 0 microversion: 2.1 time: 0.060339 Sep 10 10:35:29.314906 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 225/422] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:35:29 2022] DELETE /compute/v2.1/flavors/2013920197 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:29.532395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0ab339b1-21bd-41f5-852c-e9494a5d056e tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Calling method '.version_select at 0x7efcaf344790>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:29.537224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ab339b1-21bd-41f5-852c-e9494a5d056e tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:29.537754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ab339b1-21bd-41f5-852c-e9494a5d056e tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:29.538211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ab339b1-21bd-41f5-852c-e9494a5d056e tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:29.539010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ab339b1-21bd-41f5-852c-e9494a5d056e tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:29.539474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ab339b1-21bd-41f5-852c-e9494a5d056e tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:29.539916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ab339b1-21bd-41f5-852c-e9494a5d056e tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:29.611266 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0ab339b1-21bd-41f5-852c-e9494a5d056e tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.294913 Sep 10 10:35:29.619268 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 226/423] 10.222.0.20 () {58 vars in 1128 bytes} [Sat Sep 10 10:35:29 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:29.624763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:29.625421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] [instance: 72fde4e4-6f64-4a11-9eca-5b0a88ceb970] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:29.642083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:29.642618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:29.643176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:29.643775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:29.644455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:29.644843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:29.650174 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf13f6f6-490f-404a-9e4d-c41eec6d4c1e tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/10cd441433624b8b9e9a72361a5cf92a" status: 200 len: 371 microversion: 2.1 time: 0.366801 Sep 10 10:35:29.651198 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 198/424] 10.222.0.20 () {58 vars in 1242 bytes} [Sat Sep 10 10:35:29 2022] GET /compute/v2.1/os-quota-sets/10cd441433624b8b9e9a72361a5cf92a => generated 371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:29.656826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-293972d0-4241-4a3a-970a-b6a86a922224 req-e882ebbb-3b7e-4a50-965e-80987ee70040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52fb832d-13f8-4175-b047-fa651b9091da", "tag": "df07f796-7573-441a-8c41-4b9c692856f2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:29.671006 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] HTTP exception thrown: Instance 72fde4e4-6f64-4a11-9eca-5b0a88ceb970 could not be found. Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Request method failure captured: Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 HTTP/1.1 Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgxZ-RXhkB9jeqs4NMBaAIqyYniqrhuF-dkbs4zAdyIu3gGFFXqAGNYcUn3hPC-VUe8FX25veu3_emAXRi71y1SU2ikuwuKrZ2sYqDilPUQmWcWkJzM_1FXPL3oaN5jBc0HLotJ7ns8WkHR7wL4qvA90XQjegFApCXlj1R7dCSS4Sk Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 394e48c362f340eb91dbd10c72c186f7 Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-LiveMigrationNegativeTest-1692642929 Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:29.672674 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/394e48c362f340eb91dbd10c72c186f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/394e48c362f340eb91dbd10c72c186f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/394e48c362f340eb91dbd10c72c186f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_394e48c362f340eb91dbd10c72c186f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-LiveMigrationNegativeTest-1692642929 Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 394e48c362f340eb91dbd10c72c186f7 Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1692642929 Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-LiveMigrationNegativeTest-1692642929-project Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 480aa0631c1846b480f072613b7e38a1 Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-LiveMigrationNegativeTest-1692642929-project Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 72fde4e4-6f64-4a11-9eca-5b0a88ceb970 could not be found. Sep 10 10:35:29.674082 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '72fde4e4-6f64-4a11-9eca-5b0a88ceb970'} Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72fde4e4-6f64-4a11-9eca-5b0a88ceb970 could not be found. Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:29.674819 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72fde4e4-6f64-4a11-9eca-5b0a88ceb970 could not be found. Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72fde4e4-6f64-4a11-9eca-5b0a88ceb970 could not be found. Sep 10 10:35:29.676947 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:29.682010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-293972d0-4241-4a3a-970a-b6a86a922224 req-e882ebbb-3b7e-4a50-965e-80987ee70040 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:29.682492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-293972d0-4241-4a3a-970a-b6a86a922224 req-e882ebbb-3b7e-4a50-965e-80987ee70040 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:29.683023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-293972d0-4241-4a3a-970a-b6a86a922224 req-e882ebbb-3b7e-4a50-965e-80987ee70040 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:29.686738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] Returning 404 to user: Instance 72fde4e4-6f64-4a11-9eca-5b0a88ceb970 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:29.687761 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e8f0742b-723b-4381-8c8e-cd82cb3b16b5 tempest-LiveMigrationNegativeTest-1692642929 tempest-LiveMigrationNegativeTest-1692642929-project] 10.222.0.20 "GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970" status: 404 len: 111 microversion: 2.1 time: 0.067372 Sep 10 10:35:29.692572 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 227/425] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:29 2022] GET /compute/v2.1/servers/72fde4e4-6f64-4a11-9eca-5b0a88ceb970 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:29.697797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0d70eed5-5d13-4adb-9600-0f2dfd86a6e9 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:29.706518 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-293972d0-4241-4a3a-970a-b6a86a922224 req-e882ebbb-3b7e-4a50-965e-80987ee70040 service nova] Creating event network-changed:df07f796-7573-441a-8c41-4b9c692856f2 for instance 52fb832d-13f8-4175-b047-fa651b9091da on n-h2-856894-1 Sep 10 10:35:29.743068 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0d70eed5-5d13-4adb-9600-0f2dfd86a6e9 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.049276 Sep 10 10:35:29.743933 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 228/426] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:29 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:29.745421 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-293972d0-4241-4a3a-970a-b6a86a922224 req-e882ebbb-3b7e-4a50-965e-80987ee70040 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092703 Sep 10 10:35:29.746035 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 199/427] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:29.756970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-16789571-554d-473d-bfb5-cafa1ffbec80 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Calling method '.version_select at 0x7efcaf20e550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:29.761161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16789571-554d-473d-bfb5-cafa1ffbec80 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:29.761921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16789571-554d-473d-bfb5-cafa1ffbec80 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:29.762569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16789571-554d-473d-bfb5-cafa1ffbec80 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:29.763479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16789571-554d-473d-bfb5-cafa1ffbec80 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:29.764101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16789571-554d-473d-bfb5-cafa1ffbec80 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:29.766323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16789571-554d-473d-bfb5-cafa1ffbec80 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:29.769665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2f5409f-9238-4e41-9fd0-8343e13b9038 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2118779648", "id": 893979190, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:29.799776 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-16789571-554d-473d-bfb5-cafa1ffbec80 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.054600 Sep 10 10:35:29.802851 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 229/428] 10.222.0.20 () {58 vars in 1139 bytes} [Sat Sep 10 10:35:29 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:29.833166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d62cf7ac-6e1b-4579-b02a-86a1c86e2194 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Calling method '.version_select at 0x7efcaf2f2310>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:29.839713 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2f5409f-9238-4e41-9fd0-8343e13b9038 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.076511 Sep 10 10:35:29.852735 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 200/429] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:29 2022] POST /compute/v2.1/flavors => generated 414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:29.854532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d62cf7ac-6e1b-4579-b02a-86a1c86e2194 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:29.855208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d62cf7ac-6e1b-4579-b02a-86a1c86e2194 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:29.857362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d62cf7ac-6e1b-4579-b02a-86a1c86e2194 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:29.858902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d62cf7ac-6e1b-4579-b02a-86a1c86e2194 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:29.860337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d62cf7ac-6e1b-4579-b02a-86a1c86e2194 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:29.860972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d62cf7ac-6e1b-4579-b02a-86a1c86e2194 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:29.864797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b57f51e2-2e79-4cb3-a713-9ae086ebd88c tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:29.923900 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b57f51e2-2e79-4cb3-a713-9ae086ebd88c tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.069654 Sep 10 10:35:29.924726 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 201/430] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:29 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:29.991169 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d62cf7ac-6e1b-4579-b02a-86a1c86e2194 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.178119 Sep 10 10:35:29.992190 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 230/431] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Sep 10 10:35:29 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:35:29.993899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b0b213a-f2e2-4708-b1d2-61ef641aa09a tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Calling method '.version_select at 0x7efcaf2c7820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:30.003040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1060d703-f1f3-43da-b7e3-54444ebac693 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:30.068086 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1060d703-f1f3-43da-b7e3-54444ebac693 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/893979190" status: 202 len: 0 microversion: 2.1 time: 0.074898 Sep 10 10:35:30.069125 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 231/432] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:35:29 2022] DELETE /compute/v2.1/flavors/893979190 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:30.080850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-59944560-fa50-44b0-971c-8e8654ac45fb tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Calling method '.version_select at 0x7efcaf1b1160>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:30.090624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59944560-fa50-44b0-971c-8e8654ac45fb tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:30.091115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59944560-fa50-44b0-971c-8e8654ac45fb tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:30.096353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59944560-fa50-44b0-971c-8e8654ac45fb tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:30.098058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59944560-fa50-44b0-971c-8e8654ac45fb tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:30.105187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59944560-fa50-44b0-971c-8e8654ac45fb tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:30.105751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59944560-fa50-44b0-971c-8e8654ac45fb tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:30.197568 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-59944560-fa50-44b0-971c-8e8654ac45fb tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.123728 Sep 10 10:35:30.198212 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 232/433] 10.222.0.20 () {58 vars in 1128 bytes} [Sat Sep 10 10:35:30 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:30.223001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9fba8bdd-15c0-448a-b7b0-74b607b3214b tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:30.275548 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9fba8bdd-15c0-448a-b7b0-74b607b3214b tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.065454 Sep 10 10:35:30.276171 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 233/434] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:30 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:30.300284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c128b64c-f758-4656-8fc3-cd086129c975 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Calling method '.version_select at 0x7efcaf339550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:30.304960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c128b64c-f758-4656-8fc3-cd086129c975 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:30.305764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c128b64c-f758-4656-8fc3-cd086129c975 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:30.308029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c128b64c-f758-4656-8fc3-cd086129c975 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:30.308029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c128b64c-f758-4656-8fc3-cd086129c975 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:30.308029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c128b64c-f758-4656-8fc3-cd086129c975 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:30.308029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c128b64c-f758-4656-8fc3-cd086129c975 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:30.340115 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c128b64c-f758-4656-8fc3-cd086129c975 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.044988 Sep 10 10:35:30.341917 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 234/435] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:30 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:30.351546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7177890e-85f1-4da9-bb71-c21f93fe152f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:30.355887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7177890e-85f1-4da9-bb71-c21f93fe152f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:30.372720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7177890e-85f1-4da9-bb71-c21f93fe152f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:30.375147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7177890e-85f1-4da9-bb71-c21f93fe152f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:30.375620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7177890e-85f1-4da9-bb71-c21f93fe152f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:30.376358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7177890e-85f1-4da9-bb71-c21f93fe152f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:30.376823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7177890e-85f1-4da9-bb71-c21f93fe152f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:30.377276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7177890e-85f1-4da9-bb71-c21f93fe152f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:30.656908 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b0b213a-f2e2-4708-b1d2-61ef641aa09a tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/ae61738dc5b84158adbf697d491d8614/defaults" status: 200 len: 371 microversion: 2.1 time: 0.676729 Sep 10 10:35:30.657539 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 202/436] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:35:29 2022] GET /compute/v2.1/os-quota-sets/ae61738dc5b84158adbf697d491d8614/defaults => generated 371 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:30.679393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cdff8d75-1210-42f0-886d-e66a1c8ce9f6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:30.680145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cdff8d75-1210-42f0-886d-e66a1c8ce9f6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:30.695849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdff8d75-1210-42f0-886d-e66a1c8ce9f6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:30.698637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdff8d75-1210-42f0-886d-e66a1c8ce9f6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:30.699543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdff8d75-1210-42f0-886d-e66a1c8ce9f6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:30.703830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdff8d75-1210-42f0-886d-e66a1c8ce9f6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:30.704323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdff8d75-1210-42f0-886d-e66a1c8ce9f6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:30.704768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdff8d75-1210-42f0-886d-e66a1c8ce9f6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:30.954159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7177890e-85f1-4da9-bb71-c21f93fe152f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:30.962168 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7177890e-85f1-4da9-bb71-c21f93fe152f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1317 microversion: 2.1 time: 0.619058 Sep 10 10:35:30.977498 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 235/437] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:30 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:30.977498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-26a97161-a292-4d58-b76d-cd3c7b03cd02 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-90980944", "id": 21633214, "os-flavor-access:is_public": "True"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:31.035631 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-26a97161-a292-4d58-b76d-cd3c7b03cd02 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.067725 Sep 10 10:35:31.044997 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 236/438] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:30 2022] POST /compute/v2.1/flavors => generated 421 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:31.060257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aedcb9a0-2cd3-4c3d-a5cb-041907f2a389 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Calling method '.version_select at 0x7efcaf3399d0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.064786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aedcb9a0-2cd3-4c3d-a5cb-041907f2a389 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:31.065560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aedcb9a0-2cd3-4c3d-a5cb-041907f2a389 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:31.066331 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aedcb9a0-2cd3-4c3d-a5cb-041907f2a389 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:31.067886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aedcb9a0-2cd3-4c3d-a5cb-041907f2a389 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:31.068878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aedcb9a0-2cd3-4c3d-a5cb-041907f2a389 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:31.069753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aedcb9a0-2cd3-4c3d-a5cb-041907f2a389 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:31.105346 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aedcb9a0-2cd3-4c3d-a5cb-041907f2a389 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.051214 Sep 10 10:35:31.106608 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 237/439] 10.222.0.20 () {58 vars in 1128 bytes} [Sat Sep 10 10:35:31 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:31.112890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0549774e-0b9a-494c-b18d-b6338ca62da6 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.121832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cdff8d75-1210-42f0-886d-e66a1c8ce9f6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:31.133646 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cdff8d75-1210-42f0-886d-e66a1c8ce9f6 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1316 microversion: 2.1 time: 0.463586 Sep 10 10:35:31.135214 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 203/440] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:30 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:31.144968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-813c10af-269b-446a-ad8d-5deabbfafd4b tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf037820>, body: {"quota_set": {"ram": "5120"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:31.158753 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0549774e-0b9a-494c-b18d-b6338ca62da6 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/21633214" status: 202 len: 0 microversion: 2.1 time: 0.050881 Sep 10 10:35:31.163903 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 238/441] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:31 2022] DELETE /compute/v2.1/flavors/21633214 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:31.177561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bbf53bf0-d84e-448a-b25b-c2051634a7b9 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Calling method '.version_select at 0x7efcaf20eca0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.192267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbf53bf0-d84e-448a-b25b-c2051634a7b9 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:31.192829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbf53bf0-d84e-448a-b25b-c2051634a7b9 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:31.193244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbf53bf0-d84e-448a-b25b-c2051634a7b9 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:31.243201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbf53bf0-d84e-448a-b25b-c2051634a7b9 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:31.243920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbf53bf0-d84e-448a-b25b-c2051634a7b9 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:31.244380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbf53bf0-d84e-448a-b25b-c2051634a7b9 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:31.267768 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bbf53bf0-d84e-448a-b25b-c2051634a7b9 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h1-856894-1" status: 200 len: 467 microversion: 2.1 time: 0.102732 Sep 10 10:35:31.269146 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 239/442] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Sep 10 10:35:31 2022] GET /compute/v2.1/os-hosts/n-h1-856894-1 => generated 467 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:31.281467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-761e1b6b-3951-4d9d-9125-97f8ad23c18c tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.314317 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-761e1b6b-3951-4d9d-9125-97f8ad23c18c tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.042264 Sep 10 10:35:31.328279 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 240/443] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:31 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:31.341381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e00df42f-875f-4166-99c3-77c0fcc6dd78 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Calling method '.version_select at 0x7efcaf2f29d0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.354121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e00df42f-875f-4166-99c3-77c0fcc6dd78 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:31.355226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e00df42f-875f-4166-99c3-77c0fcc6dd78 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:31.355871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e00df42f-875f-4166-99c3-77c0fcc6dd78 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:31.369522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813c10af-269b-446a-ad8d-5deabbfafd4b tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:31.373362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813c10af-269b-446a-ad8d-5deabbfafd4b tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:31.374022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813c10af-269b-446a-ad8d-5deabbfafd4b tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:31.375015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813c10af-269b-446a-ad8d-5deabbfafd4b tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:31.375643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813c10af-269b-446a-ad8d-5deabbfafd4b tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:31.378454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813c10af-269b-446a-ad8d-5deabbfafd4b tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:31.383038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e00df42f-875f-4166-99c3-77c0fcc6dd78 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:31.383735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e00df42f-875f-4166-99c3-77c0fcc6dd78 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:31.384389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e00df42f-875f-4166-99c3-77c0fcc6dd78 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:31.418340 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e00df42f-875f-4166-99c3-77c0fcc6dd78 tempest-HostsAdminTestJSON-389991621 tempest-HostsAdminTestJSON-389991621-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h2-856894-1" status: 200 len: 598 microversion: 2.1 time: 0.080924 Sep 10 10:35:31.424228 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 241/444] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Sep 10 10:35:31 2022] GET /compute/v2.1/os-hosts/n-h2-856894-1 => generated 598 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:31.424889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-48ccb3a5-1d5e-42d2-8a3c-af82238a96b3 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2076214898", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:31.461208 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-48ccb3a5-1d5e-42d2-8a3c-af82238a96b3 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.040416 Sep 10 10:35:31.462372 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 242/445] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:31 2022] POST /compute/v2.1/flavors => generated 507 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:31.493595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8c62584e-2ab3-459e-bef7-06d3f1af70f9 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.526261 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8c62584e-2ab3-459e-bef7-06d3f1af70f9 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/31152d0d-9895-4608-9c36-32e4972ab6f5" status: 202 len: 0 microversion: 2.1 time: 0.055327 Sep 10 10:35:31.527961 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 243/446] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:35:31 2022] DELETE /compute/v2.1/flavors/31152d0d-9895-4608-9c36-32e4972ab6f5 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:31.531735 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-813c10af-269b-446a-ad8d-5deabbfafd4b tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/16a7f6dfe52340eda81bbafdf302d60d" status: 200 len: 328 microversion: 2.1 time: 0.394717 Sep 10 10:35:31.547687 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 204/447] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 10:35:31 2022] PUT /compute/v2.1/os-quota-sets/16a7f6dfe52340eda81bbafdf302d60d => generated 328 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:31.555550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-652bf0ce-33c4-4f0c-9078-98665edc581c tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.565013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21c8ba39-33c8-4742-b471-1a1f5a096f32 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Calling method '.version_select at 0x7efcaf175e50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.583683 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-652bf0ce-33c4-4f0c-9078-98665edc581c tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.049951 Sep 10 10:35:31.584564 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 244/448] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:31 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:31.610549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-47027eac-21b9-4e20-b8b1-99f7e40a7cc9 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-644045546", "id": "c86191f7-2c37-4cfb-826d-43a4b3d98a1d", "os-flavor-access:is_public": "True"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:31.648948 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-47027eac-21b9-4e20-b8b1-99f7e40a7cc9 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.043986 Sep 10 10:35:31.657822 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 245/449] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:31 2022] POST /compute/v2.1/flavors => generated 506 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:35:31.663421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d3a0f062-7838-456c-beaf-214d1173103e tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.720418 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d3a0f062-7838-456c-beaf-214d1173103e tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/c86191f7-2c37-4cfb-826d-43a4b3d98a1d" status: 202 len: 0 microversion: 2.1 time: 0.060757 Sep 10 10:35:31.724351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21c8ba39-33c8-4742-b471-1a1f5a096f32 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:31.724874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21c8ba39-33c8-4742-b471-1a1f5a096f32 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:31.726155 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 246/450] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:35:31 2022] DELETE /compute/v2.1/flavors/c86191f7-2c37-4cfb-826d-43a4b3d98a1d => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:31.726360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21c8ba39-33c8-4742-b471-1a1f5a096f32 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:31.727333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21c8ba39-33c8-4742-b471-1a1f5a096f32 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:31.730304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21c8ba39-33c8-4742-b471-1a1f5a096f32 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:31.732439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6d885908-3fdc-4887-a7f1-d6a449f83366 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.732626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21c8ba39-33c8-4742-b471-1a1f5a096f32 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:31.777197 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21c8ba39-33c8-4742-b471-1a1f5a096f32 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/16a7f6dfe52340eda81bbafdf302d60d/detail" status: 200 len: 916 microversion: 2.1 time: 0.220981 Sep 10 10:35:31.780085 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 205/451] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:35:31 2022] GET /compute/v2.1/os-quota-sets/16a7f6dfe52340eda81bbafdf302d60d/detail => generated 916 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:31.788034 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6d885908-3fdc-4887-a7f1-d6a449f83366 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.060699 Sep 10 10:35:31.797779 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 247/452] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:31 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:31.812706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9207b799-39e8-4edd-a24d-b3c81c6063fd tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-547443334", "id": 833747722, "os-flavor-access:is_public": "True"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:31.844351 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9207b799-39e8-4edd-a24d-b3c81c6063fd tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.035960 Sep 10 10:35:31.846349 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 206/453] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:31 2022] POST /compute/v2.1/flavors => generated 410 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:31.860344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b69821ef-49db-49b4-8535-348586f6f42b tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.870367 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b69821ef-49db-49b4-8535-348586f6f42b tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/833747722" status: 200 len: 410 microversion: 2.1 time: 0.014780 Sep 10 10:35:31.871214 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 248/454] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:35:31 2022] GET /compute/v2.1/flavors/833747722 => generated 410 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:31.993534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-91b64acc-a7d0-402c-a61f-739d057f6832 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:31.997041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-91b64acc-a7d0-402c-a61f-739d057f6832 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:32.018232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b64acc-a7d0-402c-a61f-739d057f6832 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:32.019698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b64acc-a7d0-402c-a61f-739d057f6832 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:32.023402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b64acc-a7d0-402c-a61f-739d057f6832 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:32.026875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b64acc-a7d0-402c-a61f-739d057f6832 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:32.031151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b64acc-a7d0-402c-a61f-739d057f6832 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:32.036595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b64acc-a7d0-402c-a61f-739d057f6832 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:32.394207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-91b64acc-a7d0-402c-a61f-739d057f6832 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:32.409683 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-91b64acc-a7d0-402c-a61f-739d057f6832 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1317 microversion: 2.1 time: 0.422640 Sep 10 10:35:32.410618 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 249/455] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:31 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:32.443411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c078cb1b-c5cc-4eff-81af-819816333a01 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:32.446102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c078cb1b-c5cc-4eff-81af-819816333a01 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:32.472508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c078cb1b-c5cc-4eff-81af-819816333a01 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:32.473119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c078cb1b-c5cc-4eff-81af-819816333a01 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:32.473570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c078cb1b-c5cc-4eff-81af-819816333a01 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:32.480848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c078cb1b-c5cc-4eff-81af-819816333a01 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:32.481580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c078cb1b-c5cc-4eff-81af-819816333a01 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:32.482027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c078cb1b-c5cc-4eff-81af-819816333a01 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:32.485241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3996ca37-30c3-4964-a843-33f47ffef3a4 tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:32.565248 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3996ca37-30c3-4964-a843-33f47ffef3a4 tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.684856 Sep 10 10:35:32.585843 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 207/456] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:31 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:32.602529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d41c905-830f-4f6e-8898-16e692b78b04 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:32.645817 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d41c905-830f-4f6e-8898-16e692b78b04 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/833747722" status: 202 len: 0 microversion: 2.1 time: 0.046834 Sep 10 10:35:32.646404 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 208/457] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:35:32 2022] DELETE /compute/v2.1/flavors/833747722 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:35:32.656098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5dba9883-5fb3-4d6c-be18-6d3d0c2a2539 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:32.710244 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5dba9883-5fb3-4d6c-be18-6d3d0c2a2539 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.058267 Sep 10 10:35:32.722188 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 209/458] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:32 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:32.738377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf101a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:32.916862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c078cb1b-c5cc-4eff-81af-819816333a01 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:32.927417 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c078cb1b-c5cc-4eff-81af-819816333a01 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1316 microversion: 2.1 time: 0.500122 Sep 10 10:35:32.928004 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 250/459] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:32 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:32.966364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-07ba6868-9aff-4735-b1ab-347aba729d51 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-73024004", "id": 1554667936, "os-flavor-access:is_public": "False"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:33.010210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:33.010871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:33.011378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:33.012181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:33.013438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:33.013861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:33.019554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:33.044030 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-07ba6868-9aff-4735-b1ab-347aba729d51 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.093953 Sep 10 10:35:33.063894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:33.064392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:33.064796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:33.065559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:33.068962 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 251/460] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:32 2022] POST /compute/v2.1/flavors => generated 428 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:33.073853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:33.074502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:33.094459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-81bb9342-dad5-4d6d-9a0d-39f8d6cdb3bb req-ef0e2a87-d8f8-487a-b2e7-2c87cc5d1905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c8aaac-8fb1-4334-a972-492a119fc8d5", "name": "network-vif-plugged", "status": "completed", "tag": "0269a13f-cff8-4c12-b6cc-739e948a57b0"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:33.125303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-81bb9342-dad5-4d6d-9a0d-39f8d6cdb3bb req-ef0e2a87-d8f8-487a-b2e7-2c87cc5d1905 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:33.126072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-81bb9342-dad5-4d6d-9a0d-39f8d6cdb3bb req-ef0e2a87-d8f8-487a-b2e7-2c87cc5d1905 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:33.127855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-81bb9342-dad5-4d6d-9a0d-39f8d6cdb3bb req-ef0e2a87-d8f8-487a-b2e7-2c87cc5d1905 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:33.153238 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-81bb9342-dad5-4d6d-9a0d-39f8d6cdb3bb req-ef0e2a87-d8f8-487a-b2e7-2c87cc5d1905 service nova] Creating event network-vif-plugged:0269a13f-cff8-4c12-b6cc-739e948a57b0 for instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 on n-h1-856894-1 Sep 10 10:35:33.175142 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-81bb9342-dad5-4d6d-9a0d-39f8d6cdb3bb req-ef0e2a87-d8f8-487a-b2e7-2c87cc5d1905 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104030 Sep 10 10:35:33.180174 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 252/461] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:33.184213 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7cc40d12-67c6-498f-b77c-78617933412c tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/16a7f6dfe52340eda81bbafdf302d60d?user_id=6bf0cccd86c349609f88407f725356e2" status: 200 len: 328 microversion: 2.1 time: 0.460423 Sep 10 10:35:33.189009 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 210/462] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 10:35:32 2022] PUT /compute/v2.1/os-quota-sets/16a7f6dfe52340eda81bbafdf302d60d?user_id=6bf0cccd86c349609f88407f725356e2 => generated 328 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:33.196103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e9718e5-4e23-4b26-84bf-d6a0f8fde2bf tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "1554667936"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:33.200787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b86fe017-a77a-445b-8e6c-ce097d76d87d tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Calling method '.version_select at 0x7efcaf037af0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:33.222317 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-4e9718e5-4e23-4b26-84bf-d6a0f8fde2bf tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] HTTP exception thrown: Flavor 1554667936 could not be found. Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e9718e5-4e23-4b26-84bf-d6a0f8fde2bf tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] Request method failure captured: Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 107 Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhuaVQjILwn6tZ9Dp_cDFST7E_nU8-T9jGtnynctUiIdzhE1fHS3IfHTq7Van2Y7GLaWrIk9ghmGT6D04ieS3ftB0vSYGczuI2S5zKNw9vzVBW8oNAmq2zwljFRffMUtnJxBM4n3u4PfyM2xM7dEeP-TrzObmfRfm9Oew6067bx68k Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: ae4b737efffc4880857715066e11bcc4 Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FlavorsAdminTestJSON-515149366 Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:35:33.224914 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae4b737efffc4880857715066e11bcc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae4b737efffc4880857715066e11bcc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae4b737efffc4880857715066e11bcc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae4b737efffc4880857715066e11bcc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FlavorsAdminTestJSON-515149366 Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: ae4b737efffc4880857715066e11bcc4 Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-515149366 Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FlavorsAdminTestJSON-515149366-project Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1920d7d0a0964415a7773b49761be0dd Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FlavorsAdminTestJSON-515149366-project Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "test", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "1554667936"}} Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:35:33.226597 n-d-856894-1 devstack@n-api.service[128787]: exception: Flavor 1554667936 could not be found. Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '1554667936'}}} Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1554667936 could not be found. Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:33.227403 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1554667936 could not be found. Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:33.229060 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:33.231744 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:33.231744 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:33.231744 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:33.231744 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1554667936 could not be found. Sep 10 10:35:33.231744 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:33.240440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e9718e5-4e23-4b26-84bf-d6a0f8fde2bf tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] Returning 400 to user: Flavor 1554667936 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:33.242096 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4e9718e5-4e23-4b26-84bf-d6a0f8fde2bf tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.060274 Sep 10 10:35:33.248374 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 253/463] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:33 2022] POST /compute/v2.1/servers => generated 81 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:35:33.264879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f27562d9-0ee7-4444-9f68-29293c95c08b tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:33.304801 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f27562d9-0ee7-4444-9f68-29293c95c08b tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1554667936" status: 202 len: 0 microversion: 2.1 time: 0.055166 Sep 10 10:35:33.318214 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 254/464] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:35:33 2022] DELETE /compute/v2.1/flavors/1554667936 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:33.326866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-35e502d5-35a9-4753-970d-44df5ed89b25 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:33.400981 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-35e502d5-35a9-4753-970d-44df5ed89b25 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.076577 Sep 10 10:35:33.412858 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 255/465] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:33 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:33.436507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ba44dbcf-bdf7-47b6-8b27-7a8cf62811d4 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1875601072", "id": 619243398, "os-flavor-access:is_public": "False"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:33.483661 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ba44dbcf-bdf7-47b6-8b27-7a8cf62811d4 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.056257 Sep 10 10:35:33.484403 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 256/466] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:33 2022] POST /compute/v2.1/flavors => generated 412 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:33.502520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ae5d7d73-e9a8-42a3-935f-65159fa7358b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:33.518537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ae5d7d73-e9a8-42a3-935f-65159fa7358b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:33.529956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae5d7d73-e9a8-42a3-935f-65159fa7358b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:33.530444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae5d7d73-e9a8-42a3-935f-65159fa7358b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:33.530871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae5d7d73-e9a8-42a3-935f-65159fa7358b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:33.531822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae5d7d73-e9a8-42a3-935f-65159fa7358b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:33.532287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae5d7d73-e9a8-42a3-935f-65159fa7358b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:33.532691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae5d7d73-e9a8-42a3-935f-65159fa7358b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:33.713910 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b86fe017-a77a-445b-8e6c-ce097d76d87d tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/16a7f6dfe52340eda81bbafdf302d60d?user_id=6bf0cccd86c349609f88407f725356e2" status: 200 len: 370 microversion: 2.1 time: 0.518487 Sep 10 10:35:33.724706 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 211/467] 10.222.0.20 () {58 vars in 1323 bytes} [Sat Sep 10 10:35:33 2022] GET /compute/v2.1/os-quota-sets/16a7f6dfe52340eda81bbafdf302d60d?user_id=6bf0cccd86c349609f88407f725356e2 => generated 370 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:35:33.742844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f772babf-fc96-430d-a6a8-6026ed976600 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-420823560", "id": 1151477953, "os-flavor-access:is_public": "True"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:33.775738 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f772babf-fc96-430d-a6a8-6026ed976600 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.046902 Sep 10 10:35:33.782123 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 212/468] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:33 2022] POST /compute/v2.1/flavors => generated 413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:33.812301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d12ea8ee-1bdf-495b-bd85-77f43703ed86 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:33.851805 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d12ea8ee-1bdf-495b-bd85-77f43703ed86 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.054534 Sep 10 10:35:33.855160 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 213/469] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Sep 10 10:35:33 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:33.869577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-411b35c8-c0ee-44f7-b5a6-801139bcdc14 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:33.888546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-411b35c8-c0ee-44f7-b5a6-801139bcdc14 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.023053 Sep 10 10:35:33.893351 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 214/470] 10.222.0.20 () {58 vars in 1177 bytes} [Sat Sep 10 10:35:33 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:33.909185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8424f28-9cc9-44d7-8888-cf81abb77963 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:33.918169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ae5d7d73-e9a8-42a3-935f-65159fa7358b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:33.932595 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8424f28-9cc9-44d7-8888-cf81abb77963 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.029786 Sep 10 10:35:33.935149 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 215/471] 10.222.0.20 () {58 vars in 1171 bytes} [Sat Sep 10 10:35:33 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:33.939159 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ae5d7d73-e9a8-42a3-935f-65159fa7358b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1317 microversion: 2.1 time: 0.452356 Sep 10 10:35:33.950334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2f83e7b-46a5-4bbb-ab1e-c7fe096cd3ad tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:33.958862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:33.959047 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 257/472] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:33 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:33.970206 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2f83e7b-46a5-4bbb-ab1e-c7fe096cd3ad tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.026528 Sep 10 10:35:33.975621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6fc2f0ca-3f65-46f1-a7ab-9812cf019e27 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:33.976612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6fc2f0ca-3f65-46f1-a7ab-9812cf019e27 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:33.977451 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 216/473] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Sep 10 10:35:33 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:33.988475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fc2f0ca-3f65-46f1-a7ab-9812cf019e27 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:33.989299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fc2f0ca-3f65-46f1-a7ab-9812cf019e27 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:33.989989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fc2f0ca-3f65-46f1-a7ab-9812cf019e27 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:33.991918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fc2f0ca-3f65-46f1-a7ab-9812cf019e27 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:33.992653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fc2f0ca-3f65-46f1-a7ab-9812cf019e27 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:33.993443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fc2f0ca-3f65-46f1-a7ab-9812cf019e27 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:33.994383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd32f645-eb01-4c89-a80a-2d638065bc71 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.066858 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd32f645-eb01-4c89-a80a-2d638065bc71 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6224 microversion: 2.1 time: 0.076541 Sep 10 10:35:34.071906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 217/474] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Sep 10 10:35:33 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:34.099847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-327415b5-a754-472b-8131-134e0477a781 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.139793 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-327415b5-a754-472b-8131-134e0477a781 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6224 microversion: 2.1 time: 0.052644 Sep 10 10:35:34.141566 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 218/475] 10.222.0.20 () {58 vars in 1175 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6224 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:34.165752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94743f38-93ae-4b6b-95c1-4955bb9fdf24 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.196566 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94743f38-93ae-4b6b-95c1-4955bb9fdf24 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6224 microversion: 2.1 time: 0.035910 Sep 10 10:35:34.197590 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 219/476] 10.222.0.20 () {58 vars in 1173 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6224 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:34.223386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b73b053-195b-40a0-8c60-06280664b5e6 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.255151 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b73b053-195b-40a0-8c60-06280664b5e6 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6224 microversion: 2.1 time: 0.037588 Sep 10 10:35:34.256085 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 220/477] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6224 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:34.276401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80ae7891-deb0-46e1-97f7-1eac2b6d6347 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.298074 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80ae7891-deb0-46e1-97f7-1eac2b6d6347 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1151477953" status: 202 len: 0 microversion: 2.1 time: 0.026055 Sep 10 10:35:34.301114 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 221/478] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:35:34 2022] DELETE /compute/v2.1/flavors/1151477953 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:35:34.307292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6fc2f0ca-3f65-46f1-a7ab-9812cf019e27 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:34.313055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3cb2da1-eb3c-4562-a17a-7b6bb151623a tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.321296 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6fc2f0ca-3f65-46f1-a7ab-9812cf019e27 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1316 microversion: 2.1 time: 0.360927 Sep 10 10:35:34.321910 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 258/479] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:33 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:34.341291 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3cb2da1-eb3c-4562-a17a-7b6bb151623a tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.035183 Sep 10 10:35:34.355058 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 222/480] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:34.362595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-de6e381c-62aa-4ca2-a2a0-9bcfb5174711 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.408930 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-de6e381c-62aa-4ca2-a2a0-9bcfb5174711 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/619243398" status: 202 len: 0 microversion: 2.1 time: 0.050127 Sep 10 10:35:34.409803 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 259/481] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:35:34 2022] DELETE /compute/v2.1/flavors/619243398 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:34.419606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af5da640-e7c5-4b4a-b6d0-59cce89c9af2 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.470897 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af5da640-e7c5-4b4a-b6d0-59cce89c9af2 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.055800 Sep 10 10:35:34.472732 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 223/482] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:34.498876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-104a9ffb-7bfe-4710-beba-b536d5101c77 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1662370521", "id": 1736813746, "os-flavor-access:is_public": "False"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:34.530667 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-104a9ffb-7bfe-4710-beba-b536d5101c77 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.037965 Sep 10 10:35:34.537135 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 260/483] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:34 2022] POST /compute/v2.1/flavors => generated 415 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:34.546470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6d0db99-a4b1-4e30-8348-f217f66137ff tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.600103 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c6d0db99-a4b1-4e30-8348-f217f66137ff tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.058193 Sep 10 10:35:34.601159 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 224/484] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:34.620828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d6046870-e15c-44a8-9b0d-883bbc4f8047 tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.663787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-510c3754-07ef-42da-993a-a734f1da1fd4 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Calling method '.version_select at 0x7efcaf1754c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.678723 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d6046870-e15c-44a8-9b0d-883bbc4f8047 tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.062544 Sep 10 10:35:34.679333 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 261/485] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:34.709502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0e89c54a-aeb0-4e73-99a4-c557bfcf123a tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.737336 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0e89c54a-aeb0-4e73-99a4-c557bfcf123a tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1736813746" status: 202 len: 0 microversion: 2.1 time: 0.032064 Sep 10 10:35:34.743267 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 262/486] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:35:34 2022] DELETE /compute/v2.1/flavors/1736813746 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:35:34.751716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2152b3f5-db45-4f73-88d1-1dae32be812d tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.800637 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2152b3f5-db45-4f73-88d1-1dae32be812d tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.055707 Sep 10 10:35:34.801585 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 263/487] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:34.823802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-92797756-09fc-4a80-bffb-e082452f2376 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1629393698", "id": 1183277612, "os-flavor-access:is_public": "True"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:34.852530 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-92797756-09fc-4a80-bffb-e082452f2376 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033234 Sep 10 10:35:34.862084 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 264/488] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:34 2022] POST /compute/v2.1/flavors => generated 414 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:34.884503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9b5a2b34-9ead-40e8-9cf2-e6106fd32451 tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.916249 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9b5a2b34-9ead-40e8-9cf2-e6106fd32451 tempest-FlavorsAdminTestJSON-515149366 tempest-FlavorsAdminTestJSON-515149366-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.048221 Sep 10 10:35:34.926378 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 265/489] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:34.946087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e50f8934-c849-4a8b-9e62-425500af9bbf tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.982029 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e50f8934-c849-4a8b-9e62-425500af9bbf tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1183277612" status: 202 len: 0 microversion: 2.1 time: 0.047101 Sep 10 10:35:34.983315 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 266/490] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:35:34 2022] DELETE /compute/v2.1/flavors/1183277612 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:35:34.989793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-08a66689-717e-45ea-a56d-dfdb08e025e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:34.991896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-08a66689-717e-45ea-a56d-dfdb08e025e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:35.001751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08a66689-717e-45ea-a56d-dfdb08e025e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:35.002362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08a66689-717e-45ea-a56d-dfdb08e025e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:35.002980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08a66689-717e-45ea-a56d-dfdb08e025e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:35.010700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08a66689-717e-45ea-a56d-dfdb08e025e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:35.011350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08a66689-717e-45ea-a56d-dfdb08e025e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:35.012090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08a66689-717e-45ea-a56d-dfdb08e025e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:35.241042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-08a66689-717e-45ea-a56d-dfdb08e025e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:35.260662 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-08a66689-717e-45ea-a56d-dfdb08e025e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1317 microversion: 2.1 time: 0.276026 Sep 10 10:35:35.284679 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 267/491] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:35.284679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9d51c759-9688-40b2-8e64-978047def247 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:35.317547 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9d51c759-9688-40b2-8e64-978047def247 tempest-FlavorsAdminTestJSON-617092603 tempest-FlavorsAdminTestJSON-617092603-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.049559 Sep 10 10:35:35.318245 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 268/492] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:35 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:35.323501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-09fcf247-f360-434d-813f-6157027da92a req-00c7ff63-df02-4bc0-9029-7407bc2bee61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52fb832d-13f8-4175-b047-fa651b9091da", "name": "network-vif-plugged", "status": "completed", "tag": "df07f796-7573-441a-8c41-4b9c692856f2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:35.338056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-09fcf247-f360-434d-813f-6157027da92a req-00c7ff63-df02-4bc0-9029-7407bc2bee61 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:35.338535 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-510c3754-07ef-42da-993a-a734f1da1fd4 tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/ae61738dc5b84158adbf697d491d8614/defaults" status: 200 len: 371 microversion: 2.1 time: 0.678385 Sep 10 10:35:35.339085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-09fcf247-f360-434d-813f-6157027da92a req-00c7ff63-df02-4bc0-9029-7407bc2bee61 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:35.339085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-09fcf247-f360-434d-813f-6157027da92a req-00c7ff63-df02-4bc0-9029-7407bc2bee61 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:35.341678 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 225/493] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:35:34 2022] GET /compute/v2.1/os-quota-sets/ae61738dc5b84158adbf697d491d8614/defaults => generated 371 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:35:35.355427 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-09fcf247-f360-434d-813f-6157027da92a req-00c7ff63-df02-4bc0-9029-7407bc2bee61 service nova] Creating event network-vif-plugged:df07f796-7573-441a-8c41-4b9c692856f2 for instance 52fb832d-13f8-4175-b047-fa651b9091da on n-h2-856894-1 Sep 10 10:35:35.358522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d5b6ed4f-9fad-4c4f-b947-92f6c83ca192 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:35.359143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d5b6ed4f-9fad-4c4f-b947-92f6c83ca192 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:35.361394 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-09fcf247-f360-434d-813f-6157027da92a req-00c7ff63-df02-4bc0-9029-7407bc2bee61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041731 Sep 10 10:35:35.362368 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 269/494] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:35.368512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-09d469d7-467f-4700-b686-532d0244234d tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf11a160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:35.389768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b6ed4f-9fad-4c4f-b947-92f6c83ca192 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:35.390274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b6ed4f-9fad-4c4f-b947-92f6c83ca192 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:35.390707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b6ed4f-9fad-4c4f-b947-92f6c83ca192 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:35.391565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b6ed4f-9fad-4c4f-b947-92f6c83ca192 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:35.392059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b6ed4f-9fad-4c4f-b947-92f6c83ca192 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:35.392493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b6ed4f-9fad-4c4f-b947-92f6c83ca192 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:35.827123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d5b6ed4f-9fad-4c4f-b947-92f6c83ca192 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:35.853699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d5b6ed4f-9fad-4c4f-b947-92f6c83ca192 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1465 microversion: 2.1 time: 0.507006 Sep 10 10:35:35.869116 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 226/495] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:35 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1465 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:35.889834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-114867651", "metadata": {"image_type": "test"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:35.892881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:35.918175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:35.918803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:35.922057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:35.922823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:35.923299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:35.923738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:36.052077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Getting quotas for project 3a85977a2f5a4870b65488cf83cce911. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:35:36.058052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Getting quotas for user 3ae584a919844c5584e066606c9efd36 and project 3a85977a2f5a4870b65488cf83cce911. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:35:36.578646 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c1afdfa-bab9-4c89-a6ac-4790fbd25f6c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "POST /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5/action" status: 202 len: 0 microversion: 2.1 time: 0.693631 Sep 10 10:35:36.603590 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 227/496] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:35:35 2022] POST /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 10 10:35:36.615302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-902e18c6-0177-4f6d-a862-41104cb4d053 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:36.616803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-902e18c6-0177-4f6d-a862-41104cb4d053 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:36.626546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=41 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:36.645506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09d469d7-467f-4700-b686-532d0244234d tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:36.647720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09d469d7-467f-4700-b686-532d0244234d tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:36.648184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09d469d7-467f-4700-b686-532d0244234d tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:36.648708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-902e18c6-0177-4f6d-a862-41104cb4d053 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:36.649459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-902e18c6-0177-4f6d-a862-41104cb4d053 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:36.651286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09d469d7-467f-4700-b686-532d0244234d tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:36.654309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-902e18c6-0177-4f6d-a862-41104cb4d053 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:36.654517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09d469d7-467f-4700-b686-532d0244234d tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:36.655014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09d469d7-467f-4700-b686-532d0244234d tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:36.658872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-902e18c6-0177-4f6d-a862-41104cb4d053 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:36.661654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-902e18c6-0177-4f6d-a862-41104cb4d053 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:36.662326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-902e18c6-0177-4f6d-a862-41104cb4d053 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:37.091385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-902e18c6-0177-4f6d-a862-41104cb4d053 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:37.107484 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-902e18c6-0177-4f6d-a862-41104cb4d053 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1317 microversion: 2.1 time: 0.499216 Sep 10 10:35:37.127475 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 228/497] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:36 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:37.140353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bbdfb81f-8e1d-478c-9c08-a2156736d8fd tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf06b550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:37.235941 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bbdfb81f-8e1d-478c-9c08-a2156736d8fd tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1423 microversion: 2.1 time: 0.107033 Sep 10 10:35:37.236780 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 229/498] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:37 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:37.257118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=12,nova_api:INSERT=17 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:37.282362 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-09d469d7-467f-4700-b686-532d0244234d tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/ae61738dc5b84158adbf697d491d8614" status: 200 len: 329 microversion: 2.1 time: 1.918743 Sep 10 10:35:37.283318 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 270/499] 10.222.0.20 () {60 vars in 1263 bytes} [Sat Sep 10 10:35:35 2022] PUT /compute/v2.1/os-quota-sets/ae61738dc5b84158adbf697d491d8614 => generated 329 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:37.300383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f5a8bc9-34d2-4b21-a812-d26c2c9bc28a tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf06b040>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:37.969769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5a8bc9-34d2-4b21-a812-d26c2c9bc28a tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:37.972661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5a8bc9-34d2-4b21-a812-d26c2c9bc28a tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:37.973801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5a8bc9-34d2-4b21-a812-d26c2c9bc28a tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:37.976998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5a8bc9-34d2-4b21-a812-d26c2c9bc28a tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:37.977923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5a8bc9-34d2-4b21-a812-d26c2c9bc28a tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:37.978847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5a8bc9-34d2-4b21-a812-d26c2c9bc28a tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:38.137922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7cee38b3-2296-46fc-8460-8c425131286a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:38.141337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7cee38b3-2296-46fc-8460-8c425131286a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:38.148309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cee38b3-2296-46fc-8460-8c425131286a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:38.148903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cee38b3-2296-46fc-8460-8c425131286a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:38.152552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cee38b3-2296-46fc-8460-8c425131286a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:38.153409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cee38b3-2296-46fc-8460-8c425131286a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:38.153885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cee38b3-2296-46fc-8460-8c425131286a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:38.154319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cee38b3-2296-46fc-8460-8c425131286a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:38.362839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7cee38b3-2296-46fc-8460-8c425131286a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:38.377982 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7cee38b3-2296-46fc-8460-8c425131286a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1466 microversion: 2.1 time: 0.246917 Sep 10 10:35:38.380803 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 271/500] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:38 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1466 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:38.403823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-62788979-1c65-4dcd-938f-1daae9657a47 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf11ac10>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:38.526416 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-62788979-1c65-4dcd-938f-1daae9657a47 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1423 microversion: 2.1 time: 0.143431 Sep 10 10:35:38.536317 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 272/501] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:38 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1423 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:38.728920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=3,nova_api:INSERT=14,nova_api:UPDATE=13 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:38.799785 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f5a8bc9-34d2-4b21-a812-d26c2c9bc28a tempest-QuotasAdminTestJSON-1490472767 tempest-QuotasAdminTestJSON-1490472767-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/ae61738dc5b84158adbf697d491d8614" status: 200 len: 329 microversion: 2.1 time: 1.504551 Sep 10 10:35:38.800848 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 230/502] 10.222.0.20 () {60 vars in 1263 bytes} [Sat Sep 10 10:35:37 2022] PUT /compute/v2.1/os-quota-sets/ae61738dc5b84158adbf697d491d8614 => generated 329 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:39.450915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d2761365-d4e4-4b38-8db4-5d27b86bfe82 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:39.451611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d2761365-d4e4-4b38-8db4-5d27b86bfe82 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:39.468388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2761365-d4e4-4b38-8db4-5d27b86bfe82 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:39.472272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2761365-d4e4-4b38-8db4-5d27b86bfe82 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:39.472754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2761365-d4e4-4b38-8db4-5d27b86bfe82 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:39.477865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2761365-d4e4-4b38-8db4-5d27b86bfe82 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:39.478360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2761365-d4e4-4b38-8db4-5d27b86bfe82 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:39.478806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2761365-d4e4-4b38-8db4-5d27b86bfe82 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:39.566064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:39.827093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-59ca8269-1604-437c-928c-314572460d90 tempest-QuotaClassesAdminTestJSON-1331889613 tempest-QuotaClassesAdminTestJSON-1331889613-project-admin] Calling method '.version_select at 0x7efcaf175f70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:39.842928 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-59ca8269-1604-437c-928c-314572460d90 tempest-QuotaClassesAdminTestJSON-1331889613 tempest-QuotaClassesAdminTestJSON-1331889613-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.990416 Sep 10 10:35:39.851695 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 231/503] 10.222.0.20 () {58 vars in 1185 bytes} [Sat Sep 10 10:35:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:39.859919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8dea2290-3a66-46bd-8d8b-64b301ee0434 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf0f73a0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:39.931414 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8dea2290-3a66-46bd-8d8b-64b301ee0434 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1423 microversion: 2.1 time: 0.078335 Sep 10 10:35:39.939609 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 232/504] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:39 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:39.952646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2484d60e-725a-43b8-bc1b-eb3ac55c10d3 tempest-QuotaClassesAdminTestJSON-1331889613 tempest-QuotaClassesAdminTestJSON-1331889613-project-admin] Action: 'update', calling method: .version_select at 0x7efcaef9f5e0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:40.378348 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d2761365-d4e4-4b38-8db4-5d27b86bfe82 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1617 microversion: 2.1 time: 1.840870 Sep 10 10:35:40.379347 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 273/505] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:38 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1617 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:40.416484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dae4d2d6-e776-4baf-96ee-c06234362086 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Action: 'create', calling method: .version_select at 0x7efcaf20e790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1899072953", "policies": ["affinity"]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:40.461346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-dae4d2d6-e776-4baf-96ee-c06234362086 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_groups'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:35:40.480178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-dae4d2d6-e776-4baf-96ee-c06234362086 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_groups'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:35:40.485827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=94,nova_cell0:UPDATE=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:40.702704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-dae4d2d6-e776-4baf-96ee-c06234362086 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_groups'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:35:40.724752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-dae4d2d6-e776-4baf-96ee-c06234362086 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_groups'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:35:40.754537 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2484d60e-725a-43b8-bc1b-eb3ac55c10d3 tempest-QuotaClassesAdminTestJSON-1331889613 tempest-QuotaClassesAdminTestJSON-1331889613-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.813742 Sep 10 10:35:40.763856 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 233/506] 10.222.0.20 () {60 vars in 1206 bytes} [Sat Sep 10 10:35:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:40.772508 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dae4d2d6-e776-4baf-96ee-c06234362086 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.361484 Sep 10 10:35:40.784461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f58a5180-a2c2-4412-a591-48de3bf200e3 tempest-QuotaClassesAdminTestJSON-1331889613 tempest-QuotaClassesAdminTestJSON-1331889613-project-admin] Calling method '.version_select at 0x7efcaf175430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:40.809610 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 274/507] 10.222.0.20 () {60 vars in 1174 bytes} [Sat Sep 10 10:35:40 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:40.831501 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f58a5180-a2c2-4412-a591-48de3bf200e3 tempest-QuotaClassesAdminTestJSON-1331889613 tempest-QuotaClassesAdminTestJSON-1331889613-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.064378 Sep 10 10:35:40.833499 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 234/508] 10.222.0.20 () {58 vars in 1185 bytes} [Sat Sep 10 10:35:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:40.848626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e4b30b79-f7f0-43c7-8d7b-f0a61d46df3e tempest-QuotaClassesAdminTestJSON-1331889613 tempest-QuotaClassesAdminTestJSON-1331889613-project-admin] Action: 'update', calling method: .version_select at 0x7efcaf11a040>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:40.960319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e6935df-cbb2-40fc-94a7-1aa11a6a91fd tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef9f310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:41.112967 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e6935df-cbb2-40fc-94a7-1aa11a6a91fd tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1423 microversion: 2.1 time: 0.156992 Sep 10 10:35:41.113689 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 235/509] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:40 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1423 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:35:41.166755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1323201246", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6dfe3f41-3da8-4d1a-a014-33a6ff7d285f"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:41.177788 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e4b30b79-f7f0-43c7-8d7b-f0a61d46df3e tempest-QuotaClassesAdminTestJSON-1331889613 tempest-QuotaClassesAdminTestJSON-1331889613-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.331489 Sep 10 10:35:41.186925 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 275/510] 10.222.0.20 () {60 vars in 1206 bytes} [Sat Sep 10 10:35:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:41.307013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:35:42.128888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-039803aa-30a7-4bd6-8ae7-87a421ce7539 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf1c3e50>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:42.245552 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-039803aa-30a7-4bd6-8ae7-87a421ce7539 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1423 microversion: 2.1 time: 0.120744 Sep 10 10:35:42.250264 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 276/511] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:42 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:43.115029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:35:43.116218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:35:43.117517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:35:43.118194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:35:43.118808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:35:43.208587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:43.210626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:43.211238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:43.212336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:43.213006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:43.213619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:43.251931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:35:43.259294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:35:43.272617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e139222-8494-41d4-bbb9-867db6d69460 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf148310>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:43.330493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Going to run 2 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:35:43.344187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c5b96b02-53dc-4c3b-9955-bab2ba5161fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:35:43.376239 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1e139222-8494-41d4-bbb9-867db6d69460 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1423 microversion: 2.1 time: 0.110354 Sep 10 10:35:43.389502 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 277/512] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:43 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1423 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:43.489670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128788) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 10 10:35:43.576702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:35:43.600225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:35:43.764396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:35:43.771943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:35:43.786321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=13,nova_api:INSERT=11 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:43.806679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=c5b96b02-53dc-4c3b-9955-bab2ba5161fc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:35:43.894493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:35:43.902529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:35:44.004648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:35:44.029203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:35:44.159823 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-369424c9-bea1-4590-b548-c2df660ad7d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.997465 Sep 10 10:35:44.160993 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 236/513] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 2999 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 10 10:35:44.184736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:44.212733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:44.215614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Searching by: {'deleted': False, 'project_id': '357ca1336b634d0389fff733e6e26ca0'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:35:44.302309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:44.310184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:44.316695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:44.318803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:44.322575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:44.323328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:44.403063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d9b41df-93a3-4228-8f38-08159c4eb33e tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef4b4c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:44.536524 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d9b41df-93a3-4228-8f38-08159c4eb33e tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1423 microversion: 2.1 time: 0.138122 Sep 10 10:35:44.537927 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 237/514] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:44 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1423 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:44.578945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:35:45.223875 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-52c8d66d-a566-4247-85d0-f048428f2359 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 1.041064 Sep 10 10:35:45.238444 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 278/515] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 10:35:44 2022] GET /compute/v2.1/servers => generated 1004 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:45.292409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e04d3f1-a2c5-4b43-b127-40c2b61c2a9c tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:45.299748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1e04d3f1-a2c5-4b43-b127-40c2b61c2a9c tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:45.301906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Calling method '.version_select at 0x7efcaef4bf70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:45.304350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:45.305107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:45.305768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:45.350767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:45.351362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:45.361662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:45.379624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:45.380333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:45.381701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:45.395101 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f3e8303-7bf5-4cd4-b9bb-3a95dee09a55 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.468530 Sep 10 10:35:45.407294 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 238/516] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:45.738445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-661cce12-87f5-4bf0-b65a-c6c8d4d57890 tempest-HypervisorAdminNegativeUnderV252Test-108315719 tempest-HypervisorAdminNegativeUnderV252Test-108315719-project] Calling method '.version_select at 0x7efcaefb0b80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:45.740612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-661cce12-87f5-4bf0-b65a-c6c8d4d57890 tempest-HypervisorAdminNegativeUnderV252Test-108315719 tempest-HypervisorAdminNegativeUnderV252Test-108315719-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '37611adeb988481da50eb47ca87aed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730fd1e1f3c74cdf93cfb58c800f8e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-661cce12-87f5-4bf0-b65a-c6c8d4d57890 tempest-HypervisorAdminNegativeUnderV252Test-108315719 tempest-HypervisorAdminNegativeUnderV252Test-108315719-project] Request method failure captured: Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-hypervisors/n-h1-856894-1/search HTTP/1.1 Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGh-z-5OtGAMU6ike9ehUx5fC-qrPgYY7O3ULgjgXtrpniNZLCOxXvLcPK63C_ciJyR_VqQrJ34OK1pHV20KbahZhiimSfJJYCqR9oPnKbWvZ6gPas-eh_XryFwqLkkui0_8Nc7wWQR3R9-nYy00MqeyD8LZ8SzPZ2ncCTC8rMXU5HE Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 730fd1e1f3c74cdf93cfb58c800f8e0f Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-108315719 Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:35:45.742565 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/730fd1e1f3c74cdf93cfb58c800f8e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/730fd1e1f3c74cdf93cfb58c800f8e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/730fd1e1f3c74cdf93cfb58c800f8e0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_730fd1e1f3c74cdf93cfb58c800f8e0f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-108315719 Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 730fd1e1f3c74cdf93cfb58c800f8e0f Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-108315719 Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-108315719-project Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 37611adeb988481da50eb47ca87aed07 Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-108315719-project Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 10 10:35:45.743842 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'n-h1-856894-1'} Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:45.744597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 10 10:35:45.745762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:45.760672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1e04d3f1-a2c5-4b43-b127-40c2b61c2a9c tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:45.767456 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1e04d3f1-a2c5-4b43-b127-40c2b61c2a9c tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1219 microversion: 2.1 time: 0.511851 Sep 10 10:35:45.777375 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 279/517] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:45 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1219 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:45.805957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8ca18b6c-8338-463b-85fd-38578ddc4180 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf0f03a0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:45.840388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-661cce12-87f5-4bf0-b65a-c6c8d4d57890 tempest-HypervisorAdminNegativeUnderV252Test-108315719 tempest-HypervisorAdminNegativeUnderV252Test-108315719-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:45.844038 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-661cce12-87f5-4bf0-b65a-c6c8d4d57890 tempest-HypervisorAdminNegativeUnderV252Test-108315719 tempest-HypervisorAdminNegativeUnderV252Test-108315719-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-856894-1/search" status: 403 len: 117 microversion: 2.1 time: 0.429442 Sep 10 10:35:45.853337 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 239/518] 10.222.0.20 () {58 vars in 1209 bytes} [Sat Sep 10 10:35:45 2022] GET /compute/v2.1/os-hypervisors/n-h1-856894-1/search => generated 117 bytes in 440 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:35:45.883354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86da3042-79b0-4e73-a906-21123dede5f1 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Calling method '.version_select at 0x7efcaef6c9d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:45.885171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86da3042-79b0-4e73-a906-21123dede5f1 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:45.885654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86da3042-79b0-4e73-a906-21123dede5f1 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:45.886109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86da3042-79b0-4e73-a906-21123dede5f1 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:45.897867 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8ca18b6c-8338-463b-85fd-38578ddc4180 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1423 microversion: 2.1 time: 0.118942 Sep 10 10:35:45.903007 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 280/519] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:45 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1423 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:45.965001 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-86da3042-79b0-4e73-a906-21123dede5f1 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86da3042-79b0-4e73-a906-21123dede5f1 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Request method failure captured: Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiAxhrUrBphpYcxdOhiNoIN9p65vymQdIWt4BpXEj0nz-KHYTOq2y7aP0adEU4tAyBxzcmYW8ByfcVncJbJGaGtl1H6Y6fuA4EOMAvGD90KVQ6M8cfzpSNG_wrg1jS57Z9ZmgRv0fTYYyfPMoR38kjuEHFgKjerB74V8MRdD5pBLt8 Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 33fa05224ceb4cf9b5f30c24ec7e62e6 Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1643517040 Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:35:45.966632 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/33fa05224ceb4cf9b5f30c24ec7e62e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/33fa05224ceb4cf9b5f30c24ec7e62e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/33fa05224ceb4cf9b5f30c24ec7e62e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_33fa05224ceb4cf9b5f30c24ec7e62e6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1643517040 Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 33fa05224ceb4cf9b5f30c24ec7e62e6 Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1643517040 Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 250134cd9a4b4022b2bf79dd574408be Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 10:35:45.968211 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:45.974569 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:45.977694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:45.977694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:45.977694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:45.977694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 10:35:45.977694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:45.977694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86da3042-79b0-4e73-a906-21123dede5f1 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:45.977694 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86da3042-79b0-4e73-a906-21123dede5f1 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.095275 Sep 10 10:35:45.983630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Calling method '.version_select at 0x7efcaf0f0670>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:45.985588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:45.986784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:45.987568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:45.988011 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 240/520] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Sep 10 10:35:45 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:46.044786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:46.051983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:46.055200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:46.086715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:46.087753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:46.090113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:46.106650 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a8c5b71c-85c6-48d8-a346-9655283a9f65 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.127343 Sep 10 10:35:46.108162 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 281/521] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:35:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:35:46.129467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d37506eb-5f72-4e6f-a0e9-4004b23fe803 tempest-HypervisorAdminNegativeUnderV252Test-108315719 tempest-HypervisorAdminNegativeUnderV252Test-108315719-project] Calling method '.version_select at 0x7efcaefb0f70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:46.131338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d37506eb-5f72-4e6f-a0e9-4004b23fe803 tempest-HypervisorAdminNegativeUnderV252Test-108315719 tempest-HypervisorAdminNegativeUnderV252Test-108315719-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '37611adeb988481da50eb47ca87aed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730fd1e1f3c74cdf93cfb58c800f8e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d37506eb-5f72-4e6f-a0e9-4004b23fe803 tempest-HypervisorAdminNegativeUnderV252Test-108315719 tempest-HypervisorAdminNegativeUnderV252Test-108315719-project] Request method failure captured: Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGh-z-5OtGAMU6ike9ehUx5fC-qrPgYY7O3ULgjgXtrpniNZLCOxXvLcPK63C_ciJyR_VqQrJ34OK1pHV20KbahZhiimSfJJYCqR9oPnKbWvZ6gPas-eh_XryFwqLkkui0_8Nc7wWQR3R9-nYy00MqeyD8LZ8SzPZ2ncCTC8rMXU5HE Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 730fd1e1f3c74cdf93cfb58c800f8e0f Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-108315719 Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:35:46.132907 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/730fd1e1f3c74cdf93cfb58c800f8e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/730fd1e1f3c74cdf93cfb58c800f8e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/730fd1e1f3c74cdf93cfb58c800f8e0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_730fd1e1f3c74cdf93cfb58c800f8e0f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-108315719 Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 730fd1e1f3c74cdf93cfb58c800f8e0f Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-108315719 Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-108315719-project Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 37611adeb988481da50eb47ca87aed07 Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-108315719-project Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 10 10:35:46.134328 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '1'} Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:35:46.135376 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 10 10:35:46.149358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:35:46.150658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d37506eb-5f72-4e6f-a0e9-4004b23fe803 tempest-HypervisorAdminNegativeUnderV252Test-108315719 tempest-HypervisorAdminNegativeUnderV252Test-108315719-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:46.150658 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d37506eb-5f72-4e6f-a0e9-4004b23fe803 tempest-HypervisorAdminNegativeUnderV252Test-108315719 tempest-HypervisorAdminNegativeUnderV252Test-108315719-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019502 Sep 10 10:35:46.150658 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 241/522] 10.222.0.20 () {58 vars in 1176 bytes} [Sat Sep 10 10:35:46 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:46.158365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-22030ffa-e9f8-438e-ae29-32b99d87e175 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Calling method '.version_select at 0x7efcaf2f2af0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:46.160095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22030ffa-e9f8-438e-ae29-32b99d87e175 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:46.161529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22030ffa-e9f8-438e-ae29-32b99d87e175 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:46.161529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22030ffa-e9f8-438e-ae29-32b99d87e175 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:46.190420 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-22030ffa-e9f8-438e-ae29-32b99d87e175 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] HTTP exception thrown: No hypervisor matching '5c87afb1-a0e9-43d9-98d8-b43f2d52521d' could be found. Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-22030ffa-e9f8-438e-ae29-32b99d87e175 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Request method failure captured: Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-hypervisors/5c87afb1-a0e9-43d9-98d8-b43f2d52521d/servers HTTP/1.1 Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGiAxhrUrBphpYcxdOhiNoIN9p65vymQdIWt4BpXEj0nz-KHYTOq2y7aP0adEU4tAyBxzcmYW8ByfcVncJbJGaGtl1H6Y6fuA4EOMAvGD90KVQ6M8cfzpSNG_wrg1jS57Z9ZmgRv0fTYYyfPMoR38kjuEHFgKjerB74V8MRdD5pBLt8 Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 33fa05224ceb4cf9b5f30c24ec7e62e6 Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1643517040 Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:35:46.191923 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/33fa05224ceb4cf9b5f30c24ec7e62e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/33fa05224ceb4cf9b5f30c24ec7e62e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/33fa05224ceb4cf9b5f30c24ec7e62e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_33fa05224ceb4cf9b5f30c24ec7e62e6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1643517040 Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 33fa05224ceb4cf9b5f30c24ec7e62e6 Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1643517040 Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 250134cd9a4b4022b2bf79dd574408be Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: exception: No hypervisor matching '5c87afb1-a0e9-43d9-98d8-b43f2d52521d' could be found. Sep 10 10:35:46.193386 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5c87afb1-a0e9-43d9-98d8-b43f2d52521d'} Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5c87afb1-a0e9-43d9-98d8-b43f2d52521d' could be found. Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:46.194199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:35:46.195508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:35:46.195508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:35:46.195508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:35:46.195508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:35:46.195508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5c87afb1-a0e9-43d9-98d8-b43f2d52521d' could be found. Sep 10 10:35:46.195508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:35:46.195508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-22030ffa-e9f8-438e-ae29-32b99d87e175 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] Returning 404 to user: No hypervisor matching '5c87afb1-a0e9-43d9-98d8-b43f2d52521d' could be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:35:46.207143 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-22030ffa-e9f8-438e-ae29-32b99d87e175 tempest-HypervisorAdminNegativeUnderV252Test-1643517040 tempest-HypervisorAdminNegativeUnderV252Test-1643517040-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/5c87afb1-a0e9-43d9-98d8-b43f2d52521d/servers" status: 404 len: 123 microversion: 2.1 time: 0.039187 Sep 10 10:35:46.210250 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 282/523] 10.222.0.20 () {58 vars in 1281 bytes} [Sat Sep 10 10:35:46 2022] GET /compute/v2.1/os-hypervisors/5c87afb1-a0e9-43d9-98d8-b43f2d52521d/servers => generated 123 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:35:46.800605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-160a6ba6-17d0-46cf-9530-690fad95daa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:46.802061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-160a6ba6-17d0-46cf-9530-690fad95daa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:46.916978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-37a4fe8c-f889-4922-a6ad-6089e4b65214 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf0f0b80>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:47.014325 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-37a4fe8c-f889-4922-a6ad-6089e4b65214 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1423 microversion: 2.1 time: 0.101553 Sep 10 10:35:47.021566 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 283/524] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:46 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:47.041129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-2eaf1000-892e-48cd-8969-362bf1e296a4 req-599ed04d-809e-4766-b9d0-8a1a12640a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c8aaac-8fb1-4334-a972-492a119fc8d5", "name": "network-vif-plugged", "status": "completed", "tag": "0269a13f-cff8-4c12-b6cc-739e948a57b0"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:47.107498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2eaf1000-892e-48cd-8969-362bf1e296a4 req-599ed04d-809e-4766-b9d0-8a1a12640a4f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:47.108051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2eaf1000-892e-48cd-8969-362bf1e296a4 req-599ed04d-809e-4766-b9d0-8a1a12640a4f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:47.108588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2eaf1000-892e-48cd-8969-362bf1e296a4 req-599ed04d-809e-4766-b9d0-8a1a12640a4f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:47.154062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-160a6ba6-17d0-46cf-9530-690fad95daa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:47.179686 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-160a6ba6-17d0-46cf-9530-690fad95daa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1219 microversion: 2.1 time: 0.374447 Sep 10 10:35:47.190218 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-2eaf1000-892e-48cd-8969-362bf1e296a4 req-599ed04d-809e-4766-b9d0-8a1a12640a4f service nova] Creating event network-vif-plugged:0269a13f-cff8-4c12-b6cc-739e948a57b0 for instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 on n-h1-856894-1 Sep 10 10:35:47.193488 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 242/525] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:46 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1219 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:47.236734 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-2eaf1000-892e-48cd-8969-362bf1e296a4 req-599ed04d-809e-4766-b9d0-8a1a12640a4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204446 Sep 10 10:35:47.248302 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 284/526] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:35:48.054454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f159aad5-d377-46fc-a316-1ec2e30fe617 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef6cee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:48.208526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8639aa14-cd2c-44f8-9eb5-c91daad3b297 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:48.209424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8639aa14-cd2c-44f8-9eb5-c91daad3b297 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:48.215825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8639aa14-cd2c-44f8-9eb5-c91daad3b297 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:48.225633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8639aa14-cd2c-44f8-9eb5-c91daad3b297 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:48.230086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8639aa14-cd2c-44f8-9eb5-c91daad3b297 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:48.235460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8639aa14-cd2c-44f8-9eb5-c91daad3b297 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:48.236102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8639aa14-cd2c-44f8-9eb5-c91daad3b297 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:48.239671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8639aa14-cd2c-44f8-9eb5-c91daad3b297 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:48.325273 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f159aad5-d377-46fc-a316-1ec2e30fe617 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1423 microversion: 2.1 time: 0.276081 Sep 10 10:35:48.334927 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 243/527] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:48 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1423 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:48.634087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8639aa14-cd2c-44f8-9eb5-c91daad3b297 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:48.647289 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8639aa14-cd2c-44f8-9eb5-c91daad3b297 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1215 microversion: 2.1 time: 0.442983 Sep 10 10:35:48.661862 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 285/528] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:48 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1215 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:49.346615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d309532c-bad5-4ed5-ac54-9c7971074c50 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef7e9d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:49.632230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b88863d2-0915-438c-a406-806e4f33ded7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:49.632875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b88863d2-0915-438c-a406-806e4f33ded7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:49.662646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b88863d2-0915-438c-a406-806e4f33ded7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:49.664710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b88863d2-0915-438c-a406-806e4f33ded7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:49.665537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b88863d2-0915-438c-a406-806e4f33ded7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:49.667648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b88863d2-0915-438c-a406-806e4f33ded7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:49.669771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b88863d2-0915-438c-a406-806e4f33ded7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:49.672755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b88863d2-0915-438c-a406-806e4f33ded7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:49.820823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b88863d2-0915-438c-a406-806e4f33ded7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:35:50.062217 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b88863d2-0915-438c-a406-806e4f33ded7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "DELETE /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 204 len: 0 microversion: 2.1 time: 0.434589 Sep 10 10:35:50.064917 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 286/529] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:35:49 2022] DELETE /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:35:50.082012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0df77e71-a2fe-498d-86b5-bb02cd35e6fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:35:50.084497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0df77e71-a2fe-498d-86b5-bb02cd35e6fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:35:50.124826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0df77e71-a2fe-498d-86b5-bb02cd35e6fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:50.125811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0df77e71-a2fe-498d-86b5-bb02cd35e6fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:50.127865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0df77e71-a2fe-498d-86b5-bb02cd35e6fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:50.128822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0df77e71-a2fe-498d-86b5-bb02cd35e6fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:35:50.131119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0df77e71-a2fe-498d-86b5-bb02cd35e6fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:35:50.132687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0df77e71-a2fe-498d-86b5-bb02cd35e6fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:35:50.322801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0df77e71-a2fe-498d-86b5-bb02cd35e6fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:35:50.334470 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0df77e71-a2fe-498d-86b5-bb02cd35e6fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1289 microversion: 2.1 time: 0.268157 Sep 10 10:35:50.335231 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 287/530] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:35:50 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1289 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:35:50.473475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-582700814", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "1817948937", "adminPass": "***", "networks": [{"uuid": "c2a9898f-5cdf-40ea-bbee-06d824e8c5d7"}], "security_groups": [{"name": "tempest-securitygroup--427678951"}], "key_name": "tempest-keypair-237547689", "user_data": "}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:35:53.231691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=15 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:54.477534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=16 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:55.756567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=45 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:55.936676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:56.826541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:35:57.159721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=31,nova_cell0:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:00.330658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:00.498868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2,nova_api:UPDATE=13 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:10.658273 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d309532c-bad5-4ed5-ac54-9c7971074c50 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1432 microversion: 2.1 time: 21.319567 Sep 10 10:36:10.676773 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 244/531] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:35:49 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1432 bytes in 21339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:10.681743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ced1006b-a96f-432f-8c52-293fd1aa39f6 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:10.711361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ced1006b-a96f-432f-8c52-293fd1aa39f6 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:10.733370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ced1006b-a96f-432f-8c52-293fd1aa39f6 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:10.733887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ced1006b-a96f-432f-8c52-293fd1aa39f6 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:10.734402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ced1006b-a96f-432f-8c52-293fd1aa39f6 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:10.735159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ced1006b-a96f-432f-8c52-293fd1aa39f6 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:10.743938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ced1006b-a96f-432f-8c52-293fd1aa39f6 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:10.746965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ced1006b-a96f-432f-8c52-293fd1aa39f6 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:10.754526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] validate_networks() for [('c2a9898f-5cdf-40ea-bbee-06d824e8c5d7', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:36:11.300930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ced1006b-a96f-432f-8c52-293fd1aa39f6 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:11.312841 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ced1006b-a96f-432f-8c52-293fd1aa39f6 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1319 microversion: 2.1 time: 0.634772 Sep 10 10:36:11.313395 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 245/532] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:10 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1319 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:11.635833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:36:11.638009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:36:11.639017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:36:11.639786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:36:11.640606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:36:11.674233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:11.679342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:11.680096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:11.681144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:11.681826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:11.688686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:11.773400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Getting quotas for project 66c9f6e01abe44fe91a53705322fd55f. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:11.791527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Getting quotas for user 7204a4162d974d978837f0605301a735 and project 66c9f6e01abe44fe91a53705322fd55f. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:11.829452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:36:11.835927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:36:11.951934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2104278938", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:11.985919 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4c170414-4104-42df-9f6d-d513cf2ae471 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 21.513775 Sep 10 10:36:11.995328 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 288/533] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:35:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 21527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:36:12.046278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-c6a55d56-36df-4ecb-ae7b-6b70da3b2db1 req-4ad0133a-f35a-4b50-821a-f0b273b1da15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066e1684-136a-40a9-90b1-dec10869b975", "name": "network-vif-deleted", "tag": "4a00ca77-e930-48ea-9732-09baa58dfd34"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:12.095628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c6a55d56-36df-4ecb-ae7b-6b70da3b2db1 req-4ad0133a-f35a-4b50-821a-f0b273b1da15 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:12.098044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c6a55d56-36df-4ecb-ae7b-6b70da3b2db1 req-4ad0133a-f35a-4b50-821a-f0b273b1da15 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:12.102224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c6a55d56-36df-4ecb-ae7b-6b70da3b2db1 req-4ad0133a-f35a-4b50-821a-f0b273b1da15 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:12.102382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:36:12.152131 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-c6a55d56-36df-4ecb-ae7b-6b70da3b2db1 req-4ad0133a-f35a-4b50-821a-f0b273b1da15 service nova] Creating event network-vif-deleted:4a00ca77-e930-48ea-9732-09baa58dfd34 for instance 066e1684-136a-40a9-90b1-dec10869b975 on n-h2-856894-1 Sep 10 10:36:12.171225 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-c6a55d56-36df-4ecb-ae7b-6b70da3b2db1 req-4ad0133a-f35a-4b50-821a-f0b273b1da15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173995 Sep 10 10:36:12.175345 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 289/534] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:12.560676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-984109985", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:12.724547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] validate_networks() for None {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:36:13.880399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:36:13.881163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:36:13.887299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:36:13.887821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:36:13.888236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:36:13.922536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:13.923398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:13.924012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:13.924969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:13.932050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:13.933645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:14.016101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Getting quotas for project ee9906c0571e482dbdfaf79228428a76. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:14.027907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Getting quotas for user d0796d5eeef94d4eb7d7f0a1e0490f01 and project ee9906c0571e482dbdfaf79228428a76. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:14.030551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:36:14.031079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:36:14.031442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:36:14.032113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:36:14.032517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:36:14.053781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:14.054274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:14.054713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:14.055434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:14.063034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:14.064788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:14.088796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:36:14.104485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:36:14.149805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Getting quotas for project 99bb8844a05f444d9debc0c5cfe6d32e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:14.171826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Getting quotas for user 7a5e475e6f334eaca29f1e114d1f06cb and project 99bb8844a05f444d9debc0c5cfe6d32e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:14.207269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:36:14.215399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:36:14.235768 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-82c334fb-7470-461a-929b-6c6659cd7ba2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.054945 Sep 10 10:36:14.245575 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 290/535] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:36:14.267144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6f3a990c-d1ba-4887-9c54-faf1935a7a30 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaefecb80>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:14.402741 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f57bb09-0ec7-4faa-b783-21c212f16e43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.087685 Sep 10 10:36:14.406207 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 246/536] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:36:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:36:14.417603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28b8ada3-816d-4f47-86cf-474d6b069119 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:14.420289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-28b8ada3-816d-4f47-86cf-474d6b069119 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:14.443014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28b8ada3-816d-4f47-86cf-474d6b069119 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:14.443499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28b8ada3-816d-4f47-86cf-474d6b069119 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:14.444034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28b8ada3-816d-4f47-86cf-474d6b069119 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:14.444628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28b8ada3-816d-4f47-86cf-474d6b069119 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:14.445095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28b8ada3-816d-4f47-86cf-474d6b069119 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:14.445529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28b8ada3-816d-4f47-86cf-474d6b069119 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:14.476671 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6f3a990c-d1ba-4887-9c54-faf1935a7a30 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 200 len: 1432 microversion: 2.1 time: 0.229095 Sep 10 10:36:14.482439 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 291/537] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:14 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 1432 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:14.497231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-066d353a-2ddf-4052-bdc0-cefb93d10edf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:14.499332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-066d353a-2ddf-4052-bdc0-cefb93d10edf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:14.529652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-066d353a-2ddf-4052-bdc0-cefb93d10edf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:14.531559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-066d353a-2ddf-4052-bdc0-cefb93d10edf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:14.532570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-066d353a-2ddf-4052-bdc0-cefb93d10edf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:14.534802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-066d353a-2ddf-4052-bdc0-cefb93d10edf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:14.535552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-066d353a-2ddf-4052-bdc0-cefb93d10edf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:14.542242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-066d353a-2ddf-4052-bdc0-cefb93d10edf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:14.626688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-28b8ada3-816d-4f47-86cf-474d6b069119 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:14.651214 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-28b8ada3-816d-4f47-86cf-474d6b069119 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1323 microversion: 2.1 time: 0.243418 Sep 10 10:36:14.651824 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 247/538] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:14 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1323 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:14.703221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2649df3e-4710-4330-a041-d86164c0a048 req-8b9388bc-f024-4478-9f98-7885d34ee40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b96b02-53dc-4c3b-9955-bab2ba5161fc", "tag": "cfb2f0a6-9704-4549-88b0-1a8eaae3dc8e"}, {"name": "network-changed", "server_uuid": "c11e0506-bd95-40ae-9f3b-0a504c02fbd7", "tag": "5e6172ec-9d0b-4969-b2c0-23558c7d02bf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:14.763599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2649df3e-4710-4330-a041-d86164c0a048 req-8b9388bc-f024-4478-9f98-7885d34ee40e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:14.767573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2649df3e-4710-4330-a041-d86164c0a048 req-8b9388bc-f024-4478-9f98-7885d34ee40e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:14.768307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2649df3e-4710-4330-a041-d86164c0a048 req-8b9388bc-f024-4478-9f98-7885d34ee40e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:14.828313 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2649df3e-4710-4330-a041-d86164c0a048 req-8b9388bc-f024-4478-9f98-7885d34ee40e service nova] Creating event network-changed:cfb2f0a6-9704-4549-88b0-1a8eaae3dc8e for instance c5b96b02-53dc-4c3b-9955-bab2ba5161fc on n-h1-856894-1 Sep 10 10:36:14.833464 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2649df3e-4710-4330-a041-d86164c0a048 req-8b9388bc-f024-4478-9f98-7885d34ee40e service nova] Creating event network-changed:5e6172ec-9d0b-4969-b2c0-23558c7d02bf for instance c11e0506-bd95-40ae-9f3b-0a504c02fbd7 on n-h1-856894-1 Sep 10 10:36:14.850455 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2649df3e-4710-4330-a041-d86164c0a048 req-8b9388bc-f024-4478-9f98-7885d34ee40e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.196735 Sep 10 10:36:14.857922 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 248/539] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:14.874174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57a1bd23-3db1-47e3-b1a2-04ac19b8be44 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:14.882721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57a1bd23-3db1-47e3-b1a2-04ac19b8be44 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:14.998175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-57a1bd23-3db1-47e3-b1a2-04ac19b8be44 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:15.006326 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57a1bd23-3db1-47e3-b1a2-04ac19b8be44 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1213 microversion: 2.1 time: 0.147122 Sep 10 10:36:15.010954 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 249/540] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:14 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:15.022469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f7715b1f-690c-40dd-af42-a0c1c89cec94 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:15.023899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f7715b1f-690c-40dd-af42-a0c1c89cec94 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:15.413269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f7715b1f-690c-40dd-af42-a0c1c89cec94 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:15.423236 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f7715b1f-690c-40dd-af42-a0c1c89cec94 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1222 microversion: 2.1 time: 0.409224 Sep 10 10:36:15.434160 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 250/541] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:15 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1222 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:15.441936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-61f0bfe8-e4b8-4df8-a312-ff05e8c2315a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:15.449847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-61f0bfe8-e4b8-4df8-a312-ff05e8c2315a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:15.463599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-066d353a-2ddf-4052-bdc0-cefb93d10edf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:15.474102 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-066d353a-2ddf-4052-bdc0-cefb93d10edf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1319 microversion: 2.1 time: 0.990109 Sep 10 10:36:15.476616 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 292/542] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:14 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1319 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:15.479852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61f0bfe8-e4b8-4df8-a312-ff05e8c2315a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:15.480394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61f0bfe8-e4b8-4df8-a312-ff05e8c2315a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:15.480841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61f0bfe8-e4b8-4df8-a312-ff05e8c2315a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:15.490527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61f0bfe8-e4b8-4df8-a312-ff05e8c2315a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:15.491024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61f0bfe8-e4b8-4df8-a312-ff05e8c2315a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:15.493613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61f0bfe8-e4b8-4df8-a312-ff05e8c2315a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:15.609149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-321419373", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "47147fcc-eb59-4f08-ae29-874c9998564e"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:15.766465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] validate_networks() for [('47147fcc-eb59-4f08-ae29-874c9998564e', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:36:15.879778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-61f0bfe8-e4b8-4df8-a312-ff05e8c2315a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:15.889022 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-61f0bfe8-e4b8-4df8-a312-ff05e8c2315a tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1465 microversion: 2.1 time: 0.453519 Sep 10 10:36:15.889644 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 251/543] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:15 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1465 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:15.912010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-effa4c9c-6c56-4dad-bc2e-bb472ba7ff1c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:15.912629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-effa4c9c-6c56-4dad-bc2e-bb472ba7ff1c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:15.940820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-effa4c9c-6c56-4dad-bc2e-bb472ba7ff1c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:15.941394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-effa4c9c-6c56-4dad-bc2e-bb472ba7ff1c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:15.942351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-effa4c9c-6c56-4dad-bc2e-bb472ba7ff1c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:15.943932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-effa4c9c-6c56-4dad-bc2e-bb472ba7ff1c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:15.944564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-effa4c9c-6c56-4dad-bc2e-bb472ba7ff1c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:15.945442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-effa4c9c-6c56-4dad-bc2e-bb472ba7ff1c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:16.170051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-effa4c9c-6c56-4dad-bc2e-bb472ba7ff1c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:16.185852 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-effa4c9c-6c56-4dad-bc2e-bb472ba7ff1c tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1321 microversion: 2.1 time: 0.277116 Sep 10 10:36:16.186705 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 252/544] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:15 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:16.192608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-03b6ee63-7f76-415e-a25f-75dce82e7f97 req-7a2332d2-520b-4b53-b0f1-3635a25292e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b96b02-53dc-4c3b-9955-bab2ba5161fc", "name": "network-vif-plugged", "status": "completed", "tag": "cfb2f0a6-9704-4549-88b0-1a8eaae3dc8e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:16.211230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-03b6ee63-7f76-415e-a25f-75dce82e7f97 req-7a2332d2-520b-4b53-b0f1-3635a25292e0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:16.212466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-03b6ee63-7f76-415e-a25f-75dce82e7f97 req-7a2332d2-520b-4b53-b0f1-3635a25292e0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:16.213056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-03b6ee63-7f76-415e-a25f-75dce82e7f97 req-7a2332d2-520b-4b53-b0f1-3635a25292e0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:16.278163 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-03b6ee63-7f76-415e-a25f-75dce82e7f97 req-7a2332d2-520b-4b53-b0f1-3635a25292e0 service nova] Creating event network-vif-plugged:cfb2f0a6-9704-4549-88b0-1a8eaae3dc8e for instance c5b96b02-53dc-4c3b-9955-bab2ba5161fc on n-h1-856894-1 Sep 10 10:36:16.288725 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-03b6ee63-7f76-415e-a25f-75dce82e7f97 req-7a2332d2-520b-4b53-b0f1-3635a25292e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099348 Sep 10 10:36:16.290609 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 253/545] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:16.296863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85cada9a-7d4b-40f8-ade3-c5459eba22ca tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf175ca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:16.397410 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85cada9a-7d4b-40f8-ade3-c5459eba22ca tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/df822980-bfab-4f6c-b4bc-2e31dca2c2a5" status: 200 len: 784 microversion: 2.1 time: 0.104843 Sep 10 10:36:16.398155 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 254/546] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:16 2022] GET /compute/v2.1/images/df822980-bfab-4f6c-b4bc-2e31dca2c2a5 => generated 784 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:16.414185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44829f18-6f80-40f9-a3ed-51b29d8fc99b tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:16.418537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-44829f18-6f80-40f9-a3ed-51b29d8fc99b tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:16.431535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44829f18-6f80-40f9-a3ed-51b29d8fc99b tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:16.432323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44829f18-6f80-40f9-a3ed-51b29d8fc99b tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:16.432970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44829f18-6f80-40f9-a3ed-51b29d8fc99b tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:16.433909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44829f18-6f80-40f9-a3ed-51b29d8fc99b tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:16.435098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44829f18-6f80-40f9-a3ed-51b29d8fc99b tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:16.435688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44829f18-6f80-40f9-a3ed-51b29d8fc99b tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:16.611715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44829f18-6f80-40f9-a3ed-51b29d8fc99b tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:16.633724 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-44829f18-6f80-40f9-a3ed-51b29d8fc99b tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1265 microversion: 2.1 time: 0.233288 Sep 10 10:36:16.636936 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 255/547] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:16 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:16.817664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b6fabb8-f275-4468-8eb4-ee8fb1d2c6de tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Action: 'create', calling method: .version_select at 0x7efcaef85310>, body: {"keypair": {"name": "tempest-keypair-1768219462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYBSRSJQ2Ethnm71mjQNPOplpBECzpkx7rNg+YSSxjxyfo8xj4d9WSBgoKFR3VYAFXiLi4xNhAnRwqo15gXA25dyEum9pnn9AzbpuZ8dkSccrXFJqxPT/2TAQ/Dl7fCyQ=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:16.851937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4b6fabb8-f275-4468-8eb4-ee8fb1d2c6de tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Getting quotas for project cabcfc642a0a420caa4515a42aace3f6. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:16.868872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4b6fabb8-f275-4468-8eb4-ee8fb1d2c6de tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Getting quotas for user 3a26238f6d374b9789bd97cb6906bd2c and project cabcfc642a0a420caa4515a42aace3f6. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:16.929366 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b6fabb8-f275-4468-8eb4-ee8fb1d2c6de tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.289299 Sep 10 10:36:16.930150 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 256/548] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:36:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:16.943838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7cb3dbc9-75b2-405e-a6bd-a88456d5fc23 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:16.968053 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7cb3dbc9-75b2-405e-a6bd-a88456d5fc23 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034473 Sep 10 10:36:16.970935 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 257/549] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:36:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:16.987175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f7b01e7f-baba-4c85-8988-e1a5203bbdc4 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:16.987942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f7b01e7f-baba-4c85-8988-e1a5203bbdc4 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:17.003404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7b01e7f-baba-4c85-8988-e1a5203bbdc4 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:17.005873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7b01e7f-baba-4c85-8988-e1a5203bbdc4 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:17.007221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7b01e7f-baba-4c85-8988-e1a5203bbdc4 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:17.009336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7b01e7f-baba-4c85-8988-e1a5203bbdc4 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:17.010554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7b01e7f-baba-4c85-8988-e1a5203bbdc4 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:17.012957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7b01e7f-baba-4c85-8988-e1a5203bbdc4 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:17.256241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f7b01e7f-baba-4c85-8988-e1a5203bbdc4 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:17.270033 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f7b01e7f-baba-4c85-8988-e1a5203bbdc4 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1274 microversion: 2.1 time: 0.297694 Sep 10 10:36:17.290342 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 258/550] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:16 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1274 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:17.297734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd6732bb-7ed0-4183-a044-8b49e7fe82b4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:17.307974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd6732bb-7ed0-4183-a044-8b49e7fe82b4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:17.317889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd6732bb-7ed0-4183-a044-8b49e7fe82b4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:17.327610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd6732bb-7ed0-4183-a044-8b49e7fe82b4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:17.328303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd6732bb-7ed0-4183-a044-8b49e7fe82b4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:17.329342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd6732bb-7ed0-4183-a044-8b49e7fe82b4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:17.330033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd6732bb-7ed0-4183-a044-8b49e7fe82b4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:17.330722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd6732bb-7ed0-4183-a044-8b49e7fe82b4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:17.663341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd6732bb-7ed0-4183-a044-8b49e7fe82b4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:17.673524 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd6732bb-7ed0-4183-a044-8b49e7fe82b4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1319 microversion: 2.1 time: 0.381864 Sep 10 10:36:17.674350 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 259/551] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:17 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:17.746853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ebc9edf7-0bab-4a23-9d11-181d4cc67cd4 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef6c310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:18.375693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:36:18.376801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:36:18.377660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:36:18.378575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:36:18.379145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:36:18.404021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:18.404596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:18.408845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:18.409741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:18.410392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:18.410901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:18.463983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Getting quotas for project 9c2ac1f5c5c843fc89294292d4489252. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:18.475661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Getting quotas for user 362b727b96934e58b180727eaad35e3b and project 9c2ac1f5c5c843fc89294292d4489252. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:18.551223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:36:18.561740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:36:18.644836 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8014b6b9-239a-4d77-b6b4-a82ce5a71fe3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.165953 Sep 10 10:36:18.653467 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 293/552] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:36:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3176 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 10:36:18.659717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-78de157f-2445-4ea0-bd7d-7f29c2acc8f3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:18.660580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-78de157f-2445-4ea0-bd7d-7f29c2acc8f3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:18.668971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78de157f-2445-4ea0-bd7d-7f29c2acc8f3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:18.669743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78de157f-2445-4ea0-bd7d-7f29c2acc8f3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:18.670358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78de157f-2445-4ea0-bd7d-7f29c2acc8f3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:18.671244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78de157f-2445-4ea0-bd7d-7f29c2acc8f3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:18.671850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78de157f-2445-4ea0-bd7d-7f29c2acc8f3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:18.672427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78de157f-2445-4ea0-bd7d-7f29c2acc8f3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:19.071312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ebc9edf7-0bab-4a23-9d11-181d4cc67cd4 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "DELETE /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 204 len: 0 microversion: 2.1 time: 1.395602 Sep 10 10:36:19.072091 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 260/553] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:17 2022] DELETE /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 0 bytes in 1397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:36:19.077861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-808a8ddc-84cd-4935-8eb0-081302ce56b2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:19.078816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-808a8ddc-84cd-4935-8eb0-081302ce56b2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:19.097683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-808a8ddc-84cd-4935-8eb0-081302ce56b2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:19.098188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-808a8ddc-84cd-4935-8eb0-081302ce56b2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:19.098637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-808a8ddc-84cd-4935-8eb0-081302ce56b2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:19.101305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-808a8ddc-84cd-4935-8eb0-081302ce56b2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:19.104930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-808a8ddc-84cd-4935-8eb0-081302ce56b2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:19.105409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-808a8ddc-84cd-4935-8eb0-081302ce56b2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:19.427085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78de157f-2445-4ea0-bd7d-7f29c2acc8f3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:19.449384 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-78de157f-2445-4ea0-bd7d-7f29c2acc8f3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1388 microversion: 2.1 time: 0.789920 Sep 10 10:36:19.451933 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 294/554] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:18 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1388 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:19.462790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ed8db48a-f36d-46b2-bdfc-44eac9653899 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:19.463731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ed8db48a-f36d-46b2-bdfc-44eac9653899 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:19.492711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed8db48a-f36d-46b2-bdfc-44eac9653899 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:19.493294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed8db48a-f36d-46b2-bdfc-44eac9653899 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:19.498031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed8db48a-f36d-46b2-bdfc-44eac9653899 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:19.499189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed8db48a-f36d-46b2-bdfc-44eac9653899 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:19.500240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed8db48a-f36d-46b2-bdfc-44eac9653899 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:19.500935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed8db48a-f36d-46b2-bdfc-44eac9653899 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:19.691543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ed8db48a-f36d-46b2-bdfc-44eac9653899 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:19.704890 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ed8db48a-f36d-46b2-bdfc-44eac9653899 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1280 microversion: 2.1 time: 0.251664 Sep 10 10:36:19.723465 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 295/555] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:19 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1280 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:19.728589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-dcb3ff61-6bed-490f-841c-dd85b05614d2 req-ee6eb75a-368b-4ab7-8308-4bff1cc59de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c8aaac-8fb1-4334-a972-492a119fc8d5", "name": "network-vif-unplugged", "status": "completed", "tag": "0269a13f-cff8-4c12-b6cc-739e948a57b0"}, {"server_uuid": "c11e0506-bd95-40ae-9f3b-0a504c02fbd7", "name": "network-vif-plugged", "status": "completed", "tag": "5e6172ec-9d0b-4969-b2c0-23558c7d02bf"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:19.749000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-dcb3ff61-6bed-490f-841c-dd85b05614d2 req-ee6eb75a-368b-4ab7-8308-4bff1cc59de8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:19.749732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-dcb3ff61-6bed-490f-841c-dd85b05614d2 req-ee6eb75a-368b-4ab7-8308-4bff1cc59de8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:19.750338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-dcb3ff61-6bed-490f-841c-dd85b05614d2 req-ee6eb75a-368b-4ab7-8308-4bff1cc59de8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:19.774096 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-dcb3ff61-6bed-490f-841c-dd85b05614d2 req-ee6eb75a-368b-4ab7-8308-4bff1cc59de8 service nova] Creating event network-vif-unplugged:0269a13f-cff8-4c12-b6cc-739e948a57b0 for instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 on n-h1-856894-1 Sep 10 10:36:19.775944 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-dcb3ff61-6bed-490f-841c-dd85b05614d2 req-ee6eb75a-368b-4ab7-8308-4bff1cc59de8 service nova] Creating event network-vif-plugged:5e6172ec-9d0b-4969-b2c0-23558c7d02bf for instance c11e0506-bd95-40ae-9f3b-0a504c02fbd7 on n-h1-856894-1 Sep 10 10:36:19.790376 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-dcb3ff61-6bed-490f-841c-dd85b05614d2 req-ee6eb75a-368b-4ab7-8308-4bff1cc59de8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.064975 Sep 10 10:36:19.791672 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 296/556] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:19.799201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:19.800255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:19.811644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:19.813252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:19.813930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:19.814889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:19.815589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:19.816245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:19.923305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:19.939373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:19.942618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:19.945378 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c5da06e8-fe44-4c04-b19c-e4644083616a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1257 microversion: 2.25 time: 0.152209 Sep 10 10:36:19.947151 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 297/557] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:19 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:19.958615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b840fb40-e3a7-4dae-8b08-2f9f2d20f166 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:19.959495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b840fb40-e3a7-4dae-8b08-2f9f2d20f166 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:19.979362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b840fb40-e3a7-4dae-8b08-2f9f2d20f166 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:19.979886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b840fb40-e3a7-4dae-8b08-2f9f2d20f166 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:19.980847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b840fb40-e3a7-4dae-8b08-2f9f2d20f166 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:19.984862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b840fb40-e3a7-4dae-8b08-2f9f2d20f166 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:19.985378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b840fb40-e3a7-4dae-8b08-2f9f2d20f166 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:19.986678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b840fb40-e3a7-4dae-8b08-2f9f2d20f166 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:20.022176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-808a8ddc-84cd-4935-8eb0-081302ce56b2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:20.032204 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-808a8ddc-84cd-4935-8eb0-081302ce56b2 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1271 microversion: 2.1 time: 0.958772 Sep 10 10:36:20.055914 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 261/558] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:19 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1271 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:20.067985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4fb62bbd-4bc9-4091-94f7-7fa6d6b8aae1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef85670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:20.114237 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-4fb62bbd-4bc9-4091-94f7-7fa6d6b8aae1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] HTTP exception thrown: Image not found. Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4fb62bbd-4bc9-4091-94f7-7fa6d6b8aae1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Request method failure captured: Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 HTTP/1.1 Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhgLqot1Lj54BIHb5Qy3GTMYCSnvGn_gMdcg5rKKznfMkVTiehK15UcUvvYA1J4Lm3JYYZyjFsJ0eRXxP-YCG65Y3i4Bqqp8vLGtZEC8P1SH2Yv1z8cI3HLp5VIP53pGPKLIgXSf-d1ZYlIEEJZ-k1hDsd1tFidox8TlbTfwN-kZDk Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 3a85977a2f5a4870b65488cf83cce911 Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerTestJSON-2069047134 Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:36:20.145996 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a85977a2f5a4870b65488cf83cce911"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a85977a2f5a4870b65488cf83cce911"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a85977a2f5a4870b65488cf83cce911"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a85977a2f5a4870b65488cf83cce911", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerTestJSON-2069047134 Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 3a85977a2f5a4870b65488cf83cce911 Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2069047134 Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerTestJSON-2069047134-project Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3ae584a919844c5584e066606c9efd36 Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerTestJSON-2069047134-project Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7284d73b-2907-4e88-862b-7933b12c5f27'} Sep 10 10:36:20.147344 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:36:20.148247 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7284d73b-2907-4e88-862b-7933b12c5f27 Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:36:20.151259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7284d73b-2907-4e88-862b-7933b12c5f27 could not be found. Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:36:20.155511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:36:20.158328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:20.165003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4fb62bbd-4bc9-4091-94f7-7fa6d6b8aae1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:36:20.167988 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4fb62bbd-4bc9-4091-94f7-7fa6d6b8aae1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 404 len: 62 microversion: 2.1 time: 0.110160 Sep 10 10:36:20.172897 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 262/559] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:20 2022] GET /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 62 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:36:20.190053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f57bde4-fa87-4af6-9f06-8851a98f75fe tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-44306703"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:20.197014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f57bde4-fa87-4af6-9f06-8851a98f75fe tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:20.209940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f57bde4-fa87-4af6-9f06-8851a98f75fe tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:20.228718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f57bde4-fa87-4af6-9f06-8851a98f75fe tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:20.231651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f57bde4-fa87-4af6-9f06-8851a98f75fe tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:20.235120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f57bde4-fa87-4af6-9f06-8851a98f75fe tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:20.237819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f57bde4-fa87-4af6-9f06-8851a98f75fe tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:20.238658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f57bde4-fa87-4af6-9f06-8851a98f75fe tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:20.569784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b840fb40-e3a7-4dae-8b08-2f9f2d20f166 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:20.578801 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b840fb40-e3a7-4dae-8b08-2f9f2d20f166 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1319 microversion: 2.1 time: 0.627609 Sep 10 10:36:20.583555 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 298/560] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:19 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1319 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:20.594100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4b9e6c9d-dd15-42c4-8b69-800745767590 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:20.594913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4b9e6c9d-dd15-42c4-8b69-800745767590 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:20.608116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b9e6c9d-dd15-42c4-8b69-800745767590 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:20.610654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b9e6c9d-dd15-42c4-8b69-800745767590 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:20.611277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b9e6c9d-dd15-42c4-8b69-800745767590 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:20.612198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b9e6c9d-dd15-42c4-8b69-800745767590 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:20.614138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b9e6c9d-dd15-42c4-8b69-800745767590 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:20.614847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b9e6c9d-dd15-42c4-8b69-800745767590 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:20.727206 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f57bde4-fa87-4af6-9f06-8851a98f75fe tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "POST /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5/action" status: 202 len: 0 microversion: 2.1 time: 0.541889 Sep 10 10:36:20.728509 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 263/561] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:36:20 2022] POST /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 10:36:20.736661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-079ba05f-9482-4167-acc5-bc67870f78c6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:20.738088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-079ba05f-9482-4167-acc5-bc67870f78c6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:20.748458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-079ba05f-9482-4167-acc5-bc67870f78c6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:20.749686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-079ba05f-9482-4167-acc5-bc67870f78c6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:20.750323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-079ba05f-9482-4167-acc5-bc67870f78c6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:20.753615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-079ba05f-9482-4167-acc5-bc67870f78c6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:20.754281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-079ba05f-9482-4167-acc5-bc67870f78c6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:20.755160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-079ba05f-9482-4167-acc5-bc67870f78c6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:20.946029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-079ba05f-9482-4167-acc5-bc67870f78c6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:20.957110 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-079ba05f-9482-4167-acc5-bc67870f78c6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1280 microversion: 2.1 time: 0.225601 Sep 10 10:36:20.958289 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 264/562] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:20 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:21.007480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30400d5f-845a-4ae5-a389-d39d2abfbb92 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef23670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:21.114329 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30400d5f-845a-4ae5-a389-d39d2abfbb92 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d" status: 200 len: 1427 microversion: 2.1 time: 0.153811 Sep 10 10:36:21.117882 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 265/563] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:20 2022] GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:21.125120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:21.126444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:21.137171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:21.138273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:21.140654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:21.142064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:21.142884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:21.143532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:21.373550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:21.387396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:21.389276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:21.392136 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4efa139a-2ce5-4509-9e4b-dcfb376d9456 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1319 microversion: 2.25 time: 0.272420 Sep 10 10:36:21.395087 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 266/564] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:21 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:21.413015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ba9f5fff-76d0-4b88-999c-f737ca5713da tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:21.413881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ba9f5fff-76d0-4b88-999c-f737ca5713da tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:21.429399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba9f5fff-76d0-4b88-999c-f737ca5713da tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:21.429953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba9f5fff-76d0-4b88-999c-f737ca5713da tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:21.430634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba9f5fff-76d0-4b88-999c-f737ca5713da tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:21.431563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba9f5fff-76d0-4b88-999c-f737ca5713da tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:21.432219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba9f5fff-76d0-4b88-999c-f737ca5713da tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:21.432845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba9f5fff-76d0-4b88-999c-f737ca5713da tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:21.472246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4b9e6c9d-dd15-42c4-8b69-800745767590 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:21.487138 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4b9e6c9d-dd15-42c4-8b69-800745767590 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1388 microversion: 2.1 time: 0.898919 Sep 10 10:36:21.488135 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 299/565] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:20 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1388 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:21.610657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bb5b942d-a859-4e98-9c06-cb686f5e61de tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:21.611364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bb5b942d-a859-4e98-9c06-cb686f5e61de tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:21.625626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb5b942d-a859-4e98-9c06-cb686f5e61de tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:21.626529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb5b942d-a859-4e98-9c06-cb686f5e61de tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:21.633351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb5b942d-a859-4e98-9c06-cb686f5e61de tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:21.634911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb5b942d-a859-4e98-9c06-cb686f5e61de tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:21.637335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb5b942d-a859-4e98-9c06-cb686f5e61de tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:21.641430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb5b942d-a859-4e98-9c06-cb686f5e61de tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:21.921868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ba9f5fff-76d0-4b88-999c-f737ca5713da tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:21.931729 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ba9f5fff-76d0-4b88-999c-f737ca5713da tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1313 microversion: 2.1 time: 0.534841 Sep 10 10:36:21.932323 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 267/566] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:21 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:21.981672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-170f395c-b9df-45af-a50f-95b19ac75585 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:21.982239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-170f395c-b9df-45af-a50f-95b19ac75585 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:21.990336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170f395c-b9df-45af-a50f-95b19ac75585 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:21.990833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170f395c-b9df-45af-a50f-95b19ac75585 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:21.991276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170f395c-b9df-45af-a50f-95b19ac75585 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:21.992041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170f395c-b9df-45af-a50f-95b19ac75585 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:21.992502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170f395c-b9df-45af-a50f-95b19ac75585 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:21.993035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-170f395c-b9df-45af-a50f-95b19ac75585 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:22.023937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bb5b942d-a859-4e98-9c06-cb686f5e61de tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:22.034233 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bb5b942d-a859-4e98-9c06-cb686f5e61de tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1319 microversion: 2.1 time: 0.431231 Sep 10 10:36:22.037116 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 300/567] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:21 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:22.049932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7f712cde-5b92-49b2-8a4c-bbb654014986 req-5300811e-4534-4578-b1b1-921998af464b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a85385a-d49e-42c6-ade1-56cedcc85d9e", "tag": "9607736b-aa48-4813-914a-a2282cc916aa"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:22.091954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7f712cde-5b92-49b2-8a4c-bbb654014986 req-5300811e-4534-4578-b1b1-921998af464b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:22.093187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7f712cde-5b92-49b2-8a4c-bbb654014986 req-5300811e-4534-4578-b1b1-921998af464b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:22.094678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7f712cde-5b92-49b2-8a4c-bbb654014986 req-5300811e-4534-4578-b1b1-921998af464b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:22.135886 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7f712cde-5b92-49b2-8a4c-bbb654014986 req-5300811e-4534-4578-b1b1-921998af464b service nova] Creating event network-changed:9607736b-aa48-4813-914a-a2282cc916aa for instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e on n-h2-856894-1 Sep 10 10:36:22.152789 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-7f712cde-5b92-49b2-8a4c-bbb654014986 req-5300811e-4534-4578-b1b1-921998af464b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109838 Sep 10 10:36:22.153482 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 301/568] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:22.175606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1beacc48-718f-4d29-a4a8-7d87c5918c11 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf148820>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:22.257673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-170f395c-b9df-45af-a50f-95b19ac75585 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:22.274104 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-170f395c-b9df-45af-a50f-95b19ac75585 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1280 microversion: 2.1 time: 0.298029 Sep 10 10:36:22.285174 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 268/569] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:21 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1280 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:36:22.326189 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1beacc48-718f-4d29-a4a8-7d87c5918c11 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d" status: 200 len: 1427 microversion: 2.1 time: 0.166399 Sep 10 10:36:22.328164 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 302/570] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:22 2022] GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:22.427777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:22.428721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:22.439559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:22.440055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:22.442236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:22.448482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:22.450287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:22.450737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:22.518688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-777cecc7-61f1-44ca-a064-6bfba491278f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:22.519794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-777cecc7-61f1-44ca-a064-6bfba491278f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:22.532965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777cecc7-61f1-44ca-a064-6bfba491278f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:22.533682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777cecc7-61f1-44ca-a064-6bfba491278f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:22.533972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777cecc7-61f1-44ca-a064-6bfba491278f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:22.534691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777cecc7-61f1-44ca-a064-6bfba491278f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:22.537473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777cecc7-61f1-44ca-a064-6bfba491278f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:22.538308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777cecc7-61f1-44ca-a064-6bfba491278f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:22.960791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:22.970826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:22.976768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:22.979105 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1cab595-c844-4789-a6eb-bd49e6d0e43f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1319 microversion: 2.25 time: 0.558627 Sep 10 10:36:22.994046 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 269/571] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:22 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:22.994046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0ea1be8-9465-416e-a72b-cc1b65cc034f tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:22.994046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0ea1be8-9465-416e-a72b-cc1b65cc034f tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:23.009354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0ea1be8-9465-416e-a72b-cc1b65cc034f tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:23.009750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0ea1be8-9465-416e-a72b-cc1b65cc034f tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:23.010186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0ea1be8-9465-416e-a72b-cc1b65cc034f tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:23.010899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0ea1be8-9465-416e-a72b-cc1b65cc034f tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:23.011913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0ea1be8-9465-416e-a72b-cc1b65cc034f tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:23.012345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0ea1be8-9465-416e-a72b-cc1b65cc034f tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:23.016937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:23.590031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0ea1be8-9465-416e-a72b-cc1b65cc034f tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:23.606246 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0ea1be8-9465-416e-a72b-cc1b65cc034f tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1313 microversion: 2.1 time: 0.625446 Sep 10 10:36:23.606844 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 270/572] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:22 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:23.611869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1720f35-a227-4dc8-89d2-92b1e2fc4122 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:23.614361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1720f35-a227-4dc8-89d2-92b1e2fc4122 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:23.630115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1720f35-a227-4dc8-89d2-92b1e2fc4122 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:23.630704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1720f35-a227-4dc8-89d2-92b1e2fc4122 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:23.631341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1720f35-a227-4dc8-89d2-92b1e2fc4122 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:23.632046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1720f35-a227-4dc8-89d2-92b1e2fc4122 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:23.632644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1720f35-a227-4dc8-89d2-92b1e2fc4122 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:23.633242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1720f35-a227-4dc8-89d2-92b1e2fc4122 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:23.684425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-777cecc7-61f1-44ca-a064-6bfba491278f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:23.700718 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-777cecc7-61f1-44ca-a064-6bfba491278f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1388 microversion: 2.1 time: 1.190087 Sep 10 10:36:23.701930 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 303/573] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:22 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1388 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:23.707256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-36051692-d50e-478e-8f46-ae3c43a4ecef tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:23.708146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-36051692-d50e-478e-8f46-ae3c43a4ecef tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:23.715583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36051692-d50e-478e-8f46-ae3c43a4ecef tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:23.716400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36051692-d50e-478e-8f46-ae3c43a4ecef tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:23.717269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36051692-d50e-478e-8f46-ae3c43a4ecef tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:23.718231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36051692-d50e-478e-8f46-ae3c43a4ecef tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:23.718932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36051692-d50e-478e-8f46-ae3c43a4ecef tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:23.719662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36051692-d50e-478e-8f46-ae3c43a4ecef tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:24.088553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:24.192644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-36051692-d50e-478e-8f46-ae3c43a4ecef tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:24.205646 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-36051692-d50e-478e-8f46-ae3c43a4ecef tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1322 microversion: 2.1 time: 0.502337 Sep 10 10:36:24.206972 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 304/574] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:23 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:24.210701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c1720f35-a227-4dc8-89d2-92b1e2fc4122 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:24.220486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1720f35-a227-4dc8-89d2-92b1e2fc4122 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1469 microversion: 2.1 time: 0.612325 Sep 10 10:36:24.221227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bed5e12b-1d84-493f-98d8-6284691770e0 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf2f29d0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:24.222405 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 271/575] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:23 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1469 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:24.229360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:24.232590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:24.241502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:24.243713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:24.244350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:24.245309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:24.248144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:24.249538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:24.325258 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bed5e12b-1d84-493f-98d8-6284691770e0 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d" status: 200 len: 1427 microversion: 2.1 time: 0.116766 Sep 10 10:36:24.326531 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 305/576] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:24 2022] GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:24.332740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d7049ab5-21c6-4ace-bc10-c08bc49e8df4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:24.333670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d7049ab5-21c6-4ace-bc10-c08bc49e8df4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c5b96b02-53dc-4c3b-9955-bab2ba5161fc] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:24.340810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7049ab5-21c6-4ace-bc10-c08bc49e8df4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:24.341676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7049ab5-21c6-4ace-bc10-c08bc49e8df4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:24.342332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7049ab5-21c6-4ace-bc10-c08bc49e8df4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:24.343240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7049ab5-21c6-4ace-bc10-c08bc49e8df4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:24.343895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7049ab5-21c6-4ace-bc10-c08bc49e8df4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:24.344521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7049ab5-21c6-4ace-bc10-c08bc49e8df4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:24.699892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:24.716352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:24.717827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:24.718974 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-54cfe5d1-bd44-4dac-bdb7-d36bda53f73f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1361 microversion: 2.25 time: 0.495074 Sep 10 10:36:24.719535 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 272/577] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:24 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:24.738041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1ab72af3-7cdd-4eb9-a8dc-07314800c83c tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:24.738918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1ab72af3-7cdd-4eb9-a8dc-07314800c83c tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:24.746156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ab72af3-7cdd-4eb9-a8dc-07314800c83c tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:24.753503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ab72af3-7cdd-4eb9-a8dc-07314800c83c tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:24.753954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ab72af3-7cdd-4eb9-a8dc-07314800c83c tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:24.754766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ab72af3-7cdd-4eb9-a8dc-07314800c83c tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:24.755229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ab72af3-7cdd-4eb9-a8dc-07314800c83c tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:24.755658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ab72af3-7cdd-4eb9-a8dc-07314800c83c tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:25.140160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d7049ab5-21c6-4ace-bc10-c08bc49e8df4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:25.158763 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d7049ab5-21c6-4ace-bc10-c08bc49e8df4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c5b96b02-53dc-4c3b-9955-bab2ba5161fc" status: 200 len: 1468 microversion: 2.1 time: 0.831029 Sep 10 10:36:25.159355 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 306/578] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:24 2022] GET /compute/v2.1/servers/c5b96b02-53dc-4c3b-9955-bab2ba5161fc => generated 1468 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:25.164157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-db000f6d-342e-45e2-aa18-d50eb4af743f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:25.164772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-db000f6d-342e-45e2-aa18-d50eb4af743f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:25.179136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db000f6d-342e-45e2-aa18-d50eb4af743f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:25.179957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db000f6d-342e-45e2-aa18-d50eb4af743f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:25.180565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db000f6d-342e-45e2-aa18-d50eb4af743f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:25.181524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db000f6d-342e-45e2-aa18-d50eb4af743f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:25.182966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db000f6d-342e-45e2-aa18-d50eb4af743f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:25.183752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db000f6d-342e-45e2-aa18-d50eb4af743f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:25.691153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1ab72af3-7cdd-4eb9-a8dc-07314800c83c tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:25.706457 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1ab72af3-7cdd-4eb9-a8dc-07314800c83c tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1313 microversion: 2.1 time: 0.981125 Sep 10 10:36:25.708233 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 273/579] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:24 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1313 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:25.729292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1721359808", "imageRef": "9adfa549-6438-4024-8d6a-64ab13f99c70", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3001b198-48c8-495f-a37d-53b0d3a62c13"}], "security_groups": [{"name": "tempest-securitygroup--870773457"}], "key_name": "tempest-keypair-1768219462", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:25.850469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-db000f6d-342e-45e2-aa18-d50eb4af743f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:25.872443 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-db000f6d-342e-45e2-aa18-d50eb4af743f tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1388 microversion: 2.1 time: 0.711807 Sep 10 10:36:25.873464 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 307/580] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:25 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1388 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:25.889854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:25.899295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:25.911939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Searching by: {'reservation_id': 'r-k0up682r', 'deleted': False, 'project_id': '357ca1336b634d0389fff733e6e26ca0'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:36:25.917752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:25.920647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:25.922328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:25.926716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:25.927422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:25.928017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:25.985581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] validate_networks() for [('3001b198-48c8-495f-a37d-53b0d3a62c13', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:36:26.165543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:36:26.397585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:26.422740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:26.424794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:26.425548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:26.884921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=14 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:27.209558 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-54569692-cd4b-4830-9bf6-6f7b21f4eb9b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-k0up682r" status: 200 len: 2930 microversion: 2.1 time: 1.333529 Sep 10 10:36:27.211760 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 308/581] 10.222.0.20 () {58 vars in 1197 bytes} [Sat Sep 10 10:36:25 2022] GET /compute/v2.1/servers/detail?reservation_id=r-k0up682r => generated 2930 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:27.228303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6aa38ad7-b310-4069-873a-ca5abc235a51 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:27.231273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6aa38ad7-b310-4069-873a-ca5abc235a51 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:27.287322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aa38ad7-b310-4069-873a-ca5abc235a51 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:27.289499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aa38ad7-b310-4069-873a-ca5abc235a51 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:27.290825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aa38ad7-b310-4069-873a-ca5abc235a51 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:27.297618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aa38ad7-b310-4069-873a-ca5abc235a51 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:27.301391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aa38ad7-b310-4069-873a-ca5abc235a51 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:27.304073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aa38ad7-b310-4069-873a-ca5abc235a51 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:27.510390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6aa38ad7-b310-4069-873a-ca5abc235a51 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:27.520521 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6aa38ad7-b310-4069-873a-ca5abc235a51 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1322 microversion: 2.1 time: 0.305954 Sep 10 10:36:27.525806 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 309/582] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:27 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:27.531176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9b3a6a91-4a10-4130-bf25-3f11ebfffca1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaf4841f0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:27.582444 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9b3a6a91-4a10-4130-bf25-3f11ebfffca1 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d" status: 200 len: 1427 microversion: 2.1 time: 0.055388 Sep 10 10:36:27.583194 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 310/583] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:27 2022] GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:27.588690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-5aa9fa5c-ecee-4827-bfc8-d27a885352b2 req-0f13f71f-6b6c-4bbe-987b-9b789c704311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31616661-a3b4-4c60-8277-1a5f6f1c492f", "tag": "fbb30454-9ab3-4ca0-80a9-e506580f89d4"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:27.599676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5aa9fa5c-ecee-4827-bfc8-d27a885352b2 req-0f13f71f-6b6c-4bbe-987b-9b789c704311 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:27.600436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5aa9fa5c-ecee-4827-bfc8-d27a885352b2 req-0f13f71f-6b6c-4bbe-987b-9b789c704311 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:27.601046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5aa9fa5c-ecee-4827-bfc8-d27a885352b2 req-0f13f71f-6b6c-4bbe-987b-9b789c704311 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:27.613252 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-5aa9fa5c-ecee-4827-bfc8-d27a885352b2 req-0f13f71f-6b6c-4bbe-987b-9b789c704311 service nova] Creating event network-changed:fbb30454-9ab3-4ca0-80a9-e506580f89d4 for instance 31616661-a3b4-4c60-8277-1a5f6f1c492f on n-h2-856894-1 Sep 10 10:36:27.619175 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-5aa9fa5c-ecee-4827-bfc8-d27a885352b2 req-0f13f71f-6b6c-4bbe-987b-9b789c704311 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034613 Sep 10 10:36:27.628468 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 311/584] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:27.634354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:27.637154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:27.648366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:27.654698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:27.655344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:27.661261 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:27.662166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:27.662797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:27.663585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:36:27.664719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:36:27.672853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:36:27.673243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:36:27.673670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:36:27.683706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:27.684554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:27.685230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:27.692425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:27.697005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:27.697808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:27.698518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:27.724761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Getting quotas for project cabcfc642a0a420caa4515a42aace3f6. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:27.731711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Getting quotas for user 3a26238f6d374b9789bd97cb6906bd2c and project cabcfc642a0a420caa4515a42aace3f6. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:27.748070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:36:27.751249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9adfa549-6438-4024-8d6a-64ab13f99c70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:36:27.851333 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c8293f9-a1e4-4592-938e-75a8fc537161 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.141825 Sep 10 10:36:27.858969 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 274/585] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:36:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:36:27.863409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fcffdbf5-13b0-4d72-bb2b-b02218ed8d71 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:27.865951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fcffdbf5-13b0-4d72-bb2b-b02218ed8d71 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:27.877754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:27.879626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcffdbf5-13b0-4d72-bb2b-b02218ed8d71 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:27.882079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcffdbf5-13b0-4d72-bb2b-b02218ed8d71 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:27.882746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcffdbf5-13b0-4d72-bb2b-b02218ed8d71 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:27.883544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcffdbf5-13b0-4d72-bb2b-b02218ed8d71 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:27.886140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcffdbf5-13b0-4d72-bb2b-b02218ed8d71 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:27.886707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcffdbf5-13b0-4d72-bb2b-b02218ed8d71 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:27.911124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:27.913244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:27.914596 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e1b86306-9397-4650-af63-2e460c31604d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1361 microversion: 2.25 time: 0.284672 Sep 10 10:36:27.931028 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 312/586] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:27 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:27.946800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-6e09d224-e06e-45cc-b475-5b29e7a9f549 req-5263e952-ebdf-4af9-9e3d-9d8daa71c2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cee035c-b7ed-45ea-ae74-1f6e84884f93", "tag": "78172492-464d-44c4-9fd7-8bcc7267628a"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:27.977207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6e09d224-e06e-45cc-b475-5b29e7a9f549 req-5263e952-ebdf-4af9-9e3d-9d8daa71c2a2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:27.977685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6e09d224-e06e-45cc-b475-5b29e7a9f549 req-5263e952-ebdf-4af9-9e3d-9d8daa71c2a2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:27.978109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6e09d224-e06e-45cc-b475-5b29e7a9f549 req-5263e952-ebdf-4af9-9e3d-9d8daa71c2a2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:28.015462 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-6e09d224-e06e-45cc-b475-5b29e7a9f549 req-5263e952-ebdf-4af9-9e3d-9d8daa71c2a2 service nova] Creating event network-changed:78172492-464d-44c4-9fd7-8bcc7267628a for instance 5cee035c-b7ed-45ea-ae74-1f6e84884f93 on n-h2-856894-1 Sep 10 10:36:28.022405 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-6e09d224-e06e-45cc-b475-5b29e7a9f549 req-5263e952-ebdf-4af9-9e3d-9d8daa71c2a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088956 Sep 10 10:36:28.022405 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 313/587] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:28.038336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e81e2f0f-4095-410f-b519-1663162f7482 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:28.039000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e81e2f0f-4095-410f-b519-1663162f7482 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:28.046521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e81e2f0f-4095-410f-b519-1663162f7482 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:28.047018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e81e2f0f-4095-410f-b519-1663162f7482 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:28.047447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e81e2f0f-4095-410f-b519-1663162f7482 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:28.048143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e81e2f0f-4095-410f-b519-1663162f7482 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:28.048591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e81e2f0f-4095-410f-b519-1663162f7482 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:28.049015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e81e2f0f-4095-410f-b519-1663162f7482 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:28.378907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e81e2f0f-4095-410f-b519-1663162f7482 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:28.393825 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e81e2f0f-4095-410f-b519-1663162f7482 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1388 microversion: 2.1 time: 0.370090 Sep 10 10:36:28.396174 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 314/588] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:28 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1388 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:28.403131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-0e69a840-a001-4f1a-8c18-492b8cdbeeaf req-20aa3312-54f1-4830-ba32-83d9b6e6838f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c8aaac-8fb1-4334-a972-492a119fc8d5", "name": "network-vif-plugged", "status": "completed", "tag": "0269a13f-cff8-4c12-b6cc-739e948a57b0"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:28.438889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0e69a840-a001-4f1a-8c18-492b8cdbeeaf req-20aa3312-54f1-4830-ba32-83d9b6e6838f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:28.439385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0e69a840-a001-4f1a-8c18-492b8cdbeeaf req-20aa3312-54f1-4830-ba32-83d9b6e6838f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:28.439811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0e69a840-a001-4f1a-8c18-492b8cdbeeaf req-20aa3312-54f1-4830-ba32-83d9b6e6838f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:28.468664 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-0e69a840-a001-4f1a-8c18-492b8cdbeeaf req-20aa3312-54f1-4830-ba32-83d9b6e6838f service nova] Creating event network-vif-plugged:0269a13f-cff8-4c12-b6cc-739e948a57b0 for instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 on n-h1-856894-1 Sep 10 10:36:28.483089 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-0e69a840-a001-4f1a-8c18-492b8cdbeeaf req-20aa3312-54f1-4830-ba32-83d9b6e6838f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085182 Sep 10 10:36:28.484304 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 315/589] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:28.724056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-873fc8c7-de8b-4622-8a1d-059f8fd66f03 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Action: 'create', calling method: .version_select at 0x7efcaefec9d0>, body: {"keypair": {"name": "tempest-keypair-1465398661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7jqdZODDKe5+OapOU96aMejSQI2LaF25mhcAovmJfiiJTvT6QRXg5hPft4cK3dfdfhGuyAaA55K/C13QHuTSzoJpd61rItzLgHi24N3BCHjMd11BY5Vady7+gyur2TdQ=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:28.740784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-873fc8c7-de8b-4622-8a1d-059f8fd66f03 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Getting quotas for project c6445fbb5cc5424c82a3c6d07abf7285. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:28.747858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-873fc8c7-de8b-4622-8a1d-059f8fd66f03 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Getting quotas for user 7376851ce7e84c71a18d7d2ac36e5d1f and project c6445fbb5cc5424c82a3c6d07abf7285. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:28.751164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:28.787276 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-873fc8c7-de8b-4622-8a1d-059f8fd66f03 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.301253 Sep 10 10:36:28.789614 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 316/590] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:36:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:28.799199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-169d2aa6-df72-43ba-b2ad-41b6f2fe6bab tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:28.834628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fcffdbf5-13b0-4d72-bb2b-b02218ed8d71 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:28.846550 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fcffdbf5-13b0-4d72-bb2b-b02218ed8d71 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1313 microversion: 2.1 time: 0.991903 Sep 10 10:36:28.847290 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 275/591] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:27 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1313 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:28.849816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.compute.server_groups [None req-169d2aa6-df72-43ba-b2ad-41b6f2fe6bab tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Querying cell de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) for 2 instances {{(pid=128787) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 10:36:28.854341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6b5a16c-1e7a-48a2-a25e-3b96fc15bcd0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:28.859520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-169d2aa6-df72-43ba-b2ad-41b6f2fe6bab tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:28.860172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-169d2aa6-df72-43ba-b2ad-41b6f2fe6bab tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:28.860719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-169d2aa6-df72-43ba-b2ad-41b6f2fe6bab tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:28.866954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d6b5a16c-1e7a-48a2-a25e-3b96fc15bcd0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:28.883102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:28.889304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6b5a16c-1e7a-48a2-a25e-3b96fc15bcd0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:28.889952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6b5a16c-1e7a-48a2-a25e-3b96fc15bcd0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:28.893701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6b5a16c-1e7a-48a2-a25e-3b96fc15bcd0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:28.896767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6b5a16c-1e7a-48a2-a25e-3b96fc15bcd0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:28.902298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6b5a16c-1e7a-48a2-a25e-3b96fc15bcd0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:28.904967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6b5a16c-1e7a-48a2-a25e-3b96fc15bcd0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:28.943625 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-169d2aa6-df72-43ba-b2ad-41b6f2fe6bab tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/6dfe3f41-3da8-4d1a-a014-33a6ff7d285f" status: 200 len: 266 microversion: 2.1 time: 0.151639 Sep 10 10:36:28.950678 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 317/592] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:36:28 2022] GET /compute/v2.1/os-server-groups/6dfe3f41-3da8-4d1a-a014-33a6ff7d285f => generated 266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:28.956896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5ebcafb4-814c-4f86-bda6-29809b61fae2 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:28.958861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5ebcafb4-814c-4f86-bda6-29809b61fae2 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:28.971094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ebcafb4-814c-4f86-bda6-29809b61fae2 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:28.973491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ebcafb4-814c-4f86-bda6-29809b61fae2 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:28.974049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ebcafb4-814c-4f86-bda6-29809b61fae2 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:28.974879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ebcafb4-814c-4f86-bda6-29809b61fae2 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:28.975582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ebcafb4-814c-4f86-bda6-29809b61fae2 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:28.976232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ebcafb4-814c-4f86-bda6-29809b61fae2 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:29.196448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d6b5a16c-1e7a-48a2-a25e-3b96fc15bcd0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:29.210081 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6b5a16c-1e7a-48a2-a25e-3b96fc15bcd0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1250 microversion: 2.1 time: 0.361627 Sep 10 10:36:29.210989 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 276/593] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:28 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1250 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:29.225182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72349246-ff55-47ea-8df2-d2fb20a98214 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaeefe550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:29.270566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5ebcafb4-814c-4f86-bda6-29809b61fae2 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:29.279401 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5ebcafb4-814c-4f86-bda6-29809b61fae2 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1322 microversion: 2.1 time: 0.333367 Sep 10 10:36:29.285351 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 318/594] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:28 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:29.302964 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72349246-ff55-47ea-8df2-d2fb20a98214 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d" status: 200 len: 1427 microversion: 2.1 time: 0.090663 Sep 10 10:36:29.303552 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 277/595] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:29 2022] GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:29.307272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:29.308607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:29.319589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfced9b8-ac92-432e-9ade-0d8e39399a11 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:29.320505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfced9b8-ac92-432e-9ade-0d8e39399a11 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:29.328660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:29.329561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:29.330162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:29.331613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfced9b8-ac92-432e-9ade-0d8e39399a11 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:29.331747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfced9b8-ac92-432e-9ade-0d8e39399a11 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:29.332170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfced9b8-ac92-432e-9ade-0d8e39399a11 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:29.332885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:29.334081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfced9b8-ac92-432e-9ade-0d8e39399a11 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:29.334673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:29.335878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:29.336006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfced9b8-ac92-432e-9ade-0d8e39399a11 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:29.336503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfced9b8-ac92-432e-9ade-0d8e39399a11 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:29.647344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:29.669790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:29.674835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:29.679369 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ab553405-133d-424c-818c-945375c72cba tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1361 microversion: 2.25 time: 0.389118 Sep 10 10:36:29.679979 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 319/596] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:29 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1361 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:29.688983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8de5b337-6f78-40ca-a157-36132cf8d5fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:29.696216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8de5b337-6f78-40ca-a157-36132cf8d5fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:29.709041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8de5b337-6f78-40ca-a157-36132cf8d5fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:29.709830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8de5b337-6f78-40ca-a157-36132cf8d5fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:29.710602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8de5b337-6f78-40ca-a157-36132cf8d5fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:29.717324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8de5b337-6f78-40ca-a157-36132cf8d5fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:29.718059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8de5b337-6f78-40ca-a157-36132cf8d5fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:29.718688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8de5b337-6f78-40ca-a157-36132cf8d5fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:29.749187 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfced9b8-ac92-432e-9ade-0d8e39399a11 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 200 len: 1620 microversion: 2.1 time: 0.438998 Sep 10 10:36:29.751453 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 278/597] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:29 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 1620 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:29.779767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7fb34b6e-9028-43f1-9d28-1a24e3bb3096 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:29.780772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7fb34b6e-9028-43f1-9d28-1a24e3bb3096 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] [instance: c5b96b02-53dc-4c3b-9955-bab2ba5161fc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:29.802593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fb34b6e-9028-43f1-9d28-1a24e3bb3096 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:29.803398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fb34b6e-9028-43f1-9d28-1a24e3bb3096 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:29.803854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fb34b6e-9028-43f1-9d28-1a24e3bb3096 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:29.804594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fb34b6e-9028-43f1-9d28-1a24e3bb3096 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:29.807334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fb34b6e-9028-43f1-9d28-1a24e3bb3096 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:29.811661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fb34b6e-9028-43f1-9d28-1a24e3bb3096 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:30.042714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8de5b337-6f78-40ca-a157-36132cf8d5fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:30.051611 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8de5b337-6f78-40ca-a157-36132cf8d5fd tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1388 microversion: 2.1 time: 0.370579 Sep 10 10:36:30.052951 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7fb34b6e-9028-43f1-9d28-1a24e3bb3096 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c5b96b02-53dc-4c3b-9955-bab2ba5161fc" status: 200 len: 1619 microversion: 2.1 time: 0.277251 Sep 10 10:36:30.058680 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 320/598] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:29 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1388 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:30.061571 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 279/599] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:29 2022] GET /compute/v2.1/servers/c5b96b02-53dc-4c3b-9955-bab2ba5161fc => generated 1619 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:30.068377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-23f0671f-515c-41cc-b110-c8dad277502e tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:30.069242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-23f0671f-515c-41cc-b110-c8dad277502e tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:30.076136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23f0671f-515c-41cc-b110-c8dad277502e tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:30.076925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23f0671f-515c-41cc-b110-c8dad277502e tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:30.087270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23f0671f-515c-41cc-b110-c8dad277502e tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:30.088065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23f0671f-515c-41cc-b110-c8dad277502e tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:30.096069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23f0671f-515c-41cc-b110-c8dad277502e tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:30.099190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23f0671f-515c-41cc-b110-c8dad277502e tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:30.102704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d56be44b-1c78-4cea-9663-32ca32b89a3f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Action: 'create', calling method: .version_select at 0x7efcaeefe8b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1527050810", "policies": ["anti-affinity"]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:30.135598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d56be44b-1c78-4cea-9663-32ca32b89a3f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:30.148109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d56be44b-1c78-4cea-9663-32ca32b89a3f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:30.317416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d56be44b-1c78-4cea-9663-32ca32b89a3f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:30.323726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d56be44b-1c78-4cea-9663-32ca32b89a3f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:30.337929 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d56be44b-1c78-4cea-9663-32ca32b89a3f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.239129 Sep 10 10:36:30.341691 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 280/600] 10.222.0.20 () {60 vars in 1174 bytes} [Sat Sep 10 10:36:30 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:30.358739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6c92c25-22e5-47f0-ac72-33b602203bc1 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:30.359355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d6c92c25-22e5-47f0-ac72-33b602203bc1 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:30.374446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6c92c25-22e5-47f0-ac72-33b602203bc1 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:30.376570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6c92c25-22e5-47f0-ac72-33b602203bc1 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:30.377300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6c92c25-22e5-47f0-ac72-33b602203bc1 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:30.384468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6c92c25-22e5-47f0-ac72-33b602203bc1 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:30.385140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6c92c25-22e5-47f0-ac72-33b602203bc1 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:30.385928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6c92c25-22e5-47f0-ac72-33b602203bc1 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:30.492154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d6c92c25-22e5-47f0-ac72-33b602203bc1 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:30.521971 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6c92c25-22e5-47f0-ac72-33b602203bc1 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1298 microversion: 2.1 time: 0.178874 Sep 10 10:36:30.539071 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 281/601] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:30 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1298 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:30.546845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-baff65bc-4d4c-4940-9acf-594204633630 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:30.547654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-baff65bc-4d4c-4940-9acf-594204633630 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:30.558612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baff65bc-4d4c-4940-9acf-594204633630 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:30.559465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baff65bc-4d4c-4940-9acf-594204633630 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:30.560059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baff65bc-4d4c-4940-9acf-594204633630 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:30.560927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baff65bc-4d4c-4940-9acf-594204633630 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:30.561566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baff65bc-4d4c-4940-9acf-594204633630 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:30.562140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baff65bc-4d4c-4940-9acf-594204633630 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:31.043633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-23f0671f-515c-41cc-b110-c8dad277502e tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:31.053363 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-23f0671f-515c-41cc-b110-c8dad277502e tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1313 microversion: 2.1 time: 0.993252 Sep 10 10:36:31.062347 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 321/602] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:30 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1313 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:31.075633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-baff65bc-4d4c-4940-9acf-594204633630 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:31.076314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-04acb9c1-2249-4a8c-899a-4c930d216a39 req-b8a3ae0a-ac66-49f1-8d03-d9e86693a3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0f0704-e44c-45ed-8cba-86d6ad048f12", "tag": "2095cfbd-e6eb-4350-a71e-b4d08d9396b4"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:31.097203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-04acb9c1-2249-4a8c-899a-4c930d216a39 req-b8a3ae0a-ac66-49f1-8d03-d9e86693a3a9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:31.098082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-04acb9c1-2249-4a8c-899a-4c930d216a39 req-b8a3ae0a-ac66-49f1-8d03-d9e86693a3a9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:31.098753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-04acb9c1-2249-4a8c-899a-4c930d216a39 req-b8a3ae0a-ac66-49f1-8d03-d9e86693a3a9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:31.122536 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-04acb9c1-2249-4a8c-899a-4c930d216a39 req-b8a3ae0a-ac66-49f1-8d03-d9e86693a3a9 service nova] Creating event network-changed:2095cfbd-e6eb-4350-a71e-b4d08d9396b4 for instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 on n-h1-856894-1 Sep 10 10:36:31.126859 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-baff65bc-4d4c-4940-9acf-594204633630 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1322 microversion: 2.1 time: 0.576516 Sep 10 10:36:31.127532 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 282/603] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:30 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1322 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:31.141886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e560e5f-bd57-4127-9303-fea14b7ba2c9 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef6c280>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:31.146540 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-04acb9c1-2249-4a8c-899a-4c930d216a39 req-b8a3ae0a-ac66-49f1-8d03-d9e86693a3a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081713 Sep 10 10:36:31.154418 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 322/604] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:31.185632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2086210537", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b5ca0581-e82b-4914-a1ef-8642fb1514c8"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:31.242015 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9e560e5f-bd57-4127-9303-fea14b7ba2c9 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d" status: 200 len: 1427 microversion: 2.1 time: 0.108691 Sep 10 10:36:31.243705 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 283/605] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:31 2022] GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:31.306463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8509748c-9862-4720-954e-81c44d528a06 req-7a61937e-0897-4923-9b6d-8c5ef95fc9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a85385a-d49e-42c6-ade1-56cedcc85d9e", "name": "network-vif-plugged", "status": "completed", "tag": "9607736b-aa48-4813-914a-a2282cc916aa"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:31.348168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8509748c-9862-4720-954e-81c44d528a06 req-7a61937e-0897-4923-9b6d-8c5ef95fc9cb service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:31.350221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8509748c-9862-4720-954e-81c44d528a06 req-7a61937e-0897-4923-9b6d-8c5ef95fc9cb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:31.351041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8509748c-9862-4720-954e-81c44d528a06 req-7a61937e-0897-4923-9b6d-8c5ef95fc9cb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:31.405104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] validate_networks() for None {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:36:31.416893 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8509748c-9862-4720-954e-81c44d528a06 req-7a61937e-0897-4923-9b6d-8c5ef95fc9cb service nova] Creating event network-vif-plugged:9607736b-aa48-4813-914a-a2282cc916aa for instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e on n-h2-856894-1 Sep 10 10:36:31.423892 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8509748c-9862-4720-954e-81c44d528a06 req-7a61937e-0897-4923-9b6d-8c5ef95fc9cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175638 Sep 10 10:36:31.425511 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 284/606] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:31.436892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:31.438035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:31.448177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:31.451013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:31.451668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:31.453783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:31.455827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:31.456485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:32.288605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:32.302672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:32.307334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:32.317781 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f3e9d090-e312-4eb3-b810-4b9acc895eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1361 microversion: 2.25 time: 0.890615 Sep 10 10:36:32.318932 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 285/607] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:31 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1361 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:32.326665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-378c44cb-48d9-48e7-82ce-a438df56d048 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:32.329465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-378c44cb-48d9-48e7-82ce-a438df56d048 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:32.356866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-378c44cb-48d9-48e7-82ce-a438df56d048 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:32.357624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-378c44cb-48d9-48e7-82ce-a438df56d048 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:32.359222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-378c44cb-48d9-48e7-82ce-a438df56d048 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:32.360285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-378c44cb-48d9-48e7-82ce-a438df56d048 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:32.360917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-378c44cb-48d9-48e7-82ce-a438df56d048 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:32.362415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-378c44cb-48d9-48e7-82ce-a438df56d048 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:32.797550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:36:32.798106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:36:32.798461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:36:32.799012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:36:32.799430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:36:32.834153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:32.834712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:32.835103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:32.835841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:32.836295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:32.836721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:32.875164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:32.883582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-378c44cb-48d9-48e7-82ce-a438df56d048 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:32.902177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:32.902818 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-378c44cb-48d9-48e7-82ce-a438df56d048 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1388 microversion: 2.1 time: 0.581193 Sep 10 10:36:32.905518 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 286/608] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:32 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1388 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:32.919046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53575344-7cb2-450f-9e62-c9899feff7c5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:32.920720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53575344-7cb2-450f-9e62-c9899feff7c5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:32.940690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53575344-7cb2-450f-9e62-c9899feff7c5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:32.941626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Going to run 2 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:36:32.943619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53575344-7cb2-450f-9e62-c9899feff7c5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:32.945603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53575344-7cb2-450f-9e62-c9899feff7c5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:32.946745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53575344-7cb2-450f-9e62-c9899feff7c5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:32.948331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53575344-7cb2-450f-9e62-c9899feff7c5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:32.949926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c1be72b7-1010-4f8d-84c0-27c703292bb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:36:32.950514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53575344-7cb2-450f-9e62-c9899feff7c5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:33.082398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128787) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 10 10:36:33.136116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:33.153575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:33.285638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:33.294311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:33.349385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=c1be72b7-1010-4f8d-84c0-27c703292bb0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:36:33.482729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:33.490028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:33.592167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:33.610369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'server_group_members'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:33.698680 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3b27bcdc-cd3a-42b3-ada6-19011bfd1150 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.542349 Sep 10 10:36:33.699304 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 323/609] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:36:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 2544 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 10 10:36:33.705519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c0298652-5726-4198-88ad-7fd899236ad5 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:33.712707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c0298652-5726-4198-88ad-7fd899236ad5 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:33.726845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0298652-5726-4198-88ad-7fd899236ad5 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:33.732930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0298652-5726-4198-88ad-7fd899236ad5 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:33.733736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0298652-5726-4198-88ad-7fd899236ad5 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:33.734701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0298652-5726-4198-88ad-7fd899236ad5 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:33.735373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0298652-5726-4198-88ad-7fd899236ad5 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:33.735982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0298652-5726-4198-88ad-7fd899236ad5 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:33.817661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53575344-7cb2-450f-9e62-c9899feff7c5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:33.830861 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53575344-7cb2-450f-9e62-c9899feff7c5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1304 microversion: 2.1 time: 0.924196 Sep 10 10:36:33.834074 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 287/610] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:32 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1304 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:33.839051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e82c09c1-5d21-4a96-bcd1-417a473fcb90 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:33.839669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e82c09c1-5d21-4a96-bcd1-417a473fcb90 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:33.870608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e82c09c1-5d21-4a96-bcd1-417a473fcb90 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:33.871100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e82c09c1-5d21-4a96-bcd1-417a473fcb90 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:33.873308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e82c09c1-5d21-4a96-bcd1-417a473fcb90 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:33.875503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e82c09c1-5d21-4a96-bcd1-417a473fcb90 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:33.876293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e82c09c1-5d21-4a96-bcd1-417a473fcb90 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:33.878373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e82c09c1-5d21-4a96-bcd1-417a473fcb90 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:34.283619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e82c09c1-5d21-4a96-bcd1-417a473fcb90 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:34.292142 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e82c09c1-5d21-4a96-bcd1-417a473fcb90 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1322 microversion: 2.1 time: 0.456758 Sep 10 10:36:34.292732 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 288/611] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:33 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:34.300697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d358bd6b-085a-4011-b273-69d51b28b485 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef85940>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:34.680685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c0298652-5726-4198-88ad-7fd899236ad5 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:34.696699 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c0298652-5726-4198-88ad-7fd899236ad5 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1313 microversion: 2.1 time: 0.992287 Sep 10 10:36:34.701186 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 324/612] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:33 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1313 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:34.716569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:34.721367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:34.760181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:34.762211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:34.777874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:34.779063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:34.780016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:34.780937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:35.576275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:35.587384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:35.591595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:35.596917 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e3061e61-9d53-4eec-915c-0b01e3146b1f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1361 microversion: 2.25 time: 0.893552 Sep 10 10:36:35.597792 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 325/613] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:34 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1361 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:35.608877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:35.619918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:35.625972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Searching by: {'deleted': False, 'project_id': '357ca1336b634d0389fff733e6e26ca0'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:36:35.637450 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:35.641684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:35.642370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:35.645572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:35.646297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:35.646952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:35.714678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=11 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:35.789817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:36:35.882133 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5c38ba39-88e9-4a8c-8eac-9c5f23c8708e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.279919 Sep 10 10:36:35.884672 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 326/614] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 10:36:35 2022] GET /compute/v2.1/servers => generated 1666 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:35.898688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-42a48ec2-12cc-407d-a69a-36914eebd504 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:35.900923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-42a48ec2-12cc-407d-a69a-36914eebd504 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:35.921566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42a48ec2-12cc-407d-a69a-36914eebd504 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:35.922492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42a48ec2-12cc-407d-a69a-36914eebd504 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:35.923274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42a48ec2-12cc-407d-a69a-36914eebd504 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:35.925856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42a48ec2-12cc-407d-a69a-36914eebd504 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:35.927267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42a48ec2-12cc-407d-a69a-36914eebd504 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:35.927942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42a48ec2-12cc-407d-a69a-36914eebd504 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:36.871181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-42a48ec2-12cc-407d-a69a-36914eebd504 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:36.884384 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-42a48ec2-12cc-407d-a69a-36914eebd504 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1587 microversion: 2.1 time: 0.998296 Sep 10 10:36:36.887520 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 327/615] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:35 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1587 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:36.900485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-bf988a57-9a74-42b9-95a6-fb6445ad55d1 req-abeaeb92-cd32-428f-ba33-1585e1c83ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31616661-a3b4-4c60-8277-1a5f6f1c492f", "name": "network-vif-plugged", "status": "completed", "tag": "fbb30454-9ab3-4ca0-80a9-e506580f89d4"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:36.922108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:36.935410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-bf988a57-9a74-42b9-95a6-fb6445ad55d1 req-abeaeb92-cd32-428f-ba33-1585e1c83ee5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:36.936189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-bf988a57-9a74-42b9-95a6-fb6445ad55d1 req-abeaeb92-cd32-428f-ba33-1585e1c83ee5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:36.937364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-bf988a57-9a74-42b9-95a6-fb6445ad55d1 req-abeaeb92-cd32-428f-ba33-1585e1c83ee5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:36.970941 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-bf988a57-9a74-42b9-95a6-fb6445ad55d1 req-abeaeb92-cd32-428f-ba33-1585e1c83ee5 service nova] Creating event network-vif-plugged:fbb30454-9ab3-4ca0-80a9-e506580f89d4 for instance 31616661-a3b4-4c60-8277-1a5f6f1c492f on n-h2-856894-1 Sep 10 10:36:36.987803 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-bf988a57-9a74-42b9-95a6-fb6445ad55d1 req-abeaeb92-cd32-428f-ba33-1585e1c83ee5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094816 Sep 10 10:36:36.991232 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 328/616] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:37.014822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-823820351", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "88b7cffb-d5ed-46dd-8cd2-9204c185f298"}], "security_groups": [{"name": "tempest-securitygroup--693319539"}], "key_name": "tempest-keypair-1465398661", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:37.709601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:40.331596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=14 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:43.625494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=46 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:43.860915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:43.988026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d358bd6b-085a-4011-b273-69d51b28b485 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d" status: 200 len: 1436 microversion: 2.1 time: 9.693236 Sep 10 10:36:43.993702 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 289/617] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:34 2022] GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d => generated 1436 bytes in 9700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:44.004874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f83e3268-63fb-402a-86a2-6a41b0471441 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:44.006034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f83e3268-63fb-402a-86a2-6a41b0471441 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:44.015447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f83e3268-63fb-402a-86a2-6a41b0471441 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.016015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f83e3268-63fb-402a-86a2-6a41b0471441 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.016574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f83e3268-63fb-402a-86a2-6a41b0471441 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.017684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f83e3268-63fb-402a-86a2-6a41b0471441 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.018535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f83e3268-63fb-402a-86a2-6a41b0471441 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.019825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f83e3268-63fb-402a-86a2-6a41b0471441 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.067159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] validate_networks() for [('88b7cffb-d5ed-46dd-8cd2-9204c185f298', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:36:44.164648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f83e3268-63fb-402a-86a2-6a41b0471441 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:44.181813 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f83e3268-63fb-402a-86a2-6a41b0471441 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1371 microversion: 2.1 time: 0.186710 Sep 10 10:36:44.197602 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 290/618] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:43 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:44.202728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-362cb4c5-75a8-4a2a-ad1e-a3b31c434724 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:44.203533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-362cb4c5-75a8-4a2a-ad1e-a3b31c434724 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:44.223877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-362cb4c5-75a8-4a2a-ad1e-a3b31c434724 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.224313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-362cb4c5-75a8-4a2a-ad1e-a3b31c434724 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.224746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-362cb4c5-75a8-4a2a-ad1e-a3b31c434724 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.225483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-362cb4c5-75a8-4a2a-ad1e-a3b31c434724 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.228786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-362cb4c5-75a8-4a2a-ad1e-a3b31c434724 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.229395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-362cb4c5-75a8-4a2a-ad1e-a3b31c434724 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.391448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-362cb4c5-75a8-4a2a-ad1e-a3b31c434724 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:44.401662 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-362cb4c5-75a8-4a2a-ad1e-a3b31c434724 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1322 microversion: 2.1 time: 0.202254 Sep 10 10:36:44.409966 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 291/619] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:44 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:44.409966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9ce8267a-fda7-4912-aac0-2f683c45b68a tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:44.409966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9ce8267a-fda7-4912-aac0-2f683c45b68a tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:44.416147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce8267a-fda7-4912-aac0-2f683c45b68a tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.417308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce8267a-fda7-4912-aac0-2f683c45b68a tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.417893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce8267a-fda7-4912-aac0-2f683c45b68a tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.418599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce8267a-fda7-4912-aac0-2f683c45b68a tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.419056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce8267a-fda7-4912-aac0-2f683c45b68a tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.419481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce8267a-fda7-4912-aac0-2f683c45b68a tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.424398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:44.570869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:36:44.571499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:36:44.572155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:36:44.572784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:36:44.573479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:36:44.584572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.585337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.585964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.586715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.587484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.587904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.613888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Getting quotas for project c6445fbb5cc5424c82a3c6d07abf7285. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:44.619791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Getting quotas for user 7376851ce7e84c71a18d7d2ac36e5d1f and project c6445fbb5cc5424c82a3c6d07abf7285. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:44.624586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9ce8267a-fda7-4912-aac0-2f683c45b68a tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:44.632402 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9ce8267a-fda7-4912-aac0-2f683c45b68a tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1462 microversion: 2.1 time: 0.228348 Sep 10 10:36:44.633305 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 292/620] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:44 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1462 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:44.636557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:36:44.639765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:36:44.651491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-20dde5ff-e1ab-4593-9ce2-563325a141ae tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:44.652214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-20dde5ff-e1ab-4593-9ce2-563325a141ae tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:44.673404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20dde5ff-e1ab-4593-9ce2-563325a141ae tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.674721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20dde5ff-e1ab-4593-9ce2-563325a141ae tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.676040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20dde5ff-e1ab-4593-9ce2-563325a141ae tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.678557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20dde5ff-e1ab-4593-9ce2-563325a141ae tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.682025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20dde5ff-e1ab-4593-9ce2-563325a141ae tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.683398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20dde5ff-e1ab-4593-9ce2-563325a141ae tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.727691 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e12b9598-03d7-4f19-89ac-6e139d76ccfd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 7.733367 Sep 10 10:36:44.734799 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 329/621] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:36:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 7736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:36:44.749781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:44.750412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:44.774354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.775093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.775531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:44.776787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:44.777393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:44.778141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.038603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20dde5ff-e1ab-4593-9ce2-563325a141ae tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:45.039775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:45.050156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:45.052042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:45.053318 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-94c63cb8-f2e9-4566-b213-c1e4cdc87a4a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1361 microversion: 2.25 time: 0.323978 Sep 10 10:36:45.053764 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-20dde5ff-e1ab-4593-9ce2-563325a141ae tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71" status: 200 len: 1319 microversion: 2.1 time: 0.412694 Sep 10 10:36:45.071854 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 293/623] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:44 2022] GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:45.075101 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 330/623] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:44 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1361 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:45.080258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-64f59098-2c12-47ae-9626-399eb236f0fc req-01ff0927-c1d2-451b-8791-5292ec94aa5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d649fdd-c8f0-4b15-9434-32d88f643ed1", "tag": "87804b23-16c0-45b3-9b2d-4f16c41d16f2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:45.086547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a851298-7e27-400c-84d9-94526680a317 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:45.087029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a851298-7e27-400c-84d9-94526680a317 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:45.090998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-64f59098-2c12-47ae-9626-399eb236f0fc req-01ff0927-c1d2-451b-8791-5292ec94aa5a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.091685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-64f59098-2c12-47ae-9626-399eb236f0fc req-01ff0927-c1d2-451b-8791-5292ec94aa5a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.092279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-64f59098-2c12-47ae-9626-399eb236f0fc req-01ff0927-c1d2-451b-8791-5292ec94aa5a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.100134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a851298-7e27-400c-84d9-94526680a317 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.103129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a851298-7e27-400c-84d9-94526680a317 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.103609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a851298-7e27-400c-84d9-94526680a317 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.104875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a851298-7e27-400c-84d9-94526680a317 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.105370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a851298-7e27-400c-84d9-94526680a317 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.105800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a851298-7e27-400c-84d9-94526680a317 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.115475 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-64f59098-2c12-47ae-9626-399eb236f0fc req-01ff0927-c1d2-451b-8791-5292ec94aa5a service nova] Creating event network-changed:87804b23-16c0-45b3-9b2d-4f16c41d16f2 for instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 on n-h2-856894-1 Sep 10 10:36:45.126902 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-64f59098-2c12-47ae-9626-399eb236f0fc req-01ff0927-c1d2-451b-8791-5292ec94aa5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050334 Sep 10 10:36:45.135612 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 331/624] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:45.146380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-91b81a5a-267d-4404-a519-01ff1e2a25a1 req-9bebb753-d1dd-4a1f-a7e3-8242e86908e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0f0704-e44c-45ed-8cba-86d6ad048f12", "name": "network-vif-plugged", "status": "completed", "tag": "2095cfbd-e6eb-4350-a71e-b4d08d9396b4"}, {"server_uuid": "5cee035c-b7ed-45ea-ae74-1f6e84884f93", "name": "network-vif-plugged", "status": "completed", "tag": "78172492-464d-44c4-9fd7-8bcc7267628a"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:45.170285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-91b81a5a-267d-4404-a519-01ff1e2a25a1 req-9bebb753-d1dd-4a1f-a7e3-8242e86908e6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.170953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-91b81a5a-267d-4404-a519-01ff1e2a25a1 req-9bebb753-d1dd-4a1f-a7e3-8242e86908e6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.171924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-91b81a5a-267d-4404-a519-01ff1e2a25a1 req-9bebb753-d1dd-4a1f-a7e3-8242e86908e6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.203746 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-91b81a5a-267d-4404-a519-01ff1e2a25a1 req-9bebb753-d1dd-4a1f-a7e3-8242e86908e6 service nova] Creating event network-vif-plugged:2095cfbd-e6eb-4350-a71e-b4d08d9396b4 for instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 on n-h1-856894-1 Sep 10 10:36:45.203746 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-91b81a5a-267d-4404-a519-01ff1e2a25a1 req-9bebb753-d1dd-4a1f-a7e3-8242e86908e6 service nova] Creating event network-vif-plugged:78172492-464d-44c4-9fd7-8bcc7267628a for instance 5cee035c-b7ed-45ea-ae74-1f6e84884f93 on n-h2-856894-1 Sep 10 10:36:45.240703 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-91b81a5a-267d-4404-a519-01ff1e2a25a1 req-9bebb753-d1dd-4a1f-a7e3-8242e86908e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102797 Sep 10 10:36:45.247398 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 332/625] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:45.270494 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a851298-7e27-400c-84d9-94526680a317 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.197238 Sep 10 10:36:45.271226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-f2711630-ff23-475d-80b9-53c01fdc7dc2 req-c71ded9e-94b7-4796-b5a4-14aba8feedd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1be72b7-1010-4f8d-84c0-27c703292bb0", "tag": "40d8ed62-742d-47d4-ace6-1adbfa066aca"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:45.271531 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 294/626] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:36:45 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:45.276418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1427de55-bbad-473d-a01e-fb891d270c4c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaee90ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:45.315163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f2711630-ff23-475d-80b9-53c01fdc7dc2 req-c71ded9e-94b7-4796-b5a4-14aba8feedd1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.316028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f2711630-ff23-475d-80b9-53c01fdc7dc2 req-c71ded9e-94b7-4796-b5a4-14aba8feedd1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.316481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f2711630-ff23-475d-80b9-53c01fdc7dc2 req-c71ded9e-94b7-4796-b5a4-14aba8feedd1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.359306 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-f2711630-ff23-475d-80b9-53c01fdc7dc2 req-c71ded9e-94b7-4796-b5a4-14aba8feedd1 service nova] Creating event network-changed:40d8ed62-742d-47d4-ace6-1adbfa066aca for instance c1be72b7-1010-4f8d-84c0-27c703292bb0 on n-h1-856894-1 Sep 10 10:36:45.371448 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1427de55-bbad-473d-a01e-fb891d270c4c tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d" status: 200 len: 1436 microversion: 2.1 time: 0.098636 Sep 10 10:36:45.372550 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 295/627] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:36:45 2022] GET /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d => generated 1436 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:45.376202 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-f2711630-ff23-475d-80b9-53c01fdc7dc2 req-c71ded9e-94b7-4796-b5a4-14aba8feedd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126422 Sep 10 10:36:45.380468 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 333/628] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:45.392591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0db03623-9e73-4169-ae54-ae07bfe6d068 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:45.405786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0db03623-9e73-4169-ae54-ae07bfe6d068 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:45.592367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ca5aa09f-f73e-4c17-8424-94507d0184fc tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Calling method '.version_select at 0x7efcaee904c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:45.627206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5aa09f-f73e-4c17-8424-94507d0184fc tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.627699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5aa09f-f73e-4c17-8424-94507d0184fc tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.628133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5aa09f-f73e-4c17-8424-94507d0184fc tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.659884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5aa09f-f73e-4c17-8424-94507d0184fc tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.660370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5aa09f-f73e-4c17-8424-94507d0184fc tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.660805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5aa09f-f73e-4c17-8424-94507d0184fc tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.679900 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ca5aa09f-f73e-4c17-8424-94507d0184fc tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/ee9906c0571e482dbdfaf79228428a76?start=2022-09-09T10%3A36%3A44.652129&end=2022-09-11T10%3A36%3A44.652129" status: 200 len: 690 microversion: 2.1 time: 0.302842 Sep 10 10:36:45.680400 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 296/629] 10.222.0.20 () {58 vars in 1412 bytes} [Sat Sep 10 10:36:45 2022] GET /compute/v2.1/os-simple-tenant-usage/ee9906c0571e482dbdfaf79228428a76?start=2022-09-09T10%3A36%3A44.652129&end=2022-09-11T10%3A36%3A44.652129 => generated 690 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:45.696151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9f35fb56-3a8a-4749-9642-b6d0acbaca5a tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:45.696770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9f35fb56-3a8a-4749-9642-b6d0acbaca5a tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:45.709172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f35fb56-3a8a-4749-9642-b6d0acbaca5a tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.709677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f35fb56-3a8a-4749-9642-b6d0acbaca5a tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.710117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f35fb56-3a8a-4749-9642-b6d0acbaca5a tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.710878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f35fb56-3a8a-4749-9642-b6d0acbaca5a tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.711391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f35fb56-3a8a-4749-9642-b6d0acbaca5a tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.711824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f35fb56-3a8a-4749-9642-b6d0acbaca5a tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.725657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0db03623-9e73-4169-ae54-ae07bfe6d068 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:45.737116 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0db03623-9e73-4169-ae54-ae07bfe6d068 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1241 microversion: 2.1 time: 0.355108 Sep 10 10:36:45.750805 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 334/630] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:45 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1241 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:45.759558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d5b0bc8-8e8a-4f1b-b550-132957888415 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:45.760506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2d5b0bc8-8e8a-4f1b-b550-132957888415 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:45.768164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5b0bc8-8e8a-4f1b-b550-132957888415 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.769050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5b0bc8-8e8a-4f1b-b550-132957888415 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.769729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5b0bc8-8e8a-4f1b-b550-132957888415 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.771295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5b0bc8-8e8a-4f1b-b550-132957888415 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.771973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5b0bc8-8e8a-4f1b-b550-132957888415 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.772651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5b0bc8-8e8a-4f1b-b550-132957888415 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.944232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9f35fb56-3a8a-4749-9642-b6d0acbaca5a tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:45.953054 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9f35fb56-3a8a-4749-9642-b6d0acbaca5a tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1371 microversion: 2.1 time: 0.260770 Sep 10 10:36:45.953733 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 297/631] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:45 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:45.961914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63afb8ab-dc01-4459-b155-22a65a53752e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:45.963060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63afb8ab-dc01-4459-b155-22a65a53752e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:45.971755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63afb8ab-dc01-4459-b155-22a65a53752e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.972244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63afb8ab-dc01-4459-b155-22a65a53752e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.972672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63afb8ab-dc01-4459-b155-22a65a53752e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:45.973575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63afb8ab-dc01-4459-b155-22a65a53752e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:45.974254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63afb8ab-dc01-4459-b155-22a65a53752e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:45.974680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63afb8ab-dc01-4459-b155-22a65a53752e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.038768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d5b0bc8-8e8a-4f1b-b550-132957888415 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:46.049578 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d5b0bc8-8e8a-4f1b-b550-132957888415 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1465 microversion: 2.1 time: 0.296882 Sep 10 10:36:46.051236 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 335/632] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:45 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1465 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:46.056037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cd88142e-9814-4768-9df3-92dafb7c89d0 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '.version_select at 0x7efcaef06430>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:46.066097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd88142e-9814-4768-9df3-92dafb7c89d0 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.069368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd88142e-9814-4768-9df3-92dafb7c89d0 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.071899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd88142e-9814-4768-9df3-92dafb7c89d0 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.097053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd88142e-9814-4768-9df3-92dafb7c89d0 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.097693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd88142e-9814-4768-9df3-92dafb7c89d0 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.098208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd88142e-9814-4768-9df3-92dafb7c89d0 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.128314 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cd88142e-9814-4768-9df3-92dafb7c89d0 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/ee9906c0571e482dbdfaf79228428a76?start=2022-09-09T10%3A36%3A44.652129&end=2022-09-11T10%3A36%3A44.652129" status: 200 len: 694 microversion: 2.1 time: 0.075954 Sep 10 10:36:46.129003 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 336/633] 10.222.0.20 () {58 vars in 1412 bytes} [Sat Sep 10 10:36:46 2022] GET /compute/v2.1/os-simple-tenant-usage/ee9906c0571e482dbdfaf79228428a76?start=2022-09-09T10%3A36%3A44.652129&end=2022-09-11T10%3A36%3A44.652129 => generated 694 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:46.143200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-570d7bba-9851-4bdb-b5e5-7521759e85b5 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef8f8b0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:46.147076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63afb8ab-dc01-4459-b155-22a65a53752e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:46.157061 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63afb8ab-dc01-4459-b155-22a65a53752e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1322 microversion: 2.1 time: 0.201983 Sep 10 10:36:46.158505 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 298/634] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:45 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:46.163452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d02f04af-0e91-408e-b058-f2b91ff94b30 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:46.164326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d02f04af-0e91-408e-b058-f2b91ff94b30 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:46.171193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d02f04af-0e91-408e-b058-f2b91ff94b30 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.171999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d02f04af-0e91-408e-b058-f2b91ff94b30 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.172687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d02f04af-0e91-408e-b058-f2b91ff94b30 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.173647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d02f04af-0e91-408e-b058-f2b91ff94b30 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.174349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d02f04af-0e91-408e-b058-f2b91ff94b30 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.174993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d02f04af-0e91-408e-b058-f2b91ff94b30 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.342139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d02f04af-0e91-408e-b058-f2b91ff94b30 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:46.354291 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d02f04af-0e91-408e-b058-f2b91ff94b30 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71" status: 200 len: 1319 microversion: 2.1 time: 0.194355 Sep 10 10:36:46.355799 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 299/635] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:46 2022] GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:46.367997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:46.368700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:46.381826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.382393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.382917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.383846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.384378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.385011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.624812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:46.641135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:46.643787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:46.645226 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63ce6411-a417-4cf0-8f18-ba5de55ce6d3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1361 microversion: 2.25 time: 0.288708 Sep 10 10:36:46.646006 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 300/636] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:46 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:46.654754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2eca3467-6261-4a2f-9171-4862814b3ba0 tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Calling method '.version_select at 0x7efcaef23790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:46.671487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eca3467-6261-4a2f-9171-4862814b3ba0 tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.672163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eca3467-6261-4a2f-9171-4862814b3ba0 tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.673405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eca3467-6261-4a2f-9171-4862814b3ba0 tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.696111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eca3467-6261-4a2f-9171-4862814b3ba0 tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.700483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eca3467-6261-4a2f-9171-4862814b3ba0 tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.701039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eca3467-6261-4a2f-9171-4862814b3ba0 tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.752886 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2eca3467-6261-4a2f-9171-4862814b3ba0 tempest-TenantUsagesTestJSON-1600941810 tempest-TenantUsagesTestJSON-1600941810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T10%3A36%3A44.652129&end=2022-09-11T10%3A36%3A44.652129&detailed=1" status: 200 len: 6814 microversion: 2.1 time: 0.101501 Sep 10 10:36:46.753901 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 301/637] 10.222.0.20 () {58 vars in 1335 bytes} [Sat Sep 10 10:36:46 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T10%3A36%3A44.652129&end=2022-09-11T10%3A36%3A44.652129&detailed=1 => generated 6814 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:46.770594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42bdc10d-51de-4ea1-b740-3e9a0401a760 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:46.771239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42bdc10d-51de-4ea1-b740-3e9a0401a760 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:46.781793 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-570d7bba-9851-4bdb-b5e5-7521759e85b5 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "DELETE /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d" status: 204 len: 0 microversion: 2.1 time: 0.647527 Sep 10 10:36:46.782703 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 337/638] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:46 2022] DELETE /compute/v2.1/images/f4a7ea44-2aea-471f-999e-38a6cbe5b96d => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:36:46.784192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42bdc10d-51de-4ea1-b740-3e9a0401a760 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.784832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42bdc10d-51de-4ea1-b740-3e9a0401a760 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.785156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42bdc10d-51de-4ea1-b740-3e9a0401a760 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.786262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42bdc10d-51de-4ea1-b740-3e9a0401a760 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.786831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42bdc10d-51de-4ea1-b740-3e9a0401a760 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.787315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42bdc10d-51de-4ea1-b740-3e9a0401a760 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.788124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0f1dee32-c90e-47ce-97a3-b9f73b6cd9db tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:46.788925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0f1dee32-c90e-47ce-97a3-b9f73b6cd9db tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:46.802433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f1dee32-c90e-47ce-97a3-b9f73b6cd9db tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.803283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f1dee32-c90e-47ce-97a3-b9f73b6cd9db tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.803814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f1dee32-c90e-47ce-97a3-b9f73b6cd9db tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.804602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f1dee32-c90e-47ce-97a3-b9f73b6cd9db tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.805178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f1dee32-c90e-47ce-97a3-b9f73b6cd9db tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.805709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f1dee32-c90e-47ce-97a3-b9f73b6cd9db tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.874432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0f1dee32-c90e-47ce-97a3-b9f73b6cd9db tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:46.880291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:46.887423 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0f1dee32-c90e-47ce-97a3-b9f73b6cd9db tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1293 microversion: 2.1 time: 0.103316 Sep 10 10:36:46.909165 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 338/639] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:46 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:46.917859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-34830b9e-b3ce-474f-9c3f-59348c68a0b8 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:46.918950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-34830b9e-b3ce-474f-9c3f-59348c68a0b8 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:46.929064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34830b9e-b3ce-474f-9c3f-59348c68a0b8 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.929845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34830b9e-b3ce-474f-9c3f-59348c68a0b8 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.931009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34830b9e-b3ce-474f-9c3f-59348c68a0b8 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.932118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34830b9e-b3ce-474f-9c3f-59348c68a0b8 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:46.933956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34830b9e-b3ce-474f-9c3f-59348c68a0b8 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:46.934578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34830b9e-b3ce-474f-9c3f-59348c68a0b8 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:46.974896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-34830b9e-b3ce-474f-9c3f-59348c68a0b8 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:36:47.064249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-42bdc10d-51de-4ea1-b740-3e9a0401a760 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:47.074642 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42bdc10d-51de-4ea1-b740-3e9a0401a760 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1587 microversion: 2.1 time: 0.308665 Sep 10 10:36:47.077061 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 302/640] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:46 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1587 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:47.089758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c93f8159-f8b5-482d-83aa-2473a481cb56 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '.version_select at 0x7efcaef238b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:47.144056 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-34830b9e-b3ce-474f-9c3f-59348c68a0b8 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 204 len: 0 microversion: 2.1 time: 0.232005 Sep 10 10:36:47.147463 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 339/641] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:36:46 2022] DELETE /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:36:47.151220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bcfd54a0-f150-4636-9ced-fedd3d11d0f0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:47.151977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bcfd54a0-f150-4636-9ced-fedd3d11d0f0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:47.163155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfd54a0-f150-4636-9ced-fedd3d11d0f0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.163821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfd54a0-f150-4636-9ced-fedd3d11d0f0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.164678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfd54a0-f150-4636-9ced-fedd3d11d0f0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.165139 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c93f8159-f8b5-482d-83aa-2473a481cb56 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] HTTP exception thrown: Image not found. Sep 10 10:36:47.166201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfd54a0-f150-4636-9ced-fedd3d11d0f0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.166870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfd54a0-f150-4636-9ced-fedd3d11d0f0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.167440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfd54a0-f150-4636-9ced-fedd3d11d0f0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c93f8159-f8b5-482d-83aa-2473a481cb56 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Request method failure captured: Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 HTTP/1.1 Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhgLqot1Lj54BIHb5Qy3GTMYCSnvGn_gMdcg5rKKznfMkVTiehK15UcUvvYA1J4Lm3JYYZyjFsJ0eRXxP-YCG65Y3i4Bqqp8vLGtZEC8P1SH2Yv1z8cI3HLp5VIP53pGPKLIgXSf-d1ZYlIEEJZ-k1hDsd1tFidox8TlbTfwN-kZDk Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 3a85977a2f5a4870b65488cf83cce911 Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerTestJSON-2069047134 Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:36:47.167660 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a85977a2f5a4870b65488cf83cce911"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a85977a2f5a4870b65488cf83cce911"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a85977a2f5a4870b65488cf83cce911"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a85977a2f5a4870b65488cf83cce911", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerTestJSON-2069047134 Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 3a85977a2f5a4870b65488cf83cce911 Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2069047134 Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerTestJSON-2069047134-project Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3ae584a919844c5584e066606c9efd36 Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerTestJSON-2069047134-project Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7284d73b-2907-4e88-862b-7933b12c5f27'} Sep 10 10:36:47.169267 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7284d73b-2907-4e88-862b-7933b12c5f27 to delete Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:47.170211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7284d73b-2907-4e88-862b-7933b12c5f27 could not be found. Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:36:47.171578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:47.172985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c93f8159-f8b5-482d-83aa-2473a481cb56 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:36:47.174609 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c93f8159-f8b5-482d-83aa-2473a481cb56 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "DELETE /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27" status: 404 len: 62 microversion: 2.1 time: 0.094480 Sep 10 10:36:47.178548 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 303/642] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:47 2022] DELETE /compute/v2.1/images/7284d73b-2907-4e88-862b-7933b12c5f27 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:36:47.185205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c08a94db-a1ef-40e7-a7ee-19b857834171 req-39041d86-ffd7-446f-ab8f-d5aef4f17e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23eada90-68cc-4481-82cf-c536ef3fcc71", "tag": "c0320f23-8c07-4224-847b-62bd846dc47d"}, {"name": "network-changed", "server_uuid": "7a85385a-d49e-42c6-ade1-56cedcc85d9e", "tag": "9607736b-aa48-4813-914a-a2282cc916aa"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:47.198055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c08a94db-a1ef-40e7-a7ee-19b857834171 req-39041d86-ffd7-446f-ab8f-d5aef4f17e7a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.199273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c08a94db-a1ef-40e7-a7ee-19b857834171 req-39041d86-ffd7-446f-ab8f-d5aef4f17e7a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.199811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c08a94db-a1ef-40e7-a7ee-19b857834171 req-39041d86-ffd7-446f-ab8f-d5aef4f17e7a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.214173 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c08a94db-a1ef-40e7-a7ee-19b857834171 req-39041d86-ffd7-446f-ab8f-d5aef4f17e7a service nova] Creating event network-changed:c0320f23-8c07-4224-847b-62bd846dc47d for instance 23eada90-68cc-4481-82cf-c536ef3fcc71 on n-h2-856894-1 Sep 10 10:36:47.214881 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c08a94db-a1ef-40e7-a7ee-19b857834171 req-39041d86-ffd7-446f-ab8f-d5aef4f17e7a service nova] Creating event network-changed:9607736b-aa48-4813-914a-a2282cc916aa for instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e on n-h2-856894-1 Sep 10 10:36:47.222561 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c08a94db-a1ef-40e7-a7ee-19b857834171 req-39041d86-ffd7-446f-ab8f-d5aef4f17e7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042455 Sep 10 10:36:47.223574 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 304/643] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:47.231498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ec716b7-7ff9-46aa-b5c4-df058508d1a1 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:47.233623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8ec716b7-7ff9-46aa-b5c4-df058508d1a1 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:47.240724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ec716b7-7ff9-46aa-b5c4-df058508d1a1 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.241555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ec716b7-7ff9-46aa-b5c4-df058508d1a1 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.242467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ec716b7-7ff9-46aa-b5c4-df058508d1a1 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.243388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ec716b7-7ff9-46aa-b5c4-df058508d1a1 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.244084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ec716b7-7ff9-46aa-b5c4-df058508d1a1 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.244756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ec716b7-7ff9-46aa-b5c4-df058508d1a1 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.338115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bcfd54a0-f150-4636-9ced-fedd3d11d0f0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:47.348015 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bcfd54a0-f150-4636-9ced-fedd3d11d0f0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1371 microversion: 2.1 time: 0.201614 Sep 10 10:36:47.361568 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 340/644] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:47 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:47.369931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bbba9671-5937-4e38-9b14-7c088d145276 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:47.371297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bbba9671-5937-4e38-9b14-7c088d145276 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:47.378901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbba9671-5937-4e38-9b14-7c088d145276 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.380306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbba9671-5937-4e38-9b14-7c088d145276 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.380963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbba9671-5937-4e38-9b14-7c088d145276 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.382067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbba9671-5937-4e38-9b14-7c088d145276 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.382733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbba9671-5937-4e38-9b14-7c088d145276 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.383384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bbba9671-5937-4e38-9b14-7c088d145276 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.418628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bbba9671-5937-4e38-9b14-7c088d145276 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:36:47.520332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8ec716b7-7ff9-46aa-b5c4-df058508d1a1 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:47.539557 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ec716b7-7ff9-46aa-b5c4-df058508d1a1 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1468 microversion: 2.1 time: 0.310101 Sep 10 10:36:47.541526 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 305/645] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:47 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1468 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:47.549999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ef050f0-ae0f-4bac-af2e-b12af0aa99f6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:47.551907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ef050f0-ae0f-4bac-af2e-b12af0aa99f6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:47.571847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ef050f0-ae0f-4bac-af2e-b12af0aa99f6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.572453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ef050f0-ae0f-4bac-af2e-b12af0aa99f6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.572801 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bbba9671-5937-4e38-9b14-7c088d145276 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 204 len: 0 microversion: 2.1 time: 0.209198 Sep 10 10:36:47.573473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ef050f0-ae0f-4bac-af2e-b12af0aa99f6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.574320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ef050f0-ae0f-4bac-af2e-b12af0aa99f6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.574804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ef050f0-ae0f-4bac-af2e-b12af0aa99f6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.575326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ef050f0-ae0f-4bac-af2e-b12af0aa99f6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.576382 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 341/646] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:36:47 2022] DELETE /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:36:47.584682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-5c9ff334-9ea5-40c1-a1c2-8a8082a36d81 req-0eded2d8-bc7a-40b0-a3b2-d09119a863ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1be72b7-1010-4f8d-84c0-27c703292bb0", "name": "network-vif-plugged", "status": "completed", "tag": "40d8ed62-742d-47d4-ace6-1adbfa066aca"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:47.601279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5c9ff334-9ea5-40c1-a1c2-8a8082a36d81 req-0eded2d8-bc7a-40b0-a3b2-d09119a863ea service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.601926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5c9ff334-9ea5-40c1-a1c2-8a8082a36d81 req-0eded2d8-bc7a-40b0-a3b2-d09119a863ea service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.602454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5c9ff334-9ea5-40c1-a1c2-8a8082a36d81 req-0eded2d8-bc7a-40b0-a3b2-d09119a863ea service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.616879 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-5c9ff334-9ea5-40c1-a1c2-8a8082a36d81 req-0eded2d8-bc7a-40b0-a3b2-d09119a863ea service nova] Creating event network-vif-plugged:40d8ed62-742d-47d4-ace6-1adbfa066aca for instance c1be72b7-1010-4f8d-84c0-27c703292bb0 on n-h1-856894-1 Sep 10 10:36:47.627905 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-5c9ff334-9ea5-40c1-a1c2-8a8082a36d81 req-0eded2d8-bc7a-40b0-a3b2-d09119a863ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046927 Sep 10 10:36:47.628956 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 342/647] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:47.646021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b0a98437-86f4-45f0-8726-ce718e669079 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:47.646760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b0a98437-86f4-45f0-8726-ce718e669079 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:47.653378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0a98437-86f4-45f0-8726-ce718e669079 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.653831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0a98437-86f4-45f0-8726-ce718e669079 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.654359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0a98437-86f4-45f0-8726-ce718e669079 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.655038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0a98437-86f4-45f0-8726-ce718e669079 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.655670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0a98437-86f4-45f0-8726-ce718e669079 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.656087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0a98437-86f4-45f0-8726-ce718e669079 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.780112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ef050f0-ae0f-4bac-af2e-b12af0aa99f6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:47.797488 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ef050f0-ae0f-4bac-af2e-b12af0aa99f6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1322 microversion: 2.1 time: 0.250978 Sep 10 10:36:47.797488 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 306/648] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:47 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:47.798792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff76809c-9b60-4882-9bda-a581064daabb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:47.799393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff76809c-9b60-4882-9bda-a581064daabb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:47.808861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff76809c-9b60-4882-9bda-a581064daabb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.809454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff76809c-9b60-4882-9bda-a581064daabb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.809887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff76809c-9b60-4882-9bda-a581064daabb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.810573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff76809c-9b60-4882-9bda-a581064daabb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.811064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff76809c-9b60-4882-9bda-a581064daabb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.811488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff76809c-9b60-4882-9bda-a581064daabb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.855866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b0a98437-86f4-45f0-8726-ce718e669079 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:47.865376 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b0a98437-86f4-45f0-8726-ce718e669079 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71" status: 200 len: 1319 microversion: 2.1 time: 0.235087 Sep 10 10:36:47.866600 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 343/649] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:47 2022] GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:47.875412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:47.876280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:47.882773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.883376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.883810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.884726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.886448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.887041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.965590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff76809c-9b60-4882-9bda-a581064daabb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:47.973627 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff76809c-9b60-4882-9bda-a581064daabb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1471 microversion: 2.1 time: 0.178297 Sep 10 10:36:47.974527 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 307/650] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:47 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:47.978958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33c80795-ee53-4cf4-bcbb-c1dcc6f1d1f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:47.979566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-33c80795-ee53-4cf4-bcbb-c1dcc6f1d1f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:47.985666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33c80795-ee53-4cf4-bcbb-c1dcc6f1d1f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.986171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33c80795-ee53-4cf4-bcbb-c1dcc6f1d1f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.986611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33c80795-ee53-4cf4-bcbb-c1dcc6f1d1f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:47.987377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33c80795-ee53-4cf4-bcbb-c1dcc6f1d1f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:47.987844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33c80795-ee53-4cf4-bcbb-c1dcc6f1d1f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:47.988273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33c80795-ee53-4cf4-bcbb-c1dcc6f1d1f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.038723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:48.047879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:48.049456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:48.050623 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fe0e1d04-3a87-4541-ac59-c0f44732194c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1558 microversion: 2.25 time: 0.180478 Sep 10 10:36:48.051190 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 344/651] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:47 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:48.052839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-33c80795-ee53-4cf4-bcbb-c1dcc6f1d1f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:48.061324 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-33c80795-ee53-4cf4-bcbb-c1dcc6f1d1f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1299 microversion: 2.1 time: 0.085782 Sep 10 10:36:48.061894 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 308/652] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:47 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:48.150277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0fce285e-c7a4-4447-8f4b-67aa85390758 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:48.151216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0fce285e-c7a4-4447-8f4b-67aa85390758 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:48.160149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fce285e-c7a4-4447-8f4b-67aa85390758 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.160938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fce285e-c7a4-4447-8f4b-67aa85390758 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.161446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fce285e-c7a4-4447-8f4b-67aa85390758 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.162792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fce285e-c7a4-4447-8f4b-67aa85390758 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.162792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fce285e-c7a4-4447-8f4b-67aa85390758 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.163002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fce285e-c7a4-4447-8f4b-67aa85390758 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.372816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-0fce285e-c7a4-4447-8f4b-67aa85390758 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid 6c0f0704-e44c-45ed-8cba-86d6ad048f12 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:36:48.374878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dce93ed2-b3d9-41e8-a10b-2a2e50c1984d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:48.375483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dce93ed2-b3d9-41e8-a10b-2a2e50c1984d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:48.382016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dce93ed2-b3d9-41e8-a10b-2a2e50c1984d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.382700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dce93ed2-b3d9-41e8-a10b-2a2e50c1984d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.383362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dce93ed2-b3d9-41e8-a10b-2a2e50c1984d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.384355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dce93ed2-b3d9-41e8-a10b-2a2e50c1984d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.384973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dce93ed2-b3d9-41e8-a10b-2a2e50c1984d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.385937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dce93ed2-b3d9-41e8-a10b-2a2e50c1984d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.428317 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0fce285e-c7a4-4447-8f4b-67aa85390758 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 2050 microversion: 2.25 time: 0.356308 Sep 10 10:36:48.428909 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 345/653] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:48 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 2050 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:48.452448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d68f2e67-7349-4499-a588-1a84a310a3fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:48.453051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d68f2e67-7349-4499-a588-1a84a310a3fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:48.458870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d68f2e67-7349-4499-a588-1a84a310a3fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.459458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d68f2e67-7349-4499-a588-1a84a310a3fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.459900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d68f2e67-7349-4499-a588-1a84a310a3fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.460589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d68f2e67-7349-4499-a588-1a84a310a3fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.461042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d68f2e67-7349-4499-a588-1a84a310a3fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.461491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d68f2e67-7349-4499-a588-1a84a310a3fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.515889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dce93ed2-b3d9-41e8-a10b-2a2e50c1984d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:48.523473 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dce93ed2-b3d9-41e8-a10b-2a2e50c1984d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1371 microversion: 2.1 time: 0.152486 Sep 10 10:36:48.524050 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 309/654] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:48 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:36:48.568605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eef75874-8dad-457f-ac8f-2f1a8f634739 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:48.569330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eef75874-8dad-457f-ac8f-2f1a8f634739 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:48.580864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eef75874-8dad-457f-ac8f-2f1a8f634739 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.581455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eef75874-8dad-457f-ac8f-2f1a8f634739 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.581999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eef75874-8dad-457f-ac8f-2f1a8f634739 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.582764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eef75874-8dad-457f-ac8f-2f1a8f634739 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.583220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eef75874-8dad-457f-ac8f-2f1a8f634739 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.583703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eef75874-8dad-457f-ac8f-2f1a8f634739 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.593564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-d68f2e67-7349-4499-a588-1a84a310a3fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid 6c0f0704-e44c-45ed-8cba-86d6ad048f12 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:36:48.606583 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d68f2e67-7349-4499-a588-1a84a310a3fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 2050 microversion: 2.25 time: 0.158218 Sep 10 10:36:48.607157 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 346/655] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:48 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 2050 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:36:48.631285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1d997bbd-c4cf-4479-ae93-2e3bbdb43c5c tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:48.636781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d997bbd-c4cf-4479-ae93-2e3bbdb43c5c tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.637531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d997bbd-c4cf-4479-ae93-2e3bbdb43c5c tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.638215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d997bbd-c4cf-4479-ae93-2e3bbdb43c5c tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.639282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d997bbd-c4cf-4479-ae93-2e3bbdb43c5c tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.639732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d997bbd-c4cf-4479-ae93-2e3bbdb43c5c tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.640150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d997bbd-c4cf-4479-ae93-2e3bbdb43c5c tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.667847 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1d997bbd-c4cf-4479-ae93-2e3bbdb43c5c tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.040411 Sep 10 10:36:48.668453 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 347/656] 10.222.0.20 () {60 vars in 1217 bytes} [Sat Sep 10 10:36:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 10:36:48.680397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-856894-1", "block_migration": "auto"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:48.682923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:48.694105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.694591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.695017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.695710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.696157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.696572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.722611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'flavor' on Instance uuid 6c0f0704-e44c-45ed-8cba-86d6ad048f12 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:36:48.735281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Going to try to live migrate instance to n-h2-856894-1 {{(pid=128787) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 10:36:48.735838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eef75874-8dad-457f-ac8f-2f1a8f634739 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:48.743999 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eef75874-8dad-457f-ac8f-2f1a8f634739 tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1468 microversion: 2.1 time: 0.182011 Sep 10 10:36:48.753144 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 310/657] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:48 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1468 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:36:48.822070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2aa5d194-e86b-444b-92d1-eaf9fdc6be1e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:48.822700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2aa5d194-e86b-444b-92d1-eaf9fdc6be1e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:48.830914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa5d194-e86b-444b-92d1-eaf9fdc6be1e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.831413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa5d194-e86b-444b-92d1-eaf9fdc6be1e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.831854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa5d194-e86b-444b-92d1-eaf9fdc6be1e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.832750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa5d194-e86b-444b-92d1-eaf9fdc6be1e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:48.833233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa5d194-e86b-444b-92d1-eaf9fdc6be1e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:48.833662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa5d194-e86b-444b-92d1-eaf9fdc6be1e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:48.975531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2aa5d194-e86b-444b-92d1-eaf9fdc6be1e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:48.984849 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2aa5d194-e86b-444b-92d1-eaf9fdc6be1e tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1322 microversion: 2.1 time: 0.170016 Sep 10 10:36:48.985459 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 311/658] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:48 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:48.990331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad2d7985-3269-4307-8add-de75cf57f13a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:48.992793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ad2d7985-3269-4307-8add-de75cf57f13a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:49.000144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad2d7985-3269-4307-8add-de75cf57f13a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:49.000637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad2d7985-3269-4307-8add-de75cf57f13a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:49.001106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad2d7985-3269-4307-8add-de75cf57f13a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:49.001870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad2d7985-3269-4307-8add-de75cf57f13a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:49.002303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad2d7985-3269-4307-8add-de75cf57f13a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:49.002721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad2d7985-3269-4307-8add-de75cf57f13a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:49.134171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ad2d7985-3269-4307-8add-de75cf57f13a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:49.142497 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad2d7985-3269-4307-8add-de75cf57f13a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71" status: 200 len: 1319 microversion: 2.1 time: 0.155973 Sep 10 10:36:49.143130 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 312/659] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:48 2022] GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:49.158577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ae064ce-6348-481e-bb31-d0630651ffbb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:49.158577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6ae064ce-6348-481e-bb31-d0630651ffbb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:49.158577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae064ce-6348-481e-bb31-d0630651ffbb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:49.158577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae064ce-6348-481e-bb31-d0630651ffbb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:49.158946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae064ce-6348-481e-bb31-d0630651ffbb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:49.158946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae064ce-6348-481e-bb31-d0630651ffbb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:49.158946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae064ce-6348-481e-bb31-d0630651ffbb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:49.158946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae064ce-6348-481e-bb31-d0630651ffbb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:49.161363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:49.328140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6ae064ce-6348-481e-bb31-d0630651ffbb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:49.336080 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ae064ce-6348-481e-bb31-d0630651ffbb tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1471 microversion: 2.1 time: 0.191994 Sep 10 10:36:49.336657 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 313/660] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:49 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:49.342371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2bc22209-1c30-4b07-8cb8-a4300be7ad8e tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:49.342962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2bc22209-1c30-4b07-8cb8-a4300be7ad8e tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:49.348587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc22209-1c30-4b07-8cb8-a4300be7ad8e tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:49.349176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc22209-1c30-4b07-8cb8-a4300be7ad8e tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:49.349539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc22209-1c30-4b07-8cb8-a4300be7ad8e tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:49.350227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc22209-1c30-4b07-8cb8-a4300be7ad8e tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:49.350681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc22209-1c30-4b07-8cb8-a4300be7ad8e tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:49.351108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc22209-1c30-4b07-8cb8-a4300be7ad8e tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:49.421119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2bc22209-1c30-4b07-8cb8-a4300be7ad8e tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:49.429946 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2bc22209-1c30-4b07-8cb8-a4300be7ad8e tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1299 microversion: 2.1 time: 0.092252 Sep 10 10:36:49.430773 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 314/661] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:49 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:49.548953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38e4ed00-acb6-4398-a254-fd2cf1e8411b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:49.549717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38e4ed00-acb6-4398-a254-fd2cf1e8411b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:49.560181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38e4ed00-acb6-4398-a254-fd2cf1e8411b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:49.560773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38e4ed00-acb6-4398-a254-fd2cf1e8411b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:49.561377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38e4ed00-acb6-4398-a254-fd2cf1e8411b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:49.562205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38e4ed00-acb6-4398-a254-fd2cf1e8411b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:49.562752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38e4ed00-acb6-4398-a254-fd2cf1e8411b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:49.563182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38e4ed00-acb6-4398-a254-fd2cf1e8411b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:50.169509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38e4ed00-acb6-4398-a254-fd2cf1e8411b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:50.177344 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38e4ed00-acb6-4398-a254-fd2cf1e8411b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1371 microversion: 2.1 time: 0.632861 Sep 10 10:36:50.177995 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 315/662] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:49 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1371 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:36:50.183031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4627d41b-77a0-494b-83d0-8806e95e32da req-2dd778b4-eb79-443e-8ce5-1eaa7a4ca567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c8aaac-8fb1-4334-a972-492a119fc8d5", "name": "network-vif-unplugged", "status": "completed", "tag": "0269a13f-cff8-4c12-b6cc-739e948a57b0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:50.192386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4627d41b-77a0-494b-83d0-8806e95e32da req-2dd778b4-eb79-443e-8ce5-1eaa7a4ca567 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:50.192960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4627d41b-77a0-494b-83d0-8806e95e32da req-2dd778b4-eb79-443e-8ce5-1eaa7a4ca567 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:50.193482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4627d41b-77a0-494b-83d0-8806e95e32da req-2dd778b4-eb79-443e-8ce5-1eaa7a4ca567 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:50.205984 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4627d41b-77a0-494b-83d0-8806e95e32da req-2dd778b4-eb79-443e-8ce5-1eaa7a4ca567 service nova] Creating event network-vif-unplugged:0269a13f-cff8-4c12-b6cc-739e948a57b0 for instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 on n-h1-856894-1 Sep 10 10:36:50.210858 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4627d41b-77a0-494b-83d0-8806e95e32da req-2dd778b4-eb79-443e-8ce5-1eaa7a4ca567 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031705 Sep 10 10:36:50.211627 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 316/663] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:50.216456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec2f9be6-a2ab-4837-92d6-9686748964ad tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:50.217184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec2f9be6-a2ab-4837-92d6-9686748964ad tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:50.223312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec2f9be6-a2ab-4837-92d6-9686748964ad tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:50.223797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec2f9be6-a2ab-4837-92d6-9686748964ad tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:50.224233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec2f9be6-a2ab-4837-92d6-9686748964ad tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:50.224927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec2f9be6-a2ab-4837-92d6-9686748964ad tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:50.225411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec2f9be6-a2ab-4837-92d6-9686748964ad tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:50.225837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec2f9be6-a2ab-4837-92d6-9686748964ad tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:50.677601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec2f9be6-a2ab-4837-92d6-9686748964ad tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0796d5eeef94d4eb7d7f0a1e0490f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9906c0571e482dbdfaf79228428a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:50.712781 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec2f9be6-a2ab-4837-92d6-9686748964ad tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 200 len: 1468 microversion: 2.1 time: 0.498174 Sep 10 10:36:50.729923 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 317/664] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:50 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 1468 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:50.744466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65091573-5e15-43d3-b53f-93aabebcf003 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:50.746018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65091573-5e15-43d3-b53f-93aabebcf003 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:50.783131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65091573-5e15-43d3-b53f-93aabebcf003 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:50.783800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65091573-5e15-43d3-b53f-93aabebcf003 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:50.784247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65091573-5e15-43d3-b53f-93aabebcf003 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:50.793706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65091573-5e15-43d3-b53f-93aabebcf003 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:50.794191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65091573-5e15-43d3-b53f-93aabebcf003 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:50.794963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65091573-5e15-43d3-b53f-93aabebcf003 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:51.460286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-65091573-5e15-43d3-b53f-93aabebcf003 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:51.478887 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65091573-5e15-43d3-b53f-93aabebcf003 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1322 microversion: 2.1 time: 0.738363 Sep 10 10:36:51.479847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 318/665] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:50 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1322 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:51.505440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3c20a98-341f-4529-843b-e224d9248f9a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:51.506998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f3c20a98-341f-4529-843b-e224d9248f9a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:51.516063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3c20a98-341f-4529-843b-e224d9248f9a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:51.516809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3c20a98-341f-4529-843b-e224d9248f9a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:51.517589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3c20a98-341f-4529-843b-e224d9248f9a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:51.518625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3c20a98-341f-4529-843b-e224d9248f9a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:51.519242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3c20a98-341f-4529-843b-e224d9248f9a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:51.519831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3c20a98-341f-4529-843b-e224d9248f9a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.057778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f3c20a98-341f-4529-843b-e224d9248f9a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:52.074897 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f3c20a98-341f-4529-843b-e224d9248f9a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71" status: 200 len: 1319 microversion: 2.1 time: 0.593262 Sep 10 10:36:52.075497 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 319/666] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:51 2022] GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 => generated 1319 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:52.094168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:52.095037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:52.108644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.109345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.109975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.110741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.111419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.111849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.146488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.147058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.147730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.148129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lazy-loading 'fault' on Instance uuid c2c8aaac-8fb1-4334-a972-492a119fc8d5 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:36:52.252904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae584a919844c5584e066606c9efd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a85977a2f5a4870b65488cf83cce911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:52.262467 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a57420bc-1171-4338-b369-4279e14c6724 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 200 len: 1306 microversion: 2.1 time: 0.185781 Sep 10 10:36:52.263740 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 320/667] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:52 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 1306 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:52.268635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a693711e-2a8c-4618-b359-ae517a52ab1b tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:52.269433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a693711e-2a8c-4618-b359-ae517a52ab1b tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:52.275592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a693711e-2a8c-4618-b359-ae517a52ab1b tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.276269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a693711e-2a8c-4618-b359-ae517a52ab1b tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.277592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a693711e-2a8c-4618-b359-ae517a52ab1b tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.278462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a693711e-2a8c-4618-b359-ae517a52ab1b tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.278922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a693711e-2a8c-4618-b359-ae517a52ab1b tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.279525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a693711e-2a8c-4618-b359-ae517a52ab1b tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.534143 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-88e17ca8-d687-472e-b0ff-2c4fd648aba7 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12/action" status: 202 len: 0 microversion: 2.25 time: 3.857124 Sep 10 10:36:52.535280 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 348/668] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:36:48 2022] POST /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12/action => generated 0 bytes in 3859 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:36:52.540481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3c063025-c0d1-47ba-8510-1e95eab35fb8 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:52.541105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3c063025-c0d1-47ba-8510-1e95eab35fb8 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:52.548652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c063025-c0d1-47ba-8510-1e95eab35fb8 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.549282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c063025-c0d1-47ba-8510-1e95eab35fb8 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.549786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c063025-c0d1-47ba-8510-1e95eab35fb8 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.550591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c063025-c0d1-47ba-8510-1e95eab35fb8 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.551242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c063025-c0d1-47ba-8510-1e95eab35fb8 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.558030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c063025-c0d1-47ba-8510-1e95eab35fb8 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.613832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a693711e-2a8c-4618-b359-ae517a52ab1b tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:52.629167 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a693711e-2a8c-4618-b359-ae517a52ab1b tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1366 microversion: 2.1 time: 0.363985 Sep 10 10:36:52.630149 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 321/669] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:52 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:52.635289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-aceeb1dc-6522-407f-a561-2ad0f18b6c38 req-0eba3f69-9b8c-4004-96a0-a66f40aeb843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31616661-a3b4-4c60-8277-1a5f6f1c492f", "name": "network-vif-deleted", "tag": "fbb30454-9ab3-4ca0-80a9-e506580f89d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:52.646238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aceeb1dc-6522-407f-a561-2ad0f18b6c38 req-0eba3f69-9b8c-4004-96a0-a66f40aeb843 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.646742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aceeb1dc-6522-407f-a561-2ad0f18b6c38 req-0eba3f69-9b8c-4004-96a0-a66f40aeb843 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.647186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aceeb1dc-6522-407f-a561-2ad0f18b6c38 req-0eba3f69-9b8c-4004-96a0-a66f40aeb843 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.662699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-aceeb1dc-6522-407f-a561-2ad0f18b6c38 req-0eba3f69-9b8c-4004-96a0-a66f40aeb843 service nova] Creating event network-vif-deleted:fbb30454-9ab3-4ca0-80a9-e506580f89d4 for instance 31616661-a3b4-4c60-8277-1a5f6f1c492f on n-h2-856894-1 Sep 10 10:36:52.677245 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-aceeb1dc-6522-407f-a561-2ad0f18b6c38 req-0eba3f69-9b8c-4004-96a0-a66f40aeb843 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045643 Sep 10 10:36:52.678521 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 322/670] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:52.689618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ccc8c2c3-72ef-4403-9ffe-78f67bf57186 req-b76d6cbf-a399-4f78-8a5e-685dd77a8e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c8aaac-8fb1-4334-a972-492a119fc8d5", "name": "network-vif-deleted", "tag": "0269a13f-cff8-4c12-b6cc-739e948a57b0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:52.711317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ccc8c2c3-72ef-4403-9ffe-78f67bf57186 req-b76d6cbf-a399-4f78-8a5e-685dd77a8e9c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.711801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ccc8c2c3-72ef-4403-9ffe-78f67bf57186 req-b76d6cbf-a399-4f78-8a5e-685dd77a8e9c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.715334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ccc8c2c3-72ef-4403-9ffe-78f67bf57186 req-b76d6cbf-a399-4f78-8a5e-685dd77a8e9c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.727234 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ccc8c2c3-72ef-4403-9ffe-78f67bf57186 req-b76d6cbf-a399-4f78-8a5e-685dd77a8e9c service nova] Creating event network-vif-deleted:0269a13f-cff8-4c12-b6cc-739e948a57b0 for instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 on n-h1-856894-1 Sep 10 10:36:52.733088 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ccc8c2c3-72ef-4403-9ffe-78f67bf57186 req-b76d6cbf-a399-4f78-8a5e-685dd77a8e9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052970 Sep 10 10:36:52.733738 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 323/671] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:52.738915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:52.739653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] [instance: 31616661-a3b4-4c60-8277-1a5f6f1c492f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:52.744067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c063025-c0d1-47ba-8510-1e95eab35fb8 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:52.748115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.748841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.749483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.750357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.750978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.751563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.753996 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3c063025-c0d1-47ba-8510-1e95eab35fb8 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1371 microversion: 2.1 time: 0.217397 Sep 10 10:36:52.754770 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 349/672] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:52 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:52.762131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-cf6a8b9f-db11-45ee-87ec-e94d167332fa req-d8d59db7-c270-46d0-9557-7680ab9333de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23eada90-68cc-4481-82cf-c536ef3fcc71", "name": "network-vif-plugged", "status": "completed", "tag": "c0320f23-8c07-4224-847b-62bd846dc47d"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:52.776335 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] HTTP exception thrown: Instance 31616661-a3b4-4c60-8277-1a5f6f1c492f could not be found. Sep 10 10:36:52.778043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cf6a8b9f-db11-45ee-87ec-e94d167332fa req-d8d59db7-c270-46d0-9557-7680ab9333de service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Request method failure captured: Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f HTTP/1.1 Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiVa5S31QTBuZRDWumeTUvPu0C-HBlJaiTBJnNa0yyUeO6PLlJSnFHa5hRlPASoZtFvy5UuBdJ_jTlbCT0Ud6SGZ_KXiL_m0P6nA5F99-6xQ5kN5o8pMBjz2aBOMM1yJPGwNwe5d9cxYhuHDGn5y3KcbxxL4qllRqs2fmbhOD_CSWs Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee9906c0571e482dbdfaf79228428a76 Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TenantUsagesTestJSON-1641302185 Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:36:52.778759 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee9906c0571e482dbdfaf79228428a76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee9906c0571e482dbdfaf79228428a76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee9906c0571e482dbdfaf79228428a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee9906c0571e482dbdfaf79228428a76", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TenantUsagesTestJSON-1641302185 Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee9906c0571e482dbdfaf79228428a76 Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1641302185 Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TenantUsagesTestJSON-1641302185-project Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d0796d5eeef94d4eb7d7f0a1e0490f01 Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TenantUsagesTestJSON-1641302185-project Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 31616661-a3b4-4c60-8277-1a5f6f1c492f could not be found. Sep 10 10:36:52.780039 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '31616661-a3b4-4c60-8277-1a5f6f1c492f'} Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31616661-a3b4-4c60-8277-1a5f6f1c492f could not be found. Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:36:52.781189 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31616661-a3b4-4c60-8277-1a5f6f1c492f could not be found. Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31616661-a3b4-4c60-8277-1a5f6f1c492f could not be found. Sep 10 10:36:52.783626 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:52.786167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] Returning 404 to user: Instance 31616661-a3b4-4c60-8277-1a5f6f1c492f could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:36:52.786167 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26a20742-98da-47e4-8c45-272f6168c1ba tempest-TenantUsagesTestJSON-1641302185 tempest-TenantUsagesTestJSON-1641302185-project] 10.222.0.20 "GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f" status: 404 len: 111 microversion: 2.1 time: 0.047369 Sep 10 10:36:52.790277 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 324/673] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:52 2022] GET /compute/v2.1/servers/31616661-a3b4-4c60-8277-1a5f6f1c492f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:36:52.794560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cf6a8b9f-db11-45ee-87ec-e94d167332fa req-d8d59db7-c270-46d0-9557-7680ab9333de service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.801512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cf6a8b9f-db11-45ee-87ec-e94d167332fa req-d8d59db7-c270-46d0-9557-7680ab9333de service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.803317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e4759f28-5c2f-40ef-824b-2ac61be10618 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:52.803935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e4759f28-5c2f-40ef-824b-2ac61be10618 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:52.824847 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-cf6a8b9f-db11-45ee-87ec-e94d167332fa req-d8d59db7-c270-46d0-9557-7680ab9333de service nova] Creating event network-vif-plugged:c0320f23-8c07-4224-847b-62bd846dc47d for instance 23eada90-68cc-4481-82cf-c536ef3fcc71 on n-h2-856894-1 Sep 10 10:36:52.825117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4759f28-5c2f-40ef-824b-2ac61be10618 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.825805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4759f28-5c2f-40ef-824b-2ac61be10618 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.826818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4759f28-5c2f-40ef-824b-2ac61be10618 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.827738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4759f28-5c2f-40ef-824b-2ac61be10618 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.828357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4759f28-5c2f-40ef-824b-2ac61be10618 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.829164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4759f28-5c2f-40ef-824b-2ac61be10618 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.838704 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-cf6a8b9f-db11-45ee-87ec-e94d167332fa req-d8d59db7-c270-46d0-9557-7680ab9333de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082244 Sep 10 10:36:52.843883 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 350/674] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:52.857561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:52.858613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:52.877975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.880577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.881340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.883644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:52.884361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:52.889776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:52.927967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:53.256048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e4759f28-5c2f-40ef-824b-2ac61be10618 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:53.269636 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e4759f28-5c2f-40ef-824b-2ac61be10618 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1472 microversion: 2.1 time: 0.473055 Sep 10 10:36:53.270784 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 325/675] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:52 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1472 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:53.284662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:53.297253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d48b49e9-4c94-49fa-8113-5d1b20063572 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:53.300991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d48b49e9-4c94-49fa-8113-5d1b20063572 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:53.302332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:53.303799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:53.309254 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-64d01958-d255-4b69-b3d0-87ab2c18f558 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1568 microversion: 2.25 time: 0.459746 Sep 10 10:36:53.310373 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 351/676] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:52 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1568 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:53.318325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d48b49e9-4c94-49fa-8113-5d1b20063572 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:53.319161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d48b49e9-4c94-49fa-8113-5d1b20063572 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:53.320447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d48b49e9-4c94-49fa-8113-5d1b20063572 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:53.320696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:53.321089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] [instance: c2c8aaac-8fb1-4334-a972-492a119fc8d5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:53.324551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d48b49e9-4c94-49fa-8113-5d1b20063572 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:53.325056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d48b49e9-4c94-49fa-8113-5d1b20063572 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:53.325506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d48b49e9-4c94-49fa-8113-5d1b20063572 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:53.336392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:53.337529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:53.338263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:53.339381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:53.340164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:53.341087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:53.358258 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] HTTP exception thrown: Instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 could not be found. Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Request method failure captured: Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 HTTP/1.1 Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGhgLqot1Lj54BIHb5Qy3GTMYCSnvGn_gMdcg5rKKznfMkVTiehK15UcUvvYA1J4Lm3JYYZyjFsJ0eRXxP-YCG65Y3i4Bqqp8vLGtZEC8P1SH2Yv1z8cI3HLp5VIP53pGPKLIgXSf-d1ZYlIEEJZ-k1hDsd1tFidox8TlbTfwN-kZDk Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 3a85977a2f5a4870b65488cf83cce911 Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ImagesOneServerTestJSON-2069047134 Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:36:53.360869 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a85977a2f5a4870b65488cf83cce911"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a85977a2f5a4870b65488cf83cce911"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a85977a2f5a4870b65488cf83cce911"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a85977a2f5a4870b65488cf83cce911", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ImagesOneServerTestJSON-2069047134 Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 3a85977a2f5a4870b65488cf83cce911 Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2069047134 Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ImagesOneServerTestJSON-2069047134-project Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 3ae584a919844c5584e066606c9efd36 Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ImagesOneServerTestJSON-2069047134-project Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 could not be found. Sep 10 10:36:53.362366 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'c2c8aaac-8fb1-4334-a972-492a119fc8d5'} Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 could not be found. Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:36:53.363233 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 could not be found. Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 could not be found. Sep 10 10:36:53.364588 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:53.366638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] Returning 404 to user: Instance c2c8aaac-8fb1-4334-a972-492a119fc8d5 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:36:53.367496 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-27a95463-e326-4bbb-9622-a1cc9207c263 tempest-ImagesOneServerTestJSON-2069047134 tempest-ImagesOneServerTestJSON-2069047134-project] 10.222.0.20 "GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5" status: 404 len: 111 microversion: 2.1 time: 0.055852 Sep 10 10:36:53.369420 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 352/677] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:53 2022] GET /compute/v2.1/servers/c2c8aaac-8fb1-4334-a972-492a119fc8d5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:36:53.590743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e8ff885c-d560-488d-8855-fc1c09dab544 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:53.591452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e8ff885c-d560-488d-8855-fc1c09dab544 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] [instance: f286d619-14c0-43c3-89b9-9d6a52fe0265] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:53.597449 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-e8ff885c-d560-488d-8855-fc1c09dab544 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] HTTP exception thrown: Instance f286d619-14c0-43c3-89b9-9d6a52fe0265 could not be found. Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e8ff885c-d560-488d-8855-fc1c09dab544 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Request method failure captured: Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/f286d619-14c0-43c3-89b9-9d6a52fe0265/action HTTP/1.1 Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 15 Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGiMjdkjJGs_rvSZoxfJS9nfeKOTxPBf-tpMcQ0HjXuPqOTrY_J27CjbEo2n7s6lQhwJKLB9azBxG4GRRYrKDZbemWLEZ3UkaLoCYH8IUeyVAk0go5SDWA9g09TGR5rgoemM8LTBE7nJZygTiHwCkjzHQAxIAMM4GOotfTzvBc1H5eE Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: f6e10a8c96fe47afad3be823705d1599 Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:36:53.598977 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6e10a8c96fe47afad3be823705d1599", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: f6e10a8c96fe47afad3be823705d1599 Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersAdminNegativeTestJSON-1252828823-project-admin Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: cd3c0d9002ad43b5bdf9bbec43993d82 Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1252828823-project-admin Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: {"migrate": {}} Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:36:53.600529 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance f286d619-14c0-43c3-89b9-9d6a52fe0265 could not be found. Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f286d619-14c0-43c3-89b9-9d6a52fe0265', 'body': {'migrate': {}}} Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f286d619-14c0-43c3-89b9-9d6a52fe0265 could not be found. Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:36:53.601583 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f286d619-14c0-43c3-89b9-9d6a52fe0265 could not be found. Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f286d619-14c0-43c3-89b9-9d6a52fe0265 could not be found. Sep 10 10:36:53.602993 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:53.604258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e8ff885c-d560-488d-8855-fc1c09dab544 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Returning 404 to user: Instance f286d619-14c0-43c3-89b9-9d6a52fe0265 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:36:53.604258 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e8ff885c-d560-488d-8855-fc1c09dab544 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/f286d619-14c0-43c3-89b9-9d6a52fe0265/action" status: 404 len: 111 microversion: 2.1 time: 0.229258 Sep 10 10:36:53.604258 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 353/678] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:36:53 2022] POST /compute/v2.1/servers/f286d619-14c0-43c3-89b9-9d6a52fe0265/action => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:36:53.652984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1215b7c0-aa63-4c1f-9777-9c2d10e31e13 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:53.653625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1215b7c0-aa63-4c1f-9777-9c2d10e31e13 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:53.670373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1215b7c0-aa63-4c1f-9777-9c2d10e31e13 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:53.670373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1215b7c0-aa63-4c1f-9777-9c2d10e31e13 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:53.671997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1215b7c0-aa63-4c1f-9777-9c2d10e31e13 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:53.672752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1215b7c0-aa63-4c1f-9777-9c2d10e31e13 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:53.673282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1215b7c0-aa63-4c1f-9777-9c2d10e31e13 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:53.673718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1215b7c0-aa63-4c1f-9777-9c2d10e31e13 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:53.697175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d48b49e9-4c94-49fa-8113-5d1b20063572 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:53.705980 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d48b49e9-4c94-49fa-8113-5d1b20063572 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71" status: 200 len: 1319 microversion: 2.1 time: 0.432907 Sep 10 10:36:53.706561 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 326/679] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:53 2022] GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:53.752514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-390418082", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:53.821537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:36:53.964515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1215b7c0-aa63-4c1f-9777-9c2d10e31e13 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:53.975727 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1215b7c0-aa63-4c1f-9777-9c2d10e31e13 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1366 microversion: 2.1 time: 0.326363 Sep 10 10:36:53.977692 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 354/680] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:53 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:36:53.985959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8606f61e-c0a1-44ae-bafc-32186d08a68d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:53.986575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8606f61e-c0a1-44ae-bafc-32186d08a68d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:53.999162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8606f61e-c0a1-44ae-bafc-32186d08a68d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:53.999667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8606f61e-c0a1-44ae-bafc-32186d08a68d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:54.000083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8606f61e-c0a1-44ae-bafc-32186d08a68d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:54.001712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8606f61e-c0a1-44ae-bafc-32186d08a68d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:54.002361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8606f61e-c0a1-44ae-bafc-32186d08a68d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:54.002782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8606f61e-c0a1-44ae-bafc-32186d08a68d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:54.326286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8606f61e-c0a1-44ae-bafc-32186d08a68d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:54.339901 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8606f61e-c0a1-44ae-bafc-32186d08a68d tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1371 microversion: 2.1 time: 0.359353 Sep 10 10:36:54.340777 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 355/681] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:53 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:54.359069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:54.362098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:54.369899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:54.370525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:54.371187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:54.372137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:54.372667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:54.373211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:54.390407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:36:54.390923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:36:54.392316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:36:54.393396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:36:54.393975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:36:54.409432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:54.410220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:54.410912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:54.412145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:54.413856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:54.414671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:54.449806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Getting quotas for project 99bb8844a05f444d9debc0c5cfe6d32e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:54.460940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Getting quotas for user 7a5e475e6f334eaca29f1e114d1f06cb and project 99bb8844a05f444d9debc0c5cfe6d32e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:54.501740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:36:54.507735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:36:54.607499 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-725c1d7f-5c9d-481a-b5eb-97f282dfcc13 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857524 Sep 10 10:36:54.608868 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 327/682] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:36:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:36:54.622292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f2e8312-c23e-4f5a-9a48-ad73abf5bc0b tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:54.623435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f2e8312-c23e-4f5a-9a48-ad73abf5bc0b tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:54.746984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:54.754311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f2e8312-c23e-4f5a-9a48-ad73abf5bc0b tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:54.763614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:54.765382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:54.766790 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f7859e23-0217-4424-b190-d1b3697330b6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1568 microversion: 2.25 time: 0.419597 Sep 10 10:36:54.777230 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 356/683] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:54 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1568 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:54.777230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-81d9c199-5753-4d2b-a0b3-4ce016057b4f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:54.777230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-81d9c199-5753-4d2b-a0b3-4ce016057b4f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:54.777617 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f2e8312-c23e-4f5a-9a48-ad73abf5bc0b tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1221 microversion: 2.1 time: 0.157961 Sep 10 10:36:54.777617 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 328/684] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:54 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1221 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:36:54.794843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81d9c199-5753-4d2b-a0b3-4ce016057b4f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:54.795346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81d9c199-5753-4d2b-a0b3-4ce016057b4f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:54.795783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81d9c199-5753-4d2b-a0b3-4ce016057b4f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:54.796561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81d9c199-5753-4d2b-a0b3-4ce016057b4f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:54.796924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81d9c199-5753-4d2b-a0b3-4ce016057b4f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:54.797377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81d9c199-5753-4d2b-a0b3-4ce016057b4f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:54.866131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b039e81c-6460-48a3-ba58-75cfff6794b5 req-33d6503f-164c-4dfa-afe5-7b5cb517078f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d649fdd-c8f0-4b15-9434-32d88f643ed1", "name": "network-vif-plugged", "status": "completed", "tag": "87804b23-16c0-45b3-9b2d-4f16c41d16f2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:54.895230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b039e81c-6460-48a3-ba58-75cfff6794b5 req-33d6503f-164c-4dfa-afe5-7b5cb517078f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:54.898726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b039e81c-6460-48a3-ba58-75cfff6794b5 req-33d6503f-164c-4dfa-afe5-7b5cb517078f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:54.899508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b039e81c-6460-48a3-ba58-75cfff6794b5 req-33d6503f-164c-4dfa-afe5-7b5cb517078f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:54.928228 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b039e81c-6460-48a3-ba58-75cfff6794b5 req-33d6503f-164c-4dfa-afe5-7b5cb517078f service nova] Creating event network-vif-plugged:87804b23-16c0-45b3-9b2d-4f16c41d16f2 for instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 on n-h2-856894-1 Sep 10 10:36:54.937115 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b039e81c-6460-48a3-ba58-75cfff6794b5 req-33d6503f-164c-4dfa-afe5-7b5cb517078f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078220 Sep 10 10:36:54.938022 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 329/685] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:36:55.013710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-743ec337-327e-4d02-a753-2486e3a8adf5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:55.015231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-743ec337-327e-4d02-a753-2486e3a8adf5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:55.042133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-743ec337-327e-4d02-a753-2486e3a8adf5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.042856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-743ec337-327e-4d02-a753-2486e3a8adf5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.045230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-743ec337-327e-4d02-a753-2486e3a8adf5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.048901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-743ec337-327e-4d02-a753-2486e3a8adf5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.049535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-743ec337-327e-4d02-a753-2486e3a8adf5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.050474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-743ec337-327e-4d02-a753-2486e3a8adf5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.110955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-81d9c199-5753-4d2b-a0b3-4ce016057b4f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:55.120187 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-81d9c199-5753-4d2b-a0b3-4ce016057b4f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71" status: 200 len: 1469 microversion: 2.1 time: 0.351152 Sep 10 10:36:55.127133 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 357/686] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:54 2022] GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:55.130986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-b9536383-2d62-428e-b6d6-dc608ce46884 req-11e67563-d907-4087-b32d-f7cfad648f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e9ca71-6d1b-4fc0-87dd-804a4a52745b", "tag": "4f741feb-1286-4ef7-a2c4-4f8c4ea45848"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:55.150578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b9536383-2d62-428e-b6d6-dc608ce46884 req-11e67563-d907-4087-b32d-f7cfad648f2e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.151053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b9536383-2d62-428e-b6d6-dc608ce46884 req-11e67563-d907-4087-b32d-f7cfad648f2e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.151980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b9536383-2d62-428e-b6d6-dc608ce46884 req-11e67563-d907-4087-b32d-f7cfad648f2e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.169581 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-b9536383-2d62-428e-b6d6-dc608ce46884 req-11e67563-d907-4087-b32d-f7cfad648f2e service nova] Creating event network-changed:4f741feb-1286-4ef7-a2c4-4f8c4ea45848 for instance a8e9ca71-6d1b-4fc0-87dd-804a4a52745b on n-h1-856894-1 Sep 10 10:36:55.193745 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-b9536383-2d62-428e-b6d6-dc608ce46884 req-11e67563-d907-4087-b32d-f7cfad648f2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066119 Sep 10 10:36:55.194638 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 358/687] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:55.202897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-14243ada-0a7d-47e3-b40f-ea2937e76329 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:55.207775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-14243ada-0a7d-47e3-b40f-ea2937e76329 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c1be72b7-1010-4f8d-84c0-27c703292bb0] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:55.221548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14243ada-0a7d-47e3-b40f-ea2937e76329 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.222043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14243ada-0a7d-47e3-b40f-ea2937e76329 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.222483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14243ada-0a7d-47e3-b40f-ea2937e76329 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.223228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14243ada-0a7d-47e3-b40f-ea2937e76329 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.223634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14243ada-0a7d-47e3-b40f-ea2937e76329 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.224066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14243ada-0a7d-47e3-b40f-ea2937e76329 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.498029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-743ec337-327e-4d02-a753-2486e3a8adf5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:55.526414 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-743ec337-327e-4d02-a753-2486e3a8adf5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1366 microversion: 2.1 time: 0.521019 Sep 10 10:36:55.545341 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 330/688] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:54 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:55.559806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-09758c1a-1b93-4b1c-bda3-fa3d2d2f0c9e req-779910de-7471-447b-8e15-999fa87b3230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0f0704-e44c-45ed-8cba-86d6ad048f12", "name": "network-vif-unplugged", "status": "completed", "tag": "2095cfbd-e6eb-4350-a71e-b4d08d9396b4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:55.573836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-14243ada-0a7d-47e3-b40f-ea2937e76329 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:55.584025 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-14243ada-0a7d-47e3-b40f-ea2937e76329 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0" status: 200 len: 1468 microversion: 2.1 time: 0.387938 Sep 10 10:36:55.585697 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 359/689] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:55 2022] GET /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0 => generated 1468 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:55.590389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8f150cf5-9333-4a3c-8cf6-fa9a0722a9ad tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:55.591212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8f150cf5-9333-4a3c-8cf6-fa9a0722a9ad tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:55.600771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-09758c1a-1b93-4b1c-bda3-fa3d2d2f0c9e req-779910de-7471-447b-8e15-999fa87b3230 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.601291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-09758c1a-1b93-4b1c-bda3-fa3d2d2f0c9e req-779910de-7471-447b-8e15-999fa87b3230 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.601723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-09758c1a-1b93-4b1c-bda3-fa3d2d2f0c9e req-779910de-7471-447b-8e15-999fa87b3230 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.615385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f150cf5-9333-4a3c-8cf6-fa9a0722a9ad tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.616519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f150cf5-9333-4a3c-8cf6-fa9a0722a9ad tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.617022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f150cf5-9333-4a3c-8cf6-fa9a0722a9ad tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.617778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f150cf5-9333-4a3c-8cf6-fa9a0722a9ad tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.618457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f150cf5-9333-4a3c-8cf6-fa9a0722a9ad tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.618942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f150cf5-9333-4a3c-8cf6-fa9a0722a9ad tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.629057 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-09758c1a-1b93-4b1c-bda3-fa3d2d2f0c9e req-779910de-7471-447b-8e15-999fa87b3230 service nova] Creating event network-vif-unplugged:2095cfbd-e6eb-4350-a71e-b4d08d9396b4 for instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 on n-h1-856894-1 Sep 10 10:36:55.641941 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-09758c1a-1b93-4b1c-bda3-fa3d2d2f0c9e req-779910de-7471-447b-8e15-999fa87b3230 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095077 Sep 10 10:36:55.642567 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 331/690] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:55.649599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:55.657047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:55.658372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Searching by: {'reservation_id': 'r-gpxer11r', 'deleted': False, 'project_id': '357ca1336b634d0389fff733e6e26ca0'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:36:55.662842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:55.667816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.668531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.669218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.670080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.672934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.673419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.733108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:55.802924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:36:55.889653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8f150cf5-9333-4a3c-8cf6-fa9a0722a9ad tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:55.899570 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8f150cf5-9333-4a3c-8cf6-fa9a0722a9ad tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1371 microversion: 2.1 time: 0.312808 Sep 10 10:36:55.902321 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 360/691] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:55 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:55.913800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7294fb9c-4b89-4043-9da6-082a93c77f2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:55.914804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7294fb9c-4b89-4043-9da6-082a93c77f2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:55.934661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7294fb9c-4b89-4043-9da6-082a93c77f2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.935222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7294fb9c-4b89-4043-9da6-082a93c77f2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.935660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7294fb9c-4b89-4043-9da6-082a93c77f2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.936368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7294fb9c-4b89-4043-9da6-082a93c77f2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.936848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7294fb9c-4b89-4043-9da6-082a93c77f2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.937298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7294fb9c-4b89-4043-9da6-082a93c77f2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:55.950305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:55.959224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:55.960188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:55.960777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.085524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7294fb9c-4b89-4043-9da6-082a93c77f2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:56.100803 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7294fb9c-4b89-4043-9da6-082a93c77f2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1217 microversion: 2.1 time: 0.196964 Sep 10 10:36:56.112467 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 361/692] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:55 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:56.112467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.112467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:56.113018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:56.126456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.127480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.128262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.129286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.129812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.130307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.247562 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-09754d0c-9bcf-40bf-af07-8729200d933f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-gpxer11r" status: 200 len: 2930 microversion: 2.1 time: 0.603025 Sep 10 10:36:56.248662 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 332/693] 10.222.0.20 () {58 vars in 1197 bytes} [Sat Sep 10 10:36:55 2022] GET /compute/v2.1/servers/detail?reservation_id=r-gpxer11r => generated 2930 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:56.312632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:56.324041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:56.325623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:56.327898 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bc1ada1a-3273-4c52-b2bb-66e9cfc51572 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1568 microversion: 2.25 time: 0.224281 Sep 10 10:36:56.328688 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 362/694] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:56 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:56.334984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-86a96d8c-de41-4fec-b113-4ee061f4ada5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.352203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.compute.server_groups [None req-86a96d8c-de41-4fec-b113-4ee061f4ada5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Querying cell de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) for 2 instances {{(pid=128787) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 10:36:56.353433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86a96d8c-de41-4fec-b113-4ee061f4ada5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.354937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86a96d8c-de41-4fec-b113-4ee061f4ada5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.355611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86a96d8c-de41-4fec-b113-4ee061f4ada5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.384577 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-86a96d8c-de41-4fec-b113-4ee061f4ada5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/b5ca0581-e82b-4914-a1ef-8642fb1514c8" status: 200 len: 271 microversion: 2.1 time: 0.053439 Sep 10 10:36:56.385720 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 363/695] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:36:56 2022] GET /compute/v2.1/os-server-groups/b5ca0581-e82b-4914-a1ef-8642fb1514c8 => generated 271 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:56.396577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d4ae1cc2-1f47-41a3-bbae-50f392630a6a tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.397609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d4ae1cc2-1f47-41a3-bbae-50f392630a6a tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:56.404795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4ae1cc2-1f47-41a3-bbae-50f392630a6a tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.405997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4ae1cc2-1f47-41a3-bbae-50f392630a6a tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.406699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4ae1cc2-1f47-41a3-bbae-50f392630a6a tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.407934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4ae1cc2-1f47-41a3-bbae-50f392630a6a tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.408717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4ae1cc2-1f47-41a3-bbae-50f392630a6a tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.410270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4ae1cc2-1f47-41a3-bbae-50f392630a6a tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.481822 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d5d33d25-6c66-4972-ae7b-641503e8cb5e tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] 10.222.0.20 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.208424 Sep 10 10:36:56.483138 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 333/696] 10.222.0.20 () {58 vars in 1128 bytes} [Sat Sep 10 10:36:56 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 10:36:56.493708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b3f38ae-ffd3-4f56-8c3a-b50ac6b6f499 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Calling method '.version_select at 0x7efcaef85ca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.522973 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9b3f38ae-ffd3-4f56-8c3a-b50ac6b6f499 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] HTTP exception thrown: Image not found. Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b3f38ae-ffd3-4f56-8c3a-b50ac6b6f499 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Request method failure captured: Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGjHkN6UwiYvilQBNpHemWrYL-iXVJVse8rpArXkb_7vFAsvBEuplpwaV5epeAFzoTvYDVJ8aSvwkrBHyjw3PNjYODhRljHGRk52Ph_14KZ7Q_0pSIoPqIgmL6pRB68gFRmkK-dt066rUbhFssCddWfeSi4gj5PuorLre6tcLbf2kg0 Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 89a86dfde6634e0cbbd52068738d562d Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:36:56.525451 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_89a86dfde6634e0cbbd52068738d562d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 89a86dfde6634e0cbbd52068738d562d Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesDeleteNegativeTestJSON-1110338020-project Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: b244733d91e040979a630428ba1306f8 Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020-project Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '-1'} Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:36:56.526899 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.527796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:36:56.528904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b3f38ae-ffd3-4f56-8c3a-b50ac6b6f499 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9b3f38ae-ffd3-4f56-8c3a-b50ac6b6f499 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] 10.222.0.20 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.038237 Sep 10 10:36:56.531847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 334/697] 10.222.0.20 () {58 vars in 1134 bytes} [Sat Sep 10 10:36:56 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:36:56.537420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4a61d22-f369-46ab-a8fd-b239663ff739 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Calling method '.version_select at 0x7efcaf19e820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.562018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d4a61d22-f369-46ab-a8fd-b239663ff739 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] HTTP exception thrown: Image not found. Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4a61d22-f369-46ab-a8fd-b239663ff739 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Request method failure captured: Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/images/a4d871dc-c997-4dcd-a2ef-40592f6c740j HTTP/1.1 Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGjHkN6UwiYvilQBNpHemWrYL-iXVJVse8rpArXkb_7vFAsvBEuplpwaV5epeAFzoTvYDVJ8aSvwkrBHyjw3PNjYODhRljHGRk52Ph_14KZ7Q_0pSIoPqIgmL6pRB68gFRmkK-dt066rUbhFssCddWfeSi4gj5PuorLre6tcLbf2kg0 Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 89a86dfde6634e0cbbd52068738d562d Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:36:56.563767 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_89a86dfde6634e0cbbd52068738d562d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 89a86dfde6634e0cbbd52068738d562d Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesDeleteNegativeTestJSON-1110338020-project Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: b244733d91e040979a630428ba1306f8 Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020-project Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'a4d871dc-c997-4dcd-a2ef-40592f6c740j'} Sep 10 10:36:56.565080 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a4d871dc-c997-4dcd-a2ef-40592f6c740j to delete Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.565904 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4d871dc-c997-4dcd-a2ef-40592f6c740j could not be found. Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:36:56.567083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4a61d22-f369-46ab-a8fd-b239663ff739 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:36:56.568882 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4a61d22-f369-46ab-a8fd-b239663ff739 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] 10.222.0.20 "DELETE /compute/v2.1/images/a4d871dc-c997-4dcd-a2ef-40592f6c740j" status: 404 len: 62 microversion: 2.1 time: 0.031607 Sep 10 10:36:56.569783 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 335/698] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:56 2022] DELETE /compute/v2.1/images/a4d871dc-c997-4dcd-a2ef-40592f6c740j => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:36:56.571554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b4123c9f-c085-4eb7-baee-5fe719e05e57 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.577459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b4123c9f-c085-4eb7-baee-5fe719e05e57 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:56.582664 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d4ae1cc2-1f47-41a3-bbae-50f392630a6a tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71" status: 200 len: 1620 microversion: 2.1 time: 0.190166 Sep 10 10:36:56.583584 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 364/699] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:56 2022] GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 => generated 1620 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:56.585122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4123c9f-c085-4eb7-baee-5fe719e05e57 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.585579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4123c9f-c085-4eb7-baee-5fe719e05e57 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.586014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4123c9f-c085-4eb7-baee-5fe719e05e57 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.586716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4123c9f-c085-4eb7-baee-5fe719e05e57 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.587167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4123c9f-c085-4eb7-baee-5fe719e05e57 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.587726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4123c9f-c085-4eb7-baee-5fe719e05e57 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.589539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-59260def-0690-4e2e-9ee0-93dbe144e37a tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Calling method '.version_select at 0x7efcaedc0550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.609817 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-59260def-0690-4e2e-9ee0-93dbe144e37a tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] HTTP exception thrown: Image not found. Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-59260def-0690-4e2e-9ee0-93dbe144e37a tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Request method failure captured: Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/images/97751820-b915-41c3-92ca-c221c83d5cac1 HTTP/1.1 Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjHkN6UwiYvilQBNpHemWrYL-iXVJVse8rpArXkb_7vFAsvBEuplpwaV5epeAFzoTvYDVJ8aSvwkrBHyjw3PNjYODhRljHGRk52Ph_14KZ7Q_0pSIoPqIgmL6pRB68gFRmkK-dt066rUbhFssCddWfeSi4gj5PuorLre6tcLbf2kg0 Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 89a86dfde6634e0cbbd52068738d562d Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:36:56.613753 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_89a86dfde6634e0cbbd52068738d562d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 89a86dfde6634e0cbbd52068738d562d Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ImagesDeleteNegativeTestJSON-1110338020-project Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b244733d91e040979a630428ba1306f8 Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020-project Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: exception: Image not found. Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '97751820-b915-41c3-92ca-c221c83d5cac1'} Sep 10 10:36:56.615219 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 97751820-b915-41c3-92ca-c221c83d5cac1 to delete Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.616151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 97751820-b915-41c3-92ca-c221c83d5cac1 could not be found. Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:36:56.617286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:36:56.618444 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.621501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-59260def-0690-4e2e-9ee0-93dbe144e37a tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Returning 404 to user: Image not found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:36:56.622591 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-59260def-0690-4e2e-9ee0-93dbe144e37a tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] 10.222.0.20 "DELETE /compute/v2.1/images/97751820-b915-41c3-92ca-c221c83d5cac1" status: 404 len: 62 microversion: 2.1 time: 0.037838 Sep 10 10:36:56.623342 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 365/700] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:36:56 2022] DELETE /compute/v2.1/images/97751820-b915-41c3-92ca-c221c83d5cac1 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:36:56.628303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-93561880-1c47-4f38-874b-5eecda6bc299 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.628989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-93561880-1c47-4f38-874b-5eecda6bc299 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] [instance: c1be72b7-1010-4f8d-84c0-27c703292bb0] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:56.636011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93561880-1c47-4f38-874b-5eecda6bc299 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.636586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93561880-1c47-4f38-874b-5eecda6bc299 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.637104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93561880-1c47-4f38-874b-5eecda6bc299 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.637989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93561880-1c47-4f38-874b-5eecda6bc299 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.638639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93561880-1c47-4f38-874b-5eecda6bc299 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.639463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93561880-1c47-4f38-874b-5eecda6bc299 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.779076 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-93561880-1c47-4f38-874b-5eecda6bc299 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0" status: 200 len: 1619 microversion: 2.1 time: 0.154296 Sep 10 10:36:56.779668 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 366/701] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:56 2022] GET /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0 => generated 1619 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:56.785639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1cce2e89-b8ed-4890-a788-eefa13b7f5a0 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Calling method '.version_select at 0x7efcaf339dc0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.847209 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-1cce2e89-b8ed-4890-a788-eefa13b7f5a0 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] HTTP exception thrown: Image not found. Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1cce2e89-b8ed-4890-a788-eefa13b7f5a0 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Request method failure captured: Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/images/tempest-invalid-447919292 HTTP/1.1 Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjHkN6UwiYvilQBNpHemWrYL-iXVJVse8rpArXkb_7vFAsvBEuplpwaV5epeAFzoTvYDVJ8aSvwkrBHyjw3PNjYODhRljHGRk52Ph_14KZ7Q_0pSIoPqIgmL6pRB68gFRmkK-dt066rUbhFssCddWfeSi4gj5PuorLre6tcLbf2kg0 Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 89a86dfde6634e0cbbd52068738d562d Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:36:56.851076 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_89a86dfde6634e0cbbd52068738d562d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 89a86dfde6634e0cbbd52068738d562d Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ImagesDeleteNegativeTestJSON-1110338020-project Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b244733d91e040979a630428ba1306f8 Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020-project Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: exception: Image not found. Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'tempest-invalid-447919292'} Sep 10 10:36:56.852416 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-447919292 to delete Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.853237 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-447919292 could not be found. Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:36:56.855298 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1cce2e89-b8ed-4890-a788-eefa13b7f5a0 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Returning 404 to user: Image not found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:36:56.857807 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1cce2e89-b8ed-4890-a788-eefa13b7f5a0 tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] 10.222.0.20 "DELETE /compute/v2.1/images/tempest-invalid-447919292" status: 404 len: 62 microversion: 2.1 time: 0.072217 Sep 10 10:36:56.859938 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 367/702] 10.222.0.20 () {58 vars in 1203 bytes} [Sat Sep 10 10:36:56 2022] DELETE /compute/v2.1/images/tempest-invalid-447919292 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:36:56.870874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-90574bb7-9064-4b96-96c0-921de73e140a tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Calling method '.version_select at 0x7efcaee49b80>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.874576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b4123c9f-c085-4eb7-baee-5fe719e05e57 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:56.884876 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b4123c9f-c085-4eb7-baee-5fe719e05e57 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1366 microversion: 2.1 time: 0.317414 Sep 10 10:36:56.888703 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 336/703] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:56 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:56.914045 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-90574bb7-9064-4b96-96c0-921de73e140a tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] HTTP exception thrown: Image not found. Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-90574bb7-9064-4b96-96c0-921de73e140a tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Request method failure captured: Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/images/659af8e4-ee0b-4f47-8ec6-9b481b1b6f12 HTTP/1.1 Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjHkN6UwiYvilQBNpHemWrYL-iXVJVse8rpArXkb_7vFAsvBEuplpwaV5epeAFzoTvYDVJ8aSvwkrBHyjw3PNjYODhRljHGRk52Ph_14KZ7Q_0pSIoPqIgmL6pRB68gFRmkK-dt066rUbhFssCddWfeSi4gj5PuorLre6tcLbf2kg0 Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 89a86dfde6634e0cbbd52068738d562d Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:36:56.915788 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/89a86dfde6634e0cbbd52068738d562d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_89a86dfde6634e0cbbd52068738d562d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 89a86dfde6634e0cbbd52068738d562d Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020 Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ImagesDeleteNegativeTestJSON-1110338020-project Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b244733d91e040979a630428ba1306f8 Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1110338020-project Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: exception: Image not found. Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '659af8e4-ee0b-4f47-8ec6-9b481b1b6f12'} Sep 10 10:36:56.917740 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 659af8e4-ee0b-4f47-8ec6-9b481b1b6f12 to delete Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.918518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 659af8e4-ee0b-4f47-8ec6-9b481b1b6f12 could not be found. Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:36:56.924222 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-90574bb7-9064-4b96-96c0-921de73e140a tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] Returning 404 to user: Image not found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:36:56.927874 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-90574bb7-9064-4b96-96c0-921de73e140a tempest-ImagesDeleteNegativeTestJSON-1110338020 tempest-ImagesDeleteNegativeTestJSON-1110338020-project] 10.222.0.20 "DELETE /compute/v2.1/images/659af8e4-ee0b-4f47-8ec6-9b481b1b6f12" status: 404 len: 62 microversion: 2.1 time: 0.057923 Sep 10 10:36:56.930050 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 368/704] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:56 2022] DELETE /compute/v2.1/images/659af8e4-ee0b-4f47-8ec6-9b481b1b6f12 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:36:56.930818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ecf78229-b22b-4c40-beac-b3581ac5b896 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:56.931437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ecf78229-b22b-4c40-beac-b3581ac5b896 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:56.938761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf78229-b22b-4c40-beac-b3581ac5b896 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.939611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf78229-b22b-4c40-beac-b3581ac5b896 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.940290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf78229-b22b-4c40-beac-b3581ac5b896 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.941254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf78229-b22b-4c40-beac-b3581ac5b896 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:56.941924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf78229-b22b-4c40-beac-b3581ac5b896 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:56.942578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf78229-b22b-4c40-beac-b3581ac5b896 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:56.999727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-575923996", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "52fb832d-13f8-4175-b047-fa651b9091da"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:57.004830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:36:57.109234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] validate_networks() for None {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:36:57.259877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ecf78229-b22b-4c40-beac-b3581ac5b896 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:57.269618 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ecf78229-b22b-4c40-beac-b3581ac5b896 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1555 microversion: 2.1 time: 0.343795 Sep 10 10:36:57.270198 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 337/705] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:56 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1555 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:57.275406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-55bb87d8-e0e4-4b9e-ba21-d55d79fa764d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:57.276808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-55bb87d8-e0e4-4b9e-ba21-d55d79fa764d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:57.284908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55bb87d8-e0e4-4b9e-ba21-d55d79fa764d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.286114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55bb87d8-e0e4-4b9e-ba21-d55d79fa764d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.286238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55bb87d8-e0e4-4b9e-ba21-d55d79fa764d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:57.287142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55bb87d8-e0e4-4b9e-ba21-d55d79fa764d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.287858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55bb87d8-e0e4-4b9e-ba21-d55d79fa764d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.288363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55bb87d8-e0e4-4b9e-ba21-d55d79fa764d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:57.390048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-55bb87d8-e0e4-4b9e-ba21-d55d79fa764d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:57.405597 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-55bb87d8-e0e4-4b9e-ba21-d55d79fa764d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1273 microversion: 2.1 time: 0.133554 Sep 10 10:36:57.406072 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 338/706] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:57 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1273 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:57.423271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1093bbb3-e2ef-4826-b09a-ed48be3629c3 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:57.425657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1093bbb3-e2ef-4826-b09a-ed48be3629c3 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:57.444475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1093bbb3-e2ef-4826-b09a-ed48be3629c3 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.445064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1093bbb3-e2ef-4826-b09a-ed48be3629c3 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.445650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1093bbb3-e2ef-4826-b09a-ed48be3629c3 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:57.446418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1093bbb3-e2ef-4826-b09a-ed48be3629c3 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.447613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1093bbb3-e2ef-4826-b09a-ed48be3629c3 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.448644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1093bbb3-e2ef-4826-b09a-ed48be3629c3 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:57.548109 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1093bbb3-e2ef-4826-b09a-ed48be3629c3 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140482 Sep 10 10:36:57.549082 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 339/707] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:36:57 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:57.554057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:57.554548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:57.567228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.567722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.568327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:57.569250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.569861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.570490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:57.587361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:36:57.587830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:36:57.588565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:36:57.588962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:36:57.589411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:36:57.607832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.608327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.608769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:57.609534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.609993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.610423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:57.629493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:36:57.636429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:36:57.655239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:36:57.658316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:36:57.713926 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-268b4b26-8cd7-43e2-8386-a7280e7f18e5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719464 Sep 10 10:36:57.715491 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 369/708] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:36:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 10:36:57.728449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-d8774ec9-fe35-408b-9091-413f4982f30c req-a56378cd-976c-4dd3-90e3-d1f0ef3e9086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0f0704-e44c-45ed-8cba-86d6ad048f12", "tag": "2095cfbd-e6eb-4350-a71e-b4d08d9396b4"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:36:57.741022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d8774ec9-fe35-408b-9091-413f4982f30c req-a56378cd-976c-4dd3-90e3-d1f0ef3e9086 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.741550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d8774ec9-fe35-408b-9091-413f4982f30c req-a56378cd-976c-4dd3-90e3-d1f0ef3e9086 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.741976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d8774ec9-fe35-408b-9091-413f4982f30c req-a56378cd-976c-4dd3-90e3-d1f0ef3e9086 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:57.758908 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-d8774ec9-fe35-408b-9091-413f4982f30c req-a56378cd-976c-4dd3-90e3-d1f0ef3e9086 service nova] Creating event network-changed:2095cfbd-e6eb-4350-a71e-b4d08d9396b4 for instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 on n-h1-856894-1 Sep 10 10:36:57.765878 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-d8774ec9-fe35-408b-9091-413f4982f30c req-a56378cd-976c-4dd3-90e3-d1f0ef3e9086 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048969 Sep 10 10:36:57.768898 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 370/709] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:36:57.775302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-35620447-9db2-4011-b0f0-172e04b78d54 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:57.777709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-35620447-9db2-4011-b0f0-172e04b78d54 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:57.877937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-35620447-9db2-4011-b0f0-172e04b78d54 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:57.894786 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-35620447-9db2-4011-b0f0-172e04b78d54 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1216 microversion: 2.1 time: 0.122538 Sep 10 10:36:57.896374 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 371/710] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:57 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1216 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:57.918829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8b29e3e4-85b5-476d-a308-aff7cd044cf6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:57.919473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8b29e3e4-85b5-476d-a308-aff7cd044cf6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:57.926701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b29e3e4-85b5-476d-a308-aff7cd044cf6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.927597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b29e3e4-85b5-476d-a308-aff7cd044cf6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.928194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b29e3e4-85b5-476d-a308-aff7cd044cf6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:57.930108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b29e3e4-85b5-476d-a308-aff7cd044cf6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:57.930590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b29e3e4-85b5-476d-a308-aff7cd044cf6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:57.931053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b29e3e4-85b5-476d-a308-aff7cd044cf6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:58.086091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:58.117297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:58.120392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:58.122906 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e91ce8f5-64b0-4a6f-9932-a0ef9287ad75 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1568 microversion: 2.25 time: 0.572535 Sep 10 10:36:58.123794 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 340/711] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:57 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1568 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:58.430360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48aebaf0-f67d-4417-b93a-a692c488df4a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:58.431368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-48aebaf0-f67d-4417-b93a-a692c488df4a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:58.445345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48aebaf0-f67d-4417-b93a-a692c488df4a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:58.446884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48aebaf0-f67d-4417-b93a-a692c488df4a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:58.450637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48aebaf0-f67d-4417-b93a-a692c488df4a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:58.451719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48aebaf0-f67d-4417-b93a-a692c488df4a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:58.452342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48aebaf0-f67d-4417-b93a-a692c488df4a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:58.454190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48aebaf0-f67d-4417-b93a-a692c488df4a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:58.642246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8b29e3e4-85b5-476d-a308-aff7cd044cf6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:58.652163 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8b29e3e4-85b5-476d-a308-aff7cd044cf6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1366 microversion: 2.1 time: 0.737376 Sep 10 10:36:58.660390 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 372/712] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:57 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1366 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:36:58.903209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-48aebaf0-f67d-4417-b93a-a692c488df4a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:58.919061 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-48aebaf0-f67d-4417-b93a-a692c488df4a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1279 microversion: 2.1 time: 0.490299 Sep 10 10:36:58.923341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0f585cd8-ece4-4759-97a5-738162db8d87 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:58.923962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0f585cd8-ece4-4759-97a5-738162db8d87 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:58.935119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f585cd8-ece4-4759-97a5-738162db8d87 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:58.937966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f585cd8-ece4-4759-97a5-738162db8d87 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:58.941518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f585cd8-ece4-4759-97a5-738162db8d87 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:58.942490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f585cd8-ece4-4759-97a5-738162db8d87 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:58.943171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f585cd8-ece4-4759-97a5-738162db8d87 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:58.943812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f585cd8-ece4-4759-97a5-738162db8d87 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:58.947266 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 341/713] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:58 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1279 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:36:59.149504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:59.150185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:59.160585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:59.161095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:59.163868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:59.167239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:59.175854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:59.176719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:59.320028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0f585cd8-ece4-4759-97a5-738162db8d87 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:59.344354 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0f585cd8-ece4-4759-97a5-738162db8d87 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1268 microversion: 2.1 time: 0.425932 Sep 10 10:36:59.347142 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 373/714] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:58 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1268 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:36:59.663226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:59.690533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1de0f243-4a94-4528-b05a-b129b749b841 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:59.694040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1de0f243-4a94-4528-b05a-b129b749b841 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:59.698107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:59.708453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:36:59.714267 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02f42850-b635-4dea-954a-9b4f235ed069 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1568 microversion: 2.25 time: 0.569423 Sep 10 10:36:59.715821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1de0f243-4a94-4528-b05a-b129b749b841 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:59.720381 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 342/715] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:36:59 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1568 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:36:59.723232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1de0f243-4a94-4528-b05a-b129b749b841 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:59.726567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1de0f243-4a94-4528-b05a-b129b749b841 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:59.736956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1de0f243-4a94-4528-b05a-b129b749b841 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:59.743164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1de0f243-4a94-4528-b05a-b129b749b841 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:59.779493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1de0f243-4a94-4528-b05a-b129b749b841 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:59.953849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2cd29984-1532-4ca7-9d9d-7d72f3774269 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:36:59.954625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2cd29984-1532-4ca7-9d9d-7d72f3774269 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:36:59.966030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd29984-1532-4ca7-9d9d-7d72f3774269 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:59.966449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd29984-1532-4ca7-9d9d-7d72f3774269 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:59.966892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd29984-1532-4ca7-9d9d-7d72f3774269 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:36:59.970041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd29984-1532-4ca7-9d9d-7d72f3774269 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:36:59.970529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd29984-1532-4ca7-9d9d-7d72f3774269 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:36:59.973165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd29984-1532-4ca7-9d9d-7d72f3774269 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:00.393852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1de0f243-4a94-4528-b05a-b129b749b841 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:00.408040 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1de0f243-4a94-4528-b05a-b129b749b841 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1366 microversion: 2.1 time: 0.723452 Sep 10 10:37:00.413603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2cd29984-1532-4ca7-9d9d-7d72f3774269 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:00.423345 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 374/716] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:59 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1366 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:00.424316 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2cd29984-1532-4ca7-9d9d-7d72f3774269 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1279 microversion: 2.1 time: 0.472817 Sep 10 10:37:00.426707 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 343/717] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:36:59 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1279 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:00.438054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7789be65-8262-41ac-b95f-231284e51b68 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:00.439279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7789be65-8262-41ac-b95f-231284e51b68 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:00.455099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7789be65-8262-41ac-b95f-231284e51b68 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:00.459300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7789be65-8262-41ac-b95f-231284e51b68 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:00.459764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7789be65-8262-41ac-b95f-231284e51b68 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:00.460505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7789be65-8262-41ac-b95f-231284e51b68 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:00.460971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7789be65-8262-41ac-b95f-231284e51b68 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:00.461430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7789be65-8262-41ac-b95f-231284e51b68 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:00.593058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7789be65-8262-41ac-b95f-231284e51b68 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:00.606911 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7789be65-8262-41ac-b95f-231284e51b68 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1274 microversion: 2.1 time: 0.182297 Sep 10 10:37:00.623782 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 375/718] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:00 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:00.753920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:00.754479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:00.764040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:00.767621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:00.768310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:00.770246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:00.772071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:00.772667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:01.281210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:01.299645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:01.302624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:01.308258 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e0403a5-46bb-451b-bc90-d41b9f3f377d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1568 microversion: 2.25 time: 0.563077 Sep 10 10:37:01.328405 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 344/719] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:00 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1568 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:01.436630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-368c26a3-ae0e-4be2-bdd9-da1d57b6ab05 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:01.437294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-368c26a3-ae0e-4be2-bdd9-da1d57b6ab05 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:01.453135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-368c26a3-ae0e-4be2-bdd9-da1d57b6ab05 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:01.453919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-368c26a3-ae0e-4be2-bdd9-da1d57b6ab05 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:01.454521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-368c26a3-ae0e-4be2-bdd9-da1d57b6ab05 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:01.454646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14e01bc6-9c7f-4900-947b-002735d218ab tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:01.455236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14e01bc6-9c7f-4900-947b-002735d218ab tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:01.455674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-368c26a3-ae0e-4be2-bdd9-da1d57b6ab05 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:01.456306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-368c26a3-ae0e-4be2-bdd9-da1d57b6ab05 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:01.456886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-368c26a3-ae0e-4be2-bdd9-da1d57b6ab05 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:01.461541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:01.465405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e01bc6-9c7f-4900-947b-002735d218ab tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:01.465907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e01bc6-9c7f-4900-947b-002735d218ab tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:01.466652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e01bc6-9c7f-4900-947b-002735d218ab tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:01.469168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e01bc6-9c7f-4900-947b-002735d218ab tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:01.469873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e01bc6-9c7f-4900-947b-002735d218ab tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:01.470464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e01bc6-9c7f-4900-947b-002735d218ab tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:01.960957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-368c26a3-ae0e-4be2-bdd9-da1d57b6ab05 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:01.994580 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-368c26a3-ae0e-4be2-bdd9-da1d57b6ab05 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1366 microversion: 2.1 time: 0.562233 Sep 10 10:37:01.995356 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 376/720] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:01 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:02.009594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7cb11057-c407-4e2c-9fde-73df89dbe3bd tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:02.010507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7cb11057-c407-4e2c-9fde-73df89dbe3bd tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:02.018767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cb11057-c407-4e2c-9fde-73df89dbe3bd tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:02.019506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cb11057-c407-4e2c-9fde-73df89dbe3bd tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:02.020647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cb11057-c407-4e2c-9fde-73df89dbe3bd tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:02.021562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cb11057-c407-4e2c-9fde-73df89dbe3bd tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:02.022168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cb11057-c407-4e2c-9fde-73df89dbe3bd tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:02.022741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cb11057-c407-4e2c-9fde-73df89dbe3bd tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:02.152194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7cb11057-c407-4e2c-9fde-73df89dbe3bd tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:02.166089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14e01bc6-9c7f-4900-947b-002735d218ab tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:02.175416 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14e01bc6-9c7f-4900-947b-002735d218ab tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1321 microversion: 2.1 time: 0.724859 Sep 10 10:37:02.175997 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 345/721] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:01 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1321 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:02.179034 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7cb11057-c407-4e2c-9fde-73df89dbe3bd tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1274 microversion: 2.1 time: 0.164493 Sep 10 10:37:02.179692 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 377/722] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:01 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:02.188587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-029fd0ae-0191-4fa0-b37e-d203451eaa20 req-1d7f89e4-92ff-4e90-8a25-38b884e4cb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e9ca71-6d1b-4fc0-87dd-804a4a52745b", "name": "network-vif-plugged", "status": "completed", "tag": "4f741feb-1286-4ef7-a2c4-4f8c4ea45848"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:02.195203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-02abe680-03b5-4898-80cf-05d8d6ceb54d req-986a4515-5f73-4fbb-9037-b21a37d3699b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d649fdd-c8f0-4b15-9434-32d88f643ed1", "tag": "87804b23-16c0-45b3-9b2d-4f16c41d16f2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:02.232184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-02abe680-03b5-4898-80cf-05d8d6ceb54d req-986a4515-5f73-4fbb-9037-b21a37d3699b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:02.233090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-02abe680-03b5-4898-80cf-05d8d6ceb54d req-986a4515-5f73-4fbb-9037-b21a37d3699b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:02.234725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-02abe680-03b5-4898-80cf-05d8d6ceb54d req-986a4515-5f73-4fbb-9037-b21a37d3699b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:02.236670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-029fd0ae-0191-4fa0-b37e-d203451eaa20 req-1d7f89e4-92ff-4e90-8a25-38b884e4cb54 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:02.240321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-029fd0ae-0191-4fa0-b37e-d203451eaa20 req-1d7f89e4-92ff-4e90-8a25-38b884e4cb54 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:02.241416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-029fd0ae-0191-4fa0-b37e-d203451eaa20 req-1d7f89e4-92ff-4e90-8a25-38b884e4cb54 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:02.278847 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-02abe680-03b5-4898-80cf-05d8d6ceb54d req-986a4515-5f73-4fbb-9037-b21a37d3699b service nova] Creating event network-changed:87804b23-16c0-45b3-9b2d-4f16c41d16f2 for instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 on n-h2-856894-1 Sep 10 10:37:02.289892 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-029fd0ae-0191-4fa0-b37e-d203451eaa20 req-1d7f89e4-92ff-4e90-8a25-38b884e4cb54 service nova] Creating event network-vif-plugged:4f741feb-1286-4ef7-a2c4-4f8c4ea45848 for instance a8e9ca71-6d1b-4fc0-87dd-804a4a52745b on n-h1-856894-1 Sep 10 10:37:02.305595 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-02abe680-03b5-4898-80cf-05d8d6ceb54d req-986a4515-5f73-4fbb-9037-b21a37d3699b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119749 Sep 10 10:37:02.308223 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 378/723] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:02.317704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-029fd0ae-0191-4fa0-b37e-d203451eaa20 req-1d7f89e4-92ff-4e90-8a25-38b884e4cb54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129014 Sep 10 10:37:02.321639 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 346/724] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:02.345656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:02.347415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:02.356824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:02.357712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:02.358398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:02.359343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:02.360601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:02.361363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:03.023437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-663a6e40-a4f5-4c1b-a18e-1e89e2191b3c tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:03.026342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-663a6e40-a4f5-4c1b-a18e-1e89e2191b3c tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:03.038780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-663a6e40-a4f5-4c1b-a18e-1e89e2191b3c tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:03.042590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-663a6e40-a4f5-4c1b-a18e-1e89e2191b3c tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:03.045949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-663a6e40-a4f5-4c1b-a18e-1e89e2191b3c tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:03.047067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-663a6e40-a4f5-4c1b-a18e-1e89e2191b3c tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:03.051870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:03.056337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-663a6e40-a4f5-4c1b-a18e-1e89e2191b3c tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:03.063984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-663a6e40-a4f5-4c1b-a18e-1e89e2191b3c tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:03.071380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:03.079485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:03.080797 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b6e59f3f-4cd7-4553-a2c4-7275787da776 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1568 microversion: 2.25 time: 0.742736 Sep 10 10:37:03.081412 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 379/725] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:02 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1568 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:03.198364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-adf3b6c1-496d-4533-8525-b91abdd67578 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:03.199182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-adf3b6c1-496d-4533-8525-b91abdd67578 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:03.205609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adf3b6c1-496d-4533-8525-b91abdd67578 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:03.206098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adf3b6c1-496d-4533-8525-b91abdd67578 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:03.206531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adf3b6c1-496d-4533-8525-b91abdd67578 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:03.210724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adf3b6c1-496d-4533-8525-b91abdd67578 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:03.211382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adf3b6c1-496d-4533-8525-b91abdd67578 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:03.212514 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adf3b6c1-496d-4533-8525-b91abdd67578 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:03.694712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-663a6e40-a4f5-4c1b-a18e-1e89e2191b3c tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:03.703356 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-663a6e40-a4f5-4c1b-a18e-1e89e2191b3c tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1366 microversion: 2.1 time: 0.687333 Sep 10 10:37:03.705194 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 347/726] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:03 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1366 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:03.721156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-700a4fac-8ffc-463a-bed4-3b2534e48815 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:03.722599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-700a4fac-8ffc-463a-bed4-3b2534e48815 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:03.730480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700a4fac-8ffc-463a-bed4-3b2534e48815 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:03.731225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700a4fac-8ffc-463a-bed4-3b2534e48815 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:03.731816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700a4fac-8ffc-463a-bed4-3b2534e48815 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:03.732676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700a4fac-8ffc-463a-bed4-3b2534e48815 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:03.733332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700a4fac-8ffc-463a-bed4-3b2534e48815 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:03.734309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700a4fac-8ffc-463a-bed4-3b2534e48815 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:03.771312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-adf3b6c1-496d-4533-8525-b91abdd67578 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:03.783900 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-adf3b6c1-496d-4533-8525-b91abdd67578 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1321 microversion: 2.1 time: 0.589281 Sep 10 10:37:03.785179 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 380/727] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:03 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1321 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:03.914319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-3a4e062f-ae11-4026-9335-2332e84c6026 req-4f2f20bd-9049-4f98-8a33-3efc884beb4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8343f197-7bda-4d75-900b-67725df1432a", "tag": "a0ab20c1-72dc-422c-9dc0-9f4e40128cf3"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:03.929544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3a4e062f-ae11-4026-9335-2332e84c6026 req-4f2f20bd-9049-4f98-8a33-3efc884beb4d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:03.931104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3a4e062f-ae11-4026-9335-2332e84c6026 req-4f2f20bd-9049-4f98-8a33-3efc884beb4d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:03.933177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3a4e062f-ae11-4026-9335-2332e84c6026 req-4f2f20bd-9049-4f98-8a33-3efc884beb4d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:03.959251 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3a4e062f-ae11-4026-9335-2332e84c6026 req-4f2f20bd-9049-4f98-8a33-3efc884beb4d service nova] Creating event network-changed:a0ab20c1-72dc-422c-9dc0-9f4e40128cf3 for instance 8343f197-7bda-4d75-900b-67725df1432a on n-h2-856894-1 Sep 10 10:37:03.966377 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-3a4e062f-ae11-4026-9335-2332e84c6026 req-4f2f20bd-9049-4f98-8a33-3efc884beb4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057172 Sep 10 10:37:03.967734 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 381/728] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:37:04.106815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:04.107624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:04.114703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:04.115637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:04.116344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:04.117474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:04.118448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:04.119074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:04.274065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-700a4fac-8ffc-463a-bed4-3b2534e48815 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:04.295688 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-700a4fac-8ffc-463a-bed4-3b2534e48815 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1316 microversion: 2.1 time: 0.589004 Sep 10 10:37:04.297441 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 348/729] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:03 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:04.381407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:04.407675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:04.411112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:04.417284 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f145060e-3a18-4faf-a283-c1f12156c2a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1568 microversion: 2.25 time: 0.313387 Sep 10 10:37:04.418998 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 382/730] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:04 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1568 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:37:04.731536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c83c7a73-7678-4d73-a55a-f82ff7f6bae0 req-2549a60c-8b37-4fc2-bf53-cbe254262e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eedcceae-bebe-4119-aeda-1654f917c921", "tag": "308595f2-1096-4350-a976-894a61762f62"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:04.734546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-72dbcde7-0603-4501-8cdf-c59de61452cd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:04.735185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-72dbcde7-0603-4501-8cdf-c59de61452cd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:04.770363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72dbcde7-0603-4501-8cdf-c59de61452cd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:04.778570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72dbcde7-0603-4501-8cdf-c59de61452cd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:04.779025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72dbcde7-0603-4501-8cdf-c59de61452cd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:04.782947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72dbcde7-0603-4501-8cdf-c59de61452cd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:04.786284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72dbcde7-0603-4501-8cdf-c59de61452cd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:04.789271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72dbcde7-0603-4501-8cdf-c59de61452cd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:04.793226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c83c7a73-7678-4d73-a55a-f82ff7f6bae0 req-2549a60c-8b37-4fc2-bf53-cbe254262e36 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:04.793892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c83c7a73-7678-4d73-a55a-f82ff7f6bae0 req-2549a60c-8b37-4fc2-bf53-cbe254262e36 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:04.794347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c83c7a73-7678-4d73-a55a-f82ff7f6bae0 req-2549a60c-8b37-4fc2-bf53-cbe254262e36 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:04.817580 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c83c7a73-7678-4d73-a55a-f82ff7f6bae0 req-2549a60c-8b37-4fc2-bf53-cbe254262e36 service nova] Creating event network-changed:308595f2-1096-4350-a976-894a61762f62 for instance eedcceae-bebe-4119-aeda-1654f917c921 on n-h1-856894-1 Sep 10 10:37:04.823048 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c83c7a73-7678-4d73-a55a-f82ff7f6bae0 req-2549a60c-8b37-4fc2-bf53-cbe254262e36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106633 Sep 10 10:37:04.823658 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 349/731] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:37:04.830669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0aa17fac-b64c-4aae-b779-25b1a8d422d3 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:04.837966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0aa17fac-b64c-4aae-b779-25b1a8d422d3 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:04.849252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa17fac-b64c-4aae-b779-25b1a8d422d3 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:04.850107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa17fac-b64c-4aae-b779-25b1a8d422d3 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:04.850773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa17fac-b64c-4aae-b779-25b1a8d422d3 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:04.858635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa17fac-b64c-4aae-b779-25b1a8d422d3 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:04.859371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa17fac-b64c-4aae-b779-25b1a8d422d3 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:04.860033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa17fac-b64c-4aae-b779-25b1a8d422d3 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:05.379395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72dbcde7-0603-4501-8cdf-c59de61452cd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:05.389961 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-72dbcde7-0603-4501-8cdf-c59de61452cd tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1556 microversion: 2.1 time: 0.664226 Sep 10 10:37:05.401274 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 383/732] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:04 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1556 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:05.410285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c38a7b04-50f8-4fad-b5ae-c64ba946109e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:05.413677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c38a7b04-50f8-4fad-b5ae-c64ba946109e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:05.423177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38a7b04-50f8-4fad-b5ae-c64ba946109e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:05.423942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38a7b04-50f8-4fad-b5ae-c64ba946109e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:05.424589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38a7b04-50f8-4fad-b5ae-c64ba946109e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:05.425501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38a7b04-50f8-4fad-b5ae-c64ba946109e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:05.426130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38a7b04-50f8-4fad-b5ae-c64ba946109e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:05.426748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38a7b04-50f8-4fad-b5ae-c64ba946109e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:05.672661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c38a7b04-50f8-4fad-b5ae-c64ba946109e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:05.690070 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c38a7b04-50f8-4fad-b5ae-c64ba946109e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1316 microversion: 2.1 time: 0.287294 Sep 10 10:37:05.690662 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 384/733] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:05 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:05.715243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-670b0976-c9e8-4967-9b73-8b7de82ab5f5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:05.715403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:05.716059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-670b0976-c9e8-4967-9b73-8b7de82ab5f5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:05.736031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-670b0976-c9e8-4967-9b73-8b7de82ab5f5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:05.737694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-670b0976-c9e8-4967-9b73-8b7de82ab5f5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:05.738371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-670b0976-c9e8-4967-9b73-8b7de82ab5f5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:05.739499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-670b0976-c9e8-4967-9b73-8b7de82ab5f5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:05.740173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-670b0976-c9e8-4967-9b73-8b7de82ab5f5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:05.740839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-670b0976-c9e8-4967-9b73-8b7de82ab5f5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:05.770789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0aa17fac-b64c-4aae-b779-25b1a8d422d3 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:05.781716 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0aa17fac-b64c-4aae-b779-25b1a8d422d3 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1321 microversion: 2.1 time: 0.953701 Sep 10 10:37:05.785401 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 350/734] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:04 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1321 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:05.798451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:05.799075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:05.817949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:05.818462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:05.818914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:05.819634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:05.820093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:05.843770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:05.878744 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-670b0976-c9e8-4967-9b73-8b7de82ab5f5 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171285 Sep 10 10:37:05.879568 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 385/735] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:37:05 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:05.946345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=10 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:06.379781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:06.391711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:06.394350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:06.396642 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-584ab70f-d1c4-4c6a-9e19-d9f701718065 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1568 microversion: 2.25 time: 0.610017 Sep 10 10:37:06.405770 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 351/736] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:05 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1568 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:06.721602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-248dfff0-6c74-4cab-9ac1-cd0b4db8047a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:06.723206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-248dfff0-6c74-4cab-9ac1-cd0b4db8047a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:06.738948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-248dfff0-6c74-4cab-9ac1-cd0b4db8047a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:06.739520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-248dfff0-6c74-4cab-9ac1-cd0b4db8047a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:06.740069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-248dfff0-6c74-4cab-9ac1-cd0b4db8047a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:06.740941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-248dfff0-6c74-4cab-9ac1-cd0b4db8047a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:06.741584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-248dfff0-6c74-4cab-9ac1-cd0b4db8047a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:06.742161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-248dfff0-6c74-4cab-9ac1-cd0b4db8047a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:06.812799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be520376-08d8-40bb-9eb6-ea61372c0a2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:06.813384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be520376-08d8-40bb-9eb6-ea61372c0a2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:06.827290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be520376-08d8-40bb-9eb6-ea61372c0a2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:06.829305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be520376-08d8-40bb-9eb6-ea61372c0a2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:06.830071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be520376-08d8-40bb-9eb6-ea61372c0a2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:06.831637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be520376-08d8-40bb-9eb6-ea61372c0a2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:06.832431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be520376-08d8-40bb-9eb6-ea61372c0a2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:06.833192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be520376-08d8-40bb-9eb6-ea61372c0a2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:07.142110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be520376-08d8-40bb-9eb6-ea61372c0a2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:07.150546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be520376-08d8-40bb-9eb6-ea61372c0a2d tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1321 microversion: 2.1 time: 0.346476 Sep 10 10:37:07.166655 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 352/737] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:06 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:07.402462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-248dfff0-6c74-4cab-9ac1-cd0b4db8047a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:07.425144 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-248dfff0-6c74-4cab-9ac1-cd0b4db8047a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1316 microversion: 2.1 time: 0.709879 Sep 10 10:37:07.427559 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 386/738] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:06 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1316 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:07.447259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:07.447800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:07.455941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:07.456869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:07.457657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:07.458435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:07.458963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:07.459483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:07.799911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:07.813452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:07.816400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:07.819975 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bdf5fbbc-3d7f-4235-b21b-d9177e9394bc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1568 microversion: 2.25 time: 0.391939 Sep 10 10:37:07.821837 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 353/739] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:07 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1568 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:08.177262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-727c1a78-6d26-4e51-98b7-b8138e80e0ce tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:08.178849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-727c1a78-6d26-4e51-98b7-b8138e80e0ce tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:08.181211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=9 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:08.183316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:08.199703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-727c1a78-6d26-4e51-98b7-b8138e80e0ce tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:08.201280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-727c1a78-6d26-4e51-98b7-b8138e80e0ce tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:08.201931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-727c1a78-6d26-4e51-98b7-b8138e80e0ce tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:08.203254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-727c1a78-6d26-4e51-98b7-b8138e80e0ce tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:08.203896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-727c1a78-6d26-4e51-98b7-b8138e80e0ce tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:08.204501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-727c1a78-6d26-4e51-98b7-b8138e80e0ce tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:08.452904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69c23553-cb26-44cb-b92d-15ac5b8a5084 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:08.453651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69c23553-cb26-44cb-b92d-15ac5b8a5084 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:08.461091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69c23553-cb26-44cb-b92d-15ac5b8a5084 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:08.466145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69c23553-cb26-44cb-b92d-15ac5b8a5084 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:08.466745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69c23553-cb26-44cb-b92d-15ac5b8a5084 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:08.467594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69c23553-cb26-44cb-b92d-15ac5b8a5084 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:08.470231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69c23553-cb26-44cb-b92d-15ac5b8a5084 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:08.470759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69c23553-cb26-44cb-b92d-15ac5b8a5084 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:08.822252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-69c23553-cb26-44cb-b92d-15ac5b8a5084 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:08.847077 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69c23553-cb26-44cb-b92d-15ac5b8a5084 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1316 microversion: 2.1 time: 0.397935 Sep 10 10:37:08.848633 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 354/740] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:08 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:08.858229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:08.859040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:08.869050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:08.871704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:08.872358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:08.873290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:08.873886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:08.874463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:09.097897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-727c1a78-6d26-4e51-98b7-b8138e80e0ce tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:09.113798 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-727c1a78-6d26-4e51-98b7-b8138e80e0ce tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1321 microversion: 2.1 time: 0.940448 Sep 10 10:37:09.115200 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 387/741] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:08 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1321 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:09.128024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:09.128286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:09.146070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:09.147844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:09.149415 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30b84a5d-1011-49f3-9665-48cdf5f349f7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1558 microversion: 2.25 time: 0.299440 Sep 10 10:37:09.150562 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 355/742] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:08 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1558 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:09.175567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b462f659-881e-4288-a5f7-86580f268670 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '.version_select at 0x7efcaedc0e50>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:09.179456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b462f659-881e-4288-a5f7-86580f268670 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:09.180072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b462f659-881e-4288-a5f7-86580f268670 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:09.180647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b462f659-881e-4288-a5f7-86580f268670 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:09.196825 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b462f659-881e-4288-a5f7-86580f268670 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.025279 Sep 10 10:37:09.212282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a474a78-5394-4f43-ac45-9989c898e033 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:09.213655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a474a78-5394-4f43-ac45-9989c898e033 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:09.219627 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 388/743] 10.222.0.20 () {60 vars in 1184 bytes} [Sat Sep 10 10:37:09 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:37:09.221643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a474a78-5394-4f43-ac45-9989c898e033 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:09.222244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a474a78-5394-4f43-ac45-9989c898e033 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:09.222787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a474a78-5394-4f43-ac45-9989c898e033 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:09.223592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a474a78-5394-4f43-ac45-9989c898e033 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:09.224131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a474a78-5394-4f43-ac45-9989c898e033 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:09.224732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a474a78-5394-4f43-ac45-9989c898e033 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:09.415208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-fe42061f-7042-4a3f-afe8-c775e9a185c3 req-e1153f58-6c72-4bb1-985a-b2303155cd4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e9ca71-6d1b-4fc0-87dd-804a4a52745b", "tag": "4f741feb-1286-4ef7-a2c4-4f8c4ea45848"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:09.454683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fe42061f-7042-4a3f-afe8-c775e9a185c3 req-e1153f58-6c72-4bb1-985a-b2303155cd4a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:09.455399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fe42061f-7042-4a3f-afe8-c775e9a185c3 req-e1153f58-6c72-4bb1-985a-b2303155cd4a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:09.455845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fe42061f-7042-4a3f-afe8-c775e9a185c3 req-e1153f58-6c72-4bb1-985a-b2303155cd4a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:09.500581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5a474a78-5394-4f43-ac45-9989c898e033 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid 6c0f0704-e44c-45ed-8cba-86d6ad048f12 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:37:09.516895 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-fe42061f-7042-4a3f-afe8-c775e9a185c3 req-e1153f58-6c72-4bb1-985a-b2303155cd4a service nova] Creating event network-changed:4f741feb-1286-4ef7-a2c4-4f8c4ea45848 for instance a8e9ca71-6d1b-4fc0-87dd-804a4a52745b on n-h1-856894-1 Sep 10 10:37:09.530291 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-fe42061f-7042-4a3f-afe8-c775e9a185c3 req-e1153f58-6c72-4bb1-985a-b2303155cd4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129304 Sep 10 10:37:09.531622 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 389/744] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:09.624221 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a474a78-5394-4f43-ac45-9989c898e033 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 2050 microversion: 2.25 time: 0.415605 Sep 10 10:37:09.626232 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 356/745] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:09 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 2050 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:09.816082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1753184725", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "47147fcc-eb59-4f08-ae29-874c9998564e"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:09.840181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f54d216b-f84a-4e0e-923a-39242442216f tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaed1e160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-209186015", "description": "tempest-description-23507882"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:09.922846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] validate_networks() for [('47147fcc-eb59-4f08-ae29-874c9998564e', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:37:10.193977 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f54d216b-f84a-4e0e-923a-39242442216f tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.618162 Sep 10 10:37:10.194576 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 390/746] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:37:09 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:10.222353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-05506f5c-130f-42f8-b8fe-9602906e1bc2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:10.223384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-05506f5c-130f-42f8-b8fe-9602906e1bc2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:10.233179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05506f5c-130f-42f8-b8fe-9602906e1bc2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:10.233889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05506f5c-130f-42f8-b8fe-9602906e1bc2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:10.236212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05506f5c-130f-42f8-b8fe-9602906e1bc2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:10.237161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05506f5c-130f-42f8-b8fe-9602906e1bc2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:10.237772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05506f5c-130f-42f8-b8fe-9602906e1bc2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:10.238530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05506f5c-130f-42f8-b8fe-9602906e1bc2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:10.716446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-05506f5c-130f-42f8-b8fe-9602906e1bc2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:10.734676 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-05506f5c-130f-42f8-b8fe-9602906e1bc2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1316 microversion: 2.1 time: 0.523423 Sep 10 10:37:10.745222 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 391/747] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:10 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:10.762785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c2bdbd08-a199-4f5b-bef2-ee13931f1af7 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:10.764185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c2bdbd08-a199-4f5b-bef2-ee13931f1af7 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:10.772949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2bdbd08-a199-4f5b-bef2-ee13931f1af7 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:10.773643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2bdbd08-a199-4f5b-bef2-ee13931f1af7 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:10.774474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2bdbd08-a199-4f5b-bef2-ee13931f1af7 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:10.776699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2bdbd08-a199-4f5b-bef2-ee13931f1af7 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:10.777767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2bdbd08-a199-4f5b-bef2-ee13931f1af7 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:10.778445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2bdbd08-a199-4f5b-bef2-ee13931f1af7 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:10.957881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c2bdbd08-a199-4f5b-bef2-ee13931f1af7 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:10.973374 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c2bdbd08-a199-4f5b-bef2-ee13931f1af7 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1321 microversion: 2.1 time: 0.235323 Sep 10 10:37:10.973969 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 392/748] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:10 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:10.980322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1974f670-76d1-4d48-8b5b-94ce73e9bfc0 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaed1e790>, body: {"security_group_rule": {"parent_group_id": "3e6212e4-e275-471e-9ac3-7d41ec382544", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:11.227072 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1974f670-76d1-4d48-8b5b-94ce73e9bfc0 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.252015 Sep 10 10:37:11.228470 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 393/749] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:37:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:11.241202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1507d840-45bb-4705-8692-73e0e30b65e4 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaed214c0>, body: {"security_group_rule": {"parent_group_id": "3e6212e4-e275-471e-9ac3-7d41ec382544", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:11.311121 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-1507d840-45bb-4705-8692-73e0e30b65e4 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] HTTP exception thrown: This rule already exists in group 3e6212e4-e275-471e-9ac3-7d41ec382544 Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1507d840-45bb-4705-8692-73e0e30b65e4 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Request method failure captured: Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 138 Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjVcLPObtEHKIYOBN7PKj0_Xxd5g5XPxvr-poObAVJxyT5jgTgWlts1Am0RTc1DT7FoLmW9ort0v1YtAHyG-v6vxTUkODFJK57gjtc4hXlnRcLjDf04BZvqbcjxrrGsF2iTCKV1IbU8wgg6_jPAXZEoKiHazyQTEy9Ssx009P_rDuI Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:11.332131 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f32853014a7e46ab85a235e21a888788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f32853014a7e46ab85a235e21a888788", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b23e86ab81a14c3e922abf06f2cf122d Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: {"security_group_rule": {"parent_group_id": "3e6212e4-e275-471e-9ac3-7d41ec382544", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 10 10:37:11.333501 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: exception: This rule already exists in group 3e6212e4-e275-471e-9ac3-7d41ec382544 Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3e6212e4-e275-471e-9ac3-7d41ec382544', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 3e6212e4-e275-471e-9ac3-7d41ec382544 Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:37:11.334249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 3e6212e4-e275-471e-9ac3-7d41ec382544 Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 3e6212e4-e275-471e-9ac3-7d41ec382544 Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:11.335579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1507d840-45bb-4705-8692-73e0e30b65e4 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Returning 400 to user: This rule already exists in group 3e6212e4-e275-471e-9ac3-7d41ec382544 {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:11.336607 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1507d840-45bb-4705-8692-73e0e30b65e4 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.098680 Sep 10 10:37:11.337046 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 394/750] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:37:11 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:37:11.349965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f5f65c7a-c682-44d6-9c9e-29b491361b13 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Calling method '.version_select at 0x7efcaededee0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:11.509518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:37:11.511022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:37:11.511508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:37:11.511920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:37:11.512334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:37:11.531952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:11.533404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:11.534365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:11.535378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:11.536069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:11.536686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:11.565807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Getting quotas for project 9c2ac1f5c5c843fc89294292d4489252. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:37:11.576943 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f5f65c7a-c682-44d6-9c9e-29b491361b13 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/78407ad0-29b5-43da-ba39-ce8b03a47e8f" status: 202 len: 0 microversion: 2.1 time: 0.234353 Sep 10 10:37:11.577778 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 395/751] 10.222.0.20 () {58 vars in 1287 bytes} [Sat Sep 10 10:37:11 2022] DELETE /compute/v2.1/os-security-group-rules/78407ad0-29b5-43da-ba39-ce8b03a47e8f => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:37:11.586942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-678d678f-7da0-44e0-b582-904445dfee35 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaee22310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-895438768", "description": "tempest-description-1371431873"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:11.589431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Getting quotas for user 362b727b96934e58b180727eaad35e3b and project 9c2ac1f5c5c843fc89294292d4489252. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:37:11.604431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:37:11.607430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:37:11.671091 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3332d66b-0850-49b1-88be-f16863fb6390 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.856909 Sep 10 10:37:11.673266 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 357/752] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:37:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 10:37:11.686092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a3c305df-b671-4e92-adb2-ae2374b4191a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:11.688184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a3c305df-b671-4e92-adb2-ae2374b4191a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:11.837041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3c305df-b671-4e92-adb2-ae2374b4191a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:11.854614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3c305df-b671-4e92-adb2-ae2374b4191a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:11.858077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3c305df-b671-4e92-adb2-ae2374b4191a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:11.860144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a3c305df-b671-4e92-adb2-ae2374b4191a tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1262 microversion: 2.25 time: 0.181179 Sep 10 10:37:11.862325 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 358/753] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:11 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1262 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:37:11.867867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-115cfc6d-2b55-453a-90e4-1a49d5061553 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:11.868651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-115cfc6d-2b55-453a-90e4-1a49d5061553 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:11.876961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-115cfc6d-2b55-453a-90e4-1a49d5061553 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:11.877643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-115cfc6d-2b55-453a-90e4-1a49d5061553 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:11.878427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-115cfc6d-2b55-453a-90e4-1a49d5061553 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:11.879281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-115cfc6d-2b55-453a-90e4-1a49d5061553 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:11.879936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-115cfc6d-2b55-453a-90e4-1a49d5061553 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:11.880506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-115cfc6d-2b55-453a-90e4-1a49d5061553 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:11.910176 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-678d678f-7da0-44e0-b582-904445dfee35 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.326807 Sep 10 10:37:11.911158 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 396/754] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:37:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:37:11.926525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-32457f90-42ba-4e06-a2e9-4291ca5c4669 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaed1ec10>, body: {"security_group_rule": {"parent_group_id": "f5140cc6-6e78-45e6-8854-d1641bd932de", "ip_protocol": "tcp", "from_port": 1810867637, "to_port": 22}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:12.023950 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-32457f90-42ba-4e06-a2e9-4291ca5c4669 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] HTTP exception thrown: Invalid port range 1810867637:22. Former value cannot be greater than the later Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-32457f90-42ba-4e06-a2e9-4291ca5c4669 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Request method failure captured: Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 146 Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjVcLPObtEHKIYOBN7PKj0_Xxd5g5XPxvr-poObAVJxyT5jgTgWlts1Am0RTc1DT7FoLmW9ort0v1YtAHyG-v6vxTUkODFJK57gjtc4hXlnRcLjDf04BZvqbcjxrrGsF2iTCKV1IbU8wgg6_jPAXZEoKiHazyQTEy9Ssx009P_rDuI Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:12.031997 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f32853014a7e46ab85a235e21a888788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f32853014a7e46ab85a235e21a888788", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b23e86ab81a14c3e922abf06f2cf122d Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: {"security_group_rule": {"parent_group_id": "f5140cc6-6e78-45e6-8854-d1641bd932de", "ip_protocol": "tcp", "from_port": 1810867637, "to_port": 22}} Sep 10 10:37:12.033632 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid port range 1810867637:22. Former value cannot be greater than the later Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f5140cc6-6e78-45e6-8854-d1641bd932de', 'ip_protocol': 'tcp', 'from_port': 1810867637, 'to_port': 22}}} Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1810867637:22. Former value cannot be greater than the later Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:12.034507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1810867637:22. Former value cannot be greater than the later Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1810867637:22. Former value cannot be greater than the later Sep 10 10:37:12.035658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.041284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-32457f90-42ba-4e06-a2e9-4291ca5c4669 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Returning 400 to user: Invalid port range 1810867637:22. Former value cannot be greater than the later {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:12.044760 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-32457f90-42ba-4e06-a2e9-4291ca5c4669 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.120431 Sep 10 10:37:12.046167 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 397/755] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:37:11 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 10:37:12.051762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-930ccf72-4d3d-40ef-86c1-17910a9480a0 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:12.052750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-930ccf72-4d3d-40ef-86c1-17910a9480a0 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:12.063121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-930ccf72-4d3d-40ef-86c1-17910a9480a0 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:12.063950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-930ccf72-4d3d-40ef-86c1-17910a9480a0 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:12.064839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-930ccf72-4d3d-40ef-86c1-17910a9480a0 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:12.066009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-930ccf72-4d3d-40ef-86c1-17910a9480a0 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:12.066776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-930ccf72-4d3d-40ef-86c1-17910a9480a0 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:12.067488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-930ccf72-4d3d-40ef-86c1-17910a9480a0 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:12.167865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-115cfc6d-2b55-453a-90e4-1a49d5061553 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:12.184361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-115cfc6d-2b55-453a-90e4-1a49d5061553 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1316 microversion: 2.1 time: 0.320511 Sep 10 10:37:12.203344 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 359/756] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:11 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:12.212716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e28d1ec4-9a90-498a-9a49-74fb20375b52 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaee90310>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1183458067", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:12.215692 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e28d1ec4-9a90-498a-9a49-74fb20375b52 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] HTTP exception thrown: Security group id should be uuid Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e28d1ec4-9a90-498a-9a49-74fb20375b52 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Request method failure captured: Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 131 Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGjVcLPObtEHKIYOBN7PKj0_Xxd5g5XPxvr-poObAVJxyT5jgTgWlts1Am0RTc1DT7FoLmW9ort0v1YtAHyG-v6vxTUkODFJK57gjtc4hXlnRcLjDf04BZvqbcjxrrGsF2iTCKV1IbU8wgg6_jPAXZEoKiHazyQTEy9Ssx009P_rDuI Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:37:12.218272 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f32853014a7e46ab85a235e21a888788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f32853014a7e46ab85a235e21a888788", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: b23e86ab81a14c3e922abf06f2cf122d Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1183458067", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:37:12.219578 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group id should be uuid Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1183458067', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:12.220336 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e28d1ec4-9a90-498a-9a49-74fb20375b52 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Returning 400 to user: Security group id should be uuid {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:12.221501 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e28d1ec4-9a90-498a-9a49-74fb20375b52 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015046 Sep 10 10:37:12.223677 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 360/757] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:37:12 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:37:12.236259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-768519f9-f649-45d5-ac6b-a57f711d43ac tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaee70790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-448391757", "description": "tempest-description-617860715"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:12.308745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-930ccf72-4d3d-40ef-86c1-17910a9480a0 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:12.332028 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-930ccf72-4d3d-40ef-86c1-17910a9480a0 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1321 microversion: 2.1 time: 0.284509 Sep 10 10:37:12.332695 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 398/758] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:12 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:12.476537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-653970750", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "7a348664-563c-432f-b19c-fd5cc8cfa620"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:12.537558 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-768519f9-f649-45d5-ac6b-a57f711d43ac tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.305131 Sep 10 10:37:12.538173 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 361/759] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:37:12 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:12.551765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74929c42-6a24-4ba7-a0fc-93586f75520d tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaee0f160>, body: {"security_group_rule": {"parent_group_id": "372eaee3-18cf-4529-b1af-b9e87574e05e", "ip_protocol": "tempest-999-2144651619", "from_port": 22, "to_port": 22}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:12.574235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] validate_networks() for [('7a348664-563c-432f-b19c-fd5cc8cfa620', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:37:12.619115 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-74929c42-6a24-4ba7-a0fc-93586f75520d tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] HTTP exception thrown: Invalid IP protocol tempest-999-2144651619. Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74929c42-6a24-4ba7-a0fc-93586f75520d tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Request method failure captured: Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 157 Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGjVcLPObtEHKIYOBN7PKj0_Xxd5g5XPxvr-poObAVJxyT5jgTgWlts1Am0RTc1DT7FoLmW9ort0v1YtAHyG-v6vxTUkODFJK57gjtc4hXlnRcLjDf04BZvqbcjxrrGsF2iTCKV1IbU8wgg6_jPAXZEoKiHazyQTEy9Ssx009P_rDuI Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:37:12.621524 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f32853014a7e46ab85a235e21a888788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f32853014a7e46ab85a235e21a888788", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: b23e86ab81a14c3e922abf06f2cf122d Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: {"security_group_rule": {"parent_group_id": "372eaee3-18cf-4529-b1af-b9e87574e05e", "ip_protocol": "tempest-999-2144651619", "from_port": 22, "to_port": 22}} Sep 10 10:37:12.622889 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid IP protocol tempest-999-2144651619. Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'security_group_rule': {'parent_group_id': '372eaee3-18cf-4529-b1af-b9e87574e05e', 'ip_protocol': 'tempest-999-2144651619', 'from_port': 22, 'to_port': 22}}} Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2144651619. Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:12.623580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2144651619. Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2144651619. Sep 10 10:37:12.624745 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:12.628457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74929c42-6a24-4ba7-a0fc-93586f75520d tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Returning 400 to user: Invalid IP protocol tempest-999-2144651619. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:12.628457 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74929c42-6a24-4ba7-a0fc-93586f75520d tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.075622 Sep 10 10:37:12.628457 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 362/760] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:37:12 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 10 10:37:12.634400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-98d73de3-34fe-4fa0-8ed9-d54788716f10 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaf1759d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-669910151", "description": "tempest-description-232351795"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:12.877243 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-98d73de3-34fe-4fa0-8ed9-d54788716f10 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.247028 Sep 10 10:37:12.877966 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 363/761] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:37:12 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:12.891414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:12.892099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:12.909917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:12.912449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:12.913255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:12.914243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:12.915822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:12.916527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:13.056615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:13.069156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:13.071518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:13.073825 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-28dcd82c-f2ca-4d4d-bf62-80de09c00d71 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1314 microversion: 2.25 time: 0.189632 Sep 10 10:37:13.075175 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 364/762] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:12 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:37:13.094952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9bd983c5-aa5d-4dc0-8255-f16e37cf5491 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaee90280>, body: {"security_group_rule": {"parent_group_id": "c0113721-b303-40b7-8663-e6b7d7539f87", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:13.186988 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9bd983c5-aa5d-4dc0-8255-f16e37cf5491 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9bd983c5-aa5d-4dc0-8255-f16e37cf5491 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Request method failure captured: Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 138 Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGjVcLPObtEHKIYOBN7PKj0_Xxd5g5XPxvr-poObAVJxyT5jgTgWlts1Am0RTc1DT7FoLmW9ort0v1YtAHyG-v6vxTUkODFJK57gjtc4hXlnRcLjDf04BZvqbcjxrrGsF2iTCKV1IbU8wgg6_jPAXZEoKiHazyQTEy9Ssx009P_rDuI Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:37:13.188794 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f32853014a7e46ab85a235e21a888788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f32853014a7e46ab85a235e21a888788", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: b23e86ab81a14c3e922abf06f2cf122d Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: {"security_group_rule": {"parent_group_id": "c0113721-b303-40b7-8663-e6b7d7539f87", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 10 10:37:13.190231 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c0113721-b303-40b7-8663-e6b7d7539f87', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:13.191105 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 10:37:13.192311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.195450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9bd983c5-aa5d-4dc0-8255-f16e37cf5491 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:13.196553 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9bd983c5-aa5d-4dc0-8255-f16e37cf5491 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.111502 Sep 10 10:37:13.198225 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 365/763] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:37:13 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:37:13.211027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32a72371-a4ea-4f40-a081-c804e520d5f1 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaee27dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-792328812", "description": "tempest-description-523081269"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:13.241412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:37:13.242428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:37:13.243088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:37:13.243711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:37:13.244843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:37:13.257278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:13.259274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:13.261271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:13.263276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:13.264371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:13.265303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:13.286669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Getting quotas for project 21b4ac48f7424cf18bfde0028fb844e0. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:37:13.299404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Getting quotas for user 335f46fe0ed64826baea53c3309e4e97 and project 21b4ac48f7424cf18bfde0028fb844e0. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:37:13.323009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:37:13.326793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:37:13.382949 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-30735b79-f11a-43fe-b1d8-5e75a2bd288a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030634 Sep 10 10:37:13.384208 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 399/764] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:37:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:37:13.395770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-61b557ab-b1da-42c7-ae2a-11245f39acff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:13.396892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-61b557ab-b1da-42c7-ae2a-11245f39acff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:13.404761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b557ab-b1da-42c7-ae2a-11245f39acff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:13.405706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b557ab-b1da-42c7-ae2a-11245f39acff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:13.406369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b557ab-b1da-42c7-ae2a-11245f39acff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:13.407336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b557ab-b1da-42c7-ae2a-11245f39acff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:13.408400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b557ab-b1da-42c7-ae2a-11245f39acff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:13.409126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b557ab-b1da-42c7-ae2a-11245f39acff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:13.428263 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-32a72371-a4ea-4f40-a081-c804e520d5f1 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.224918 Sep 10 10:37:13.429268 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 366/765] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:37:13 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:13.441606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c85ebf41-aa6e-4fb5-9f08-3b61609db0d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:13.442208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c85ebf41-aa6e-4fb5-9f08-3b61609db0d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:13.452663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c85ebf41-aa6e-4fb5-9f08-3b61609db0d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:13.460963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c85ebf41-aa6e-4fb5-9f08-3b61609db0d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:13.461459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c85ebf41-aa6e-4fb5-9f08-3b61609db0d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:13.462202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c85ebf41-aa6e-4fb5-9f08-3b61609db0d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:13.462666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c85ebf41-aa6e-4fb5-9f08-3b61609db0d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:13.463146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c85ebf41-aa6e-4fb5-9f08-3b61609db0d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:13.566234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-61b557ab-b1da-42c7-ae2a-11245f39acff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:13.576424 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-61b557ab-b1da-42c7-ae2a-11245f39acff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1316 microversion: 2.1 time: 0.189960 Sep 10 10:37:13.577462 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 400/766] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:13 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:13.583425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-98b04d6b-098a-4ae9-86f7-8a5158f400ae tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:13.584535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-98b04d6b-098a-4ae9-86f7-8a5158f400ae tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:13.677628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-98b04d6b-098a-4ae9-86f7-8a5158f400ae tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:13.691024 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-98b04d6b-098a-4ae9-86f7-8a5158f400ae tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1215 microversion: 2.1 time: 0.111534 Sep 10 10:37:13.691766 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 401/767] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:13 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:13.704756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea26cb9f-c9f7-47ba-8f96-1d585c0a40f0 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaef06550>, body: {"security_group_rule": {"parent_group_id": "23564850-fe58-41db-8980-c9d16a5ebe6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 542849134}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:13.797376 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-ea26cb9f-c9f7-47ba-8f96-1d585c0a40f0 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] HTTP exception thrown: Invalid port range 22:542849134. Valid TCP ports should be between 1-65535 Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea26cb9f-c9f7-47ba-8f96-1d585c0a40f0 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Request method failure captured: Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 145 Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjVcLPObtEHKIYOBN7PKj0_Xxd5g5XPxvr-poObAVJxyT5jgTgWlts1Am0RTc1DT7FoLmW9ort0v1YtAHyG-v6vxTUkODFJK57gjtc4hXlnRcLjDf04BZvqbcjxrrGsF2iTCKV1IbU8wgg6_jPAXZEoKiHazyQTEy9Ssx009P_rDuI Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:13.800330 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f32853014a7e46ab85a235e21a888788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f32853014a7e46ab85a235e21a888788", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b23e86ab81a14c3e922abf06f2cf122d Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: {"security_group_rule": {"parent_group_id": "23564850-fe58-41db-8980-c9d16a5ebe6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 542849134}} Sep 10 10:37:13.801767 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid port range 22:542849134. Valid TCP ports should be between 1-65535 Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'security_group_rule': {'parent_group_id': '23564850-fe58-41db-8980-c9d16a5ebe6b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 542849134}}} Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:542849134. Valid TCP ports should be between 1-65535 Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:13.802525 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:542849134. Valid TCP ports should be between 1-65535 Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:542849134. Valid TCP ports should be between 1-65535 Sep 10 10:37:13.803738 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.804994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea26cb9f-c9f7-47ba-8f96-1d585c0a40f0 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Returning 400 to user: Invalid port range 22:542849134. Valid TCP ports should be between 1-65535 {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:13.804994 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ea26cb9f-c9f7-47ba-8f96-1d585c0a40f0 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.108174 Sep 10 10:37:13.804994 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 402/768] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:37:13 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:37:13.828199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c85ebf41-aa6e-4fb5-9f08-3b61609db0d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:13.833308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bba513d1-5a8e-4e3b-9a2b-937cebd77211 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Action: 'create', calling method: .version_select at 0x7efcaf0f01f0>, body: {"security_group_rule": {"parent_group_id": "164ac87d-4224-47a1-9b6e-6bf34033c35a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:13.845354 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c85ebf41-aa6e-4fb5-9f08-3b61609db0d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1321 microversion: 2.1 time: 0.415037 Sep 10 10:37:13.846035 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 367/769] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:13 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:13.871290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG neutronclient.v2_0.client [None req-bba513d1-5a8e-4e3b-9a2b-937cebd77211 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 164ac87d-4224-47a1-9b6e-6bf34033c35a does not exist", "detail": ""}} {{(pid=128787) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:37:13.872486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.security_group_api [None req-bba513d1-5a8e-4e3b-9a2b-937cebd77211 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Neutron security group 164ac87d-4224-47a1-9b6e-6bf34033c35a not found {{(pid=128787) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:37:13.873105 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-bba513d1-5a8e-4e3b-9a2b-937cebd77211 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] HTTP exception thrown: Security group 164ac87d-4224-47a1-9b6e-6bf34033c35a does not exist Sep 10 10:37:13.873105 n-d-856894-1 devstack@n-api.service[128787]: Neutron server returns request_ids: ['req-91b817bb-7fff-4520-9bd4-d4e1aa0250f6'] Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bba513d1-5a8e-4e3b-9a2b-937cebd77211 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Request method failure captured: Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 138 Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjVcLPObtEHKIYOBN7PKj0_Xxd5g5XPxvr-poObAVJxyT5jgTgWlts1Am0RTc1DT7FoLmW9ort0v1YtAHyG-v6vxTUkODFJK57gjtc4hXlnRcLjDf04BZvqbcjxrrGsF2iTCKV1IbU8wgg6_jPAXZEoKiHazyQTEy9Ssx009P_rDuI Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:13.904593 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f32853014a7e46ab85a235e21a888788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f32853014a7e46ab85a235e21a888788", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b23e86ab81a14c3e922abf06f2cf122d Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: {"security_group_rule": {"parent_group_id": "164ac87d-4224-47a1-9b6e-6bf34033c35a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 10 10:37:13.906131 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: exception: Security group 164ac87d-4224-47a1-9b6e-6bf34033c35a does not exist Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: Neutron server returns request_ids: ['req-91b817bb-7fff-4520-9bd4-d4e1aa0250f6'] Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'security_group_rule': {'parent_group_id': '164ac87d-4224-47a1-9b6e-6bf34033c35a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:37:13.906834 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 164ac87d-4224-47a1-9b6e-6bf34033c35a does not exist Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91b817bb-7fff-4520-9bd4-d4e1aa0250f6'] Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 10 10:37:13.908254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 164ac87d-4224-47a1-9b6e-6bf34033c35a does not exist Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91b817bb-7fff-4520-9bd4-d4e1aa0250f6'] Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 164ac87d-4224-47a1-9b6e-6bf34033c35a does not exist Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91b817bb-7fff-4520-9bd4-d4e1aa0250f6'] Sep 10 10:37:13.909485 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.910848 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:13.910848 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.910848 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.910848 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:13.910848 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:13.910848 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:13.910848 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:13.910848 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 164ac87d-4224-47a1-9b6e-6bf34033c35a does not exist Sep 10 10:37:13.910848 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91b817bb-7fff-4520-9bd4-d4e1aa0250f6'] Sep 10 10:37:13.910848 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.915289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bba513d1-5a8e-4e3b-9a2b-937cebd77211 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Returning 404 to user: Security group 164ac87d-4224-47a1-9b6e-6bf34033c35a does not exist Sep 10 10:37:13.915289 n-d-856894-1 devstack@n-api.service[128787]: Neutron server returns request_ids: ['req-91b817bb-7fff-4520-9bd4-d4e1aa0250f6'] {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:13.918050 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bba513d1-5a8e-4e3b-9a2b-937cebd77211 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.107556 Sep 10 10:37:13.920856 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 403/770] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:37:13 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:13.931099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0bd760b2-8ff4-43f8-b727-940b86c5b076 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Calling method '.version_select at 0x7efcaee90550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:13.969965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-0bd760b2-8ff4-43f8-b727-940b86c5b076 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule c08ed000-9a99-45d7-85d2-b39bef885f4b does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:37:13.970793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-0bd760b2-8ff4-43f8-b727-940b86c5b076 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Neutron security group rule c08ed000-9a99-45d7-85d2-b39bef885f4b not found {{(pid=128788) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 10 10:37:13.971485 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0bd760b2-8ff4-43f8-b727-940b86c5b076 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] HTTP exception thrown: Security group rule c08ed000-9a99-45d7-85d2-b39bef885f4b does not exist Sep 10 10:37:13.971485 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-05765cc4-f30e-40f6-b1ce-510a9f4034c8'] Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0bd760b2-8ff4-43f8-b727-940b86c5b076 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Request method failure captured: Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-group-rules/c08ed000-9a99-45d7-85d2-b39bef885f4b HTTP/1.1 Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGjVcLPObtEHKIYOBN7PKj0_Xxd5g5XPxvr-poObAVJxyT5jgTgWlts1Am0RTc1DT7FoLmW9ort0v1YtAHyG-v6vxTUkODFJK57gjtc4hXlnRcLjDf04BZvqbcjxrrGsF2iTCKV1IbU8wgg6_jPAXZEoKiHazyQTEy9Ssx009P_rDuI Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:37:13.975837 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f32853014a7e46ab85a235e21a888788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f32853014a7e46ab85a235e21a888788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f32853014a7e46ab85a235e21a888788", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: f32853014a7e46ab85a235e21a888788 Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364 Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: b23e86ab81a14c3e922abf06f2cf122d Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-189617364-project Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group rule c08ed000-9a99-45d7-85d2-b39bef885f4b does not exist Sep 10 10:37:13.977394 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-05765cc4-f30e-40f6-b1ce-510a9f4034c8'] Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'c08ed000-9a99-45d7-85d2-b39bef885f4b'} Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:37:13.978253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule c08ed000-9a99-45d7-85d2-b39bef885f4b does not exist Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05765cc4-f30e-40f6-b1ce-510a9f4034c8'] Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 10 10:37:13.979428 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule c08ed000-9a99-45d7-85d2-b39bef885f4b does not exist Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05765cc4-f30e-40f6-b1ce-510a9f4034c8'] Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule c08ed000-9a99-45d7-85d2-b39bef885f4b does not exist Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05765cc4-f30e-40f6-b1ce-510a9f4034c8'] Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.980796 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:13.982816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.982816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:13.982816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:13.982816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:13.982816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:13.982816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:13.982816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule c08ed000-9a99-45d7-85d2-b39bef885f4b does not exist Sep 10 10:37:13.982816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05765cc4-f30e-40f6-b1ce-510a9f4034c8'] Sep 10 10:37:13.982816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:13.984558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0bd760b2-8ff4-43f8-b727-940b86c5b076 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Returning 404 to user: Security group rule c08ed000-9a99-45d7-85d2-b39bef885f4b does not exist Sep 10 10:37:13.984558 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-05765cc4-f30e-40f6-b1ce-510a9f4034c8'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:13.985868 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0bd760b2-8ff4-43f8-b727-940b86c5b076 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/c08ed000-9a99-45d7-85d2-b39bef885f4b" status: 404 len: 199 microversion: 2.1 time: 0.058965 Sep 10 10:37:13.986550 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 368/771] 10.222.0.20 () {58 vars in 1287 bytes} [Sat Sep 10 10:37:13 2022] DELETE /compute/v2.1/os-security-group-rules/c08ed000-9a99-45d7-85d2-b39bef885f4b => generated 199 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:37:13.998495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-323ce906-3dd1-4509-9cec-8c2b72b9f664 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Calling method '.version_select at 0x7efcaf307dc0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:14.108273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:14.109040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:14.118000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:14.118834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:14.120064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:14.121289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:14.122256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:14.123247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:14.326973 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-323ce906-3dd1-4509-9cec-8c2b72b9f664 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/23564850-fe58-41db-8980-c9d16a5ebe6b" status: 202 len: 0 microversion: 2.1 time: 0.333803 Sep 10 10:37:14.328410 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 404/772] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:37:13 2022] DELETE /compute/v2.1/os-security-groups/23564850-fe58-41db-8980-c9d16a5ebe6b => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:37:14.337324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3ce408b3-389f-46ae-9965-60bdd4cf1838 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Calling method '.version_select at 0x7efcaf4614c0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:14.541476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:14.556139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:14.561437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:14.562700 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2147e178-dde3-4422-9b6f-8d6ede7bc2c6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1320 microversion: 2.25 time: 0.462324 Sep 10 10:37:14.566430 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 369/773] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:14 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1320 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:37:14.583242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3b6fa426-fa2d-4ae7-bd01-0be6f0a32acd req-1acf4733-2b81-49de-84dd-09627ec15dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8343f197-7bda-4d75-900b-67725df1432a", "name": "network-vif-plugged", "status": "completed", "tag": "a0ab20c1-72dc-422c-9dc0-9f4e40128cf3"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:14.638341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3b6fa426-fa2d-4ae7-bd01-0be6f0a32acd req-1acf4733-2b81-49de-84dd-09627ec15dc0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:14.640058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3b6fa426-fa2d-4ae7-bd01-0be6f0a32acd req-1acf4733-2b81-49de-84dd-09627ec15dc0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:14.641413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3b6fa426-fa2d-4ae7-bd01-0be6f0a32acd req-1acf4733-2b81-49de-84dd-09627ec15dc0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:14.680266 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3b6fa426-fa2d-4ae7-bd01-0be6f0a32acd req-1acf4733-2b81-49de-84dd-09627ec15dc0 service nova] Creating event network-vif-plugged:a0ab20c1-72dc-422c-9dc0-9f4e40128cf3 for instance 8343f197-7bda-4d75-900b-67725df1432a on n-h2-856894-1 Sep 10 10:37:14.699780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3b6fa426-fa2d-4ae7-bd01-0be6f0a32acd req-1acf4733-2b81-49de-84dd-09627ec15dc0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132033 Sep 10 10:37:14.709643 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 370/774] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:14.717796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a2769e86-7a9c-4a5d-8774-c97944a3bfa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:14.718514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a2769e86-7a9c-4a5d-8774-c97944a3bfa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:14.747635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2769e86-7a9c-4a5d-8774-c97944a3bfa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:14.748440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2769e86-7a9c-4a5d-8774-c97944a3bfa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:14.749752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2769e86-7a9c-4a5d-8774-c97944a3bfa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:14.750730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2769e86-7a9c-4a5d-8774-c97944a3bfa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:14.751409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2769e86-7a9c-4a5d-8774-c97944a3bfa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:14.752075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2769e86-7a9c-4a5d-8774-c97944a3bfa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:14.945913 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3ce408b3-389f-46ae-9965-60bdd4cf1838 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c0113721-b303-40b7-8663-e6b7d7539f87" status: 202 len: 0 microversion: 2.1 time: 0.613812 Sep 10 10:37:14.946986 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 405/775] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:37:14 2022] DELETE /compute/v2.1/os-security-groups/c0113721-b303-40b7-8663-e6b7d7539f87 => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:37:14.953221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ada063aa-71b7-4c8d-b2f2-58e7ab71c77e tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:14.953955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ada063aa-71b7-4c8d-b2f2-58e7ab71c77e tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:14.973299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ada063aa-71b7-4c8d-b2f2-58e7ab71c77e tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:14.974167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ada063aa-71b7-4c8d-b2f2-58e7ab71c77e tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:14.974709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ada063aa-71b7-4c8d-b2f2-58e7ab71c77e tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:14.976057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ada063aa-71b7-4c8d-b2f2-58e7ab71c77e tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:14.976707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ada063aa-71b7-4c8d-b2f2-58e7ab71c77e tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:14.977287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ada063aa-71b7-4c8d-b2f2-58e7ab71c77e tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:15.097727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ada063aa-71b7-4c8d-b2f2-58e7ab71c77e tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:15.106657 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ada063aa-71b7-4c8d-b2f2-58e7ab71c77e tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1267 microversion: 2.1 time: 0.157896 Sep 10 10:37:15.110641 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 406/776] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:14 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:15.116599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-83cee505-eef4-41e5-8214-4e4ea2ea38d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:15.117733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-83cee505-eef4-41e5-8214-4e4ea2ea38d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:15.124370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a2769e86-7a9c-4a5d-8774-c97944a3bfa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:15.135000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a2769e86-7a9c-4a5d-8774-c97944a3bfa5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1316 microversion: 2.1 time: 0.423837 Sep 10 10:37:15.151390 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 371/777] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:14 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:15.158659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-83cee505-eef4-41e5-8214-4e4ea2ea38d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:15.159320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-83cee505-eef4-41e5-8214-4e4ea2ea38d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:15.160124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-83cee505-eef4-41e5-8214-4e4ea2ea38d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:15.161149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-83cee505-eef4-41e5-8214-4e4ea2ea38d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:15.162338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-83cee505-eef4-41e5-8214-4e4ea2ea38d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:15.162894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-83cee505-eef4-41e5-8214-4e4ea2ea38d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:15.172045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f81cc30f-81e6-43ec-b7ac-83cf6c281f3e tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Calling method '.version_select at 0x7efcaee90dc0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:15.198434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:15.352340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-83cee505-eef4-41e5-8214-4e4ea2ea38d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:15.367521 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-83cee505-eef4-41e5-8214-4e4ea2ea38d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1321 microversion: 2.1 time: 0.254936 Sep 10 10:37:15.370204 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 407/778] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:15 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:15.591538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:15.592882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:15.626061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:15.627364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:15.628134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:15.629698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:15.631724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:15.632641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:15.839876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:15.858091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:15.859699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:15.861635 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d7bce741-ac90-43b7-b2a3-2b1101c74617 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1362 microversion: 2.25 time: 0.276249 Sep 10 10:37:15.862969 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 408/779] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:15 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:37:15.976656 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f81cc30f-81e6-43ec-b7ac-83cf6c281f3e tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/372eaee3-18cf-4529-b1af-b9e87574e05e" status: 202 len: 0 microversion: 2.1 time: 0.823672 Sep 10 10:37:15.981152 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 372/780] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:37:15 2022] DELETE /compute/v2.1/os-security-groups/372eaee3-18cf-4529-b1af-b9e87574e05e => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:37:15.986191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-619ffcfa-7664-4d1b-bffc-d2787ae56cfd tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Calling method '.version_select at 0x7efcaf2f24c0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:16.141856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b6bc8ef-cbb7-4cd1-9b66-61c72616b8e0 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:16.145126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b6bc8ef-cbb7-4cd1-9b66-61c72616b8e0 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:16.154117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b6bc8ef-cbb7-4cd1-9b66-61c72616b8e0 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:16.154981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b6bc8ef-cbb7-4cd1-9b66-61c72616b8e0 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:16.155633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b6bc8ef-cbb7-4cd1-9b66-61c72616b8e0 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:16.156551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b6bc8ef-cbb7-4cd1-9b66-61c72616b8e0 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:16.157262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b6bc8ef-cbb7-4cd1-9b66-61c72616b8e0 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:16.158171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b6bc8ef-cbb7-4cd1-9b66-61c72616b8e0 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:16.246314 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-619ffcfa-7664-4d1b-bffc-d2787ae56cfd tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f5140cc6-6e78-45e6-8854-d1641bd932de" status: 202 len: 0 microversion: 2.1 time: 0.264000 Sep 10 10:37:16.249620 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 409/781] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:37:15 2022] DELETE /compute/v2.1/os-security-groups/f5140cc6-6e78-45e6-8854-d1641bd932de => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:37:16.263571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-05157504-633c-47e8-9ec2-ed46d87c9fd8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:16.264195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-05157504-633c-47e8-9ec2-ed46d87c9fd8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:16.281910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:16.284048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05157504-633c-47e8-9ec2-ed46d87c9fd8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:16.284541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05157504-633c-47e8-9ec2-ed46d87c9fd8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:16.284982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05157504-633c-47e8-9ec2-ed46d87c9fd8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:16.285721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05157504-633c-47e8-9ec2-ed46d87c9fd8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:16.289992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05157504-633c-47e8-9ec2-ed46d87c9fd8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:16.291510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05157504-633c-47e8-9ec2-ed46d87c9fd8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:16.296222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2b6bc8ef-cbb7-4cd1-9b66-61c72616b8e0 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:16.348976 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b6bc8ef-cbb7-4cd1-9b66-61c72616b8e0 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1273 microversion: 2.1 time: 0.218173 Sep 10 10:37:16.354784 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 373/782] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:16 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:16.377390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c95b6af-fe47-43f3-976b-7aa93c5a8435 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] Calling method '.version_select at 0x7efcaebe5dc0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:16.462165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-05157504-633c-47e8-9ec2-ed46d87c9fd8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:16.486025 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-05157504-633c-47e8-9ec2-ed46d87c9fd8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1316 microversion: 2.1 time: 0.236418 Sep 10 10:37:16.488462 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 410/783] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:16 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:16.498099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-73c18f48-c1fe-4c6b-abea-a0e50f77fac9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:16.499284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-73c18f48-c1fe-4c6b-abea-a0e50f77fac9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:16.510968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73c18f48-c1fe-4c6b-abea-a0e50f77fac9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:16.511602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73c18f48-c1fe-4c6b-abea-a0e50f77fac9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:16.512288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73c18f48-c1fe-4c6b-abea-a0e50f77fac9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:16.513103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73c18f48-c1fe-4c6b-abea-a0e50f77fac9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:16.514221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73c18f48-c1fe-4c6b-abea-a0e50f77fac9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:16.514788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73c18f48-c1fe-4c6b-abea-a0e50f77fac9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:16.741046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-73c18f48-c1fe-4c6b-abea-a0e50f77fac9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:16.752090 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-73c18f48-c1fe-4c6b-abea-a0e50f77fac9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1321 microversion: 2.1 time: 0.261543 Sep 10 10:37:16.753313 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 411/784] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:16 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:16.822971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-a64dda02-c30a-481b-a595-d117a57b524c req-908e2121-29c9-4c41-9f35-888a52121328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eedcceae-bebe-4119-aeda-1654f917c921", "name": "network-vif-plugged", "status": "completed", "tag": "308595f2-1096-4350-a976-894a61762f62"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:16.837745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a64dda02-c30a-481b-a595-d117a57b524c req-908e2121-29c9-4c41-9f35-888a52121328 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:16.839272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a64dda02-c30a-481b-a595-d117a57b524c req-908e2121-29c9-4c41-9f35-888a52121328 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:16.839943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a64dda02-c30a-481b-a595-d117a57b524c req-908e2121-29c9-4c41-9f35-888a52121328 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:16.857476 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-a64dda02-c30a-481b-a595-d117a57b524c req-908e2121-29c9-4c41-9f35-888a52121328 service nova] Creating event network-vif-plugged:308595f2-1096-4350-a976-894a61762f62 for instance eedcceae-bebe-4119-aeda-1654f917c921 on n-h1-856894-1 Sep 10 10:37:16.863151 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-a64dda02-c30a-481b-a595-d117a57b524c req-908e2121-29c9-4c41-9f35-888a52121328 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046314 Sep 10 10:37:16.864843 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 412/785] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:16.898534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:16.899762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:16.909572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:16.910295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:16.910918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:16.912342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:16.913341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:16.913926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:17.048415 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c95b6af-fe47-43f3-976b-7aa93c5a8435 tempest-SecurityGroupRulesNegativeTestJSON-189617364 tempest-SecurityGroupRulesNegativeTestJSON-189617364-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3e6212e4-e275-471e-9ac3-7d41ec382544" status: 202 len: 0 microversion: 2.1 time: 0.691222 Sep 10 10:37:17.049307 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 374/786] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:37:16 2022] DELETE /compute/v2.1/os-security-groups/3e6212e4-e275-471e-9ac3-7d41ec382544 => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:37:17.142670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:17.151618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:17.155491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:17.160628 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3584822e-a32e-4c3e-a3cc-3ca7c2bd875b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1362 microversion: 2.25 time: 0.271245 Sep 10 10:37:17.162335 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 413/787] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:16 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:17.264611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1e32f557-bdf5-40ea-96b3-89f4e84f2108 req-bc0985f2-7eb3-464d-829b-f87c3905595d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5fc162-ff4a-4020-97ca-7e9960c2f455", "tag": "7696d8d6-82d0-49c4-a65c-99ae55b6449f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:17.287189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1e32f557-bdf5-40ea-96b3-89f4e84f2108 req-bc0985f2-7eb3-464d-829b-f87c3905595d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:17.287674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1e32f557-bdf5-40ea-96b3-89f4e84f2108 req-bc0985f2-7eb3-464d-829b-f87c3905595d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:17.288716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1e32f557-bdf5-40ea-96b3-89f4e84f2108 req-bc0985f2-7eb3-464d-829b-f87c3905595d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:17.332991 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1e32f557-bdf5-40ea-96b3-89f4e84f2108 req-bc0985f2-7eb3-464d-829b-f87c3905595d service nova] Creating event network-changed:7696d8d6-82d0-49c4-a65c-99ae55b6449f for instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 on n-h1-856894-1 Sep 10 10:37:17.340142 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1e32f557-bdf5-40ea-96b3-89f4e84f2108 req-bc0985f2-7eb3-464d-829b-f87c3905595d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079309 Sep 10 10:37:17.345421 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 375/788] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:17.376316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7a2d2a89-2c90-41ad-9a82-b676764a4d39 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:17.380132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7a2d2a89-2c90-41ad-9a82-b676764a4d39 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:17.388862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2d2a89-2c90-41ad-9a82-b676764a4d39 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:17.389602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2d2a89-2c90-41ad-9a82-b676764a4d39 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:17.390228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2d2a89-2c90-41ad-9a82-b676764a4d39 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:17.390950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2d2a89-2c90-41ad-9a82-b676764a4d39 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:17.391572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2d2a89-2c90-41ad-9a82-b676764a4d39 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:17.391998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2d2a89-2c90-41ad-9a82-b676764a4d39 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:17.513082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2f359c1-1876-40fe-ae10-1894580bb926 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:17.514165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2f359c1-1876-40fe-ae10-1894580bb926 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:17.528670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f359c1-1876-40fe-ae10-1894580bb926 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:17.535366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f359c1-1876-40fe-ae10-1894580bb926 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:17.539155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f359c1-1876-40fe-ae10-1894580bb926 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:17.540829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f359c1-1876-40fe-ae10-1894580bb926 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:17.542588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f359c1-1876-40fe-ae10-1894580bb926 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:17.543969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f359c1-1876-40fe-ae10-1894580bb926 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:17.722808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7a2d2a89-2c90-41ad-9a82-b676764a4d39 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:17.745662 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7a2d2a89-2c90-41ad-9a82-b676764a4d39 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.373799 Sep 10 10:37:17.746647 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 414/789] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:17 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:17.785679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e2441932-1612-4d0a-a964-53339392df72 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:17.787414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e2441932-1612-4d0a-a964-53339392df72 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:17.793426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d2f359c1-1876-40fe-ae10-1894580bb926 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:17.804081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2441932-1612-4d0a-a964-53339392df72 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:17.805149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2441932-1612-4d0a-a964-53339392df72 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:17.806166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2441932-1612-4d0a-a964-53339392df72 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:17.807614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2441932-1612-4d0a-a964-53339392df72 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:17.808397 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2f359c1-1876-40fe-ae10-1894580bb926 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1316 microversion: 2.1 time: 0.300179 Sep 10 10:37:17.808716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2441932-1612-4d0a-a964-53339392df72 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:17.809347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2441932-1612-4d0a-a964-53339392df72 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:17.824670 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 376/790] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:17 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:18.055413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e2441932-1612-4d0a-a964-53339392df72 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:18.068916 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e2441932-1612-4d0a-a964-53339392df72 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1469 microversion: 2.1 time: 0.289169 Sep 10 10:37:18.071656 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 415/791] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:17 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1469 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:18.097400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d1220e6-40a6-4291-a68b-3f94f6eb179c tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:18.098366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9d1220e6-40a6-4291-a68b-3f94f6eb179c tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:18.105676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d1220e6-40a6-4291-a68b-3f94f6eb179c tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:18.106674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d1220e6-40a6-4291-a68b-3f94f6eb179c tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:18.107359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d1220e6-40a6-4291-a68b-3f94f6eb179c tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:18.110207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d1220e6-40a6-4291-a68b-3f94f6eb179c tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:18.111101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d1220e6-40a6-4291-a68b-3f94f6eb179c tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:18.111790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d1220e6-40a6-4291-a68b-3f94f6eb179c tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:18.148671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-9d1220e6-40a6-4291-a68b-3f94f6eb179c tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lazy-loading 'flavor' on Instance uuid 8343f197-7bda-4d75-900b-67725df1432a {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:37:18.187370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:18.188159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:18.203763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:18.204688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:18.205418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:18.206389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:18.213095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:18.214603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:18.284287 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d1220e6-40a6-4291-a68b-3f94f6eb179c tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a/action" status: 202 len: 0 microversion: 2.1 time: 0.190637 Sep 10 10:37:18.285612 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 377/792] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:37:18 2022] POST /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:37:18.294122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cfadbb8a-4600-4cf2-b790-3fd76729d27f tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:18.294988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cfadbb8a-4600-4cf2-b790-3fd76729d27f tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:18.304933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfadbb8a-4600-4cf2-b790-3fd76729d27f tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:18.305977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfadbb8a-4600-4cf2-b790-3fd76729d27f tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:18.306772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfadbb8a-4600-4cf2-b790-3fd76729d27f tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:18.307942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfadbb8a-4600-4cf2-b790-3fd76729d27f tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:18.308913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfadbb8a-4600-4cf2-b790-3fd76729d27f tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:18.309678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfadbb8a-4600-4cf2-b790-3fd76729d27f tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:18.739445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:18.757730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:18.759472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:18.763919 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-72d3e863-d432-450d-90f0-76220a20b155 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1362 microversion: 2.25 time: 0.578336 Sep 10 10:37:18.765537 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 416/793] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:18 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1362 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:37:18.773677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-158bd0e9-b067-4a4b-a923-7f5f5b946858 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:18.775615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-158bd0e9-b067-4a4b-a923-7f5f5b946858 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:18.785328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-158bd0e9-b067-4a4b-a923-7f5f5b946858 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:18.786118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-158bd0e9-b067-4a4b-a923-7f5f5b946858 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:18.786896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-158bd0e9-b067-4a4b-a923-7f5f5b946858 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:18.787803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-158bd0e9-b067-4a4b-a923-7f5f5b946858 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:18.788520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-158bd0e9-b067-4a4b-a923-7f5f5b946858 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:18.789282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-158bd0e9-b067-4a4b-a923-7f5f5b946858 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:19.292994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-158bd0e9-b067-4a4b-a923-7f5f5b946858 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:19.304050 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-158bd0e9-b067-4a4b-a923-7f5f5b946858 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.536943 Sep 10 10:37:19.304660 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 417/794] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:18 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:19.309671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-094b411d-9e48-40c8-8d78-1e283889f18d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:19.310674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-094b411d-9e48-40c8-8d78-1e283889f18d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:19.318094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-094b411d-9e48-40c8-8d78-1e283889f18d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:19.319006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-094b411d-9e48-40c8-8d78-1e283889f18d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:19.320116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-094b411d-9e48-40c8-8d78-1e283889f18d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:19.321117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-094b411d-9e48-40c8-8d78-1e283889f18d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:19.321681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-094b411d-9e48-40c8-8d78-1e283889f18d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:19.322203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-094b411d-9e48-40c8-8d78-1e283889f18d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:19.458272 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cfadbb8a-4600-4cf2-b790-3fd76729d27f tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1628 microversion: 2.1 time: 1.168640 Sep 10 10:37:19.458860 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 378/795] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:18 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1628 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:19.488447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-372db472-01e4-4c50-b799-b89b5c77c2d1 req-33f0c5e5-7d1e-4860-9267-32c592a8b65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5505968a-0f31-49c9-949b-43e93328561b", "tag": "b4a4e135-2ccb-4806-8ed0-f899e206496b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:19.507653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-372db472-01e4-4c50-b799-b89b5c77c2d1 req-33f0c5e5-7d1e-4860-9267-32c592a8b65f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:19.508145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-372db472-01e4-4c50-b799-b89b5c77c2d1 req-33f0c5e5-7d1e-4860-9267-32c592a8b65f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:19.508571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-372db472-01e4-4c50-b799-b89b5c77c2d1 req-33f0c5e5-7d1e-4860-9267-32c592a8b65f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:19.520800 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-372db472-01e4-4c50-b799-b89b5c77c2d1 req-33f0c5e5-7d1e-4860-9267-32c592a8b65f service nova] Creating event network-changed:b4a4e135-2ccb-4806-8ed0-f899e206496b for instance 5505968a-0f31-49c9-949b-43e93328561b on n-h1-856894-1 Sep 10 10:37:19.526149 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-372db472-01e4-4c50-b799-b89b5c77c2d1 req-33f0c5e5-7d1e-4860-9267-32c592a8b65f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044130 Sep 10 10:37:19.526948 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 379/796] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:19.532156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-433521db-c4c0-42b4-99ff-63bda0cc9208 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:19.533190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-433521db-c4c0-42b4-99ff-63bda0cc9208 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:19.539666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-433521db-c4c0-42b4-99ff-63bda0cc9208 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:19.540238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-433521db-c4c0-42b4-99ff-63bda0cc9208 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:19.540687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-433521db-c4c0-42b4-99ff-63bda0cc9208 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:19.541656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-433521db-c4c0-42b4-99ff-63bda0cc9208 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:19.542113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-433521db-c4c0-42b4-99ff-63bda0cc9208 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:19.542811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-433521db-c4c0-42b4-99ff-63bda0cc9208 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:19.563814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-094b411d-9e48-40c8-8d78-1e283889f18d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:19.571069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-433521db-c4c0-42b4-99ff-63bda0cc9208 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:37:19.581051 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-094b411d-9e48-40c8-8d78-1e283889f18d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1466 microversion: 2.1 time: 0.274105 Sep 10 10:37:19.593100 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 418/797] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:19 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1466 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:19.606089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-492f32b0-fe2d-4d65-b19b-3ee142768685 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:19.607025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-492f32b0-fe2d-4d65-b19b-3ee142768685 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:19.613396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-492f32b0-fe2d-4d65-b19b-3ee142768685 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:19.614116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-492f32b0-fe2d-4d65-b19b-3ee142768685 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:19.614698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-492f32b0-fe2d-4d65-b19b-3ee142768685 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:19.615827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-492f32b0-fe2d-4d65-b19b-3ee142768685 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:19.616446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-492f32b0-fe2d-4d65-b19b-3ee142768685 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:19.617029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-492f32b0-fe2d-4d65-b19b-3ee142768685 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:19.704079 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-433521db-c4c0-42b4-99ff-63bda0cc9208 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 204 len: 0 microversion: 2.1 time: 0.175021 Sep 10 10:37:19.705502 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 380/798] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:37:19 2022] DELETE /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:37:19.716894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de3ba2d8-2e98-43cf-b4f2-85f332baa9df tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:19.718936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de3ba2d8-2e98-43cf-b4f2-85f332baa9df tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:19.726736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de3ba2d8-2e98-43cf-b4f2-85f332baa9df tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:19.727503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de3ba2d8-2e98-43cf-b4f2-85f332baa9df tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:19.728137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de3ba2d8-2e98-43cf-b4f2-85f332baa9df tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:19.730231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de3ba2d8-2e98-43cf-b4f2-85f332baa9df tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:19.730882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de3ba2d8-2e98-43cf-b4f2-85f332baa9df tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:19.731535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de3ba2d8-2e98-43cf-b4f2-85f332baa9df tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:19.953782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:20.057345 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-492f32b0-fe2d-4d65-b19b-3ee142768685 tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1617 microversion: 2.1 time: 0.455584 Sep 10 10:37:20.059128 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 419/799] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:19 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1617 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:20.065028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:20.065635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:20.072551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:20.073258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:20.074165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:20.080493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:20.081333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:20.081950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:20.181356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-de3ba2d8-2e98-43cf-b4f2-85f332baa9df tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:20.195506 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de3ba2d8-2e98-43cf-b4f2-85f332baa9df tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1712 microversion: 2.1 time: 0.485101 Sep 10 10:37:20.196614 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 381/800] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:19 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1712 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:20.202235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-976147142", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["52fb832d-13f8-4175-b047-fa651b9091da"]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:20.211645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:20.264730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:37:20.349185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:20.358670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:20.360500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:20.361944 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a8956be4-d9a1-45ef-a28c-352eb725d58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1362 microversion: 2.25 time: 0.301849 Sep 10 10:37:20.363256 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 420/801] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:20 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:20.368173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d1b09102-0c78-4d0b-8ef6-b531e3d218fd tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:20.369135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d1b09102-0c78-4d0b-8ef6-b531e3d218fd tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:20.376251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1b09102-0c78-4d0b-8ef6-b531e3d218fd tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:20.377117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1b09102-0c78-4d0b-8ef6-b531e3d218fd tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:20.377867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1b09102-0c78-4d0b-8ef6-b531e3d218fd tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:20.378818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1b09102-0c78-4d0b-8ef6-b531e3d218fd tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:20.379491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1b09102-0c78-4d0b-8ef6-b531e3d218fd tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:20.380144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1b09102-0c78-4d0b-8ef6-b531e3d218fd tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:20.533189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:37:20.533676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:37:20.534079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:37:20.534489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:37:20.534904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:37:20.544329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:20.544816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:20.545296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:20.546034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:20.546496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:20.546923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:20.563892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:37:20.569234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:37:20.582136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:37:20.584403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:37:20.599340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d1b09102-0c78-4d0b-8ef6-b531e3d218fd tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:20.607429 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d1b09102-0c78-4d0b-8ef6-b531e3d218fd tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.242867 Sep 10 10:37:20.622542 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 421/802] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:20 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:20.635448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-60bd5161-c11d-42d7-96f2-5688b38945bf tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:20.636384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-60bd5161-c11d-42d7-96f2-5688b38945bf tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:20.643068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60bd5161-c11d-42d7-96f2-5688b38945bf tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:20.643892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60bd5161-c11d-42d7-96f2-5688b38945bf tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:20.644710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60bd5161-c11d-42d7-96f2-5688b38945bf tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:20.653812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60bd5161-c11d-42d7-96f2-5688b38945bf tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:20.654590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60bd5161-c11d-42d7-96f2-5688b38945bf tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:20.658283 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26d2df9c-34b5-4325-8c64-689f340ddc07 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.459494 Sep 10 10:37:20.659126 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 382/803] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:37:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:37:20.659537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60bd5161-c11d-42d7-96f2-5688b38945bf tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:20.675002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b179d83-c99a-4e9c-a6cd-3683bb2d5906 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:20.675863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b179d83-c99a-4e9c-a6cd-3683bb2d5906 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:20.739567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2b179d83-c99a-4e9c-a6cd-3683bb2d5906 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:20.751426 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b179d83-c99a-4e9c-a6cd-3683bb2d5906 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1216 microversion: 2.1 time: 0.083937 Sep 10 10:37:20.757734 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 383/804] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:20 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:20.984238 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-60bd5161-c11d-42d7-96f2-5688b38945bf tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1611 microversion: 2.1 time: 0.359489 Sep 10 10:37:20.985422 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 422/805] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:20 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1611 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:21.008968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:21.009626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:21.016313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.016882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.017295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.018012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.018468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.018897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.097705 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] HTTP exception thrown: Cannot 'migrate' instance 8343f197-7bda-4d75-900b-67725df1432a while it is in vm_state suspended Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Request method failure captured: Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a/action HTTP/1.1 Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 15 Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiMjdkjJGs_rvSZoxfJS9nfeKOTxPBf-tpMcQ0HjXuPqOTrY_J27CjbEo2n7s6lQhwJKLB9azBxG4GRRYrKDZbemWLEZ3UkaLoCYH8IUeyVAk0go5SDWA9g09TGR5rgoemM8LTBE7nJZygTiHwCkjzHQAxIAMM4GOotfTzvBc1H5eE Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: f6e10a8c96fe47afad3be823705d1599 Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:37:21.099354 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6e10a8c96fe47afad3be823705d1599", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: f6e10a8c96fe47afad3be823705d1599 Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersAdminNegativeTestJSON-1252828823-project-admin Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: cd3c0d9002ad43b5bdf9bbec43993d82 Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1252828823-project-admin Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: {"migrate": {}} Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:37:21.100871 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'migrate' instance 8343f197-7bda-4d75-900b-67725df1432a while it is in vm_state suspended Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '8343f197-7bda-4d75-900b-67725df1432a', 'body': {'migrate': {}}} Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8343f197-7bda-4d75-900b-67725df1432a in vm_state suspended. Cannot resize while the instance is in this state. Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.101843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 8343f197-7bda-4d75-900b-67725df1432a while it is in vm_state suspended Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:21.103120 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:21.104363 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:21.104363 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:21.104363 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 8343f197-7bda-4d75-900b-67725df1432a while it is in vm_state suspended Sep 10 10:37:21.104363 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.104363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Returning 409 to user: Cannot 'migrate' instance 8343f197-7bda-4d75-900b-67725df1432a while it is in vm_state suspended {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:21.104363 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-600e80e7-b090-4cd9-8f8c-e6cf164e7650 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a/action" status: 409 len: 148 microversion: 2.1 time: 0.095681 Sep 10 10:37:21.104363 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 384/806] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:37:21 2022] POST /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a/action => generated 148 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:37:21.111200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e8233ca-9e69-47a5-8201-1296eba12b41 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e8233ca-9e69-47a5-8201-1296eba12b41 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Request method failure captured: Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93/action HTTP/1.1 Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 39 Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGiMjdkjJGs_rvSZoxfJS9nfeKOTxPBf-tpMcQ0HjXuPqOTrY_J27CjbEo2n7s6lQhwJKLB9azBxG4GRRYrKDZbemWLEZ3UkaLoCYH8IUeyVAk0go5SDWA9g09TGR5rgoemM8LTBE7nJZygTiHwCkjzHQAxIAMM4GOotfTzvBc1H5eE Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: f6e10a8c96fe47afad3be823705d1599 Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:37:21.115047 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6e10a8c96fe47afad3be823705d1599", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: f6e10a8c96fe47afad3be823705d1599 Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersAdminNegativeTestJSON-1252828823-project-admin Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: cd3c0d9002ad43b5bdf9bbec43993d82 Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1252828823-project-admin Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: {"os-resetState": {"state": "invalid"}} Sep 10 10:37:21.116652 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5cee035c-b7ed-45ea-ae74-1f6e84884f93', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:21.117578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:37:21.119166 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 10 10:37:21.120658 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.122513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e8233ca-9e69-47a5-8201-1296eba12b41 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:21.126830 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3e8233ca-9e69-47a5-8201-1296eba12b41 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93/action" status: 400 len: 144 microversion: 2.1 time: 0.019406 Sep 10 10:37:21.133242 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 423/807] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:37:21 2022] POST /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93/action => generated 144 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:37:21.140604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c005d1c3-8f10-4a3a-a7bd-adfff18f3dc0 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c005d1c3-8f10-4a3a-a7bd-adfff18f3dc0 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Request method failure captured: Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93/action HTTP/1.1 Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 31 Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiMjdkjJGs_rvSZoxfJS9nfeKOTxPBf-tpMcQ0HjXuPqOTrY_J27CjbEo2n7s6lQhwJKLB9azBxG4GRRYrKDZbemWLEZ3UkaLoCYH8IUeyVAk0go5SDWA9g09TGR5rgoemM8LTBE7nJZygTiHwCkjzHQAxIAMM4GOotfTzvBc1H5eE Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: f6e10a8c96fe47afad3be823705d1599 Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:37:21.144945 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6e10a8c96fe47afad3be823705d1599", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: f6e10a8c96fe47afad3be823705d1599 Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersAdminNegativeTestJSON-1252828823-project-admin Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: cd3c0d9002ad43b5bdf9bbec43993d82 Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1252828823-project-admin Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: {"os-resetState": {"state": 1}} Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:37:21.146546 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '5cee035c-b7ed-45ea-ae74-1f6e84884f93', 'body': {'os-resetState': {'state': 1}}} Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 1 Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:21.147356 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 10 10:37:21.148615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.151614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c005d1c3-8f10-4a3a-a7bd-adfff18f3dc0 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:21.151614 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c005d1c3-8f10-4a3a-a7bd-adfff18f3dc0 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93/action" status: 400 len: 120 microversion: 2.1 time: 0.011879 Sep 10 10:37:21.154383 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 385/808] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:37:21 2022] POST /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:37:21.160689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-34a9c56f-8880-4495-a91e-cbc5c1953061 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:21.163072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-34a9c56f-8880-4495-a91e-cbc5c1953061 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Failed to fetch instance by id 999 {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 10:37:21.163649 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-34a9c56f-8880-4495-a91e-cbc5c1953061 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-34a9c56f-8880-4495-a91e-cbc5c1953061 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Request method failure captured: Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 37 Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGiMjdkjJGs_rvSZoxfJS9nfeKOTxPBf-tpMcQ0HjXuPqOTrY_J27CjbEo2n7s6lQhwJKLB9azBxG4GRRYrKDZbemWLEZ3UkaLoCYH8IUeyVAk0go5SDWA9g09TGR5rgoemM8LTBE7nJZygTiHwCkjzHQAxIAMM4GOotfTzvBc1H5eE Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: f6e10a8c96fe47afad3be823705d1599 Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 10:37:21.175993 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6e10a8c96fe47afad3be823705d1599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6e10a8c96fe47afad3be823705d1599", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: f6e10a8c96fe47afad3be823705d1599 Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1252828823 Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersAdminNegativeTestJSON-1252828823-project-admin Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: cd3c0d9002ad43b5bdf9bbec43993d82 Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1252828823-project-admin Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: {"os-resetState": {"state": "error"}} Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:21.177386 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 999 could not be found. Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:37:21.178406 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-34a9c56f-8880-4495-a91e-cbc5c1953061 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:21.179784 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-34a9c56f-8880-4495-a91e-cbc5c1953061 tempest-ServersAdminNegativeTestJSON-1252828823 tempest-ServersAdminNegativeTestJSON-1252828823-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.023605 Sep 10 10:37:21.180784 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 424/809] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Sep 10 10:37:21 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 10:37:21.189051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a162fbed-ee9e-467b-80ad-6fda81b1a3d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:21.189811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a162fbed-ee9e-467b-80ad-6fda81b1a3d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:21.199362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a162fbed-ee9e-467b-80ad-6fda81b1a3d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.200143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a162fbed-ee9e-467b-80ad-6fda81b1a3d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.200804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a162fbed-ee9e-467b-80ad-6fda81b1a3d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.201894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a162fbed-ee9e-467b-80ad-6fda81b1a3d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.202500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a162fbed-ee9e-467b-80ad-6fda81b1a3d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.202962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a162fbed-ee9e-467b-80ad-6fda81b1a3d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.222189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d02d9973-1074-40a0-ab3b-79fcecec4fa3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:21.223011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d02d9973-1074-40a0-ab3b-79fcecec4fa3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:21.233256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02d9973-1074-40a0-ab3b-79fcecec4fa3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.233758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02d9973-1074-40a0-ab3b-79fcecec4fa3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.234198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02d9973-1074-40a0-ab3b-79fcecec4fa3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.234918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02d9973-1074-40a0-ab3b-79fcecec4fa3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.235377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02d9973-1074-40a0-ab3b-79fcecec4fa3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.235803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02d9973-1074-40a0-ab3b-79fcecec4fa3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.241049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a162fbed-ee9e-467b-80ad-6fda81b1a3d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:37:21.367884 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a162fbed-ee9e-467b-80ad-6fda81b1a3d6 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 204 len: 0 microversion: 2.1 time: 0.182669 Sep 10 10:37:21.368882 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 386/810] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:37:21 2022] DELETE /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:37:21.380266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c4bd98a0-9dff-4b82-ad65-a3dfef7ee257 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:21.382049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4bd98a0-9dff-4b82-ad65-a3dfef7ee257 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:21.395123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bd98a0-9dff-4b82-ad65-a3dfef7ee257 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.395782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bd98a0-9dff-4b82-ad65-a3dfef7ee257 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.396355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bd98a0-9dff-4b82-ad65-a3dfef7ee257 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.397388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bd98a0-9dff-4b82-ad65-a3dfef7ee257 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.397960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bd98a0-9dff-4b82-ad65-a3dfef7ee257 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.398497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bd98a0-9dff-4b82-ad65-a3dfef7ee257 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.575338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d02d9973-1074-40a0-ab3b-79fcecec4fa3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:21.580072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c4bd98a0-9dff-4b82-ad65-a3dfef7ee257 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:21.584829 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d02d9973-1074-40a0-ab3b-79fcecec4fa3 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1712 microversion: 2.1 time: 0.366937 Sep 10 10:37:21.594196 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c4bd98a0-9dff-4b82-ad65-a3dfef7ee257 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1466 microversion: 2.1 time: 0.220086 Sep 10 10:37:21.595857 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 387/811] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:21 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1466 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:21.601959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:21.602101 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 425/812] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:21 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1712 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:21.604227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:21.612089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.612791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.613466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.614363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.615565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.616340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.635460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8cb36d53-4f93-491b-9613-6eadc0db9dd1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:21.636074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8cb36d53-4f93-491b-9613-6eadc0db9dd1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:21.642523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cb36d53-4f93-491b-9613-6eadc0db9dd1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.643015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cb36d53-4f93-491b-9613-6eadc0db9dd1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.643444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cb36d53-4f93-491b-9613-6eadc0db9dd1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.644139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cb36d53-4f93-491b-9613-6eadc0db9dd1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.644588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cb36d53-4f93-491b-9613-6eadc0db9dd1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.645000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cb36d53-4f93-491b-9613-6eadc0db9dd1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.807219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:21.821646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:21.823703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:21.824872 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff4d5546-f19e-41bc-9f3a-57aab2103cdd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1362 microversion: 2.25 time: 0.227917 Sep 10 10:37:21.825686 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 388/813] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:21 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:21.833214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c5ec9d2-8e3d-46b0-b803-cefd1a6ec519 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:21.833836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c5ec9d2-8e3d-46b0-b803-cefd1a6ec519 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:21.844225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c5ec9d2-8e3d-46b0-b803-cefd1a6ec519 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.844959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c5ec9d2-8e3d-46b0-b803-cefd1a6ec519 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.849853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c5ec9d2-8e3d-46b0-b803-cefd1a6ec519 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.850805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c5ec9d2-8e3d-46b0-b803-cefd1a6ec519 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:21.851594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c5ec9d2-8e3d-46b0-b803-cefd1a6ec519 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:21.852687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c5ec9d2-8e3d-46b0-b803-cefd1a6ec519 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:21.937729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2c5ec9d2-8e3d-46b0-b803-cefd1a6ec519 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:21.945563 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c5ec9d2-8e3d-46b0-b803-cefd1a6ec519 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1220 microversion: 2.1 time: 0.116043 Sep 10 10:37:21.946215 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 389/814] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:21 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:21.977227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8cb36d53-4f93-491b-9613-6eadc0db9dd1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:21.985444 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8cb36d53-4f93-491b-9613-6eadc0db9dd1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.354058 Sep 10 10:37:21.986010 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 426/815] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:21 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:22.611418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87639106-d89b-42af-8ed7-90cb95052be7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:22.613876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87639106-d89b-42af-8ed7-90cb95052be7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:22.619477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aadb08c0-af95-4fb5-9681-5e5a6ebdcace tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:22.620617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-aadb08c0-af95-4fb5-9681-5e5a6ebdcace tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:22.623406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87639106-d89b-42af-8ed7-90cb95052be7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:22.627448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87639106-d89b-42af-8ed7-90cb95052be7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:22.628104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87639106-d89b-42af-8ed7-90cb95052be7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:22.628828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87639106-d89b-42af-8ed7-90cb95052be7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:22.629931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87639106-d89b-42af-8ed7-90cb95052be7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:22.630375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87639106-d89b-42af-8ed7-90cb95052be7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:22.635804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aadb08c0-af95-4fb5-9681-5e5a6ebdcace tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:22.640832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aadb08c0-af95-4fb5-9681-5e5a6ebdcace tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:22.643002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aadb08c0-af95-4fb5-9681-5e5a6ebdcace tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:22.647992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aadb08c0-af95-4fb5-9681-5e5a6ebdcace tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:22.648727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aadb08c0-af95-4fb5-9681-5e5a6ebdcace tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:22.650983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aadb08c0-af95-4fb5-9681-5e5a6ebdcace tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:22.880813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-aadb08c0-af95-4fb5-9681-5e5a6ebdcace tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:22.884331 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:22.889847 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aadb08c0-af95-4fb5-9681-5e5a6ebdcace tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1466 microversion: 2.1 time: 0.274505 Sep 10 10:37:22.890425 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 427/816] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:22 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1466 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:22.895336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:22.895940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:22.901994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:22.902671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:22.903280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:22.904440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:22.905671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:22.906623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:22.908771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-87639106-d89b-42af-8ed7-90cb95052be7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:22.919881 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87639106-d89b-42af-8ed7-90cb95052be7 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1712 microversion: 2.1 time: 0.313484 Sep 10 10:37:22.920470 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 390/817] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:22 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1712 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:22.968540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5e0ce998-ac26-4909-b068-2cd1cac3bc36 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:22.969225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5e0ce998-ac26-4909-b068-2cd1cac3bc36 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:22.975400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e0ce998-ac26-4909-b068-2cd1cac3bc36 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:22.975862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e0ce998-ac26-4909-b068-2cd1cac3bc36 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:22.976457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e0ce998-ac26-4909-b068-2cd1cac3bc36 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:22.977193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e0ce998-ac26-4909-b068-2cd1cac3bc36 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:22.977647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e0ce998-ac26-4909-b068-2cd1cac3bc36 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:22.978071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e0ce998-ac26-4909-b068-2cd1cac3bc36 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:23.045167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e0ce998-ac26-4909-b068-2cd1cac3bc36 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:23.054720 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5e0ce998-ac26-4909-b068-2cd1cac3bc36 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1268 microversion: 2.1 time: 0.089749 Sep 10 10:37:23.055754 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 391/818] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:22 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1268 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:23.055954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:23.066001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:23.066876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d58eb59-4094-4af3-90a3-de5bf3228b22 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:23.067627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d58eb59-4094-4af3-90a3-de5bf3228b22 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:23.068257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:23.069935 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a6b022be-af46-4dc0-ac62-a90d39707ca1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1362 microversion: 2.25 time: 0.178068 Sep 10 10:37:23.071041 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 428/819] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:22 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:23.076978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d58eb59-4094-4af3-90a3-de5bf3228b22 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:23.077918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d58eb59-4094-4af3-90a3-de5bf3228b22 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:23.079073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d58eb59-4094-4af3-90a3-de5bf3228b22 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:23.082741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d58eb59-4094-4af3-90a3-de5bf3228b22 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:23.083530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d58eb59-4094-4af3-90a3-de5bf3228b22 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:23.084127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d58eb59-4094-4af3-90a3-de5bf3228b22 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:23.367264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d58eb59-4094-4af3-90a3-de5bf3228b22 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:23.376665 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d58eb59-4094-4af3-90a3-de5bf3228b22 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.318731 Sep 10 10:37:23.380329 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 392/820] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:23 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:23.912312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5c5ec012-099a-4eaf-bb9f-513e70831863 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:23.912969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5c5ec012-099a-4eaf-bb9f-513e70831863 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:23.917987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:23.918707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:23.929202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c5ec012-099a-4eaf-bb9f-513e70831863 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:23.935526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c5ec012-099a-4eaf-bb9f-513e70831863 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:23.936717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c5ec012-099a-4eaf-bb9f-513e70831863 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:23.938061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c5ec012-099a-4eaf-bb9f-513e70831863 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:23.941714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c5ec012-099a-4eaf-bb9f-513e70831863 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:23.942161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c5ec012-099a-4eaf-bb9f-513e70831863 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:23.944860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-144193d6-3681-4934-bcff-af5090a0323a tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:23.947699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-144193d6-3681-4934-bcff-af5090a0323a tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:23.956580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144193d6-3681-4934-bcff-af5090a0323a tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:23.960680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144193d6-3681-4934-bcff-af5090a0323a tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:23.961444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144193d6-3681-4934-bcff-af5090a0323a tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:23.962438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144193d6-3681-4934-bcff-af5090a0323a tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:23.964379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144193d6-3681-4934-bcff-af5090a0323a tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:23.965095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144193d6-3681-4934-bcff-af5090a0323a tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:24.273489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5c5ec012-099a-4eaf-bb9f-513e70831863 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:24.288134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-144193d6-3681-4934-bcff-af5090a0323a tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:24.293305 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5c5ec012-099a-4eaf-bb9f-513e70831863 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1466 microversion: 2.1 time: 0.384269 Sep 10 10:37:24.294329 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 429/821] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:23 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1466 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:24.303308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-81758ef3-e9b6-43b5-970f-8819e12023ce tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:24.304233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-81758ef3-e9b6-43b5-970f-8819e12023ce tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:24.321114 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-144193d6-3681-4934-bcff-af5090a0323a tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1712 microversion: 2.1 time: 0.379016 Sep 10 10:37:24.323254 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 393/822] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:23 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1712 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:24.327324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81758ef3-e9b6-43b5-970f-8819e12023ce tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:24.328096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81758ef3-e9b6-43b5-970f-8819e12023ce tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:24.334637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81758ef3-e9b6-43b5-970f-8819e12023ce tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:24.336495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:24.337538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:24.339577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81758ef3-e9b6-43b5-970f-8819e12023ce tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:24.340334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81758ef3-e9b6-43b5-970f-8819e12023ce tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:24.343065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-81758ef3-e9b6-43b5-970f-8819e12023ce tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:24.357448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:24.359208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:24.361152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:24.363204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:24.365147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:24.368362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:24.780374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-81758ef3-e9b6-43b5-970f-8819e12023ce tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:24.795541 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-81758ef3-e9b6-43b5-970f-8819e12023ce tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1316 microversion: 2.1 time: 0.499239 Sep 10 10:37:24.797684 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 430/823] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:24 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:24.805389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a37debec-4ad4-4d00-bafd-fa634e01be95 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:24.806372 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a37debec-4ad4-4d00-bafd-fa634e01be95 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:24.827287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a37debec-4ad4-4d00-bafd-fa634e01be95 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:24.828168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a37debec-4ad4-4d00-bafd-fa634e01be95 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:24.828834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a37debec-4ad4-4d00-bafd-fa634e01be95 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:24.830365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a37debec-4ad4-4d00-bafd-fa634e01be95 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:24.831127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a37debec-4ad4-4d00-bafd-fa634e01be95 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:24.831902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a37debec-4ad4-4d00-bafd-fa634e01be95 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:25.091345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:25.110240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a37debec-4ad4-4d00-bafd-fa634e01be95 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:25.122966 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a37debec-4ad4-4d00-bafd-fa634e01be95 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.323967 Sep 10 10:37:25.125763 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 431/824] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:24 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:25.126232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:25.128163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:25.131582 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a1f5894-72fa-4f24-a3b5-ca7c2c0bd472 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1362 microversion: 2.25 time: 0.807147 Sep 10 10:37:25.142326 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 394/825] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:24 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1362 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:25.147067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-4a96c45c-3f89-48c2-9f6c-625b5c778d9b req-54cc6946-c028-428d-8704-26cb4ce48416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8343f197-7bda-4d75-900b-67725df1432a", "name": "network-vif-deleted", "tag": "a0ab20c1-72dc-422c-9dc0-9f4e40128cf3"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:25.166768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4a96c45c-3f89-48c2-9f6c-625b5c778d9b req-54cc6946-c028-428d-8704-26cb4ce48416 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:25.167618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4a96c45c-3f89-48c2-9f6c-625b5c778d9b req-54cc6946-c028-428d-8704-26cb4ce48416 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:25.168275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4a96c45c-3f89-48c2-9f6c-625b5c778d9b req-54cc6946-c028-428d-8704-26cb4ce48416 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:25.182072 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-4a96c45c-3f89-48c2-9f6c-625b5c778d9b req-54cc6946-c028-428d-8704-26cb4ce48416 service nova] Creating event network-vif-deleted:a0ab20c1-72dc-422c-9dc0-9f4e40128cf3 for instance 8343f197-7bda-4d75-900b-67725df1432a on n-h2-856894-1 Sep 10 10:37:25.191370 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-4a96c45c-3f89-48c2-9f6c-625b5c778d9b req-54cc6946-c028-428d-8704-26cb4ce48416 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060738 Sep 10 10:37:25.198181 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 432/826] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:25.320115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:25.321830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:25.333211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:25.333671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:25.336805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:25.337604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:25.338334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:25.339080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:25.351518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-eea8a8a9-d3cf-4bcd-885a-81744b151eca tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:25.352235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-eea8a8a9-d3cf-4bcd-885a-81744b151eca tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:25.364031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eea8a8a9-d3cf-4bcd-885a-81744b151eca tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:25.364844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eea8a8a9-d3cf-4bcd-885a-81744b151eca tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:25.365397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eea8a8a9-d3cf-4bcd-885a-81744b151eca tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:25.367205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eea8a8a9-d3cf-4bcd-885a-81744b151eca tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:25.368313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eea8a8a9-d3cf-4bcd-885a-81744b151eca tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:25.369940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eea8a8a9-d3cf-4bcd-885a-81744b151eca tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:25.382328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:25.382908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:25.383562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:25.384128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lazy-loading 'fault' on Instance uuid 8343f197-7bda-4d75-900b-67725df1432a {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:37:25.461480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-eea8a8a9-d3cf-4bcd-885a-81744b151eca tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7204a4162d974d978837f0605301a735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c9f6e01abe44fe91a53705322fd55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:25.472608 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-eea8a8a9-d3cf-4bcd-885a-81744b151eca tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 200 len: 1645 microversion: 2.1 time: 0.126326 Sep 10 10:37:25.473747 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 433/827] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:25 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 1645 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:25.476730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:25.486727 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f3885795-b763-4263-99bb-65858eee65e8 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 200 len: 1311 microversion: 2.1 time: 0.170587 Sep 10 10:37:25.488199 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 395/828] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:25 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 1311 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:25.824152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-66647076-2099-48a9-add4-789edcebf233 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:25.824850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-66647076-2099-48a9-add4-789edcebf233 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:25.840654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66647076-2099-48a9-add4-789edcebf233 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:25.843643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66647076-2099-48a9-add4-789edcebf233 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:25.845848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66647076-2099-48a9-add4-789edcebf233 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:25.848147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66647076-2099-48a9-add4-789edcebf233 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:25.849426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66647076-2099-48a9-add4-789edcebf233 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:25.850376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66647076-2099-48a9-add4-789edcebf233 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.000237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7f0bf3ee-a6af-4dbd-b1ad-29c36fa53605 req-d3b26922-84d3-478a-8d1d-a2155a4281e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d67504-0205-4bb6-b002-d53a7ca7de9b", "tag": "2c5d00d4-7c93-4f25-b2dc-6e4774aefbcf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:26.016966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7f0bf3ee-a6af-4dbd-b1ad-29c36fa53605 req-d3b26922-84d3-478a-8d1d-a2155a4281e8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.019482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7f0bf3ee-a6af-4dbd-b1ad-29c36fa53605 req-d3b26922-84d3-478a-8d1d-a2155a4281e8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.021455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7f0bf3ee-a6af-4dbd-b1ad-29c36fa53605 req-d3b26922-84d3-478a-8d1d-a2155a4281e8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.044533 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7f0bf3ee-a6af-4dbd-b1ad-29c36fa53605 req-d3b26922-84d3-478a-8d1d-a2155a4281e8 service nova] Creating event network-changed:2c5d00d4-7c93-4f25-b2dc-6e4774aefbcf for instance e5d67504-0205-4bb6-b002-d53a7ca7de9b on n-h1-856894-1 Sep 10 10:37:26.051744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7f0bf3ee-a6af-4dbd-b1ad-29c36fa53605 req-d3b26922-84d3-478a-8d1d-a2155a4281e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055496 Sep 10 10:37:26.052663 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 396/829] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:37:26.077499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-66647076-2099-48a9-add4-789edcebf233 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:26.085852 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-66647076-2099-48a9-add4-789edcebf233 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1316 microversion: 2.1 time: 0.266342 Sep 10 10:37:26.086726 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 434/830] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:25 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:26.151512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6bffef5b-505c-4d61-84aa-96c4161d54d5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:26.152241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6bffef5b-505c-4d61-84aa-96c4161d54d5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:26.166738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bffef5b-505c-4d61-84aa-96c4161d54d5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.167234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bffef5b-505c-4d61-84aa-96c4161d54d5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.167674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bffef5b-505c-4d61-84aa-96c4161d54d5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.168377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bffef5b-505c-4d61-84aa-96c4161d54d5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.168831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bffef5b-505c-4d61-84aa-96c4161d54d5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.169292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bffef5b-505c-4d61-84aa-96c4161d54d5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.170837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:26.171786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:26.194228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.195424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.196364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.197931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.198956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.200521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.435920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6bffef5b-505c-4d61-84aa-96c4161d54d5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:26.449059 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6bffef5b-505c-4d61-84aa-96c4161d54d5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.302334 Sep 10 10:37:26.453786 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 397/831] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:26 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:26.463296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9e3e831e-72cf-4257-9d1c-d86ee98ccbbd req-61959fd6-1c9b-41c2-a71d-c737b12184eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5fc162-ff4a-4020-97ca-7e9960c2f455", "name": "network-vif-plugged", "status": "completed", "tag": "7696d8d6-82d0-49c4-a65c-99ae55b6449f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:26.490259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:26.509585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9e3e831e-72cf-4257-9d1c-d86ee98ccbbd req-61959fd6-1c9b-41c2-a71d-c737b12184eb service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.515078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9e3e831e-72cf-4257-9d1c-d86ee98ccbbd req-61959fd6-1c9b-41c2-a71d-c737b12184eb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.516235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:26.516646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9e3e831e-72cf-4257-9d1c-d86ee98ccbbd req-61959fd6-1c9b-41c2-a71d-c737b12184eb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.517946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:26.521678 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9fc63c05-c9c5-49cb-a0d6-71ec7540537f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1362 microversion: 2.25 time: 0.357651 Sep 10 10:37:26.524056 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 435/832] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:26 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:26.536038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:26.539988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:26.549399 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9e3e831e-72cf-4257-9d1c-d86ee98ccbbd req-61959fd6-1c9b-41c2-a71d-c737b12184eb service nova] Creating event network-vif-plugged:7696d8d6-82d0-49c4-a65c-99ae55b6449f for instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 on n-h1-856894-1 Sep 10 10:37:26.551113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.551619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.552429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.553063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.553630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.554271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.560838 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9e3e831e-72cf-4257-9d1c-d86ee98ccbbd req-61959fd6-1c9b-41c2-a71d-c737b12184eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103663 Sep 10 10:37:26.562963 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 398/833] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:26.574235 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] HTTP exception thrown: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Request method failure captured: Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e HTTP/1.1 Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgwwtDMsWi_zxyEcqzYrjQ323Je0zR0NCapJDcXwp5_shTsFNGq_mok36cap5Llp2dQM_qV1VvEToI2sVRD4URDC-S6IMnWkR__nXa5DqWsXkyaz-MWEvDdx9XWNSmJwlD_32wgWniIyzcwJWUsEY9KqsnhtN2xyrWKYi-nvsrYaGU Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:26.576444 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66c9f6e01abe44fe91a53705322fd55f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7204a4162d974d978837f0605301a735 Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:26.578457 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '7a85385a-d49e-42c6-ade1-56cedcc85d9e'} Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:26.579300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:26.580890 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.581996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:26.582078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Returning 404 to user: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:26.582153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 8343f197-7bda-4d75-900b-67725df1432a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:26.582236 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f2f1fd65-8585-4215-91c8-5f3f17930122 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 404 len: 111 microversion: 2.1 time: 0.049817 Sep 10 10:37:26.582236 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 436/834] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:26 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:26.591174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.591382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:26.592066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.592168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:26.592257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.592781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.601400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.602089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.602735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.604311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.604926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.605765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.608730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.609147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.626631 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] HTTP exception thrown: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Request method failure captured: Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 HTTP/1.1 Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgwwtDMsWi_zxyEcqzYrjQ323Je0zR0NCapJDcXwp5_shTsFNGq_mok36cap5Llp2dQM_qV1VvEToI2sVRD4URDC-S6IMnWkR__nXa5DqWsXkyaz-MWEvDdx9XWNSmJwlD_32wgWniIyzcwJWUsEY9KqsnhtN2xyrWKYi-nvsrYaGU Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:26.628871 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66c9f6e01abe44fe91a53705322fd55f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7204a4162d974d978837f0605301a735 Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:26.630330 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '066e1684-136a-40a9-90b1-dec10869b975'} Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:26.631220 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:26.632815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.638206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Returning 404 to user: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:26.640230 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0ea5b38d-02f0-4ff3-b83f-e015b8b46610 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "DELETE /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 404 len: 111 microversion: 2.1 time: 0.056439 Sep 10 10:37:26.642345 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] HTTP exception thrown: Instance 8343f197-7bda-4d75-900b-67725df1432a could not be found. Sep 10 10:37:26.643288 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 437/835] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:37:26 2022] DELETE /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Request method failure captured: Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a HTTP/1.1 Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiK-Fh8eZyB_Is3vXJHKuJPlugCLV2ISPHd5-FcatYK8fFUM4U5bNp7dQcF1XFkf3uVml9sDW79e0esk6Z-tRrGquyARave141Jt0OA_L30NefS7l8sP8dxB8FabSZv3Hl19qLhPtqtU_bEL_nI-z7ZVRLJURjjhaLCX5graVmBxv0 Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 99bb8844a05f444d9debc0c5cfe6d32e Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-144821354 Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:37:26.645406 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99bb8844a05f444d9debc0c5cfe6d32e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99bb8844a05f444d9debc0c5cfe6d32e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99bb8844a05f444d9debc0c5cfe6d32e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99bb8844a05f444d9debc0c5cfe6d32e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersAdminNegativeTestJSON-144821354 Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 99bb8844a05f444d9debc0c5cfe6d32e Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-144821354 Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersAdminNegativeTestJSON-144821354-project Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 7a5e475e6f334eaca29f1e114d1f06cb Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersAdminNegativeTestJSON-144821354-project Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 8343f197-7bda-4d75-900b-67725df1432a could not be found. Sep 10 10:37:26.646780 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '8343f197-7bda-4d75-900b-67725df1432a'} Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8343f197-7bda-4d75-900b-67725df1432a could not be found. Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:26.647550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8343f197-7bda-4d75-900b-67725df1432a could not be found. Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8343f197-7bda-4d75-900b-67725df1432a could not be found. Sep 10 10:37:26.648691 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.650076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Returning 404 to user: Instance 8343f197-7bda-4d75-900b-67725df1432a could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:26.650076 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f8d4252-d57f-4b8e-82f2-eaec6eb609f9 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a" status: 404 len: 111 microversion: 2.1 time: 0.084610 Sep 10 10:37:26.650844 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 399/836] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:26 2022] GET /compute/v2.1/servers/8343f197-7bda-4d75-900b-67725df1432a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:26.664202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2bb63eb-5fd6-4090-8d2c-9104d643be43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:26.665054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:26.665748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2bb63eb-5fd6-4090-8d2c-9104d643be43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:26.666460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:26.672745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.673275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.673716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.674427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.674882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.675307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.680676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2bb63eb-5fd6-4090-8d2c-9104d643be43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.681220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2bb63eb-5fd6-4090-8d2c-9104d643be43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.682292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2bb63eb-5fd6-4090-8d2c-9104d643be43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.683003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2bb63eb-5fd6-4090-8d2c-9104d643be43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.683461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2bb63eb-5fd6-4090-8d2c-9104d643be43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.683885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2bb63eb-5fd6-4090-8d2c-9104d643be43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.699119 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] HTTP exception thrown: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Request method failure captured: Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 HTTP/1.1 Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgwwtDMsWi_zxyEcqzYrjQ323Je0zR0NCapJDcXwp5_shTsFNGq_mok36cap5Llp2dQM_qV1VvEToI2sVRD4URDC-S6IMnWkR__nXa5DqWsXkyaz-MWEvDdx9XWNSmJwlD_32wgWniIyzcwJWUsEY9KqsnhtN2xyrWKYi-nvsrYaGU Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:26.702891 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66c9f6e01abe44fe91a53705322fd55f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7204a4162d974d978837f0605301a735 Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:26.704462 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '066e1684-136a-40a9-90b1-dec10869b975'} Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:26.705254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:26.707195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:26.711888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Returning 404 to user: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:26.713542 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-22ff99de-092a-4ad9-9c10-8c3f7def5323 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 404 len: 111 microversion: 2.1 time: 0.065565 Sep 10 10:37:26.718087 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 438/837] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:26 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:26.724528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-27ff6101-d654-4874-a00f-72f29dd68d6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '.version_select at 0x7efcaedc7e50>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:26.737931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2bb63eb-5fd6-4090-8d2c-9104d643be43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:37:26.750895 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-27ff6101-d654-4874-a00f-72f29dd68d6d tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237547689" status: 202 len: 0 microversion: 2.1 time: 0.029971 Sep 10 10:37:26.752530 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 439/838] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Sep 10 10:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237547689 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:37:26.766100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:26.874551 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2bb63eb-5fd6-4090-8d2c-9104d643be43 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 204 len: 0 microversion: 2.1 time: 0.213871 Sep 10 10:37:26.878079 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 400/839] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:37:26 2022] DELETE /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:37:26.888959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0c25d925-9ff9-4b2f-a789-659c2f9d7c79 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:26.891400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0c25d925-9ff9-4b2f-a789-659c2f9d7c79 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:26.900550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c25d925-9ff9-4b2f-a789-659c2f9d7c79 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.901146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c25d925-9ff9-4b2f-a789-659c2f9d7c79 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.901884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c25d925-9ff9-4b2f-a789-659c2f9d7c79 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:26.902597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c25d925-9ff9-4b2f-a789-659c2f9d7c79 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:26.903053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c25d925-9ff9-4b2f-a789-659c2f9d7c79 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:26.903476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c25d925-9ff9-4b2f-a789-659c2f9d7c79 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:27.109301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5953688a-71af-4fe8-a4ad-3eb5515c343e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:27.110282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5953688a-71af-4fe8-a4ad-3eb5515c343e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:27.116788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5953688a-71af-4fe8-a4ad-3eb5515c343e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:27.117257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5953688a-71af-4fe8-a4ad-3eb5515c343e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:27.117704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5953688a-71af-4fe8-a4ad-3eb5515c343e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:27.118410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5953688a-71af-4fe8-a4ad-3eb5515c343e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:27.119631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5953688a-71af-4fe8-a4ad-3eb5515c343e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:27.120054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5953688a-71af-4fe8-a4ad-3eb5515c343e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:27.223867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0c25d925-9ff9-4b2f-a789-659c2f9d7c79 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:27.238741 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0c25d925-9ff9-4b2f-a789-659c2f9d7c79 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1478 microversion: 2.1 time: 0.356708 Sep 10 10:37:27.240333 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 440/840] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:26 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1478 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:27.246106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-eb733b1c-07a8-4c08-850f-cfa81450f2a4 req-20e78693-e035-4792-9556-a64896ce4454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a85385a-d49e-42c6-ade1-56cedcc85d9e", "name": "network-vif-deleted", "tag": "9607736b-aa48-4813-914a-a2282cc916aa"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:27.257162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eb733b1c-07a8-4c08-850f-cfa81450f2a4 req-20e78693-e035-4792-9556-a64896ce4454 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:27.258379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eb733b1c-07a8-4c08-850f-cfa81450f2a4 req-20e78693-e035-4792-9556-a64896ce4454 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:27.259007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eb733b1c-07a8-4c08-850f-cfa81450f2a4 req-20e78693-e035-4792-9556-a64896ce4454 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:27.275756 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-eb733b1c-07a8-4c08-850f-cfa81450f2a4 req-20e78693-e035-4792-9556-a64896ce4454 service nova] Creating event network-vif-deleted:9607736b-aa48-4813-914a-a2282cc916aa for instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e on n-h2-856894-1 Sep 10 10:37:27.283769 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-eb733b1c-07a8-4c08-850f-cfa81450f2a4 req-20e78693-e035-4792-9556-a64896ce4454 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040518 Sep 10 10:37:27.285031 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 441/841] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:27.309997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5953688a-71af-4fe8-a4ad-3eb5515c343e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:27.318910 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5953688a-71af-4fe8-a4ad-3eb5515c343e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1316 microversion: 2.1 time: 0.213963 Sep 10 10:37:27.319502 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 401/842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:27 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:27.480974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ed2b8ed5-5aac-413f-bd9d-a042cc55a0e1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:27.481926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ed2b8ed5-5aac-413f-bd9d-a042cc55a0e1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:27.489597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ed5-5aac-413f-bd9d-a042cc55a0e1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:27.490398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ed5-5aac-413f-bd9d-a042cc55a0e1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:27.490840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ed5-5aac-413f-bd9d-a042cc55a0e1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:27.491554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ed5-5aac-413f-bd9d-a042cc55a0e1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:27.492040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ed5-5aac-413f-bd9d-a042cc55a0e1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:27.492633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ed5-5aac-413f-bd9d-a042cc55a0e1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:27.550788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:27.551467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:27.558467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:27.559120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:27.559757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:27.560489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:27.560947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:27.561406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:27.732643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:27.742676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:27.744667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:27.746078 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-734c0820-6bf3-49d4-bc50-d2c4d3845c30 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1362 microversion: 2.25 time: 0.199638 Sep 10 10:37:27.746839 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 402/843] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:27 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:27.997363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ed2b8ed5-5aac-413f-bd9d-a042cc55a0e1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:28.006805 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ed2b8ed5-5aac-413f-bd9d-a042cc55a0e1 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.530810 Sep 10 10:37:28.016892 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 442/844] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:27 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:28.267614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d0c3679-f529-4ba3-b7ae-fc97ff109b1a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:28.268466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d0c3679-f529-4ba3-b7ae-fc97ff109b1a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:28.278639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0c3679-f529-4ba3-b7ae-fc97ff109b1a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.279648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0c3679-f529-4ba3-b7ae-fc97ff109b1a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.281585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0c3679-f529-4ba3-b7ae-fc97ff109b1a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.283157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0c3679-f529-4ba3-b7ae-fc97ff109b1a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.283790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0c3679-f529-4ba3-b7ae-fc97ff109b1a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.284480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0c3679-f529-4ba3-b7ae-fc97ff109b1a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.359265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c6d121d3-d954-4a4b-be9e-3eb72d4cd7aa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:28.360133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c6d121d3-d954-4a4b-be9e-3eb72d4cd7aa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:28.378792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6d121d3-d954-4a4b-be9e-3eb72d4cd7aa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.379298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6d121d3-d954-4a4b-be9e-3eb72d4cd7aa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.379740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6d121d3-d954-4a4b-be9e-3eb72d4cd7aa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.380453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6d121d3-d954-4a4b-be9e-3eb72d4cd7aa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.384199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6d121d3-d954-4a4b-be9e-3eb72d4cd7aa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.384789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6d121d3-d954-4a4b-be9e-3eb72d4cd7aa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.493889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d0c3679-f529-4ba3-b7ae-fc97ff109b1a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:28.503475 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d0c3679-f529-4ba3-b7ae-fc97ff109b1a tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1478 microversion: 2.1 time: 0.240283 Sep 10 10:37:28.504631 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 403/845] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:28 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1478 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:28.629888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2724dfd-5a04-4330-81dc-3fb7254b0a05 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:28.668968 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2724dfd-5a04-4330-81dc-3fb7254b0a05 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1983811351" status: 202 len: 0 microversion: 2.1 time: 0.044330 Sep 10 10:37:28.670537 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 404/846] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:37:28 2022] DELETE /compute/v2.1/flavors/1983811351 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:37:28.685741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b0b4f94-8f08-4572-821e-eded76acb77b tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:28.710717 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b0b4f94-8f08-4572-821e-eded76acb77b tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.029531 Sep 10 10:37:28.711470 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 405/847] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:37:28 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:28.730841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ade0d9b-9f6c-4964-9139-dffa7a6e4c54 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:28.748796 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7ade0d9b-9f6c-4964-9139-dffa7a6e4c54 tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1817948937" status: 202 len: 0 microversion: 2.1 time: 0.021949 Sep 10 10:37:28.749320 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 406/848] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:37:28 2022] DELETE /compute/v2.1/flavors/1817948937 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:37:28.758260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e42aeb4-a723-4923-a588-e661128708ea tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:28.781309 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e42aeb4-a723-4923-a588-e661128708ea tempest-ServersWithSpecificFlavorTestJSON-1322936915 tempest-ServersWithSpecificFlavorTestJSON-1322936915-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027323 Sep 10 10:37:28.781906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 407/849] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:37:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:28.808240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:28.809304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:28.816629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.817334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.817950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.818824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.819284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.819759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.821186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c6d121d3-d954-4a4b-be9e-3eb72d4cd7aa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:28.829116 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c6d121d3-d954-4a4b-be9e-3eb72d4cd7aa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1316 microversion: 2.1 time: 0.487144 Sep 10 10:37:28.830627 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 443/850] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:28 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:28.845945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:28.846711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:28.854012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.856929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.860848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.861742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.862542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.863207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.882663 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] HTTP exception thrown: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Request method failure captured: Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e HTTP/1.1 Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgwwtDMsWi_zxyEcqzYrjQ323Je0zR0NCapJDcXwp5_shTsFNGq_mok36cap5Llp2dQM_qV1VvEToI2sVRD4URDC-S6IMnWkR__nXa5DqWsXkyaz-MWEvDdx9XWNSmJwlD_32wgWniIyzcwJWUsEY9KqsnhtN2xyrWKYi-nvsrYaGU Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:28.884786 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66c9f6e01abe44fe91a53705322fd55f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7204a4162d974d978837f0605301a735 Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:28.886214 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '7a85385a-d49e-42c6-ade1-56cedcc85d9e'} Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:28.886942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:28.888134 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:28.891796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Returning 404 to user: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:28.893055 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d8962c39-208d-496c-b255-1258e06ea763 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 404 len: 111 microversion: 2.1 time: 0.061408 Sep 10 10:37:28.894179 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 444/851] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:37:28 2022] DELETE /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:28.902351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:28.903323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 7a85385a-d49e-42c6-ade1-56cedcc85d9e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:28.909860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.910913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.911734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.912666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.913397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.914060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.930295 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] HTTP exception thrown: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Request method failure captured: Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e HTTP/1.1 Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgwwtDMsWi_zxyEcqzYrjQ323Je0zR0NCapJDcXwp5_shTsFNGq_mok36cap5Llp2dQM_qV1VvEToI2sVRD4URDC-S6IMnWkR__nXa5DqWsXkyaz-MWEvDdx9XWNSmJwlD_32wgWniIyzcwJWUsEY9KqsnhtN2xyrWKYi-nvsrYaGU Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:28.933170 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66c9f6e01abe44fe91a53705322fd55f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7204a4162d974d978837f0605301a735 Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:28.934508 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '7a85385a-d49e-42c6-ade1-56cedcc85d9e'} Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:28.935373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. Sep 10 10:37:28.936529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:28.939155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Returning 404 to user: Instance 7a85385a-d49e-42c6-ade1-56cedcc85d9e could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:28.940118 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-64e0aec5-dedc-49c0-a0d6-6902576cab69 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e" status: 404 len: 111 microversion: 2.1 time: 0.042048 Sep 10 10:37:28.940792 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 445/852] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:28 2022] GET /compute/v2.1/servers/7a85385a-d49e-42c6-ade1-56cedcc85d9e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:28.954138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:28.954654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:28.966809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.967915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.968383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:28.969161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:28.969819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:28.970199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:29.002269 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] HTTP exception thrown: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Request method failure captured: Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 HTTP/1.1 Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgwwtDMsWi_zxyEcqzYrjQ323Je0zR0NCapJDcXwp5_shTsFNGq_mok36cap5Llp2dQM_qV1VvEToI2sVRD4URDC-S6IMnWkR__nXa5DqWsXkyaz-MWEvDdx9XWNSmJwlD_32wgWniIyzcwJWUsEY9KqsnhtN2xyrWKYi-nvsrYaGU Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:29.005432 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66c9f6e01abe44fe91a53705322fd55f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7204a4162d974d978837f0605301a735 Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:29.007167 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '066e1684-136a-40a9-90b1-dec10869b975'} Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:29.008041 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:29.009546 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:29.011468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Returning 404 to user: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:29.011468 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-988df989-29dd-4d5b-ba96-cff6c60e34ed tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "DELETE /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 404 len: 111 microversion: 2.1 time: 0.059411 Sep 10 10:37:29.011468 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 446/853] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:37:28 2022] DELETE /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:29.028592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:29.028592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] [instance: 066e1684-136a-40a9-90b1-dec10869b975] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:29.044376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:29.045621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:29.046202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:29.047119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:29.047909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:29.048439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:29.065501 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] HTTP exception thrown: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Request method failure captured: Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 HTTP/1.1 Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGgwwtDMsWi_zxyEcqzYrjQ323Je0zR0NCapJDcXwp5_shTsFNGq_mok36cap5Llp2dQM_qV1VvEToI2sVRD4URDC-S6IMnWkR__nXa5DqWsXkyaz-MWEvDdx9XWNSmJwlD_32wgWniIyzcwJWUsEY9KqsnhtN2xyrWKYi-nvsrYaGU Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:29.067494 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66c9f6e01abe44fe91a53705322fd55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66c9f6e01abe44fe91a53705322fd55f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 66c9f6e01abe44fe91a53705322fd55f Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480 Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7204a4162d974d978837f0605301a735 Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1297798480-project Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:29.069039 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '066e1684-136a-40a9-90b1-dec10869b975'} Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:29.069931 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. Sep 10 10:37:29.072644 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:29.075180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] Returning 404 to user: Instance 066e1684-136a-40a9-90b1-dec10869b975 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:29.077776 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-23cad3f6-7757-4d66-8e63-c0a1c5e5fde9 tempest-ServersWithSpecificFlavorTestJSON-1297798480 tempest-ServersWithSpecificFlavorTestJSON-1297798480-project] 10.222.0.20 "GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975" status: 404 len: 111 microversion: 2.1 time: 0.059109 Sep 10 10:37:29.077776 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 447/854] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:29 2022] GET /compute/v2.1/servers/066e1684-136a-40a9-90b1-dec10869b975 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:29.081374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:29.082371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a387c4d4-2b99-4db9-8297-82e5a64567ee tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:29.083152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a387c4d4-2b99-4db9-8297-82e5a64567ee tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:29.091355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a387c4d4-2b99-4db9-8297-82e5a64567ee tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:29.091946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a387c4d4-2b99-4db9-8297-82e5a64567ee tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:29.092496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a387c4d4-2b99-4db9-8297-82e5a64567ee tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:29.093435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a387c4d4-2b99-4db9-8297-82e5a64567ee tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:29.094007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a387c4d4-2b99-4db9-8297-82e5a64567ee tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:29.094838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a387c4d4-2b99-4db9-8297-82e5a64567ee tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:29.106411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:29.107877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:29.109026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-208c79ec-3060-4dc6-8576-659fcfd2f88b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1362 microversion: 2.25 time: 0.314096 Sep 10 10:37:29.121105 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 408/855] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:28 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:29.527664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1355159b-a47d-4b80-ab1c-bbaf1e22d292 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:29.528274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1355159b-a47d-4b80-ab1c-bbaf1e22d292 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:29.535585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1355159b-a47d-4b80-ab1c-bbaf1e22d292 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:29.536091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1355159b-a47d-4b80-ab1c-bbaf1e22d292 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:29.536532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1355159b-a47d-4b80-ab1c-bbaf1e22d292 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:29.537273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1355159b-a47d-4b80-ab1c-bbaf1e22d292 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:29.537736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1355159b-a47d-4b80-ab1c-bbaf1e22d292 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:29.538162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1355159b-a47d-4b80-ab1c-bbaf1e22d292 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:29.561095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a387c4d4-2b99-4db9-8297-82e5a64567ee tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:29.579377 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a387c4d4-2b99-4db9-8297-82e5a64567ee tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.499963 Sep 10 10:37:29.581663 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 448/856] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:29 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:29.695882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1355159b-a47d-4b80-ab1c-bbaf1e22d292 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5e475e6f334eaca29f1e114d1f06cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bb8844a05f444d9debc0c5cfe6d32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:29.707456 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1355159b-a47d-4b80-ab1c-bbaf1e22d292 tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 200 len: 1436 microversion: 2.1 time: 0.184138 Sep 10 10:37:29.712208 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 409/857] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:29 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 1436 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:29.861129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d821b7f-2531-46f9-b47d-d0a9385105ff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:29.862000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-d7635f23-332c-4f04-b2a3-c8318a5e615f req-4395ec12-3011-48f9-98a3-7b3832bc758c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cee035c-b7ed-45ea-ae74-1f6e84884f93", "name": "network-vif-deleted", "tag": "78172492-464d-44c4-9fd7-8bcc7267628a"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:29.862156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d821b7f-2531-46f9-b47d-d0a9385105ff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:29.874901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d821b7f-2531-46f9-b47d-d0a9385105ff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:29.875414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d821b7f-2531-46f9-b47d-d0a9385105ff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:29.875856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d821b7f-2531-46f9-b47d-d0a9385105ff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:29.876573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d821b7f-2531-46f9-b47d-d0a9385105ff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:29.877241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d821b7f-2531-46f9-b47d-d0a9385105ff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:29.877826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d821b7f-2531-46f9-b47d-d0a9385105ff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:29.885012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d7635f23-332c-4f04-b2a3-c8318a5e615f req-4395ec12-3011-48f9-98a3-7b3832bc758c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:29.886020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d7635f23-332c-4f04-b2a3-c8318a5e615f req-4395ec12-3011-48f9-98a3-7b3832bc758c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:29.886828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d7635f23-332c-4f04-b2a3-c8318a5e615f req-4395ec12-3011-48f9-98a3-7b3832bc758c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:29.907003 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-d7635f23-332c-4f04-b2a3-c8318a5e615f req-4395ec12-3011-48f9-98a3-7b3832bc758c service nova] Creating event network-vif-deleted:78172492-464d-44c4-9fd7-8bcc7267628a for instance 5cee035c-b7ed-45ea-ae74-1f6e84884f93 on n-h2-856894-1 Sep 10 10:37:29.916507 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-d7635f23-332c-4f04-b2a3-c8318a5e615f req-4395ec12-3011-48f9-98a3-7b3832bc758c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064339 Sep 10 10:37:29.919261 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 449/858] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:30.147410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:30.149528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:30.161181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:30.170743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:30.171650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:30.172490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:30.173096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:30.173592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:30.423586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d821b7f-2531-46f9-b47d-d0a9385105ff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:30.432132 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d821b7f-2531-46f9-b47d-d0a9385105ff tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1316 microversion: 2.1 time: 0.574762 Sep 10 10:37:30.449527 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 410/859] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:29 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:30.455309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6ce97f9f-ce7d-4ef2-b7b5-c9365cf39989 req-59b3f64c-a470-450a-9ef6-c68b171dca79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5505968a-0f31-49c9-949b-43e93328561b", "name": "network-vif-plugged", "status": "completed", "tag": "b4a4e135-2ccb-4806-8ed0-f899e206496b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:30.466849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6ce97f9f-ce7d-4ef2-b7b5-c9365cf39989 req-59b3f64c-a470-450a-9ef6-c68b171dca79 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:30.467676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6ce97f9f-ce7d-4ef2-b7b5-c9365cf39989 req-59b3f64c-a470-450a-9ef6-c68b171dca79 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:30.468320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6ce97f9f-ce7d-4ef2-b7b5-c9365cf39989 req-59b3f64c-a470-450a-9ef6-c68b171dca79 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:30.487911 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6ce97f9f-ce7d-4ef2-b7b5-c9365cf39989 req-59b3f64c-a470-450a-9ef6-c68b171dca79 service nova] Creating event network-vif-plugged:b4a4e135-2ccb-4806-8ed0-f899e206496b for instance 5505968a-0f31-49c9-949b-43e93328561b on n-h1-856894-1 Sep 10 10:37:30.497205 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6ce97f9f-ce7d-4ef2-b7b5-c9365cf39989 req-59b3f64c-a470-450a-9ef6-c68b171dca79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044999 Sep 10 10:37:30.498553 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 411/860] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:30.527999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:30.544061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:30.547993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:30.551172 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4be6d90c-d5f8-4f5a-84ae-afab2c0f70a5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1558 microversion: 2.25 time: 0.417078 Sep 10 10:37:30.576012 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 450/861] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:30 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1558 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:30.581193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8fe49bdc-3cd9-4b22-afc5-1d720deb0225 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:30.582448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8fe49bdc-3cd9-4b22-afc5-1d720deb0225 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:30.585175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:30.601960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe49bdc-3cd9-4b22-afc5-1d720deb0225 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:30.603887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe49bdc-3cd9-4b22-afc5-1d720deb0225 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:30.605887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe49bdc-3cd9-4b22-afc5-1d720deb0225 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:30.606139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-948add05-d7ac-492e-96d7-1898dc6f3057 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:30.606840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe49bdc-3cd9-4b22-afc5-1d720deb0225 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:30.607310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe49bdc-3cd9-4b22-afc5-1d720deb0225 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:30.607742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe49bdc-3cd9-4b22-afc5-1d720deb0225 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:30.610333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-948add05-d7ac-492e-96d7-1898dc6f3057 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:30.632386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-948add05-d7ac-492e-96d7-1898dc6f3057 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:30.632938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-948add05-d7ac-492e-96d7-1898dc6f3057 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:30.637518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-948add05-d7ac-492e-96d7-1898dc6f3057 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:30.640130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-948add05-d7ac-492e-96d7-1898dc6f3057 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:30.642074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-948add05-d7ac-492e-96d7-1898dc6f3057 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:30.643568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-948add05-d7ac-492e-96d7-1898dc6f3057 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:30.746652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=16 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:31.019252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-948add05-d7ac-492e-96d7-1898dc6f3057 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:31.032261 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-948add05-d7ac-492e-96d7-1898dc6f3057 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.432620 Sep 10 10:37:31.036976 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 451/862] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:30 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:31.042636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:31.055077 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] [instance: 5cee035c-b7ed-45ea-ae74-1f6e84884f93] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:31.062214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-8fe49bdc-3cd9-4b22-afc5-1d720deb0225 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid ff5fc162-ff4a-4020-97ca-7e9960c2f455 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:37:31.067617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.068749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.070853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.071758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.074216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.074855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.083409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:31.095678 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8fe49bdc-3cd9-4b22-afc5-1d720deb0225 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 2051 microversion: 2.25 time: 0.519683 Sep 10 10:37:31.096663 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 412/863] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:30 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 2051 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:37:31.099421 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] HTTP exception thrown: Instance 5cee035c-b7ed-45ea-ae74-1f6e84884f93 could not be found. Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Request method failure captured: Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 HTTP/1.1 Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGiK-Fh8eZyB_Is3vXJHKuJPlugCLV2ISPHd5-FcatYK8fFUM4U5bNp7dQcF1XFkf3uVml9sDW79e0esk6Z-tRrGquyARave141Jt0OA_L30NefS7l8sP8dxB8FabSZv3Hl19qLhPtqtU_bEL_nI-z7ZVRLJURjjhaLCX5graVmBxv0 Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 99bb8844a05f444d9debc0c5cfe6d32e Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-144821354 Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:31.102396 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99bb8844a05f444d9debc0c5cfe6d32e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99bb8844a05f444d9debc0c5cfe6d32e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99bb8844a05f444d9debc0c5cfe6d32e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99bb8844a05f444d9debc0c5cfe6d32e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersAdminNegativeTestJSON-144821354 Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 99bb8844a05f444d9debc0c5cfe6d32e Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-144821354 Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersAdminNegativeTestJSON-144821354-project Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7a5e475e6f334eaca29f1e114d1f06cb Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersAdminNegativeTestJSON-144821354-project Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 5cee035c-b7ed-45ea-ae74-1f6e84884f93 could not be found. Sep 10 10:37:31.104475 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5cee035c-b7ed-45ea-ae74-1f6e84884f93'} Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cee035c-b7ed-45ea-ae74-1f6e84884f93 could not be found. Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:31.105292 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cee035c-b7ed-45ea-ae74-1f6e84884f93 could not be found. Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cee035c-b7ed-45ea-ae74-1f6e84884f93 could not be found. Sep 10 10:37:31.106493 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:31.108924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] Returning 404 to user: Instance 5cee035c-b7ed-45ea-ae74-1f6e84884f93 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:31.109839 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-31dcba8b-0449-4b95-8a22-a1a3354516cd tempest-ServersAdminNegativeTestJSON-144821354 tempest-ServersAdminNegativeTestJSON-144821354-project] 10.222.0.20 "GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93" status: 404 len: 111 microversion: 2.1 time: 0.071579 Sep 10 10:37:31.115516 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 452/864] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:31 2022] GET /compute/v2.1/servers/5cee035c-b7ed-45ea-ae74-1f6e84884f93 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:31.125244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60b3523a-8223-4b99-9e59-94fb2b9634b9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:31.126215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60b3523a-8223-4b99-9e59-94fb2b9634b9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:31.129488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:31.136743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60b3523a-8223-4b99-9e59-94fb2b9634b9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.139460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60b3523a-8223-4b99-9e59-94fb2b9634b9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.141269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60b3523a-8223-4b99-9e59-94fb2b9634b9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.145170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60b3523a-8223-4b99-9e59-94fb2b9634b9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.147022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60b3523a-8223-4b99-9e59-94fb2b9634b9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.147504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60b3523a-8223-4b99-9e59-94fb2b9634b9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.455889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2345e6f9-d400-4804-b7dd-c40fe0acd05e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:31.456609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2345e6f9-d400-4804-b7dd-c40fe0acd05e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:31.465332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2345e6f9-d400-4804-b7dd-c40fe0acd05e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.466293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2345e6f9-d400-4804-b7dd-c40fe0acd05e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.466951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2345e6f9-d400-4804-b7dd-c40fe0acd05e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.468582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2345e6f9-d400-4804-b7dd-c40fe0acd05e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.469290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2345e6f9-d400-4804-b7dd-c40fe0acd05e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.470611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2345e6f9-d400-4804-b7dd-c40fe0acd05e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.594773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-60b3523a-8223-4b99-9e59-94fb2b9634b9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid ff5fc162-ff4a-4020-97ca-7e9960c2f455 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:37:31.621063 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60b3523a-8223-4b99-9e59-94fb2b9634b9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 2051 microversion: 2.25 time: 0.499629 Sep 10 10:37:31.626890 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 413/865] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:31 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 2051 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:31.651463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6a8689a8-467b-4e5d-ad92-318504c00c3d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:31.655619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a8689a8-467b-4e5d-ad92-318504c00c3d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.656384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a8689a8-467b-4e5d-ad92-318504c00c3d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.657027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a8689a8-467b-4e5d-ad92-318504c00c3d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.658311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a8689a8-467b-4e5d-ad92-318504c00c3d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.658987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a8689a8-467b-4e5d-ad92-318504c00c3d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.659643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a8689a8-467b-4e5d-ad92-318504c00c3d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.690708 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6a8689a8-467b-4e5d-ad92-318504c00c3d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043522 Sep 10 10:37:31.700438 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 414/866] 10.222.0.20 () {60 vars in 1217 bytes} [Sat Sep 10 10:37:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:37:31.712258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8a24f10-dc43-41ec-afc6-06876ca25103 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:31.714481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8a24f10-dc43-41ec-afc6-06876ca25103 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:31.734552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a24f10-dc43-41ec-afc6-06876ca25103 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.735140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a24f10-dc43-41ec-afc6-06876ca25103 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.735662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a24f10-dc43-41ec-afc6-06876ca25103 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.736450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a24f10-dc43-41ec-afc6-06876ca25103 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.737389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a24f10-dc43-41ec-afc6-06876ca25103 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.738045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a24f10-dc43-41ec-afc6-06876ca25103 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.832696 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8a24f10-dc43-41ec-afc6-06876ca25103 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455/action" status: 202 len: 0 microversion: 2.25 time: 0.130540 Sep 10 10:37:31.836726 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 415/867] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:37:31 2022] POST /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:37:31.842566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-604ad91b-687f-4029-b534-2227fac1d1fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:31.843588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-604ad91b-687f-4029-b534-2227fac1d1fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:31.859198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-604ad91b-687f-4029-b534-2227fac1d1fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.860138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-604ad91b-687f-4029-b534-2227fac1d1fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.860833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-604ad91b-687f-4029-b534-2227fac1d1fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:31.861841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-604ad91b-687f-4029-b534-2227fac1d1fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:31.862522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-604ad91b-687f-4029-b534-2227fac1d1fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:31.863237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-604ad91b-687f-4029-b534-2227fac1d1fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:32.145727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2345e6f9-d400-4804-b7dd-c40fe0acd05e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:32.158465 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2345e6f9-d400-4804-b7dd-c40fe0acd05e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1316 microversion: 2.1 time: 0.706119 Sep 10 10:37:32.159365 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 453/868] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:31 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1316 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:32.167640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f0e519fb-2013-4556-9a85-2656d32906c5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:32.178416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f0e519fb-2013-4556-9a85-2656d32906c5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:32.187287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0e519fb-2013-4556-9a85-2656d32906c5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:32.188298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0e519fb-2013-4556-9a85-2656d32906c5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:32.188983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0e519fb-2013-4556-9a85-2656d32906c5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:32.189812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0e519fb-2013-4556-9a85-2656d32906c5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:32.190908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0e519fb-2013-4556-9a85-2656d32906c5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:32.192105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0e519fb-2013-4556-9a85-2656d32906c5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:32.213787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-604ad91b-687f-4029-b534-2227fac1d1fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid ff5fc162-ff4a-4020-97ca-7e9960c2f455 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:37:32.235749 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-604ad91b-687f-4029-b534-2227fac1d1fe tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 2056 microversion: 2.25 time: 0.397318 Sep 10 10:37:32.238690 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 416/869] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:31 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 2056 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:32.861589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f0e519fb-2013-4556-9a85-2656d32906c5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:32.887174 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f0e519fb-2013-4556-9a85-2656d32906c5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1315 microversion: 2.1 time: 0.725321 Sep 10 10:37:32.905763 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 454/870] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:32 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:33.190083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-217c1440-6100-4b36-8de3-4c158a77bb34 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:33.190731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-217c1440-6100-4b36-8de3-4c158a77bb34 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:33.200518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-217c1440-6100-4b36-8de3-4c158a77bb34 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:33.201015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-217c1440-6100-4b36-8de3-4c158a77bb34 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:33.203710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-217c1440-6100-4b36-8de3-4c158a77bb34 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:33.207681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-217c1440-6100-4b36-8de3-4c158a77bb34 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:33.208797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-217c1440-6100-4b36-8de3-4c158a77bb34 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:33.209533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-217c1440-6100-4b36-8de3-4c158a77bb34 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:33.433944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f3027f6-873e-492e-9003-7093391f6f26 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] Action: 'create', calling method: .version_select at 0x7efcaef23700>, body: {"keypair": {"name": "tempest-keypair-1194628985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3Ob4Q7Z4XG/EImGJpR+VBi/t7FOIg4v3C/5K17s7ZsSDlwsZRcREVczc/wHlkSqq2sz3HRTKXmBa5JdJgAIkqzKgXPkK0fX7U/QY6sRl7meqx0LK08Ssf1MauFnVRmA=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:33.457650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0f3027f6-873e-492e-9003-7093391f6f26 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] Getting quotas for project 7540a87e5e374f0ea5121a509cafcbaa. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:37:33.465376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0f3027f6-873e-492e-9003-7093391f6f26 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] Getting quotas for user f83fafabfe18473bb8be479771fb6cc2 and project 7540a87e5e374f0ea5121a509cafcbaa. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:37:33.520576 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f3027f6-873e-492e-9003-7093391f6f26 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.359391 Sep 10 10:37:33.521828 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 417/871] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:37:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:33.526918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82759803-28eb-4d64-a733-823f2de86aa2 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:33.535937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82759803-28eb-4d64-a733-823f2de86aa2 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:33.544979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82759803-28eb-4d64-a733-823f2de86aa2 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:33.550052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82759803-28eb-4d64-a733-823f2de86aa2 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:33.550737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82759803-28eb-4d64-a733-823f2de86aa2 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:33.553286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82759803-28eb-4d64-a733-823f2de86aa2 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:33.553932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82759803-28eb-4d64-a733-823f2de86aa2 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:33.554535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82759803-28eb-4d64-a733-823f2de86aa2 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:33.593171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-217c1440-6100-4b36-8de3-4c158a77bb34 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:33.601434 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-217c1440-6100-4b36-8de3-4c158a77bb34 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1316 microversion: 2.1 time: 0.415395 Sep 10 10:37:33.602024 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 455/872] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:33 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:33.820838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-82759803-28eb-4d64-a733-823f2de86aa2 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid ff5fc162-ff4a-4020-97ca-7e9960c2f455 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:37:33.844059 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82759803-28eb-4d64-a733-823f2de86aa2 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 2036 microversion: 2.25 time: 0.321144 Sep 10 10:37:33.844666 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 418/873] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:33 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 2036 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:33.873828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-856894-1", "block_migration": "auto"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:33.876387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:33.888591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:33.889175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:33.889666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:33.890435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:33.890980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:33.891305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:33.912815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c9b7a723-2cce-4b76-93c1-375d230888e5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:33.913499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c9b7a723-2cce-4b76-93c1-375d230888e5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:33.923341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9b7a723-2cce-4b76-93c1-375d230888e5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:33.923854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9b7a723-2cce-4b76-93c1-375d230888e5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:33.924181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'flavor' on Instance uuid ff5fc162-ff4a-4020-97ca-7e9960c2f455 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:37:33.924293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9b7a723-2cce-4b76-93c1-375d230888e5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:33.925017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9b7a723-2cce-4b76-93c1-375d230888e5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:33.925549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9b7a723-2cce-4b76-93c1-375d230888e5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:33.925932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9b7a723-2cce-4b76-93c1-375d230888e5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:33.963314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Going to try to live migrate instance to n-h2-856894-1 {{(pid=128787) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 10:37:34.365508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c9b7a723-2cce-4b76-93c1-375d230888e5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:34.377688 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c9b7a723-2cce-4b76-93c1-375d230888e5 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1503 microversion: 2.1 time: 0.470391 Sep 10 10:37:34.378302 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 419/874] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:33 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1503 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:34.400625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3f031f2d-79c4-4272-a21f-de70798630e9 req-e474003b-481b-4b20-a9a7-55192205bf2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d67504-0205-4bb6-b002-d53a7ca7de9b", "name": "network-vif-plugged", "status": "completed", "tag": "2c5d00d4-7c93-4f25-b2dc-6e4774aefbcf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:34.417880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3f031f2d-79c4-4272-a21f-de70798630e9 req-e474003b-481b-4b20-a9a7-55192205bf2d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:34.418476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3f031f2d-79c4-4272-a21f-de70798630e9 req-e474003b-481b-4b20-a9a7-55192205bf2d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:34.419196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3f031f2d-79c4-4272-a21f-de70798630e9 req-e474003b-481b-4b20-a9a7-55192205bf2d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:34.424593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:34.450762 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3f031f2d-79c4-4272-a21f-de70798630e9 req-e474003b-481b-4b20-a9a7-55192205bf2d service nova] Creating event network-vif-plugged:2c5d00d4-7c93-4f25-b2dc-6e4774aefbcf for instance e5d67504-0205-4bb6-b002-d53a7ca7de9b on n-h1-856894-1 Sep 10 10:37:34.477482 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3f031f2d-79c4-4272-a21f-de70798630e9 req-e474003b-481b-4b20-a9a7-55192205bf2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095424 Sep 10 10:37:34.478618 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 420/875] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:34.486979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbcf2875-5ffd-408f-b9d9-65fea9cb48da tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:34.487605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fbcf2875-5ffd-408f-b9d9-65fea9cb48da tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:34.504130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbcf2875-5ffd-408f-b9d9-65fea9cb48da tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:34.504971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbcf2875-5ffd-408f-b9d9-65fea9cb48da tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:34.505649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbcf2875-5ffd-408f-b9d9-65fea9cb48da tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:34.506745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbcf2875-5ffd-408f-b9d9-65fea9cb48da tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:34.507415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbcf2875-5ffd-408f-b9d9-65fea9cb48da tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:34.508079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbcf2875-5ffd-408f-b9d9-65fea9cb48da tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:34.586554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fbcf2875-5ffd-408f-b9d9-65fea9cb48da tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:37:34.795667 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbcf2875-5ffd-408f-b9d9-65fea9cb48da tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 204 len: 0 microversion: 2.1 time: 0.315530 Sep 10 10:37:34.802124 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 421/876] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:37:34 2022] DELETE /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:37:34.809951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d0f4966-5816-4eea-ad0b-46c473102439 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:34.816017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d0f4966-5816-4eea-ad0b-46c473102439 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:34.825628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d0f4966-5816-4eea-ad0b-46c473102439 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:34.826685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d0f4966-5816-4eea-ad0b-46c473102439 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:34.827475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d0f4966-5816-4eea-ad0b-46c473102439 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:34.828390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d0f4966-5816-4eea-ad0b-46c473102439 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:34.829105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d0f4966-5816-4eea-ad0b-46c473102439 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:34.829726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d0f4966-5816-4eea-ad0b-46c473102439 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:35.184835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6d0f4966-5816-4eea-ad0b-46c473102439 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:35.200429 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6d0f4966-5816-4eea-ad0b-46c473102439 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1316 microversion: 2.1 time: 0.396476 Sep 10 10:37:35.221388 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 422/877] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:34 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:35.230826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-267a07d9-e467-4be4-8f11-98dee11d02b4 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:35.231644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-267a07d9-e467-4be4-8f11-98dee11d02b4 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:35.239130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267a07d9-e467-4be4-8f11-98dee11d02b4 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:35.239634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267a07d9-e467-4be4-8f11-98dee11d02b4 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:35.240625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267a07d9-e467-4be4-8f11-98dee11d02b4 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:35.241384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267a07d9-e467-4be4-8f11-98dee11d02b4 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:35.241852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267a07d9-e467-4be4-8f11-98dee11d02b4 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:35.242462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267a07d9-e467-4be4-8f11-98dee11d02b4 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:35.624196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-267a07d9-e467-4be4-8f11-98dee11d02b4 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:35.636937 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-267a07d9-e467-4be4-8f11-98dee11d02b4 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1509 microversion: 2.1 time: 0.413705 Sep 10 10:37:35.638783 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 423/878] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:35 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:36.231075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c21773c8-6a93-4304-93ae-881aae2ced04 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:36.232239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c21773c8-6a93-4304-93ae-881aae2ced04 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:36.242063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c21773c8-6a93-4304-93ae-881aae2ced04 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:36.243564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c21773c8-6a93-4304-93ae-881aae2ced04 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:36.245369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c21773c8-6a93-4304-93ae-881aae2ced04 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:36.246844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c21773c8-6a93-4304-93ae-881aae2ced04 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:36.247662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c21773c8-6a93-4304-93ae-881aae2ced04 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:36.249355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c21773c8-6a93-4304-93ae-881aae2ced04 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:36.576928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c21773c8-6a93-4304-93ae-881aae2ced04 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:36.607958 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c21773c8-6a93-4304-93ae-881aae2ced04 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1316 microversion: 2.1 time: 0.383188 Sep 10 10:37:36.610114 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 424/879] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:36 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:36.662782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ed6ac1b-90cf-470c-aa58-87116fafe170 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:36.663437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6ed6ac1b-90cf-470c-aa58-87116fafe170 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:36.672093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ed6ac1b-90cf-470c-aa58-87116fafe170 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:36.672950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ed6ac1b-90cf-470c-aa58-87116fafe170 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:36.673693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ed6ac1b-90cf-470c-aa58-87116fafe170 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:36.674558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ed6ac1b-90cf-470c-aa58-87116fafe170 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:36.675828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ed6ac1b-90cf-470c-aa58-87116fafe170 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:36.676485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ed6ac1b-90cf-470c-aa58-87116fafe170 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:37.224569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6ed6ac1b-90cf-470c-aa58-87116fafe170 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:37.241679 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ed6ac1b-90cf-470c-aa58-87116fafe170 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1509 microversion: 2.1 time: 0.583925 Sep 10 10:37:37.242587 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 425/880] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:36 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1509 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:37.633547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-599da894-d7db-4700-a040-f5f01241f9e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:37.634173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-599da894-d7db-4700-a040-f5f01241f9e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:37.652787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599da894-d7db-4700-a040-f5f01241f9e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:37.653320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599da894-d7db-4700-a040-f5f01241f9e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:37.653764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599da894-d7db-4700-a040-f5f01241f9e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:37.654480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599da894-d7db-4700-a040-f5f01241f9e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:37.654943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599da894-d7db-4700-a040-f5f01241f9e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:37.655374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599da894-d7db-4700-a040-f5f01241f9e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:38.609812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-599da894-d7db-4700-a040-f5f01241f9e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:38.625313 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-599da894-d7db-4700-a040-f5f01241f9e2 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1466 microversion: 2.1 time: 0.995450 Sep 10 10:37:38.625921 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 426/881] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:37 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1466 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:38.640526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-274ff884-a75f-4d64-a000-52102266fa23 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:38.641927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-274ff884-a75f-4d64-a000-52102266fa23 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:38.679102 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d2626f15-5a09-482c-9f2b-10bbf691a175 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455/action" status: 202 len: 0 microversion: 2.25 time: 4.809581 Sep 10 10:37:38.679897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-274ff884-a75f-4d64-a000-52102266fa23 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:38.680796 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 456/882] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:37:33 2022] POST /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455/action => generated 0 bytes in 4812 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:37:38.681471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-274ff884-a75f-4d64-a000-52102266fa23 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:38.682250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-274ff884-a75f-4d64-a000-52102266fa23 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:38.683790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-274ff884-a75f-4d64-a000-52102266fa23 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:38.684980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-274ff884-a75f-4d64-a000-52102266fa23 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:38.686023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-274ff884-a75f-4d64-a000-52102266fa23 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:38.686602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-156a61ef-b0e5-4dc5-bb7a-a54ce2c0758d tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:38.688404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-156a61ef-b0e5-4dc5-bb7a-a54ce2c0758d tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:38.719454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-156a61ef-b0e5-4dc5-bb7a-a54ce2c0758d tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:38.719960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-156a61ef-b0e5-4dc5-bb7a-a54ce2c0758d tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:38.720416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-156a61ef-b0e5-4dc5-bb7a-a54ce2c0758d tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:38.721170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-156a61ef-b0e5-4dc5-bb7a-a54ce2c0758d tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:38.733400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-156a61ef-b0e5-4dc5-bb7a-a54ce2c0758d tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:38.739157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-156a61ef-b0e5-4dc5-bb7a-a54ce2c0758d tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:39.086397 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-156a61ef-b0e5-4dc5-bb7a-a54ce2c0758d tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1617 microversion: 2.1 time: 0.404057 Sep 10 10:37:39.090120 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 457/883] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:38 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1617 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:39.098533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:39.102684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:39.136143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:39.139599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:39.142776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:39.144330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:39.144995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:39.146044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:39.588473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-274ff884-a75f-4d64-a000-52102266fa23 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:39.602316 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-274ff884-a75f-4d64-a000-52102266fa23 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1509 microversion: 2.1 time: 0.971832 Sep 10 10:37:39.604319 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 427/884] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:38 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1509 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:39.612158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-244563266", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "52fb832d-13f8-4175-b047-fa651b9091da"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:39.710766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:39.735469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:39.738495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:39.739923 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7a2a54cc-7937-4145-9146-97b82f98d1af tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1568 microversion: 2.25 time: 0.648618 Sep 10 10:37:39.740898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:37:39.744132 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 458/885] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:39 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1568 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:39.853135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-b7f16a39-8449-4ccd-b5bc-6d7ff32f726f req-e3223ac0-bcae-4abb-a67a-67a322172d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5505968a-0f31-49c9-949b-43e93328561b", "name": "network-vif-deleted", "tag": "b4a4e135-2ccb-4806-8ed0-f899e206496b"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:39.883511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b7f16a39-8449-4ccd-b5bc-6d7ff32f726f req-e3223ac0-bcae-4abb-a67a-67a322172d2e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:39.884098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b7f16a39-8449-4ccd-b5bc-6d7ff32f726f req-e3223ac0-bcae-4abb-a67a-67a322172d2e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:39.887040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b7f16a39-8449-4ccd-b5bc-6d7ff32f726f req-e3223ac0-bcae-4abb-a67a-67a322172d2e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:39.933065 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-b7f16a39-8449-4ccd-b5bc-6d7ff32f726f req-e3223ac0-bcae-4abb-a67a-67a322172d2e service nova] Creating event network-vif-deleted:b4a4e135-2ccb-4806-8ed0-f899e206496b for instance 5505968a-0f31-49c9-949b-43e93328561b on n-h1-856894-1 Sep 10 10:37:39.945371 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-b7f16a39-8449-4ccd-b5bc-6d7ff32f726f req-e3223ac0-bcae-4abb-a67a-67a322172d2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107301 Sep 10 10:37:39.946289 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 459/886] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:37:40.565016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:37:40.565883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:37:40.566686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:37:40.567388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:37:40.568044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:37:40.578803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:40.579617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:40.580553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:40.581393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:40.582084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:40.583134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:40.610998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:37:40.618305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Getting quotas for user 60543e7cbbb0451bb8b1929437b2a0ea and project 357ca1336b634d0389fff733e6e26ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:37:40.628684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:40.629423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:40.639015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:37:40.639460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:40.642913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:37:40.644663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:40.648325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:40.648813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:40.653835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:40.654321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:40.654766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:40.779090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:40.780591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:40.781244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:40.781871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lazy-loading 'fault' on Instance uuid 5505968a-0f31-49c9-949b-43e93328561b {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:37:40.794956 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53dceba6-ce97-4366-993f-de5cbfe0d55d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185248 Sep 10 10:37:40.801817 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 428/887] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:37:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:37:40.814902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:40.815539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:40.842042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:40.845021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:40.845653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:40.846394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:40.846891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:40.847398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:40.938670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f46fe0ed64826baea53c3309e4e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b4ac48f7424cf18bfde0028fb844e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:40.947834 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f8567e59-65e4-4f9c-9048-711b92eff28d tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 200 len: 1305 microversion: 2.1 time: 0.323699 Sep 10 10:37:40.952725 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 460/888] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:40 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 1305 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:40.969226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e2c9db34-508b-4d09-8fc4-655dead37b17 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:40.970077 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e2c9db34-508b-4d09-8fc4-655dead37b17 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:41.179970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e2c9db34-508b-4d09-8fc4-655dead37b17 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:41.211010 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e2c9db34-508b-4d09-8fc4-655dead37b17 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1216 microversion: 2.1 time: 0.255214 Sep 10 10:37:41.214696 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 461/889] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:40 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1216 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:41.232934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-3baf228e-1090-422f-8c8b-fcd7c3255d1e req-3cec3f2b-47a7-4446-b9c5-433b048080da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5fc162-ff4a-4020-97ca-7e9960c2f455", "name": "network-vif-unplugged", "status": "completed", "tag": "7696d8d6-82d0-49c4-a65c-99ae55b6449f"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:41.260152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3baf228e-1090-422f-8c8b-fcd7c3255d1e req-3cec3f2b-47a7-4446-b9c5-433b048080da service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:41.266243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3baf228e-1090-422f-8c8b-fcd7c3255d1e req-3cec3f2b-47a7-4446-b9c5-433b048080da service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:41.266998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3baf228e-1090-422f-8c8b-fcd7c3255d1e req-3cec3f2b-47a7-4446-b9c5-433b048080da service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:41.298812 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3baf228e-1090-422f-8c8b-fcd7c3255d1e req-3cec3f2b-47a7-4446-b9c5-433b048080da service nova] Creating event network-vif-unplugged:7696d8d6-82d0-49c4-a65c-99ae55b6449f for instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 on n-h1-856894-1 Sep 10 10:37:41.340294 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-3baf228e-1090-422f-8c8b-fcd7c3255d1e req-3cec3f2b-47a7-4446-b9c5-433b048080da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112499 Sep 10 10:37:41.342427 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 462/890] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:41.587236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:41.599548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:41.601725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:41.607435 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5e027f81-10ab-4932-8cd5-4616f6838427 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1568 microversion: 2.25 time: 0.805575 Sep 10 10:37:41.608477 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 429/891] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:40 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1568 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:41.977487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:41.980180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:41.996714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:41.997602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:41.999209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.000431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.002540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.003084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.036014 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] HTTP exception thrown: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Request method failure captured: Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b HTTP/1.1 Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjYpGsozwLL2lazqKTPUPc-qfqoYQT3Ff0EVv4Db4qVlcYYsrZ00Yf9ONhSUAc4eMSbBVCg9LV17fBFq6aihmpoMw6DLoegZif40ly5AuCum-RlZrFmW3y2LU1HNM8qrLKhR8-gATThLX7RPTldZqlR841_IJRJ_Lhso55qgxH3sbc Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:42.046102 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21b4ac48f7424cf18bfde0028fb844e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 335f46fe0ed64826baea53c3309e4e97 Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.047552 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5505968a-0f31-49c9-949b-43e93328561b'} Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:42.048373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.049732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.052538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Returning 404 to user: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:42.055447 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e5e76ecf-0cb6-4143-bb56-7f449d390a42 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 404 len: 111 microversion: 2.1 time: 0.083124 Sep 10 10:37:42.061619 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 463/892] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:41 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:42.068723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1996074582", "metadata": {"image_type": "test"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:42.077760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:42.089843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.091477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.092116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.095017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.096177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.098107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.124507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] HTTP exception thrown: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Request method failure captured: Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b/action HTTP/1.1 Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 112 Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGjYpGsozwLL2lazqKTPUPc-qfqoYQT3Ff0EVv4Db4qVlcYYsrZ00Yf9ONhSUAc4eMSbBVCg9LV17fBFq6aihmpoMw6DLoegZif40ly5AuCum-RlZrFmW3y2LU1HNM8qrLKhR8-gATThLX7RPTldZqlR841_IJRJ_Lhso55qgxH3sbc Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:37:42.127594 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21b4ac48f7424cf18bfde0028fb844e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 335f46fe0ed64826baea53c3309e4e97 Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1996074582", "metadata": {"image_type": "test"}}} Sep 10 10:37:42.128881 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '5505968a-0f31-49c9-949b-43e93328561b', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1996074582', 'metadata': {'image_type': 'test'}}}} Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.129647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.131109 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.133596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.133596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:42.133596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:42.133596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.133596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.135177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Returning 404 to user: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:42.136235 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f443a768-733b-4410-b631-540100c7c99a tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "POST /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b/action" status: 404 len: 111 microversion: 2.1 time: 0.073730 Sep 10 10:37:42.137205 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 430/893] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Sep 10 10:37:42 2022] POST /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:42.152884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-21c58e64-2393-4c17-b327-8ad56770e5e2 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2067832329", "metadata": {"image_type": "test"}}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:42.155311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-21c58e64-2393-4c17-b327-8ad56770e5e2 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Failed to fetch instance by id tempest-invalid-2057000358 {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 10:37:42.155837 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-21c58e64-2393-4c17-b327-8ad56770e5e2 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] HTTP exception thrown: Instance tempest-invalid-2057000358 could not be found. Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-21c58e64-2393-4c17-b327-8ad56770e5e2 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Request method failure captured: Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/tempest-invalid-2057000358/action HTTP/1.1 Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 112 Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjYpGsozwLL2lazqKTPUPc-qfqoYQT3Ff0EVv4Db4qVlcYYsrZ00Yf9ONhSUAc4eMSbBVCg9LV17fBFq6aihmpoMw6DLoegZif40ly5AuCum-RlZrFmW3y2LU1HNM8qrLKhR8-gATThLX7RPTldZqlR841_IJRJ_Lhso55qgxH3sbc Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:42.159157 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21b4ac48f7424cf18bfde0028fb844e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 335f46fe0ed64826baea53c3309e4e97 Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2067832329", "metadata": {"image_type": "test"}}} Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:42.160458 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance tempest-invalid-2057000358 could not be found. Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'tempest-invalid-2057000358', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2067832329', 'metadata': {'image_type': 'test'}}}} Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2057000358 could not be found. Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:37:42.161315 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2057000358 could not be found. Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2057000358 could not be found. Sep 10 10:37:42.162538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.170015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-21c58e64-2393-4c17-b327-8ad56770e5e2 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Returning 404 to user: Instance tempest-invalid-2057000358 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:42.170015 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-21c58e64-2393-4c17-b327-8ad56770e5e2 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "POST /compute/v2.1/servers/tempest-invalid-2057000358/action" status: 404 len: 101 microversion: 2.1 time: 0.015333 Sep 10 10:37:42.170015 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 464/894] 10.222.0.20 () {60 vars in 1249 bytes} [Sat Sep 10 10:37:42 2022] POST /compute/v2.1/servers/tempest-invalid-2057000358/action => generated 101 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:42.187993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5fe6312-5aad-49af-a239-4d0314581e0c tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1790691958"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:42.191788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f5fe6312-5aad-49af-a239-4d0314581e0c tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 10:37:42.193056 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f5fe6312-5aad-49af-a239-4d0314581e0c tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5fe6312-5aad-49af-a239-4d0314581e0c tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Request method failure captured: Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 57 Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGjYpGsozwLL2lazqKTPUPc-qfqoYQT3Ff0EVv4Db4qVlcYYsrZ00Yf9ONhSUAc4eMSbBVCg9LV17fBFq6aihmpoMw6DLoegZif40ly5AuCum-RlZrFmW3y2LU1HNM8qrLKhR8-gATThLX7RPTldZqlR841_IJRJ_Lhso55qgxH3sbc Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:37:42.195115 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21b4ac48f7424cf18bfde0028fb844e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 335f46fe0ed64826baea53c3309e4e97 Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: {"createImage": {"name": "tempest-test-snap-1790691958"}} Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:37:42.196873 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1790691958'}}} Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:37:42.197951 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 10:37:42.199442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.203282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5fe6312-5aad-49af-a239-4d0314581e0c tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:42.204431 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f5fe6312-5aad-49af-a239-4d0314581e0c tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.035300 Sep 10 10:37:42.206584 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 431/895] 10.222.0.20 () {60 vars in 1275 bytes} [Sat Sep 10 10:37:42 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:42.215786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f76db815-3eaa-4f78-8933-b7585234ded8 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-805196236"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:42.219321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f76db815-3eaa-4f78-8933-b7585234ded8 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 10:37:42.220098 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-f76db815-3eaa-4f78-8933-b7585234ded8 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f76db815-3eaa-4f78-8933-b7585234ded8 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Request method failure captured: Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 56 Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjYpGsozwLL2lazqKTPUPc-qfqoYQT3Ff0EVv4Db4qVlcYYsrZ00Yf9ONhSUAc4eMSbBVCg9LV17fBFq6aihmpoMw6DLoegZif40ly5AuCum-RlZrFmW3y2LU1HNM8qrLKhR8-gATThLX7RPTldZqlR841_IJRJ_Lhso55qgxH3sbc Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:42.221985 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21b4ac48f7424cf18bfde0028fb844e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 335f46fe0ed64826baea53c3309e4e97 Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: {"createImage": {"name": "tempest-test-snap-805196236"}} Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:42.223329 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-805196236'}}} Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:37:42.224114 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 10:37:42.225317 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.228772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f76db815-3eaa-4f78-8933-b7585234ded8 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:42.229886 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f76db815-3eaa-4f78-8933-b7585234ded8 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.018402 Sep 10 10:37:42.231564 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 465/896] 10.222.0.20 () {60 vars in 1281 bytes} [Sat Sep 10 10:37:42 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:42.245421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:42.246468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:42.248757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-212b3b8a-b4ac-4bfb-bd8f-9206f2fb8e10 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:42.250442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-212b3b8a-b4ac-4bfb-bd8f-9206f2fb8e10 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:42.257809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.258449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.259169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.260621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.261346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.261996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.277477 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] HTTP exception thrown: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Request method failure captured: Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b HTTP/1.1 Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjYpGsozwLL2lazqKTPUPc-qfqoYQT3Ff0EVv4Db4qVlcYYsrZ00Yf9ONhSUAc4eMSbBVCg9LV17fBFq6aihmpoMw6DLoegZif40ly5AuCum-RlZrFmW3y2LU1HNM8qrLKhR8-gATThLX7RPTldZqlR841_IJRJ_Lhso55qgxH3sbc Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:42.279237 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21b4ac48f7424cf18bfde0028fb844e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 335f46fe0ed64826baea53c3309e4e97 Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.280999 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5505968a-0f31-49c9-949b-43e93328561b'} Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:42.281934 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.283566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.284890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Returning 404 to user: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:42.284986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-212b3b8a-b4ac-4bfb-bd8f-9206f2fb8e10 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.285103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-212b3b8a-b4ac-4bfb-bd8f-9206f2fb8e10 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.286019 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9a9e7bed-1ef7-43b7-91cd-c5d1ae71b890 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 404 len: 111 microversion: 2.1 time: 0.048986 Sep 10 10:37:42.286701 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 466/897] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:37:42 2022] DELETE /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:37:42.287902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-212b3b8a-b4ac-4bfb-bd8f-9206f2fb8e10 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.293556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-212b3b8a-b4ac-4bfb-bd8f-9206f2fb8e10 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.294537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-212b3b8a-b4ac-4bfb-bd8f-9206f2fb8e10 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.295161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-212b3b8a-b4ac-4bfb-bd8f-9206f2fb8e10 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.295831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:42.296815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] [instance: 5505968a-0f31-49c9-949b-43e93328561b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:42.304121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.305252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.305252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.306713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.307329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.307848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.326186 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] HTTP exception thrown: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Request method failure captured: Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b HTTP/1.1 Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGjYpGsozwLL2lazqKTPUPc-qfqoYQT3Ff0EVv4Db4qVlcYYsrZ00Yf9ONhSUAc4eMSbBVCg9LV17fBFq6aihmpoMw6DLoegZif40ly5AuCum-RlZrFmW3y2LU1HNM8qrLKhR8-gATThLX7RPTldZqlR841_IJRJ_Lhso55qgxH3sbc Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:37:42.328616 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21b4ac48f7424cf18bfde0028fb844e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21b4ac48f7424cf18bfde0028fb844e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 21b4ac48f7424cf18bfde0028fb844e0 Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-210538945 Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 335f46fe0ed64826baea53c3309e4e97 Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ImagesNegativeTestJSON-210538945-project Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.330148 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5505968a-0f31-49c9-949b-43e93328561b'} Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:37:42.332062 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. Sep 10 10:37:42.333247 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:37:42.334297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] Returning 404 to user: Instance 5505968a-0f31-49c9-949b-43e93328561b could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:37:42.334297 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-33170174-bb6c-49c0-be50-992a0e8abb17 tempest-ImagesNegativeTestJSON-210538945 tempest-ImagesNegativeTestJSON-210538945-project] 10.222.0.20 "GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b" status: 404 len: 111 microversion: 2.1 time: 0.041456 Sep 10 10:37:42.338604 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 467/898] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:42 2022] GET /compute/v2.1/servers/5505968a-0f31-49c9-949b-43e93328561b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:37:42.638582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:42.639571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:42.647757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.648948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.653537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.654582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:42.655454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:42.656195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:42.676399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-212b3b8a-b4ac-4bfb-bd8f-9206f2fb8e10 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:42.699880 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-212b3b8a-b4ac-4bfb-bd8f-9206f2fb8e10 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1268 microversion: 2.1 time: 0.463984 Sep 10 10:37:42.700498 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 432/899] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:42 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1268 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:43.284884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:43.298001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:43.299536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:43.300744 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-27e68c56-4237-4b7b-98d4-c70b4e3e74e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1568 microversion: 2.25 time: 0.666629 Sep 10 10:37:43.305736 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 468/900] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:42 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1568 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:43.421802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-dc0d080b-c23c-4cc1-95b1-aa61d8d06780 req-78824e04-32ee-4ccb-9f12-d10e93077b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5fc162-ff4a-4020-97ca-7e9960c2f455", "tag": "7696d8d6-82d0-49c4-a65c-99ae55b6449f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:43.469891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dc0d080b-c23c-4cc1-95b1-aa61d8d06780 req-78824e04-32ee-4ccb-9f12-d10e93077b7e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:43.480862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dc0d080b-c23c-4cc1-95b1-aa61d8d06780 req-78824e04-32ee-4ccb-9f12-d10e93077b7e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:43.485939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dc0d080b-c23c-4cc1-95b1-aa61d8d06780 req-78824e04-32ee-4ccb-9f12-d10e93077b7e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:43.520272 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-dc0d080b-c23c-4cc1-95b1-aa61d8d06780 req-78824e04-32ee-4ccb-9f12-d10e93077b7e service nova] Creating event network-changed:7696d8d6-82d0-49c4-a65c-99ae55b6449f for instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 on n-h1-856894-1 Sep 10 10:37:43.535303 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-dc0d080b-c23c-4cc1-95b1-aa61d8d06780 req-78824e04-32ee-4ccb-9f12-d10e93077b7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117186 Sep 10 10:37:43.547844 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 433/901] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:43.727435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d06c6ec5-7a6d-4d72-aac0-51c0af27a6e8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:43.728579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d06c6ec5-7a6d-4d72-aac0-51c0af27a6e8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:43.738788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d06c6ec5-7a6d-4d72-aac0-51c0af27a6e8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:43.739166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d06c6ec5-7a6d-4d72-aac0-51c0af27a6e8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:43.739611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d06c6ec5-7a6d-4d72-aac0-51c0af27a6e8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:43.740556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d06c6ec5-7a6d-4d72-aac0-51c0af27a6e8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:43.741021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d06c6ec5-7a6d-4d72-aac0-51c0af27a6e8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:43.749550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d06c6ec5-7a6d-4d72-aac0-51c0af27a6e8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:43.921431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d06c6ec5-7a6d-4d72-aac0-51c0af27a6e8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:43.944733 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d06c6ec5-7a6d-4d72-aac0-51c0af27a6e8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1274 microversion: 2.1 time: 0.221117 Sep 10 10:37:43.952624 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 469/902] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:43 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:44.335556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:44.336277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:44.348473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:44.360717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:44.364309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:44.366050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:44.366547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:44.366991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:44.975657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0a8555f4-ec03-47df-8bb6-0fdc26fc5f28 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:44.976223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0a8555f4-ec03-47df-8bb6-0fdc26fc5f28 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:44.987469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8555f4-ec03-47df-8bb6-0fdc26fc5f28 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:44.991487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8555f4-ec03-47df-8bb6-0fdc26fc5f28 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:44.992094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8555f4-ec03-47df-8bb6-0fdc26fc5f28 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:44.993336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8555f4-ec03-47df-8bb6-0fdc26fc5f28 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:44.994407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8555f4-ec03-47df-8bb6-0fdc26fc5f28 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:44.994834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8555f4-ec03-47df-8bb6-0fdc26fc5f28 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:45.775959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0a8555f4-ec03-47df-8bb6-0fdc26fc5f28 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:45.791765 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0a8555f4-ec03-47df-8bb6-0fdc26fc5f28 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1316 microversion: 2.1 time: 0.820048 Sep 10 10:37:45.797917 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 470/903] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:44 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1316 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:46.060502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:46.078038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:46.087237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:46.093721 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc2849f4-8750-49d8-9249-0c6676ddcfe5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1568 microversion: 2.25 time: 1.762527 Sep 10 10:37:46.096394 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 434/904] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:44 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1568 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:46.827465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-51ad5fa6-f420-4293-b06b-d45ed49a936f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:46.828815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-51ad5fa6-f420-4293-b06b-d45ed49a936f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:46.840084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51ad5fa6-f420-4293-b06b-d45ed49a936f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:46.845216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51ad5fa6-f420-4293-b06b-d45ed49a936f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:46.846129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51ad5fa6-f420-4293-b06b-d45ed49a936f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:46.847107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51ad5fa6-f420-4293-b06b-d45ed49a936f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:46.852345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51ad5fa6-f420-4293-b06b-d45ed49a936f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:46.853651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51ad5fa6-f420-4293-b06b-d45ed49a936f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:47.126273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:47.127520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:47.159477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:47.160331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:47.161084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:47.174977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:47.181616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:47.191785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:47.826302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:47.852352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:47.853939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:47.866144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a62f6b1f-4992-4c28-9f9b-c199f7b2e29f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1568 microversion: 2.25 time: 0.733896 Sep 10 10:37:47.866863 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 435/905] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:47 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1568 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:37:48.005716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-51ad5fa6-f420-4293-b06b-d45ed49a936f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:48.029870 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-51ad5fa6-f420-4293-b06b-d45ed49a936f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1316 microversion: 2.1 time: 1.210140 Sep 10 10:37:48.057288 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 471/906] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:46 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1316 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:48.904201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:48.906046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:48.930273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:48.932085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:48.935601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:48.936590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:48.938223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:48.939238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:49.075601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9c202ea3-f603-4ec3-a905-0fa369a7011e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:49.076922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9c202ea3-f603-4ec3-a905-0fa369a7011e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:49.097003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c202ea3-f603-4ec3-a905-0fa369a7011e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:49.101005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c202ea3-f603-4ec3-a905-0fa369a7011e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:49.104089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c202ea3-f603-4ec3-a905-0fa369a7011e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:49.105126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c202ea3-f603-4ec3-a905-0fa369a7011e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:49.107193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c202ea3-f603-4ec3-a905-0fa369a7011e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:49.107865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c202ea3-f603-4ec3-a905-0fa369a7011e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:49.564766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9c202ea3-f603-4ec3-a905-0fa369a7011e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:49.588793 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9c202ea3-f603-4ec3-a905-0fa369a7011e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1316 microversion: 2.1 time: 0.512958 Sep 10 10:37:49.611808 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 472/907] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:49 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:49.614210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:49.628502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:49.640883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:49.651761 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1c3173a-4992-4c20-8758-1a1b827ec24f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1568 microversion: 2.25 time: 0.749693 Sep 10 10:37:49.653618 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 436/908] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:48 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1568 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:49.701101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-56ba2cc7-1a3d-4e81-98a7-bc8ba3873bf5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2017e569-0149-4da6-8d7f-ef3fc7308081"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:49.706766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-56ba2cc7-1a3d-4e81-98a7-bc8ba3873bf5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:49.722903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56ba2cc7-1a3d-4e81-98a7-bc8ba3873bf5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:49.727151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56ba2cc7-1a3d-4e81-98a7-bc8ba3873bf5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:49.728591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56ba2cc7-1a3d-4e81-98a7-bc8ba3873bf5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:49.730805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56ba2cc7-1a3d-4e81-98a7-bc8ba3873bf5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:49.734585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56ba2cc7-1a3d-4e81-98a7-bc8ba3873bf5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:49.736551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56ba2cc7-1a3d-4e81-98a7-bc8ba3873bf5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:49.785441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:49.884108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b0bb2b9e-696a-457f-9cf0-309f6448c929 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5019786-8cf8-4c30-a2f7-f740d971a763"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:49.893445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b0bb2b9e-696a-457f-9cf0-309f6448c929 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:49.922530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0bb2b9e-696a-457f-9cf0-309f6448c929 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:49.924611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0bb2b9e-696a-457f-9cf0-309f6448c929 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:49.927961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0bb2b9e-696a-457f-9cf0-309f6448c929 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:49.929182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0bb2b9e-696a-457f-9cf0-309f6448c929 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:49.933236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0bb2b9e-696a-457f-9cf0-309f6448c929 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:49.933950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0bb2b9e-696a-457f-9cf0-309f6448c929 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:50.596650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:50.632410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=10 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:50.682953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:50.755377 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b0bb2b9e-696a-457f-9cf0-309f6448c929 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "POST /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875154 Sep 10 10:37:50.759191 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 437/909] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 10:37:49 2022] POST /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments => generated 194 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:50.801352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-af3e3809-01e6-4488-8b30-46fdf47f7993 req-95184cd8-00ba-4c45-8574-5d4ce338d916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65a6dc23-ba5c-4362-a927-9f20d0ba5bf3", "tag": "d964ee68-1797-460c-b363-8855a33bf48d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:50.819081 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-56ba2cc7-1a3d-4e81-98a7-bc8ba3873bf5 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "POST /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.130983 Sep 10 10:37:50.820425 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 473/910] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 10:37:49 2022] POST /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-volume_attachments => generated 194 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:50.824937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-af3e3809-01e6-4488-8b30-46fdf47f7993 req-95184cd8-00ba-4c45-8574-5d4ce338d916 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:50.826141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-af3e3809-01e6-4488-8b30-46fdf47f7993 req-95184cd8-00ba-4c45-8574-5d4ce338d916 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:50.835582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-af3e3809-01e6-4488-8b30-46fdf47f7993 req-95184cd8-00ba-4c45-8574-5d4ce338d916 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:50.839494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3400cf98-a76f-4601-9a2e-aaa7a06e7747 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:50.845423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3400cf98-a76f-4601-9a2e-aaa7a06e7747 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:50.871368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3400cf98-a76f-4601-9a2e-aaa7a06e7747 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:50.872019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3400cf98-a76f-4601-9a2e-aaa7a06e7747 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:50.872606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3400cf98-a76f-4601-9a2e-aaa7a06e7747 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:50.874341 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-af3e3809-01e6-4488-8b30-46fdf47f7993 req-95184cd8-00ba-4c45-8574-5d4ce338d916 service nova] Creating event network-changed:d964ee68-1797-460c-b363-8855a33bf48d for instance 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 on n-h2-856894-1 Sep 10 10:37:50.874495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3400cf98-a76f-4601-9a2e-aaa7a06e7747 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:50.876217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3400cf98-a76f-4601-9a2e-aaa7a06e7747 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:50.876768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3400cf98-a76f-4601-9a2e-aaa7a06e7747 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:50.880723 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-af3e3809-01e6-4488-8b30-46fdf47f7993 req-95184cd8-00ba-4c45-8574-5d4ce338d916 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102690 Sep 10 10:37:50.882194 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 438/911] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:50.892312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:50.893926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:50.902139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:50.903214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:50.903830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:50.907449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:50.908345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:50.908935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:51.199948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:51.416004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:51.429342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:51.430969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:51.432189 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c29022e5-8170-4eee-ac8d-e849c236ee3d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1568 microversion: 2.25 time: 0.548767 Sep 10 10:37:51.432764 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 439/912] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:50 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1568 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:51.797885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3400cf98-a76f-4601-9a2e-aaa7a06e7747 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:51.812622 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3400cf98-a76f-4601-9a2e-aaa7a06e7747 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1316 microversion: 2.1 time: 0.989534 Sep 10 10:37:51.813335 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 474/913] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:50 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1316 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:52.459903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:52.461621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:52.470647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:52.471378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:52.472200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:52.473583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:52.474307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:52.474896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:52.840160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e510fb00-f348-4c76-a6d2-f9e0ba1a00b7 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:52.841548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e510fb00-f348-4c76-a6d2-f9e0ba1a00b7 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:52.854001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e510fb00-f348-4c76-a6d2-f9e0ba1a00b7 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:52.857808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e510fb00-f348-4c76-a6d2-f9e0ba1a00b7 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:52.859392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e510fb00-f348-4c76-a6d2-f9e0ba1a00b7 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:52.860312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e510fb00-f348-4c76-a6d2-f9e0ba1a00b7 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:52.865791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e510fb00-f348-4c76-a6d2-f9e0ba1a00b7 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:52.866532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e510fb00-f348-4c76-a6d2-f9e0ba1a00b7 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:52.945965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:52.961629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:52.964201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:52.965912 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c1dd24d-0b77-46c5-8711-69fea26be1be tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1568 microversion: 2.25 time: 0.511015 Sep 10 10:37:52.969847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 440/914] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:52 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1568 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:53.408953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e510fb00-f348-4c76-a6d2-f9e0ba1a00b7 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:53.419622 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e510fb00-f348-4c76-a6d2-f9e0ba1a00b7 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1316 microversion: 2.1 time: 0.581447 Sep 10 10:37:53.423242 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 475/915] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:52 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:53.755794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-734940862", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "a982d658-1052-468f-9779-6bee76fe373a"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:53.902049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] validate_networks() for [('a982d658-1052-468f-9779-6bee76fe373a', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:37:53.999796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:54.000428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:54.025002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:54.034015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:54.041951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:54.043082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:54.043740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:54.045044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:54.461606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:54.482686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:54.487820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:54.489383 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bc72f0a1-2ba9-48a5-a729-765ed7517281 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1568 microversion: 2.25 time: 0.494118 Sep 10 10:37:54.490935 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 476/916] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:53 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1568 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:54.498104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5ad61aab-134f-48bc-84c3-ec5c37fa161e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:54.498980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5ad61aab-134f-48bc-84c3-ec5c37fa161e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:54.505935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ad61aab-134f-48bc-84c3-ec5c37fa161e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:54.507106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ad61aab-134f-48bc-84c3-ec5c37fa161e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:54.507771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ad61aab-134f-48bc-84c3-ec5c37fa161e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:54.512960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ad61aab-134f-48bc-84c3-ec5c37fa161e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:54.513872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ad61aab-134f-48bc-84c3-ec5c37fa161e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:54.514387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ad61aab-134f-48bc-84c3-ec5c37fa161e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:54.927945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5ad61aab-134f-48bc-84c3-ec5c37fa161e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:54.936651 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5ad61aab-134f-48bc-84c3-ec5c37fa161e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1316 microversion: 2.1 time: 0.443779 Sep 10 10:37:54.937184 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 477/917] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:54 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:55.373795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:37:55.374377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:37:55.374690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:37:55.375301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:37:55.375899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:37:55.404189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:55.404662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:55.407170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:55.411194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:55.411675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:55.412120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:55.477464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Getting quotas for project 349a486eb0c34b76b50169c1dbe6b11f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:37:55.502132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Getting quotas for user dd1f2852ff4a4a4fb199977ad4cf82d2 and project 349a486eb0c34b76b50169c1dbe6b11f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:37:55.520036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:55.520668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:55.521804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:37:55.524329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:37:55.534935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:55.536277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:55.536902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:55.538368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:55.539012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:55.539606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:55.585889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:37:55.622063 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-55d66da7-217d-441c-82e8-4c69a8d6592f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.150668 Sep 10 10:37:55.624315 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 441/918] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:37:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:37:55.636211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-254cd159-9677-4de5-af6a-d5b11efe18a6 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:55.637130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-254cd159-9677-4de5-af6a-d5b11efe18a6 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:55.856132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-254cd159-9677-4de5-af6a-d5b11efe18a6 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:55.879324 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-254cd159-9677-4de5-af6a-d5b11efe18a6 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1223 microversion: 2.1 time: 0.247123 Sep 10 10:37:55.886338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 442/919] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:55 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1223 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:55.966299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c72bc34c-d6ce-42cd-b0c2-57509802c05f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:55.966924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c72bc34c-d6ce-42cd-b0c2-57509802c05f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:55.978908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c72bc34c-d6ce-42cd-b0c2-57509802c05f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:55.979412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c72bc34c-d6ce-42cd-b0c2-57509802c05f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:55.986296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c72bc34c-d6ce-42cd-b0c2-57509802c05f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:55.994925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c72bc34c-d6ce-42cd-b0c2-57509802c05f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:55.995718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c72bc34c-d6ce-42cd-b0c2-57509802c05f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:55.998429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c72bc34c-d6ce-42cd-b0c2-57509802c05f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:56.026575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:56.035847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:56.047903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:56.049336 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-35094d18-9db8-4869-92e7-60c632dff7d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1543 microversion: 2.25 time: 0.533357 Sep 10 10:37:56.055375 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 478/920] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:55 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1543 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:37:56.080623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1c5dffc3-5872-46b6-9368-66202a6904a8 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '.version_select at 0x7efcaec2ce50>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:56.084297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c5dffc3-5872-46b6-9368-66202a6904a8 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:56.084622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c5dffc3-5872-46b6-9368-66202a6904a8 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:56.085093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c5dffc3-5872-46b6-9368-66202a6904a8 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:56.111231 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1c5dffc3-5872-46b6-9368-66202a6904a8 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.034236 Sep 10 10:37:56.119639 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 479/921] 10.222.0.20 () {60 vars in 1184 bytes} [Sat Sep 10 10:37:56 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:56.142698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-33c98ded-d484-4694-859a-1f231cc4c722 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:56.143363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-33c98ded-d484-4694-859a-1f231cc4c722 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:56.154913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33c98ded-d484-4694-859a-1f231cc4c722 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:56.155419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33c98ded-d484-4694-859a-1f231cc4c722 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:56.155863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33c98ded-d484-4694-859a-1f231cc4c722 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:56.156651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33c98ded-d484-4694-859a-1f231cc4c722 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:56.157033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33c98ded-d484-4694-859a-1f231cc4c722 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:56.157521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33c98ded-d484-4694-859a-1f231cc4c722 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:56.497810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-33c98ded-d484-4694-859a-1f231cc4c722 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid ff5fc162-ff4a-4020-97ca-7e9960c2f455 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:37:56.528092 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-33c98ded-d484-4694-859a-1f231cc4c722 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 2036 microversion: 2.25 time: 0.401698 Sep 10 10:37:56.529663 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 480/922] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:37:56 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 2036 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:37:56.575964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-59217077-0500-45aa-8fa8-2766c8527d23 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Action: 'create', calling method: .version_select at 0x7efcaefecc10>, body: {"keypair": {"name": "tempest-keypair-1091877618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTyYQS1aK+DEB/kpJAW//iyWRYj+v5w1sPftNMkPwS+FoQVsqBTRTi4X8ZqlpVp/SXQcKLj3MC6XdwgvfNeLWbjiuhzg8Jq7RQ6ZinO41B1q/4ZW4vuiO+FuI/z+jmi7g=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:56.623652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-59217077-0500-45aa-8fa8-2766c8527d23 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Getting quotas for project 9c2ac1f5c5c843fc89294292d4489252. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:37:56.643853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-59217077-0500-45aa-8fa8-2766c8527d23 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Getting quotas for user 362b727b96934e58b180727eaad35e3b and project 9c2ac1f5c5c843fc89294292d4489252. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:37:56.686258 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-59217077-0500-45aa-8fa8-2766c8527d23 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.114602 Sep 10 10:37:56.687510 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 481/923] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Sep 10 10:37:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 10:37:56.739202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c72bc34c-d6ce-42cd-b0c2-57509802c05f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:56.755580 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c72bc34c-d6ce-42cd-b0c2-57509802c05f tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1316 microversion: 2.1 time: 0.791854 Sep 10 10:37:56.756674 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 443/924] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:55 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:56.912901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0ef5ac25-5bb9-4f20-8ae4-8b5bcb7bb71e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:56.914180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0ef5ac25-5bb9-4f20-8ae4-8b5bcb7bb71e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:57.082993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0ef5ac25-5bb9-4f20-8ae4-8b5bcb7bb71e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:57.100516 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0ef5ac25-5bb9-4f20-8ae4-8b5bcb7bb71e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1223 microversion: 2.1 time: 0.196696 Sep 10 10:37:57.103474 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 482/925] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:56 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1223 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:57.786106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eca797e7-b366-4041-a1b7-02c014692d2a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:57.786946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eca797e7-b366-4041-a1b7-02c014692d2a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:57.802614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eca797e7-b366-4041-a1b7-02c014692d2a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:57.803140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eca797e7-b366-4041-a1b7-02c014692d2a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:57.803591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eca797e7-b366-4041-a1b7-02c014692d2a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:57.804313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eca797e7-b366-4041-a1b7-02c014692d2a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:57.812441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eca797e7-b366-4041-a1b7-02c014692d2a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:57.814488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eca797e7-b366-4041-a1b7-02c014692d2a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:58.129669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8d180e00-a922-4cf9-bfe2-65068a7035e8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:58.130585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8d180e00-a922-4cf9-bfe2-65068a7035e8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:58.143663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d180e00-a922-4cf9-bfe2-65068a7035e8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:58.144229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d180e00-a922-4cf9-bfe2-65068a7035e8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:58.144857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d180e00-a922-4cf9-bfe2-65068a7035e8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:58.145757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d180e00-a922-4cf9-bfe2-65068a7035e8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:58.146289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d180e00-a922-4cf9-bfe2-65068a7035e8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:58.146785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d180e00-a922-4cf9-bfe2-65068a7035e8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:58.335039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eca797e7-b366-4041-a1b7-02c014692d2a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:58.343730 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eca797e7-b366-4041-a1b7-02c014692d2a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1316 microversion: 2.1 time: 0.563049 Sep 10 10:37:58.344365 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 444/926] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:57 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1316 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:58.406483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8d180e00-a922-4cf9-bfe2-65068a7035e8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:58.433980 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8d180e00-a922-4cf9-bfe2-65068a7035e8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1275 microversion: 2.1 time: 0.309461 Sep 10 10:37:58.436630 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 483/927] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:58 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1275 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:37:59.370399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0331246f-2a9a-4d9f-83dd-b97b877b6200 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:59.371865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0331246f-2a9a-4d9f-83dd-b97b877b6200 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:59.390642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331246f-2a9a-4d9f-83dd-b97b877b6200 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:59.391489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331246f-2a9a-4d9f-83dd-b97b877b6200 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:59.392288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331246f-2a9a-4d9f-83dd-b97b877b6200 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:59.395533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331246f-2a9a-4d9f-83dd-b97b877b6200 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:59.397040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331246f-2a9a-4d9f-83dd-b97b877b6200 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:59.398365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0331246f-2a9a-4d9f-83dd-b97b877b6200 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:59.752470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-79cfc0ff-48fa-4b73-81e0-a502eb95af92 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-582679256", "ram": 512, "vcpus": 1, "disk": 10, "id": 1098973248, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:37:59.810318 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-79cfc0ff-48fa-4b73-81e0-a502eb95af92 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.405977 Sep 10 10:37:59.823878 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 484/928] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:37:59 2022] POST /compute/v2.1/flavors => generated 415 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:37:59.833875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0331246f-2a9a-4d9f-83dd-b97b877b6200 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:37:59.838390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9443b1de-b796-4305-9d58-07ac2c2637c8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:37:59.840317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9443b1de-b796-4305-9d58-07ac2c2637c8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:37:59.843283 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0331246f-2a9a-4d9f-83dd-b97b877b6200 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1316 microversion: 2.1 time: 0.476756 Sep 10 10:37:59.860194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9443b1de-b796-4305-9d58-07ac2c2637c8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:59.860677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9443b1de-b796-4305-9d58-07ac2c2637c8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:59.861554 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 445/929] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:59 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:37:59.862168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9443b1de-b796-4305-9d58-07ac2c2637c8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:37:59.863072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9443b1de-b796-4305-9d58-07ac2c2637c8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:37:59.863529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9443b1de-b796-4305-9d58-07ac2c2637c8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:37:59.864134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9443b1de-b796-4305-9d58-07ac2c2637c8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:00.058285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9443b1de-b796-4305-9d58-07ac2c2637c8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:00.083190 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9443b1de-b796-4305-9d58-07ac2c2637c8 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1281 microversion: 2.1 time: 0.253662 Sep 10 10:38:00.088514 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 485/930] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:37:59 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1281 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:00.111816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-22d41fa3-405c-4df5-bc9c-c5ecc63f3424 req-a0f1510c-d0f6-4ba1-99d7-a8f20f728f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a6dc23-ba5c-4362-a927-9f20d0ba5bf3", "name": "network-vif-plugged", "status": "completed", "tag": "d964ee68-1797-460c-b363-8855a33bf48d"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:00.128872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-22d41fa3-405c-4df5-bc9c-c5ecc63f3424 req-a0f1510c-d0f6-4ba1-99d7-a8f20f728f40 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:00.129862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-22d41fa3-405c-4df5-bc9c-c5ecc63f3424 req-a0f1510c-d0f6-4ba1-99d7-a8f20f728f40 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:00.130470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-22d41fa3-405c-4df5-bc9c-c5ecc63f3424 req-a0f1510c-d0f6-4ba1-99d7-a8f20f728f40 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:00.155124 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-22d41fa3-405c-4df5-bc9c-c5ecc63f3424 req-a0f1510c-d0f6-4ba1-99d7-a8f20f728f40 service nova] Creating event network-vif-plugged:d964ee68-1797-460c-b363-8855a33bf48d for instance 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 on n-h2-856894-1 Sep 10 10:38:00.161229 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-22d41fa3-405c-4df5-bc9c-c5ecc63f3424 req-a0f1510c-d0f6-4ba1-99d7-a8f20f728f40 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055293 Sep 10 10:38:00.162450 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 486/931] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:38:00.273175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-674eddba-3948-4829-80e5-1b91c8108b45 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:00.294373 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-674eddba-3948-4829-80e5-1b91c8108b45 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] HTTP exception thrown: Flavor 1098973248 has no extra specs with key hw:cpu_thread_policy. Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-674eddba-3948-4829-80e5-1b91c8108b45 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Request method failure captured: Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/flavors/1098973248/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkFIgfJtByOtTYo_eNXjbCSrXM_DdYWYbC5JXbZVckagYuL_JKhAhMX6qxfF3nkcRsACaBbRSINssB2As8iEIGsLfP7OeniUee3OIa6t4deQvSA38OMRbm6jDUfX3nfnwXja0z9bf3R3XwLhs7A9oHYj-5PieUA0T8P8_G2XyjBto4 Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 7e1ebf131e0f49b78c2f081de9cad6bd Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:00.308358 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e1ebf131e0f49b78c2f081de9cad6bd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 7e1ebf131e0f49b78c2f081de9cad6bd Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: a510340459844a0d8f7c0d9cb0d3a128 Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:00.310115 n-d-856894-1 devstack@n-api.service[128788]: exception: Flavor 1098973248 has no extra specs with key hw:cpu_thread_policy. Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'flavor_id': '1098973248', 'id': 'hw:cpu_thread_policy'} Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1098973248 has no extra specs with key hw:cpu_thread_policy. Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.311000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.312564 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.312564 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.312564 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.312564 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:00.312564 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:00.312564 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1098973248 has no extra specs with key hw:cpu_thread_policy. Sep 10 10:38:00.312564 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.315703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-674eddba-3948-4829-80e5-1b91c8108b45 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Returning 404 to user: Flavor 1098973248 has no extra specs with key hw:cpu_thread_policy. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:00.317118 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-674eddba-3948-4829-80e5-1b91c8108b45 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] 10.222.0.20 "GET /compute/v2.1/flavors/1098973248/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.454007 Sep 10 10:38:00.319326 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 446/932] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:37:59 2022] GET /compute/v2.1/flavors/1098973248/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:00.330535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-95685494-4c19-4ffb-9028-07b1c2dad46a tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:00.337868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-95685494-4c19-4ffb-9028-07b1c2dad46a tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a510340459844a0d8f7c0d9cb0d3a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ebf131e0f49b78c2f081de9cad6bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-95685494-4c19-4ffb-9028-07b1c2dad46a tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Request method failure captured: Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/flavors/1098973248/os-extra_specs HTTP/1.1 Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 66 Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGkFIgfJtByOtTYo_eNXjbCSrXM_DdYWYbC5JXbZVckagYuL_JKhAhMX6qxfF3nkcRsACaBbRSINssB2As8iEIGsLfP7OeniUee3OIa6t4deQvSA38OMRbm6jDUfX3nfnwXja0z9bf3R3XwLhs7A9oHYj-5PieUA0T8P8_G2XyjBto4 Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 7e1ebf131e0f49b78c2f081de9cad6bd Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:38:00.345387 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e1ebf131e0f49b78c2f081de9cad6bd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 7e1ebf131e0f49b78c2f081de9cad6bd Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: a510340459844a0d8f7c0d9cb0d3a128 Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 10 10:38:00.346814 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'flavor_id': '1098973248', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:38:00.347566 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 10 10:38:00.348732 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.354139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-95685494-4c19-4ffb-9028-07b1c2dad46a tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:00.356094 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-95685494-4c19-4ffb-9028-07b1c2dad46a tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] 10.222.0.20 "POST /compute/v2.1/flavors/1098973248/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.030016 Sep 10 10:38:00.361147 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 487/933] 10.222.0.20 () {60 vars in 1224 bytes} [Sat Sep 10 10:38:00 2022] POST /compute/v2.1/flavors/1098973248/os-extra_specs => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:00.366159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a49a283f-cd2e-4dac-9ea3-37b9834cb829 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:00.450383 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a49a283f-cd2e-4dac-9ea3-37b9834cb829 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1098973248/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078705 Sep 10 10:38:00.452319 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 447/934] 10.222.0.20 () {60 vars in 1224 bytes} [Sat Sep 10 10:38:00 2022] POST /compute/v2.1/flavors/1098973248/os-extra_specs => generated 66 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:38:00.466709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbd7612a-771c-4d50-8260-0c477904ed11 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:00.468251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbd7612a-771c-4d50-8260-0c477904ed11 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a510340459844a0d8f7c0d9cb0d3a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ebf131e0f49b78c2f081de9cad6bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbd7612a-771c-4d50-8260-0c477904ed11 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Request method failure captured: Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkFIgfJtByOtTYo_eNXjbCSrXM_DdYWYbC5JXbZVckagYuL_JKhAhMX6qxfF3nkcRsACaBbRSINssB2As8iEIGsLfP7OeniUee3OIa6t4deQvSA38OMRbm6jDUfX3nfnwXja0z9bf3R3XwLhs7A9oHYj-5PieUA0T8P8_G2XyjBto4 Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 7e1ebf131e0f49b78c2f081de9cad6bd Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:00.470487 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e1ebf131e0f49b78c2f081de9cad6bd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 7e1ebf131e0f49b78c2f081de9cad6bd Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: a510340459844a0d8f7c0d9cb0d3a128 Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:00.474461 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'flavor_id': '1098973248', 'id': 'hw:numa_nodes'} Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:38:00.475160 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.476389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbd7612a-771c-4d50-8260-0c477904ed11 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:00.479028 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbd7612a-771c-4d50-8260-0c477904ed11 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] 10.222.0.20 "DELETE /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012067 Sep 10 10:38:00.479028 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 448/935] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:38:00 2022] DELETE /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:00.484514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1ddc2fd3-d1e4-467f-9c48-3cf10b7bb5c1 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:00.518203 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1ddc2fd3-d1e4-467f-9c48-3cf10b7bb5c1 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1098973248/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038260 Sep 10 10:38:00.530896 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 449/936] 10.222.0.20 () {60 vars in 1224 bytes} [Sat Sep 10 10:38:00 2022] POST /compute/v2.1/flavors/1098973248/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:38:00.536778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f4dc1edc-9466-46a6-90d6-5f3a58f75e89 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:00.541431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f4dc1edc-9466-46a6-90d6-5f3a58f75e89 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a510340459844a0d8f7c0d9cb0d3a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ebf131e0f49b78c2f081de9cad6bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f4dc1edc-9466-46a6-90d6-5f3a58f75e89 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Request method failure captured: Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 22 Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkFIgfJtByOtTYo_eNXjbCSrXM_DdYWYbC5JXbZVckagYuL_JKhAhMX6qxfF3nkcRsACaBbRSINssB2As8iEIGsLfP7OeniUee3OIa6t4deQvSA38OMRbm6jDUfX3nfnwXja0z9bf3R3XwLhs7A9oHYj-5PieUA0T8P8_G2XyjBto4 Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 7e1ebf131e0f49b78c2f081de9cad6bd Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:00.543626 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e1ebf131e0f49b78c2f081de9cad6bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e1ebf131e0f49b78c2f081de9cad6bd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 7e1ebf131e0f49b78c2f081de9cad6bd Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: a510340459844a0d8f7c0d9cb0d3a128 Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: {"hw:numa_nodes": "1"} Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:00.545103 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'flavor_id': '1098973248', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:38:00.545943 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 10 10:38:00.547245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.548423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f4dc1edc-9466-46a6-90d6-5f3a58f75e89 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:00.549053 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f4dc1edc-9466-46a6-90d6-5f3a58f75e89 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497 tempest-FlavorsExtraSpecsNegativeTestJSON-1018784497-project] 10.222.0.20 "PUT /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013334 Sep 10 10:38:00.556525 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 450/937] 10.222.0.20 () {60 vars in 1265 bytes} [Sat Sep 10 10:38:00 2022] PUT /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:00.562007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0df4a734-5e18-4033-9dbe-415cbbb52c24 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:00.579573 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0df4a734-5e18-4033-9dbe-415cbbb52c24 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] HTTP exception thrown: Flavor 1098973248 has no extra specs with key hw:cpu_thread_policy. Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0df4a734-5e18-4033-9dbe-415cbbb52c24 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Request method failure captured: Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/flavors/1098973248/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkHX2vWH6vV7Bn8-n8g9vXj7NzIzPJZ4vNYeqxDMn43GzsAglXyHFF5k1gI3lFP3JdTRfP07SdxVLe7G1F5dZLtPwjE0f9jaakS1fdIZ6Ul-jBDde3c9cOWA_HvaDTWDQH4XF54UOHVmscNeSIbwp6_AVxuX5nReqCRTcWg7FRkEvw Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6aedd4abf7d84c778d624de72e062d0b Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:38:00.582849 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6aedd4abf7d84c778d624de72e062d0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6aedd4abf7d84c778d624de72e062d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6aedd4abf7d84c778d624de72e062d0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6aedd4abf7d84c778d624de72e062d0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6aedd4abf7d84c778d624de72e062d0b Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 258ed9c76a034f1296bcb3edc907d020 Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:00.584446 n-d-856894-1 devstack@n-api.service[128788]: exception: Flavor 1098973248 has no extra specs with key hw:cpu_thread_policy. Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'flavor_id': '1098973248', 'id': 'hw:cpu_thread_policy'} Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1098973248 has no extra specs with key hw:cpu_thread_policy. Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.585307 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.586809 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.586809 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.586809 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.586809 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:00.586809 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:00.586809 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1098973248 has no extra specs with key hw:cpu_thread_policy. Sep 10 10:38:00.586809 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.589938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0df4a734-5e18-4033-9dbe-415cbbb52c24 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Returning 404 to user: Flavor 1098973248 has no extra specs with key hw:cpu_thread_policy. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:00.589938 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0df4a734-5e18-4033-9dbe-415cbbb52c24 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1098973248/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.031360 Sep 10 10:38:00.589938 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 451/938] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:38:00 2022] DELETE /compute/v2.1/flavors/1098973248/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:00.609633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-242b1ffe-6836-4c84-8e0c-ab5d79f6bab6 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:00.622212 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-242b1ffe-6836-4c84-8e0c-ab5d79f6bab6 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-242b1ffe-6836-4c84-8e0c-ab5d79f6bab6 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Request method failure captured: Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 27 Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkHX2vWH6vV7Bn8-n8g9vXj7NzIzPJZ4vNYeqxDMn43GzsAglXyHFF5k1gI3lFP3JdTRfP07SdxVLe7G1F5dZLtPwjE0f9jaakS1fdIZ6Ul-jBDde3c9cOWA_HvaDTWDQH4XF54UOHVmscNeSIbwp6_AVxuX5nReqCRTcWg7FRkEvw Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6aedd4abf7d84c778d624de72e062d0b Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:38:00.639222 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6aedd4abf7d84c778d624de72e062d0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6aedd4abf7d84c778d624de72e062d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6aedd4abf7d84c778d624de72e062d0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6aedd4abf7d84c778d624de72e062d0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6aedd4abf7d84c778d624de72e062d0b Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 258ed9c76a034f1296bcb3edc907d020 Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: {"hw:cpu_policy": "shared"} Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:00.640893 n-d-856894-1 devstack@n-api.service[128788]: exception: Request body and URI mismatch Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'flavor_id': '1098973248', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.642124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.644061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:00.644061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:00.644061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 10 10:38:00.644061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.644061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-242b1ffe-6836-4c84-8e0c-ab5d79f6bab6 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:00.644061 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-242b1ffe-6836-4c84-8e0c-ab5d79f6bab6 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.044400 Sep 10 10:38:00.654893 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 452/939] 10.222.0.20 () {60 vars in 1265 bytes} [Sat Sep 10 10:38:00 2022] PUT /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes => generated 73 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:38:00.663776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8e4cbd5-6976-454c-b7ae-9a1885595182 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8e4cbd5-6976-454c-b7ae-9a1885595182 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Request method failure captured: Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 49 Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkHX2vWH6vV7Bn8-n8g9vXj7NzIzPJZ4vNYeqxDMn43GzsAglXyHFF5k1gI3lFP3JdTRfP07SdxVLe7G1F5dZLtPwjE0f9jaakS1fdIZ6Ul-jBDde3c9cOWA_HvaDTWDQH4XF54UOHVmscNeSIbwp6_AVxuX5nReqCRTcWg7FRkEvw Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6aedd4abf7d84c778d624de72e062d0b Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:38:00.679831 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6aedd4abf7d84c778d624de72e062d0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6aedd4abf7d84c778d624de72e062d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6aedd4abf7d84c778d624de72e062d0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6aedd4abf7d84c778d624de72e062d0b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6aedd4abf7d84c778d624de72e062d0b Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 258ed9c76a034f1296bcb3edc907d020 Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 10 10:38:00.681502 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'flavor_id': '1098973248', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance: Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 10 10:38:00.682347 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.684163 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.685701 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.685701 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.685701 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:38:00.685701 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:38:00.685701 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 10:38:00.685701 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.685701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8e4cbd5-6976-454c-b7ae-9a1885595182 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:00.698673 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8e4cbd5-6976-454c-b7ae-9a1885595182 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.025602 Sep 10 10:38:00.699360 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 453/940] 10.222.0.20 () {60 vars in 1265 bytes} [Sat Sep 10 10:38:00 2022] PUT /compute/v2.1/flavors/1098973248/os-extra_specs/hw:numa_nodes => generated 117 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:38:00.711524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe0bcceb-7ea7-4896-8981-63f335c2e640 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:00.726965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f750cd7b-bc65-4c5a-9436-34161c7ed22e tempest-ListImageFiltersNegativeTestJSON-305717640 tempest-ListImageFiltersNegativeTestJSON-305717640-project] Calling method '.version_select at 0x7efcaf3440d0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:00.762408 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe0bcceb-7ea7-4896-8981-63f335c2e640 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1098973248" status: 202 len: 0 microversion: 2.1 time: 0.055928 Sep 10 10:38:00.767238 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 454/941] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:38:00 2022] DELETE /compute/v2.1/flavors/1098973248 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:38:00.770087 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-f750cd7b-bc65-4c5a-9436-34161c7ed22e tempest-ListImageFiltersNegativeTestJSON-305717640 tempest-ListImageFiltersNegativeTestJSON-305717640-project] HTTP exception thrown: Image not found. Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f750cd7b-bc65-4c5a-9436-34161c7ed22e tempest-ListImageFiltersNegativeTestJSON-305717640 tempest-ListImageFiltersNegativeTestJSON-305717640-project] Request method failure captured: Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/images/b33a0614-4c6a-4a61-bc9b-8842b385b878 HTTP/1.1 Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGkIbGLnREos7JYzpi--UvSmaSvIAMxUAkD6CTIudn_9n9JQGGgGsc3isjaAH9E9vTuTBL-A0rIadRQrpoEE7AIvU0Ej_m4tozgC0ju6vCE4zRgQy4b-TPdSQz5-DMRe6SPSC9EfzWMeGomTzZOIvV5tjfkBKJFTM8g7jOzjGYqO5Xk Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 46554a4c2fba44229a214d991146c0d1 Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-305717640 Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:38:00.773158 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/46554a4c2fba44229a214d991146c0d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/46554a4c2fba44229a214d991146c0d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/46554a4c2fba44229a214d991146c0d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_46554a4c2fba44229a214d991146c0d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-305717640 Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 46554a4c2fba44229a214d991146c0d1 Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-305717640 Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ListImageFiltersNegativeTestJSON-305717640-project Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: ce163bcfb6ae40628e174970923405ae Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-305717640-project Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: exception: Image not found. Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'b33a0614-4c6a-4a61-bc9b-8842b385b878'} Sep 10 10:38:00.775004 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:38:00.780971 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b33a0614-4c6a-4a61-bc9b-8842b385b878 Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:38:00.782252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b33a0614-4c6a-4a61-bc9b-8842b385b878 could not be found. Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:38:00.785451 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:00.788872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f750cd7b-bc65-4c5a-9436-34161c7ed22e tempest-ListImageFiltersNegativeTestJSON-305717640 tempest-ListImageFiltersNegativeTestJSON-305717640-project] Returning 404 to user: Image not found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:00.792638 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f750cd7b-bc65-4c5a-9436-34161c7ed22e tempest-ListImageFiltersNegativeTestJSON-305717640 tempest-ListImageFiltersNegativeTestJSON-305717640-project] 10.222.0.20 "GET /compute/v2.1/images/b33a0614-4c6a-4a61-bc9b-8842b385b878" status: 404 len: 62 microversion: 2.1 time: 0.339393 Sep 10 10:38:00.792638 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 488/942] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:38:00 2022] GET /compute/v2.1/images/b33a0614-4c6a-4a61-bc9b-8842b385b878 => generated 62 bytes in 342 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 10:38:00.796105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-009faffa-cc32-4716-874f-11ffc40a0e96 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:00.861990 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-009faffa-cc32-4716-874f-11ffc40a0e96 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660 tempest-FlavorsExtraSpecsNegativeTestJSON-670517660-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083267 Sep 10 10:38:00.865093 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 455/943] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:38:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:00.886903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-004cca95-4f97-4266-9eec-68b33ea259bb tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:00.888635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-004cca95-4f97-4266-9eec-68b33ea259bb tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:00.911065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004cca95-4f97-4266-9eec-68b33ea259bb tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:00.911881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004cca95-4f97-4266-9eec-68b33ea259bb tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:00.912472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004cca95-4f97-4266-9eec-68b33ea259bb tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:00.913888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004cca95-4f97-4266-9eec-68b33ea259bb tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:00.919121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004cca95-4f97-4266-9eec-68b33ea259bb tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:00.920396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004cca95-4f97-4266-9eec-68b33ea259bb tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:01.117485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac459772-387a-43ec-89e1-5ce0bf253674 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:01.120164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac459772-387a-43ec-89e1-5ce0bf253674 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:01.142302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac459772-387a-43ec-89e1-5ce0bf253674 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:01.145795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac459772-387a-43ec-89e1-5ce0bf253674 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:01.148375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac459772-387a-43ec-89e1-5ce0bf253674 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:01.149461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac459772-387a-43ec-89e1-5ce0bf253674 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:01.152581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac459772-387a-43ec-89e1-5ce0bf253674 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:01.154377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac459772-387a-43ec-89e1-5ce0bf253674 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:01.316588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-004cca95-4f97-4266-9eec-68b33ea259bb tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:01.325350 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-004cca95-4f97-4266-9eec-68b33ea259bb tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1316 microversion: 2.1 time: 0.450732 Sep 10 10:38:01.327323 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 489/944] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:00 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:01.474687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1549513806", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "47147fcc-eb59-4f08-ae29-874c9998564e"}], "security_groups": [{"name": "tempest-securitygroup--1083771560"}], "key_name": "tempest-keypair-1091877618", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:01.550210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ac459772-387a-43ec-89e1-5ce0bf253674 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:01.580167 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac459772-387a-43ec-89e1-5ce0bf253674 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1323 microversion: 2.1 time: 0.467337 Sep 10 10:38:01.581425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 456/945] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:01 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:01.719168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] validate_networks() for [('47147fcc-eb59-4f08-ae29-874c9998564e', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:38:01.980506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c652672f-2009-4423-897d-8ac45cd49c25 req-8d65b138-34a4-47ea-aee2-abd05f1437db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ec3aa3-5082-4375-83af-0108cfee103e", "tag": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:01.999324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c652672f-2009-4423-897d-8ac45cd49c25 req-8d65b138-34a4-47ea-aee2-abd05f1437db service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:02.003237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c652672f-2009-4423-897d-8ac45cd49c25 req-8d65b138-34a4-47ea-aee2-abd05f1437db service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:02.004214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c652672f-2009-4423-897d-8ac45cd49c25 req-8d65b138-34a4-47ea-aee2-abd05f1437db service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:02.031410 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c652672f-2009-4423-897d-8ac45cd49c25 req-8d65b138-34a4-47ea-aee2-abd05f1437db service nova] Creating event network-changed:e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf for instance f1ec3aa3-5082-4375-83af-0108cfee103e on n-h1-856894-1 Sep 10 10:38:02.037442 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c652672f-2009-4423-897d-8ac45cd49c25 req-8d65b138-34a4-47ea-aee2-abd05f1437db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061185 Sep 10 10:38:02.038893 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 457/946] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:38:02.355034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a1a4b792-be77-418d-81a5-c4f8a1130882 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:02.355735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a1a4b792-be77-418d-81a5-c4f8a1130882 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:02.370909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1a4b792-be77-418d-81a5-c4f8a1130882 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:02.371595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1a4b792-be77-418d-81a5-c4f8a1130882 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:02.372030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1a4b792-be77-418d-81a5-c4f8a1130882 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:02.372738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1a4b792-be77-418d-81a5-c4f8a1130882 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:02.373230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1a4b792-be77-418d-81a5-c4f8a1130882 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:02.373653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1a4b792-be77-418d-81a5-c4f8a1130882 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:02.510521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:38:02.511074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:38:02.511654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:38:02.512166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:38:02.512685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:38:02.531602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:02.532267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:02.532809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:02.533990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:02.536512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:02.537085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:02.581016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Getting quotas for project 9c2ac1f5c5c843fc89294292d4489252. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:38:02.597437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Getting quotas for user 362b727b96934e58b180727eaad35e3b and project 9c2ac1f5c5c843fc89294292d4489252. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:38:02.630994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:38:02.636673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:38:02.733115 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3e3e7480-909d-498f-9154-f855759a5987 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.262465 Sep 10 10:38:02.741408 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 490/947] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:38:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 10:38:02.746777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-65a2fa61-7bd6-4bcd-809c-258e325e6a3c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:02.747887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-65a2fa61-7bd6-4bcd-809c-258e325e6a3c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:02.754432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a2fa61-7bd6-4bcd-809c-258e325e6a3c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:02.755136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a2fa61-7bd6-4bcd-809c-258e325e6a3c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:02.756224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a2fa61-7bd6-4bcd-809c-258e325e6a3c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:02.757448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a2fa61-7bd6-4bcd-809c-258e325e6a3c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:02.758060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a2fa61-7bd6-4bcd-809c-258e325e6a3c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:02.758663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a2fa61-7bd6-4bcd-809c-258e325e6a3c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:02.958839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a1a4b792-be77-418d-81a5-c4f8a1130882 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:02.971065 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a1a4b792-be77-418d-81a5-c4f8a1130882 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1466 microversion: 2.1 time: 0.620973 Sep 10 10:38:02.989605 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 458/948] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:02 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1466 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:38:02.999273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ffacfc9a-0631-4c22-8312-316d49f4f005 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:02.999523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ffacfc9a-0631-4c22-8312-316d49f4f005 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:03.016346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-65a2fa61-7bd6-4bcd-809c-258e325e6a3c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:03.035865 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-65a2fa61-7bd6-4bcd-809c-258e325e6a3c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1323 microversion: 2.1 time: 0.293039 Sep 10 10:38:03.039463 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 491/949] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:02 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:03.048477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aa064871-a3d7-47ee-9549-4d93025fbd6b tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:03.054164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-aa064871-a3d7-47ee-9549-4d93025fbd6b tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:03.069062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa064871-a3d7-47ee-9549-4d93025fbd6b tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:03.069813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa064871-a3d7-47ee-9549-4d93025fbd6b tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:03.070935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa064871-a3d7-47ee-9549-4d93025fbd6b tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:03.072696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa064871-a3d7-47ee-9549-4d93025fbd6b tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:03.073964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa064871-a3d7-47ee-9549-4d93025fbd6b tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:03.074588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa064871-a3d7-47ee-9549-4d93025fbd6b tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:03.132321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffacfc9a-0631-4c22-8312-316d49f4f005 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:03.146623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffacfc9a-0631-4c22-8312-316d49f4f005 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:03.152398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffacfc9a-0631-4c22-8312-316d49f4f005 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:03.153974 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ffacfc9a-0631-4c22-8312-316d49f4f005 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1286 microversion: 2.25 time: 0.174356 Sep 10 10:38:03.182158 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 459/950] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:02 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1286 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:38:03.380861 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aa064871-a3d7-47ee-9549-4d93025fbd6b tempest-ServersOnMultiNodesTest-584710503 tempest-ServersOnMultiNodesTest-584710503-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1617 microversion: 2.1 time: 0.338085 Sep 10 10:38:03.387229 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 492/951] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:03 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1617 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:03.417337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-341b6e86-c636-4e61-94b7-d08147c37561 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:03.418350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-341b6e86-c636-4e61-94b7-d08147c37561 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:03.427413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-341b6e86-c636-4e61-94b7-d08147c37561 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:03.428270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-341b6e86-c636-4e61-94b7-d08147c37561 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:03.428999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-341b6e86-c636-4e61-94b7-d08147c37561 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:03.430398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-341b6e86-c636-4e61-94b7-d08147c37561 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:03.431198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-341b6e86-c636-4e61-94b7-d08147c37561 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:03.431852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-341b6e86-c636-4e61-94b7-d08147c37561 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:03.466219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-341b6e86-c636-4e61-94b7-d08147c37561 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:03.625551 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-341b6e86-c636-4e61-94b7-d08147c37561 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 204 len: 0 microversion: 2.1 time: 0.213809 Sep 10 10:38:03.626679 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 460/952] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:03 2022] DELETE /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:03.636464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f827c6fe-357b-4e77-a8dd-3207fa967800 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:03.637291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f827c6fe-357b-4e77-a8dd-3207fa967800 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:03.645175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f827c6fe-357b-4e77-a8dd-3207fa967800 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:03.645854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f827c6fe-357b-4e77-a8dd-3207fa967800 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:03.646568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f827c6fe-357b-4e77-a8dd-3207fa967800 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:03.647375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f827c6fe-357b-4e77-a8dd-3207fa967800 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:03.647936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f827c6fe-357b-4e77-a8dd-3207fa967800 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:03.648466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f827c6fe-357b-4e77-a8dd-3207fa967800 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:03.842923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f827c6fe-357b-4e77-a8dd-3207fa967800 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:03.853701 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f827c6fe-357b-4e77-a8dd-3207fa967800 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1472 microversion: 2.1 time: 0.222943 Sep 10 10:38:03.879930 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 493/953] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:03 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1472 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:04.072394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9ffcdeae-c6f0-4bc2-9485-3f43899c83c0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:04.074196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9ffcdeae-c6f0-4bc2-9485-3f43899c83c0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:04.085741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ffcdeae-c6f0-4bc2-9485-3f43899c83c0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:04.086188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ffcdeae-c6f0-4bc2-9485-3f43899c83c0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:04.086638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ffcdeae-c6f0-4bc2-9485-3f43899c83c0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:04.090262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ffcdeae-c6f0-4bc2-9485-3f43899c83c0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:04.091021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ffcdeae-c6f0-4bc2-9485-3f43899c83c0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:04.095462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ffcdeae-c6f0-4bc2-9485-3f43899c83c0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:04.397578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-45d52c36-bdeb-4974-9155-31ac0da743f5 tempest-AbsoluteLimitsTestJSON-1895186709 tempest-AbsoluteLimitsTestJSON-1895186709-project] Calling method '.version_select at 0x7efcaf2f2430>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:04.424267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45d52c36-bdeb-4974-9155-31ac0da743f5 tempest-AbsoluteLimitsTestJSON-1895186709 tempest-AbsoluteLimitsTestJSON-1895186709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:04.424659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45d52c36-bdeb-4974-9155-31ac0da743f5 tempest-AbsoluteLimitsTestJSON-1895186709 tempest-AbsoluteLimitsTestJSON-1895186709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:04.425813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45d52c36-bdeb-4974-9155-31ac0da743f5 tempest-AbsoluteLimitsTestJSON-1895186709 tempest-AbsoluteLimitsTestJSON-1895186709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:04.426754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45d52c36-bdeb-4974-9155-31ac0da743f5 tempest-AbsoluteLimitsTestJSON-1895186709 tempest-AbsoluteLimitsTestJSON-1895186709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:04.437894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45d52c36-bdeb-4974-9155-31ac0da743f5 tempest-AbsoluteLimitsTestJSON-1895186709 tempest-AbsoluteLimitsTestJSON-1895186709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:04.438598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45d52c36-bdeb-4974-9155-31ac0da743f5 tempest-AbsoluteLimitsTestJSON-1895186709 tempest-AbsoluteLimitsTestJSON-1895186709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:04.476309 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-45d52c36-bdeb-4974-9155-31ac0da743f5 tempest-AbsoluteLimitsTestJSON-1895186709 tempest-AbsoluteLimitsTestJSON-1895186709-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.285900 Sep 10 10:38:04.476915 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 494/954] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Sep 10 10:38:04 2022] GET /compute/v2.1/limits => generated 511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:38:04.484805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:04.486055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:04.495656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:04.496355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:04.496983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:04.498013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:04.498634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:04.499312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:04.572022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:04.582082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:04.584034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:04.585379 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-591dd964-489a-4b75-b27c-0f45cb1d3a9d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1290 microversion: 2.25 time: 0.105511 Sep 10 10:38:04.586475 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 495/955] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:04 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1290 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:38:04.735237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9ffcdeae-c6f0-4bc2-9485-3f43899c83c0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:04.756119 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9ffcdeae-c6f0-4bc2-9485-3f43899c83c0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1323 microversion: 2.1 time: 0.689799 Sep 10 10:38:04.784695 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 461/956] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:04 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1323 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:04.893576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c89f5782-52da-4a39-b405-52ba418778d9 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:04.894203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c89f5782-52da-4a39-b405-52ba418778d9 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:04.903842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:04.908702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89f5782-52da-4a39-b405-52ba418778d9 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:04.909290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89f5782-52da-4a39-b405-52ba418778d9 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:04.913608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89f5782-52da-4a39-b405-52ba418778d9 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:04.914389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89f5782-52da-4a39-b405-52ba418778d9 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:04.914862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89f5782-52da-4a39-b405-52ba418778d9 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:04.925409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89f5782-52da-4a39-b405-52ba418778d9 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:04.946034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:05.612806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:05.613535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:05.616055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:05.631361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:05.631873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:05.632454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:05.633361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:05.634362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:05.634774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:05.679544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c89f5782-52da-4a39-b405-52ba418778d9 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:05.701787 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c89f5782-52da-4a39-b405-52ba418778d9 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1472 microversion: 2.1 time: 0.812723 Sep 10 10:38:05.703041 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 496/957] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:04 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1472 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:05.788383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7edae6ab-9149-4164-a492-2fe49fd97a56 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:05.789455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7edae6ab-9149-4164-a492-2fe49fd97a56 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:05.798651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7edae6ab-9149-4164-a492-2fe49fd97a56 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:05.801327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7edae6ab-9149-4164-a492-2fe49fd97a56 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:05.803536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7edae6ab-9149-4164-a492-2fe49fd97a56 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:05.804927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7edae6ab-9149-4164-a492-2fe49fd97a56 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:05.807069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7edae6ab-9149-4164-a492-2fe49fd97a56 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:05.807832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7edae6ab-9149-4164-a492-2fe49fd97a56 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:05.825701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:05.840433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:05.841924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:05.843058 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b2bdc2bf-7a2e-4c76-9aba-5073c7691dac tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1338 microversion: 2.25 time: 0.235113 Sep 10 10:38:05.843988 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 462/958] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:05 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1338 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:38:06.317735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7edae6ab-9149-4164-a492-2fe49fd97a56 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:06.328785 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7edae6ab-9149-4164-a492-2fe49fd97a56 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1323 microversion: 2.1 time: 0.544675 Sep 10 10:38:06.343285 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 497/959] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:05 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1323 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:06.566655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c7829d27-e4ee-42db-9fb0-23469a87f3f4 req-c6126858-45ea-42c2-8512-6385ebe6d7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65a6dc23-ba5c-4362-a927-9f20d0ba5bf3", "name": "network-vif-deleted", "tag": "d964ee68-1797-460c-b363-8855a33bf48d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:06.596362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c7829d27-e4ee-42db-9fb0-23469a87f3f4 req-c6126858-45ea-42c2-8512-6385ebe6d7b0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:06.596930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c7829d27-e4ee-42db-9fb0-23469a87f3f4 req-c6126858-45ea-42c2-8512-6385ebe6d7b0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:06.615423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c7829d27-e4ee-42db-9fb0-23469a87f3f4 req-c6126858-45ea-42c2-8512-6385ebe6d7b0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:06.718627 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c7829d27-e4ee-42db-9fb0-23469a87f3f4 req-c6126858-45ea-42c2-8512-6385ebe6d7b0 service nova] Creating event network-vif-deleted:d964ee68-1797-460c-b363-8855a33bf48d for instance 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 on n-h2-856894-1 Sep 10 10:38:06.730284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-56f5449d-263f-49b2-86a3-2e2b01c34530 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:06.730907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-56f5449d-263f-49b2-86a3-2e2b01c34530 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:06.740048 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c7829d27-e4ee-42db-9fb0-23469a87f3f4 req-c6126858-45ea-42c2-8512-6385ebe6d7b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177298 Sep 10 10:38:06.742655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56f5449d-263f-49b2-86a3-2e2b01c34530 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:06.743705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56f5449d-263f-49b2-86a3-2e2b01c34530 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:06.744146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56f5449d-263f-49b2-86a3-2e2b01c34530 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:06.744851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56f5449d-263f-49b2-86a3-2e2b01c34530 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:06.745340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56f5449d-263f-49b2-86a3-2e2b01c34530 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:06.745762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56f5449d-263f-49b2-86a3-2e2b01c34530 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:06.754570 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 463/960] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:06.827951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-12287f9b-aa38-4d62-81ec-d0bacf857691 req-280e4032-30da-45d5-9256-005562e204cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ec3aa3-5082-4375-83af-0108cfee103e", "name": "network-vif-plugged", "status": "completed", "tag": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:06.882190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-12287f9b-aa38-4d62-81ec-d0bacf857691 req-280e4032-30da-45d5-9256-005562e204cd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:06.882720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-12287f9b-aa38-4d62-81ec-d0bacf857691 req-280e4032-30da-45d5-9256-005562e204cd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:06.883172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-12287f9b-aa38-4d62-81ec-d0bacf857691 req-280e4032-30da-45d5-9256-005562e204cd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:06.943526 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-12287f9b-aa38-4d62-81ec-d0bacf857691 req-280e4032-30da-45d5-9256-005562e204cd service nova] Creating event network-vif-plugged:e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf for instance f1ec3aa3-5082-4375-83af-0108cfee103e on n-h1-856894-1 Sep 10 10:38:06.961055 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-12287f9b-aa38-4d62-81ec-d0bacf857691 req-280e4032-30da-45d5-9256-005562e204cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159369 Sep 10 10:38:06.967795 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 464/961] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:38:06.993847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:06.994596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:07.027404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:07.036446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-56f5449d-263f-49b2-86a3-2e2b01c34530 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:07.045811 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-56f5449d-263f-49b2-86a3-2e2b01c34530 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 200 len: 1301 microversion: 2.1 time: 0.320110 Sep 10 10:38:07.046408 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 498/962] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:06 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 1301 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:38:07.061937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:07.061937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:07.061937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:07.061937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:07.062773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:07.261894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:07.282797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:07.294610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:07.297552 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79a605e3-bbb0-43a5-90fd-1bd1ceed89c2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1344 microversion: 2.25 time: 0.325900 Sep 10 10:38:07.298653 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 465/963] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:06 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1344 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:38:07.356128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-abe1d645-284d-4895-890d-f5c159fac4ae tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:07.356863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-abe1d645-284d-4895-890d-f5c159fac4ae tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:07.372158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-abe1d645-284d-4895-890d-f5c159fac4ae tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:07.374704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-abe1d645-284d-4895-890d-f5c159fac4ae tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:07.375154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-abe1d645-284d-4895-890d-f5c159fac4ae tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:07.375882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-abe1d645-284d-4895-890d-f5c159fac4ae tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:07.376345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-abe1d645-284d-4895-890d-f5c159fac4ae tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:07.377681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-abe1d645-284d-4895-890d-f5c159fac4ae tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:08.072140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:08.072750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:08.089610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:08.091609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:08.093006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:08.093775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:08.094242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:08.094670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:08.146033 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] HTTP exception thrown: Instance 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 could not be found. Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Request method failure captured: Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 HTTP/1.1 Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhjI0mBqovPP_llH0i9ni5xLfpitYZ9to6OfdBtLoayGJQT5xzq7QKB27fo9vkreHidq0J1x2CX58WsSrHegIUCYsoMBlyuMHcTRQwcLNBdhUi5REBsXOKdRMO2cK9AjuPfavjPXujwLasNtH09EmYLXj_3SbG_oM5FX9r90EDM1Ok Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:08.155321 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_357ca1336b634d0389fff733e6e26ca0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 60543e7cbbb0451bb8b1929437b2a0ea Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 could not be found. Sep 10 10:38:08.156937 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '65a6dc23-ba5c-4362-a927-9f20d0ba5bf3'} Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 could not be found. Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:08.157871 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 could not be found. Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 could not be found. Sep 10 10:38:08.159592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:08.167020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Returning 404 to user: Instance 65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:08.168473 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-963741ef-524a-467e-b9b8-484d6e2cecb5 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3" status: 404 len: 111 microversion: 2.1 time: 0.101741 Sep 10 10:38:08.171841 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 466/964] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:08 2022] GET /compute/v2.1/servers/65a6dc23-ba5c-4362-a927-9f20d0ba5bf3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:38:08.188058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f9768dd-163c-457e-9f01-1613d9e3d55a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:08.190448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f9768dd-163c-457e-9f01-1613d9e3d55a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:08.207287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f9768dd-163c-457e-9f01-1613d9e3d55a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:08.213909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f9768dd-163c-457e-9f01-1613d9e3d55a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:08.214402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f9768dd-163c-457e-9f01-1613d9e3d55a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:08.215156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f9768dd-163c-457e-9f01-1613d9e3d55a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:08.215625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f9768dd-163c-457e-9f01-1613d9e3d55a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:08.216056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f9768dd-163c-457e-9f01-1613d9e3d55a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:08.292368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f9768dd-163c-457e-9f01-1613d9e3d55a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:08.395350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:08.520669 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f9768dd-163c-457e-9f01-1613d9e3d55a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 204 len: 0 microversion: 2.1 time: 0.344099 Sep 10 10:38:08.521307 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 467/965] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:08 2022] DELETE /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:08.530418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:08.531132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:08.549789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:08.551759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:08.552401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:08.554064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:08.556784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:08.558043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:08.937925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-abe1d645-284d-4895-890d-f5c159fac4ae tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:08.952695 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-abe1d645-284d-4895-890d-f5c159fac4ae tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1323 microversion: 2.1 time: 1.600617 Sep 10 10:38:08.954315 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 499/966] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:07 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1323 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:08.959970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8023dfe8-4b1b-43db-8158-c54279e5dc1e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:08.960804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8023dfe8-4b1b-43db-8158-c54279e5dc1e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:08.968483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8023dfe8-4b1b-43db-8158-c54279e5dc1e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:08.969552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8023dfe8-4b1b-43db-8158-c54279e5dc1e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:08.970175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8023dfe8-4b1b-43db-8158-c54279e5dc1e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:08.971384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8023dfe8-4b1b-43db-8158-c54279e5dc1e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:08.972002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8023dfe8-4b1b-43db-8158-c54279e5dc1e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:08.972658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8023dfe8-4b1b-43db-8158-c54279e5dc1e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:09.075896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:09.111628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:09.119617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:09.121014 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4aa3e53f-3b16-44a0-80c6-f22ab177fcd3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1412 microversion: 2.25 time: 0.598338 Sep 10 10:38:09.133036 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 468/967] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:08 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1412 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:38:09.536282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b124be4-de1d-404f-a54e-17b5d0e5e681 tempest-InstanceUsageAuditLogNegativeTestJSON-288416671 tempest-InstanceUsageAuditLogNegativeTestJSON-288416671-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:09.540150 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-3b124be4-de1d-404f-a54e-17b5d0e5e681 tempest-InstanceUsageAuditLogNegativeTestJSON-288416671 tempest-InstanceUsageAuditLogNegativeTestJSON-288416671-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b124be4-de1d-404f-a54e-17b5d0e5e681 tempest-InstanceUsageAuditLogNegativeTestJSON-288416671 tempest-InstanceUsageAuditLogNegativeTestJSON-288416671-project-admin] Request method failure captured: Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkQiDsfERRBOULp2_L_1STN8s47whDxuiROp9xrpQ3NiafOqFRFKHLpaC2qKk69k9sZntvpyVW9GMqRaqZZj4aYvzGRz0LKUEH15KfOq0LNOlISwEPr5Y1d3ciVtr9weO3K7IuaTS_qUHVJk7CAO19i9yp_E2H1Q7YnUsXUwcp4lxs Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1185320e1d8541eeb04739c25870bd23 Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-288416671 Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:38:09.561285 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1185320e1d8541eeb04739c25870bd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1185320e1d8541eeb04739c25870bd23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1185320e1d8541eeb04739c25870bd23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1185320e1d8541eeb04739c25870bd23", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-288416671 Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1185320e1d8541eeb04739c25870bd23 Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-288416671 Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-288416671-project-admin Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 62e6fde64fb64bd0abe7b93be57aae3a Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-288416671-project-admin Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:09.563206 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid timestamp for date invalid_time Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'invalid_time'} Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:09.564023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.565602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b124be4-de1d-404f-a54e-17b5d0e5e681 tempest-InstanceUsageAuditLogNegativeTestJSON-288416671 tempest-InstanceUsageAuditLogNegativeTestJSON-288416671-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:09.567692 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b124be4-de1d-404f-a54e-17b5d0e5e681 tempest-InstanceUsageAuditLogNegativeTestJSON-288416671 tempest-InstanceUsageAuditLogNegativeTestJSON-288416671-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.441600 Sep 10 10:38:09.568653 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 469/968] 10.222.0.20 () {58 vars in 1224 bytes} [Sat Sep 10 10:38:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 443 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:38:09.584910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8023dfe8-4b1b-43db-8158-c54279e5dc1e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:09.609114 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8023dfe8-4b1b-43db-8158-c54279e5dc1e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1472 microversion: 2.1 time: 0.649341 Sep 10 10:38:09.612682 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 500/969] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:08 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1472 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:09.796643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a5abac0-a16e-4483-af27-95e85d8d0124 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:09.798763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0a5abac0-a16e-4483-af27-95e85d8d0124 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'd580399f4a66486f82690c7931ebcddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271f81d4c74a4f3897fbab9db76fb020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a5abac0-a16e-4483-af27-95e85d8d0124 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project] Request method failure captured: Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkP1m0a_W5PilI92b4BPkgO_uDrTxJmCGxu_56y7eCcdzoMAg9Xi_0CGbDBDtwNEuoblskoCQxJwYHiBt4waIn16CWtAEod3blt5D7h3K9w28TlJddEI3WgPO-FEtyiWaepPy8TTOAZjGfK2f2I7P5O9O4mS4MX3HtKTNZ2ayTat90 Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 271f81d4c74a4f3897fbab9db76fb020 Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:09.800607 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:09.802188 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/271f81d4c74a4f3897fbab9db76fb020"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/271f81d4c74a4f3897fbab9db76fb020"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/271f81d4c74a4f3897fbab9db76fb020"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_271f81d4c74a4f3897fbab9db76fb020", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:09.802188 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 Sep 10 10:38:09.802188 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 271f81d4c74a4f3897fbab9db76fb020 Sep 10 10:38:09.802188 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 Sep 10 10:38:09.802188 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project Sep 10 10:38:09.802188 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:09.802188 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:09.802188 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d580399f4a66486f82690c7931ebcddd Sep 10 10:38:09.802188 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project Sep 10 10:38:09.802188 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: action_args: {} Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:38:09.802848 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 10 10:38:09.804059 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.807461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a5abac0-a16e-4483-af27-95e85d8d0124 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:09.810102 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0a5abac0-a16e-4483-af27-95e85d8d0124 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.233091 Sep 10 10:38:09.816250 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 470/970] 10.222.0.20 () {58 vars in 1185 bytes} [Sat Sep 10 10:38:09 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 240 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:09.826554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b9be3f70-7b5d-47ab-99db-e95c088c8760 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:09.829798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b9be3f70-7b5d-47ab-99db-e95c088c8760 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'd580399f4a66486f82690c7931ebcddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271f81d4c74a4f3897fbab9db76fb020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b9be3f70-7b5d-47ab-99db-e95c088c8760 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project] Request method failure captured: Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10%2010:38:09 HTTP/1.1 Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGkP1m0a_W5PilI92b4BPkgO_uDrTxJmCGxu_56y7eCcdzoMAg9Xi_0CGbDBDtwNEuoblskoCQxJwYHiBt4waIn16CWtAEod3blt5D7h3K9w28TlJddEI3WgPO-FEtyiWaepPy8TTOAZjGfK2f2I7P5O9O4mS4MX3HtKTNZ2ayTat90 Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 271f81d4c74a4f3897fbab9db76fb020 Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:38:09.832281 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:38:09.834060 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/271f81d4c74a4f3897fbab9db76fb020"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/271f81d4c74a4f3897fbab9db76fb020"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/271f81d4c74a4f3897fbab9db76fb020"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_271f81d4c74a4f3897fbab9db76fb020", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:09.834060 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 Sep 10 10:38:09.834060 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 271f81d4c74a4f3897fbab9db76fb020 Sep 10 10:38:09.834060 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 Sep 10 10:38:09.834060 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project Sep 10 10:38:09.834060 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:38:09.834060 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:38:09.834060 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: d580399f4a66486f82690c7931ebcddd Sep 10 10:38:09.834060 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project Sep 10 10:38:09.834060 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '2022-09-10 10:38:09'} Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:38:09.834857 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 10 10:38:09.837255 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:38:09.841297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b9be3f70-7b5d-47ab-99db-e95c088c8760 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:09.841297 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b9be3f70-7b5d-47ab-99db-e95c088c8760 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122 tempest-InstanceUsageAuditLogNegativeTestJSON-1157040122-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10 10:38:09" status: 403 len: 128 microversion: 2.1 time: 0.019417 Sep 10 10:38:09.844586 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 501/971] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Sep 10 10:38:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10%2010%3A38%3A09 => generated 128 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:09.983929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e451bc5-33b4-465c-a544-54a8475cf1cd tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:09.985520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e451bc5-33b4-465c-a544-54a8475cf1cd tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:09.996017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e451bc5-33b4-465c-a544-54a8475cf1cd tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:10.001290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e451bc5-33b4-465c-a544-54a8475cf1cd tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:10.002212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e451bc5-33b4-465c-a544-54a8475cf1cd tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:10.002976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e451bc5-33b4-465c-a544-54a8475cf1cd tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:10.003447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e451bc5-33b4-465c-a544-54a8475cf1cd tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:10.003875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e451bc5-33b4-465c-a544-54a8475cf1cd tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:10.162390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:10.164541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:10.175558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:10.176568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:10.177224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:10.178100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:10.178798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:10.179752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:10.386372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e451bc5-33b4-465c-a544-54a8475cf1cd tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:10.399991 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e451bc5-33b4-465c-a544-54a8475cf1cd tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1517 microversion: 2.1 time: 0.424102 Sep 10 10:38:10.401799 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 471/972] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:09 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1517 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:10.431545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a1714231-93d8-44e7-a5ed-5ad377379d9f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Action: 'create', calling method: .version_select at 0x7efcaeb261f0>, body: {"pool": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:10.470284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:10.492388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:10.497393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:10.505677 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b73db36d-1603-4c03-af53-b2fbbbece58f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1412 microversion: 2.25 time: 0.349141 Sep 10 10:38:10.509910 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 502/973] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:10 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1412 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:38:10.599431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-5c04b95f-2292-4ebc-81ae-f574c14c6916 req-1ff5817c-a814-4599-91f3-6cacc75c084e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf4f355-1582-4020-a738-9d8579be881b", "tag": "5c9581bc-bf42-47dd-b446-4cf4841d36b7"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:10.621538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5c04b95f-2292-4ebc-81ae-f574c14c6916 req-1ff5817c-a814-4599-91f3-6cacc75c084e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:10.622025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5c04b95f-2292-4ebc-81ae-f574c14c6916 req-1ff5817c-a814-4599-91f3-6cacc75c084e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:10.622523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5c04b95f-2292-4ebc-81ae-f574c14c6916 req-1ff5817c-a814-4599-91f3-6cacc75c084e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:10.661817 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-5c04b95f-2292-4ebc-81ae-f574c14c6916 req-1ff5817c-a814-4599-91f3-6cacc75c084e service nova] Creating event network-changed:5c9581bc-bf42-47dd-b446-4cf4841d36b7 for instance 7bf4f355-1582-4020-a738-9d8579be881b on n-h2-856894-1 Sep 10 10:38:10.669539 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-5c04b95f-2292-4ebc-81ae-f574c14c6916 req-1ff5817c-a814-4599-91f3-6cacc75c084e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074491 Sep 10 10:38:10.670750 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 503/974] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:38:10.676187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-90248ff4-619e-4312-8760-1bd33f2e8b93 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:10.677614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-90248ff4-619e-4312-8760-1bd33f2e8b93 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:10.695852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90248ff4-619e-4312-8760-1bd33f2e8b93 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:10.696380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90248ff4-619e-4312-8760-1bd33f2e8b93 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:10.696820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90248ff4-619e-4312-8760-1bd33f2e8b93 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:10.697552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90248ff4-619e-4312-8760-1bd33f2e8b93 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:10.698188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90248ff4-619e-4312-8760-1bd33f2e8b93 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:10.698788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90248ff4-619e-4312-8760-1bd33f2e8b93 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:11.429091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-90248ff4-619e-4312-8760-1bd33f2e8b93 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:11.443675 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-90248ff4-619e-4312-8760-1bd33f2e8b93 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1472 microversion: 2.1 time: 0.771400 Sep 10 10:38:11.444359 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 504/975] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:10 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1472 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:11.540740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:11.541491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:11.549803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:11.550973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:11.551653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:11.552755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:11.553466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:11.554388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:12.128035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:12.183553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:12.188148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:12.190931 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-995f38d8-6bf4-4720-82f2-c29ecff61206 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1412 microversion: 2.25 time: 0.656100 Sep 10 10:38:12.192206 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 505/976] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:11 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1412 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:38:12.204433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-b1d0e044-e06d-4abb-b76a-59263f4eb714 req-b924f54f-05a1-4a06-afe9-023f8b04e273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d67504-0205-4bb6-b002-d53a7ca7de9b", "name": "network-vif-deleted", "tag": "2c5d00d4-7c93-4f25-b2dc-6e4774aefbcf"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:12.218525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b1d0e044-e06d-4abb-b76a-59263f4eb714 req-b924f54f-05a1-4a06-afe9-023f8b04e273 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:12.219279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b1d0e044-e06d-4abb-b76a-59263f4eb714 req-b924f54f-05a1-4a06-afe9-023f8b04e273 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:12.219937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b1d0e044-e06d-4abb-b76a-59263f4eb714 req-b924f54f-05a1-4a06-afe9-023f8b04e273 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:12.268654 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-b1d0e044-e06d-4abb-b76a-59263f4eb714 req-b924f54f-05a1-4a06-afe9-023f8b04e273 service nova] Creating event network-vif-deleted:2c5d00d4-7c93-4f25-b2dc-6e4774aefbcf for instance e5d67504-0205-4bb6-b002-d53a7ca7de9b on n-h1-856894-1 Sep 10 10:38:12.288160 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-b1d0e044-e06d-4abb-b76a-59263f4eb714 req-b924f54f-05a1-4a06-afe9-023f8b04e273 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091783 Sep 10 10:38:12.289833 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 506/977] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:12.311319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-114c03e8-fe63-4eca-9826-842f41cb2507 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1360219507", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c1b2eff8-00e4-496a-9170-09634317b110"}], "security_groups": [{"name": "tempest-securitygroup--986323876"}], "key_name": "tempest-keypair-1194628985", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ec56406e-abdf-4cf4-9365-e77db67924da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:13.127491 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a1714231-93d8-44e7-a5ed-5ad377379d9f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.703979 Sep 10 10:38:13.142788 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 472/978] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:38:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:38:13.145486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:13.146230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:13.157638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=10 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:13.159832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:13.160590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:13.161583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:13.162517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:13.163385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:13.164013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:13.214124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:13.215013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:13.215663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:13.217969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lazy-loading 'fault' on Instance uuid e5d67504-0205-4bb6-b002-d53a7ca7de9b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:38:13.278783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:13.289952 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7f81d49-d0fc-4c3c-b345-b7c97c3cf279 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 200 len: 1306 microversion: 2.1 time: 0.150663 Sep 10 10:38:13.293486 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 473/979] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:13 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 1306 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:13.300500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:13.301395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:13.308945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:13.309813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:13.310500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:13.311445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:13.312379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:13.313032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:13.644268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:13.667087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:13.669670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:13.671260 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c64458b7-cd70-4d09-9f3a-2e6cb496f863 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1412 microversion: 2.25 time: 0.376441 Sep 10 10:38:13.672047 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 474/980] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:13 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1412 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:38:13.704228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1898773927", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "a982d658-1052-468f-9779-6bee76fe373a"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:13.783787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] validate_networks() for [('a982d658-1052-468f-9779-6bee76fe373a', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:38:14.259779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:38:14.260726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:38:14.260726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:38:14.261115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:38:14.261538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:38:14.281307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:14.283058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:14.284134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:14.285016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:14.285538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:14.286502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:14.317570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Getting quotas for project 349a486eb0c34b76b50169c1dbe6b11f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:38:14.320249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:RELEASE=4,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:14.325553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Getting quotas for user dd1f2852ff4a4a4fb199977ad4cf82d2 and project 349a486eb0c34b76b50169c1dbe6b11f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:38:14.342568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:38:14.344984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:38:14.402287 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab8c3dbd-56d3-405a-88e6-ce87ee23fbaa tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728782 Sep 10 10:38:14.403308 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 475/981] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:38:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:38:14.422642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=14 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:14.449603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:14.656234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f0698d5a-fd10-47e1-bce5-4c0b8232b7d2"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:14.659204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:14.668778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:14.677061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:14.677822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:14.679405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:14.680084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:14.681445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:15.053497 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] HTTP exception thrown: Volume f0698d5a-fd10-47e1-bce5-4c0b8232b7d2 could not be found. Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Request method failure captured: Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments/e5019786-8cf8-4c30-a2f7-f740d971a763 HTTP/1.1 Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 74 Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGireajzhdiyI-cN-_5OfP9vCeBOiqfUxeMDbVoIUuhtBtSunPkkMaBqAG2hlZIqky7w0bMserwTi8pPXRxNLTCrBUMN6tM01W0BLPgrWBLO8bvzgbajwI38DVjWw11HFPVRMCmSGu2XwpvlwivVkQ4zfKD7aU6gPgIuPI1lFcEJz40 Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b3f9aff4c34641c4933c53067124a359 Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesAdminNegativeTest-756588692 Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:38:15.092353 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3f9aff4c34641c4933c53067124a359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3f9aff4c34641c4933c53067124a359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3f9aff4c34641c4933c53067124a359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3f9aff4c34641c4933c53067124a359", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesAdminNegativeTest-756588692 Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b3f9aff4c34641c4933c53067124a359 Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-756588692 Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesAdminNegativeTest-756588692-project-admin Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 307e449747484a038f593b61567c3c98 Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesAdminNegativeTest-756588692-project-admin Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: {"volumeAttachment": {"volumeId": "f0698d5a-fd10-47e1-bce5-4c0b8232b7d2"}} Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:15.094076 n-d-856894-1 devstack@n-api.service[128788]: exception: Volume f0698d5a-fd10-47e1-bce5-4c0b8232b7d2 could not be found. Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': 'a8e9ca71-6d1b-4fc0-87dd-804a4a52745b', 'id': 'e5019786-8cf8-4c30-a2f7-f740d971a763', 'body': {'volumeAttachment': {'volumeId': 'f0698d5a-fd10-47e1-bce5-4c0b8232b7d2'}}} Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:38:15.094973 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0698d5a-fd10-47e1-bce5-4c0b8232b7d2 could not be found. (HTTP 404) (Request-ID: req-d919eaba-f65e-48b6-85af-3796b833797d) Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 10:38:15.096028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0698d5a-fd10-47e1-bce5-4c0b8232b7d2 could not be found. Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:15.098186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume f0698d5a-fd10-47e1-bce5-4c0b8232b7d2 could not be found. Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0698d5a-fd10-47e1-bce5-4c0b8232b7d2 could not be found. Sep 10 10:38:15.100456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.108689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Returning 400 to user: Volume f0698d5a-fd10-47e1-bce5-4c0b8232b7d2 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:15.108689 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1fa48f7a-9150-4a1e-8de2-c94bca126173 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments/e5019786-8cf8-4c30-a2f7-f740d971a763" status: 400 len: 107 microversion: 2.1 time: 0.690061 Sep 10 10:38:15.108689 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 476/982] 10.222.0.20 () {60 vars in 1433 bytes} [Sat Sep 10 10:38:14 2022] PUT /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments/e5019786-8cf8-4c30-a2f7-f740d971a763 => generated 107 bytes in 691 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:38:15.108689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:15.108689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: e5d67504-0205-4bb6-b002-d53a7ca7de9b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:15.119061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:15.119768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:15.120309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:15.121221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:15.132087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:15.132714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:15.158966 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] HTTP exception thrown: Instance e5d67504-0205-4bb6-b002-d53a7ca7de9b could not be found. Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Request method failure captured: Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b HTTP/1.1 Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhjI0mBqovPP_llH0i9ni5xLfpitYZ9to6OfdBtLoayGJQT5xzq7QKB27fo9vkreHidq0J1x2CX58WsSrHegIUCYsoMBlyuMHcTRQwcLNBdhUi5REBsXOKdRMO2cK9AjuPfavjPXujwLasNtH09EmYLXj_3SbG_oM5FX9r90EDM1Ok Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:15.160660 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_357ca1336b634d0389fff733e6e26ca0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 60543e7cbbb0451bb8b1929437b2a0ea Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance e5d67504-0205-4bb6-b002-d53a7ca7de9b could not be found. Sep 10 10:38:15.162134 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e5d67504-0205-4bb6-b002-d53a7ca7de9b'} Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d67504-0205-4bb6-b002-d53a7ca7de9b could not be found. Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:15.162867 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d67504-0205-4bb6-b002-d53a7ca7de9b could not be found. Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d67504-0205-4bb6-b002-d53a7ca7de9b could not be found. Sep 10 10:38:15.164050 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:15.165711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Returning 404 to user: Instance e5d67504-0205-4bb6-b002-d53a7ca7de9b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:15.165711 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27b47d2a-ef70-4a76-8824-ed48c6ce5d5b tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b" status: 404 len: 111 microversion: 2.1 time: 0.066384 Sep 10 10:38:15.168927 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 477/983] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:15 2022] GET /compute/v2.1/servers/e5d67504-0205-4bb6-b002-d53a7ca7de9b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:15.175943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf66ad67-dfaa-4830-86f0-34ad0c0f456f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:15.176639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bf66ad67-dfaa-4830-86f0-34ad0c0f456f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:15.188767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66ad67-dfaa-4830-86f0-34ad0c0f456f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:15.189424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66ad67-dfaa-4830-86f0-34ad0c0f456f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:15.190085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66ad67-dfaa-4830-86f0-34ad0c0f456f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:15.190951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66ad67-dfaa-4830-86f0-34ad0c0f456f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:15.191644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66ad67-dfaa-4830-86f0-34ad0c0f456f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:15.192932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66ad67-dfaa-4830-86f0-34ad0c0f456f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:15.614796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bf66ad67-dfaa-4830-86f0-34ad0c0f456f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:15.623186 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf66ad67-dfaa-4830-86f0-34ad0c0f456f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 200 len: 1228 microversion: 2.1 time: 0.453055 Sep 10 10:38:15.623854 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 478/984] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:15 2022] GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 1228 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:15.628602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:15.629462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:15.635804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:15.636548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:15.637208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:15.638116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:15.638775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:15.639387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:15.844547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:15.854359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:15.859477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:15.861847 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4745a715-4e4b-4873-98f0-1eb0ae868254 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1412 microversion: 2.25 time: 0.236822 Sep 10 10:38:15.866309 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 479/985] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:15 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1412 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:38:15.871699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cbdfd56a-d31c-435f-9b28-395ad7a1800e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:15.877557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cbdfd56a-d31c-435f-9b28-395ad7a1800e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:15.887893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbdfd56a-d31c-435f-9b28-395ad7a1800e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:15.888421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbdfd56a-d31c-435f-9b28-395ad7a1800e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:15.888888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbdfd56a-d31c-435f-9b28-395ad7a1800e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:15.904032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbdfd56a-d31c-435f-9b28-395ad7a1800e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:15.904032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbdfd56a-d31c-435f-9b28-395ad7a1800e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:15.904032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbdfd56a-d31c-435f-9b28-395ad7a1800e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:15.940827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cbdfd56a-d31c-435f-9b28-395ad7a1800e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:16.085726 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cbdfd56a-d31c-435f-9b28-395ad7a1800e tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 204 len: 0 microversion: 2.1 time: 0.216755 Sep 10 10:38:16.088697 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 480/986] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:15 2022] DELETE /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:16.103971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c2d9cd1-ef03-420d-95a0-a9bfab8864c1 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:16.106556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c2d9cd1-ef03-420d-95a0-a9bfab8864c1 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:16.123774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c2d9cd1-ef03-420d-95a0-a9bfab8864c1 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:16.124278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c2d9cd1-ef03-420d-95a0-a9bfab8864c1 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:16.124720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c2d9cd1-ef03-420d-95a0-a9bfab8864c1 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:16.126981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c2d9cd1-ef03-420d-95a0-a9bfab8864c1 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:16.128940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c2d9cd1-ef03-420d-95a0-a9bfab8864c1 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:16.129426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c2d9cd1-ef03-420d-95a0-a9bfab8864c1 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:16.428454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-8c2d9cd1-ef03-420d-95a0-a9bfab8864c1 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lazy-loading 'services' on Instance uuid a8e9ca71-6d1b-4fc0-87dd-804a4a52745b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:38:16.659243 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c2d9cd1-ef03-420d-95a0-a9bfab8864c1 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments/e5019786-8cf8-4c30-a2f7-f740d971a763" status: 202 len: 0 microversion: 2.1 time: 0.566573 Sep 10 10:38:16.661690 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 481/987] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 10:38:16 2022] DELETE /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments/e5019786-8cf8-4c30-a2f7-f740d971a763 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:38:16.679763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07bc7168-4a24-4919-9f3b-f96173da28a4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:16.681493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07bc7168-4a24-4919-9f3b-f96173da28a4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:16.689754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07bc7168-4a24-4919-9f3b-f96173da28a4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:16.690418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07bc7168-4a24-4919-9f3b-f96173da28a4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:16.691545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07bc7168-4a24-4919-9f3b-f96173da28a4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:16.691745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07bc7168-4a24-4919-9f3b-f96173da28a4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:16.692324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07bc7168-4a24-4919-9f3b-f96173da28a4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:16.692937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07bc7168-4a24-4919-9f3b-f96173da28a4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:17.029973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-07bc7168-4a24-4919-9f3b-f96173da28a4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:17.041307 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07bc7168-4a24-4919-9f3b-f96173da28a4 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1472 microversion: 2.1 time: 0.376649 Sep 10 10:38:17.057330 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 482/988] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:16 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:17.064649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b236bb49-8c0e-47a3-939d-c55b24b10fd7 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:17.065405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b236bb49-8c0e-47a3-939d-c55b24b10fd7 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:17.073358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b236bb49-8c0e-47a3-939d-c55b24b10fd7 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:17.073857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b236bb49-8c0e-47a3-939d-c55b24b10fd7 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:17.074292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b236bb49-8c0e-47a3-939d-c55b24b10fd7 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:17.075682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b236bb49-8c0e-47a3-939d-c55b24b10fd7 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:17.076141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b236bb49-8c0e-47a3-939d-c55b24b10fd7 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:17.076801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b236bb49-8c0e-47a3-939d-c55b24b10fd7 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:17.241017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b236bb49-8c0e-47a3-939d-c55b24b10fd7 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:17.259977 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b236bb49-8c0e-47a3-939d-c55b24b10fd7 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 200 len: 1276 microversion: 2.1 time: 0.196658 Sep 10 10:38:17.260595 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 483/989] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:17 2022] GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:17.272235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc80aab4-7e79-4e31-a6bb-7b9439b88122 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:17.275238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dc80aab4-7e79-4e31-a6bb-7b9439b88122 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:17.293682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc80aab4-7e79-4e31-a6bb-7b9439b88122 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:17.294300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc80aab4-7e79-4e31-a6bb-7b9439b88122 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:17.299661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc80aab4-7e79-4e31-a6bb-7b9439b88122 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:17.309242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc80aab4-7e79-4e31-a6bb-7b9439b88122 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:17.309866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc80aab4-7e79-4e31-a6bb-7b9439b88122 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:17.310413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc80aab4-7e79-4e31-a6bb-7b9439b88122 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:17.380326 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dc80aab4-7e79-4e31-a6bb-7b9439b88122 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114630 Sep 10 10:38:17.381436 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 484/990] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:38:17 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:17.389428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:17.393033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:17.409462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:17.409968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:17.410411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:17.411125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:17.411577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:17.412000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:17.454365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:17.735644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:17.752923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:17.759222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:17.763876 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0f75d28-b6c2-4552-a8c9-34400b1514b5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1412 microversion: 2.25 time: 0.381165 Sep 10 10:38:17.766978 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 485/991] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:17 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1412 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:38:18.124915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-549841207", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "ce8dfd77-285f-48ef-8c16-680bc1a3373b"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:18.232576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] validate_networks() for [('ce8dfd77-285f-48ef-8c16-680bc1a3373b', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:38:19.521850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:38:19.523168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:38:19.523882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:38:19.525144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:38:19.527102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:38:19.559215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:19.560187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:19.562222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:19.563896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:19.567108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:19.567861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:19.620820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Getting quotas for project 2241042726464bb38ae2376211eeaa9b. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:38:19.632673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Getting quotas for user d8f46993376d436b8242e986606b7c22 and project 2241042726464bb38ae2376211eeaa9b. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:38:19.666952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:38:19.677803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:38:19.827317 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.874972 Sep 10 10:38:19.835498 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 486/992] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:38:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 10:38:19.864897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:19.869124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:19.885003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:19.887694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:19.889286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:19.892014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:19.893859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:19.894487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:19.970005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:19.971512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:19.974880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:19.975544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lazy-loading 'fault' on Instance uuid eedcceae-bebe-4119-aeda-1654f917c921 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:38:20.113044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:20.123162 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c0a5301-76f3-460f-8513-5b5f5796bb5a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 200 len: 1306 microversion: 2.1 time: 0.286277 Sep 10 10:38:20.141099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 487/993] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:19 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 1306 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:20.146066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-916734cc-3789-4548-8c07-2a6e7c6aafa1 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:20.149774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-916734cc-3789-4548-8c07-2a6e7c6aafa1 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:20.160747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-916734cc-3789-4548-8c07-2a6e7c6aafa1 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:20.162342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-916734cc-3789-4548-8c07-2a6e7c6aafa1 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:20.166977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-916734cc-3789-4548-8c07-2a6e7c6aafa1 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:20.167888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-916734cc-3789-4548-8c07-2a6e7c6aafa1 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:20.171366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-916734cc-3789-4548-8c07-2a6e7c6aafa1 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:20.172055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-916734cc-3789-4548-8c07-2a6e7c6aafa1 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:20.841123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-916734cc-3789-4548-8c07-2a6e7c6aafa1 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:20.855738 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-916734cc-3789-4548-8c07-2a6e7c6aafa1 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 200 len: 1324 microversion: 2.1 time: 0.727315 Sep 10 10:38:20.861332 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 488/994] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:20 2022] GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 1324 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:20.871176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d8df1f50-b3eb-4568-a82a-22735fac2486 req-ef8a9aab-bb5f-42d3-ae8e-81ad0fb35fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf4f355-1582-4020-a738-9d8579be881b", "name": "network-vif-plugged", "status": "completed", "tag": "5c9581bc-bf42-47dd-b446-4cf4841d36b7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:20.890567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d8df1f50-b3eb-4568-a82a-22735fac2486 req-ef8a9aab-bb5f-42d3-ae8e-81ad0fb35fb1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:20.897626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d8df1f50-b3eb-4568-a82a-22735fac2486 req-ef8a9aab-bb5f-42d3-ae8e-81ad0fb35fb1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:20.898323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d8df1f50-b3eb-4568-a82a-22735fac2486 req-ef8a9aab-bb5f-42d3-ae8e-81ad0fb35fb1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:20.924141 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d8df1f50-b3eb-4568-a82a-22735fac2486 req-ef8a9aab-bb5f-42d3-ae8e-81ad0fb35fb1 service nova] Creating event network-vif-plugged:5c9581bc-bf42-47dd-b446-4cf4841d36b7 for instance 7bf4f355-1582-4020-a738-9d8579be881b on n-h2-856894-1 Sep 10 10:38:20.934916 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d8df1f50-b3eb-4568-a82a-22735fac2486 req-ef8a9aab-bb5f-42d3-ae8e-81ad0fb35fb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071985 Sep 10 10:38:20.941310 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 489/995] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:20.953785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86359d90-8658-42a5-9eaf-80c262785907 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:20.958722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86359d90-8658-42a5-9eaf-80c262785907 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:20.980469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86359d90-8658-42a5-9eaf-80c262785907 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:20.981094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86359d90-8658-42a5-9eaf-80c262785907 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:20.983783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86359d90-8658-42a5-9eaf-80c262785907 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:20.990447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86359d90-8658-42a5-9eaf-80c262785907 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:20.991022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86359d90-8658-42a5-9eaf-80c262785907 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:20.993180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86359d90-8658-42a5-9eaf-80c262785907 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:21.068394 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86359d90-8658-42a5-9eaf-80c262785907 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125618 Sep 10 10:38:21.069297 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 490/996] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:38:20 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:21.076724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-06512dc4-7a70-4794-a9a1-765824da2259 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:21.080974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-06512dc4-7a70-4794-a9a1-765824da2259 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:21.092229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06512dc4-7a70-4794-a9a1-765824da2259 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:21.093047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06512dc4-7a70-4794-a9a1-765824da2259 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:21.093806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06512dc4-7a70-4794-a9a1-765824da2259 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:21.094949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06512dc4-7a70-4794-a9a1-765824da2259 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:21.095815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06512dc4-7a70-4794-a9a1-765824da2259 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:21.096458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06512dc4-7a70-4794-a9a1-765824da2259 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:21.168101 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-06512dc4-7a70-4794-a9a1-765824da2259 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094256 Sep 10 10:38:21.175380 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 491/997] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:38:21 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:21.190798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:21.191833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:21.209191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:21.210735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:21.211187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:21.214834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:21.215327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:21.217180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:22.012037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:22.026275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:22.028679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:22.033118 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9868c788-5c76-4c5e-9ba2-fa3f4b7adcd4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1412 microversion: 2.25 time: 0.856307 Sep 10 10:38:22.037939 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 492/998] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:21 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1412 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:38:22.042920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-048f19f4-4305-47c6-8d36-c0489bc474c1 req-fa13bb58-34e1-4fdd-92e5-65b2e2ee9035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eedcceae-bebe-4119-aeda-1654f917c921", "name": "network-vif-deleted", "tag": "308595f2-1096-4350-a976-894a61762f62"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:22.070686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-048f19f4-4305-47c6-8d36-c0489bc474c1 req-fa13bb58-34e1-4fdd-92e5-65b2e2ee9035 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:22.074679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-048f19f4-4305-47c6-8d36-c0489bc474c1 req-fa13bb58-34e1-4fdd-92e5-65b2e2ee9035 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:22.075494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-048f19f4-4305-47c6-8d36-c0489bc474c1 req-fa13bb58-34e1-4fdd-92e5-65b2e2ee9035 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:22.104767 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-048f19f4-4305-47c6-8d36-c0489bc474c1 req-fa13bb58-34e1-4fdd-92e5-65b2e2ee9035 service nova] Creating event network-vif-deleted:308595f2-1096-4350-a976-894a61762f62 for instance eedcceae-bebe-4119-aeda-1654f917c921 on n-h1-856894-1 Sep 10 10:38:22.120008 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-048f19f4-4305-47c6-8d36-c0489bc474c1 req-fa13bb58-34e1-4fdd-92e5-65b2e2ee9035 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079629 Sep 10 10:38:22.122966 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 493/999] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:22.132755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-16644831-2e1e-4278-a3e8-dc9a04838c55 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:22.139633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-16644831-2e1e-4278-a3e8-dc9a04838c55 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:22.175424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16644831-2e1e-4278-a3e8-dc9a04838c55 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:22.176200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16644831-2e1e-4278-a3e8-dc9a04838c55 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:22.176818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16644831-2e1e-4278-a3e8-dc9a04838c55 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:22.179307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16644831-2e1e-4278-a3e8-dc9a04838c55 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:22.180001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16644831-2e1e-4278-a3e8-dc9a04838c55 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:22.182239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16644831-2e1e-4278-a3e8-dc9a04838c55 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:22.227399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=50 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:22.339290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=20 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:22.377142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-16644831-2e1e-4278-a3e8-dc9a04838c55 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:22.394415 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-16644831-2e1e-4278-a3e8-dc9a04838c55 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1286 microversion: 2.1 time: 0.269660 Sep 10 10:38:22.395289 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 494/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:22 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1286 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:22.408731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:22.411297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: eedcceae-bebe-4119-aeda-1654f917c921] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:22.425877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:22.428676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:22.429347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:22.431517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:22.432175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:22.433219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:22.467162 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] HTTP exception thrown: Instance eedcceae-bebe-4119-aeda-1654f917c921 could not be found. Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Request method failure captured: Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 HTTP/1.1 Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhjI0mBqovPP_llH0i9ni5xLfpitYZ9to6OfdBtLoayGJQT5xzq7QKB27fo9vkreHidq0J1x2CX58WsSrHegIUCYsoMBlyuMHcTRQwcLNBdhUi5REBsXOKdRMO2cK9AjuPfavjPXujwLasNtH09EmYLXj_3SbG_oM5FX9r90EDM1Ok Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:22.470741 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_357ca1336b634d0389fff733e6e26ca0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 60543e7cbbb0451bb8b1929437b2a0ea Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance eedcceae-bebe-4119-aeda-1654f917c921 could not be found. Sep 10 10:38:22.472335 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'eedcceae-bebe-4119-aeda-1654f917c921'} Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eedcceae-bebe-4119-aeda-1654f917c921 could not be found. Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:22.473245 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eedcceae-bebe-4119-aeda-1654f917c921 could not be found. Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eedcceae-bebe-4119-aeda-1654f917c921 could not be found. Sep 10 10:38:22.474694 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:22.477596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Returning 404 to user: Instance eedcceae-bebe-4119-aeda-1654f917c921 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:22.478636 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-33e665c5-dad8-4647-ad40-70a7144f3b52 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921" status: 404 len: 111 microversion: 2.1 time: 0.080740 Sep 10 10:38:22.480314 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 495/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:22 2022] GET /compute/v2.1/servers/eedcceae-bebe-4119-aeda-1654f917c921 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:22.492045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8b0e272-b9bd-46c5-a54c-4e6faba9b61e tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:22.494786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e8b0e272-b9bd-46c5-a54c-4e6faba9b61e tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:22.513401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8b0e272-b9bd-46c5-a54c-4e6faba9b61e tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:22.514895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8b0e272-b9bd-46c5-a54c-4e6faba9b61e tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:22.516716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8b0e272-b9bd-46c5-a54c-4e6faba9b61e tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:22.518578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8b0e272-b9bd-46c5-a54c-4e6faba9b61e tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:22.521596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8b0e272-b9bd-46c5-a54c-4e6faba9b61e tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:22.522277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8b0e272-b9bd-46c5-a54c-4e6faba9b61e tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:22.685229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-e8b0e272-b9bd-46c5-a54c-4e6faba9b61e tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lazy-loading 'services' on Instance uuid 7d649fdd-c8f0-4b15-9434-32d88f643ed1 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:38:22.794350 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8b0e272-b9bd-46c5-a54c-4e6faba9b61e tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-volume_attachments/2017e569-0149-4da6-8d7f-ef3fc7308081" status: 202 len: 0 microversion: 2.1 time: 0.312080 Sep 10 10:38:22.804695 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 496/1002] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 10:38:22 2022] DELETE /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-volume_attachments/2017e569-0149-4da6-8d7f-ef3fc7308081 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:38:22.826611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-93d32578-44c9-4594-9fcf-43864f083b5c req-55243c70-d65c-4329-89b1-50314d8a2724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575a3c7a-4117-41ba-b077-bae7057bc385", "tag": "7b405912-28fa-479e-8a19-a8e0e8ac9641"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:22.851834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-93d32578-44c9-4594-9fcf-43864f083b5c req-55243c70-d65c-4329-89b1-50314d8a2724 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:22.852610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-93d32578-44c9-4594-9fcf-43864f083b5c req-55243c70-d65c-4329-89b1-50314d8a2724 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:22.853293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-93d32578-44c9-4594-9fcf-43864f083b5c req-55243c70-d65c-4329-89b1-50314d8a2724 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:22.868328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-93d32578-44c9-4594-9fcf-43864f083b5c req-55243c70-d65c-4329-89b1-50314d8a2724 service nova] Creating event network-changed:7b405912-28fa-479e-8a19-a8e0e8ac9641 for instance 575a3c7a-4117-41ba-b077-bae7057bc385 on n-h2-856894-1 Sep 10 10:38:22.876237 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-93d32578-44c9-4594-9fcf-43864f083b5c req-55243c70-d65c-4329-89b1-50314d8a2724 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067630 Sep 10 10:38:22.877639 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 497/1003] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:22.885016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60321d27-4d81-43a1-afbb-ace403d1c934 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:22.886034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60321d27-4d81-43a1-afbb-ace403d1c934 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:22.899707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60321d27-4d81-43a1-afbb-ace403d1c934 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:22.900780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60321d27-4d81-43a1-afbb-ace403d1c934 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:22.901478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60321d27-4d81-43a1-afbb-ace403d1c934 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:22.902793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60321d27-4d81-43a1-afbb-ace403d1c934 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:22.903565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60321d27-4d81-43a1-afbb-ace403d1c934 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:22.904191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60321d27-4d81-43a1-afbb-ace403d1c934 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:23.369135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60321d27-4d81-43a1-afbb-ace403d1c934 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:23.378843 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60321d27-4d81-43a1-afbb-ace403d1c934 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 200 len: 1324 microversion: 2.1 time: 0.499812 Sep 10 10:38:23.379664 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 498/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:22 2022] GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 1324 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:23.384857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95e0f9b6-74f5-4e65-bc20-242804bbcf8f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:23.387188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95e0f9b6-74f5-4e65-bc20-242804bbcf8f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:23.399412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95e0f9b6-74f5-4e65-bc20-242804bbcf8f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:23.400435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95e0f9b6-74f5-4e65-bc20-242804bbcf8f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:23.401042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95e0f9b6-74f5-4e65-bc20-242804bbcf8f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:23.402249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95e0f9b6-74f5-4e65-bc20-242804bbcf8f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:23.403126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95e0f9b6-74f5-4e65-bc20-242804bbcf8f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:23.403713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95e0f9b6-74f5-4e65-bc20-242804bbcf8f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:23.445649 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95e0f9b6-74f5-4e65-bc20-242804bbcf8f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064675 Sep 10 10:38:23.452202 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 499/1005] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:38:23 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:23.459473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-993536bb-4d2a-4212-8f06-7bbc69904c6d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:23.460406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-993536bb-4d2a-4212-8f06-7bbc69904c6d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c1be72b7-1010-4f8d-84c0-27c703292bb0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:23.469871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993536bb-4d2a-4212-8f06-7bbc69904c6d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:23.470702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993536bb-4d2a-4212-8f06-7bbc69904c6d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:23.471413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993536bb-4d2a-4212-8f06-7bbc69904c6d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:23.472610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993536bb-4d2a-4212-8f06-7bbc69904c6d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:23.473842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993536bb-4d2a-4212-8f06-7bbc69904c6d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:23.474697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993536bb-4d2a-4212-8f06-7bbc69904c6d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:23.509006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-993536bb-4d2a-4212-8f06-7bbc69904c6d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c1be72b7-1010-4f8d-84c0-27c703292bb0] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:23.724247 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-993536bb-4d2a-4212-8f06-7bbc69904c6d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0" status: 204 len: 0 microversion: 2.1 time: 0.269732 Sep 10 10:38:23.726060 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 500/1006] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:23 2022] DELETE /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:23.735706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:23.737041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:23.747502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:23.748558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:23.749002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:23.750635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:23.751669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:23.752120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:24.271802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:24.300588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:24.304665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:24.306904 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6499746-7c65-4744-8831-86ab41ec6815 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1608 microversion: 2.25 time: 0.579303 Sep 10 10:38:24.329440 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 501/1007] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:38:23 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1608 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:38:24.345233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d78fcbaf-93c2-4332-8c50-be289226eeac tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:24.345858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d78fcbaf-93c2-4332-8c50-be289226eeac tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:24.354916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d78fcbaf-93c2-4332-8c50-be289226eeac tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:24.355413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d78fcbaf-93c2-4332-8c50-be289226eeac tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:24.355847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d78fcbaf-93c2-4332-8c50-be289226eeac tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:24.356621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d78fcbaf-93c2-4332-8c50-be289226eeac tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:24.357099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d78fcbaf-93c2-4332-8c50-be289226eeac tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:24.357587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d78fcbaf-93c2-4332-8c50-be289226eeac tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:24.883146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d78fcbaf-93c2-4332-8c50-be289226eeac tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:24.886879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:24.891918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d78fcbaf-93c2-4332-8c50-be289226eeac tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1316 microversion: 2.1 time: 0.561154 Sep 10 10:38:24.901773 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 502/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:24 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:24.923859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4da52ffa-7c2e-4836-90e7-1b724f57efba tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:24.930070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4da52ffa-7c2e-4836-90e7-1b724f57efba tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:24.940286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da52ffa-7c2e-4836-90e7-1b724f57efba tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:24.940880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da52ffa-7c2e-4836-90e7-1b724f57efba tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:24.941622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da52ffa-7c2e-4836-90e7-1b724f57efba tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:24.942411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da52ffa-7c2e-4836-90e7-1b724f57efba tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:24.943080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da52ffa-7c2e-4836-90e7-1b724f57efba tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:24.943646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da52ffa-7c2e-4836-90e7-1b724f57efba tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:25.008114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4da52ffa-7c2e-4836-90e7-1b724f57efba tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:25.157981 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4da52ffa-7c2e-4836-90e7-1b724f57efba tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71" status: 204 len: 0 microversion: 2.1 time: 0.254116 Sep 10 10:38:25.159618 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 503/1009] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:24 2022] DELETE /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:25.187363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b3075dbc-f8ac-4fb0-88e9-6ca0fc8274a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:25.189588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b3075dbc-f8ac-4fb0-88e9-6ca0fc8274a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:25.201541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:25.205818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3075dbc-f8ac-4fb0-88e9-6ca0fc8274a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:25.207494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3075dbc-f8ac-4fb0-88e9-6ca0fc8274a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:25.207997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3075dbc-f8ac-4fb0-88e9-6ca0fc8274a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:25.209642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3075dbc-f8ac-4fb0-88e9-6ca0fc8274a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:25.211191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3075dbc-f8ac-4fb0-88e9-6ca0fc8274a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:25.213215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3075dbc-f8ac-4fb0-88e9-6ca0fc8274a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:25.530883 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b3075dbc-f8ac-4fb0-88e9-6ca0fc8274a6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.369977 Sep 10 10:38:25.532285 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 504/1010] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Sep 10 10:38:25 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-interface => generated 284 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:38:25.538256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-571501a9-ac5f-4098-b3e8-953684ecf908 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:25.539561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-571501a9-ac5f-4098-b3e8-953684ecf908 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:25.554678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571501a9-ac5f-4098-b3e8-953684ecf908 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:25.555409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571501a9-ac5f-4098-b3e8-953684ecf908 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:25.555860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571501a9-ac5f-4098-b3e8-953684ecf908 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:25.556571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571501a9-ac5f-4098-b3e8-953684ecf908 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:25.557034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571501a9-ac5f-4098-b3e8-953684ecf908 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:25.557485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571501a9-ac5f-4098-b3e8-953684ecf908 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:25.959852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-571501a9-ac5f-4098-b3e8-953684ecf908 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:25.972758 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-571501a9-ac5f-4098-b3e8-953684ecf908 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 200 len: 1324 microversion: 2.1 time: 0.439000 Sep 10 10:38:25.977730 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 505/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:25 2022] GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:25.992862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b31afb15-5ffa-4843-9dc0-804797ac5800 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:25.995710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b31afb15-5ffa-4843-9dc0-804797ac5800 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:26.027199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b31afb15-5ffa-4843-9dc0-804797ac5800 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:26.040481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b31afb15-5ffa-4843-9dc0-804797ac5800 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:26.041059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b31afb15-5ffa-4843-9dc0-804797ac5800 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:26.041855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b31afb15-5ffa-4843-9dc0-804797ac5800 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:26.042338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b31afb15-5ffa-4843-9dc0-804797ac5800 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:26.042768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b31afb15-5ffa-4843-9dc0-804797ac5800 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:26.115976 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b31afb15-5ffa-4843-9dc0-804797ac5800 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.136851 Sep 10 10:38:26.116937 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 506/1012] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:38:25 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:38:26.121589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0e3834c-dfb9-4c1d-93d7-a5c3891a6837 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:26.133713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0e3834c-dfb9-4c1d-93d7-a5c3891a6837 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c1be72b7-1010-4f8d-84c0-27c703292bb0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:26.140799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0e3834c-dfb9-4c1d-93d7-a5c3891a6837 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:26.141563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0e3834c-dfb9-4c1d-93d7-a5c3891a6837 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:26.142173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0e3834c-dfb9-4c1d-93d7-a5c3891a6837 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:26.143058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0e3834c-dfb9-4c1d-93d7-a5c3891a6837 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:26.143667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0e3834c-dfb9-4c1d-93d7-a5c3891a6837 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:26.144435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0e3834c-dfb9-4c1d-93d7-a5c3891a6837 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:27.113008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a0e3834c-dfb9-4c1d-93d7-a5c3891a6837 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:27.125606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a0e3834c-dfb9-4c1d-93d7-a5c3891a6837 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0" status: 200 len: 1474 microversion: 2.1 time: 1.005258 Sep 10 10:38:27.142072 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 507/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:26 2022] GET /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0 => generated 1474 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:27.147297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27ccf901-689b-4418-a222-87df83f993a1 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:27.148126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-27ccf901-689b-4418-a222-87df83f993a1 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:27.155417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ccf901-689b-4418-a222-87df83f993a1 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:27.156145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ccf901-689b-4418-a222-87df83f993a1 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:27.156870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ccf901-689b-4418-a222-87df83f993a1 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:27.157762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ccf901-689b-4418-a222-87df83f993a1 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:27.158396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ccf901-689b-4418-a222-87df83f993a1 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:27.159409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ccf901-689b-4418-a222-87df83f993a1 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:27.732047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-27ccf901-689b-4418-a222-87df83f993a1 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:27.773872 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27ccf901-689b-4418-a222-87df83f993a1 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1316 microversion: 2.1 time: 0.629585 Sep 10 10:38:27.776140 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 508/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:27 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1316 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:27.790480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-958182220", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "88b7cffb-d5ed-46dd-8cd2-9204c185f298"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:27.898368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] validate_networks() for [('88b7cffb-d5ed-46dd-8cd2-9204c185f298', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:38:29.277772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:38:29.278445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:38:29.278688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:38:29.279344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:38:29.279933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:38:29.296859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:29.309908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:29.310672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:29.311720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:29.312385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:29.313025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:29.355807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Getting quotas for project c6445fbb5cc5424c82a3c6d07abf7285. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:38:29.362280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Getting quotas for user 7376851ce7e84c71a18d7d2ac36e5d1f and project c6445fbb5cc5424c82a3c6d07abf7285. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:38:29.389550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:38:29.404663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:38:29.502268 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36f76012-ac5f-4953-bf5c-1ff76001b1ec tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724854 Sep 10 10:38:29.503593 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 509/1015] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:38:29.514167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1d7d2c9-3685-4860-92d4-ae9f9f9e1a5c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:29.515164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1d7d2c9-3685-4860-92d4-ae9f9f9e1a5c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:29.541113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1d7d2c9-3685-4860-92d4-ae9f9f9e1a5c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:29.541628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1d7d2c9-3685-4860-92d4-ae9f9f9e1a5c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:29.542086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1d7d2c9-3685-4860-92d4-ae9f9f9e1a5c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:29.542790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1d7d2c9-3685-4860-92d4-ae9f9f9e1a5c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:29.543248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1d7d2c9-3685-4860-92d4-ae9f9f9e1a5c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:29.543676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1d7d2c9-3685-4860-92d4-ae9f9f9e1a5c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:30.042413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c1d7d2c9-3685-4860-92d4-ae9f9f9e1a5c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:30.051894 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1d7d2c9-3685-4860-92d4-ae9f9f9e1a5c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 200 len: 1324 microversion: 2.1 time: 0.546978 Sep 10 10:38:30.052491 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 510/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:29 2022] GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 1324 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:30.068899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f83f1305-7bd3-4ebc-803f-bff0d856e460 req-fc436a66-5008-4e82-8586-a9647dd0c72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23eada90-68cc-4481-82cf-c536ef3fcc71", "name": "network-vif-deleted", "tag": "c0320f23-8c07-4224-847b-62bd846dc47d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:30.089412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f83f1305-7bd3-4ebc-803f-bff0d856e460 req-fc436a66-5008-4e82-8586-a9647dd0c72f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:30.090417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f83f1305-7bd3-4ebc-803f-bff0d856e460 req-fc436a66-5008-4e82-8586-a9647dd0c72f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:30.091493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f83f1305-7bd3-4ebc-803f-bff0d856e460 req-fc436a66-5008-4e82-8586-a9647dd0c72f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:30.115979 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f83f1305-7bd3-4ebc-803f-bff0d856e460 req-fc436a66-5008-4e82-8586-a9647dd0c72f service nova] Creating event network-vif-deleted:c0320f23-8c07-4224-847b-62bd846dc47d for instance 23eada90-68cc-4481-82cf-c536ef3fcc71 on n-h2-856894-1 Sep 10 10:38:30.126899 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f83f1305-7bd3-4ebc-803f-bff0d856e460 req-fc436a66-5008-4e82-8586-a9647dd0c72f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070415 Sep 10 10:38:30.130231 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 511/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:30.136111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1b4026d7-7d0f-431d-a581-4093bd96e12e req-cfe6623b-3e60-4b92-888c-1f51bdf080c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1be72b7-1010-4f8d-84c0-27c703292bb0", "name": "network-vif-deleted", "tag": "40d8ed62-742d-47d4-ace6-1adbfa066aca"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:30.244929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b4026d7-7d0f-431d-a581-4093bd96e12e req-cfe6623b-3e60-4b92-888c-1f51bdf080c5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:30.245988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b4026d7-7d0f-431d-a581-4093bd96e12e req-cfe6623b-3e60-4b92-888c-1f51bdf080c5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:30.246437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b4026d7-7d0f-431d-a581-4093bd96e12e req-cfe6623b-3e60-4b92-888c-1f51bdf080c5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:30.268281 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1b4026d7-7d0f-431d-a581-4093bd96e12e req-cfe6623b-3e60-4b92-888c-1f51bdf080c5 service nova] Creating event network-vif-deleted:40d8ed62-742d-47d4-ace6-1adbfa066aca for instance c1be72b7-1010-4f8d-84c0-27c703292bb0 on n-h1-856894-1 Sep 10 10:38:30.286989 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1b4026d7-7d0f-431d-a581-4093bd96e12e req-cfe6623b-3e60-4b92-888c-1f51bdf080c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154861 Sep 10 10:38:30.288005 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 512/1018] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:30.294066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:30.294900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c1be72b7-1010-4f8d-84c0-27c703292bb0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:30.311348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:30.312592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:30.313343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:30.314549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:30.321357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:30.322116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:30.369646 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] HTTP exception thrown: Instance c1be72b7-1010-4f8d-84c0-27c703292bb0 could not be found. Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Request method failure captured: Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0 HTTP/1.1 Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhjI0mBqovPP_llH0i9ni5xLfpitYZ9to6OfdBtLoayGJQT5xzq7QKB27fo9vkreHidq0J1x2CX58WsSrHegIUCYsoMBlyuMHcTRQwcLNBdhUi5REBsXOKdRMO2cK9AjuPfavjPXujwLasNtH09EmYLXj_3SbG_oM5FX9r90EDM1Ok Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:30.371931 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_357ca1336b634d0389fff733e6e26ca0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 60543e7cbbb0451bb8b1929437b2a0ea Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance c1be72b7-1010-4f8d-84c0-27c703292bb0 could not be found. Sep 10 10:38:30.373767 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'c1be72b7-1010-4f8d-84c0-27c703292bb0'} Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1be72b7-1010-4f8d-84c0-27c703292bb0 could not be found. Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:30.374757 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1be72b7-1010-4f8d-84c0-27c703292bb0 could not be found. Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1be72b7-1010-4f8d-84c0-27c703292bb0 could not be found. Sep 10 10:38:30.379587 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:30.382822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Returning 404 to user: Instance c1be72b7-1010-4f8d-84c0-27c703292bb0 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:30.383751 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9896bb74-d808-4100-93a3-878f6e52e589 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0" status: 404 len: 111 microversion: 2.1 time: 0.094558 Sep 10 10:38:30.384664 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 513/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:30 2022] GET /compute/v2.1/servers/c1be72b7-1010-4f8d-84c0-27c703292bb0 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:30.390789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c36ae48-96a7-4864-b2ff-6f2988e81d27 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:30.393902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c36ae48-96a7-4864-b2ff-6f2988e81d27 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:30.406377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c36ae48-96a7-4864-b2ff-6f2988e81d27 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:30.406878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c36ae48-96a7-4864-b2ff-6f2988e81d27 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:30.407320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c36ae48-96a7-4864-b2ff-6f2988e81d27 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:30.408022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c36ae48-96a7-4864-b2ff-6f2988e81d27 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:30.408483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c36ae48-96a7-4864-b2ff-6f2988e81d27 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:30.411650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c36ae48-96a7-4864-b2ff-6f2988e81d27 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:31.028107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3c36ae48-96a7-4864-b2ff-6f2988e81d27 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:31.038459 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c36ae48-96a7-4864-b2ff-6f2988e81d27 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1316 microversion: 2.1 time: 0.652432 Sep 10 10:38:31.046158 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 514/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:30 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:31.061492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9335009a-9633-45be-9fb7-2c2e4f4dd543 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:31.064835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9335009a-9633-45be-9fb7-2c2e4f4dd543 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:31.082188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9335009a-9633-45be-9fb7-2c2e4f4dd543 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:31.084863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9335009a-9633-45be-9fb7-2c2e4f4dd543 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:31.085491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9335009a-9633-45be-9fb7-2c2e4f4dd543 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:31.087016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9335009a-9633-45be-9fb7-2c2e4f4dd543 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:31.090315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9335009a-9633-45be-9fb7-2c2e4f4dd543 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:31.091004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9335009a-9633-45be-9fb7-2c2e4f4dd543 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:31.335043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9335009a-9633-45be-9fb7-2c2e4f4dd543 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:31.351671 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9335009a-9633-45be-9fb7-2c2e4f4dd543 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2" status: 200 len: 1221 microversion: 2.1 time: 0.304007 Sep 10 10:38:31.356040 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 515/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:31 2022] GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 => generated 1221 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:31.362475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3d89b52d-8f0d-468f-af44-bb4362ae08c9 req-aa16d0b4-01df-4ed2-b215-baeb5930f9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575a3c7a-4117-41ba-b077-bae7057bc385", "name": "network-vif-plugged", "status": "completed", "tag": "7b405912-28fa-479e-8a19-a8e0e8ac9641"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:31.376227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d89b52d-8f0d-468f-af44-bb4362ae08c9 req-aa16d0b4-01df-4ed2-b215-baeb5930f9d4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:31.377258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d89b52d-8f0d-468f-af44-bb4362ae08c9 req-aa16d0b4-01df-4ed2-b215-baeb5930f9d4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:31.378008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d89b52d-8f0d-468f-af44-bb4362ae08c9 req-aa16d0b4-01df-4ed2-b215-baeb5930f9d4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:31.405184 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3d89b52d-8f0d-468f-af44-bb4362ae08c9 req-aa16d0b4-01df-4ed2-b215-baeb5930f9d4 service nova] Creating event network-vif-plugged:7b405912-28fa-479e-8a19-a8e0e8ac9641 for instance 575a3c7a-4117-41ba-b077-bae7057bc385 on n-h2-856894-1 Sep 10 10:38:31.411940 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3d89b52d-8f0d-468f-af44-bb4362ae08c9 req-aa16d0b4-01df-4ed2-b215-baeb5930f9d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053729 Sep 10 10:38:31.471816 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 516/1022] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:31.492135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:31.492978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 23eada90-68cc-4481-82cf-c536ef3fcc71] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:31.512368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:31.514386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:31.517459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:31.517671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:31.520663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:31.521804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:31.567130 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] HTTP exception thrown: Instance 23eada90-68cc-4481-82cf-c536ef3fcc71 could not be found. Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Request method failure captured: Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 HTTP/1.1 Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhjI0mBqovPP_llH0i9ni5xLfpitYZ9to6OfdBtLoayGJQT5xzq7QKB27fo9vkreHidq0J1x2CX58WsSrHegIUCYsoMBlyuMHcTRQwcLNBdhUi5REBsXOKdRMO2cK9AjuPfavjPXujwLasNtH09EmYLXj_3SbG_oM5FX9r90EDM1Ok Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:31.569638 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_357ca1336b634d0389fff733e6e26ca0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 60543e7cbbb0451bb8b1929437b2a0ea Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 23eada90-68cc-4481-82cf-c536ef3fcc71 could not be found. Sep 10 10:38:31.571786 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '23eada90-68cc-4481-82cf-c536ef3fcc71'} Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23eada90-68cc-4481-82cf-c536ef3fcc71 could not be found. Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:31.572563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23eada90-68cc-4481-82cf-c536ef3fcc71 could not be found. Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23eada90-68cc-4481-82cf-c536ef3fcc71 could not be found. Sep 10 10:38:31.573832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:31.592261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Returning 404 to user: Instance 23eada90-68cc-4481-82cf-c536ef3fcc71 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:31.595459 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eafbf278-2e4d-4aed-aff5-1835f3ce7e42 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71" status: 404 len: 111 microversion: 2.1 time: 0.119440 Sep 10 10:38:31.598350 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 517/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:31 2022] GET /compute/v2.1/servers/23eada90-68cc-4481-82cf-c536ef3fcc71 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:31.614474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-deb3ae94-d15e-43a9-9fc3-cd7806ffddd9 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:31.615102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-deb3ae94-d15e-43a9-9fc3-cd7806ffddd9 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:31.631981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-deb3ae94-d15e-43a9-9fc3-cd7806ffddd9 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:31.634678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-deb3ae94-d15e-43a9-9fc3-cd7806ffddd9 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:31.635596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-deb3ae94-d15e-43a9-9fc3-cd7806ffddd9 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:31.638352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-deb3ae94-d15e-43a9-9fc3-cd7806ffddd9 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:31.639569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-deb3ae94-d15e-43a9-9fc3-cd7806ffddd9 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:31.640612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-deb3ae94-d15e-43a9-9fc3-cd7806ffddd9 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:32.104254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-deb3ae94-d15e-43a9-9fc3-cd7806ffddd9 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:32.134209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-deb3ae94-d15e-43a9-9fc3-cd7806ffddd9 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 200 len: 1324 microversion: 2.1 time: 0.526706 Sep 10 10:38:32.135518 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 518/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:31 2022] GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 1324 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:32.144249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10ac2a3e-1ac6-4cab-b546-94fb592d388a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:32.236927 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10ac2a3e-1ac6-4cab-b546-94fb592d388a tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/b5ca0581-e82b-4914-a1ef-8642fb1514c8" status: 204 len: 0 microversion: 2.1 time: 0.095585 Sep 10 10:38:32.240847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 519/1025] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:38:32 2022] DELETE /compute/v2.1/os-server-groups/b5ca0581-e82b-4914-a1ef-8642fb1514c8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:32.247804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ddf17304-8e69-486d-865f-067ddbaa6f84 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:32.248831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ddf17304-8e69-486d-865f-067ddbaa6f84 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:32.266122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf17304-8e69-486d-865f-067ddbaa6f84 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:32.266943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf17304-8e69-486d-865f-067ddbaa6f84 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:32.267568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf17304-8e69-486d-865f-067ddbaa6f84 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:32.268459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf17304-8e69-486d-865f-067ddbaa6f84 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:32.271110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf17304-8e69-486d-865f-067ddbaa6f84 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:32.271865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf17304-8e69-486d-865f-067ddbaa6f84 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:33.062892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ddf17304-8e69-486d-865f-067ddbaa6f84 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:33.078532 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ddf17304-8e69-486d-865f-067ddbaa6f84 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1316 microversion: 2.1 time: 0.835953 Sep 10 10:38:33.079117 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 520/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:32 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1316 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:33.086245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-30f77e27-67a1-4247-a38a-2ef76325e9ad req-2c8a6fa7-aeaf-40af-93b6-9dfa1f44f951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf4f355-1582-4020-a738-9d8579be881b", "tag": "5c9581bc-bf42-47dd-b446-4cf4841d36b7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:33.109001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-30f77e27-67a1-4247-a38a-2ef76325e9ad req-2c8a6fa7-aeaf-40af-93b6-9dfa1f44f951 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:33.110787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-30f77e27-67a1-4247-a38a-2ef76325e9ad req-2c8a6fa7-aeaf-40af-93b6-9dfa1f44f951 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:33.111223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-30f77e27-67a1-4247-a38a-2ef76325e9ad req-2c8a6fa7-aeaf-40af-93b6-9dfa1f44f951 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:33.128990 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-30f77e27-67a1-4247-a38a-2ef76325e9ad req-2c8a6fa7-aeaf-40af-93b6-9dfa1f44f951 service nova] Creating event network-changed:5c9581bc-bf42-47dd-b446-4cf4841d36b7 for instance 7bf4f355-1582-4020-a738-9d8579be881b on n-h2-856894-1 Sep 10 10:38:33.136587 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-30f77e27-67a1-4247-a38a-2ef76325e9ad req-2c8a6fa7-aeaf-40af-93b6-9dfa1f44f951 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056094 Sep 10 10:38:33.137780 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 521/1027] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:33.142942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d823cfbd-1030-4a14-bdda-d9e9a04ff2b8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:33.143526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d823cfbd-1030-4a14-bdda-d9e9a04ff2b8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c5b96b02-53dc-4c3b-9955-bab2ba5161fc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:33.161387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d823cfbd-1030-4a14-bdda-d9e9a04ff2b8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:33.162076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d823cfbd-1030-4a14-bdda-d9e9a04ff2b8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:33.163076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d823cfbd-1030-4a14-bdda-d9e9a04ff2b8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:33.163935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d823cfbd-1030-4a14-bdda-d9e9a04ff2b8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:33.165715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d823cfbd-1030-4a14-bdda-d9e9a04ff2b8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:33.166659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d823cfbd-1030-4a14-bdda-d9e9a04ff2b8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:33.198948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d823cfbd-1030-4a14-bdda-d9e9a04ff2b8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c5b96b02-53dc-4c3b-9955-bab2ba5161fc] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:33.252135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:33.328505 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d823cfbd-1030-4a14-bdda-d9e9a04ff2b8 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c5b96b02-53dc-4c3b-9955-bab2ba5161fc" status: 204 len: 0 microversion: 2.1 time: 0.188117 Sep 10 10:38:33.329855 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 522/1028] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:33 2022] DELETE /compute/v2.1/servers/c5b96b02-53dc-4c3b-9955-bab2ba5161fc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:33.345939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-638c9c64-db4b-4d11-b156-fd21bc01abfa req-ce42da55-1bf3-429d-96b4-2fd74396ecff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979c4b7b-70c8-4234-ae4a-cc928b70462b", "tag": "0076597d-2651-44f6-9885-72831fb8eafe"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:33.372401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-638c9c64-db4b-4d11-b156-fd21bc01abfa req-ce42da55-1bf3-429d-96b4-2fd74396ecff service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:33.373854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-638c9c64-db4b-4d11-b156-fd21bc01abfa req-ce42da55-1bf3-429d-96b4-2fd74396ecff service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:33.374556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-638c9c64-db4b-4d11-b156-fd21bc01abfa req-ce42da55-1bf3-429d-96b4-2fd74396ecff service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:33.390283 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-638c9c64-db4b-4d11-b156-fd21bc01abfa req-ce42da55-1bf3-429d-96b4-2fd74396ecff service nova] Creating event network-changed:0076597d-2651-44f6-9885-72831fb8eafe for instance 979c4b7b-70c8-4234-ae4a-cc928b70462b on n-h1-856894-1 Sep 10 10:38:33.396638 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-638c9c64-db4b-4d11-b156-fd21bc01abfa req-ce42da55-1bf3-429d-96b4-2fd74396ecff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064522 Sep 10 10:38:33.397688 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 523/1029] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:33.405781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94aa0908-b20e-4313-99b1-7391f8f85fb0 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:33.406786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-94aa0908-b20e-4313-99b1-7391f8f85fb0 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:33.430705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94aa0908-b20e-4313-99b1-7391f8f85fb0 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:33.431624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94aa0908-b20e-4313-99b1-7391f8f85fb0 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:33.432332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94aa0908-b20e-4313-99b1-7391f8f85fb0 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:33.433362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94aa0908-b20e-4313-99b1-7391f8f85fb0 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:33.434107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94aa0908-b20e-4313-99b1-7391f8f85fb0 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:33.434905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94aa0908-b20e-4313-99b1-7391f8f85fb0 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:33.548393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-94aa0908-b20e-4313-99b1-7391f8f85fb0 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:33.559823 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94aa0908-b20e-4313-99b1-7391f8f85fb0 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2" status: 200 len: 1275 microversion: 2.1 time: 0.160416 Sep 10 10:38:33.565441 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 524/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:33 2022] GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:33.576047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f78a9cb6-403b-4324-814a-62de979aeb7e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:33.579584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f78a9cb6-403b-4324-814a-62de979aeb7e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:33.598011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f78a9cb6-403b-4324-814a-62de979aeb7e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:33.598517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f78a9cb6-403b-4324-814a-62de979aeb7e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:33.599646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f78a9cb6-403b-4324-814a-62de979aeb7e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:33.600590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f78a9cb6-403b-4324-814a-62de979aeb7e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:33.601300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f78a9cb6-403b-4324-814a-62de979aeb7e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:33.602568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f78a9cb6-403b-4324-814a-62de979aeb7e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:33.927331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f78a9cb6-403b-4324-814a-62de979aeb7e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:33.994025 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f78a9cb6-403b-4324-814a-62de979aeb7e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 200 len: 1518 microversion: 2.1 time: 0.419816 Sep 10 10:38:33.995556 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 525/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:33 2022] GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 1518 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:34.002475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc6dbcbe-49e0-44e1-9520-4e53f33e845b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:34.005901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cc6dbcbe-49e0-44e1-9520-4e53f33e845b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:34.040308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc6dbcbe-49e0-44e1-9520-4e53f33e845b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:34.044178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc6dbcbe-49e0-44e1-9520-4e53f33e845b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:34.044358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc6dbcbe-49e0-44e1-9520-4e53f33e845b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:34.045711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc6dbcbe-49e0-44e1-9520-4e53f33e845b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:34.046180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc6dbcbe-49e0-44e1-9520-4e53f33e845b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:34.046944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc6dbcbe-49e0-44e1-9520-4e53f33e845b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:34.099068 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cc6dbcbe-49e0-44e1-9520-4e53f33e845b tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101616 Sep 10 10:38:34.104916 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 526/1032] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:38:33 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:38:34.128297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e211ece7-5c9d-4428-aeae-2c08dcc7fa99 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:34.129051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e211ece7-5c9d-4428-aeae-2c08dcc7fa99 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:34.152284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e211ece7-5c9d-4428-aeae-2c08dcc7fa99 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:34.154921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e211ece7-5c9d-4428-aeae-2c08dcc7fa99 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:34.156172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e211ece7-5c9d-4428-aeae-2c08dcc7fa99 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:34.157499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e211ece7-5c9d-4428-aeae-2c08dcc7fa99 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:34.158127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e211ece7-5c9d-4428-aeae-2c08dcc7fa99 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:34.159066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e211ece7-5c9d-4428-aeae-2c08dcc7fa99 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:34.225598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e211ece7-5c9d-4428-aeae-2c08dcc7fa99 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:34.341985 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e211ece7-5c9d-4428-aeae-2c08dcc7fa99 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 204 len: 0 microversion: 2.1 time: 0.235380 Sep 10 10:38:34.342848 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 527/1033] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:34 2022] DELETE /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:34.348508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Action: 'action', calling method: .version_select at 0x7efcb0782790>, body: {"addFloatingIp": {"address": "172.25.6.204"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:34.351138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:34.359877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:34.360621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:34.361130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:34.361807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:34.362251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:34.362860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:34.434576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "refresh_cache-f1ec3aa3-5082-4375-83af-0108cfee103e" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:38:34.435245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquired lock "refresh_cache-f1ec3aa3-5082-4375-83af-0108cfee103e" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:38:38.202619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Building network info cache for instance {{(pid=128788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 10:38:39.324542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:39.384114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=18 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:39.595574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Updating instance_info_cache with network_info: [{"id": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf", "address": "fa:16:3e:8c:5f:46", "network": {"id": "a982d658-1052-468f-9779-6bee76fe373a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-38497816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "349a486eb0c34b76b50169c1dbe6b11f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape4e9db81-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:38:39.618578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Releasing lock "refresh_cache-f1ec3aa3-5082-4375-83af-0108cfee103e" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:38:39.619987 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d8c3a20b-1dae-468b-8ad6-48c446813a42 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "POST /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e/action" status: 202 len: 0 microversion: 2.1 time: 5.275592 Sep 10 10:38:39.625566 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 528/1034] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:38:34 2022] POST /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e/action => generated 0 bytes in 5282 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 10:38:39.631407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4712748b-e505-4959-9ded-1dbbdb7b79b8 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:39.632437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4712748b-e505-4959-9ded-1dbbdb7b79b8 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:39.639460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4712748b-e505-4959-9ded-1dbbdb7b79b8 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:39.640264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4712748b-e505-4959-9ded-1dbbdb7b79b8 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:39.640833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4712748b-e505-4959-9ded-1dbbdb7b79b8 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:39.641737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4712748b-e505-4959-9ded-1dbbdb7b79b8 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:39.642391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4712748b-e505-4959-9ded-1dbbdb7b79b8 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:39.642913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4712748b-e505-4959-9ded-1dbbdb7b79b8 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:39.828122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4712748b-e505-4959-9ded-1dbbdb7b79b8 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:39.836681 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4712748b-e505-4959-9ded-1dbbdb7b79b8 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1316 microversion: 2.1 time: 0.208614 Sep 10 10:38:39.837339 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 529/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:39 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:39.842386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1da40868-4747-4d58-b0dc-a202fb405c2c tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:39.844593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1da40868-4747-4d58-b0dc-a202fb405c2c tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:39.850527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da40868-4747-4d58-b0dc-a202fb405c2c tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:39.851015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da40868-4747-4d58-b0dc-a202fb405c2c tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:39.851449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da40868-4747-4d58-b0dc-a202fb405c2c tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:39.852186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da40868-4747-4d58-b0dc-a202fb405c2c tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:39.852638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da40868-4747-4d58-b0dc-a202fb405c2c tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:39.853063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da40868-4747-4d58-b0dc-a202fb405c2c tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:39.882017 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1da40868-4747-4d58-b0dc-a202fb405c2c tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043282 Sep 10 10:38:39.883315 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 530/1036] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:38:39 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:38:39.887409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:39.888012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c5b96b02-53dc-4c3b-9955-bab2ba5161fc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:39.893717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:39.894200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:39.894892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:39.895486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:39.895937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:39.896358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:39.910566 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] HTTP exception thrown: Instance c5b96b02-53dc-4c3b-9955-bab2ba5161fc could not be found. Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Request method failure captured: Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/c5b96b02-53dc-4c3b-9955-bab2ba5161fc HTTP/1.1 Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhjI0mBqovPP_llH0i9ni5xLfpitYZ9to6OfdBtLoayGJQT5xzq7QKB27fo9vkreHidq0J1x2CX58WsSrHegIUCYsoMBlyuMHcTRQwcLNBdhUi5REBsXOKdRMO2cK9AjuPfavjPXujwLasNtH09EmYLXj_3SbG_oM5FX9r90EDM1Ok Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:39.912351 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_357ca1336b634d0389fff733e6e26ca0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 60543e7cbbb0451bb8b1929437b2a0ea Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance c5b96b02-53dc-4c3b-9955-bab2ba5161fc could not be found. Sep 10 10:38:39.913918 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'c5b96b02-53dc-4c3b-9955-bab2ba5161fc'} Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b96b02-53dc-4c3b-9955-bab2ba5161fc could not be found. Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:39.914789 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b96b02-53dc-4c3b-9955-bab2ba5161fc could not be found. Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b96b02-53dc-4c3b-9955-bab2ba5161fc could not be found. Sep 10 10:38:39.915999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:39.917108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Returning 404 to user: Instance c5b96b02-53dc-4c3b-9955-bab2ba5161fc could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:39.917108 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d8abc8f-9548-4eaf-8180-ea4dcd7cb5fa tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c5b96b02-53dc-4c3b-9955-bab2ba5161fc" status: 404 len: 111 microversion: 2.1 time: 0.029611 Sep 10 10:38:39.917108 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 531/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:39 2022] GET /compute/v2.1/servers/c5b96b02-53dc-4c3b-9955-bab2ba5161fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:39.919386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e06afd9-85d0-4de2-b137-2df5019a61f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:39.920000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e06afd9-85d0-4de2-b137-2df5019a61f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:39.925923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e06afd9-85d0-4de2-b137-2df5019a61f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:39.926415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e06afd9-85d0-4de2-b137-2df5019a61f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:39.926854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e06afd9-85d0-4de2-b137-2df5019a61f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:39.927554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e06afd9-85d0-4de2-b137-2df5019a61f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:39.928014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e06afd9-85d0-4de2-b137-2df5019a61f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:39.928444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e06afd9-85d0-4de2-b137-2df5019a61f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:40.065002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e06afd9-85d0-4de2-b137-2df5019a61f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:40.073440 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e06afd9-85d0-4de2-b137-2df5019a61f6 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2" status: 200 len: 1317 microversion: 2.1 time: 0.158113 Sep 10 10:38:40.074105 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 532/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:39 2022] GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:40.078583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c99a7e11-11c6-4a86-bec6-7fd64b71676f req-8f144f3d-7c71-4675-9fd7-97e70e97db5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979c4b7b-70c8-4234-ae4a-cc928b70462b", "name": "network-vif-plugged", "status": "completed", "tag": "0076597d-2651-44f6-9885-72831fb8eafe"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:40.088313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c99a7e11-11c6-4a86-bec6-7fd64b71676f req-8f144f3d-7c71-4675-9fd7-97e70e97db5b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:40.089044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c99a7e11-11c6-4a86-bec6-7fd64b71676f req-8f144f3d-7c71-4675-9fd7-97e70e97db5b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:40.089506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c99a7e11-11c6-4a86-bec6-7fd64b71676f req-8f144f3d-7c71-4675-9fd7-97e70e97db5b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:40.104581 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c99a7e11-11c6-4a86-bec6-7fd64b71676f req-8f144f3d-7c71-4675-9fd7-97e70e97db5b service nova] Creating event network-vif-plugged:0076597d-2651-44f6-9885-72831fb8eafe for instance 979c4b7b-70c8-4234-ae4a-cc928b70462b on n-h1-856894-1 Sep 10 10:38:40.110051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c99a7e11-11c6-4a86-bec6-7fd64b71676f req-8f144f3d-7c71-4675-9fd7-97e70e97db5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034678 Sep 10 10:38:40.110678 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 533/1039] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:40.115862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4268f8bd-c78c-4b36-ad59-d10fa3206aea req-9e3b722c-359b-41c6-ae61-5381e09f0653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11e0506-bd95-40ae-9f3b-0a504c02fbd7", "name": "network-vif-deleted", "tag": "5e6172ec-9d0b-4969-b2c0-23558c7d02bf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:40.126994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4268f8bd-c78c-4b36-ad59-d10fa3206aea req-9e3b722c-359b-41c6-ae61-5381e09f0653 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:40.127376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4268f8bd-c78c-4b36-ad59-d10fa3206aea req-9e3b722c-359b-41c6-ae61-5381e09f0653 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:40.127816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4268f8bd-c78c-4b36-ad59-d10fa3206aea req-9e3b722c-359b-41c6-ae61-5381e09f0653 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:40.140486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4268f8bd-c78c-4b36-ad59-d10fa3206aea req-9e3b722c-359b-41c6-ae61-5381e09f0653 service nova] Creating event network-vif-deleted:5e6172ec-9d0b-4969-b2c0-23558c7d02bf for instance c11e0506-bd95-40ae-9f3b-0a504c02fbd7 on n-h1-856894-1 Sep 10 10:38:40.146804 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4268f8bd-c78c-4b36-ad59-d10fa3206aea req-9e3b722c-359b-41c6-ae61-5381e09f0653 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033898 Sep 10 10:38:40.147466 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 534/1040] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:40.158421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3853bd7c-f955-4912-a568-28f04221fb1a req-6cbe7e8f-9bd9-4985-a889-f2c8de9e62be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b96b02-53dc-4c3b-9955-bab2ba5161fc", "name": "network-vif-deleted", "tag": "cfb2f0a6-9704-4549-88b0-1a8eaae3dc8e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:40.169127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3853bd7c-f955-4912-a568-28f04221fb1a req-6cbe7e8f-9bd9-4985-a889-f2c8de9e62be service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:40.169616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3853bd7c-f955-4912-a568-28f04221fb1a req-6cbe7e8f-9bd9-4985-a889-f2c8de9e62be service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:40.170049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3853bd7c-f955-4912-a568-28f04221fb1a req-6cbe7e8f-9bd9-4985-a889-f2c8de9e62be service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:40.181637 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3853bd7c-f955-4912-a568-28f04221fb1a req-6cbe7e8f-9bd9-4985-a889-f2c8de9e62be service nova] Creating event network-vif-deleted:cfb2f0a6-9704-4549-88b0-1a8eaae3dc8e for instance c5b96b02-53dc-4c3b-9955-bab2ba5161fc on n-h1-856894-1 Sep 10 10:38:40.186603 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3853bd7c-f955-4912-a568-28f04221fb1a req-6cbe7e8f-9bd9-4985-a889-f2c8de9e62be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037775 Sep 10 10:38:40.187217 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 535/1041] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:40.192435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.204"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:40.194942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:40.201976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:40.202462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:40.202901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:40.203614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:40.204062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:40.204487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:40.230923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "refresh_cache-575a3c7a-4117-41ba-b077-bae7057bc385" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:38:40.231332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquired lock "refresh_cache-575a3c7a-4117-41ba-b077-bae7057bc385" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:38:42.145924 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.network.neutron [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] re-assign floating IP 172.25.6.204 from instance f1ec3aa3-5082-4375-83af-0108cfee103e Sep 10 10:38:42.194350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Building network info cache for instance {{(pid=128788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 10:38:42.751525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Updating instance_info_cache with network_info: [{"id": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf", "address": "fa:16:3e:8c:5f:46", "network": {"id": "a982d658-1052-468f-9779-6bee76fe373a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-38497816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "349a486eb0c34b76b50169c1dbe6b11f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape4e9db81-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:38:42.765862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Building network info cache for instance {{(pid=128788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 10:38:43.328340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Updating instance_info_cache with network_info: [{"id": "7b405912-28fa-479e-8a19-a8e0e8ac9641", "address": "fa:16:3e:f2:8e:30", "network": {"id": "a982d658-1052-468f-9779-6bee76fe373a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-38497816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "349a486eb0c34b76b50169c1dbe6b11f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7b405912-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:38:43.340983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Releasing lock "refresh_cache-575a3c7a-4117-41ba-b077-bae7057bc385" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:38:43.342440 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c550b927-7617-4cb3-834e-39839fcba911 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "POST /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385/action" status: 202 len: 0 microversion: 2.1 time: 3.154089 Sep 10 10:38:43.343441 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 536/1042] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:38:40 2022] POST /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385/action => generated 0 bytes in 3156 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 10:38:43.480259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2066038525", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "739381d7-2276-4bb9-bb8a-d3d8569e8efc"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:43.547544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] validate_networks() for [('739381d7-2276-4bb9-bb8a-d3d8569e8efc', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:38:43.978143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:38:43.978736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:38:43.979574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:38:43.979996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:38:43.980560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:38:43.983242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:43.994386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:43.995039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:43.995482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:43.996425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:43.996882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:43.997361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.019916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Getting quotas for project bb350b19a7254f0bbffb6e5b8dc2bbe3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:38:44.027178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Getting quotas for user a1013c609b044cb781dd1691909db7bf and project bb350b19a7254f0bbffb6e5b8dc2bbe3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:38:44.041557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:38:44.043870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:38:44.095008 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9126ed32-41fe-4c8d-9d35-c934a07a402f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749847 Sep 10 10:38:44.096139 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 537/1043] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:38:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:38:44.101281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:44.102991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: c11e0506-bd95-40ae-9f3b-0a504c02fbd7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:44.110118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.110851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.111453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.112320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.112938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.113530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.116523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:44.131469 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] HTTP exception thrown: Instance c11e0506-bd95-40ae-9f3b-0a504c02fbd7 could not be found. Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Request method failure captured: Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 HTTP/1.1 Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhjI0mBqovPP_llH0i9ni5xLfpitYZ9to6OfdBtLoayGJQT5xzq7QKB27fo9vkreHidq0J1x2CX58WsSrHegIUCYsoMBlyuMHcTRQwcLNBdhUi5REBsXOKdRMO2cK9AjuPfavjPXujwLasNtH09EmYLXj_3SbG_oM5FX9r90EDM1Ok Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:44.138573 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_357ca1336b634d0389fff733e6e26ca0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 60543e7cbbb0451bb8b1929437b2a0ea Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance c11e0506-bd95-40ae-9f3b-0a504c02fbd7 could not be found. Sep 10 10:38:44.140154 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'c11e0506-bd95-40ae-9f3b-0a504c02fbd7'} Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11e0506-bd95-40ae-9f3b-0a504c02fbd7 could not be found. Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:44.144215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11e0506-bd95-40ae-9f3b-0a504c02fbd7 could not be found. Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11e0506-bd95-40ae-9f3b-0a504c02fbd7 could not be found. Sep 10 10:38:44.147014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:44.150026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Returning 404 to user: Instance c11e0506-bd95-40ae-9f3b-0a504c02fbd7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:44.150026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-985b4213-eb09-4ce9-9427-c9b7aea437cf tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7" status: 404 len: 111 microversion: 2.1 time: 0.042792 Sep 10 10:38:44.150026 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 538/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:44 2022] GET /compute/v2.1/servers/c11e0506-bd95-40ae-9f3b-0a504c02fbd7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:44.154786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd226029-bf9f-4436-b9c6-4558137ad343 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:44.155410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd226029-bf9f-4436-b9c6-4558137ad343 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:44.165039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd226029-bf9f-4436-b9c6-4558137ad343 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.165933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd226029-bf9f-4436-b9c6-4558137ad343 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.166382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd226029-bf9f-4436-b9c6-4558137ad343 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.167108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd226029-bf9f-4436-b9c6-4558137ad343 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.167965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd226029-bf9f-4436-b9c6-4558137ad343 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.168724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd226029-bf9f-4436-b9c6-4558137ad343 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.200179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd226029-bf9f-4436-b9c6-4558137ad343 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:44.299785 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd226029-bf9f-4436-b9c6-4558137ad343 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 204 len: 0 microversion: 2.1 time: 0.149528 Sep 10 10:38:44.300774 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 539/1045] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:44 2022] DELETE /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:44.306598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1aca874e-8434-475f-8200-b9b9c2327c6f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:44.307222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1aca874e-8434-475f-8200-b9b9c2327c6f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:44.313296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aca874e-8434-475f-8200-b9b9c2327c6f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.313965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aca874e-8434-475f-8200-b9b9c2327c6f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.314728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aca874e-8434-475f-8200-b9b9c2327c6f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.315097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aca874e-8434-475f-8200-b9b9c2327c6f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.315558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aca874e-8434-475f-8200-b9b9c2327c6f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.315988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aca874e-8434-475f-8200-b9b9c2327c6f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.453504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1aca874e-8434-475f-8200-b9b9c2327c6f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:44.462441 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1aca874e-8434-475f-8200-b9b9c2327c6f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1505 microversion: 2.1 time: 0.160273 Sep 10 10:38:44.463055 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 540/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:44 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:44.468010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97845aaa-f0b3-47bb-99f7-ff134dbca90d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:44.468625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-97845aaa-f0b3-47bb-99f7-ff134dbca90d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:44.475446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97845aaa-f0b3-47bb-99f7-ff134dbca90d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.475920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97845aaa-f0b3-47bb-99f7-ff134dbca90d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.476471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97845aaa-f0b3-47bb-99f7-ff134dbca90d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.477256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97845aaa-f0b3-47bb-99f7-ff134dbca90d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.477819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97845aaa-f0b3-47bb-99f7-ff134dbca90d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.478191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97845aaa-f0b3-47bb-99f7-ff134dbca90d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.624236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-97845aaa-f0b3-47bb-99f7-ff134dbca90d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:44.631978 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-97845aaa-f0b3-47bb-99f7-ff134dbca90d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2" status: 200 len: 1317 microversion: 2.1 time: 0.167894 Sep 10 10:38:44.632550 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 541/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:44 2022] GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:44.637807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c0141e27-568f-41ca-9562-c99acb6893fd req-621b69c1-c9be-4fec-b078-b4c9698b82d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ec3aa3-5082-4375-83af-0108cfee103e", "tag": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf"}, {"name": "network-changed", "server_uuid": "7990b5bc-7c91-404f-99d0-dc02bb9875a2", "tag": "85cc2ade-c13d-4552-bf81-f8249685737f"}, {"name": "network-changed", "server_uuid": "f1ec3aa3-5082-4375-83af-0108cfee103e", "tag": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf"}, {"name": "network-changed", "server_uuid": "575a3c7a-4117-41ba-b077-bae7057bc385", "tag": "7b405912-28fa-479e-8a19-a8e0e8ac9641"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:44.650185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c0141e27-568f-41ca-9562-c99acb6893fd req-621b69c1-c9be-4fec-b078-b4c9698b82d9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.650663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c0141e27-568f-41ca-9562-c99acb6893fd req-621b69c1-c9be-4fec-b078-b4c9698b82d9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.651130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c0141e27-568f-41ca-9562-c99acb6893fd req-621b69c1-c9be-4fec-b078-b4c9698b82d9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.665350 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c0141e27-568f-41ca-9562-c99acb6893fd req-621b69c1-c9be-4fec-b078-b4c9698b82d9 service nova] Creating event network-changed:e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf for instance f1ec3aa3-5082-4375-83af-0108cfee103e on n-h1-856894-1 Sep 10 10:38:44.665872 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c0141e27-568f-41ca-9562-c99acb6893fd req-621b69c1-c9be-4fec-b078-b4c9698b82d9 service nova] Creating event network-changed:85cc2ade-c13d-4552-bf81-f8249685737f for instance 7990b5bc-7c91-404f-99d0-dc02bb9875a2 on n-h1-856894-1 Sep 10 10:38:44.666385 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c0141e27-568f-41ca-9562-c99acb6893fd req-621b69c1-c9be-4fec-b078-b4c9698b82d9 service nova] Creating event network-changed:e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf for instance f1ec3aa3-5082-4375-83af-0108cfee103e on n-h1-856894-1 Sep 10 10:38:44.666897 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c0141e27-568f-41ca-9562-c99acb6893fd req-621b69c1-c9be-4fec-b078-b4c9698b82d9 service nova] Creating event network-changed:7b405912-28fa-479e-8a19-a8e0e8ac9641 for instance 575a3c7a-4117-41ba-b077-bae7057bc385 on n-h2-856894-1 Sep 10 10:38:44.677097 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c0141e27-568f-41ca-9562-c99acb6893fd req-621b69c1-c9be-4fec-b078-b4c9698b82d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.042820 Sep 10 10:38:44.677739 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 542/1048] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:44.684236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Action: 'action', calling method: .version_select at 0x7efcb0782b80>, body: {"removeFloatingIp": {"address": "172.25.6.204"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:44.809405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:44.815682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.816165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.816598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:44.817333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:44.817786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:44.818205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:45.104911 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] HTTP exception thrown: Floating IP 172.25.6.204 is not associated with instance f1ec3aa3-5082-4375-83af-0108cfee103e. Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Request method failure captured: Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e/action HTTP/1.1 Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 49 Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkAOkSWQSqVekN0OPS0ld8I636oIPRCVFVZ_WN2AgT-uW-oXCiGIRJ2mm3nBCQEO8cGIt7H_0BQ83duO0hoHIYeaH5HWwWacXH-FZ-miOT4W7c1TwoxYFNz-stAf5i4RPJYQMTJrGCKVM7iYAsAjWC3EiFAvkxNvNZt3zc1lV3_olE Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 349a486eb0c34b76b50169c1dbe6b11f Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:45.113653 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_349a486eb0c34b76b50169c1dbe6b11f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 349a486eb0c34b76b50169c1dbe6b11f Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FloatingIPsAssociationTestJSON-1319870254-project Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: dd1f2852ff4a4a4fb199977ad4cf82d2 Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1319870254-project Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: {"removeFloatingIp": {"address": "172.25.6.204"}} Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:38:45.115241 n-d-856894-1 devstack@n-api.service[128788]: exception: Floating IP 172.25.6.204 is not associated with instance f1ec3aa3-5082-4375-83af-0108cfee103e. Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f1ec3aa3-5082-4375-83af-0108cfee103e', 'body': {'removeFloatingIp': {'address': '172.25.6.204'}}} Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.204 is not associated with instance f1ec3aa3-5082-4375-83af-0108cfee103e. Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:45.116259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:45.118278 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:45.118278 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:45.118278 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:45.118278 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:45.118278 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.204 is not associated with instance f1ec3aa3-5082-4375-83af-0108cfee103e. Sep 10 10:38:45.118278 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:45.118278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Returning 409 to user: Floating IP 172.25.6.204 is not associated with instance f1ec3aa3-5082-4375-83af-0108cfee103e. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:45.118278 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5474ec95-56ad-4127-adfc-e545b242712e tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "POST /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e/action" status: 409 len: 146 microversion: 2.1 time: 0.438063 Sep 10 10:38:45.119179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 543/1049] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:38:44 2022] POST /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e/action => generated 146 bytes in 441 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:38:45.125700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80567fae-5eb2-4e5f-95f0-043878b0c887 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:45.126449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80567fae-5eb2-4e5f-95f0-043878b0c887 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:45.133819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80567fae-5eb2-4e5f-95f0-043878b0c887 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:45.134386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80567fae-5eb2-4e5f-95f0-043878b0c887 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:45.134894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80567fae-5eb2-4e5f-95f0-043878b0c887 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:45.135673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80567fae-5eb2-4e5f-95f0-043878b0c887 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:45.136108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80567fae-5eb2-4e5f-95f0-043878b0c887 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:45.136520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80567fae-5eb2-4e5f-95f0-043878b0c887 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:45.234311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80567fae-5eb2-4e5f-95f0-043878b0c887 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:45.242687 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80567fae-5eb2-4e5f-95f0-043878b0c887 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1215 microversion: 2.1 time: 0.122470 Sep 10 10:38:45.243246 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 544/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:45 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:45.250373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4669138b-4cbd-436c-a63c-559f9a25d3fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:45.285791 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4669138b-4cbd-436c-a63c-559f9a25d3fc tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/6dfe3f41-3da8-4d1a-a014-33a6ff7d285f" status: 204 len: 0 microversion: 2.1 time: 0.041281 Sep 10 10:38:45.286491 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 545/1051] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:38:45 2022] DELETE /compute/v2.1/os-server-groups/6dfe3f41-3da8-4d1a-a014-33a6ff7d285f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:45.291913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d8a73750-e267-44d6-bf70-49adfa97b1e4 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:45.292523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d8a73750-e267-44d6-bf70-49adfa97b1e4 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:45.298853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8a73750-e267-44d6-bf70-49adfa97b1e4 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:45.299643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8a73750-e267-44d6-bf70-49adfa97b1e4 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:45.300165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8a73750-e267-44d6-bf70-49adfa97b1e4 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:45.300934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8a73750-e267-44d6-bf70-49adfa97b1e4 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:45.301436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8a73750-e267-44d6-bf70-49adfa97b1e4 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:45.301857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8a73750-e267-44d6-bf70-49adfa97b1e4 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:45.431165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d8a73750-e267-44d6-bf70-49adfa97b1e4 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:45.439139 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d8a73750-e267-44d6-bf70-49adfa97b1e4 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1680 microversion: 2.1 time: 0.151745 Sep 10 10:38:45.439747 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 546/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:45 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:45.444451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-950bb63f-67be-4b9b-99f0-74513acd9d03 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:45.444980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-950bb63f-67be-4b9b-99f0-74513acd9d03 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:45.450504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-950bb63f-67be-4b9b-99f0-74513acd9d03 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:45.450986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-950bb63f-67be-4b9b-99f0-74513acd9d03 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:45.451423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-950bb63f-67be-4b9b-99f0-74513acd9d03 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:45.452103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-950bb63f-67be-4b9b-99f0-74513acd9d03 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:45.452556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-950bb63f-67be-4b9b-99f0-74513acd9d03 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:45.452974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-950bb63f-67be-4b9b-99f0-74513acd9d03 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:45.486985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-950bb63f-67be-4b9b-99f0-74513acd9d03 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:45.487978 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-950bb63f-67be-4b9b-99f0-74513acd9d03 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b/os-instance-actions/req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0" status: 200 len: 313 microversion: 2.1 time: 0.047309 Sep 10 10:38:45.488570 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 547/1053] 10.222.0.20 () {58 vars in 1419 bytes} [Sat Sep 10 10:38:45 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b/os-instance-actions/req-63c42dd0-1e6c-4e7e-9c87-ed77cb506ae0 => generated 313 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:45.493387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7bc27640-b717-4ba6-b2c4-57ff05ddfcd8 req-6d43ca29-2e16-407a-abb1-65e471240b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7990b5bc-7c91-404f-99d0-dc02bb9875a2", "name": "network-vif-plugged", "status": "completed", "tag": "85cc2ade-c13d-4552-bf81-f8249685737f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:45.502992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7bc27640-b717-4ba6-b2c4-57ff05ddfcd8 req-6d43ca29-2e16-407a-abb1-65e471240b77 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:45.503501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7bc27640-b717-4ba6-b2c4-57ff05ddfcd8 req-6d43ca29-2e16-407a-abb1-65e471240b77 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:45.503946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7bc27640-b717-4ba6-b2c4-57ff05ddfcd8 req-6d43ca29-2e16-407a-abb1-65e471240b77 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:45.515074 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7bc27640-b717-4ba6-b2c4-57ff05ddfcd8 req-6d43ca29-2e16-407a-abb1-65e471240b77 service nova] Creating event network-vif-plugged:85cc2ade-c13d-4552-bf81-f8249685737f for instance 7990b5bc-7c91-404f-99d0-dc02bb9875a2 on n-h1-856894-1 Sep 10 10:38:45.519930 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7bc27640-b717-4ba6-b2c4-57ff05ddfcd8 req-6d43ca29-2e16-407a-abb1-65e471240b77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030241 Sep 10 10:38:45.520518 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 548/1054] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:45.526541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.204"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:45.776825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:45.788801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:45.789663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:45.798399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:45.799400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:45.800518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:45.800518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:46.470980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "refresh_cache-575a3c7a-4117-41ba-b077-bae7057bc385" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:38:46.471498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquired lock "refresh_cache-575a3c7a-4117-41ba-b077-bae7057bc385" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:38:48.104896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Building network info cache for instance {{(pid=128788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 10:38:49.419597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Updating instance_info_cache with network_info: [{"id": "7b405912-28fa-479e-8a19-a8e0e8ac9641", "address": "fa:16:3e:f2:8e:30", "network": {"id": "a982d658-1052-468f-9779-6bee76fe373a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-38497816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "349a486eb0c34b76b50169c1dbe6b11f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7b405912-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:38:49.434917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Releasing lock "refresh_cache-575a3c7a-4117-41ba-b077-bae7057bc385" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:38:49.436337 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42106a72-7109-4a43-aeab-e2a04e52cd51 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "POST /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385/action" status: 202 len: 0 microversion: 2.1 time: 3.914625 Sep 10 10:38:49.437589 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 549/1055] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:38:45 2022] POST /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385/action => generated 0 bytes in 3917 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 10:38:49.447585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc4ead8d-9684-4b2c-a34b-1de242fae30d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:49.448439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fc4ead8d-9684-4b2c-a34b-1de242fae30d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:49.455367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4ead8d-9684-4b2c-a34b-1de242fae30d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:49.456123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4ead8d-9684-4b2c-a34b-1de242fae30d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:49.457602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4ead8d-9684-4b2c-a34b-1de242fae30d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:49.458641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4ead8d-9684-4b2c-a34b-1de242fae30d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:49.459307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4ead8d-9684-4b2c-a34b-1de242fae30d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:49.460036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4ead8d-9684-4b2c-a34b-1de242fae30d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:49.493428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fc4ead8d-9684-4b2c-a34b-1de242fae30d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:49.579285 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc4ead8d-9684-4b2c-a34b-1de242fae30d tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 204 len: 0 microversion: 2.1 time: 0.136286 Sep 10 10:38:49.579894 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 550/1056] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:49 2022] DELETE /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:49.585101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6c5219a-b0f2-4a89-9fcf-a30e58ddd447 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:49.587560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e6c5219a-b0f2-4a89-9fcf-a30e58ddd447 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:49.595608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c5219a-b0f2-4a89-9fcf-a30e58ddd447 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:49.596087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c5219a-b0f2-4a89-9fcf-a30e58ddd447 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:49.596401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c5219a-b0f2-4a89-9fcf-a30e58ddd447 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:49.597165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c5219a-b0f2-4a89-9fcf-a30e58ddd447 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:49.598199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c5219a-b0f2-4a89-9fcf-a30e58ddd447 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:49.598629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c5219a-b0f2-4a89-9fcf-a30e58ddd447 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:49.678724 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6c5219a-b0f2-4a89-9fcf-a30e58ddd447 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "POST /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b/action" status: 202 len: 0 microversion: 2.1 time: 0.097180 Sep 10 10:38:49.681143 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 551/1057] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:38:49 2022] POST /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:38:49.687611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c92dba60-3449-47fd-bd84-1e1c5d91e473 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:49.688314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c92dba60-3449-47fd-bd84-1e1c5d91e473 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:49.697094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dba60-3449-47fd-bd84-1e1c5d91e473 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:49.697654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dba60-3449-47fd-bd84-1e1c5d91e473 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:49.698080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dba60-3449-47fd-bd84-1e1c5d91e473 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:49.698795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dba60-3449-47fd-bd84-1e1c5d91e473 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:49.699242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dba60-3449-47fd-bd84-1e1c5d91e473 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:49.699698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dba60-3449-47fd-bd84-1e1c5d91e473 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:49.925826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c92dba60-3449-47fd-bd84-1e1c5d91e473 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:49.934011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:49.938004 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c92dba60-3449-47fd-bd84-1e1c5d91e473 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2" status: 200 len: 1508 microversion: 2.1 time: 0.255528 Sep 10 10:38:49.938600 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 552/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:49 2022] GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:49.945032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-675a9bb3-1afc-423f-839f-6bbd25702de9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:49.946619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-675a9bb3-1afc-423f-839f-6bbd25702de9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:49.954388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-675a9bb3-1afc-423f-839f-6bbd25702de9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:49.955000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-675a9bb3-1afc-423f-839f-6bbd25702de9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:49.955721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-675a9bb3-1afc-423f-839f-6bbd25702de9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:49.956564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-675a9bb3-1afc-423f-839f-6bbd25702de9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:49.957181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-675a9bb3-1afc-423f-839f-6bbd25702de9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:49.958110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-675a9bb3-1afc-423f-839f-6bbd25702de9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.167397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-675a9bb3-1afc-423f-839f-6bbd25702de9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:50.175128 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-675a9bb3-1afc-423f-839f-6bbd25702de9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1311 microversion: 2.1 time: 0.235509 Sep 10 10:38:50.189464 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 553/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:49 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1311 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:50.196285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:50.197116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:50.203602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.204416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.205021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.206502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.206502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.207176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.241523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.242040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.242489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.242951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lazy-loading 'fault' on Instance uuid 7d649fdd-c8f0-4b15-9434-32d88f643ed1 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:38:50.294473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:50.302570 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-352797b7-8065-47de-867a-b08451685797 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1332 microversion: 2.1 time: 0.111975 Sep 10 10:38:50.303148 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 554/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:50 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:50.307953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-895740ee-0d28-4f1a-beb9-5d748ef2e46f req-c6f9825f-b201-497a-813f-8e319d457304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575a3c7a-4117-41ba-b077-bae7057bc385", "tag": "7b405912-28fa-479e-8a19-a8e0e8ac9641"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:50.317421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-895740ee-0d28-4f1a-beb9-5d748ef2e46f req-c6f9825f-b201-497a-813f-8e319d457304 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.317841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-895740ee-0d28-4f1a-beb9-5d748ef2e46f req-c6f9825f-b201-497a-813f-8e319d457304 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.318344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-895740ee-0d28-4f1a-beb9-5d748ef2e46f req-c6f9825f-b201-497a-813f-8e319d457304 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.330636 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-895740ee-0d28-4f1a-beb9-5d748ef2e46f req-c6f9825f-b201-497a-813f-8e319d457304 service nova] Creating event network-changed:7b405912-28fa-479e-8a19-a8e0e8ac9641 for instance 575a3c7a-4117-41ba-b077-bae7057bc385 on n-h2-856894-1 Sep 10 10:38:50.336593 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-895740ee-0d28-4f1a-beb9-5d748ef2e46f req-c6f9825f-b201-497a-813f-8e319d457304 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031515 Sep 10 10:38:50.337880 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 555/1061] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:50.343531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6508cc97-2476-4561-b7cf-3ac6c5fbb20f req-e6f95c63-7e30-46cf-ba49-782a99c3986f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5751da7d-3075-4105-9e33-9b923dff4ca2", "tag": "03bced10-8ebd-4323-9fca-0c8b0be79660"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:50.353750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6508cc97-2476-4561-b7cf-3ac6c5fbb20f req-e6f95c63-7e30-46cf-ba49-782a99c3986f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.354233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6508cc97-2476-4561-b7cf-3ac6c5fbb20f req-e6f95c63-7e30-46cf-ba49-782a99c3986f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.354669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6508cc97-2476-4561-b7cf-3ac6c5fbb20f req-e6f95c63-7e30-46cf-ba49-782a99c3986f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.365776 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6508cc97-2476-4561-b7cf-3ac6c5fbb20f req-e6f95c63-7e30-46cf-ba49-782a99c3986f service nova] Creating event network-changed:03bced10-8ebd-4323-9fca-0c8b0be79660 for instance 5751da7d-3075-4105-9e33-9b923dff4ca2 on n-h2-856894-1 Sep 10 10:38:50.370584 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6508cc97-2476-4561-b7cf-3ac6c5fbb20f req-e6f95c63-7e30-46cf-ba49-782a99c3986f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031142 Sep 10 10:38:50.371174 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 556/1062] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:50.376249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2328653a-3ab7-40ea-b37f-78d43336e8e0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:50.376831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2328653a-3ab7-40ea-b37f-78d43336e8e0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:50.383561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2328653a-3ab7-40ea-b37f-78d43336e8e0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.384048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2328653a-3ab7-40ea-b37f-78d43336e8e0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.384488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2328653a-3ab7-40ea-b37f-78d43336e8e0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.385204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2328653a-3ab7-40ea-b37f-78d43336e8e0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.385666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2328653a-3ab7-40ea-b37f-78d43336e8e0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.386097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2328653a-3ab7-40ea-b37f-78d43336e8e0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.412219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2328653a-3ab7-40ea-b37f-78d43336e8e0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:50.495853 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2328653a-3ab7-40ea-b37f-78d43336e8e0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "DELETE /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 204 len: 0 microversion: 2.1 time: 0.123162 Sep 10 10:38:50.496514 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 557/1063] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:50 2022] DELETE /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:50.502342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a3e2d0c4-481f-4803-ab28-a6aade4538d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:50.503041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a3e2d0c4-481f-4803-ab28-a6aade4538d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:50.508891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e2d0c4-481f-4803-ab28-a6aade4538d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.509406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e2d0c4-481f-4803-ab28-a6aade4538d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.509843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e2d0c4-481f-4803-ab28-a6aade4538d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.510530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e2d0c4-481f-4803-ab28-a6aade4538d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.510982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e2d0c4-481f-4803-ab28-a6aade4538d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.511411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e2d0c4-481f-4803-ab28-a6aade4538d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.659271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3e2d0c4-481f-4803-ab28-a6aade4538d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:50.667948 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a3e2d0c4-481f-4803-ab28-a6aade4538d3 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1472 microversion: 2.1 time: 0.170126 Sep 10 10:38:50.673263 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 558/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:50 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:50.677016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ce35ac7-0a05-4d2e-b129-5a1308822d3f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:50.678404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3ce35ac7-0a05-4d2e-b129-5a1308822d3f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:50.685361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ce35ac7-0a05-4d2e-b129-5a1308822d3f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.685926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ce35ac7-0a05-4d2e-b129-5a1308822d3f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.686431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ce35ac7-0a05-4d2e-b129-5a1308822d3f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.687189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ce35ac7-0a05-4d2e-b129-5a1308822d3f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.687736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ce35ac7-0a05-4d2e-b129-5a1308822d3f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.688220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ce35ac7-0a05-4d2e-b129-5a1308822d3f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.819470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3ce35ac7-0a05-4d2e-b129-5a1308822d3f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:50.828343 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3ce35ac7-0a05-4d2e-b129-5a1308822d3f tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1512 microversion: 2.1 time: 0.158288 Sep 10 10:38:50.835554 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 559/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:50 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:50.835554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.204"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:50.836740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:50.842932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.843543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.844196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.845008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:50.845614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:50.846240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:50.873133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "refresh_cache-f1ec3aa3-5082-4375-83af-0108cfee103e" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:38:50.873705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquired lock "refresh_cache-f1ec3aa3-5082-4375-83af-0108cfee103e" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:38:51.903960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Building network info cache for instance {{(pid=128788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 10:38:52.391725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Updating instance_info_cache with network_info: [{"id": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf", "address": "fa:16:3e:8c:5f:46", "network": {"id": "a982d658-1052-468f-9779-6bee76fe373a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-38497816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "349a486eb0c34b76b50169c1dbe6b11f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape4e9db81-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:38:52.405625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Releasing lock "refresh_cache-f1ec3aa3-5082-4375-83af-0108cfee103e" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:38:52.406609 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-59ed0812-8553-427a-a874-8a59e0ef40a0 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "POST /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e/action" status: 202 len: 0 microversion: 2.1 time: 1.576514 Sep 10 10:38:52.407363 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 560/1066] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:38:50 2022] POST /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e/action => generated 0 bytes in 1578 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 10:38:52.412475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf5cb839-68a0-4f75-b98a-f9e2ba5c3899 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:52.413211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bf5cb839-68a0-4f75-b98a-f9e2ba5c3899 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:52.419579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf5cb839-68a0-4f75-b98a-f9e2ba5c3899 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.420070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf5cb839-68a0-4f75-b98a-f9e2ba5c3899 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.420512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf5cb839-68a0-4f75-b98a-f9e2ba5c3899 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:52.421310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf5cb839-68a0-4f75-b98a-f9e2ba5c3899 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.421825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf5cb839-68a0-4f75-b98a-f9e2ba5c3899 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.422258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf5cb839-68a0-4f75-b98a-f9e2ba5c3899 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:52.559571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bf5cb839-68a0-4f75-b98a-f9e2ba5c3899 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:52.567700 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf5cb839-68a0-4f75-b98a-f9e2ba5c3899 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1311 microversion: 2.1 time: 0.159109 Sep 10 10:38:52.568497 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 561/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:52 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1311 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:52.573560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:52.574175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:52.580234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.580726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.581196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:52.581895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.582348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.582770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:52.615855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.616340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.616774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:52.617282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lazy-loading 'fault' on Instance uuid 7d649fdd-c8f0-4b15-9434-32d88f643ed1 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:38:52.662172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a26238f6d374b9789bd97cb6906bd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabcfc642a0a420caa4515a42aace3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:52.675167 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b57d785a-3905-45c3-86f1-e59284d404a6 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 200 len: 1332 microversion: 2.1 time: 0.105724 Sep 10 10:38:52.675765 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 562/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:52 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:52.680295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5272f211-6bac-4de1-8b6f-493a0f08675f"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:52.682670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:52.692711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.692711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.692711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:52.692711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.693147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.693147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:52.742695 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] HTTP exception thrown: Volume 9d7dcd15-3682-4439-8e7a-9aeef94e1c67 could not be found. Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Request method failure captured: Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2/os-volume_attachments/9d7dcd15-3682-4439-8e7a-9aeef94e1c67 HTTP/1.1 Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 74 Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGireajzhdiyI-cN-_5OfP9vCeBOiqfUxeMDbVoIUuhtBtSunPkkMaBqAG2hlZIqky7w0bMserwTi8pPXRxNLTCrBUMN6tM01W0BLPgrWBLO8bvzgbajwI38DVjWw11HFPVRMCmSGu2XwpvlwivVkQ4zfKD7aU6gPgIuPI1lFcEJz40 Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b3f9aff4c34641c4933c53067124a359 Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesAdminNegativeTest-756588692 Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:38:52.744834 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3f9aff4c34641c4933c53067124a359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3f9aff4c34641c4933c53067124a359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3f9aff4c34641c4933c53067124a359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3f9aff4c34641c4933c53067124a359", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesAdminNegativeTest-756588692 Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b3f9aff4c34641c4933c53067124a359 Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-756588692 Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesAdminNegativeTest-756588692-project-admin Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 307e449747484a038f593b61567c3c98 Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesAdminNegativeTest-756588692-project-admin Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: {"volumeAttachment": {"volumeId": "5272f211-6bac-4de1-8b6f-493a0f08675f"}} Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:52.746409 n-d-856894-1 devstack@n-api.service[128788]: exception: Volume 9d7dcd15-3682-4439-8e7a-9aeef94e1c67 could not be found. Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '7990b5bc-7c91-404f-99d0-dc02bb9875a2', 'id': '9d7dcd15-3682-4439-8e7a-9aeef94e1c67', 'body': {'volumeAttachment': {'volumeId': '5272f211-6bac-4de1-8b6f-493a0f08675f'}}} Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:38:52.747359 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d7dcd15-3682-4439-8e7a-9aeef94e1c67 could not be found. (HTTP 404) (Request-ID: req-5cb8a4af-7532-488c-b5f9-815ac54e292d) Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 10:38:52.748896 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d7dcd15-3682-4439-8e7a-9aeef94e1c67 could not be found. Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:52.750303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d7dcd15-3682-4439-8e7a-9aeef94e1c67 could not be found. Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d7dcd15-3682-4439-8e7a-9aeef94e1c67 could not be found. Sep 10 10:38:52.751835 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:52.753269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] Returning 404 to user: Volume 9d7dcd15-3682-4439-8e7a-9aeef94e1c67 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:52.753269 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-caa501da-bac7-4c22-be1f-51639c5b55a2 tempest-VolumesAdminNegativeTest-756588692 tempest-VolumesAdminNegativeTest-756588692-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2/os-volume_attachments/9d7dcd15-3682-4439-8e7a-9aeef94e1c67" status: 404 len: 109 microversion: 2.1 time: 0.069550 Sep 10 10:38:52.753269 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 563/1069] 10.222.0.20 () {60 vars in 1433 bytes} [Sat Sep 10 10:38:52 2022] PUT /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2/os-volume_attachments/9d7dcd15-3682-4439-8e7a-9aeef94e1c67 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:52.756620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9cbed1c7-7a9e-4978-b5aa-72775f1385b1 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:52.756620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9cbed1c7-7a9e-4978-b5aa-72775f1385b1 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:52.763734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbed1c7-7a9e-4978-b5aa-72775f1385b1 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.764233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbed1c7-7a9e-4978-b5aa-72775f1385b1 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.764661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbed1c7-7a9e-4978-b5aa-72775f1385b1 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:52.766034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbed1c7-7a9e-4978-b5aa-72775f1385b1 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.766034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbed1c7-7a9e-4978-b5aa-72775f1385b1 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.766393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbed1c7-7a9e-4978-b5aa-72775f1385b1 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:52.921154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9cbed1c7-7a9e-4978-b5aa-72775f1385b1 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:52.930276 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9cbed1c7-7a9e-4978-b5aa-72775f1385b1 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1472 microversion: 2.1 time: 0.177319 Sep 10 10:38:52.933436 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 564/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:52 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:52.938350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9ce5b6f3-429f-4c32-abd5-2e05d866e80e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:52.939349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9ce5b6f3-429f-4c32-abd5-2e05d866e80e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:52.946838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce5b6f3-429f-4c32-abd5-2e05d866e80e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.947608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce5b6f3-429f-4c32-abd5-2e05d866e80e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.948365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce5b6f3-429f-4c32-abd5-2e05d866e80e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:52.949495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce5b6f3-429f-4c32-abd5-2e05d866e80e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:52.950225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce5b6f3-429f-4c32-abd5-2e05d866e80e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:52.950855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ce5b6f3-429f-4c32-abd5-2e05d866e80e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:53.268105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9ce5b6f3-429f-4c32-abd5-2e05d866e80e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:53.289340 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9ce5b6f3-429f-4c32-abd5-2e05d866e80e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1505 microversion: 2.1 time: 0.348496 Sep 10 10:38:53.291748 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 565/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:52 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:53.309652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1ed0b3af-5920-4b22-a707-65032093a373 req-cf1924c4-0354-4343-b835-bff177157416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d649fdd-c8f0-4b15-9434-32d88f643ed1", "name": "network-vif-deleted", "tag": "87804b23-16c0-45b3-9b2d-4f16c41d16f2"}, {"name": "network-changed", "server_uuid": "f1ec3aa3-5082-4375-83af-0108cfee103e", "tag": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:53.336897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1ed0b3af-5920-4b22-a707-65032093a373 req-cf1924c4-0354-4343-b835-bff177157416 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:53.338063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1ed0b3af-5920-4b22-a707-65032093a373 req-cf1924c4-0354-4343-b835-bff177157416 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:53.338917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1ed0b3af-5920-4b22-a707-65032093a373 req-cf1924c4-0354-4343-b835-bff177157416 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:53.364356 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1ed0b3af-5920-4b22-a707-65032093a373 req-cf1924c4-0354-4343-b835-bff177157416 service nova] Creating event network-vif-deleted:87804b23-16c0-45b3-9b2d-4f16c41d16f2 for instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 on n-h2-856894-1 Sep 10 10:38:53.365178 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1ed0b3af-5920-4b22-a707-65032093a373 req-cf1924c4-0354-4343-b835-bff177157416 service nova] Creating event network-changed:e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf for instance f1ec3aa3-5082-4375-83af-0108cfee103e on n-h1-856894-1 Sep 10 10:38:53.381487 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1ed0b3af-5920-4b22-a707-65032093a373 req-cf1924c4-0354-4343-b835-bff177157416 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.086340 Sep 10 10:38:53.382732 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 566/1072] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:53.394357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-212b9d70-8213-4f51-a4cb-fce1ae05fe4b tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '.version_select at 0x7efcae84b0d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:54.008146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:54.037570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:54.254085 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-212b9d70-8213-4f51-a4cb-fce1ae05fe4b tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/90684d36-3846-4b92-a568-927ac47b85ee" status: 200 len: 184 microversion: 2.1 time: 0.866944 Sep 10 10:38:54.255597 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 567/1073] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:38:53 2022] GET /compute/v2.1/os-floating-ips/90684d36-3846-4b92-a568-927ac47b85ee => generated 184 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:54.303096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e3a1e1c-3d2b-4a4e-8394-89b9308366e2 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '.version_select at 0x7efcae84baf0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:54.307378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e3a1e1c-3d2b-4a4e-8394-89b9308366e2 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:54.316997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:54.343390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3a1e1c-3d2b-4a4e-8394-89b9308366e2 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:54.343908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3a1e1c-3d2b-4a4e-8394-89b9308366e2 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:54.344331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3a1e1c-3d2b-4a4e-8394-89b9308366e2 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:54.345042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3a1e1c-3d2b-4a4e-8394-89b9308366e2 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:54.349873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3a1e1c-3d2b-4a4e-8394-89b9308366e2 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:54.350219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3a1e1c-3d2b-4a4e-8394-89b9308366e2 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:54.429372 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e3a1e1c-3d2b-4a4e-8394-89b9308366e2 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.165914 Sep 10 10:38:54.438383 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 568/1074] 10.222.0.20 () {58 vars in 1296 bytes} [Sat Sep 10 10:38:54 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b/os-instance-actions => generated 611 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:54.444527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-938f84b9-95c8-466b-8d1b-02ee3aa447eb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:54.446628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-938f84b9-95c8-466b-8d1b-02ee3aa447eb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:54.454755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-938f84b9-95c8-466b-8d1b-02ee3aa447eb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:54.455247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-938f84b9-95c8-466b-8d1b-02ee3aa447eb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:54.455687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-938f84b9-95c8-466b-8d1b-02ee3aa447eb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:54.456740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-938f84b9-95c8-466b-8d1b-02ee3aa447eb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:54.457238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-938f84b9-95c8-466b-8d1b-02ee3aa447eb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:54.457924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-938f84b9-95c8-466b-8d1b-02ee3aa447eb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:54.943621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-938f84b9-95c8-466b-8d1b-02ee3aa447eb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:54.950942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:38:54.982255 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-938f84b9-95c8-466b-8d1b-02ee3aa447eb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1311 microversion: 2.1 time: 0.542050 Sep 10 10:38:54.993139 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 569/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:54 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1311 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:54.996692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:54.998859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:55.013391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:55.015873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:55.016680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:55.017634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:55.018285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:55.018925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:55.060008 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] HTTP exception thrown: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Request method failure captured: Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 HTTP/1.1 Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhp7nnRNasAAglteNOXq90ZZ_5fgKHPXhvNySMEDzwhpnBGiV8DJpt9HuWc7zzqZ2zviR_0u7sSGuCHzLY_LQevImAN68SS3jtEoNNOjgHbWzWNvnf-CUBrsjnENQtVHoa2XS4qbqF1aQtBxUkT3l9vJcCv_caP8iTMGTviO5xd3JM Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: cabcfc642a0a420caa4515a42aace3f6 Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-300269448 Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:55.061827 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cabcfc642a0a420caa4515a42aace3f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cabcfc642a0a420caa4515a42aace3f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cabcfc642a0a420caa4515a42aace3f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cabcfc642a0a420caa4515a42aace3f6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-300269448 Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: cabcfc642a0a420caa4515a42aace3f6 Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-300269448 Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachSCSIVolumeTestJSON-300269448-project Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3a26238f6d374b9789bd97cb6906bd2c Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-300269448-project Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:38:55.063282 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7d649fdd-c8f0-4b15-9434-32d88f643ed1'} Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:55.064117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:38:55.065469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:55.066644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Returning 404 to user: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:55.067082 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95bb2679-df3a-460f-80ce-e1bd6075b3a0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 404 len: 111 microversion: 2.1 time: 0.077719 Sep 10 10:38:55.069779 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 570/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:54 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:55.078286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:55.079270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:55.092446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:55.092948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:55.093579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:55.094321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:55.100554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:55.102728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:55.161634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:55.162227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:55.163139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:55.164425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lazy-loading 'fault' on Instance uuid 52fb832d-13f8-4175-b047-fa651b9091da {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:38:55.290767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60543e7cbbb0451bb8b1929437b2a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357ca1336b634d0389fff733e6e26ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:55.298830 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b2b0cc2d-6d25-40d3-9dc9-4e4366112a94 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 200 len: 1307 microversion: 2.1 time: 0.227122 Sep 10 10:38:55.301769 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 571/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:55 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:55.315019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.204"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:55.475438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:55.482060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:55.482836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:55.483361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:55.484155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:55.484679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:55.485261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:55.702323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "refresh_cache-f1ec3aa3-5082-4375-83af-0108cfee103e" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:38:55.702811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquired lock "refresh_cache-f1ec3aa3-5082-4375-83af-0108cfee103e" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:38:56.358469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Building network info cache for instance {{(pid=128788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 10:38:56.857724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Updating instance_info_cache with network_info: [{"id": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf", "address": "fa:16:3e:8c:5f:46", "network": {"id": "a982d658-1052-468f-9779-6bee76fe373a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-38497816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "349a486eb0c34b76b50169c1dbe6b11f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape4e9db81-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:38:56.871267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Releasing lock "refresh_cache-f1ec3aa3-5082-4375-83af-0108cfee103e" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:38:56.872178 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ecef609-3916-4905-be30-b6c3e813566d tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "POST /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e/action" status: 202 len: 0 microversion: 2.1 time: 1.569220 Sep 10 10:38:56.872800 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 572/1078] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:38:55 2022] POST /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e/action => generated 0 bytes in 1570 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 10:38:56.877342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e7c61245-cf46-4e8a-bd61-38c323d4b2a4 req-742b5ebd-4e27-4483-a3c6-3dfe1f290c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52fb832d-13f8-4175-b047-fa651b9091da", "name": "network-vif-deleted", "tag": "df07f796-7573-441a-8c41-4b9c692856f2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:56.887325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e7c61245-cf46-4e8a-bd61-38c323d4b2a4 req-742b5ebd-4e27-4483-a3c6-3dfe1f290c10 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:56.887803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e7c61245-cf46-4e8a-bd61-38c323d4b2a4 req-742b5ebd-4e27-4483-a3c6-3dfe1f290c10 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:56.888237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e7c61245-cf46-4e8a-bd61-38c323d4b2a4 req-742b5ebd-4e27-4483-a3c6-3dfe1f290c10 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:56.899078 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e7c61245-cf46-4e8a-bd61-38c323d4b2a4 req-742b5ebd-4e27-4483-a3c6-3dfe1f290c10 service nova] Creating event network-vif-deleted:df07f796-7573-441a-8c41-4b9c692856f2 for instance 52fb832d-13f8-4175-b047-fa651b9091da on n-h2-856894-1 Sep 10 10:38:56.903874 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e7c61245-cf46-4e8a-bd61-38c323d4b2a4 req-742b5ebd-4e27-4483-a3c6-3dfe1f290c10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029911 Sep 10 10:38:56.904466 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 573/1079] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:56.909714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2bcf292c-99ee-4967-99ff-ad2946a90a29 req-c9a6c48e-c9f3-4033-be81-1741319a806e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5751da7d-3075-4105-9e33-9b923dff4ca2", "name": "network-vif-plugged", "status": "completed", "tag": "03bced10-8ebd-4323-9fca-0c8b0be79660"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:56.919111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2bcf292c-99ee-4967-99ff-ad2946a90a29 req-c9a6c48e-c9f3-4033-be81-1741319a806e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:56.919592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2bcf292c-99ee-4967-99ff-ad2946a90a29 req-c9a6c48e-c9f3-4033-be81-1741319a806e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:56.920026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2bcf292c-99ee-4967-99ff-ad2946a90a29 req-c9a6c48e-c9f3-4033-be81-1741319a806e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:56.931101 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2bcf292c-99ee-4967-99ff-ad2946a90a29 req-c9a6c48e-c9f3-4033-be81-1741319a806e service nova] Creating event network-vif-plugged:03bced10-8ebd-4323-9fca-0c8b0be79660 for instance 5751da7d-3075-4105-9e33-9b923dff4ca2 on n-h2-856894-1 Sep 10 10:38:56.935868 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2bcf292c-99ee-4967-99ff-ad2946a90a29 req-c9a6c48e-c9f3-4033-be81-1741319a806e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030127 Sep 10 10:38:56.936445 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 574/1080] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:56.941379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c39f5507-ddd1-432d-ad08-63b314a1f54c tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:56.941969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c39f5507-ddd1-432d-ad08-63b314a1f54c tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:56.948660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39f5507-ddd1-432d-ad08-63b314a1f54c tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:56.949211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39f5507-ddd1-432d-ad08-63b314a1f54c tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:56.949702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39f5507-ddd1-432d-ad08-63b314a1f54c tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:56.950409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39f5507-ddd1-432d-ad08-63b314a1f54c tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:56.950866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39f5507-ddd1-432d-ad08-63b314a1f54c tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:56.951296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39f5507-ddd1-432d-ad08-63b314a1f54c tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:56.976445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c39f5507-ddd1-432d-ad08-63b314a1f54c tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:57.067989 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c39f5507-ddd1-432d-ad08-63b314a1f54c tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "DELETE /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 204 len: 0 microversion: 2.1 time: 0.130059 Sep 10 10:38:57.069176 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 575/1081] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:56 2022] DELETE /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:57.077666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a85e01f-5877-498f-a579-6df87cc1b1e0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '.version_select at 0x7efcae84b310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:57.099471 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a85e01f-5877-498f-a579-6df87cc1b1e0 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768219462" status: 202 len: 0 microversion: 2.1 time: 0.028256 Sep 10 10:38:57.100060 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 576/1082] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 10:38:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768219462 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:38:57.107229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e4a620f1-f6f1-4148-a4a3-25c2919e6e67 req-5cdd3692-907d-467a-9ab5-9e1c69ebf405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575a3c7a-4117-41ba-b077-bae7057bc385", "name": "network-vif-deleted", "tag": "7b405912-28fa-479e-8a19-a8e0e8ac9641"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:38:57.120154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e4a620f1-f6f1-4148-a4a3-25c2919e6e67 req-5cdd3692-907d-467a-9ab5-9e1c69ebf405 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.120630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e4a620f1-f6f1-4148-a4a3-25c2919e6e67 req-5cdd3692-907d-467a-9ab5-9e1c69ebf405 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.121263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e4a620f1-f6f1-4148-a4a3-25c2919e6e67 req-5cdd3692-907d-467a-9ab5-9e1c69ebf405 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.132365 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e4a620f1-f6f1-4148-a4a3-25c2919e6e67 req-5cdd3692-907d-467a-9ab5-9e1c69ebf405 service nova] Creating event network-vif-deleted:7b405912-28fa-479e-8a19-a8e0e8ac9641 for instance 575a3c7a-4117-41ba-b077-bae7057bc385 on n-h2-856894-1 Sep 10 10:38:57.137530 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e4a620f1-f6f1-4148-a4a3-25c2919e6e67 req-5cdd3692-907d-467a-9ab5-9e1c69ebf405 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036091 Sep 10 10:38:57.138500 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 577/1083] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:38:57.143444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-932e9380-7a8a-4485-85d9-0f41b987af41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:57.144207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-932e9380-7a8a-4485-85d9-0f41b987af41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:57.150744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-932e9380-7a8a-4485-85d9-0f41b987af41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.151241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-932e9380-7a8a-4485-85d9-0f41b987af41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.151682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-932e9380-7a8a-4485-85d9-0f41b987af41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.152571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-932e9380-7a8a-4485-85d9-0f41b987af41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.153037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-932e9380-7a8a-4485-85d9-0f41b987af41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.153493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-932e9380-7a8a-4485-85d9-0f41b987af41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.326663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-932e9380-7a8a-4485-85d9-0f41b987af41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:57.336730 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-932e9380-7a8a-4485-85d9-0f41b987af41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1311 microversion: 2.1 time: 0.196589 Sep 10 10:38:57.345815 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 578/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:57 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:57.349960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-618304a0-bdf5-41c0-be31-0252a81b9de3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:57.350910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-618304a0-bdf5-41c0-be31-0252a81b9de3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:57.357782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-618304a0-bdf5-41c0-be31-0252a81b9de3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.358772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-618304a0-bdf5-41c0-be31-0252a81b9de3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.359451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-618304a0-bdf5-41c0-be31-0252a81b9de3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.360059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-618304a0-bdf5-41c0-be31-0252a81b9de3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.360856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-618304a0-bdf5-41c0-be31-0252a81b9de3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.361671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-618304a0-bdf5-41c0-be31-0252a81b9de3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.390913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-618304a0-bdf5-41c0-be31-0252a81b9de3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:38:57.476803 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-618304a0-bdf5-41c0-be31-0252a81b9de3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2" status: 204 len: 0 microversion: 2.1 time: 0.131358 Sep 10 10:38:57.480664 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 579/1085] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:57 2022] DELETE /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:38:57.484118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:57.485300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] [instance: 52fb832d-13f8-4175-b047-fa651b9091da] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:57.492995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.493558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.493990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.494685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.495135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.495551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.514420 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] HTTP exception thrown: Instance 52fb832d-13f8-4175-b047-fa651b9091da could not be found. Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Request method failure captured: Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da HTTP/1.1 Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhjI0mBqovPP_llH0i9ni5xLfpitYZ9to6OfdBtLoayGJQT5xzq7QKB27fo9vkreHidq0J1x2CX58WsSrHegIUCYsoMBlyuMHcTRQwcLNBdhUi5REBsXOKdRMO2cK9AjuPfavjPXujwLasNtH09EmYLXj_3SbG_oM5FX9r90EDM1Ok Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:57.516084 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/357ca1336b634d0389fff733e6e26ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_357ca1336b634d0389fff733e6e26ca0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 357ca1336b634d0389fff733e6e26ca0 Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1946751926 Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 60543e7cbbb0451bb8b1929437b2a0ea Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersOnMultiNodesTest-1946751926-project Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 52fb832d-13f8-4175-b047-fa651b9091da could not be found. Sep 10 10:38:57.517749 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '52fb832d-13f8-4175-b047-fa651b9091da'} Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52fb832d-13f8-4175-b047-fa651b9091da could not be found. Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:57.518599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52fb832d-13f8-4175-b047-fa651b9091da could not be found. Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52fb832d-13f8-4175-b047-fa651b9091da could not be found. Sep 10 10:38:57.519808 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.520997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] Returning 404 to user: Instance 52fb832d-13f8-4175-b047-fa651b9091da could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:57.520997 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f1d3e8c-bd00-4b4b-8e33-75d0b0ebb544 tempest-ServersOnMultiNodesTest-1946751926 tempest-ServersOnMultiNodesTest-1946751926-project] 10.222.0.20 "GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da" status: 404 len: 111 microversion: 2.1 time: 0.038652 Sep 10 10:38:57.520997 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 580/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:57 2022] GET /compute/v2.1/servers/52fb832d-13f8-4175-b047-fa651b9091da => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:57.523255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:57.524085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:57.530124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.530285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.530647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.531508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.532407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.532729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.547525 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] HTTP exception thrown: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Request method failure captured: Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 HTTP/1.1 Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkAOkSWQSqVekN0OPS0ld8I636oIPRCVFVZ_WN2AgT-uW-oXCiGIRJ2mm3nBCQEO8cGIt7H_0BQ83duO0hoHIYeaH5HWwWacXH-FZ-miOT4W7c1TwoxYFNz-stAf5i4RPJYQMTJrGCKVM7iYAsAjWC3EiFAvkxNvNZt3zc1lV3_olE Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 349a486eb0c34b76b50169c1dbe6b11f Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:57.549288 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_349a486eb0c34b76b50169c1dbe6b11f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 349a486eb0c34b76b50169c1dbe6b11f Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FloatingIPsAssociationTestJSON-1319870254-project Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: dd1f2852ff4a4a4fb199977ad4cf82d2 Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1319870254-project Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. Sep 10 10:38:57.550948 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '575a3c7a-4117-41ba-b077-bae7057bc385'} Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:57.551891 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. Sep 10 10:38:57.553402 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.555443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Returning 404 to user: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:57.555443 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d7b1a97-5e23-42ed-be50-5c8a9d5c0f0f tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "DELETE /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 404 len: 111 microversion: 2.1 time: 0.033924 Sep 10 10:38:57.556128 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 581/1087] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:38:57 2022] DELETE /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:57.560666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee27840f-4735-4768-b01f-56bacc89d49e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:57.563401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ee27840f-4735-4768-b01f-56bacc89d49e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:57.572204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee27840f-4735-4768-b01f-56bacc89d49e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.572771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee27840f-4735-4768-b01f-56bacc89d49e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.573538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee27840f-4735-4768-b01f-56bacc89d49e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.574202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee27840f-4735-4768-b01f-56bacc89d49e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.574740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee27840f-4735-4768-b01f-56bacc89d49e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.575137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee27840f-4735-4768-b01f-56bacc89d49e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.727765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ee27840f-4735-4768-b01f-56bacc89d49e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:57.736053 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ee27840f-4735-4768-b01f-56bacc89d49e tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1511 microversion: 2.1 time: 0.178798 Sep 10 10:38:57.736978 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 582/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:57 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:57.741482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c39a5669-e067-46e7-b58e-39821a11d4c4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:57.742624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c39a5669-e067-46e7-b58e-39821a11d4c4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:57.748813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39a5669-e067-46e7-b58e-39821a11d4c4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.749324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39a5669-e067-46e7-b58e-39821a11d4c4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.750073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39a5669-e067-46e7-b58e-39821a11d4c4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.751240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39a5669-e067-46e7-b58e-39821a11d4c4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.752009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39a5669-e067-46e7-b58e-39821a11d4c4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.752435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c39a5669-e067-46e7-b58e-39821a11d4c4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.901814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c39a5669-e067-46e7-b58e-39821a11d4c4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:57.912331 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c39a5669-e067-46e7-b58e-39821a11d4c4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2" status: 200 len: 1514 microversion: 2.1 time: 0.174083 Sep 10 10:38:57.913253 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 583/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:57 2022] GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:57.918334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:57.919141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: 575a3c7a-4117-41ba-b077-bae7057bc385] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:57.925355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.926083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.927048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.928161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:57.932608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:57.933181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:57.949423 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] HTTP exception thrown: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Request method failure captured: Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 HTTP/1.1 Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkAOkSWQSqVekN0OPS0ld8I636oIPRCVFVZ_WN2AgT-uW-oXCiGIRJ2mm3nBCQEO8cGIt7H_0BQ83duO0hoHIYeaH5HWwWacXH-FZ-miOT4W7c1TwoxYFNz-stAf5i4RPJYQMTJrGCKVM7iYAsAjWC3EiFAvkxNvNZt3zc1lV3_olE Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 349a486eb0c34b76b50169c1dbe6b11f Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:38:57.951000 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_349a486eb0c34b76b50169c1dbe6b11f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 349a486eb0c34b76b50169c1dbe6b11f Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FloatingIPsAssociationTestJSON-1319870254-project Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: dd1f2852ff4a4a4fb199977ad4cf82d2 Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1319870254-project Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. Sep 10 10:38:57.952532 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '575a3c7a-4117-41ba-b077-bae7057bc385'} Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:38:57.953551 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. Sep 10 10:38:57.954965 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:38:57.956277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Returning 404 to user: Instance 575a3c7a-4117-41ba-b077-bae7057bc385 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:38:57.956277 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51ab3e4b-83a3-4b2d-b8c5-3d65a12a7868 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385" status: 404 len: 111 microversion: 2.1 time: 0.037565 Sep 10 10:38:57.956277 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 584/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:57 2022] GET /compute/v2.1/servers/575a3c7a-4117-41ba-b077-bae7057bc385 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:38:57.961558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad1b028b-4601-4d12-9a70-cf832616d299 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '.version_select at 0x7efcaea26550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:59.193486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad1b028b-4601-4d12-9a70-cf832616d299 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/90684d36-3846-4b92-a568-927ac47b85ee" status: 202 len: 0 microversion: 2.1 time: 1.236002 Sep 10 10:38:59.194675 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 585/1091] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:38:57 2022] DELETE /compute/v2.1/os-floating-ips/90684d36-3846-4b92-a568-927ac47b85ee => generated 0 bytes in 1238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:38:59.201091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb12266c-1956-4557-a0cb-e9c65ccc2595 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:59.201754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fb12266c-1956-4557-a0cb-e9c65ccc2595 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:59.209153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12266c-1956-4557-a0cb-e9c65ccc2595 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:59.209653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12266c-1956-4557-a0cb-e9c65ccc2595 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:59.210144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12266c-1956-4557-a0cb-e9c65ccc2595 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:59.211265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12266c-1956-4557-a0cb-e9c65ccc2595 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:59.211642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12266c-1956-4557-a0cb-e9c65ccc2595 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:59.212075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12266c-1956-4557-a0cb-e9c65ccc2595 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:59.775180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb12266c-1956-4557-a0cb-e9c65ccc2595 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:38:59.787883 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb12266c-1956-4557-a0cb-e9c65ccc2595 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1494 microversion: 2.1 time: 0.591311 Sep 10 10:38:59.791355 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 586/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:59 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1494 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:38:59.798297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f70dad88-1efa-4a67-9063-af05f731e0a6 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:38:59.799380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f70dad88-1efa-4a67-9063-af05f731e0a6 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:38:59.809505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f70dad88-1efa-4a67-9063-af05f731e0a6 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:59.810494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f70dad88-1efa-4a67-9063-af05f731e0a6 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:59.811430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f70dad88-1efa-4a67-9063-af05f731e0a6 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:38:59.812369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f70dad88-1efa-4a67-9063-af05f731e0a6 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:38:59.813766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f70dad88-1efa-4a67-9063-af05f731e0a6 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:38:59.815177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f70dad88-1efa-4a67-9063-af05f731e0a6 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:00.207942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f70dad88-1efa-4a67-9063-af05f731e0a6 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:00.228940 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f70dad88-1efa-4a67-9063-af05f731e0a6 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1511 microversion: 2.1 time: 0.434875 Sep 10 10:39:00.230287 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 587/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:38:59 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:00.238310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e59cc45-cc7c-4bf3-87fc-67aa41bd8290 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:00.240137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e59cc45-cc7c-4bf3-87fc-67aa41bd8290 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:00.265335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e59cc45-cc7c-4bf3-87fc-67aa41bd8290 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:00.265833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e59cc45-cc7c-4bf3-87fc-67aa41bd8290 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:00.266449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e59cc45-cc7c-4bf3-87fc-67aa41bd8290 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:00.267538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e59cc45-cc7c-4bf3-87fc-67aa41bd8290 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:00.268648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e59cc45-cc7c-4bf3-87fc-67aa41bd8290 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:00.269293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e59cc45-cc7c-4bf3-87fc-67aa41bd8290 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:00.296313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:39:00.593575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e59cc45-cc7c-4bf3-87fc-67aa41bd8290 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:00.602462 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e59cc45-cc7c-4bf3-87fc-67aa41bd8290 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2" status: 200 len: 1514 microversion: 2.1 time: 0.369458 Sep 10 10:39:00.614835 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 588/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:00 2022] GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:00.620594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9dad1983-595c-4d45-a262-094d0a5fe5db req-23f1455f-c221-4a22-9677-82c1803fac80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ec3aa3-5082-4375-83af-0108cfee103e", "tag": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:00.637155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9dad1983-595c-4d45-a262-094d0a5fe5db req-23f1455f-c221-4a22-9677-82c1803fac80 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:00.637518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9dad1983-595c-4d45-a262-094d0a5fe5db req-23f1455f-c221-4a22-9677-82c1803fac80 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:00.637946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9dad1983-595c-4d45-a262-094d0a5fe5db req-23f1455f-c221-4a22-9677-82c1803fac80 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:00.657644 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9dad1983-595c-4d45-a262-094d0a5fe5db req-23f1455f-c221-4a22-9677-82c1803fac80 service nova] Creating event network-changed:e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf for instance f1ec3aa3-5082-4375-83af-0108cfee103e on n-h1-856894-1 Sep 10 10:39:00.683558 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9dad1983-595c-4d45-a262-094d0a5fe5db req-23f1455f-c221-4a22-9677-82c1803fac80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067045 Sep 10 10:39:00.684468 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 589/1095] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:00.693436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b053eae8-2967-4696-ac30-4de42db6e7b4 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:00.694080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b053eae8-2967-4696-ac30-4de42db6e7b4 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:00.713119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b053eae8-2967-4696-ac30-4de42db6e7b4 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:00.713642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b053eae8-2967-4696-ac30-4de42db6e7b4 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:00.714081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b053eae8-2967-4696-ac30-4de42db6e7b4 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:00.714784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b053eae8-2967-4696-ac30-4de42db6e7b4 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:00.715231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b053eae8-2967-4696-ac30-4de42db6e7b4 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:00.715651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b053eae8-2967-4696-ac30-4de42db6e7b4 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:00.758989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b053eae8-2967-4696-ac30-4de42db6e7b4 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:39:00.925790 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b053eae8-2967-4696-ac30-4de42db6e7b4 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 204 len: 0 microversion: 2.1 time: 0.239461 Sep 10 10:39:00.927360 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 590/1096] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:39:00 2022] DELETE /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:39:01.261816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-744e16ef-038b-4f5d-8c3b-a60e5254c497 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:01.262534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-744e16ef-038b-4f5d-8c3b-a60e5254c497 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:01.269388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-744e16ef-038b-4f5d-8c3b-a60e5254c497 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:01.270204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-744e16ef-038b-4f5d-8c3b-a60e5254c497 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:01.270820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-744e16ef-038b-4f5d-8c3b-a60e5254c497 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:01.272038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-744e16ef-038b-4f5d-8c3b-a60e5254c497 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:01.272897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-744e16ef-038b-4f5d-8c3b-a60e5254c497 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:01.274404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-744e16ef-038b-4f5d-8c3b-a60e5254c497 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:01.549416 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-744e16ef-038b-4f5d-8c3b-a60e5254c497 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1645 microversion: 2.1 time: 0.620519 Sep 10 10:39:01.550645 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 591/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:00 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1645 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:01.556198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e9447090-3f72-492a-9db5-f905a68db846 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:01.557004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e9447090-3f72-492a-9db5-f905a68db846 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:01.563527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9447090-3f72-492a-9db5-f905a68db846 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:01.564019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9447090-3f72-492a-9db5-f905a68db846 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:01.564662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9447090-3f72-492a-9db5-f905a68db846 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:01.565386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9447090-3f72-492a-9db5-f905a68db846 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:01.566002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9447090-3f72-492a-9db5-f905a68db846 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:01.566581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9447090-3f72-492a-9db5-f905a68db846 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:01.810465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9447090-3f72-492a-9db5-f905a68db846 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:01.820998 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e9447090-3f72-492a-9db5-f905a68db846 tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1523 microversion: 2.1 time: 0.268441 Sep 10 10:39:01.822982 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 592/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:01 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:01.832272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c286702c-f67f-411d-8620-8b358e713d35 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:01.833939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c286702c-f67f-411d-8620-8b358e713d35 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:01.846557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c286702c-f67f-411d-8620-8b358e713d35 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:01.847355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c286702c-f67f-411d-8620-8b358e713d35 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:01.849030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c286702c-f67f-411d-8620-8b358e713d35 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:01.852731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c286702c-f67f-411d-8620-8b358e713d35 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:01.855059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c286702c-f67f-411d-8620-8b358e713d35 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:01.855746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c286702c-f67f-411d-8620-8b358e713d35 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:02.020197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c286702c-f67f-411d-8620-8b358e713d35 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f46993376d436b8242e986606b7c22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241042726464bb38ae2376211eeaa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:02.031219 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c286702c-f67f-411d-8620-8b358e713d35 tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 200 len: 1469 microversion: 2.1 time: 0.206721 Sep 10 10:39:02.032515 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 593/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:01 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:02.046420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-54fd25e0-4666-4b68-9bdb-d75e0f2724a9 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:02.047707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54fd25e0-4666-4b68-9bdb-d75e0f2724a9 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:02.059240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54fd25e0-4666-4b68-9bdb-d75e0f2724a9 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:02.062449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54fd25e0-4666-4b68-9bdb-d75e0f2724a9 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:02.064669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54fd25e0-4666-4b68-9bdb-d75e0f2724a9 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:02.065822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54fd25e0-4666-4b68-9bdb-d75e0f2724a9 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:02.076277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54fd25e0-4666-4b68-9bdb-d75e0f2724a9 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:02.077441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54fd25e0-4666-4b68-9bdb-d75e0f2724a9 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:02.459940 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-54fd25e0-4666-4b68-9bdb-d75e0f2724a9 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1645 microversion: 2.1 time: 0.426139 Sep 10 10:39:02.473356 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 594/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:02 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1645 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:02.477877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:02.479031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:02.487133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:02.487813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:02.488406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:02.489554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:02.490176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:02.490757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:02.527938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:02.529435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:02.530239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:02.530838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lazy-loading 'fault' on Instance uuid 7990b5bc-7c91-404f-99d0-dc02bb9875a2 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:39:02.676578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:02.690447 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d902cd62-0f41-4538-9be8-287ca3bb2f9f tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2" status: 200 len: 1307 microversion: 2.1 time: 0.224374 Sep 10 10:39:02.691332 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 595/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:02 2022] GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:02.700784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07fd9d9f-568e-4234-a0d9-bca4224dce64 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:02.702879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07fd9d9f-568e-4234-a0d9-bca4224dce64 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:02.713893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07fd9d9f-568e-4234-a0d9-bca4224dce64 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:02.714575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07fd9d9f-568e-4234-a0d9-bca4224dce64 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:02.715227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07fd9d9f-568e-4234-a0d9-bca4224dce64 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:02.716095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07fd9d9f-568e-4234-a0d9-bca4224dce64 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:02.716894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07fd9d9f-568e-4234-a0d9-bca4224dce64 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:02.717395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07fd9d9f-568e-4234-a0d9-bca4224dce64 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:03.622912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-07fd9d9f-568e-4234-a0d9-bca4224dce64 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid 7bf4f355-1582-4020-a738-9d8579be881b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:39:03.647392 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07fd9d9f-568e-4234-a0d9-bca4224dce64 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 2346 microversion: 2.25 time: 0.953658 Sep 10 10:39:03.662313 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 596/1102] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:39:02 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 2346 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:39:03.678551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-00eca9cc-5fde-410d-9bd9-f3d1ce09886a tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:03.683123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00eca9cc-5fde-410d-9bd9-f3d1ce09886a tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:03.683643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00eca9cc-5fde-410d-9bd9-f3d1ce09886a tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:03.684082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00eca9cc-5fde-410d-9bd9-f3d1ce09886a tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:03.684994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00eca9cc-5fde-410d-9bd9-f3d1ce09886a tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:03.686145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00eca9cc-5fde-410d-9bd9-f3d1ce09886a tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:03.686578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00eca9cc-5fde-410d-9bd9-f3d1ce09886a tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:03.714624 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-00eca9cc-5fde-410d-9bd9-f3d1ce09886a tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050874 Sep 10 10:39:03.715914 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 597/1103] 10.222.0.20 () {58 vars in 1176 bytes} [Sat Sep 10 10:39:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:03.720787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ccd00a14-01eb-4427-8bac-889a8b1271c3 req-eaf55ae0-0f93-4b0d-aef8-b1f82b97d99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979c4b7b-70c8-4234-ae4a-cc928b70462b", "name": "network-vif-deleted", "tag": "0076597d-2651-44f6-9885-72831fb8eafe"}, {"server_uuid": "7990b5bc-7c91-404f-99d0-dc02bb9875a2", "name": "network-vif-deleted", "tag": "85cc2ade-c13d-4552-bf81-f8249685737f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:03.732939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ccd00a14-01eb-4427-8bac-889a8b1271c3 req-eaf55ae0-0f93-4b0d-aef8-b1f82b97d99b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:03.733761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ccd00a14-01eb-4427-8bac-889a8b1271c3 req-eaf55ae0-0f93-4b0d-aef8-b1f82b97d99b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:03.734381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ccd00a14-01eb-4427-8bac-889a8b1271c3 req-eaf55ae0-0f93-4b0d-aef8-b1f82b97d99b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:03.752824 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ccd00a14-01eb-4427-8bac-889a8b1271c3 req-eaf55ae0-0f93-4b0d-aef8-b1f82b97d99b service nova] Creating event network-vif-deleted:0076597d-2651-44f6-9885-72831fb8eafe for instance 979c4b7b-70c8-4234-ae4a-cc928b70462b on n-h1-856894-1 Sep 10 10:39:03.753632 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ccd00a14-01eb-4427-8bac-889a8b1271c3 req-eaf55ae0-0f93-4b0d-aef8-b1f82b97d99b service nova] Creating event network-vif-deleted:85cc2ade-c13d-4552-bf81-f8249685737f for instance 7990b5bc-7c91-404f-99d0-dc02bb9875a2 on n-h1-856894-1 Sep 10 10:39:03.761939 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ccd00a14-01eb-4427-8bac-889a8b1271c3 req-eaf55ae0-0f93-4b0d-aef8-b1f82b97d99b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044389 Sep 10 10:39:03.762846 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 598/1104] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:03.768480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3bd40f87-edcb-4259-b9af-50f2805e3acc tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:03.769464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3bd40f87-edcb-4259-b9af-50f2805e3acc tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:03.776529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bd40f87-edcb-4259-b9af-50f2805e3acc tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:03.777342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bd40f87-edcb-4259-b9af-50f2805e3acc tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:03.777953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bd40f87-edcb-4259-b9af-50f2805e3acc tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:03.778862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bd40f87-edcb-4259-b9af-50f2805e3acc tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:03.779487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bd40f87-edcb-4259-b9af-50f2805e3acc tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:03.780079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bd40f87-edcb-4259-b9af-50f2805e3acc tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.130934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3bd40f87-edcb-4259-b9af-50f2805e3acc tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1f2852ff4a4a4fb199977ad4cf82d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a486eb0c34b76b50169c1dbe6b11f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:04.144396 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3bd40f87-edcb-4259-b9af-50f2805e3acc tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 200 len: 1523 microversion: 2.1 time: 0.380116 Sep 10 10:39:04.144992 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 599/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:03 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:04.149597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:04.150200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] [instance: 979c4b7b-70c8-4234-ae4a-cc928b70462b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:04.157597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.158226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.158730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.159764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.160290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.160721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.175414 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] HTTP exception thrown: Instance 979c4b7b-70c8-4234-ae4a-cc928b70462b could not be found. Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Request method failure captured: Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b HTTP/1.1 Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkZRQOKMzVEOXqVsOobrkm847_XUYb4q6fmG8POyG8pIJTQWqKfVlSiAtzM90Z17GJyHzPvQ1d9lH4uz7pmtNXQ6ZBvJazH6hDZ9lVjpZUYU_DGaDVBvdIdv7DQZ8ItfD90dTFC_K2jd95ufH8zdYwqvGKo-uj0VqHuVzFm3PSpIoY Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 2241042726464bb38ae2376211eeaa9b Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-InstanceActionsTestJSON-758237809 Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:39:04.178304 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2241042726464bb38ae2376211eeaa9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2241042726464bb38ae2376211eeaa9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2241042726464bb38ae2376211eeaa9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2241042726464bb38ae2376211eeaa9b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-InstanceActionsTestJSON-758237809 Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 2241042726464bb38ae2376211eeaa9b Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-InstanceActionsTestJSON-758237809 Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-InstanceActionsTestJSON-758237809-project Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d8f46993376d436b8242e986606b7c22 Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-InstanceActionsTestJSON-758237809-project Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 979c4b7b-70c8-4234-ae4a-cc928b70462b could not be found. Sep 10 10:39:04.180275 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '979c4b7b-70c8-4234-ae4a-cc928b70462b'} Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979c4b7b-70c8-4234-ae4a-cc928b70462b could not be found. Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:39:04.181395 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979c4b7b-70c8-4234-ae4a-cc928b70462b could not be found. Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979c4b7b-70c8-4234-ae4a-cc928b70462b could not be found. Sep 10 10:39:04.183277 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.185343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] Returning 404 to user: Instance 979c4b7b-70c8-4234-ae4a-cc928b70462b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:39:04.185343 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b168a762-0c5a-4f72-b767-048ec4d69a2d tempest-InstanceActionsTestJSON-758237809 tempest-InstanceActionsTestJSON-758237809-project] 10.222.0.20 "GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b" status: 404 len: 111 microversion: 2.1 time: 0.034283 Sep 10 10:39:04.185343 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 600/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:04 2022] GET /compute/v2.1/servers/979c4b7b-70c8-4234-ae4a-cc928b70462b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:39:04.189309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ae90a867-bf0d-4d8b-976a-a0bc632a0e8b req-2e209479-985a-46e2-8f00-c97585d23df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ec3aa3-5082-4375-83af-0108cfee103e", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:04.204131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae90a867-bf0d-4d8b-976a-a0bc632a0e8b req-2e209479-985a-46e2-8f00-c97585d23df2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.204656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae90a867-bf0d-4d8b-976a-a0bc632a0e8b req-2e209479-985a-46e2-8f00-c97585d23df2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.205130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae90a867-bf0d-4d8b-976a-a0bc632a0e8b req-2e209479-985a-46e2-8f00-c97585d23df2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.219006 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ae90a867-bf0d-4d8b-976a-a0bc632a0e8b req-2e209479-985a-46e2-8f00-c97585d23df2 service nova] Creating event network-vif-unplugged:e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf for instance f1ec3aa3-5082-4375-83af-0108cfee103e on n-h1-856894-1 Sep 10 10:39:04.224158 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ae90a867-bf0d-4d8b-976a-a0bc632a0e8b req-2e209479-985a-46e2-8f00-c97585d23df2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042234 Sep 10 10:39:04.224756 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 601/1107] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:04.231957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:04.232550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:04.238999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.239422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.239859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.240561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.241016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.241471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.254961 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] HTTP exception thrown: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Request method failure captured: Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 HTTP/1.1 Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhp7nnRNasAAglteNOXq90ZZ_5fgKHPXhvNySMEDzwhpnBGiV8DJpt9HuWc7zzqZ2zviR_0u7sSGuCHzLY_LQevImAN68SS3jtEoNNOjgHbWzWNvnf-CUBrsjnENQtVHoa2XS4qbqF1aQtBxUkT3l9vJcCv_caP8iTMGTviO5xd3JM Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: cabcfc642a0a420caa4515a42aace3f6 Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-300269448 Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:39:04.256621 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cabcfc642a0a420caa4515a42aace3f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cabcfc642a0a420caa4515a42aace3f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cabcfc642a0a420caa4515a42aace3f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cabcfc642a0a420caa4515a42aace3f6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-300269448 Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: cabcfc642a0a420caa4515a42aace3f6 Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-300269448 Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachSCSIVolumeTestJSON-300269448-project Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3a26238f6d374b9789bd97cb6906bd2c Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-300269448-project Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:39:04.258099 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7d649fdd-c8f0-4b15-9434-32d88f643ed1'} Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:39:04.258850 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:39:04.260082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.261336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Returning 404 to user: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:39:04.261336 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1cb8651a-60f0-401f-afa6-cf240d337176 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 404 len: 111 microversion: 2.1 time: 0.032238 Sep 10 10:39:04.261336 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 602/1108] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:39:04 2022] DELETE /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:39:04.265478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2982b860-e026-4d1a-ac6f-62ad0cc9983d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:04.269090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2982b860-e026-4d1a-ac6f-62ad0cc9983d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.269650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2982b860-e026-4d1a-ac6f-62ad0cc9983d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.270151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2982b860-e026-4d1a-ac6f-62ad0cc9983d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.270972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2982b860-e026-4d1a-ac6f-62ad0cc9983d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.271460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2982b860-e026-4d1a-ac6f-62ad0cc9983d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.271925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2982b860-e026-4d1a-ac6f-62ad0cc9983d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.297362 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2982b860-e026-4d1a-ac6f-62ad0cc9983d tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037724 Sep 10 10:39:04.297972 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 603/1109] 10.222.0.20 () {60 vars in 1217 bytes} [Sat Sep 10 10:39:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:39:04.305434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:04.305434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: 7990b5bc-7c91-404f-99d0-dc02bb9875a2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:04.309887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.310459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.310985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.311790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.312314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.312903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.328891 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] HTTP exception thrown: Instance 7990b5bc-7c91-404f-99d0-dc02bb9875a2 could not be found. Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Request method failure captured: Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 HTTP/1.1 Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiZZwtluVZzECzqtk4pHS_D-bS8MCvEtSaApPOnJvYLZ4ODd0cepr0Neafxs4NDrDF5-vnW46C-kERordFHYMlymbWwGnrGaKQekzu83o64ASWvodo4GksQYi1SofAkgXAtOeyLKTY_0VfSQiF3gCqenbN1-Ivle_F4Cov5IiOP9tc Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: c6445fbb5cc5424c82a3c6d07abf7285 Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesAdminNegativeTest-2088522016 Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:39:04.330929 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6445fbb5cc5424c82a3c6d07abf7285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6445fbb5cc5424c82a3c6d07abf7285"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6445fbb5cc5424c82a3c6d07abf7285"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6445fbb5cc5424c82a3c6d07abf7285", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesAdminNegativeTest-2088522016 Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: c6445fbb5cc5424c82a3c6d07abf7285 Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2088522016 Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesAdminNegativeTest-2088522016-project Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 7376851ce7e84c71a18d7d2ac36e5d1f Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesAdminNegativeTest-2088522016-project Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7990b5bc-7c91-404f-99d0-dc02bb9875a2 could not be found. Sep 10 10:39:04.332267 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7990b5bc-7c91-404f-99d0-dc02bb9875a2'} Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7990b5bc-7c91-404f-99d0-dc02bb9875a2 could not be found. Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:39:04.333125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7990b5bc-7c91-404f-99d0-dc02bb9875a2 could not be found. Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7990b5bc-7c91-404f-99d0-dc02bb9875a2 could not be found. Sep 10 10:39:04.334484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:04.336166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Returning 404 to user: Instance 7990b5bc-7c91-404f-99d0-dc02bb9875a2 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:39:04.336166 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe997005-5d58-4487-8596-26b21583c2a3 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2" status: 404 len: 111 microversion: 2.1 time: 0.033665 Sep 10 10:39:04.337270 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 604/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:04 2022] GET /compute/v2.1/servers/7990b5bc-7c91-404f-99d0-dc02bb9875a2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:39:04.342335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-856894-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:04.344819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:04.347231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:39:04.354076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.354629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.355140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.355917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:04.356442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:04.356953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:04.387904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lazy-loading 'flavor' on Instance uuid 5751da7d-3075-4105-9e33-9b923dff4ca2 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:39:04.411644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Going to try to live migrate instance to n-h1-856894-1 {{(pid=128788) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 10:39:06.590047 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4082fbdc-f029-484a-b4cf-912b77915964 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2/action" status: 202 len: 0 microversion: 2.1 time: 2.248442 Sep 10 10:39:06.596381 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 605/1111] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:39:04 2022] POST /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2/action => generated 0 bytes in 2256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:39:06.617440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:06.620073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] [instance: 7d649fdd-c8f0-4b15-9434-32d88f643ed1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:06.670381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:06.671257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:06.673374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:06.674458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:06.677771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:06.678655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:06.731625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:39:06.747991 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] HTTP exception thrown: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Request method failure captured: Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 HTTP/1.1 Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGhp7nnRNasAAglteNOXq90ZZ_5fgKHPXhvNySMEDzwhpnBGiV8DJpt9HuWc7zzqZ2zviR_0u7sSGuCHzLY_LQevImAN68SS3jtEoNNOjgHbWzWNvnf-CUBrsjnENQtVHoa2XS4qbqF1aQtBxUkT3l9vJcCv_caP8iTMGTviO5xd3JM Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: cabcfc642a0a420caa4515a42aace3f6 Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-300269448 Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:39:06.754467 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cabcfc642a0a420caa4515a42aace3f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cabcfc642a0a420caa4515a42aace3f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cabcfc642a0a420caa4515a42aace3f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cabcfc642a0a420caa4515a42aace3f6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-300269448 Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: cabcfc642a0a420caa4515a42aace3f6 Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-300269448 Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachSCSIVolumeTestJSON-300269448-project Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3a26238f6d374b9789bd97cb6906bd2c Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-300269448-project Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:39:06.756111 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7d649fdd-c8f0-4b15-9434-32d88f643ed1'} Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:39:06.757117 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. Sep 10 10:39:06.759090 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:06.764789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] Returning 404 to user: Instance 7d649fdd-c8f0-4b15-9434-32d88f643ed1 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:39:06.766733 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b649021-389b-4c87-bfd3-dd3f32107594 tempest-AttachSCSIVolumeTestJSON-300269448 tempest-AttachSCSIVolumeTestJSON-300269448-project] 10.222.0.20 "GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1" status: 404 len: 111 microversion: 2.1 time: 0.162036 Sep 10 10:39:06.769276 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 606/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:06 2022] GET /compute/v2.1/servers/7d649fdd-c8f0-4b15-9434-32d88f643ed1 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:39:06.788615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:06.791906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] [instance: f1ec3aa3-5082-4375-83af-0108cfee103e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:06.809707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:06.811460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:06.812539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:06.815094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:06.816306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:06.821226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:06.839866 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] HTTP exception thrown: Instance f1ec3aa3-5082-4375-83af-0108cfee103e could not be found. Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Request method failure captured: Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e HTTP/1.1 Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkAOkSWQSqVekN0OPS0ld8I636oIPRCVFVZ_WN2AgT-uW-oXCiGIRJ2mm3nBCQEO8cGIt7H_0BQ83duO0hoHIYeaH5HWwWacXH-FZ-miOT4W7c1TwoxYFNz-stAf5i4RPJYQMTJrGCKVM7iYAsAjWC3EiFAvkxNvNZt3zc1lV3_olE Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 349a486eb0c34b76b50169c1dbe6b11f Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:39:06.841759 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/349a486eb0c34b76b50169c1dbe6b11f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_349a486eb0c34b76b50169c1dbe6b11f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 349a486eb0c34b76b50169c1dbe6b11f Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1319870254 Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FloatingIPsAssociationTestJSON-1319870254-project Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: dd1f2852ff4a4a4fb199977ad4cf82d2 Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1319870254-project Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f1ec3aa3-5082-4375-83af-0108cfee103e could not be found. Sep 10 10:39:06.843372 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f1ec3aa3-5082-4375-83af-0108cfee103e'} Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ec3aa3-5082-4375-83af-0108cfee103e could not be found. Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:39:06.844283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ec3aa3-5082-4375-83af-0108cfee103e could not be found. Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ec3aa3-5082-4375-83af-0108cfee103e could not be found. Sep 10 10:39:06.845981 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:06.849940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] Returning 404 to user: Instance f1ec3aa3-5082-4375-83af-0108cfee103e could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:39:06.851570 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7432f78-bbc3-47e2-a4a5-8391c540d16c tempest-FloatingIPsAssociationTestJSON-1319870254 tempest-FloatingIPsAssociationTestJSON-1319870254-project] 10.222.0.20 "GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e" status: 404 len: 111 microversion: 2.1 time: 0.079035 Sep 10 10:39:06.852300 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 607/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:06 2022] GET /compute/v2.1/servers/f1ec3aa3-5082-4375-83af-0108cfee103e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:39:06.857245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0452a99b-0bb3-4afd-b814-1ce66f2efcdb req-b4ebb249-2545-40d6-87d6-4461e7d215f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ec3aa3-5082-4375-83af-0108cfee103e", "name": "network-vif-deleted", "tag": "e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:06.869471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0452a99b-0bb3-4afd-b814-1ce66f2efcdb req-b4ebb249-2545-40d6-87d6-4461e7d215f0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:06.870210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0452a99b-0bb3-4afd-b814-1ce66f2efcdb req-b4ebb249-2545-40d6-87d6-4461e7d215f0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:06.870794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0452a99b-0bb3-4afd-b814-1ce66f2efcdb req-b4ebb249-2545-40d6-87d6-4461e7d215f0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:06.885687 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0452a99b-0bb3-4afd-b814-1ce66f2efcdb req-b4ebb249-2545-40d6-87d6-4461e7d215f0 service nova] Creating event network-vif-deleted:e4e9db81-7e01-4ebe-bd3d-454ba7eea6bf for instance f1ec3aa3-5082-4375-83af-0108cfee103e on n-h1-856894-1 Sep 10 10:39:06.891422 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0452a99b-0bb3-4afd-b814-1ce66f2efcdb req-b4ebb249-2545-40d6-87d6-4461e7d215f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037739 Sep 10 10:39:06.892653 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 608/1114] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:06.899561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7cd483aa-6279-4e2b-a0b0-c948d3ca4d37 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:06.900826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7cd483aa-6279-4e2b-a0b0-c948d3ca4d37 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:06.907756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cd483aa-6279-4e2b-a0b0-c948d3ca4d37 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:06.908551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cd483aa-6279-4e2b-a0b0-c948d3ca4d37 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:06.909464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cd483aa-6279-4e2b-a0b0-c948d3ca4d37 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:06.910677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cd483aa-6279-4e2b-a0b0-c948d3ca4d37 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:06.911299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cd483aa-6279-4e2b-a0b0-c948d3ca4d37 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:06.911892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cd483aa-6279-4e2b-a0b0-c948d3ca4d37 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:07.594719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7cd483aa-6279-4e2b-a0b0-c948d3ca4d37 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:07.604656 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7cd483aa-6279-4e2b-a0b0-c948d3ca4d37 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1504 microversion: 2.1 time: 0.710565 Sep 10 10:39:07.608712 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 609/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:06 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1504 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:07.626803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0658fc72-25c1-4131-8088-32d8c6b3479b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "052638ff-6169-42f9-8bba-bc64ef05d4d7", "device": "/dev/xvdb"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:07.630135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0658fc72-25c1-4131-8088-32d8c6b3479b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:07.639319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0658fc72-25c1-4131-8088-32d8c6b3479b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:07.639895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0658fc72-25c1-4131-8088-32d8c6b3479b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:07.640423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0658fc72-25c1-4131-8088-32d8c6b3479b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:07.642174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0658fc72-25c1-4131-8088-32d8c6b3479b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:07.642697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0658fc72-25c1-4131-8088-32d8c6b3479b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:07.643885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0658fc72-25c1-4131-8088-32d8c6b3479b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:08.061589 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0658fc72-25c1-4131-8088-32d8c6b3479b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "POST /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.450919 Sep 10 10:39:08.068694 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 610/1116] 10.222.0.20 () {62 vars in 1364 bytes} [Sat Sep 10 10:39:07 2022] POST /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:39:08.632423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26fc924f-f973-4b0a-a3fd-5381fc2b4ef9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:08.633209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26fc924f-f973-4b0a-a3fd-5381fc2b4ef9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:08.648854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26fc924f-f973-4b0a-a3fd-5381fc2b4ef9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:08.649390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26fc924f-f973-4b0a-a3fd-5381fc2b4ef9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:08.649832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26fc924f-f973-4b0a-a3fd-5381fc2b4ef9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:08.650537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26fc924f-f973-4b0a-a3fd-5381fc2b4ef9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:08.653365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26fc924f-f973-4b0a-a3fd-5381fc2b4ef9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:08.656781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26fc924f-f973-4b0a-a3fd-5381fc2b4ef9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:09.261839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-26fc924f-f973-4b0a-a3fd-5381fc2b4ef9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:09.283765 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26fc924f-f973-4b0a-a3fd-5381fc2b4ef9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1504 microversion: 2.1 time: 0.652383 Sep 10 10:39:09.285347 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 611/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:08 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1504 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:10.078749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1422106b-6921-400a-9da0-8571b28a06d9 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:10.080010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1422106b-6921-400a-9da0-8571b28a06d9 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:10.091695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1422106b-6921-400a-9da0-8571b28a06d9 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:10.093681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1422106b-6921-400a-9da0-8571b28a06d9 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:10.095918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1422106b-6921-400a-9da0-8571b28a06d9 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:10.098035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1422106b-6921-400a-9da0-8571b28a06d9 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:10.099228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1422106b-6921-400a-9da0-8571b28a06d9 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:10.100721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1422106b-6921-400a-9da0-8571b28a06d9 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:10.142265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1422106b-6921-400a-9da0-8571b28a06d9 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:39:10.285720 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1422106b-6921-400a-9da0-8571b28a06d9 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 204 len: 0 microversion: 2.1 time: 0.208115 Sep 10 10:39:10.289725 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 612/1118] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:39:10 2022] DELETE /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:39:10.309941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d2c5316-a3be-4bc3-923f-754d677f3237 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:10.310688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d2c5316-a3be-4bc3-923f-754d677f3237 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:10.321192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d2c5316-a3be-4bc3-923f-754d677f3237 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:10.321601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d2c5316-a3be-4bc3-923f-754d677f3237 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:10.322042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d2c5316-a3be-4bc3-923f-754d677f3237 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:10.322750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d2c5316-a3be-4bc3-923f-754d677f3237 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:10.323206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d2c5316-a3be-4bc3-923f-754d677f3237 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:10.323631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d2c5316-a3be-4bc3-923f-754d677f3237 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:10.886205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6d2c5316-a3be-4bc3-923f-754d677f3237 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:10.897095 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6d2c5316-a3be-4bc3-923f-754d677f3237 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1680 microversion: 2.1 time: 0.603102 Sep 10 10:39:10.898936 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 613/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:10 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1680 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:10.904817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf089154-a26c-4ec3-bc89-fde3a8e929e7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:10.905921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bf089154-a26c-4ec3-bc89-fde3a8e929e7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:10.913998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf089154-a26c-4ec3-bc89-fde3a8e929e7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:10.914984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf089154-a26c-4ec3-bc89-fde3a8e929e7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:10.916074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf089154-a26c-4ec3-bc89-fde3a8e929e7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:10.917226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf089154-a26c-4ec3-bc89-fde3a8e929e7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:10.917910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf089154-a26c-4ec3-bc89-fde3a8e929e7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:10.918834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf089154-a26c-4ec3-bc89-fde3a8e929e7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:11.424460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bf089154-a26c-4ec3-bc89-fde3a8e929e7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:11.432416 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf089154-a26c-4ec3-bc89-fde3a8e929e7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1504 microversion: 2.1 time: 0.532216 Sep 10 10:39:11.433016 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 614/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:10 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:11.579198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-47d085a9-4f0c-4d90-8a91-76d6841cda2c req-d56838f8-bdeb-4bdc-9c86-3eb9eb9c4c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5751da7d-3075-4105-9e33-9b923dff4ca2", "name": "network-vif-unplugged", "status": "completed", "tag": "03bced10-8ebd-4323-9fca-0c8b0be79660"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:11.592360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-47d085a9-4f0c-4d90-8a91-76d6841cda2c req-d56838f8-bdeb-4bdc-9c86-3eb9eb9c4c9c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:11.593177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-47d085a9-4f0c-4d90-8a91-76d6841cda2c req-d56838f8-bdeb-4bdc-9c86-3eb9eb9c4c9c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:11.593829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-47d085a9-4f0c-4d90-8a91-76d6841cda2c req-d56838f8-bdeb-4bdc-9c86-3eb9eb9c4c9c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:11.606457 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-47d085a9-4f0c-4d90-8a91-76d6841cda2c req-d56838f8-bdeb-4bdc-9c86-3eb9eb9c4c9c service nova] Creating event network-vif-unplugged:03bced10-8ebd-4323-9fca-0c8b0be79660 for instance 5751da7d-3075-4105-9e33-9b923dff4ca2 on n-h2-856894-1 Sep 10 10:39:11.614853 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-47d085a9-4f0c-4d90-8a91-76d6841cda2c req-d56838f8-bdeb-4bdc-9c86-3eb9eb9c4c9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173979 Sep 10 10:39:11.616127 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 615/1121] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:11.818825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27a807d7-4719-48ca-9740-9ae9d739889d tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae81a310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-401108606", "description": "tempest-description-197163906"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:12.820321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27a807d7-4719-48ca-9740-9ae9d739889d tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.133995 Sep 10 10:39:12.821421 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 616/1122] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:39:11 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:12.826450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e47c1a96-77a8-4e3d-864d-f546e43db373 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] Calling method '.version_select at 0x7efcae883160>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:12.869745 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e47c1a96-77a8-4e3d-864d-f546e43db373 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194628985" status: 202 len: 0 microversion: 2.1 time: 0.047160 Sep 10 10:39:12.871056 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 617/1123] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 10:39:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194628985 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:39:12.877020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7c0038e2-b423-41b6-af73-1a5322df171d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:12.878034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7c0038e2-b423-41b6-af73-1a5322df171d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:12.900054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c0038e2-b423-41b6-af73-1a5322df171d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:12.904261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c0038e2-b423-41b6-af73-1a5322df171d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:12.905208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c0038e2-b423-41b6-af73-1a5322df171d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:12.907354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c0038e2-b423-41b6-af73-1a5322df171d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:12.908057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c0038e2-b423-41b6-af73-1a5322df171d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:12.910093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c0038e2-b423-41b6-af73-1a5322df171d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:13.332975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c0038e2-b423-41b6-af73-1a5322df171d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7376851ce7e84c71a18d7d2ac36e5d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6445fbb5cc5424c82a3c6d07abf7285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:13.348605 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7c0038e2-b423-41b6-af73-1a5322df171d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 200 len: 1613 microversion: 2.1 time: 0.476188 Sep 10 10:39:13.349624 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 618/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:12 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 1613 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:13.355029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f3af837-bf7b-422e-a0ff-6c9615b6a71f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:13.355632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f3af837-bf7b-422e-a0ff-6c9615b6a71f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:13.375760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f3af837-bf7b-422e-a0ff-6c9615b6a71f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:13.376650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f3af837-bf7b-422e-a0ff-6c9615b6a71f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:13.377949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f3af837-bf7b-422e-a0ff-6c9615b6a71f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:13.381112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f3af837-bf7b-422e-a0ff-6c9615b6a71f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:13.381829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f3af837-bf7b-422e-a0ff-6c9615b6a71f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:13.383026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f3af837-bf7b-422e-a0ff-6c9615b6a71f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:13.853320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1f3af837-bf7b-422e-a0ff-6c9615b6a71f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:13.866773 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f3af837-bf7b-422e-a0ff-6c9615b6a71f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1504 microversion: 2.1 time: 0.514743 Sep 10 10:39:13.867682 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 619/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:13 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:13.883282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87303f74-1346-4dbb-919f-03279e0f7494 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae835ca0>, body: {"security_group_rule": {"parent_group_id": "2fe04614-42ae-481a-a19a-0763a0ed338b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:14.278714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:39:14.698682 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87303f74-1346-4dbb-919f-03279e0f7494 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.829750 Sep 10 10:39:14.699655 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 620/1126] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:39:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:14.704654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7982ada2-5075-4873-8397-aa5f0e7d554e req-ccf0fa6a-d304-4cca-83e6-b49186cb1a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5751da7d-3075-4105-9e33-9b923dff4ca2", "tag": "03bced10-8ebd-4323-9fca-0c8b0be79660"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:14.736770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7982ada2-5075-4873-8397-aa5f0e7d554e req-ccf0fa6a-d304-4cca-83e6-b49186cb1a70 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:14.737515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7982ada2-5075-4873-8397-aa5f0e7d554e req-ccf0fa6a-d304-4cca-83e6-b49186cb1a70 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:14.738078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7982ada2-5075-4873-8397-aa5f0e7d554e req-ccf0fa6a-d304-4cca-83e6-b49186cb1a70 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:14.795639 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7982ada2-5075-4873-8397-aa5f0e7d554e req-ccf0fa6a-d304-4cca-83e6-b49186cb1a70 service nova] Creating event network-changed:03bced10-8ebd-4323-9fca-0c8b0be79660 for instance 5751da7d-3075-4105-9e33-9b923dff4ca2 on n-h2-856894-1 Sep 10 10:39:14.812289 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7982ada2-5075-4873-8397-aa5f0e7d554e req-ccf0fa6a-d304-4cca-83e6-b49186cb1a70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109191 Sep 10 10:39:14.815324 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 621/1127] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:14.839410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:14.842679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] [instance: a8e9ca71-6d1b-4fc0-87dd-804a4a52745b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:14.856739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:14.860638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:14.861369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:14.863222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:14.871419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:14.872423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:14.900702 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] HTTP exception thrown: Instance a8e9ca71-6d1b-4fc0-87dd-804a4a52745b could not be found. Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Request method failure captured: Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b HTTP/1.1 Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiZZwtluVZzECzqtk4pHS_D-bS8MCvEtSaApPOnJvYLZ4ODd0cepr0Neafxs4NDrDF5-vnW46C-kERordFHYMlymbWwGnrGaKQekzu83o64ASWvodo4GksQYi1SofAkgXAtOeyLKTY_0VfSQiF3gCqenbN1-Ivle_F4Cov5IiOP9tc Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: c6445fbb5cc5424c82a3c6d07abf7285 Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesAdminNegativeTest-2088522016 Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:39:14.909981 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6445fbb5cc5424c82a3c6d07abf7285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6445fbb5cc5424c82a3c6d07abf7285"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6445fbb5cc5424c82a3c6d07abf7285"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6445fbb5cc5424c82a3c6d07abf7285", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesAdminNegativeTest-2088522016 Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: c6445fbb5cc5424c82a3c6d07abf7285 Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2088522016 Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesAdminNegativeTest-2088522016-project Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 7376851ce7e84c71a18d7d2ac36e5d1f Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesAdminNegativeTest-2088522016-project Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance a8e9ca71-6d1b-4fc0-87dd-804a4a52745b could not be found. Sep 10 10:39:14.911342 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'a8e9ca71-6d1b-4fc0-87dd-804a4a52745b'} Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e9ca71-6d1b-4fc0-87dd-804a4a52745b could not be found. Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:39:14.912097 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e9ca71-6d1b-4fc0-87dd-804a4a52745b could not be found. Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e9ca71-6d1b-4fc0-87dd-804a4a52745b could not be found. Sep 10 10:39:14.913549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:14.923134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Returning 404 to user: Instance a8e9ca71-6d1b-4fc0-87dd-804a4a52745b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:39:14.924941 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6a683b4e-cad0-4df5-8b09-4948d87389f4 tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b" status: 404 len: 111 microversion: 2.1 time: 0.108309 Sep 10 10:39:14.925956 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 622/1128] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:14 2022] GET /compute/v2.1/servers/a8e9ca71-6d1b-4fc0-87dd-804a4a52745b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:39:14.935238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49904dfb-a357-4f55-8d41-bb0ab679d415 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae87c5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-89507300", "description": "tempest-description-483700350"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:15.700774 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-49904dfb-a357-4f55-8d41-bb0ab679d415 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.773517 Sep 10 10:39:15.701706 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 623/1129] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:39:14 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:15.706496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7818a651-eaf1-469a-afa3-438a6d8f9939 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:15.707394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7818a651-eaf1-469a-afa3-438a6d8f9939 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:15.723413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7818a651-eaf1-469a-afa3-438a6d8f9939 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:15.724287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7818a651-eaf1-469a-afa3-438a6d8f9939 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:15.737154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7818a651-eaf1-469a-afa3-438a6d8f9939 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:15.738491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7818a651-eaf1-469a-afa3-438a6d8f9939 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:15.739210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7818a651-eaf1-469a-afa3-438a6d8f9939 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:15.739873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7818a651-eaf1-469a-afa3-438a6d8f9939 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:16.470954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7818a651-eaf1-469a-afa3-438a6d8f9939 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:16.480273 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7818a651-eaf1-469a-afa3-438a6d8f9939 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1504 microversion: 2.1 time: 0.777294 Sep 10 10:39:16.489830 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 624/1130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:15 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1504 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:16.495644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33f76525-ffc6-45e3-a028-e7ae48ee935d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] Calling method '.version_select at 0x7efcae815790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:16.565285 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-33f76525-ffc6-45e3-a028-e7ae48ee935d tempest-VolumesAdminNegativeTest-2088522016 tempest-VolumesAdminNegativeTest-2088522016-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465398661" status: 202 len: 0 microversion: 2.1 time: 0.073863 Sep 10 10:39:16.566264 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 625/1131] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 10:39:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465398661 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:39:16.576658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28e8a690-03da-4810-8544-939327ed2060 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae825ca0>, body: {"security_group_rule": {"parent_group_id": "1ba171b4-fabf-4b8a-891f-4cbcc20bf040", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:17.828290 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-28e8a690-03da-4810-8544-939327ed2060 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.257449 Sep 10 10:39:17.828968 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 626/1132] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:39:16 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:17.834156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3e7a35b6-1594-4a83-9d5f-a60d7be9bd57 req-783cebf6-8e0e-413d-aebc-1c2c0822f3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e9ca71-6d1b-4fc0-87dd-804a4a52745b", "name": "network-vif-deleted", "tag": "4f741feb-1286-4ef7-a2c4-4f8c4ea45848"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:17.858456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e7a35b6-1594-4a83-9d5f-a60d7be9bd57 req-783cebf6-8e0e-413d-aebc-1c2c0822f3f2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:17.858969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e7a35b6-1594-4a83-9d5f-a60d7be9bd57 req-783cebf6-8e0e-413d-aebc-1c2c0822f3f2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:17.860593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e7a35b6-1594-4a83-9d5f-a60d7be9bd57 req-783cebf6-8e0e-413d-aebc-1c2c0822f3f2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:17.887066 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3e7a35b6-1594-4a83-9d5f-a60d7be9bd57 req-783cebf6-8e0e-413d-aebc-1c2c0822f3f2 service nova] Creating event network-vif-deleted:4f741feb-1286-4ef7-a2c4-4f8c4ea45848 for instance a8e9ca71-6d1b-4fc0-87dd-804a4a52745b on n-h1-856894-1 Sep 10 10:39:17.898921 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3e7a35b6-1594-4a83-9d5f-a60d7be9bd57 req-783cebf6-8e0e-413d-aebc-1c2c0822f3f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066240 Sep 10 10:39:17.899772 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 627/1133] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:17.910333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49c9ef1d-f425-4643-b984-5e010c57bfea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:17.911201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-49c9ef1d-f425-4643-b984-5e010c57bfea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:17.918153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49c9ef1d-f425-4643-b984-5e010c57bfea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:17.918922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49c9ef1d-f425-4643-b984-5e010c57bfea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:17.919653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49c9ef1d-f425-4643-b984-5e010c57bfea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:17.920586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49c9ef1d-f425-4643-b984-5e010c57bfea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:17.921341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49c9ef1d-f425-4643-b984-5e010c57bfea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:17.921987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49c9ef1d-f425-4643-b984-5e010c57bfea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:18.259165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-49c9ef1d-f425-4643-b984-5e010c57bfea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:18.270774 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-49c9ef1d-f425-4643-b984-5e010c57bfea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1504 microversion: 2.1 time: 0.369364 Sep 10 10:39:18.272287 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 628/1134] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:17 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:18.285894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1503a25-f749-454d-9b1f-ffdb7d2bb926 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae8254c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1239230976", "description": "tempest-description-1802203812"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:19.391233 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1503a25-f749-454d-9b1f-ffdb7d2bb926 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.116933 Sep 10 10:39:19.391856 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 629/1135] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:39:18 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:19.396621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea339041-5a0a-4c1f-990e-bb5825dc7496 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:19.397463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea339041-5a0a-4c1f-990e-bb5825dc7496 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:19.421087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea339041-5a0a-4c1f-990e-bb5825dc7496 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:19.423141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea339041-5a0a-4c1f-990e-bb5825dc7496 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:19.427014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea339041-5a0a-4c1f-990e-bb5825dc7496 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:19.427929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea339041-5a0a-4c1f-990e-bb5825dc7496 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:19.428591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea339041-5a0a-4c1f-990e-bb5825dc7496 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:19.433039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea339041-5a0a-4c1f-990e-bb5825dc7496 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:20.001391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ea339041-5a0a-4c1f-990e-bb5825dc7496 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:20.013297 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea339041-5a0a-4c1f-990e-bb5825dc7496 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1504 microversion: 2.1 time: 0.620231 Sep 10 10:39:20.014267 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 630/1136] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:19 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1504 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:20.026218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6b5f43b4-3cac-4365-a714-a5188d77d0af tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae87c700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1544369575", "description": "tempest-description-1125837735"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:20.818740 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6b5f43b4-3cac-4365-a714-a5188d77d0af tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.802685 Sep 10 10:39:20.822560 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 631/1137] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:39:20 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:20.838551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80a8001b-f0bf-42e4-854c-9420ce58efb5 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae8253a0>, body: {"security_group_rule": {"parent_group_id": "8ce50ed5-9a56-49c8-91cf-f5ea34eb2187", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a1f12221-e574-4bb7-98a7-4ed1c109ff89"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:22.430588 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80a8001b-f0bf-42e4-854c-9420ce58efb5 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.598831 Sep 10 10:39:22.445346 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 632/1138] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:39:20 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:22.450729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-999d3727-8343-477c-b2c9-c9a43ceda0d3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:22.451641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-999d3727-8343-477c-b2c9-c9a43ceda0d3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:22.460768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-999d3727-8343-477c-b2c9-c9a43ceda0d3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:22.463206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-999d3727-8343-477c-b2c9-c9a43ceda0d3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:22.464894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-999d3727-8343-477c-b2c9-c9a43ceda0d3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:22.467931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-999d3727-8343-477c-b2c9-c9a43ceda0d3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:22.468635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-999d3727-8343-477c-b2c9-c9a43ceda0d3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:22.469285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-999d3727-8343-477c-b2c9-c9a43ceda0d3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:22.538441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:39:22.926758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-999d3727-8343-477c-b2c9-c9a43ceda0d3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:22.936018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-999d3727-8343-477c-b2c9-c9a43ceda0d3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1494 microversion: 2.1 time: 0.489094 Sep 10 10:39:22.936628 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 633/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:22 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1494 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:22.942446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-84f67261-3d9a-493c-a356-1c575db60292 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae87c8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1009598592", "description": "tempest-description-1061016402"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:23.460989 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-84f67261-3d9a-493c-a356-1c575db60292 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.522090 Sep 10 10:39:23.463899 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 634/1140] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:39:22 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:23.479168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79d1f026-00d8-4e57-9934-603f916e8405 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '.version_select at 0x7efcae87ca60>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:23.497427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79d1f026-00d8-4e57-9934-603f916e8405 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:23.498544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79d1f026-00d8-4e57-9934-603f916e8405 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:23.499134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79d1f026-00d8-4e57-9934-603f916e8405 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:23.534890 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79d1f026-00d8-4e57-9934-603f916e8405 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.068330 Sep 10 10:39:23.535526 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 635/1141] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:39:23 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:23.546240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-64e42cf4-f5b4-4786-963f-aee020167dbb tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae84b040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1984089335", "description": "tempest-description-1360879722"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:24.766017 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-64e42cf4-f5b4-4786-963f-aee020167dbb tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.229381 Sep 10 10:39:24.767926 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 636/1142] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:39:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:24.785302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ed87cf8-4a69-4046-8d22-7e8f23c8a4a3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:24.787437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3ed87cf8-4a69-4046-8d22-7e8f23c8a4a3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:24.805897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ed87cf8-4a69-4046-8d22-7e8f23c8a4a3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:24.806547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ed87cf8-4a69-4046-8d22-7e8f23c8a4a3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:24.807111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ed87cf8-4a69-4046-8d22-7e8f23c8a4a3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:24.807991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ed87cf8-4a69-4046-8d22-7e8f23c8a4a3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:24.808679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ed87cf8-4a69-4046-8d22-7e8f23c8a4a3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:24.809306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ed87cf8-4a69-4046-8d22-7e8f23c8a4a3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:25.154181 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3ed87cf8-4a69-4046-8d22-7e8f23c8a4a3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1645 microversion: 2.1 time: 0.382107 Sep 10 10:39:25.155276 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 637/1143] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:24 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1645 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:25.167555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a2e2220-3506-4c5c-a2c9-159b7370b9aa tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:25.168633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8a2e2220-3506-4c5c-a2c9-159b7370b9aa tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:25.180916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a2e2220-3506-4c5c-a2c9-159b7370b9aa tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:25.181763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a2e2220-3506-4c5c-a2c9-159b7370b9aa tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:25.182981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a2e2220-3506-4c5c-a2c9-159b7370b9aa tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:25.184054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a2e2220-3506-4c5c-a2c9-159b7370b9aa tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:25.184874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a2e2220-3506-4c5c-a2c9-159b7370b9aa tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:25.185544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a2e2220-3506-4c5c-a2c9-159b7370b9aa tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:25.689891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-8a2e2220-3506-4c5c-a2c9-159b7370b9aa tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid 7bf4f355-1582-4020-a738-9d8579be881b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:39:25.720278 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8a2e2220-3506-4c5c-a2c9-159b7370b9aa tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 2424 microversion: 2.25 time: 0.563520 Sep 10 10:39:25.749398 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 638/1144] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:39:25 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 2424 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:39:25.754616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d13c405-4337-4baf-bff8-5b5cc464ab4d tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae7d6940>, body: {"security_group_rule": {"parent_group_id": "44a00144-27d9-4701-b675-227fbb1fa480", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "03109d55-8187-453f-9874-9a24266e9ed9"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:26.837719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d13c405-4337-4baf-bff8-5b5cc464ab4d tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.086727 Sep 10 10:39:26.838451 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 639/1145] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:39:25 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:26.844062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1722978370", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "739381d7-2276-4bb9-bb8a-d3d8569e8efc"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:26.967843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] validate_networks() for [('739381d7-2276-4bb9-bb8a-d3d8569e8efc', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:39:29.079419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:39:29.080569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:39:29.081874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:39:29.082493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:39:29.083132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:39:29.109991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:29.110580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:29.112445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:29.118102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:29.118711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:29.119168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:29.187604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Getting quotas for project bb350b19a7254f0bbffb6e5b8dc2bbe3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:39:29.202192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Getting quotas for user a1013c609b044cb781dd1691909db7bf and project bb350b19a7254f0bbffb6e5b8dc2bbe3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:39:29.220906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:39:29.223750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:39:29.316672 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9122d3eb-9dee-46a7-b519-ae52365b15fb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.477046 Sep 10 10:39:29.317812 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 640/1146] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:39:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:39:29.324284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-856894-1", "block_migration": "auto"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:29.328335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:29.351886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:29.352817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:29.353563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:29.354484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:29.355150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:29.355821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:29.426763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'flavor' on Instance uuid 7bf4f355-1582-4020-a738-9d8579be881b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:39:29.455166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Going to try to live migrate instance to n-h1-856894-1 {{(pid=128788) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 10:39:33.136703 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8efe4374-f032-4371-af79-157b8d1f71a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/action" status: 202 len: 0 microversion: 2.25 time: 3.816568 Sep 10 10:39:33.139581 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 641/1147] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:39:29 2022] POST /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/action => generated 0 bytes in 3821 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:39:33.153492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85410c68-b361-43e5-90aa-74ac235c7377 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcae7e2c10>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:34.918827 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85410c68-b361-43e5-90aa-74ac235c7377 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/03109d55-8187-453f-9874-9a24266e9ed9" status: 202 len: 0 microversion: 2.1 time: 1.777834 Sep 10 10:39:34.920152 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 642/1148] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:39:33 2022] DELETE /compute/v2.1/os-security-groups/03109d55-8187-453f-9874-9a24266e9ed9 => generated 0 bytes in 1780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:39:34.925184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea0ee2fe-bf1c-4eec-a9b3-69bd58309b26 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:34.926525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea0ee2fe-bf1c-4eec-a9b3-69bd58309b26 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:34.930730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:39:34.945044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea0ee2fe-bf1c-4eec-a9b3-69bd58309b26 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:34.946364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea0ee2fe-bf1c-4eec-a9b3-69bd58309b26 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:34.948385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea0ee2fe-bf1c-4eec-a9b3-69bd58309b26 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:34.949698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea0ee2fe-bf1c-4eec-a9b3-69bd58309b26 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:34.951854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea0ee2fe-bf1c-4eec-a9b3-69bd58309b26 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:34.952676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea0ee2fe-bf1c-4eec-a9b3-69bd58309b26 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:35.230440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ea0ee2fe-bf1c-4eec-a9b3-69bd58309b26 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:35.250014 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea0ee2fe-bf1c-4eec-a9b3-69bd58309b26 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1269 microversion: 2.1 time: 0.325016 Sep 10 10:39:35.253703 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 643/1149] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:34 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1269 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:35.589619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-991638199", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "fab32c3e-22ab-4f65-908f-4fc13bb820f4"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:35.713198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] validate_networks() for [('fab32c3e-22ab-4f65-908f-4fc13bb820f4', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:39:38.498529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:39:38.499743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:39:38.501328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:39:38.501778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:39:38.502207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:39:38.513307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:38.513801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:38.514248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:38.514986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:38.521342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:38.522260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:38.578717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Getting quotas for project 9d9f9ca498dd4db18965e199d7d385f3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:39:38.588744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Getting quotas for user e1b58fd7016a470b9cc588bc2f7eab7b and project 9d9f9ca498dd4db18965e199d7d385f3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:39:38.626027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Going to run 3 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:39:38.632731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:39:38.721771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: e84e3fbc-9d8c-4029-874c-34eec1bba0c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=17266718-ca01-4a84-b2ee-800852e38df1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:39:38.809981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 307ad6bd-3be6-49e5-b902-dcb017a25d22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=e84e3fbc-9d8c-4029-874c-34eec1bba0c0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:39:38.943343 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-619fc275-164b-4403-856a-9e8db704173e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.688059 Sep 10 10:39:38.944980 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 644/1150] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:39:38.950242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:38.951504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:38.958843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:38.960416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:38.961299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:38.962554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:38.963242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:38.963896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:39.419941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:39.436286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:39.440795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:39.444082 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc4805cf-8e42-4e7a-b989-a818562e11bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1815 microversion: 2.25 time: 0.497397 Sep 10 10:39:39.446447 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 645/1151] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:39:38 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1815 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:39:39.535386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a2e70ea-eee4-4269-b883-3401fc0f4554 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:39.584252 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a2e70ea-eee4-4269-b883-3401fc0f4554 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.134269 Sep 10 10:39:39.598770 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 646/1152] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:39:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:39.619462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94a13696-0818-4092-9e2b-1e75b80a3812 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcae7ec160>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:39.778135 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94a13696-0818-4092-9e2b-1e75b80a3812 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/44a00144-27d9-4701-b675-227fbb1fa480" status: 200 len: 248 microversion: 2.1 time: 0.173651 Sep 10 10:39:39.779956 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 647/1153] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:39:39 2022] GET /compute/v2.1/os-security-groups/44a00144-27d9-4701-b675-227fbb1fa480 => generated 248 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:39.789969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1c43956-fc9e-45a3-9240-8d008a120e14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:39.790607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e1c43956-fc9e-45a3-9240-8d008a120e14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:39.815933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1c43956-fc9e-45a3-9240-8d008a120e14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:39.816449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1c43956-fc9e-45a3-9240-8d008a120e14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:39.816903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1c43956-fc9e-45a3-9240-8d008a120e14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:39.820494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1c43956-fc9e-45a3-9240-8d008a120e14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:39.821207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1c43956-fc9e-45a3-9240-8d008a120e14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:39.821680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1c43956-fc9e-45a3-9240-8d008a120e14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:40.639644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e1c43956-fc9e-45a3-9240-8d008a120e14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:40.653427 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1c43956-fc9e-45a3-9240-8d008a120e14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1311 microversion: 2.1 time: 0.872278 Sep 10 10:39:40.656062 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 648/1154] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:39 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1311 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:40.802298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2126020e-12ac-4140-9613-6f2308f8e586 tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] Calling method '.version_select at 0x7efcae7ecee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:40.995938 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2126020e-12ac-4140-9613-6f2308f8e586 tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.338063 Sep 10 10:39:40.996994 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 649/1155] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:39:40 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:39:41.002825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:41.019948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:41.023438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Searching by: {'deleted': False, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:39:41.047930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:41.048450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:41.049813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:41.050632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:41.051107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:41.051539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:41.356145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:39:41.496774 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c4bf98d-7665-4392-9e6d-4695411661e2 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.492152 Sep 10 10:39:41.497542 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 650/1156] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 10:39:40 2022] GET /compute/v2.1/servers => generated 1015 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:41.502938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2dcc6a88-6344-4716-b1db-0f017aba2f48 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:41.551574 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2dcc6a88-6344-4716-b1db-0f017aba2f48 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.052834 Sep 10 10:39:41.552645 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 651/1157] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 10:39:41 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:41.560367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-41103920-3898-4f6d-b0df-fe92e3c414a7 req-9ca92a72-e167-4aff-a53a-cdc7fac59648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677f76e1-63ef-4c0a-806d-7c965e2fca1d", "tag": "735d8dd5-9665-43f6-887a-972fb6ed4a3f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:41.575358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41103920-3898-4f6d-b0df-fe92e3c414a7 req-9ca92a72-e167-4aff-a53a-cdc7fac59648 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:41.575953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41103920-3898-4f6d-b0df-fe92e3c414a7 req-9ca92a72-e167-4aff-a53a-cdc7fac59648 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:41.576410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41103920-3898-4f6d-b0df-fe92e3c414a7 req-9ca92a72-e167-4aff-a53a-cdc7fac59648 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:41.590121 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-41103920-3898-4f6d-b0df-fe92e3c414a7 req-9ca92a72-e167-4aff-a53a-cdc7fac59648 service nova] Creating event network-changed:735d8dd5-9665-43f6-887a-972fb6ed4a3f for instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d on n-h1-856894-1 Sep 10 10:39:41.596105 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-41103920-3898-4f6d-b0df-fe92e3c414a7 req-9ca92a72-e167-4aff-a53a-cdc7fac59648 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042172 Sep 10 10:39:41.596815 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 652/1158] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:41.606478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c030780-39a2-4863-832a-be84fd09ae62 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae7e4ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-750577634", "description": "tempest-description-584683441"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:41.934150 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c030780-39a2-4863-832a-be84fd09ae62 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.331974 Sep 10 10:39:41.934916 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 653/1159] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:39:41 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:41.948868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:41.949671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:41.990702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:41.991772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:41.992217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:42.003694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:42.004588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:42.004963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:42.726639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:42.739325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:42.747004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:42.754699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5292e179-16f2-47c9-97a4-132a08ca42d6 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1815 microversion: 2.25 time: 0.810352 Sep 10 10:39:42.761207 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 654/1160] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:39:41 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1815 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:39:42.783921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22cbe367-6aa8-492c-a832-758ae498d2c9 tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] Action: 'create', calling method: .version_select at 0x7efcae7e8f70>, body: {"pool": "non_exist_pool"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:43.038280 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-22cbe367-6aa8-492c-a832-758ae498d2c9 tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] HTTP exception thrown: Floating IP pool not found. Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22cbe367-6aa8-492c-a832-758ae498d2c9 tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] Request method failure captured: Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 26 Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlouBa2z5xZlSJ4DCOOlk2bnjRudvMGXmwxExLxvycYJLqPp9I5tFZgK1AgY-HGVMb2WXl-zYJ1QE2PFkbWtPNJaa4VEENg18UVpNC39CorsUxXOH_9B4j-uytDI5QSDKwo9BQtMDq4IKgD5q3mw9TDWgUdb-NjnoSLDWxU6K_Rjbw Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: c24506e3927f4a428b8fb6d409bf12c3 Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1534284799 Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:39:43.039943 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c24506e3927f4a428b8fb6d409bf12c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c24506e3927f4a428b8fb6d409bf12c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c24506e3927f4a428b8fb6d409bf12c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c24506e3927f4a428b8fb6d409bf12c3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1534284799 Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: c24506e3927f4a428b8fb6d409bf12c3 Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1534284799 Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FloatingIPsNegativeTestJSON-1534284799-project Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e3e6343f8b344920888e8c3d99d060cf Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1534284799-project Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: {"pool": "non_exist_pool"} Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: exception: Floating IP pool not found. Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 10 10:39:43.041745 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:39:43.042853 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22cbe367-6aa8-492c-a832-758ae498d2c9 tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] Returning 404 to user: Floating IP pool not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:39:43.044259 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-22cbe367-6aa8-492c-a832-758ae498d2c9 tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.277519 Sep 10 10:39:43.046257 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 655/1161] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:39:42 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:39:43.050644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a36518b-2411-4e24-8e31-8392574f4beb tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:43.057199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0a36518b-2411-4e24-8e31-8392574f4beb tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:43.103134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a36518b-2411-4e24-8e31-8392574f4beb tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:43.104609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a36518b-2411-4e24-8e31-8392574f4beb tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:43.105250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a36518b-2411-4e24-8e31-8392574f4beb tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:43.106944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a36518b-2411-4e24-8e31-8392574f4beb tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:43.107682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a36518b-2411-4e24-8e31-8392574f4beb tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:43.108700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a36518b-2411-4e24-8e31-8392574f4beb tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:43.736310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0a36518b-2411-4e24-8e31-8392574f4beb tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:43.745887 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0a36518b-2411-4e24-8e31-8392574f4beb tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 200 len: 1280 microversion: 2.1 time: 0.702248 Sep 10 10:39:43.746396 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 656/1162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:43 2022] GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 1280 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:43.773999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-424d82ae-a0d3-4ca3-ba74-56332af60d02 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:43.794077 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-424d82ae-a0d3-4ca3-ba74-56332af60d02 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033944 Sep 10 10:39:43.795076 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 657/1163] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:39:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:43.799926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1cfd2d93-fd6a-428f-972a-ac5b873c1677 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:43.800405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1cfd2d93-fd6a-428f-972a-ac5b873c1677 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:43.828187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cfd2d93-fd6a-428f-972a-ac5b873c1677 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:43.835841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cfd2d93-fd6a-428f-972a-ac5b873c1677 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:43.836293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cfd2d93-fd6a-428f-972a-ac5b873c1677 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:43.837266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cfd2d93-fd6a-428f-972a-ac5b873c1677 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:43.837897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cfd2d93-fd6a-428f-972a-ac5b873c1677 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:43.838608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cfd2d93-fd6a-428f-972a-ac5b873c1677 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:45.264356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1cfd2d93-fd6a-428f-972a-ac5b873c1677 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:45.273309 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1cfd2d93-fd6a-428f-972a-ac5b873c1677 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1311 microversion: 2.1 time: 1.476259 Sep 10 10:39:45.274215 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 658/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:43 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1311 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:45.300643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c9e784bb-b89c-45fc-b99c-03b4fd7bdc75 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae7e8b80>, body: {"security_group_rule": {"parent_group_id": "679f2df8-bc52-4ca6-b057-ac1f82dbb29d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:47.054538 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c9e784bb-b89c-45fc-b99c-03b4fd7bdc75 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.769685 Sep 10 10:39:47.055199 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 659/1165] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:39:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:47.070226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b25c76de-631e-4b55-8308-d5aaa07966ad tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] Calling method '.version_select at 0x7efcae7e2670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:47.199412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-b25c76de-631e-4b55-8308-d5aaa07966ad tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 93135d85-ad5d-4201-967d-e2801e8c9920 could not be found", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:39:47.201226 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b25c76de-631e-4b55-8308-d5aaa07966ad tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] HTTP exception thrown: Floating IP not found for ID 93135d85-ad5d-4201-967d-e2801e8c9920 Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b25c76de-631e-4b55-8308-d5aaa07966ad tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] Request method failure captured: Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-floating-ips/93135d85-ad5d-4201-967d-e2801e8c9920 HTTP/1.1 Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlouBa2z5xZlSJ4DCOOlk2bnjRudvMGXmwxExLxvycYJLqPp9I5tFZgK1AgY-HGVMb2WXl-zYJ1QE2PFkbWtPNJaa4VEENg18UVpNC39CorsUxXOH_9B4j-uytDI5QSDKwo9BQtMDq4IKgD5q3mw9TDWgUdb-NjnoSLDWxU6K_Rjbw Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: c24506e3927f4a428b8fb6d409bf12c3 Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1534284799 Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:39:47.203196 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c24506e3927f4a428b8fb6d409bf12c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c24506e3927f4a428b8fb6d409bf12c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c24506e3927f4a428b8fb6d409bf12c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c24506e3927f4a428b8fb6d409bf12c3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1534284799 Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: c24506e3927f4a428b8fb6d409bf12c3 Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1534284799 Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FloatingIPsNegativeTestJSON-1534284799-project Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e3e6343f8b344920888e8c3d99d060cf Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1534284799-project Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: exception: Floating IP not found for ID 93135d85-ad5d-4201-967d-e2801e8c9920 Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '93135d85-ad5d-4201-967d-e2801e8c9920'} Sep 10 10:39:47.204672 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:39:47.205599 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 93135d85-ad5d-4201-967d-e2801e8c9920 could not be found Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-391d71f0-6d0a-4651-8a89-abbd829dc01b'] Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 93135d85-ad5d-4201-967d-e2801e8c9920. Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:47.206919 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 93135d85-ad5d-4201-967d-e2801e8c9920 Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:39:47.208831 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:39:47.211675 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 93135d85-ad5d-4201-967d-e2801e8c9920 Sep 10 10:39:47.211675 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:47.216748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b25c76de-631e-4b55-8308-d5aaa07966ad tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] Returning 404 to user: Floating IP not found for ID 93135d85-ad5d-4201-967d-e2801e8c9920 {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:39:47.216748 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b25c76de-631e-4b55-8308-d5aaa07966ad tempest-FloatingIPsNegativeTestJSON-1534284799 tempest-FloatingIPsNegativeTestJSON-1534284799-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/93135d85-ad5d-4201-967d-e2801e8c9920" status: 404 len: 111 microversion: 2.1 time: 0.150198 Sep 10 10:39:47.216748 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 660/1166] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:39:47 2022] DELETE /compute/v2.1/os-floating-ips/93135d85-ad5d-4201-967d-e2801e8c9920 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:39:47.250743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:47.253061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:47.271460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:47.276296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:47.278393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:47.279253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:47.281812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:47.286791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:47.683056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:47.699770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:47.701371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:47.705165 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d27f664-f1ce-428d-a940-0f915355e158 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1815 microversion: 2.25 time: 0.473835 Sep 10 10:39:47.709266 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 661/1167] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:39:47 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1815 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:39:47.721247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f7065dd-70e1-44a7-abae-30a2f7dd1b90 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:47.746772 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f7065dd-70e1-44a7-abae-30a2f7dd1b90 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031427 Sep 10 10:39:47.748186 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 662/1168] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:39:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:48.500493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc7d3371-3494-4ad2-9b81-bc3db35337a1 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Action: 'create', calling method: .version_select at 0x7efcae7e2940>, body: {"keypair": {"name": "tempest-keypair-2061915880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDqosHPkQ/vqU9M50fcnk9WVA56HWfnbL7xXbPmLl1l1xh+EHkogdWP8JOumoLfpXAfte/EnEihaZ31EWXgrjDz3lEbRe983vX09c7mqE/LzD8TJxxbmr0W6xrIG6BKhw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:48.523370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fc7d3371-3494-4ad2-9b81-bc3db35337a1 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Getting quotas for project 76f49d607f6a4934a17b15d43755a0d6. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:39:48.535308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fc7d3371-3494-4ad2-9b81-bc3db35337a1 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Getting quotas for user 2688e0179e93428cb8c196d389d2fc78 and project 76f49d607f6a4934a17b15d43755a0d6. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:39:48.570439 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc7d3371-3494-4ad2-9b81-bc3db35337a1 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.819794 Sep 10 10:39:48.571471 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 663/1169] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:39:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:48.576805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e00cefa0-8c90-4736-9bda-159b090cdc53 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:48.577728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e00cefa0-8c90-4736-9bda-159b090cdc53 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:48.584443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e00cefa0-8c90-4736-9bda-159b090cdc53 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:48.585242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e00cefa0-8c90-4736-9bda-159b090cdc53 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:48.585934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e00cefa0-8c90-4736-9bda-159b090cdc53 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:48.586823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e00cefa0-8c90-4736-9bda-159b090cdc53 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:48.587621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e00cefa0-8c90-4736-9bda-159b090cdc53 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:48.588278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e00cefa0-8c90-4736-9bda-159b090cdc53 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:49.010668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e00cefa0-8c90-4736-9bda-159b090cdc53 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:49.035075 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e00cefa0-8c90-4736-9bda-159b090cdc53 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 200 len: 1322 microversion: 2.1 time: 0.459746 Sep 10 10:39:49.037058 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 664/1170] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:48 2022] GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 1322 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:49.145949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b34212e1-e239-4b90-9a18-1a8c096e4e21 req-e1c6cb4a-674f-4047-b88f-a48d0cbaa13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f76e1-63ef-4c0a-806d-7c965e2fca1d", "name": "network-vif-plugged", "status": "completed", "tag": "735d8dd5-9665-43f6-887a-972fb6ed4a3f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:49.157459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b34212e1-e239-4b90-9a18-1a8c096e4e21 req-e1c6cb4a-674f-4047-b88f-a48d0cbaa13b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:49.158478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b34212e1-e239-4b90-9a18-1a8c096e4e21 req-e1c6cb4a-674f-4047-b88f-a48d0cbaa13b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:49.159118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b34212e1-e239-4b90-9a18-1a8c096e4e21 req-e1c6cb4a-674f-4047-b88f-a48d0cbaa13b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:49.168751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:39:49.181407 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b34212e1-e239-4b90-9a18-1a8c096e4e21 req-e1c6cb4a-674f-4047-b88f-a48d0cbaa13b service nova] Creating event network-vif-plugged:735d8dd5-9665-43f6-887a-972fb6ed4a3f for instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d on n-h1-856894-1 Sep 10 10:39:49.187844 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b34212e1-e239-4b90-9a18-1a8c096e4e21 req-e1c6cb4a-674f-4047-b88f-a48d0cbaa13b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148705 Sep 10 10:39:49.189193 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 665/1171] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:49.200728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b544514a-8ca8-4f2c-88ee-1b181e092ebb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:49.202341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b544514a-8ca8-4f2c-88ee-1b181e092ebb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:49.212117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b544514a-8ca8-4f2c-88ee-1b181e092ebb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:49.213186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b544514a-8ca8-4f2c-88ee-1b181e092ebb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:49.213896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b544514a-8ca8-4f2c-88ee-1b181e092ebb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:49.214864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b544514a-8ca8-4f2c-88ee-1b181e092ebb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:49.215711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b544514a-8ca8-4f2c-88ee-1b181e092ebb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:49.227990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b544514a-8ca8-4f2c-88ee-1b181e092ebb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:50.029280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b544514a-8ca8-4f2c-88ee-1b181e092ebb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:50.042588 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b544514a-8ca8-4f2c-88ee-1b181e092ebb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1311 microversion: 2.1 time: 0.851480 Sep 10 10:39:50.043884 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 666/1172] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:49 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1311 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:50.049885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cf30914-5e63-4b5a-91ec-be8261b914db tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Action: 'create', calling method: .version_select at 0x7efcae7e0430>, body: {"security_group_rule": {"parent_group_id": "679f2df8-bc52-4ca6-b057-ac1f82dbb29d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:50.864601 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4cf30914-5e63-4b5a-91ec-be8261b914db tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.819324 Sep 10 10:39:50.869195 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 667/1173] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Sep 10 10:39:50 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:50.900055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab541f35-2e31-4ce2-9245-81e41a6299e1 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:51.003027 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab541f35-2e31-4ce2-9245-81e41a6299e1 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.132571 Sep 10 10:39:51.019318 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 668/1174] 10.222.0.20 () {58 vars in 1165 bytes} [Sat Sep 10 10:39:50 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:51.033527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:51.037039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:51.050160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:51.055243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:51.055985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:51.058771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:51.059777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:51.061429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:51.200663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:39:51.832826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:51.842251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:51.855160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:51.856289 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d55d284-685a-4849-8de4-e75588a1d542 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1815 microversion: 2.25 time: 0.835532 Sep 10 10:39:51.856863 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 669/1175] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:39:51 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1815 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:39:51.863585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f7c16e51-1a63-41c4-8879-541211ddcb7a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:51.864209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f7c16e51-1a63-41c4-8879-541211ddcb7a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:51.889541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7c16e51-1a63-41c4-8879-541211ddcb7a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:51.890169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7c16e51-1a63-41c4-8879-541211ddcb7a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:51.890620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7c16e51-1a63-41c4-8879-541211ddcb7a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:51.891580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7c16e51-1a63-41c4-8879-541211ddcb7a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:51.892119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7c16e51-1a63-41c4-8879-541211ddcb7a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:51.892444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7c16e51-1a63-41c4-8879-541211ddcb7a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:52.711786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f7c16e51-1a63-41c4-8879-541211ddcb7a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:52.720114 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f7c16e51-1a63-41c4-8879-541211ddcb7a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 200 len: 1322 microversion: 2.1 time: 0.862145 Sep 10 10:39:52.720700 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 670/1176] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:51 2022] GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 1322 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:52.728127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-396a58eb-74b3-4bb3-aa38-429df833aab4 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcae825670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:53.034516 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-396a58eb-74b3-4bb3-aa38-429df833aab4 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/679f2df8-bc52-4ca6-b057-ac1f82dbb29d" status: 200 len: 663 microversion: 2.1 time: 0.312332 Sep 10 10:39:53.036338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 671/1177] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:39:52 2022] GET /compute/v2.1/os-security-groups/679f2df8-bc52-4ca6-b057-ac1f82dbb29d => generated 663 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:53.051935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-36a9f515-4ea8-4278-bd1f-f1a74da3cc39 req-f01a6338-323b-47d7-89ad-79bdf86ab22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17266718-ca01-4a84-b2ee-800852e38df1", "tag": "b711a40c-1ea4-4cf0-b7bd-ee43ed0f1794"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:53.075259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-36a9f515-4ea8-4278-bd1f-f1a74da3cc39 req-f01a6338-323b-47d7-89ad-79bdf86ab22b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:53.077182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-36a9f515-4ea8-4278-bd1f-f1a74da3cc39 req-f01a6338-323b-47d7-89ad-79bdf86ab22b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:53.080031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-36a9f515-4ea8-4278-bd1f-f1a74da3cc39 req-f01a6338-323b-47d7-89ad-79bdf86ab22b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:53.109531 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-36a9f515-4ea8-4278-bd1f-f1a74da3cc39 req-f01a6338-323b-47d7-89ad-79bdf86ab22b service nova] Creating event network-changed:b711a40c-1ea4-4cf0-b7bd-ee43ed0f1794 for instance 17266718-ca01-4a84-b2ee-800852e38df1 on n-h2-856894-1 Sep 10 10:39:53.116972 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-36a9f515-4ea8-4278-bd1f-f1a74da3cc39 req-f01a6338-323b-47d7-89ad-79bdf86ab22b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072493 Sep 10 10:39:53.118251 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 672/1178] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:53.124057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ae52ea0-c49c-4cab-99a4-8951f34ba0f8 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:53.137202 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ae52ea0-c49c-4cab-99a4-8951f34ba0f8 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017197 Sep 10 10:39:53.138384 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 673/1179] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:39:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:53.143193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3956f67b-8b05-44af-895a-753788155138 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:53.144199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3956f67b-8b05-44af-895a-753788155138 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:53.164690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3956f67b-8b05-44af-895a-753788155138 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:53.166547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3956f67b-8b05-44af-895a-753788155138 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:53.167247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3956f67b-8b05-44af-895a-753788155138 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:53.173603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3956f67b-8b05-44af-895a-753788155138 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:53.174414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3956f67b-8b05-44af-895a-753788155138 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:53.175557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3956f67b-8b05-44af-895a-753788155138 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:53.677040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3956f67b-8b05-44af-895a-753788155138 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:53.703250 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3956f67b-8b05-44af-895a-753788155138 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1494 microversion: 2.1 time: 0.562905 Sep 10 10:39:53.704432 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 674/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:53 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1494 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:53.709872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:53.710624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:53.717923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:53.719258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:53.719931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:53.721130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:53.721812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:53.722480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:54.117188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:54.131862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:54.134253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:54.136209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f233f31-5b85-419c-a50b-0eac1f71baf0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1815 microversion: 2.25 time: 0.430597 Sep 10 10:39:54.141711 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 675/1181] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:39:53 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1815 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:39:54.146621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c0342bfd-4d8b-43a6-bbbe-1b7626f26701 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcae7e8f70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:55.539671 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c0342bfd-4d8b-43a6-bbbe-1b7626f26701 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/ac53441b-50de-4742-b9e6-b0e507f121ac" status: 202 len: 0 microversion: 2.1 time: 1.396596 Sep 10 10:39:55.541285 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 676/1182] 10.222.0.20 () {58 vars in 1287 bytes} [Sat Sep 10 10:39:54 2022] DELETE /compute/v2.1/os-security-group-rules/ac53441b-50de-4742-b9e6-b0e507f121ac => generated 0 bytes in 1399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:39:55.546501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9161c460-1b42-470e-b03d-4722c784d8ef tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:55.624343 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9161c460-1b42-470e-b03d-4722c784d8ef tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.081578 Sep 10 10:39:55.626947 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 677/1183] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Sep 10 10:39:55 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:55.633925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "7c20d4a6-da78-44eb-a496-e7071ba06d09"}], "security_groups": [{"name": "tempest-securitygroup--1887365353"}], "key_name": "tempest-keypair-2061915880", "user_data": "}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:56.127515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] validate_networks() for [('7c20d4a6-da78-44eb-a496-e7071ba06d09', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:39:56.930724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:39:56.931306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:39:56.931983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:39:56.932488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:39:56.933046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:39:56.942510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=17 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:39:56.948694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:56.949367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:56.949903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:56.950742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:56.952108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:56.952108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:56.978310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Getting quotas for project 76f49d607f6a4934a17b15d43755a0d6. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:39:56.985040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Getting quotas for user 2688e0179e93428cb8c196d389d2fc78 and project 76f49d607f6a4934a17b15d43755a0d6. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:39:57.002039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:39:57.005738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:39:57.036096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:39:57.077461 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fd9ce05d-e742-4d03-a62e-b2260f271c48 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.448993 Sep 10 10:39:57.078510 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 678/1184] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:39:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:39:57.083858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-717186e8-2169-4170-8b71-196ed42171c4 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:57.085471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-717186e8-2169-4170-8b71-196ed42171c4 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:57.098890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-717186e8-2169-4170-8b71-196ed42171c4 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:57.100133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-717186e8-2169-4170-8b71-196ed42171c4 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:57.101173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-717186e8-2169-4170-8b71-196ed42171c4 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:57.102598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-717186e8-2169-4170-8b71-196ed42171c4 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:57.103246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-717186e8-2169-4170-8b71-196ed42171c4 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:57.105860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-717186e8-2169-4170-8b71-196ed42171c4 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:57.269752 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-717186e8-2169-4170-8b71-196ed42171c4 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1645 microversion: 2.1 time: 0.190101 Sep 10 10:39:57.271020 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 679/1185] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:57 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1645 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:57.279398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a0b50a1-1b07-4ada-84be-3466155d8c03 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:57.281495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a0b50a1-1b07-4ada-84be-3466155d8c03 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:57.309724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a0b50a1-1b07-4ada-84be-3466155d8c03 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:57.310300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a0b50a1-1b07-4ada-84be-3466155d8c03 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:57.310851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a0b50a1-1b07-4ada-84be-3466155d8c03 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:57.311676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a0b50a1-1b07-4ada-84be-3466155d8c03 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:57.312245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a0b50a1-1b07-4ada-84be-3466155d8c03 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:57.312688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a0b50a1-1b07-4ada-84be-3466155d8c03 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:57.528356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a0b50a1-1b07-4ada-84be-3466155d8c03 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:57.551015 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a0b50a1-1b07-4ada-84be-3466155d8c03 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 200 len: 1322 microversion: 2.1 time: 0.277572 Sep 10 10:39:57.552596 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 680/1186] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:57 2022] GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:57.560800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:57.562956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:57.572620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:57.575044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:57.576449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:57.578558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:57.581123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:57.583128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:57.786029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:57.815745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:57.826942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:57.828608 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80e13ccc-f0bf-431c-aadb-a5d04f3c04ce tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1815 microversion: 2.25 time: 0.273088 Sep 10 10:39:57.833264 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 681/1187] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:39:57 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1815 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:39:57.839146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5b39c12f-1372-4c95-af68-f183ec237069 req-e870f282-86c1-4252-94d5-5c6adff4b220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84e3fbc-9d8c-4029-874c-34eec1bba0c0", "tag": "fd3346bd-6041-427a-813c-054af7fcb81b"}, {"name": "network-changed", "server_uuid": "307ad6bd-3be6-49e5-b902-dcb017a25d22", "tag": "6fb73a8e-3c5b-4daa-89a7-daa69937ed66"}, {"server_uuid": "7bf4f355-1582-4020-a738-9d8579be881b", "name": "network-vif-unplugged", "status": "completed", "tag": "5c9581bc-bf42-47dd-b446-4cf4841d36b7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:39:57.857828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b39c12f-1372-4c95-af68-f183ec237069 req-e870f282-86c1-4252-94d5-5c6adff4b220 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:57.858913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b39c12f-1372-4c95-af68-f183ec237069 req-e870f282-86c1-4252-94d5-5c6adff4b220 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:57.859588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b39c12f-1372-4c95-af68-f183ec237069 req-e870f282-86c1-4252-94d5-5c6adff4b220 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:57.880469 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5b39c12f-1372-4c95-af68-f183ec237069 req-e870f282-86c1-4252-94d5-5c6adff4b220 service nova] Creating event network-changed:fd3346bd-6041-427a-813c-054af7fcb81b for instance e84e3fbc-9d8c-4029-874c-34eec1bba0c0 on n-h1-856894-1 Sep 10 10:39:57.881330 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5b39c12f-1372-4c95-af68-f183ec237069 req-e870f282-86c1-4252-94d5-5c6adff4b220 service nova] Creating event network-changed:6fb73a8e-3c5b-4daa-89a7-daa69937ed66 for instance 307ad6bd-3be6-49e5-b902-dcb017a25d22 on n-h2-856894-1 Sep 10 10:39:57.882020 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5b39c12f-1372-4c95-af68-f183ec237069 req-e870f282-86c1-4252-94d5-5c6adff4b220 service nova] Creating event network-vif-unplugged:5c9581bc-bf42-47dd-b446-4cf4841d36b7 for instance 7bf4f355-1582-4020-a738-9d8579be881b on n-h2-856894-1 Sep 10 10:39:57.892140 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5b39c12f-1372-4c95-af68-f183ec237069 req-e870f282-86c1-4252-94d5-5c6adff4b220 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.057417 Sep 10 10:39:57.892930 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 682/1188] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:57.901591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7702ce6c-569e-47b1-bf76-0767e3bbed7c tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcae87cc10>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:58.556080 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7702ce6c-569e-47b1-bf76-0767e3bbed7c tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/679f2df8-bc52-4ca6-b057-ac1f82dbb29d" status: 202 len: 0 microversion: 2.1 time: 0.658617 Sep 10 10:39:58.557440 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 683/1189] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:39:57 2022] DELETE /compute/v2.1/os-security-groups/679f2df8-bc52-4ca6-b057-ac1f82dbb29d => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:39:58.573145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d9ea4fa-fabb-4878-835e-c1a3dd66e906 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:58.596950 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d9ea4fa-fabb-4878-835e-c1a3dd66e906 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.038145 Sep 10 10:39:58.608227 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 684/1190] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:39:58 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:39:59.111810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e20c6aaa-67f2-4187-84df-f9e6b4af2988 tempest-FloatingIPDetailsNegativeTestJSON-1350689518 tempest-FloatingIPDetailsNegativeTestJSON-1350689518-project] Calling method '.version_select at 0x7efcae81a5e0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:59.286118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-e20c6aaa-67f2-4187-84df-f9e6b4af2988 tempest-FloatingIPDetailsNegativeTestJSON-1350689518 tempest-FloatingIPDetailsNegativeTestJSON-1350689518-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8 could not be found", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:39:59.287041 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e20c6aaa-67f2-4187-84df-f9e6b4af2988 tempest-FloatingIPDetailsNegativeTestJSON-1350689518 tempest-FloatingIPDetailsNegativeTestJSON-1350689518-project] HTTP exception thrown: Floating IP not found for ID 15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8 Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e20c6aaa-67f2-4187-84df-f9e6b4af2988 tempest-FloatingIPDetailsNegativeTestJSON-1350689518 tempest-FloatingIPDetailsNegativeTestJSON-1350689518-project] Request method failure captured: Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-floating-ips/15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8 HTTP/1.1 Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGl7GgL-CCZiqU4Bk5mcXUKtyOK_T0utPtEE5qFDkSb4QIfQGOsnDECfwhwZKmxVn9z6A-__4IVggAU9qr3zvkj4Zz2avCSuDfFpwEXf_z7wmoU9Q0V02VdBdJ1DHOQB7-LxRO0y3B3FUr-atGeo8qfCt0Q81jMNKeN0t9sdFqA5zPg Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 05258b17d7814c00a43f37cad4c8db69 Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1350689518 Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:39:59.295973 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05258b17d7814c00a43f37cad4c8db69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/05258b17d7814c00a43f37cad4c8db69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/05258b17d7814c00a43f37cad4c8db69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_05258b17d7814c00a43f37cad4c8db69", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1350689518 Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 05258b17d7814c00a43f37cad4c8db69 Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1350689518 Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1350689518-project Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: f3075c3f782f4d69bd8b51f690381751 Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1350689518-project Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: exception: Floating IP not found for ID 15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8 Sep 10 10:39:59.297806 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8'} Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:39:59.298827 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8 could not be found Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2df03db4-2cac-47e1-a9f4-6398f4388d06'] Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8. Sep 10 10:39:59.300407 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8 Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:39:59.302390 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:39:59.304567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:39:59.304567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8 Sep 10 10:39:59.304567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:39:59.304567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e20c6aaa-67f2-4187-84df-f9e6b4af2988 tempest-FloatingIPDetailsNegativeTestJSON-1350689518 tempest-FloatingIPDetailsNegativeTestJSON-1350689518-project] Returning 404 to user: Floating IP not found for ID 15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8 {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:39:59.304567 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e20c6aaa-67f2-4187-84df-f9e6b4af2988 tempest-FloatingIPDetailsNegativeTestJSON-1350689518 tempest-FloatingIPDetailsNegativeTestJSON-1350689518-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8" status: 404 len: 111 microversion: 2.1 time: 0.687689 Sep 10 10:39:59.304567 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 685/1191] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:39:58 2022] GET /compute/v2.1/os-floating-ips/15fabae8-3f2d-43bd-9a2a-6b58cc4f93f8 => generated 111 bytes in 690 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:39:59.310273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d48625c-ceac-482f-9e25-129c31cf601a tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:59.316097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d48625c-ceac-482f-9e25-129c31cf601a tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:59.333643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d48625c-ceac-482f-9e25-129c31cf601a tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:59.335546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d48625c-ceac-482f-9e25-129c31cf601a tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:59.336167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d48625c-ceac-482f-9e25-129c31cf601a tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:59.337057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d48625c-ceac-482f-9e25-129c31cf601a tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:59.339072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d48625c-ceac-482f-9e25-129c31cf601a tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:59.339834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d48625c-ceac-482f-9e25-129c31cf601a tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:59.572985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d48625c-ceac-482f-9e25-129c31cf601a tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2688e0179e93428cb8c196d389d2fc78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f49d607f6a4934a17b15d43755a0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:39:59.593528 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d48625c-ceac-482f-9e25-129c31cf601a tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e" status: 200 len: 1284 microversion: 2.1 time: 0.291963 Sep 10 10:39:59.601962 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 686/1192] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:59 2022] GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e => generated 1284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:39:59.612386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a9a59cb6-c633-4b67-b403-2e3ce5262714 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:39:59.613011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a9a59cb6-c633-4b67-b403-2e3ce5262714 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:39:59.632331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a59cb6-c633-4b67-b403-2e3ce5262714 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:59.633362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a59cb6-c633-4b67-b403-2e3ce5262714 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:59.635575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a59cb6-c633-4b67-b403-2e3ce5262714 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:39:59.636678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a59cb6-c633-4b67-b403-2e3ce5262714 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:39:59.637876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a59cb6-c633-4b67-b403-2e3ce5262714 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:39:59.638540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a59cb6-c633-4b67-b403-2e3ce5262714 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:00.278205 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a9a59cb6-c633-4b67-b403-2e3ce5262714 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1645 microversion: 2.1 time: 0.674993 Sep 10 10:40:00.281667 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 687/1193] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:39:59 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1645 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:00.301202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a665011-f343-4fa7-a19b-c2d37cbc21ed tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcae87c790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:00.383785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-5a665011-f343-4fa7-a19b-c2d37cbc21ed tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 03109d55-8187-453f-9874-9a24266e9ed9 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:40:00.384378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-5a665011-f343-4fa7-a19b-c2d37cbc21ed tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Neutron security group 03109d55-8187-453f-9874-9a24266e9ed9 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:40:00.385128 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5a665011-f343-4fa7-a19b-c2d37cbc21ed tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] HTTP exception thrown: Security group 03109d55-8187-453f-9874-9a24266e9ed9 does not exist Sep 10 10:40:00.385128 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-65d44241-6683-41f0-aec2-5760c1472f1e'] Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a665011-f343-4fa7-a19b-c2d37cbc21ed tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Request method failure captured: Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/03109d55-8187-453f-9874-9a24266e9ed9 HTTP/1.1 Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlP2RF12yrDEHaJ20HK2VyoaHMzS0eqk_mAXeQizVR34tXI8E9uoJaDqlkLT5AX0Sgw3l5raHc_DBvJT1gqrsJV8atgoY_uWocVuvpk20T4zJvhmwvh0f6l949-q4-604KTe66EHM7GGqubtsKmYGdtLRXj3ObuYwKAmotUkWQpfXk Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: df15d8b3338e4a1eb821de83adbb0f1c Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-80940689 Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:00.387966 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/df15d8b3338e4a1eb821de83adbb0f1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/df15d8b3338e4a1eb821de83adbb0f1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/df15d8b3338e4a1eb821de83adbb0f1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_df15d8b3338e4a1eb821de83adbb0f1c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupRulesTestJSON-80940689 Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: df15d8b3338e4a1eb821de83adbb0f1c Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-80940689 Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupRulesTestJSON-80940689-project Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 79f904bd1e114587b7dd37837cc428d9 Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupRulesTestJSON-80940689-project Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 03109d55-8187-453f-9874-9a24266e9ed9 does not exist Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-65d44241-6683-41f0-aec2-5760c1472f1e'] Sep 10 10:40:00.389835 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '03109d55-8187-453f-9874-9a24266e9ed9'} Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:40:00.390765 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 03109d55-8187-453f-9874-9a24266e9ed9 does not exist Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65d44241-6683-41f0-aec2-5760c1472f1e'] Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:40:00.392016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 03109d55-8187-453f-9874-9a24266e9ed9 does not exist Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65d44241-6683-41f0-aec2-5760c1472f1e'] Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 03109d55-8187-453f-9874-9a24266e9ed9 does not exist Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65d44241-6683-41f0-aec2-5760c1472f1e'] Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:00.394329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 03109d55-8187-453f-9874-9a24266e9ed9 does not exist Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65d44241-6683-41f0-aec2-5760c1472f1e'] Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a665011-f343-4fa7-a19b-c2d37cbc21ed tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Returning 404 to user: Security group 03109d55-8187-453f-9874-9a24266e9ed9 does not exist Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-65d44241-6683-41f0-aec2-5760c1472f1e'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a665011-f343-4fa7-a19b-c2d37cbc21ed tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/03109d55-8187-453f-9874-9a24266e9ed9" status: 404 len: 194 microversion: 2.1 time: 0.104086 Sep 10 10:40:00.396212 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 688/1194] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:40:00 2022] DELETE /compute/v2.1/os-security-groups/03109d55-8187-453f-9874-9a24266e9ed9 => generated 194 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:40:00.403512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f41aece-329a-4890-9a8a-7f33b7bbff3c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:00.404179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f41aece-329a-4890-9a8a-7f33b7bbff3c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:00.412362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f41aece-329a-4890-9a8a-7f33b7bbff3c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:00.425740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f41aece-329a-4890-9a8a-7f33b7bbff3c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:00.427093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f41aece-329a-4890-9a8a-7f33b7bbff3c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:00.429437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f41aece-329a-4890-9a8a-7f33b7bbff3c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:00.432074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f41aece-329a-4890-9a8a-7f33b7bbff3c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:00.432914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f41aece-329a-4890-9a8a-7f33b7bbff3c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:00.955555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f41aece-329a-4890-9a8a-7f33b7bbff3c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:00.973571 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f41aece-329a-4890-9a8a-7f33b7bbff3c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 200 len: 1322 microversion: 2.1 time: 0.581151 Sep 10 10:40:00.975322 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 689/1195] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:00 2022] GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 1322 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:00.984603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f684a48d-25eb-4490-a336-7314b0c07aff tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:01.003516 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f684a48d-25eb-4490-a336-7314b0c07aff tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026810 Sep 10 10:40:01.004668 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 690/1196] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:40:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:01.012187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0d3d355f-caaf-4bba-906e-a3d381abc4fa req-be236c89-3677-4c82-9100-fa8cfb5ebb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17266718-ca01-4a84-b2ee-800852e38df1", "name": "network-vif-plugged", "status": "completed", "tag": "b711a40c-1ea4-4cf0-b7bd-ee43ed0f1794"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:01.037947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0d3d355f-caaf-4bba-906e-a3d381abc4fa req-be236c89-3677-4c82-9100-fa8cfb5ebb30 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:01.038498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0d3d355f-caaf-4bba-906e-a3d381abc4fa req-be236c89-3677-4c82-9100-fa8cfb5ebb30 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:01.038940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0d3d355f-caaf-4bba-906e-a3d381abc4fa req-be236c89-3677-4c82-9100-fa8cfb5ebb30 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:01.055958 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0d3d355f-caaf-4bba-906e-a3d381abc4fa req-be236c89-3677-4c82-9100-fa8cfb5ebb30 service nova] Creating event network-vif-plugged:b711a40c-1ea4-4cf0-b7bd-ee43ed0f1794 for instance 17266718-ca01-4a84-b2ee-800852e38df1 on n-h2-856894-1 Sep 10 10:40:01.072309 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0d3d355f-caaf-4bba-906e-a3d381abc4fa req-be236c89-3677-4c82-9100-fa8cfb5ebb30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063958 Sep 10 10:40:01.078017 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 691/1197] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:01.095898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:01.096782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:01.104722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:01.105823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:01.106563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:01.107671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:01.108780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:01.109549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:01.712188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:01.721515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:01.723057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:01.724506 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30255b62-5ea3-4d4d-99fd-85a000cc97c7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1815 microversion: 2.25 time: 0.645250 Sep 10 10:40:01.739603 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 692/1198] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:01 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1815 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:01.750603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-61f871f3-b35e-4683-aafb-aed7de11aed4 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Calling method '.version_select at 0x7efcaea26700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:01.798739 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-61f871f3-b35e-4683-aafb-aed7de11aed4 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2" status: 200 len: 637 microversion: 2.1 time: 0.057677 Sep 10 10:40:01.808895 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 693/1199] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:40:01 2022] GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2 => generated 637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:01.813924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-92db6e0b-99b6-49e9-97f7-330eb6ed22ad req-ec1fba1d-d78b-479b-a4ff-7a052d1e7a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf4f355-1582-4020-a738-9d8579be881b", "tag": "5c9581bc-bf42-47dd-b446-4cf4841d36b7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:01.824992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-92db6e0b-99b6-49e9-97f7-330eb6ed22ad req-ec1fba1d-d78b-479b-a4ff-7a052d1e7a56 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:01.825799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-92db6e0b-99b6-49e9-97f7-330eb6ed22ad req-ec1fba1d-d78b-479b-a4ff-7a052d1e7a56 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:01.826454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-92db6e0b-99b6-49e9-97f7-330eb6ed22ad req-ec1fba1d-d78b-479b-a4ff-7a052d1e7a56 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:01.840222 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-92db6e0b-99b6-49e9-97f7-330eb6ed22ad req-ec1fba1d-d78b-479b-a4ff-7a052d1e7a56 service nova] Creating event network-changed:5c9581bc-bf42-47dd-b446-4cf4841d36b7 for instance 7bf4f355-1582-4020-a738-9d8579be881b on n-h2-856894-1 Sep 10 10:40:01.848772 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-92db6e0b-99b6-49e9-97f7-330eb6ed22ad req-ec1fba1d-d78b-479b-a4ff-7a052d1e7a56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038383 Sep 10 10:40:01.850356 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 694/1200] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:01.858121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63e6a4f9-cf83-42db-b8b1-3a6fafb215e3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:01.862178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63e6a4f9-cf83-42db-b8b1-3a6fafb215e3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:01.862916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63e6a4f9-cf83-42db-b8b1-3a6fafb215e3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:01.863577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63e6a4f9-cf83-42db-b8b1-3a6fafb215e3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:01.864404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63e6a4f9-cf83-42db-b8b1-3a6fafb215e3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:01.864956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63e6a4f9-cf83-42db-b8b1-3a6fafb215e3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:01.865550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63e6a4f9-cf83-42db-b8b1-3a6fafb215e3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:01.893559 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63e6a4f9-cf83-42db-b8b1-3a6fafb215e3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039227 Sep 10 10:40:01.894495 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 695/1201] 10.222.0.20 () {58 vars in 1176 bytes} [Sat Sep 10 10:40:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:01.899878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ddebfaf7-6035-4f27-b9ea-503e520c8c53 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcae79c3a0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:02.412897 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ddebfaf7-6035-4f27-b9ea-503e520c8c53 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/44a00144-27d9-4701-b675-227fbb1fa480" status: 202 len: 0 microversion: 2.1 time: 0.516591 Sep 10 10:40:02.418132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 696/1202] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:40:01 2022] DELETE /compute/v2.1/os-security-groups/44a00144-27d9-4701-b675-227fbb1fa480 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:40:02.424533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f0e169b8-990a-4979-a25d-11673cee4e23 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:02.425647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f0e169b8-990a-4979-a25d-11673cee4e23 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:02.432504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0e169b8-990a-4979-a25d-11673cee4e23 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:02.433327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0e169b8-990a-4979-a25d-11673cee4e23 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:02.434050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0e169b8-990a-4979-a25d-11673cee4e23 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:02.435124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0e169b8-990a-4979-a25d-11673cee4e23 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:02.436120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0e169b8-990a-4979-a25d-11673cee4e23 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:02.437639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0e169b8-990a-4979-a25d-11673cee4e23 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:02.702476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f0e169b8-990a-4979-a25d-11673cee4e23 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2688e0179e93428cb8c196d389d2fc78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f49d607f6a4934a17b15d43755a0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:02.712696 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f0e169b8-990a-4979-a25d-11673cee4e23 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e" status: 200 len: 1352 microversion: 2.1 time: 0.293211 Sep 10 10:40:02.729776 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 697/1203] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:02 2022] GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e => generated 1352 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:02.735763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23821d65-b077-4972-87c9-7bf2b9de7359 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:02.798993 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23821d65-b077-4972-87c9-7bf2b9de7359 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.067974 Sep 10 10:40:02.816132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 698/1204] 10.222.0.20 () {58 vars in 1167 bytes} [Sat Sep 10 10:40:02 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:02.847417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e4eacf5f-d7bb-4f5a-b1ac-ae1f5b04fd07 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Action: 'update_all', calling method: .version_select at 0x7efcae7e2550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:02.967554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e4eacf5f-d7bb-4f5a-b1ac-ae1f5b04fd07 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:02.982561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e4eacf5f-d7bb-4f5a-b1ac-ae1f5b04fd07 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for user 9d401fb9435f429197f93afbc387a415 and project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:03.477839 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e4eacf5f-d7bb-4f5a-b1ac-ae1f5b04fd07 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.660194 Sep 10 10:40:03.478564 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 699/1205] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:40:02 2022] PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 61 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:03.483904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-96fb3b8f-7b5a-4315-9b51-dfe5c8489bb3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:03.484876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-96fb3b8f-7b5a-4315-9b51-dfe5c8489bb3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:03.501214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96fb3b8f-7b5a-4315-9b51-dfe5c8489bb3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:03.502211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96fb3b8f-7b5a-4315-9b51-dfe5c8489bb3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:03.507243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96fb3b8f-7b5a-4315-9b51-dfe5c8489bb3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:03.508344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96fb3b8f-7b5a-4315-9b51-dfe5c8489bb3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:03.509695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96fb3b8f-7b5a-4315-9b51-dfe5c8489bb3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:03.510365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96fb3b8f-7b5a-4315-9b51-dfe5c8489bb3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:03.637116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:03.682944 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-96fb3b8f-7b5a-4315-9b51-dfe5c8489bb3 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d/action" status: 202 len: 0 microversion: 2.1 time: 0.202278 Sep 10 10:40:03.683989 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 700/1206] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:40:03 2022] POST /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:40:03.696824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d86ce52-6f6c-4811-8f69-2602e105229a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:03.697755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d86ce52-6f6c-4811-8f69-2602e105229a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:03.714983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d86ce52-6f6c-4811-8f69-2602e105229a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:03.715722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d86ce52-6f6c-4811-8f69-2602e105229a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:03.716356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d86ce52-6f6c-4811-8f69-2602e105229a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:03.717282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d86ce52-6f6c-4811-8f69-2602e105229a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:03.717911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d86ce52-6f6c-4811-8f69-2602e105229a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:03.722646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d86ce52-6f6c-4811-8f69-2602e105229a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:04.052743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d86ce52-6f6c-4811-8f69-2602e105229a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:04.061926 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d86ce52-6f6c-4811-8f69-2602e105229a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 200 len: 1515 microversion: 2.1 time: 0.376296 Sep 10 10:40:04.062930 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 701/1207] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:03 2022] GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 1515 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:04.067612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b5054d8-61a1-4e63-a599-2577cdd46d85 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcae7471f0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:04.376154 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b5054d8-61a1-4e63-a599-2577cdd46d85 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a1f12221-e574-4bb7-98a7-4ed1c109ff89" status: 202 len: 0 microversion: 2.1 time: 0.311860 Sep 10 10:40:04.376932 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 702/1208] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:40:04 2022] DELETE /compute/v2.1/os-security-groups/a1f12221-e574-4bb7-98a7-4ed1c109ff89 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:40:04.383216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:04.383823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:04.391106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:04.391599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:04.392366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:04.394001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:04.394741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:04.395604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:04.573856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:04.586941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:04.588937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:04.590180 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1621001e-6b73-4d12-976d-504e13f82410 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1815 microversion: 2.25 time: 0.212132 Sep 10 10:40:04.596926 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 703/1209] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:04 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1815 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:04.601792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0bbf017c-59eb-401a-b9c2-9dacac6cecc7 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:04.610489 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0bbf017c-59eb-401a-b9c2-9dacac6cecc7 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018196 Sep 10 10:40:04.611124 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 704/1210] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:40:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:04.616311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c6377ac3-4c20-4253-b5b7-cb5f6b79720e req-e4b696f5-41c9-49fa-9af1-52c6763d90ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84e3fbc-9d8c-4029-874c-34eec1bba0c0", "name": "network-vif-plugged", "status": "completed", "tag": "fd3346bd-6041-427a-813c-054af7fcb81b"}, {"server_uuid": "307ad6bd-3be6-49e5-b902-dcb017a25d22", "name": "network-vif-plugged", "status": "completed", "tag": "6fb73a8e-3c5b-4daa-89a7-daa69937ed66"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:04.631670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c6377ac3-4c20-4253-b5b7-cb5f6b79720e req-e4b696f5-41c9-49fa-9af1-52c6763d90ca service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:04.632290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c6377ac3-4c20-4253-b5b7-cb5f6b79720e req-e4b696f5-41c9-49fa-9af1-52c6763d90ca service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:04.632852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c6377ac3-4c20-4253-b5b7-cb5f6b79720e req-e4b696f5-41c9-49fa-9af1-52c6763d90ca service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:04.648066 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c6377ac3-4c20-4253-b5b7-cb5f6b79720e req-e4b696f5-41c9-49fa-9af1-52c6763d90ca service nova] Creating event network-vif-plugged:fd3346bd-6041-427a-813c-054af7fcb81b for instance e84e3fbc-9d8c-4029-874c-34eec1bba0c0 on n-h1-856894-1 Sep 10 10:40:04.648719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c6377ac3-4c20-4253-b5b7-cb5f6b79720e req-e4b696f5-41c9-49fa-9af1-52c6763d90ca service nova] Creating event network-vif-plugged:6fb73a8e-3c5b-4daa-89a7-daa69937ed66 for instance 307ad6bd-3be6-49e5-b902-dcb017a25d22 on n-h2-856894-1 Sep 10 10:40:04.657293 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c6377ac3-4c20-4253-b5b7-cb5f6b79720e req-e4b696f5-41c9-49fa-9af1-52c6763d90ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044663 Sep 10 10:40:04.658184 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 705/1211] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:04.664967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5913cfcc-b751-47c8-bdeb-81fe97a77168 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Calling method '.version_select at 0x7efcae6db5e0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:05.012419 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5913cfcc-b751-47c8-bdeb-81fe97a77168 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "DELETE /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.352761 Sep 10 10:40:05.012994 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 706/1212] 10.222.0.20 () {58 vars in 1296 bytes} [Sat Sep 10 10:40:04 2022] DELETE /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata/os_version => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:40:05.018254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c67f25d-c82a-4525-a35f-6f01d8555bb1 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:05.019361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c67f25d-c82a-4525-a35f-6f01d8555bb1 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:05.026559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c67f25d-c82a-4525-a35f-6f01d8555bb1 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:05.027529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c67f25d-c82a-4525-a35f-6f01d8555bb1 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:05.028143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c67f25d-c82a-4525-a35f-6f01d8555bb1 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:05.029201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c67f25d-c82a-4525-a35f-6f01d8555bb1 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:05.029849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c67f25d-c82a-4525-a35f-6f01d8555bb1 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:05.030471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c67f25d-c82a-4525-a35f-6f01d8555bb1 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:05.291546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c67f25d-c82a-4525-a35f-6f01d8555bb1 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1630 microversion: 2.1 time: 0.277254 Sep 10 10:40:05.292748 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 707/1213] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:05 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1630 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:05.298244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c1ba526-dfeb-4228-8010-6b5d8a030021 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:05.298875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c1ba526-dfeb-4228-8010-6b5d8a030021 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:05.305430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1ba526-dfeb-4228-8010-6b5d8a030021 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:05.306188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1ba526-dfeb-4228-8010-6b5d8a030021 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:05.306800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1ba526-dfeb-4228-8010-6b5d8a030021 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:05.307766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1ba526-dfeb-4228-8010-6b5d8a030021 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:05.308813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1ba526-dfeb-4228-8010-6b5d8a030021 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:05.309448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c1ba526-dfeb-4228-8010-6b5d8a030021 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:05.440474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c1ba526-dfeb-4228-8010-6b5d8a030021 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2688e0179e93428cb8c196d389d2fc78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f49d607f6a4934a17b15d43755a0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:05.448671 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c1ba526-dfeb-4228-8010-6b5d8a030021 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e" status: 200 len: 1352 microversion: 2.1 time: 0.154582 Sep 10 10:40:05.449274 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 708/1214] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:05 2022] GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e => generated 1352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:05.453572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-17c7e356-9564-4ed1-9b02-5213f87eda99 req-34be7bfb-4c4b-499d-b25f-4e34206f75b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d9d635e-343c-4ec4-851d-7967c0f64f1e", "tag": "007043f4-be22-489b-9177-ce600e376823"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:05.462887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-17c7e356-9564-4ed1-9b02-5213f87eda99 req-34be7bfb-4c4b-499d-b25f-4e34206f75b0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:05.463362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-17c7e356-9564-4ed1-9b02-5213f87eda99 req-34be7bfb-4c4b-499d-b25f-4e34206f75b0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:05.463796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-17c7e356-9564-4ed1-9b02-5213f87eda99 req-34be7bfb-4c4b-499d-b25f-4e34206f75b0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:05.476119 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-17c7e356-9564-4ed1-9b02-5213f87eda99 req-34be7bfb-4c4b-499d-b25f-4e34206f75b0 service nova] Creating event network-changed:007043f4-be22-489b-9177-ce600e376823 for instance 1d9d635e-343c-4ec4-851d-7967c0f64f1e on n-h1-856894-1 Sep 10 10:40:05.480865 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-17c7e356-9564-4ed1-9b02-5213f87eda99 req-34be7bfb-4c4b-499d-b25f-4e34206f75b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030485 Sep 10 10:40:05.481477 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 709/1215] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:05.486262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-037611a5-3386-4e61-940d-4bda61240c77 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:05.486959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-037611a5-3386-4e61-940d-4bda61240c77 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 307ad6bd-3be6-49e5-b902-dcb017a25d22] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:05.492820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-037611a5-3386-4e61-940d-4bda61240c77 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:05.493338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-037611a5-3386-4e61-940d-4bda61240c77 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:05.493780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-037611a5-3386-4e61-940d-4bda61240c77 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:05.494465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-037611a5-3386-4e61-940d-4bda61240c77 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:05.494922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-037611a5-3386-4e61-940d-4bda61240c77 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:05.495349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-037611a5-3386-4e61-940d-4bda61240c77 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:05.818566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-037611a5-3386-4e61-940d-4bda61240c77 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:05.827142 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-037611a5-3386-4e61-940d-4bda61240c77 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/307ad6bd-3be6-49e5-b902-dcb017a25d22" status: 200 len: 1322 microversion: 2.1 time: 0.344563 Sep 10 10:40:05.827725 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 710/1216] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:05 2022] GET /compute/v2.1/servers/307ad6bd-3be6-49e5-b902-dcb017a25d22 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:05.832216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c87befe-5568-4fff-b971-ad4c7fa19c18 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcae883af0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:06.258889 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c87befe-5568-4fff-b971-ad4c7fa19c18 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/8ce50ed5-9a56-49c8-91cf-f5ea34eb2187" status: 202 len: 0 microversion: 2.1 time: 0.430093 Sep 10 10:40:06.259594 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 711/1217] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:40:05 2022] DELETE /compute/v2.1/os-security-groups/8ce50ed5-9a56-49c8-91cf-f5ea34eb2187 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:40:06.265999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc0583df-8502-4357-9e86-c9c7c1a78575 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:06.285518 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc0583df-8502-4357-9e86-c9c7c1a78575 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.024493 Sep 10 10:40:06.287194 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 712/1218] 10.222.0.20 () {58 vars in 1144 bytes} [Sat Sep 10 10:40:06 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:06.294026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-96c77e79-59a5-4847-bde5-420947681254 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Calling method '.version_select at 0x7efcae835d30>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:06.355793 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-96c77e79-59a5-4847-bde5-420947681254 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 37 microversion: 2.1 time: 0.068621 Sep 10 10:40:06.360034 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 713/1219] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:40:06 2022] GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 37 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:06.363091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-856894-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:06.365641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:06.372014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:06.372507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:06.373332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:06.373669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:06.374125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:06.374555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:06.400250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lazy-loading 'flavor' on Instance uuid 677f76e1-63ef-4c0a-806d-7c965e2fca1d {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:40:06.413887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Going to try to live migrate instance to n-h2-856894-1 {{(pid=128788) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 10:40:07.978894 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3145d338-0450-4bae-9ec0-795aa5526196 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d/action" status: 202 len: 0 microversion: 2.1 time: 1.620243 Sep 10 10:40:07.979660 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 714/1220] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:40:06 2022] POST /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d/action => generated 0 bytes in 1622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:40:08.063642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-768b169b-c387-4085-906a-ebbbf3e495e8 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Calling method '.version_select at 0x7efcae65e310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:08.088610 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-768b169b-c387-4085-906a-ebbbf3e495e8 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] HTTP exception thrown: Image not found. Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-768b169b-c387-4085-906a-ebbbf3e495e8 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Request method failure captured: Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/images/0a6a3ae7-056d-4949-8b41-d3d3af192e46/metadata/os_distro HTTP/1.1 Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmF0OHxdKrJCtxwL6324M9VBmYSXgWV03p3vkGEiBBJjUpHTaAfgOn-8JrtPs1VrQn0xSijAjKHC8GaAybelDMuJOK4TJZN9IXjUbDcU9AFzDOWee35Cxe4ddl1s5SPjkYPdC2clV1OX0EblFBtZgnAc0f7LbFEFz6rnET4WpCCoXw Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:08.097100 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3c7bb789de5f487dadb71d00c7fa7d39", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 4a6bfcbca6a44c06b23f9bf8bcd1dc78 Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'image_id': '0a6a3ae7-056d-4949-8b41-d3d3af192e46', 'id': 'os_distro'} Sep 10 10:40:08.098807 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:08.104147 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0a6a3ae7-056d-4949-8b41-d3d3af192e46 Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:08.105641 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0a6a3ae7-056d-4949-8b41-d3d3af192e46 could not be found. Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:40:08.107327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:08.108773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-768b169b-c387-4085-906a-ebbbf3e495e8 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:08.110269 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-768b169b-c387-4085-906a-ebbbf3e495e8 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] 10.222.0.20 "DELETE /compute/v2.1/images/0a6a3ae7-056d-4949-8b41-d3d3af192e46/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.117863 Sep 10 10:40:08.110269 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 715/1221] 10.222.0.20 () {58 vars in 1293 bytes} [Sat Sep 10 10:40:07 2022] DELETE /compute/v2.1/images/0a6a3ae7-056d-4949-8b41-d3d3af192e46/metadata/os_distro => generated 62 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:40:08.110269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:08.110269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:08.112088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:08.112726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:08.113226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:08.113951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:08.114405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:08.114830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:08.243659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:08.252236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:08.253703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:08.254855 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef3580cf-5837-44d7-9e99-89f56cbe0c6d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1805 microversion: 2.25 time: 0.154623 Sep 10 10:40:08.255404 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 716/1222] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:08 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:08.260464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8255f91-55d2-4c4c-9ed2-5084fd35d109 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcae835160>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:08.595102 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8255f91-55d2-4c4c-9ed2-5084fd35d109 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1ba171b4-fabf-4b8a-891f-4cbcc20bf040" status: 202 len: 0 microversion: 2.1 time: 0.338583 Sep 10 10:40:08.596711 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 717/1223] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:40:08 2022] DELETE /compute/v2.1/os-security-groups/1ba171b4-fabf-4b8a-891f-4cbcc20bf040 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:40:08.602674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-821a395f-0fcb-481d-a270-0efae0499dad tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:08.612175 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-821a395f-0fcb-481d-a270-0efae0499dad tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014307 Sep 10 10:40:08.612824 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 718/1224] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:40:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:08.624662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28426ca1-b98d-46b9-9d6a-a011cb42ec60 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Action: 'update_all', calling method: .version_select at 0x7efcae834310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:08.684160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-28426ca1-b98d-46b9-9d6a-a011cb42ec60 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:08.689535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-28426ca1-b98d-46b9-9d6a-a011cb42ec60 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for user 9d401fb9435f429197f93afbc387a415 and project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:08.932745 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-28426ca1-b98d-46b9-9d6a-a011cb42ec60 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.318378 Sep 10 10:40:08.933946 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 719/1225] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:40:08 2022] PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 61 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:08.938655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-13c93bf6-3204-453b-adf8-59a9076ee450 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:08.939465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-13c93bf6-3204-453b-adf8-59a9076ee450 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:08.946187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c93bf6-3204-453b-adf8-59a9076ee450 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:08.946934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c93bf6-3204-453b-adf8-59a9076ee450 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:08.947562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c93bf6-3204-453b-adf8-59a9076ee450 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:08.948448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c93bf6-3204-453b-adf8-59a9076ee450 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:08.949121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c93bf6-3204-453b-adf8-59a9076ee450 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:08.949554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c93bf6-3204-453b-adf8-59a9076ee450 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:09.166620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-13c93bf6-3204-453b-adf8-59a9076ee450 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2688e0179e93428cb8c196d389d2fc78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f49d607f6a4934a17b15d43755a0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:09.174474 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-13c93bf6-3204-453b-adf8-59a9076ee450 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e" status: 200 len: 1352 microversion: 2.1 time: 0.239303 Sep 10 10:40:09.175041 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 720/1226] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:08 2022] GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e => generated 1352 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:09.179798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a88fd33-1af1-45e9-a829-755a7dfee493 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:09.180431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a88fd33-1af1-45e9-a829-755a7dfee493 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 307ad6bd-3be6-49e5-b902-dcb017a25d22] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:09.187136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a88fd33-1af1-45e9-a829-755a7dfee493 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:09.187624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a88fd33-1af1-45e9-a829-755a7dfee493 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:09.188061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a88fd33-1af1-45e9-a829-755a7dfee493 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:09.188753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a88fd33-1af1-45e9-a829-755a7dfee493 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:09.189238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a88fd33-1af1-45e9-a829-755a7dfee493 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:09.189667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a88fd33-1af1-45e9-a829-755a7dfee493 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:09.392802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5a88fd33-1af1-45e9-a829-755a7dfee493 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:09.401306 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a88fd33-1af1-45e9-a829-755a7dfee493 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/307ad6bd-3be6-49e5-b902-dcb017a25d22" status: 200 len: 1515 microversion: 2.1 time: 0.225018 Sep 10 10:40:09.401896 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 721/1227] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:09 2022] GET /compute/v2.1/servers/307ad6bd-3be6-49e5-b902-dcb017a25d22 => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:09.406705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8b9c94b-b2af-4a41-a276-ea911dac7e7e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:09.407355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8b9c94b-b2af-4a41-a276-ea911dac7e7e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:09.413410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b9c94b-b2af-4a41-a276-ea911dac7e7e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:09.413856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b9c94b-b2af-4a41-a276-ea911dac7e7e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:09.414292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b9c94b-b2af-4a41-a276-ea911dac7e7e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:09.414981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b9c94b-b2af-4a41-a276-ea911dac7e7e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:09.415434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b9c94b-b2af-4a41-a276-ea911dac7e7e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:09.415859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b9c94b-b2af-4a41-a276-ea911dac7e7e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:09.626052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8b9c94b-b2af-4a41-a276-ea911dac7e7e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:09.634426 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8b9c94b-b2af-4a41-a276-ea911dac7e7e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1504 microversion: 2.1 time: 0.231404 Sep 10 10:40:09.635010 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 722/1228] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:09 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:09.639899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-110cbc96-48ff-447c-af4f-7d38ea1d4833 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Calling method '.version_select at 0x7efcae835ca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:09.663916 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-110cbc96-48ff-447c-af4f-7d38ea1d4833 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] HTTP exception thrown: Image not found. Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-110cbc96-48ff-447c-af4f-7d38ea1d4833 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Request method failure captured: Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/images/366cce76-8b74-4982-98c0-4d3994a61a71/metadata/os_version HTTP/1.1 Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmF0OHxdKrJCtxwL6324M9VBmYSXgWV03p3vkGEiBBJjUpHTaAfgOn-8JrtPs1VrQn0xSijAjKHC8GaAybelDMuJOK4TJZN9IXjUbDcU9AFzDOWee35Cxe4ddl1s5SPjkYPdC2clV1OX0EblFBtZgnAc0f7LbFEFz6rnET4WpCCoXw Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:09.666016 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3c7bb789de5f487dadb71d00c7fa7d39", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 4a6bfcbca6a44c06b23f9bf8bcd1dc78 Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'image_id': '366cce76-8b74-4982-98c0-4d3994a61a71', 'id': 'os_version'} Sep 10 10:40:09.667580 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:09.668467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 366cce76-8b74-4982-98c0-4d3994a61a71 Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:09.670300 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 366cce76-8b74-4982-98c0-4d3994a61a71 could not be found. Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:40:09.672952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:09.674624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-110cbc96-48ff-447c-af4f-7d38ea1d4833 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:09.676065 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-110cbc96-48ff-447c-af4f-7d38ea1d4833 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] 10.222.0.20 "GET /compute/v2.1/images/366cce76-8b74-4982-98c0-4d3994a61a71/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.031041 Sep 10 10:40:09.676065 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 723/1229] 10.222.0.20 () {58 vars in 1293 bytes} [Sat Sep 10 10:40:09 2022] GET /compute/v2.1/images/366cce76-8b74-4982-98c0-4d3994a61a71/metadata/os_version => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:40:09.677583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b3ca7345-c009-4f44-acbb-1b359ee788a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '.version_select at 0x7efcae6db700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:09.681208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3ca7345-c009-4f44-acbb-1b359ee788a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:09.681766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3ca7345-c009-4f44-acbb-1b359ee788a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:09.682914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3ca7345-c009-4f44-acbb-1b359ee788a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:09.695133 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b3ca7345-c009-4f44-acbb-1b359ee788a9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.25 time: 0.026142 Sep 10 10:40:09.695825 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 724/1230] 10.222.0.20 () {60 vars in 1184 bytes} [Sat Sep 10 10:40:09 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:09.700637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe4ec322-bb91-44d2-aace-36bc474b9851 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] Calling method '.version_select at 0x7efcaea26700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:10.067725 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe4ec322-bb91-44d2-aace-36bc474b9851 tempest-SecurityGroupRulesTestJSON-80940689 tempest-SecurityGroupRulesTestJSON-80940689-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2fe04614-42ae-481a-a19a-0763a0ed338b" status: 202 len: 0 microversion: 2.1 time: 0.370516 Sep 10 10:40:10.068308 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 725/1231] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:40:09 2022] DELETE /compute/v2.1/os-security-groups/2fe04614-42ae-481a-a19a-0763a0ed338b => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:40:10.076498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aff35426-967f-4966-89ff-c636b24d0c83 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:10.098428 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aff35426-967f-4966-89ff-c636b24d0c83 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.029024 Sep 10 10:40:10.099288 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 726/1232] 10.222.0.20 () {58 vars in 1148 bytes} [Sat Sep 10 10:40:10 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:10.114710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-70f35ec4-c0e0-421f-876c-d0e7f69f561f tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Calling method '.version_select at 0x7efcae81ae50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:10.161899 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-70f35ec4-c0e0-421f-876c-d0e7f69f561f tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.051080 Sep 10 10:40:10.163005 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 727/1233] 10.222.0.20 () {58 vars in 1290 bytes} [Sat Sep 10 10:40:10 2022] GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata/os_distro => generated 33 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:10.167518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14af7bc9-d7c4-4d6e-9fba-d252a9b1cdc0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:10.168163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14af7bc9-d7c4-4d6e-9fba-d252a9b1cdc0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: e84e3fbc-9d8c-4029-874c-34eec1bba0c0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:10.174437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14af7bc9-d7c4-4d6e-9fba-d252a9b1cdc0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:10.174934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14af7bc9-d7c4-4d6e-9fba-d252a9b1cdc0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:10.175372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14af7bc9-d7c4-4d6e-9fba-d252a9b1cdc0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:10.176080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14af7bc9-d7c4-4d6e-9fba-d252a9b1cdc0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:10.176600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14af7bc9-d7c4-4d6e-9fba-d252a9b1cdc0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:10.176955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14af7bc9-d7c4-4d6e-9fba-d252a9b1cdc0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:10.328805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14af7bc9-d7c4-4d6e-9fba-d252a9b1cdc0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:10.337213 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14af7bc9-d7c4-4d6e-9fba-d252a9b1cdc0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0" status: 200 len: 1514 microversion: 2.1 time: 0.173165 Sep 10 10:40:10.349637 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 728/1234] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:10 2022] GET /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:10.356692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb77b4fc-1b25-40d0-b795-ad136ed43fdd tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Calling method '.version_select at 0x7efcae7e85e0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:10.381983 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-cb77b4fc-1b25-40d0-b795-ad136ed43fdd tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] HTTP exception thrown: Image not found. Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb77b4fc-1b25-40d0-b795-ad136ed43fdd tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Request method failure captured: Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/images/4f3d4eb4-51fa-49d3-82d1-cd7bf7315fa7/metadata HTTP/1.1 Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmF0OHxdKrJCtxwL6324M9VBmYSXgWV03p3vkGEiBBJjUpHTaAfgOn-8JrtPs1VrQn0xSijAjKHC8GaAybelDMuJOK4TJZN9IXjUbDcU9AFzDOWee35Cxe4ddl1s5SPjkYPdC2clV1OX0EblFBtZgnAc0f7LbFEFz6rnET4WpCCoXw Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:10.384356 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3c7bb789de5f487dadb71d00c7fa7d39", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 4a6bfcbca6a44c06b23f9bf8bcd1dc78 Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'image_id': '4f3d4eb4-51fa-49d3-82d1-cd7bf7315fa7'} Sep 10 10:40:10.385968 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:10.387029 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4f3d4eb4-51fa-49d3-82d1-cd7bf7315fa7 Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:10.388660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4f3d4eb4-51fa-49d3-82d1-cd7bf7315fa7 could not be found. Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:40:10.390248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:10.391473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb77b4fc-1b25-40d0-b795-ad136ed43fdd tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:10.392795 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb77b4fc-1b25-40d0-b795-ad136ed43fdd tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] 10.222.0.20 "GET /compute/v2.1/images/4f3d4eb4-51fa-49d3-82d1-cd7bf7315fa7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035595 Sep 10 10:40:10.392795 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 729/1235] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:40:10 2022] GET /compute/v2.1/images/4f3d4eb4-51fa-49d3-82d1-cd7bf7315fa7/metadata => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:40:10.396135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e922747-8622-4e8e-9445-06d119ec90fd tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:10.397389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e922747-8622-4e8e-9445-06d119ec90fd tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:10.404363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e922747-8622-4e8e-9445-06d119ec90fd tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:10.404851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e922747-8622-4e8e-9445-06d119ec90fd tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:10.405316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e922747-8622-4e8e-9445-06d119ec90fd tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:10.406018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e922747-8622-4e8e-9445-06d119ec90fd tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:10.406469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e922747-8622-4e8e-9445-06d119ec90fd tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:10.406889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e922747-8622-4e8e-9445-06d119ec90fd tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:10.533778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4e922747-8622-4e8e-9445-06d119ec90fd tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid 7bf4f355-1582-4020-a738-9d8579be881b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:40:10.547620 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e922747-8622-4e8e-9445-06d119ec90fd tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 2424 microversion: 2.25 time: 0.158181 Sep 10 10:40:10.548198 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 730/1236] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:10 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 2424 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:10.552970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-03818557-efdb-4c31-af49-ebf3d42af3d4 req-3e0d320a-8e6d-41fe-8bf3-d7fdf361d282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f76e1-63ef-4c0a-806d-7c965e2fca1d", "name": "network-vif-unplugged", "status": "completed", "tag": "735d8dd5-9665-43f6-887a-972fb6ed4a3f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:10.562386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-03818557-efdb-4c31-af49-ebf3d42af3d4 req-3e0d320a-8e6d-41fe-8bf3-d7fdf361d282 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:10.563017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-03818557-efdb-4c31-af49-ebf3d42af3d4 req-3e0d320a-8e6d-41fe-8bf3-d7fdf361d282 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:10.563455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-03818557-efdb-4c31-af49-ebf3d42af3d4 req-3e0d320a-8e6d-41fe-8bf3-d7fdf361d282 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:10.574964 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-03818557-efdb-4c31-af49-ebf3d42af3d4 req-3e0d320a-8e6d-41fe-8bf3-d7fdf361d282 service nova] Creating event network-vif-unplugged:735d8dd5-9665-43f6-887a-972fb6ed4a3f for instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d on n-h1-856894-1 Sep 10 10:40:10.579742 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-03818557-efdb-4c31-af49-ebf3d42af3d4 req-3e0d320a-8e6d-41fe-8bf3-d7fdf361d282 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030427 Sep 10 10:40:10.580315 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 731/1237] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:10.585993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d97de430-67f2-45a5-b622-ea499af68928 req-9780d2c7-cd25-454e-947d-ca0c15d190ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9d635e-343c-4ec4-851d-7967c0f64f1e", "name": "network-vif-plugged", "status": "completed", "tag": "007043f4-be22-489b-9177-ce600e376823"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:10.595396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d97de430-67f2-45a5-b622-ea499af68928 req-9780d2c7-cd25-454e-947d-ca0c15d190ea service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:10.595870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d97de430-67f2-45a5-b622-ea499af68928 req-9780d2c7-cd25-454e-947d-ca0c15d190ea service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:10.596300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d97de430-67f2-45a5-b622-ea499af68928 req-9780d2c7-cd25-454e-947d-ca0c15d190ea service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:10.606952 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d97de430-67f2-45a5-b622-ea499af68928 req-9780d2c7-cd25-454e-947d-ca0c15d190ea service nova] Creating event network-vif-plugged:007043f4-be22-489b-9177-ce600e376823 for instance 1d9d635e-343c-4ec4-851d-7967c0f64f1e on n-h1-856894-1 Sep 10 10:40:10.611660 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d97de430-67f2-45a5-b622-ea499af68928 req-9780d2c7-cd25-454e-947d-ca0c15d190ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030058 Sep 10 10:40:10.612244 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 732/1238] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:10.619113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90aab362-884a-4cb1-9c82-5222591df1d1 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:10.632611 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90aab362-884a-4cb1-9c82-5222591df1d1 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.019081 Sep 10 10:40:10.633356 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 733/1239] 10.222.0.20 () {58 vars in 1140 bytes} [Sat Sep 10 10:40:10 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:10.644467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b92c803-82e3-4e50-828d-63642abb9b6d tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Action: 'update_all', calling method: .version_select at 0x7efcae79c940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:10.698710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0b92c803-82e3-4e50-828d-63642abb9b6d tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:10.701346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:10.705727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0b92c803-82e3-4e50-828d-63642abb9b6d tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for user 9d401fb9435f429197f93afbc387a415 and project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:10.866629 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b92c803-82e3-4e50-828d-63642abb9b6d tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.232204 Sep 10 10:40:10.867224 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 734/1240] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:40:10 2022] PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 61 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:10.872350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5cf6e8ed-4a3f-489e-ae46-d87ff29b03f7 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:10.873139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5cf6e8ed-4a3f-489e-ae46-d87ff29b03f7 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:10.879468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cf6e8ed-4a3f-489e-ae46-d87ff29b03f7 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:10.879962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cf6e8ed-4a3f-489e-ae46-d87ff29b03f7 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:10.880404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cf6e8ed-4a3f-489e-ae46-d87ff29b03f7 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:10.881191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cf6e8ed-4a3f-489e-ae46-d87ff29b03f7 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:10.881648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cf6e8ed-4a3f-489e-ae46-d87ff29b03f7 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:10.882080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cf6e8ed-4a3f-489e-ae46-d87ff29b03f7 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:10.886342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:11.040222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5cf6e8ed-4a3f-489e-ae46-d87ff29b03f7 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2688e0179e93428cb8c196d389d2fc78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f49d607f6a4934a17b15d43755a0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:11.050008 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5cf6e8ed-4a3f-489e-ae46-d87ff29b03f7 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e" status: 200 len: 1352 microversion: 2.1 time: 0.181466 Sep 10 10:40:11.050656 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 735/1241] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:10 2022] GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e => generated 1352 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:11.055561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c418e5f-2503-410c-a054-da38acc277ad tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:11.056060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c418e5f-2503-410c-a054-da38acc277ad tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:11.062217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c418e5f-2503-410c-a054-da38acc277ad tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:11.062556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c418e5f-2503-410c-a054-da38acc277ad tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:11.063019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c418e5f-2503-410c-a054-da38acc277ad tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:11.063703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c418e5f-2503-410c-a054-da38acc277ad tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:11.064156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c418e5f-2503-410c-a054-da38acc277ad tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:11.064576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c418e5f-2503-410c-a054-da38acc277ad tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:11.092415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c418e5f-2503-410c-a054-da38acc277ad tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:40:11.183606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c418e5f-2503-410c-a054-da38acc277ad tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 204 len: 0 microversion: 2.1 time: 0.130985 Sep 10 10:40:11.185148 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 736/1242] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:40:11 2022] DELETE /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:40:11.192464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72b0f6bc-3d97-4d54-913e-5a888739c4a8 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Action: 'update_all', calling method: .version_select at 0x7efcae81a430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:11.219398 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-72b0f6bc-3d97-4d54-913e-5a888739c4a8 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] HTTP exception thrown: Image not found. Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72b0f6bc-3d97-4d54-913e-5a888739c4a8 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Request method failure captured: Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/images/b0af1c4f-5a8f-4fb6-ba82-a726fc451d65/metadata HTTP/1.1 Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 57 Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmF0OHxdKrJCtxwL6324M9VBmYSXgWV03p3vkGEiBBJjUpHTaAfgOn-8JrtPs1VrQn0xSijAjKHC8GaAybelDMuJOK4TJZN9IXjUbDcU9AFzDOWee35Cxe4ddl1s5SPjkYPdC2clV1OX0EblFBtZgnAc0f7LbFEFz6rnET4WpCCoXw Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:11.221713 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3c7bb789de5f487dadb71d00c7fa7d39", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 4a6bfcbca6a44c06b23f9bf8bcd1dc78 Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:40:11.223425 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'image_id': 'b0af1c4f-5a8f-4fb6-ba82-a726fc451d65', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:11.224475 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b0af1c4f-5a8f-4fb6-ba82-a726fc451d65 Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:11.226023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b0af1c4f-5a8f-4fb6-ba82-a726fc451d65 could not be found. Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:11.227530 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:40:11.229411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.230881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72b0f6bc-3d97-4d54-913e-5a888739c4a8 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:11.230881 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72b0f6bc-3d97-4d54-913e-5a888739c4a8 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] 10.222.0.20 "PUT /compute/v2.1/images/b0af1c4f-5a8f-4fb6-ba82-a726fc451d65/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036421 Sep 10 10:40:11.230881 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 737/1243] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:40:11 2022] PUT /compute/v2.1/images/b0af1c4f-5a8f-4fb6-ba82-a726fc451d65/metadata => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:40:11.230881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d1202962-cc10-4a3b-a108-b305f496646b tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:11.230881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d1202962-cc10-4a3b-a108-b305f496646b tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:11.238582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1202962-cc10-4a3b-a108-b305f496646b tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:11.239039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1202962-cc10-4a3b-a108-b305f496646b tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:11.239479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1202962-cc10-4a3b-a108-b305f496646b tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:11.242033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1202962-cc10-4a3b-a108-b305f496646b tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:11.242697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1202962-cc10-4a3b-a108-b305f496646b tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:11.243293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1202962-cc10-4a3b-a108-b305f496646b tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:11.386140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d1202962-cc10-4a3b-a108-b305f496646b tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid 7bf4f355-1582-4020-a738-9d8579be881b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:40:11.400320 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d1202962-cc10-4a3b-a108-b305f496646b tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 2424 microversion: 2.25 time: 0.175650 Sep 10 10:40:11.400917 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 738/1244] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:11 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 2424 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:11.405727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c40cce71-cf62-407c-a002-cfaea5839a5f tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:11.414505 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c40cce71-cf62-407c-a002-cfaea5839a5f tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012493 Sep 10 10:40:11.415326 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 739/1245] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:40:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:11.419595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7965d2f9-b01d-4c21-8921-108e9df33570 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:11.420311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7965d2f9-b01d-4c21-8921-108e9df33570 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:11.426330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7965d2f9-b01d-4c21-8921-108e9df33570 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:11.426825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7965d2f9-b01d-4c21-8921-108e9df33570 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:11.427262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7965d2f9-b01d-4c21-8921-108e9df33570 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:11.428112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7965d2f9-b01d-4c21-8921-108e9df33570 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:11.428904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7965d2f9-b01d-4c21-8921-108e9df33570 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:11.429366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7965d2f9-b01d-4c21-8921-108e9df33570 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:11.568259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7965d2f9-b01d-4c21-8921-108e9df33570 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:11.576996 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7965d2f9-b01d-4c21-8921-108e9df33570 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1504 microversion: 2.1 time: 0.160825 Sep 10 10:40:11.577613 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 740/1246] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:11 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:11.582459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad9001bc-e33c-44b8-bb3d-61a6fd9d6497 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Calling method '.version_select at 0x7efcae834160>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:11.624783 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad9001bc-e33c-44b8-bb3d-61a6fd9d6497 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.046113 Sep 10 10:40:11.625425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 741/1247] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:40:11 2022] GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 61 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:11.630299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-adc1d984-6f3f-4804-9c6f-8fc622c4290f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:11.632333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-adc1d984-6f3f-4804-9c6f-8fc622c4290f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:11.638807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adc1d984-6f3f-4804-9c6f-8fc622c4290f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:11.639336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adc1d984-6f3f-4804-9c6f-8fc622c4290f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:11.639774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adc1d984-6f3f-4804-9c6f-8fc622c4290f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:11.640479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adc1d984-6f3f-4804-9c6f-8fc622c4290f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:11.640940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adc1d984-6f3f-4804-9c6f-8fc622c4290f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:11.641399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adc1d984-6f3f-4804-9c6f-8fc622c4290f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:11.773140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-adc1d984-6f3f-4804-9c6f-8fc622c4290f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:11.780916 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-adc1d984-6f3f-4804-9c6f-8fc622c4290f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 200 len: 1521 microversion: 2.1 time: 0.154546 Sep 10 10:40:11.781595 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 742/1248] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:11 2022] GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:11.786714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19ae2410-4746-4473-87ea-24207d73552f tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Action: 'update', calling method: .version_select at 0x7efcae81a040>, body: {"meta": {"os_distro": "alt"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:11.819243 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-19ae2410-4746-4473-87ea-24207d73552f tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] HTTP exception thrown: Image not found. Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19ae2410-4746-4473-87ea-24207d73552f tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Request method failure captured: Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/images/4bbfec46-b37d-4c14-acd5-915ab1c943e4/metadata/os_distro HTTP/1.1 Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 30 Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmF0OHxdKrJCtxwL6324M9VBmYSXgWV03p3vkGEiBBJjUpHTaAfgOn-8JrtPs1VrQn0xSijAjKHC8GaAybelDMuJOK4TJZN9IXjUbDcU9AFzDOWee35Cxe4ddl1s5SPjkYPdC2clV1OX0EblFBtZgnAc0f7LbFEFz6rnET4WpCCoXw Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:11.821585 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3c7bb789de5f487dadb71d00c7fa7d39", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 4a6bfcbca6a44c06b23f9bf8bcd1dc78 Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: {"meta": {"os_distro": "alt"}} Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:40:11.823334 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'image_id': '4bbfec46-b37d-4c14-acd5-915ab1c943e4', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:11.824447 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4bbfec46-b37d-4c14-acd5-915ab1c943e4 Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:11.825985 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4bbfec46-b37d-4c14-acd5-915ab1c943e4 could not be found. Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:11.827634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:40:11.829186 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:11.830854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19ae2410-4746-4473-87ea-24207d73552f tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:11.838278 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-19ae2410-4746-4473-87ea-24207d73552f tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] 10.222.0.20 "PUT /compute/v2.1/images/4bbfec46-b37d-4c14-acd5-915ab1c943e4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.055557 Sep 10 10:40:11.839070 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 743/1249] 10.222.0.20 () {60 vars in 1310 bytes} [Sat Sep 10 10:40:11 2022] PUT /compute/v2.1/images/4bbfec46-b37d-4c14-acd5-915ab1c943e4/metadata/os_distro => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:40:11.844035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-acaa838e-75d4-4f9d-9b39-b17539cf8c94 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:11.869211 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-acaa838e-75d4-4f9d-9b39-b17539cf8c94 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.028727 Sep 10 10:40:11.870046 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 744/1250] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:40:11 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:11.884820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78edffb5-ed03-4300-a3b8-6db23e42b683 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:11.885635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78edffb5-ed03-4300-a3b8-6db23e42b683 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:11.887784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:11.894508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78edffb5-ed03-4300-a3b8-6db23e42b683 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:11.895230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78edffb5-ed03-4300-a3b8-6db23e42b683 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:11.895864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78edffb5-ed03-4300-a3b8-6db23e42b683 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:11.896851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78edffb5-ed03-4300-a3b8-6db23e42b683 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:11.897523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78edffb5-ed03-4300-a3b8-6db23e42b683 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:11.898138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78edffb5-ed03-4300-a3b8-6db23e42b683 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:12.191258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-78edffb5-ed03-4300-a3b8-6db23e42b683 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lazy-loading 'services' on Instance uuid 7bf4f355-1582-4020-a738-9d8579be881b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:40:12.270503 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78edffb5-ed03-4300-a3b8-6db23e42b683 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments/052638ff-6169-42f9-8bba-bc64ef05d4d7" status: 202 len: 0 microversion: 2.25 time: 0.390226 Sep 10 10:40:12.276954 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 745/1251] 10.222.0.20 () {60 vars in 1457 bytes} [Sat Sep 10 10:40:11 2022] DELETE /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments/052638ff-6169-42f9-8bba-bc64ef05d4d7 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:40:12.279686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f97bccb-b554-4ac8-81f6-71b6ec241eac tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Action: 'update_all', calling method: .version_select at 0x7efcae6654c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:12.345393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8f97bccb-b554-4ac8-81f6-71b6ec241eac tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:12.351970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8f97bccb-b554-4ac8-81f6-71b6ec241eac tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for user 9d401fb9435f429197f93afbc387a415 and project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:12.543210 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f97bccb-b554-4ac8-81f6-71b6ec241eac tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.268261 Sep 10 10:40:12.543794 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 746/1252] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:40:12 2022] PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 61 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:12.548280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc62ae55-4d39-49f5-bbe9-d99b4585ad25 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Action: 'create', calling method: .version_select at 0x7efcae665670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:12.573243 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-bc62ae55-4d39-49f5-bbe9-d99b4585ad25 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] HTTP exception thrown: Image not found. Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc62ae55-4d39-49f5-bbe9-d99b4585ad25 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Request method failure captured: Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/images/e5dac484-ea6b-4108-9075-b3c58ae35ddc/metadata HTTP/1.1 Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 57 Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmF0OHxdKrJCtxwL6324M9VBmYSXgWV03p3vkGEiBBJjUpHTaAfgOn-8JrtPs1VrQn0xSijAjKHC8GaAybelDMuJOK4TJZN9IXjUbDcU9AFzDOWee35Cxe4ddl1s5SPjkYPdC2clV1OX0EblFBtZgnAc0f7LbFEFz6rnET4WpCCoXw Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:12.575496 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3c7bb789de5f487dadb71d00c7fa7d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3c7bb789de5f487dadb71d00c7fa7d39", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 3c7bb789de5f487dadb71d00c7fa7d39 Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973 Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 4a6bfcbca6a44c06b23f9bf8bcd1dc78 Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052407973-project Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:40:12.577304 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'image_id': 'e5dac484-ea6b-4108-9075-b3c58ae35ddc', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:12.578285 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e5dac484-ea6b-4108-9075-b3c58ae35ddc Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:40:12.579484 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5dac484-ea6b-4108-9075-b3c58ae35ddc could not be found. Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:12.580772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:40:12.582509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:12.584791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc62ae55-4d39-49f5-bbe9-d99b4585ad25 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:12.584791 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc62ae55-4d39-49f5-bbe9-d99b4585ad25 tempest-ImagesMetadataNegativeTestJSON-2052407973 tempest-ImagesMetadataNegativeTestJSON-2052407973-project] 10.222.0.20 "POST /compute/v2.1/images/e5dac484-ea6b-4108-9075-b3c58ae35ddc/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032219 Sep 10 10:40:12.584791 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 747/1253] 10.222.0.20 () {60 vars in 1281 bytes} [Sat Sep 10 10:40:12 2022] POST /compute/v2.1/images/e5dac484-ea6b-4108-9075-b3c58ae35ddc/metadata => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:40:12.584791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-447bbf85-cc4b-41f9-826b-3f0789705690 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:12.613228 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-447bbf85-cc4b-41f9-826b-3f0789705690 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034634 Sep 10 10:40:12.614130 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 748/1254] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:40:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:12.626114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6fd7eca9-0cc1-4d66-a109-e4cb1f0fc94d tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:12.626992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6fd7eca9-0cc1-4d66-a109-e4cb1f0fc94d tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:12.634165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd7eca9-0cc1-4d66-a109-e4cb1f0fc94d tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:12.634747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd7eca9-0cc1-4d66-a109-e4cb1f0fc94d tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:12.635184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd7eca9-0cc1-4d66-a109-e4cb1f0fc94d tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:12.635877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd7eca9-0cc1-4d66-a109-e4cb1f0fc94d tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:12.636463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd7eca9-0cc1-4d66-a109-e4cb1f0fc94d tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:12.637003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd7eca9-0cc1-4d66-a109-e4cb1f0fc94d tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:12.799065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6fd7eca9-0cc1-4d66-a109-e4cb1f0fc94d tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2688e0179e93428cb8c196d389d2fc78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f49d607f6a4934a17b15d43755a0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:12.810214 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6fd7eca9-0cc1-4d66-a109-e4cb1f0fc94d tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e" status: 200 len: 1542 microversion: 2.1 time: 0.187922 Sep 10 10:40:12.811384 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 749/1255] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:12 2022] GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e => generated 1542 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:12.820079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7201866a-4963-47de-b3d4-81cc6722fb28 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:12.823284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7201866a-4963-47de-b3d4-81cc6722fb28 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:12.831759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201866a-4963-47de-b3d4-81cc6722fb28 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:12.832311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201866a-4963-47de-b3d4-81cc6722fb28 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:12.832801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201866a-4963-47de-b3d4-81cc6722fb28 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:12.834059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201866a-4963-47de-b3d4-81cc6722fb28 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:12.834686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201866a-4963-47de-b3d4-81cc6722fb28 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:12.835347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201866a-4963-47de-b3d4-81cc6722fb28 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:12.899232 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7201866a-4963-47de-b3d4-81cc6722fb28 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.085998 Sep 10 10:40:12.900376 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 750/1256] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 10:40:12 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:40:12.911170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d236ce5-410b-4c50-93c1-f4cb7c4748c5 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Action: 'update_all', calling method: .version_select at 0x7efcae6db700>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:12.999242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-5d236ce5-410b-4c50-93c1-f4cb7c4748c5 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:13.006833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-5d236ce5-410b-4c50-93c1-f4cb7c4748c5 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for user 9d401fb9435f429197f93afbc387a415 and project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:13.631216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d236ce5-410b-4c50-93c1-f4cb7c4748c5 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 64 microversion: 2.1 time: 0.728975 Sep 10 10:40:13.633052 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 751/1257] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:40:12 2022] PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 64 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:13.641171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a539a2cb-6839-4681-97c3-742b8275feec req-0f609c17-12fd-4c34-bd6b-a66086415525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677f76e1-63ef-4c0a-806d-7c965e2fca1d", "tag": "735d8dd5-9665-43f6-887a-972fb6ed4a3f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:13.652938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a539a2cb-6839-4681-97c3-742b8275feec req-0f609c17-12fd-4c34-bd6b-a66086415525 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:13.653894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a539a2cb-6839-4681-97c3-742b8275feec req-0f609c17-12fd-4c34-bd6b-a66086415525 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:13.654828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a539a2cb-6839-4681-97c3-742b8275feec req-0f609c17-12fd-4c34-bd6b-a66086415525 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:13.688822 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a539a2cb-6839-4681-97c3-742b8275feec req-0f609c17-12fd-4c34-bd6b-a66086415525 service nova] Creating event network-changed:735d8dd5-9665-43f6-887a-972fb6ed4a3f for instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d on n-h1-856894-1 Sep 10 10:40:13.700357 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a539a2cb-6839-4681-97c3-742b8275feec req-0f609c17-12fd-4c34-bd6b-a66086415525 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067195 Sep 10 10:40:13.703717 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 752/1258] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:13.711209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4dc27bf-c6ec-4cd0-8d8d-c58132abf67c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:13.712227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4dc27bf-c6ec-4cd0-8d8d-c58132abf67c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:13.746931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4dc27bf-c6ec-4cd0-8d8d-c58132abf67c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:13.747664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4dc27bf-c6ec-4cd0-8d8d-c58132abf67c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:13.748420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4dc27bf-c6ec-4cd0-8d8d-c58132abf67c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:13.749506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4dc27bf-c6ec-4cd0-8d8d-c58132abf67c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:13.750213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4dc27bf-c6ec-4cd0-8d8d-c58132abf67c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:13.751564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4dc27bf-c6ec-4cd0-8d8d-c58132abf67c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:14.146903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4dc27bf-c6ec-4cd0-8d8d-c58132abf67c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:14.195089 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a4dc27bf-c6ec-4cd0-8d8d-c58132abf67c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1504 microversion: 2.1 time: 0.487104 Sep 10 10:40:14.198172 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 753/1259] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:13 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1504 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:14.216383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-758ed8b4-0f0a-4c5f-aaf5-a71a9e0cd187 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:14.251285 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-758ed8b4-0f0a-4c5f-aaf5-a71a9e0cd187 tempest-FlavorsV2TestJSON-908865249 tempest-FlavorsV2TestJSON-908865249-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046735 Sep 10 10:40:14.260115 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 754/1260] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:40:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:14.283472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:14.284117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:14.317117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:14.317622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:14.318072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:14.319359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:14.319841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:14.330554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:14.434860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:14.435901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:14.436265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:14.436860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lazy-loading 'fault' on Instance uuid 17266718-ca01-4a84-b2ee-800852e38df1 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:40:14.560466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:14.569931 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ebe9be48-6311-4c0d-bc15-b85f1873bc16 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 200 len: 1312 microversion: 2.1 time: 0.316350 Sep 10 10:40:14.571556 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 755/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:14 2022] GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 1312 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:14.576818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6e3a04a-ba53-481d-bcab-d7d3ea128533 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:14.577607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6e3a04a-ba53-481d-bcab-d7d3ea128533 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:14.601854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6e3a04a-ba53-481d-bcab-d7d3ea128533 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:14.601854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6e3a04a-ba53-481d-bcab-d7d3ea128533 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:14.601854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6e3a04a-ba53-481d-bcab-d7d3ea128533 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:14.601854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6e3a04a-ba53-481d-bcab-d7d3ea128533 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:14.602324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6e3a04a-ba53-481d-bcab-d7d3ea128533 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:14.603045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6e3a04a-ba53-481d-bcab-d7d3ea128533 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:14.899427 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6e3a04a-ba53-481d-bcab-d7d3ea128533 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.326300 Sep 10 10:40:14.909118 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 756/1262] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:40:14 2022] GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e/os-interface => generated 285 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:14.915013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e0f16c9-ef6f-4dd5-ad21-4512900892ba tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Calling method '.version_select at 0x7efcae6fed30>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:15.043466 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e0f16c9-ef6f-4dd5-ad21-4512900892ba tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 64 microversion: 2.1 time: 0.132911 Sep 10 10:40:15.044662 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 757/1263] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:40:14 2022] GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 64 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:15.055441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-696621b9-d48e-4137-a2f2-a6f32dd78eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:15.059406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-696621b9-d48e-4137-a2f2-a6f32dd78eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:15.070440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696621b9-d48e-4137-a2f2-a6f32dd78eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:15.071247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696621b9-d48e-4137-a2f2-a6f32dd78eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:15.071933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696621b9-d48e-4137-a2f2-a6f32dd78eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:15.073142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696621b9-d48e-4137-a2f2-a6f32dd78eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:15.073816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696621b9-d48e-4137-a2f2-a6f32dd78eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:15.074975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696621b9-d48e-4137-a2f2-a6f32dd78eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:15.121523 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-696621b9-d48e-4137-a2f2-a6f32dd78eb3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075285 Sep 10 10:40:15.123018 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 758/1264] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 10:40:15 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:40:15.129909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a403c93a-e9ff-4335-919a-a228069b7046 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Action: 'update_all', calling method: .version_select at 0x7efcae6fee50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:15.205053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a403c93a-e9ff-4335-919a-a228069b7046 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:15.213186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a403c93a-e9ff-4335-919a-a228069b7046 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for user 9d401fb9435f429197f93afbc387a415 and project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:15.693620 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a403c93a-e9ff-4335-919a-a228069b7046 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.563828 Sep 10 10:40:15.693620 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 759/1265] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:40:15 2022] PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 61 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:15.698928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc14bfd6-da0d-4821-a083-0995d35ac38c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:15.699672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cc14bfd6-da0d-4821-a083-0995d35ac38c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:15.707506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc14bfd6-da0d-4821-a083-0995d35ac38c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:15.708192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc14bfd6-da0d-4821-a083-0995d35ac38c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:15.708813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc14bfd6-da0d-4821-a083-0995d35ac38c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:15.710188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc14bfd6-da0d-4821-a083-0995d35ac38c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:15.710754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc14bfd6-da0d-4821-a083-0995d35ac38c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:15.711293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc14bfd6-da0d-4821-a083-0995d35ac38c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:16.063409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cc14bfd6-da0d-4821-a083-0995d35ac38c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:16.071410 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cc14bfd6-da0d-4821-a083-0995d35ac38c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1504 microversion: 2.1 time: 0.380801 Sep 10 10:40:16.072414 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 760/1266] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:15 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:16.077252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:16.078138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:16.084626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:16.085430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:16.086093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:16.087028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:16.087702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:16.088337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:16.106498 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] HTTP exception thrown: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Request method failure captured: Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 HTTP/1.1 Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlkaMIH9WxjI3dQogKvVOJ0PygWp1d7JHtYNvoiM9PYptQFFB0_rnmcgvQ0svAAZrc7HjlP6IMnGFZFdFfCSRbyvAGYeSBN2JNI3SJcZm8AJlpC_DnIMLbIQtqxfgNRbAiRsVzjOi1egKvMUPD7kWmz-wvT6cYAWg6BzRUxUVU5RYE Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:16.111591 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d9f9ca498dd4db18965e199d7d385f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e1b58fd7016a470b9cc588bc2f7eab7b Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:16.113123 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '17266718-ca01-4a84-b2ee-800852e38df1'} Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:16.113996 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:16.116236 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:16.117485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Returning 404 to user: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:16.117485 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-03bb8ae8-47ed-4f36-a7d5-8e2216bd912d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 404 len: 111 microversion: 2.1 time: 0.043831 Sep 10 10:40:16.118167 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 761/1267] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:16 2022] GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:40:16.126701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ba003ff9-9e9b-40c4-b6bf-581c497dd835 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Action: 'update', calling method: .version_select at 0x7efcae7e8af0>, body: {"meta": {"os_version": "alt"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:16.223830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ba003ff9-9e9b-40c4-b6bf-581c497dd835 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:16.237525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ba003ff9-9e9b-40c4-b6bf-581c497dd835 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for user 9d401fb9435f429197f93afbc387a415 and project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:16.817683 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ba003ff9-9e9b-40c4-b6bf-581c497dd835 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.698301 Sep 10 10:40:16.818562 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 762/1268] 10.222.0.20 () {60 vars in 1313 bytes} [Sat Sep 10 10:40:16 2022] PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata/os_version => generated 31 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:16.826927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8815c974-5a6a-4a5b-8797-1db5a8beed4c req-250f36b7-fc92-4e02-bb7c-f38d79cdff96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17266718-ca01-4a84-b2ee-800852e38df1", "name": "network-vif-deleted", "tag": "b711a40c-1ea4-4cf0-b7bd-ee43ed0f1794"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:16.843631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8815c974-5a6a-4a5b-8797-1db5a8beed4c req-250f36b7-fc92-4e02-bb7c-f38d79cdff96 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:16.848453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8815c974-5a6a-4a5b-8797-1db5a8beed4c req-250f36b7-fc92-4e02-bb7c-f38d79cdff96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:16.849092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8815c974-5a6a-4a5b-8797-1db5a8beed4c req-250f36b7-fc92-4e02-bb7c-f38d79cdff96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:16.872915 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8815c974-5a6a-4a5b-8797-1db5a8beed4c req-250f36b7-fc92-4e02-bb7c-f38d79cdff96 service nova] Creating event network-vif-deleted:b711a40c-1ea4-4cf0-b7bd-ee43ed0f1794 for instance 17266718-ca01-4a84-b2ee-800852e38df1 on n-h2-856894-1 Sep 10 10:40:16.888629 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8815c974-5a6a-4a5b-8797-1db5a8beed4c req-250f36b7-fc92-4e02-bb7c-f38d79cdff96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068835 Sep 10 10:40:16.890696 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 763/1269] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:16.904951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22359672-2d36-48f2-8ef3-1159334a3e41 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:16.919384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-22359672-2d36-48f2-8ef3-1159334a3e41 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:16.920796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-22359672-2d36-48f2-8ef3-1159334a3e41 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '9d9f9ca498dd4db18965e199d7d385f3'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:40:16.932904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22359672-2d36-48f2-8ef3-1159334a3e41 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:16.939838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22359672-2d36-48f2-8ef3-1159334a3e41 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:16.940530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22359672-2d36-48f2-8ef3-1159334a3e41 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:16.942432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22359672-2d36-48f2-8ef3-1159334a3e41 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:16.943160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22359672-2d36-48f2-8ef3-1159334a3e41 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:16.943835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22359672-2d36-48f2-8ef3-1159334a3e41 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:17.029239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:17.047936 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-22359672-2d36-48f2-8ef3-1159334a3e41 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.153194 Sep 10 10:40:17.049406 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 764/1270] 10.222.0.20 () {58 vars in 1230 bytes} [Sat Sep 10 10:40:16 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:17.055120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4661664a-473b-49f7-afdd-400fed348c81 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:17.057775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4661664a-473b-49f7-afdd-400fed348c81 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:17.065582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4661664a-473b-49f7-afdd-400fed348c81 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:17.066853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4661664a-473b-49f7-afdd-400fed348c81 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:17.067541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4661664a-473b-49f7-afdd-400fed348c81 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:17.068511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4661664a-473b-49f7-afdd-400fed348c81 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:17.069219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4661664a-473b-49f7-afdd-400fed348c81 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:17.069870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4661664a-473b-49f7-afdd-400fed348c81 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:17.106785 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4661664a-473b-49f7-afdd-400fed348c81 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.056078 Sep 10 10:40:17.108190 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 765/1271] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 10:40:17 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:40:17.113363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-64dbd7a8-cca0-4c30-b5ed-2a803f746abf tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Calling method '.version_select at 0x7efcae7e80d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:17.179458 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-64dbd7a8-cca0-4c30-b5ed-2a803f746abf tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 58 microversion: 2.1 time: 0.069509 Sep 10 10:40:17.185258 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 766/1272] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:40:17 2022] GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 58 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:17.190396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de08cf8d-9282-4a3c-9d12-a1577b33986f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de08cf8d-9282-4a3c-9d12-a1577b33986f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Request method failure captured: Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlkaMIH9WxjI3dQogKvVOJ0PygWp1d7JHtYNvoiM9PYptQFFB0_rnmcgvQ0svAAZrc7HjlP6IMnGFZFdFfCSRbyvAGYeSBN2JNI3SJcZm8AJlpC_DnIMLbIQtqxfgNRbAiRsVzjOi1egKvMUPD7kWmz-wvT6cYAWg6BzRUxUVU5RYE Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:17.204599 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d9f9ca498dd4db18965e199d7d385f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e1b58fd7016a470b9cc588bc2f7eab7b Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 10 10:40:17.206300 n-d-856894-1 devstack@n-api.service[128788]: action_args: {} Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:17.207119 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:17.208742 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:17.212655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:40:17.212655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:40:17.212655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 10 10:40:17.212655 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:17.213206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de08cf8d-9282-4a3c-9d12-a1577b33986f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:17.215977 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de08cf8d-9282-4a3c-9d12-a1577b33986f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.034375 Sep 10 10:40:17.216560 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 767/1273] 10.222.0.20 () {58 vars in 1182 bytes} [Sat Sep 10 10:40:17 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:40:17.238142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ed713cb-5b75-4358-8f1f-78a5ad2c352d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:17.242990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8ed713cb-5b75-4358-8f1f-78a5ad2c352d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:17.273406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed713cb-5b75-4358-8f1f-78a5ad2c352d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:17.275678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed713cb-5b75-4358-8f1f-78a5ad2c352d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:17.276154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed713cb-5b75-4358-8f1f-78a5ad2c352d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:17.277352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed713cb-5b75-4358-8f1f-78a5ad2c352d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:17.277826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed713cb-5b75-4358-8f1f-78a5ad2c352d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:17.278257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed713cb-5b75-4358-8f1f-78a5ad2c352d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:17.772627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8ed713cb-5b75-4358-8f1f-78a5ad2c352d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:17.784125 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ed713cb-5b75-4358-8f1f-78a5ad2c352d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1504 microversion: 2.1 time: 0.565623 Sep 10 10:40:17.784710 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 768/1274] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:17 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:17.797679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f105757-14b4-41a5-a2ca-97c7dec3b81c tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Action: 'update_all', calling method: .version_select at 0x7efcae7e8ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:17.879151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4f105757-14b4-41a5-a2ca-97c7dec3b81c tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:17.891066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4f105757-14b4-41a5-a2ca-97c7dec3b81c tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for user 9d401fb9435f429197f93afbc387a415 and project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:18.493507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f105757-14b4-41a5-a2ca-97c7dec3b81c tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.707233 Sep 10 10:40:18.494837 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 769/1275] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:40:17 2022] PUT /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 61 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:18.499708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:18.504689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:18.509946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Searching by: {'deleted': False, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:40:18.512255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:18.530155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:18.530904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:18.531532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:18.532623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:18.533324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:18.536699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:18.604983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:40:18.641269 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-39735152-5a95-409a-9cfc-213ca8074a90 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.144914 Sep 10 10:40:18.642271 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 770/1276] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 10:40:18 2022] GET /compute/v2.1/servers => generated 681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:18.860675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-81723104-b2dc-4f55-bfb1-8669db240de5 req-ea3024fb-5256-400d-9526-4c16e77ad001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d9d635e-343c-4ec4-851d-7967c0f64f1e", "tag": "007043f4-be22-489b-9177-ce600e376823"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:18.875557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-81723104-b2dc-4f55-bfb1-8669db240de5 req-ea3024fb-5256-400d-9526-4c16e77ad001 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:18.876810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-81723104-b2dc-4f55-bfb1-8669db240de5 req-ea3024fb-5256-400d-9526-4c16e77ad001 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:18.877825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-81723104-b2dc-4f55-bfb1-8669db240de5 req-ea3024fb-5256-400d-9526-4c16e77ad001 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:18.894219 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-81723104-b2dc-4f55-bfb1-8669db240de5 req-ea3024fb-5256-400d-9526-4c16e77ad001 service nova] Creating event network-changed:007043f4-be22-489b-9177-ce600e376823 for instance 1d9d635e-343c-4ec4-851d-7967c0f64f1e on n-h1-856894-1 Sep 10 10:40:18.902102 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-81723104-b2dc-4f55-bfb1-8669db240de5 req-ea3024fb-5256-400d-9526-4c16e77ad001 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249960 Sep 10 10:40:18.903543 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 771/1277] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:18.990140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-39896850", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": "none"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:19.058768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:40:19.059371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:40:19.060034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:40:19.061301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:40:19.062011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:40:19.072966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:19.073921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:19.074540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:19.075743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:19.076438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:19.077895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:19.117300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Getting quotas for project 6445b7c0c716431895f3dc1a46db3c26. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:19.125427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Getting quotas for user 9bd0038233c64d7190e049d47372400b and project 6445b7c0c716431895f3dc1a46db3c26. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:19.143021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:40:19.146014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:40:19.234046 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b93c4505-8324-4618-b6f5-fe0ccd7dee5c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.328260 Sep 10 10:40:19.234712 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 772/1278] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 330 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 10:40:19.255622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b60927d2-daf2-4487-b991-81f4c063815c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:19.260930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b60927d2-daf2-4487-b991-81f4c063815c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:19.294630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b60927d2-daf2-4487-b991-81f4c063815c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:19.303566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b60927d2-daf2-4487-b991-81f4c063815c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:19.311347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b60927d2-daf2-4487-b991-81f4c063815c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:19.312603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b60927d2-daf2-4487-b991-81f4c063815c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:19.313442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b60927d2-daf2-4487-b991-81f4c063815c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:19.314699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b60927d2-daf2-4487-b991-81f4c063815c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:19.378783 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b60927d2-daf2-4487-b991-81f4c063815c tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141587 Sep 10 10:40:19.385682 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 773/1279] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 10:40:19 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:40:19.393096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-75b6cc58-541a-48c3-85cf-6b6cab122588 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Action: 'create', calling method: .version_select at 0x7efcae7e8280>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:19.458603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-75b6cc58-541a-48c3-85cf-6b6cab122588 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:19.466333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-75b6cc58-541a-48c3-85cf-6b6cab122588 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Getting quotas for user 9d401fb9435f429197f93afbc387a415 and project b31a8c705add413d97376f257e434bc4. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:20.215564 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-75b6cc58-541a-48c3-85cf-6b6cab122588 tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "POST /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 85 microversion: 2.1 time: 0.828450 Sep 10 10:40:20.216858 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 774/1280] 10.222.0.20 () {60 vars in 1281 bytes} [Sat Sep 10 10:40:19 2022] POST /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 85 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:20.231457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:20.237816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:20.238702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.servers [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Removing options 'limit' from query {{(pid=128788) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 10:40:20.239568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Searching by: {'deleted': False, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:40:20.250766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:20.251716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:20.252354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:20.253335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:20.255535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:20.256880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:20.342931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:40:20.379945 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b9c2efe-a5f1-4c58-be50-3ca3e96bb21e tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.161422 Sep 10 10:40:20.381207 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 775/1281] 10.222.0.20 () {58 vars in 1144 bytes} [Sat Sep 10 10:40:20 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:20.388787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5400256c-e214-4aea-9a12-fc7b87e34b01 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:20.389453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5400256c-e214-4aea-9a12-fc7b87e34b01 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:20.399497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5400256c-e214-4aea-9a12-fc7b87e34b01 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:20.400002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5400256c-e214-4aea-9a12-fc7b87e34b01 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:20.400445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5400256c-e214-4aea-9a12-fc7b87e34b01 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:20.401181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5400256c-e214-4aea-9a12-fc7b87e34b01 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:20.401824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5400256c-e214-4aea-9a12-fc7b87e34b01 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:20.402419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5400256c-e214-4aea-9a12-fc7b87e34b01 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:20.809131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5400256c-e214-4aea-9a12-fc7b87e34b01 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:20.826034 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5400256c-e214-4aea-9a12-fc7b87e34b01 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1479 microversion: 2.1 time: 0.443551 Sep 10 10:40:20.827884 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 776/1282] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:20 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1479 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:20.832807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:20.833655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:20.851329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:20.852037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:20.852642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:20.853580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:20.854214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:20.854807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:21.183493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:21.193622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:21.197245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:21.202453 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-20a802ab-d7a2-4693-8002-4f787c5961fa tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1328 microversion: 2.57 time: 0.373333 Sep 10 10:40:21.203337 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 777/1283] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:20 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1328 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:21.222880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd36f927-52d9-4fbc-bf61-6c58acbfd4ed tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] Calling method '.version_select at 0x7efcae6fe9d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:21.288112 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd36f927-52d9-4fbc-bf61-6c58acbfd4ed tempest-ImagesMetadataTestJSON-761524453 tempest-ImagesMetadataTestJSON-761524453-project] 10.222.0.20 "GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata" status: 200 len: 85 microversion: 2.1 time: 0.083434 Sep 10 10:40:21.290150 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 778/1284] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:40:21 2022] GET /compute/v2.1/images/0019c007-f1a0-4401-aaee-64fa2a097aa2/metadata => generated 85 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:21.297211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74786a9c-42e1-4179-ac2b-fed59a5f44c4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:21.301614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74786a9c-42e1-4179-ac2b-fed59a5f44c4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:21.318686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74786a9c-42e1-4179-ac2b-fed59a5f44c4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:21.318686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74786a9c-42e1-4179-ac2b-fed59a5f44c4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:21.322911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74786a9c-42e1-4179-ac2b-fed59a5f44c4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:21.323821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74786a9c-42e1-4179-ac2b-fed59a5f44c4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:21.324316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74786a9c-42e1-4179-ac2b-fed59a5f44c4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:21.324763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74786a9c-42e1-4179-ac2b-fed59a5f44c4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:21.408641 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74786a9c-42e1-4179-ac2b-fed59a5f44c4 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.117119 Sep 10 10:40:21.410578 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 779/1285] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 10:40:21 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:21.424518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec4ede6a-55fe-4ab1-9550-33d4112cb36a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec4ede6a-55fe-4ab1-9550-33d4112cb36a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Request method failure captured: Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlkaMIH9WxjI3dQogKvVOJ0PygWp1d7JHtYNvoiM9PYptQFFB0_rnmcgvQ0svAAZrc7HjlP6IMnGFZFdFfCSRbyvAGYeSBN2JNI3SJcZm8AJlpC_DnIMLbIQtqxfgNRbAiRsVzjOi1egKvMUPD7kWmz-wvT6cYAWg6BzRUxUVU5RYE Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:21.437174 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d9f9ca498dd4db18965e199d7d385f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e1b58fd7016a470b9cc588bc2f7eab7b Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 10 10:40:21.439008 n-d-856894-1 devstack@n-api.service[128788]: action_args: {} Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi '-1' Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:21.439949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.441869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:21.443901 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:21.443901 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:21.443901 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:40:21.443901 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:40:21.443901 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 10 10:40:21.443901 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.443901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec4ede6a-55fe-4ab1-9550-33d4112cb36a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:21.443901 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec4ede6a-55fe-4ab1-9550-33d4112cb36a tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.028238 Sep 10 10:40:21.449358 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 780/1286] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Sep 10 10:40:21 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:40:21.463869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-430138d1-2fe7-49fe-876f-4593c298ed71 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '.version_select at 0x7efcae6fe940>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:21.475911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-430138d1-2fe7-49fe-876f-4593c298ed71 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:21.476439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-430138d1-2fe7-49fe-876f-4593c298ed71 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:21.478684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-430138d1-2fe7-49fe-876f-4593c298ed71 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:21.503932 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-430138d1-2fe7-49fe-876f-4593c298ed71 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1936 microversion: 2.1 time: 0.052403 Sep 10 10:40:21.504566 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 781/1287] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:40:21 2022] GET /compute/v2.1/os-migrations => generated 1936 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:21.520394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71c439c2-3a87-49ff-8281-c68e7cd8a4e6 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71c439c2-3a87-49ff-8281-c68e7cd8a4e6 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Request method failure captured: Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlkaMIH9WxjI3dQogKvVOJ0PygWp1d7JHtYNvoiM9PYptQFFB0_rnmcgvQ0svAAZrc7HjlP6IMnGFZFdFfCSRbyvAGYeSBN2JNI3SJcZm8AJlpC_DnIMLbIQtqxfgNRbAiRsVzjOi1egKvMUPD7kWmz-wvT6cYAWg6BzRUxUVU5RYE Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:21.524861 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d9f9ca498dd4db18965e199d7d385f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e1b58fd7016a470b9cc588bc2f7eab7b Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 10 10:40:21.526338 n-d-856894-1 devstack@n-api.service[128788]: action_args: {} Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'testing' Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:21.527152 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.528727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:21.530053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:21.530053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:21.530053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:40:21.530053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:40:21.530053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 10 10:40:21.530053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:21.530053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71c439c2-3a87-49ff-8281-c68e7cd8a4e6 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:21.530053 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71c439c2-3a87-49ff-8281-c68e7cd8a4e6 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.020297 Sep 10 10:40:21.530053 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 782/1288] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:40:21 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:40:21.545899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-17b16fca-7b19-412b-a0cf-7c9fd020077e tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:21.546535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-17b16fca-7b19-412b-a0cf-7c9fd020077e tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:21.554709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b16fca-7b19-412b-a0cf-7c9fd020077e tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:21.555205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b16fca-7b19-412b-a0cf-7c9fd020077e tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:21.556127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b16fca-7b19-412b-a0cf-7c9fd020077e tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:21.557172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b16fca-7b19-412b-a0cf-7c9fd020077e tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:21.558122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b16fca-7b19-412b-a0cf-7c9fd020077e tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:21.558805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b16fca-7b19-412b-a0cf-7c9fd020077e tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:22.333238 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-17b16fca-7b19-412b-a0cf-7c9fd020077e tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1630 microversion: 2.1 time: 0.804873 Sep 10 10:40:22.338419 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 783/1289] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:21 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1630 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:22.343446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63126bbe-64d8-4921-8d39-892db22ebcff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:22.351297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63126bbe-64d8-4921-8d39-892db22ebcff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:22.363966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63126bbe-64d8-4921-8d39-892db22ebcff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:40:22.380937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.servers [None req-63126bbe-64d8-4921-8d39-892db22ebcff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Flavor 'non_existing_flavor' could not be found {{(pid=128788) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 10 10:40:22.382374 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63126bbe-64d8-4921-8d39-892db22ebcff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.042607 Sep 10 10:40:22.384863 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 784/1290] 10.222.0.20 () {58 vars in 1178 bytes} [Sat Sep 10 10:40:22 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:22.392890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:22.416323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:22.437788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:22.453370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:22.454003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:22.454872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:22.455353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:22.455806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:22.582808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:22.605203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:22.608116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:22.609482 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b3b41c66-9078-4972-a0dc-0ebd2ac56643 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1334 microversion: 2.57 time: 0.223454 Sep 10 10:40:22.610535 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 785/1291] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:22 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1334 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:22.615640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-20df533f-82c5-4204-bd79-4b63250f4f41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Action: 'create', calling method: .version_select at 0x7efcae65e5e0>, body: {"keypair": {"name": "tempest-keypair-800861784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExznTXA1LMmn69zYEgLc8efcMaugYMnWaYjZDrBa1GPKF5kKrOxRf8r780LZnSesHIDcx73gg/zymvM4Q1ddtuJsGnqRcK3CG0pN/iG8nP0+eQIB7O+6QHkuJZt46jdaA=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:22.636663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-20df533f-82c5-4204-bd79-4b63250f4f41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Getting quotas for project bb350b19a7254f0bbffb6e5b8dc2bbe3. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:22.645047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-20df533f-82c5-4204-bd79-4b63250f4f41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Getting quotas for user a1013c609b044cb781dd1691909db7bf and project bb350b19a7254f0bbffb6e5b8dc2bbe3. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:22.675900 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-20df533f-82c5-4204-bd79-4b63250f4f41 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064114 Sep 10 10:40:22.676463 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 786/1292] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:40:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:22.690256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f95876c-c259-49c2-84c2-ab0413e5308f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:22.701982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f95876c-c259-49c2-84c2-ab0413e5308f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:22.703485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f95876c-c259-49c2-84c2-ab0413e5308f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:40:22.712228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f95876c-c259-49c2-84c2-ab0413e5308f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:22.713037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f95876c-c259-49c2-84c2-ab0413e5308f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:22.713898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f95876c-c259-49c2-84c2-ab0413e5308f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:22.715548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f95876c-c259-49c2-84c2-ab0413e5308f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:22.716991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f95876c-c259-49c2-84c2-ab0413e5308f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:22.717788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f95876c-c259-49c2-84c2-ab0413e5308f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:22.956141 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f95876c-c259-49c2-84c2-ab0413e5308f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.278271 Sep 10 10:40:22.961401 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 787/1293] 10.222.0.20 () {58 vars in 1174 bytes} [Sat Sep 10 10:40:22 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:22.970898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-98033bb0-3d3e-4004-b2cb-ba7c90a9aae7 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:22.984318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-98033bb0-3d3e-4004-b2cb-ba7c90a9aae7 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:22.986046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-98033bb0-3d3e-4004-b2cb-ba7c90a9aae7 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:40:23.004244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98033bb0-3d3e-4004-b2cb-ba7c90a9aae7 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:23.009203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98033bb0-3d3e-4004-b2cb-ba7c90a9aae7 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:23.009903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98033bb0-3d3e-4004-b2cb-ba7c90a9aae7 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:23.010859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98033bb0-3d3e-4004-b2cb-ba7c90a9aae7 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:23.011514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98033bb0-3d3e-4004-b2cb-ba7c90a9aae7 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:23.013591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98033bb0-3d3e-4004-b2cb-ba7c90a9aae7 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:23.171059 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-98033bb0-3d3e-4004-b2cb-ba7c90a9aae7 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.204568 Sep 10 10:40:23.172162 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 788/1294] 10.222.0.20 () {58 vars in 1184 bytes} [Sat Sep 10 10:40:22 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 10:40:23.186196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:23.193938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:23.194953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Searching by: {'deleted': False, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:40:23.201483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:23.202826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:23.203454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:23.204543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:23.205319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:23.206396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:23.335433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:40:23.424921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:23.435945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:23.436927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:23.437719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:23.842166 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-232db9ec-942e-4651-9533-abcd4c6e01ba tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.660174 Sep 10 10:40:23.857882 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 789/1295] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:40:23 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:40:23.877004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:23.878006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:23.888453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:23.889417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:23.890019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:23.890898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:23.893239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:23.893907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:24.052338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:24.065451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:24.070644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:24.072358 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ecb46dc5-5fc6-46cb-9821-95cdc830cdf6 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1355 microversion: 2.57 time: 0.213352 Sep 10 10:40:24.077796 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 790/1296] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:23 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1355 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:24.095212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05c512d2-abd8-412d-85e0-b7d0a267dec5 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:24.102222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05c512d2-abd8-412d-85e0-b7d0a267dec5 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:24.103872 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05c512d2-abd8-412d-85e0-b7d0a267dec5 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.024667 Sep 10 10:40:24.104707 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 791/1297] 10.222.0.20 () {58 vars in 1178 bytes} [Sat Sep 10 10:40:24 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:40:24.111772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:24.117772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:24.132858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:24.137046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:24.145822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:24.146730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:24.147386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:24.149473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:24.316827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:40:24.317282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:40:24.317762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:40:24.319209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:40:24.319628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:40:24.379663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:24.469524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:24.487626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:24.490111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:24.491035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:24.492755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:24.494863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:24.497180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:24.594837 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1cbf6c5-2a73-49e9-88e7-9753fab55cd4 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "POST /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4/action" status: 202 len: 1136 microversion: 2.57 time: 0.486305 Sep 10 10:40:24.596540 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 792/1298] 10.222.0.20 () {62 vars in 1320 bytes} [Sat Sep 10 10:40:24 2022] POST /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4/action => generated 1136 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 10:40:24.604893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:24.642191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:24.664238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Searching by: {'deleted': False, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:40:24.692869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:24.696206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:24.699484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:24.703023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:24.704942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:24.714126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:24.828077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:40:24.940882 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-700d1d5c-a946-4992-97ff-8cd0ffe29a3f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.342952 Sep 10 10:40:24.950552 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 793/1299] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 10:40:24 2022] GET /compute/v2.1/servers => generated 681 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:24.966475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:24.972843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:24.986648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:24.989136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:24.994270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:24.995854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:24.996679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:25.001615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:25.223769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:25.237578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:25.258216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:25.266536 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b969e3b1-d502-4eb2-abd7-990c2845e9b0 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1364 microversion: 2.57 time: 0.307449 Sep 10 10:40:25.266536 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 794/1300] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:24 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:25.274655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c8e6322-de22-4ab2-8264-1568c225a7ff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:25.275162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c8e6322-de22-4ab2-8264-1568c225a7ff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: e84e3fbc-9d8c-4029-874c-34eec1bba0c0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:25.299391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8e6322-de22-4ab2-8264-1568c225a7ff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:25.300810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8e6322-de22-4ab2-8264-1568c225a7ff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:25.304465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8e6322-de22-4ab2-8264-1568c225a7ff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:25.305348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8e6322-de22-4ab2-8264-1568c225a7ff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:25.305940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8e6322-de22-4ab2-8264-1568c225a7ff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:25.306429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c8e6322-de22-4ab2-8264-1568c225a7ff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:25.384997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c8e6322-de22-4ab2-8264-1568c225a7ff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: e84e3fbc-9d8c-4029-874c-34eec1bba0c0] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:40:25.604485 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c8e6322-de22-4ab2-8264-1568c225a7ff tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0" status: 204 len: 0 microversion: 2.1 time: 0.337628 Sep 10 10:40:25.605172 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 795/1301] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:40:25 2022] DELETE /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:40:25.619517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bdcf7dab-83b8-4c29-9f50-bb7fcf0bf378 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:25.621501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bdcf7dab-83b8-4c29-9f50-bb7fcf0bf378 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 307ad6bd-3be6-49e5-b902-dcb017a25d22] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:25.657194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdcf7dab-83b8-4c29-9f50-bb7fcf0bf378 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:25.658836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdcf7dab-83b8-4c29-9f50-bb7fcf0bf378 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:25.659288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdcf7dab-83b8-4c29-9f50-bb7fcf0bf378 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:25.665760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdcf7dab-83b8-4c29-9f50-bb7fcf0bf378 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:25.667194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdcf7dab-83b8-4c29-9f50-bb7fcf0bf378 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:25.669099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdcf7dab-83b8-4c29-9f50-bb7fcf0bf378 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:25.764065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bdcf7dab-83b8-4c29-9f50-bb7fcf0bf378 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 307ad6bd-3be6-49e5-b902-dcb017a25d22] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:40:25.954129 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bdcf7dab-83b8-4c29-9f50-bb7fcf0bf378 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/307ad6bd-3be6-49e5-b902-dcb017a25d22" status: 204 len: 0 microversion: 2.1 time: 0.343634 Sep 10 10:40:25.954741 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 796/1302] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:40:25 2022] DELETE /compute/v2.1/servers/307ad6bd-3be6-49e5-b902-dcb017a25d22 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:40:25.977236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:25.982133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:25.997427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:25.998170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:25.998793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:25.999674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:26.002873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:26.003521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:26.059536 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] HTTP exception thrown: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Request method failure captured: Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 HTTP/1.1 Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlkaMIH9WxjI3dQogKvVOJ0PygWp1d7JHtYNvoiM9PYptQFFB0_rnmcgvQ0svAAZrc7HjlP6IMnGFZFdFfCSRbyvAGYeSBN2JNI3SJcZm8AJlpC_DnIMLbIQtqxfgNRbAiRsVzjOi1egKvMUPD7kWmz-wvT6cYAWg6BzRUxUVU5RYE Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:26.062905 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d9f9ca498dd4db18965e199d7d385f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e1b58fd7016a470b9cc588bc2f7eab7b Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:26.064784 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '17266718-ca01-4a84-b2ee-800852e38df1'} Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:26.065878 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:26.068723 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:26.073858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Returning 404 to user: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:26.075037 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c05f9533-7949-4818-bb01-f8aefddfd170 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 404 len: 111 microversion: 2.1 time: 0.114154 Sep 10 10:40:26.082855 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 797/1303] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:40:25 2022] DELETE /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:40:26.092415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02a279dd-0b53-4082-95fc-ebfcff0e178c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:26.093718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02a279dd-0b53-4082-95fc-ebfcff0e178c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: e84e3fbc-9d8c-4029-874c-34eec1bba0c0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:26.102070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a279dd-0b53-4082-95fc-ebfcff0e178c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:26.103534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a279dd-0b53-4082-95fc-ebfcff0e178c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:26.104229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a279dd-0b53-4082-95fc-ebfcff0e178c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:26.105866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a279dd-0b53-4082-95fc-ebfcff0e178c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:26.109388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a279dd-0b53-4082-95fc-ebfcff0e178c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:26.109866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a279dd-0b53-4082-95fc-ebfcff0e178c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:26.421747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02a279dd-0b53-4082-95fc-ebfcff0e178c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:26.432484 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02a279dd-0b53-4082-95fc-ebfcff0e178c tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0" status: 200 len: 1520 microversion: 2.1 time: 0.347124 Sep 10 10:40:26.433421 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 798/1304] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:26 2022] GET /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0 => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:26.449957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:26.451007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:26.466850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:26.468494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:26.469121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:26.471761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:26.473229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:26.473760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:26.755319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:26.775395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:26.778090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:26.779893 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-34dd69df-ae98-4829-a450-82e87f43f1ec tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1364 microversion: 2.57 time: 0.345085 Sep 10 10:40:26.781016 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 799/1305] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:26 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:27.471940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0350119d-9d13-49df-ab51-6ecd33f63381 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:27.472561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0350119d-9d13-49df-ab51-6ecd33f63381 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: e84e3fbc-9d8c-4029-874c-34eec1bba0c0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:27.487396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0350119d-9d13-49df-ab51-6ecd33f63381 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:27.489039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0350119d-9d13-49df-ab51-6ecd33f63381 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:27.491977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0350119d-9d13-49df-ab51-6ecd33f63381 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:27.492996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0350119d-9d13-49df-ab51-6ecd33f63381 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:27.493899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0350119d-9d13-49df-ab51-6ecd33f63381 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:27.495798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0350119d-9d13-49df-ab51-6ecd33f63381 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:28.618798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0350119d-9d13-49df-ab51-6ecd33f63381 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b58fd7016a470b9cc588bc2f7eab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9f9ca498dd4db18965e199d7d385f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:28.655558 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0350119d-9d13-49df-ab51-6ecd33f63381 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0" status: 200 len: 1520 microversion: 2.1 time: 1.193028 Sep 10 10:40:28.656298 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 800/1306] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:27 2022] GET /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0 => generated 1520 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:28.675094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:28.675741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:28.692561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:28.719011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:28.719507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:28.721705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:28.722661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:28.723298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:28.727106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:28.969331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:28.980533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:28.986034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:28.987360 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c2cbfa1-1b79-4935-8285-a24533947ebe tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1364 microversion: 2.57 time: 0.328746 Sep 10 10:40:28.994294 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 801/1307] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:28 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:28.999553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e47be46-3649-48ec-89fe-81a8e13a6722 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae96f8b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:29.070780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e47be46-3649-48ec-89fe-81a8e13a6722 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/3f6a6e8a-21ce-464a-b99d-58a844e5643e" status: 200 len: 662 microversion: 2.1 time: 0.075266 Sep 10 10:40:29.073460 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 802/1308] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:40:28 2022] GET /compute/v2.1/images/3f6a6e8a-21ce-464a-b99d-58a844e5643e => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:29.079846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1644542026", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "739381d7-2276-4bb9-bb8a-d3d8569e8efc"}], "security_groups": [{"name": "tempest-securitygroup--1774462921"}], "key_name": "tempest-keypair-800861784", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:29.427079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] validate_networks() for [('739381d7-2276-4bb9-bb8a-d3d8569e8efc', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:40:30.699829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:40:30.700402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:40:30.700586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:40:30.701011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:40:30.701471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:40:30.723283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=54 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:30.725873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:30.726434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:30.726889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:30.727738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:30.728202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:30.728653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:30.749958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Getting quotas for project bb350b19a7254f0bbffb6e5b8dc2bbe3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:30.758998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Getting quotas for user a1013c609b044cb781dd1691909db7bf and project bb350b19a7254f0bbffb6e5b8dc2bbe3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:30.776631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:40:30.779687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:40:30.877858 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8154d535-d9ba-4f23-9079-798d922e5e70 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.801968 Sep 10 10:40:30.886953 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 803/1309] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:40:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:40:30.892075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10a00a0d-1ff6-48de-a830-3514c6a2c4e5 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae96f310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:31.012451 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10a00a0d-1ff6-48de-a830-3514c6a2c4e5 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/3f6a6e8a-21ce-464a-b99d-58a844e5643e" status: 200 len: 662 microversion: 2.1 time: 0.124130 Sep 10 10:40:31.013170 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 804/1310] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:40:30 2022] GET /compute/v2.1/images/3f6a6e8a-21ce-464a-b99d-58a844e5643e => generated 662 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:31.019505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:31.020502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: e84e3fbc-9d8c-4029-874c-34eec1bba0c0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:31.037813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:31.042628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:31.044463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:31.048730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:31.055389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:31.056206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:31.136188 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] HTTP exception thrown: Instance e84e3fbc-9d8c-4029-874c-34eec1bba0c0 could not be found. Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Request method failure captured: Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0 HTTP/1.1 Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlkaMIH9WxjI3dQogKvVOJ0PygWp1d7JHtYNvoiM9PYptQFFB0_rnmcgvQ0svAAZrc7HjlP6IMnGFZFdFfCSRbyvAGYeSBN2JNI3SJcZm8AJlpC_DnIMLbIQtqxfgNRbAiRsVzjOi1egKvMUPD7kWmz-wvT6cYAWg6BzRUxUVU5RYE Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:31.138323 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d9f9ca498dd4db18965e199d7d385f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e1b58fd7016a470b9cc588bc2f7eab7b Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance e84e3fbc-9d8c-4029-874c-34eec1bba0c0 could not be found. Sep 10 10:40:31.140292 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e84e3fbc-9d8c-4029-874c-34eec1bba0c0'} Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84e3fbc-9d8c-4029-874c-34eec1bba0c0 could not be found. Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:31.141180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84e3fbc-9d8c-4029-874c-34eec1bba0c0 could not be found. Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84e3fbc-9d8c-4029-874c-34eec1bba0c0 could not be found. Sep 10 10:40:31.142582 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:31.144799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Returning 404 to user: Instance e84e3fbc-9d8c-4029-874c-34eec1bba0c0 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:31.144799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a487c27d-7acd-4416-854c-0af16838ba7f tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0" status: 404 len: 111 microversion: 2.1 time: 0.128007 Sep 10 10:40:31.148046 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 805/1311] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:31 2022] GET /compute/v2.1/servers/e84e3fbc-9d8c-4029-874c-34eec1bba0c0 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:40:31.157172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c5e5ef91-2413-461a-a568-1f7368e0f66e req-c83186cd-85bb-4369-bae8-8bb92c953e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307ad6bd-3be6-49e5-b902-dcb017a25d22", "name": "network-vif-deleted", "tag": "6fb73a8e-3c5b-4daa-89a7-daa69937ed66"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:31.206450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c5e5ef91-2413-461a-a568-1f7368e0f66e req-c83186cd-85bb-4369-bae8-8bb92c953e81 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:31.208364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c5e5ef91-2413-461a-a568-1f7368e0f66e req-c83186cd-85bb-4369-bae8-8bb92c953e81 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:31.209738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c5e5ef91-2413-461a-a568-1f7368e0f66e req-c83186cd-85bb-4369-bae8-8bb92c953e81 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:31.245311 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c5e5ef91-2413-461a-a568-1f7368e0f66e req-c83186cd-85bb-4369-bae8-8bb92c953e81 service nova] Creating event network-vif-deleted:6fb73a8e-3c5b-4daa-89a7-daa69937ed66 for instance 307ad6bd-3be6-49e5-b902-dcb017a25d22 on n-h2-856894-1 Sep 10 10:40:31.260082 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c5e5ef91-2413-461a-a568-1f7368e0f66e req-c83186cd-85bb-4369-bae8-8bb92c953e81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110639 Sep 10 10:40:31.261031 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 806/1312] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:31.276688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:31.278906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:31.289242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:31.289934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:31.290689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:31.291706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:31.292336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:31.293006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:31.421424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:31.440702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:31.442082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:31.448194 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a07c7e1d-eda1-443e-aa06-0547d674c129 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1364 microversion: 2.57 time: 0.181044 Sep 10 10:40:31.462393 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 807/1313] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:31 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:31.476399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-894606ed-527c-4949-a49d-a23224ea7075 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:31.477171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-894606ed-527c-4949-a49d-a23224ea7075 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:31.576940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-894606ed-527c-4949-a49d-a23224ea7075 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:31.587439 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-894606ed-527c-4949-a49d-a23224ea7075 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1234 microversion: 2.1 time: 0.123752 Sep 10 10:40:31.588576 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 808/1314] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:31 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1234 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:31.863346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-152741066", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "6949200c-0a45-48d1-a5e5-5e687dfebc1f"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:31.967474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] validate_networks() for [('6949200c-0a45-48d1-a5e5-5e687dfebc1f', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:40:33.288742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:40:33.289490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:40:33.289798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:40:33.290266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:40:33.290748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:40:33.309279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:33.309776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:33.310224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:33.310964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:33.322653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:33.323632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:33.375430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Getting quotas for project 302151fe6dda436ca654252333e7fc7f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:33.384707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Getting quotas for user 75dc4bf3c30b42448e6dbea15579400e and project 302151fe6dda436ca654252333e7fc7f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:33.418724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:40:33.423158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:40:33.544686 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e058a0e2-45e4-4d14-b2d3-32aacb2839e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.954752 Sep 10 10:40:33.562351 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 809/1315] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:40:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:40:33.594034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:33.596648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 307ad6bd-3be6-49e5-b902-dcb017a25d22] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:33.608342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:33.608950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:33.609601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:33.610393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:33.610938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:33.611648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:33.633360 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] HTTP exception thrown: Instance 307ad6bd-3be6-49e5-b902-dcb017a25d22 could not be found. Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Request method failure captured: Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/307ad6bd-3be6-49e5-b902-dcb017a25d22 HTTP/1.1 Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlkaMIH9WxjI3dQogKvVOJ0PygWp1d7JHtYNvoiM9PYptQFFB0_rnmcgvQ0svAAZrc7HjlP6IMnGFZFdFfCSRbyvAGYeSBN2JNI3SJcZm8AJlpC_DnIMLbIQtqxfgNRbAiRsVzjOi1egKvMUPD7kWmz-wvT6cYAWg6BzRUxUVU5RYE Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:33.636300 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d9f9ca498dd4db18965e199d7d385f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e1b58fd7016a470b9cc588bc2f7eab7b Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 307ad6bd-3be6-49e5-b902-dcb017a25d22 could not be found. Sep 10 10:40:33.638165 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '307ad6bd-3be6-49e5-b902-dcb017a25d22'} Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307ad6bd-3be6-49e5-b902-dcb017a25d22 could not be found. Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:33.638969 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307ad6bd-3be6-49e5-b902-dcb017a25d22 could not be found. Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307ad6bd-3be6-49e5-b902-dcb017a25d22 could not be found. Sep 10 10:40:33.640322 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:33.641797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Returning 404 to user: Instance 307ad6bd-3be6-49e5-b902-dcb017a25d22 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:33.641797 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea4b0996-17aa-46b4-be0b-077acf3a060d tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/307ad6bd-3be6-49e5-b902-dcb017a25d22" status: 404 len: 111 microversion: 2.1 time: 0.077407 Sep 10 10:40:33.644833 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 810/1316] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:33 2022] GET /compute/v2.1/servers/307ad6bd-3be6-49e5-b902-dcb017a25d22 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:40:33.652346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:33.652966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:33.678030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:33.678537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:33.681835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:33.692382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:33.693341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:33.694605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:33.736768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:33.901890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:33.912884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:33.914509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:33.915701 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76ef8530-e6ff-4ba6-9a0a-25dd790f473d tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1364 microversion: 2.57 time: 0.269456 Sep 10 10:40:33.916261 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 811/1317] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:33 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:33.924381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4f16f66-329d-4e2e-b641-04d4467dce4c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:33.925097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4f16f66-329d-4e2e-b641-04d4467dce4c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:33.934814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f16f66-329d-4e2e-b641-04d4467dce4c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:33.935305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f16f66-329d-4e2e-b641-04d4467dce4c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:33.935741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f16f66-329d-4e2e-b641-04d4467dce4c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:33.936433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f16f66-329d-4e2e-b641-04d4467dce4c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:33.937066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f16f66-329d-4e2e-b641-04d4467dce4c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:33.944777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f16f66-329d-4e2e-b641-04d4467dce4c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:34.037839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4f16f66-329d-4e2e-b641-04d4467dce4c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:34.045694 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a4f16f66-329d-4e2e-b641-04d4467dce4c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1292 microversion: 2.1 time: 0.128360 Sep 10 10:40:34.057378 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 812/1318] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:33 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1292 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:34.061400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d65f5f00-3c67-4562-b708-5db1b10f82c6 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcaea41ca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:34.156205 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d65f5f00-3c67-4562-b708-5db1b10f82c6 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/ce027d5f-b72a-4f2f-bcd2-7b18ebfa6f4a" status: 200 len: 661 microversion: 2.1 time: 0.103799 Sep 10 10:40:34.160930 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 813/1319] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:40:34 2022] GET /compute/v2.1/images/ce027d5f-b72a-4f2f-bcd2-7b18ebfa6f4a => generated 661 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:34.174982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8bda9e73-ea88-42c9-9ace-b16f6ea3c3dc req-1f0060bc-6a39-467b-957f-d6f0b642d9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84e3fbc-9d8c-4029-874c-34eec1bba0c0", "name": "network-vif-deleted", "tag": "fd3346bd-6041-427a-813c-054af7fcb81b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:34.214049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8bda9e73-ea88-42c9-9ace-b16f6ea3c3dc req-1f0060bc-6a39-467b-957f-d6f0b642d9c5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:34.214544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8bda9e73-ea88-42c9-9ace-b16f6ea3c3dc req-1f0060bc-6a39-467b-957f-d6f0b642d9c5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:34.214973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8bda9e73-ea88-42c9-9ace-b16f6ea3c3dc req-1f0060bc-6a39-467b-957f-d6f0b642d9c5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:34.267859 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8bda9e73-ea88-42c9-9ace-b16f6ea3c3dc req-1f0060bc-6a39-467b-957f-d6f0b642d9c5 service nova] Creating event network-vif-deleted:fd3346bd-6041-427a-813c-054af7fcb81b for instance e84e3fbc-9d8c-4029-874c-34eec1bba0c0 on n-h1-856894-1 Sep 10 10:40:34.281401 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8bda9e73-ea88-42c9-9ace-b16f6ea3c3dc req-1f0060bc-6a39-467b-957f-d6f0b642d9c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118191 Sep 10 10:40:34.283480 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 814/1320] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:34.305927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6de3215-e1b5-431a-a583-223ea295a7b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:34.311414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c6de3215-e1b5-431a-a583-223ea295a7b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:34.526166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c6de3215-e1b5-431a-a583-223ea295a7b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:34.539513 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c6de3215-e1b5-431a-a583-223ea295a7b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 200 len: 1207 microversion: 2.1 time: 0.254079 Sep 10 10:40:34.543416 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 815/1321] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:34 2022] GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 1207 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:34.559685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:34.565939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] [instance: 17266718-ca01-4a84-b2ee-800852e38df1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:34.584347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:34.587987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:34.589879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:34.592401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:34.594719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:34.595636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:34.639564 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] HTTP exception thrown: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Request method failure captured: Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 HTTP/1.1 Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlkaMIH9WxjI3dQogKvVOJ0PygWp1d7JHtYNvoiM9PYptQFFB0_rnmcgvQ0svAAZrc7HjlP6IMnGFZFdFfCSRbyvAGYeSBN2JNI3SJcZm8AJlpC_DnIMLbIQtqxfgNRbAiRsVzjOi1egKvMUPD7kWmz-wvT6cYAWg6BzRUxUVU5RYE Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:34.641572 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d9f9ca498dd4db18965e199d7d385f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d9f9ca498dd4db18965e199d7d385f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9d9f9ca498dd4db18965e199d7d385f3 Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767080926 Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e1b58fd7016a470b9cc588bc2f7eab7b Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServersNegativeTestJSON-767080926-project Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:34.643384 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '17266718-ca01-4a84-b2ee-800852e38df1'} Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:34.644351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. Sep 10 10:40:34.646556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:34.651136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] Returning 404 to user: Instance 17266718-ca01-4a84-b2ee-800852e38df1 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:34.652227 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-586d8e24-6f83-4837-aa8b-a2410f67f3f0 tempest-ListServersNegativeTestJSON-767080926 tempest-ListServersNegativeTestJSON-767080926-project] 10.222.0.20 "GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1" status: 404 len: 111 microversion: 2.1 time: 0.104678 Sep 10 10:40:34.655937 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 816/1322] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:34 2022] GET /compute/v2.1/servers/17266718-ca01-4a84-b2ee-800852e38df1 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:40:34.673864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-585899166", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "b6b75eb3-e7cb-4aab-bcda-975724c5e7f6"}, {"uuid": "0bcd9cb7-5ccc-45cb-a607-aba89d20a688"}, {"uuid": "b6b75eb3-e7cb-4aab-bcda-975724c5e7f6"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:34.800079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] validate_networks() for [('b6b75eb3-e7cb-4aab-bcda-975724c5e7f6', None, None, None, None, None), ('0bcd9cb7-5ccc-45cb-a607-aba89d20a688', None, None, None, None, None), ('b6b75eb3-e7cb-4aab-bcda-975724c5e7f6', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:40:38.763526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:40:38.765594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:40:38.766466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:40:38.767043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:40:38.768348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:40:38.789932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:38.790829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:38.791454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:38.792372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:38.793420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:38.794039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:38.827902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Getting quotas for project ebcf75baac6d4be481406daf0dd81e1a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:38.837450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Getting quotas for user 47ee461c12bb4fae9792abbc067a71fa and project ebcf75baac6d4be481406daf0dd81e1a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:38.858478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:40:38.863809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:40:38.971461 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe77c53c-2691-49ac-b166-ab3efd5a207d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.314046 Sep 10 10:40:38.979089 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 817/1323] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:40:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:40:38.991034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ce46611d-00e0-49d3-b1db-cdae40298da7 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae934550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:39.080548 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ce46611d-00e0-49d3-b1db-cdae40298da7 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/ce027d5f-b72a-4f2f-bcd2-7b18ebfa6f4a" status: 200 len: 661 microversion: 2.1 time: 0.099395 Sep 10 10:40:39.081934 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 818/1324] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:40:38 2022] GET /compute/v2.1/images/ce027d5f-b72a-4f2f-bcd2-7b18ebfa6f4a => generated 661 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:39.089033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:39.090158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:39.149700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:39.150425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:39.150998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:39.151950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:39.157043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:39.160396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:39.400204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:39.422938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:39.436399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:39.437933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4645de0-32cc-437e-861a-4a390290bad2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1364 microversion: 2.57 time: 0.353605 Sep 10 10:40:39.453576 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 819/1325] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:39 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1364 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:39.464799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a940d75-57b4-4f38-b063-025fdda3995d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:39.465745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a940d75-57b4-4f38-b063-025fdda3995d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:39.472513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a940d75-57b4-4f38-b063-025fdda3995d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:39.473106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a940d75-57b4-4f38-b063-025fdda3995d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:39.473808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a940d75-57b4-4f38-b063-025fdda3995d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:39.474597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a940d75-57b4-4f38-b063-025fdda3995d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:39.475063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a940d75-57b4-4f38-b063-025fdda3995d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:39.475496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a940d75-57b4-4f38-b063-025fdda3995d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:39.841737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a940d75-57b4-4f38-b063-025fdda3995d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:39.850418 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a940d75-57b4-4f38-b063-025fdda3995d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1360 microversion: 2.1 time: 0.395573 Sep 10 10:40:39.851347 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 820/1326] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:39 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1360 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:39.856184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a247083-e607-4a67-b4dd-f8350c8bf2d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:39.857101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a247083-e607-4a67-b4dd-f8350c8bf2d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:39.863279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a247083-e607-4a67-b4dd-f8350c8bf2d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:39.864210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a247083-e607-4a67-b4dd-f8350c8bf2d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:39.864802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a247083-e607-4a67-b4dd-f8350c8bf2d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:39.865934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a247083-e607-4a67-b4dd-f8350c8bf2d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:39.866697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a247083-e607-4a67-b4dd-f8350c8bf2d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:39.867384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a247083-e607-4a67-b4dd-f8350c8bf2d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:40.815435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a247083-e607-4a67-b4dd-f8350c8bf2d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:40.826006 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a247083-e607-4a67-b4dd-f8350c8bf2d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 200 len: 1307 microversion: 2.1 time: 0.973372 Sep 10 10:40:40.837592 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 821/1327] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:39 2022] GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 1307 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:40.848655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-47493e03-58c8-4892-a756-6a585867e227 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:40.850815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47493e03-58c8-4892-a756-6a585867e227 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:40.859067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47493e03-58c8-4892-a756-6a585867e227 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:40.859944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47493e03-58c8-4892-a756-6a585867e227 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:40.860621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47493e03-58c8-4892-a756-6a585867e227 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:40.861617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47493e03-58c8-4892-a756-6a585867e227 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:40.862311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47493e03-58c8-4892-a756-6a585867e227 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:40.862821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47493e03-58c8-4892-a756-6a585867e227 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:40.999097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-47493e03-58c8-4892-a756-6a585867e227 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:41.020091 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-47493e03-58c8-4892-a756-6a585867e227 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1270 microversion: 2.1 time: 0.180975 Sep 10 10:40:41.020699 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 822/1328] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:40 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:41.028180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b56ca212-e362-4255-9e67-a8e7cb5dc28e req-e78b867e-ec1f-4ec9-a610-d316b601dabf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5815be-a9f4-4a13-846f-d2f2d7384e00", "tag": "bb2be5dc-a2e7-4447-9939-ef537449e050"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:41.046524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b56ca212-e362-4255-9e67-a8e7cb5dc28e req-e78b867e-ec1f-4ec9-a610-d316b601dabf service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:41.047749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b56ca212-e362-4255-9e67-a8e7cb5dc28e req-e78b867e-ec1f-4ec9-a610-d316b601dabf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:41.048516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b56ca212-e362-4255-9e67-a8e7cb5dc28e req-e78b867e-ec1f-4ec9-a610-d316b601dabf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:41.061935 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b56ca212-e362-4255-9e67-a8e7cb5dc28e req-e78b867e-ec1f-4ec9-a610-d316b601dabf service nova] Creating event network-changed:bb2be5dc-a2e7-4447-9939-ef537449e050 for instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 on n-h1-856894-1 Sep 10 10:40:41.068951 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b56ca212-e362-4255-9e67-a8e7cb5dc28e req-e78b867e-ec1f-4ec9-a610-d316b601dabf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046151 Sep 10 10:40:41.070219 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 823/1329] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:41.075769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:41.077551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:41.084403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:41.085999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:41.086525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:41.088023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:41.088851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:41.089341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:41.204595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:41.214593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:41.217354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:41.218911 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d01219c7-f8f9-4349-a3e8-82b44b0504b2 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1364 microversion: 2.57 time: 0.147349 Sep 10 10:40:41.219501 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 824/1330] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:41 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:41.228237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73cf1431-63d6-4f73-9553-00e88ac2c6b3 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae96f430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:41.280579 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73cf1431-63d6-4f73-9553-00e88ac2c6b3 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/6aaa9c9a-6c6f-4304-a123-43f5b3e01bce" status: 200 len: 661 microversion: 2.1 time: 0.058708 Sep 10 10:40:41.281222 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 825/1331] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:40:41 2022] GET /compute/v2.1/images/6aaa9c9a-6c6f-4304-a123-43f5b3e01bce => generated 661 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:41.288553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07c165f8-9fa2-4a5e-9ffe-6aeeeeee3f35 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:41.289831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07c165f8-9fa2-4a5e-9ffe-6aeeeeee3f35 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:41.297675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07c165f8-9fa2-4a5e-9ffe-6aeeeeee3f35 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:41.298564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07c165f8-9fa2-4a5e-9ffe-6aeeeeee3f35 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:41.299609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07c165f8-9fa2-4a5e-9ffe-6aeeeeee3f35 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:41.300656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07c165f8-9fa2-4a5e-9ffe-6aeeeeee3f35 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:41.301426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07c165f8-9fa2-4a5e-9ffe-6aeeeeee3f35 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:41.302048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07c165f8-9fa2-4a5e-9ffe-6aeeeeee3f35 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:41.662268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-07c165f8-9fa2-4a5e-9ffe-6aeeeeee3f35 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:41.697531 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07c165f8-9fa2-4a5e-9ffe-6aeeeeee3f35 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1360 microversion: 2.1 time: 0.412763 Sep 10 10:40:41.710484 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 826/1332] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:41 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1360 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:41.710484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b6b8f48-a7b6-4804-8d3e-0105d6029bbc tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae8f8820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:41.808249 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b6b8f48-a7b6-4804-8d3e-0105d6029bbc tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/6aaa9c9a-6c6f-4304-a123-43f5b3e01bce" status: 200 len: 661 microversion: 2.1 time: 0.108083 Sep 10 10:40:41.830937 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 827/1333] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:40:41 2022] GET /compute/v2.1/images/6aaa9c9a-6c6f-4304-a123-43f5b3e01bce => generated 661 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:41.856457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62af3e9b-5f59-4f5a-9e47-929be6ce8855 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:41.857289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62af3e9b-5f59-4f5a-9e47-929be6ce8855 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:41.868105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62af3e9b-5f59-4f5a-9e47-929be6ce8855 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:41.868598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62af3e9b-5f59-4f5a-9e47-929be6ce8855 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:41.869037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62af3e9b-5f59-4f5a-9e47-929be6ce8855 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:41.870474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62af3e9b-5f59-4f5a-9e47-929be6ce8855 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:41.872769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62af3e9b-5f59-4f5a-9e47-929be6ce8855 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:41.874161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62af3e9b-5f59-4f5a-9e47-929be6ce8855 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:42.422317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62af3e9b-5f59-4f5a-9e47-929be6ce8855 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:42.430602 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62af3e9b-5f59-4f5a-9e47-929be6ce8855 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 200 len: 1307 microversion: 2.1 time: 0.578577 Sep 10 10:40:42.433451 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 828/1334] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:41 2022] GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 1307 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:42.446215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-487778592", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:42.553877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:40:43.530774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:40:43.531343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:40:43.531786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:40:43.532044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:40:43.532531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:40:43.554011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:43.555624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:43.556248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:43.557298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:43.557997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:43.558682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:43.568785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=23 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:43.583600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Getting quotas for project 0a13d3e6b7ed498da4fbde463f57214a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:43.590723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Getting quotas for user 3d8273421e8a4b74be0d3f6621a05f0a and project 0a13d3e6b7ed498da4fbde463f57214a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:43.595135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:43.630483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:40:43.633463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:40:43.740548 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26c8c014-f5f5-4ab1-a9e5-89e8904ad9ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302693 Sep 10 10:40:43.742950 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 829/1335] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:40:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:40:43.748141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-200783b1-74f1-4a05-a99b-6c60405ad850 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:43.748771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-200783b1-74f1-4a05-a99b-6c60405ad850 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:43.757400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200783b1-74f1-4a05-a99b-6c60405ad850 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:43.758365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200783b1-74f1-4a05-a99b-6c60405ad850 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:43.758964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200783b1-74f1-4a05-a99b-6c60405ad850 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:43.759998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200783b1-74f1-4a05-a99b-6c60405ad850 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:43.760790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200783b1-74f1-4a05-a99b-6c60405ad850 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:43.762567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200783b1-74f1-4a05-a99b-6c60405ad850 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:44.680462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-200783b1-74f1-4a05-a99b-6c60405ad850 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:44.689864 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-200783b1-74f1-4a05-a99b-6c60405ad850 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1312 microversion: 2.1 time: 0.945586 Sep 10 10:40:44.690463 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 830/1336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:43 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1312 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:44.714259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:44.716291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:44.724397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:44.725099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:44.725694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:44.726781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:44.727298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:44.727782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:44.851850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:44.863852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:44.865978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:44.869678 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e0b41e1-fb7b-4ceb-8d33-b907a029ce6c tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1364 microversion: 2.57 time: 0.165966 Sep 10 10:40:44.869678 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 831/1337] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:44 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:44.876782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b26c6b09-f91a-474d-9fc8-bdbb15f5b3b7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:44.885030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b26c6b09-f91a-474d-9fc8-bdbb15f5b3b7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:44.894409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b26c6b09-f91a-474d-9fc8-bdbb15f5b3b7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:44.894935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b26c6b09-f91a-474d-9fc8-bdbb15f5b3b7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:44.895926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b26c6b09-f91a-474d-9fc8-bdbb15f5b3b7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:44.896890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b26c6b09-f91a-474d-9fc8-bdbb15f5b3b7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:44.897788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b26c6b09-f91a-474d-9fc8-bdbb15f5b3b7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:44.898445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b26c6b09-f91a-474d-9fc8-bdbb15f5b3b7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:45.164028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b26c6b09-f91a-474d-9fc8-bdbb15f5b3b7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:45.178701 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b26c6b09-f91a-474d-9fc8-bdbb15f5b3b7 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1360 microversion: 2.1 time: 0.308747 Sep 10 10:40:45.179879 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 832/1338] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:44 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1360 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:45.198234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-62e28654-fb48-4cdc-9d94-c0d9ad98960d req-767496e0-5af1-41f6-8777-c02998e4018a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "115a3202-4538-4932-bc5c-155415678a28", "tag": "82fc5252-bf77-4de0-9696-26c9a450c003"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:45.211962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-62e28654-fb48-4cdc-9d94-c0d9ad98960d req-767496e0-5af1-41f6-8777-c02998e4018a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:45.212793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-62e28654-fb48-4cdc-9d94-c0d9ad98960d req-767496e0-5af1-41f6-8777-c02998e4018a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:45.213537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-62e28654-fb48-4cdc-9d94-c0d9ad98960d req-767496e0-5af1-41f6-8777-c02998e4018a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:45.234013 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-62e28654-fb48-4cdc-9d94-c0d9ad98960d req-767496e0-5af1-41f6-8777-c02998e4018a service nova] Creating event network-changed:82fc5252-bf77-4de0-9696-26c9a450c003 for instance 115a3202-4538-4932-bc5c-155415678a28 on n-h1-856894-1 Sep 10 10:40:45.240668 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-62e28654-fb48-4cdc-9d94-c0d9ad98960d req-767496e0-5af1-41f6-8777-c02998e4018a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058827 Sep 10 10:40:45.241656 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 833/1339] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:45.247195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73dc3f84-be8b-4fea-bc71-44cd12cd1260 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:45.247869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73dc3f84-be8b-4fea-bc71-44cd12cd1260 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:45.255887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73dc3f84-be8b-4fea-bc71-44cd12cd1260 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:45.257170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73dc3f84-be8b-4fea-bc71-44cd12cd1260 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:45.257790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73dc3f84-be8b-4fea-bc71-44cd12cd1260 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:45.259572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73dc3f84-be8b-4fea-bc71-44cd12cd1260 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:45.260195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73dc3f84-be8b-4fea-bc71-44cd12cd1260 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:45.260785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73dc3f84-be8b-4fea-bc71-44cd12cd1260 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:45.555091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73dc3f84-be8b-4fea-bc71-44cd12cd1260 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:45.565961 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73dc3f84-be8b-4fea-bc71-44cd12cd1260 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 200 len: 1307 microversion: 2.1 time: 0.322878 Sep 10 10:40:45.581702 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 834/1340] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:45 2022] GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:45.589967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1206910790", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:45.680884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:40:46.584539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:40:46.585365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:40:46.586063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:40:46.586689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:40:46.587344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:40:46.602342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:46.603030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:46.603629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:46.604639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:46.605311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:46.605927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:46.629780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Getting quotas for project 0a13d3e6b7ed498da4fbde463f57214a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:46.638223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Getting quotas for user 3d8273421e8a4b74be0d3f6621a05f0a and project 0a13d3e6b7ed498da4fbde463f57214a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:46.657838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:40:46.661749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:40:46.752713 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7fbaea3a-d051-4aa2-9b65-f36eb8c3fb2b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169637 Sep 10 10:40:46.754511 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 835/1341] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:40:46.765789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43112d53-7584-4774-bb11-ee27df6d1d95 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:46.766721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-43112d53-7584-4774-bb11-ee27df6d1d95 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:46.780588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43112d53-7584-4774-bb11-ee27df6d1d95 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:46.781472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43112d53-7584-4774-bb11-ee27df6d1d95 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:46.782084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43112d53-7584-4774-bb11-ee27df6d1d95 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:46.783144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43112d53-7584-4774-bb11-ee27df6d1d95 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:46.783865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43112d53-7584-4774-bb11-ee27df6d1d95 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:46.784472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43112d53-7584-4774-bb11-ee27df6d1d95 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:48.383785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-43112d53-7584-4774-bb11-ee27df6d1d95 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:48.399599 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43112d53-7584-4774-bb11-ee27df6d1d95 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1333 microversion: 2.1 time: 1.643016 Sep 10 10:40:48.407186 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 836/1342] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:46 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1333 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:48.422587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:48.423231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:48.440136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:48.441367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:48.441836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:48.442686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:48.443157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:48.443594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:48.840340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:48.853815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:48.860079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:48.862066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:48.866590 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79cc550c-04c7-4366-9cea-244f9b5328ef tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1364 microversion: 2.57 time: 0.458055 Sep 10 10:40:48.867470 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 837/1343] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:48 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1364 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:48.882094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-27f7ce89-d571-4475-b858-cc1548297388 req-d5554d89-019e-472e-8eb7-64793aa7d994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5815be-a9f4-4a13-846f-d2f2d7384e00", "name": "network-vif-plugged", "status": "completed", "tag": "bb2be5dc-a2e7-4447-9939-ef537449e050"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:48.918924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-27f7ce89-d571-4475-b858-cc1548297388 req-d5554d89-019e-472e-8eb7-64793aa7d994 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:48.919410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-27f7ce89-d571-4475-b858-cc1548297388 req-d5554d89-019e-472e-8eb7-64793aa7d994 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:48.921829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-27f7ce89-d571-4475-b858-cc1548297388 req-d5554d89-019e-472e-8eb7-64793aa7d994 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:48.959838 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-27f7ce89-d571-4475-b858-cc1548297388 req-d5554d89-019e-472e-8eb7-64793aa7d994 service nova] Creating event network-vif-plugged:bb2be5dc-a2e7-4447-9939-ef537449e050 for instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 on n-h1-856894-1 Sep 10 10:40:48.967649 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-27f7ce89-d571-4475-b858-cc1548297388 req-d5554d89-019e-472e-8eb7-64793aa7d994 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093400 Sep 10 10:40:48.973961 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 838/1344] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:48.980553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a9589714-4440-4274-9dc9-b67b2aa0347e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:48.981992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a9589714-4440-4274-9dc9-b67b2aa0347e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:48.989370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9589714-4440-4274-9dc9-b67b2aa0347e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:48.990242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9589714-4440-4274-9dc9-b67b2aa0347e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:48.990699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9589714-4440-4274-9dc9-b67b2aa0347e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:48.991443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9589714-4440-4274-9dc9-b67b2aa0347e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:48.991883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9589714-4440-4274-9dc9-b67b2aa0347e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:48.992379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9589714-4440-4274-9dc9-b67b2aa0347e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:49.792450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a9589714-4440-4274-9dc9-b67b2aa0347e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:49.811851 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a9589714-4440-4274-9dc9-b67b2aa0347e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1360 microversion: 2.1 time: 0.836406 Sep 10 10:40:49.816365 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 839/1345] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:48 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1360 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:49.841881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c7087c7a-e716-42ec-a080-128e5c8e8594 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:49.845844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c7087c7a-e716-42ec-a080-128e5c8e8594 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:49.881970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7087c7a-e716-42ec-a080-128e5c8e8594 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:49.890560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7087c7a-e716-42ec-a080-128e5c8e8594 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:49.891437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7087c7a-e716-42ec-a080-128e5c8e8594 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:49.896382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7087c7a-e716-42ec-a080-128e5c8e8594 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:49.897133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7087c7a-e716-42ec-a080-128e5c8e8594 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:49.897820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7087c7a-e716-42ec-a080-128e5c8e8594 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:50.871157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c7087c7a-e716-42ec-a080-128e5c8e8594 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:50.900535 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c7087c7a-e716-42ec-a080-128e5c8e8594 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 200 len: 1307 microversion: 2.1 time: 1.056741 Sep 10 10:40:50.916826 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 840/1346] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:49 2022] GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 1307 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:50.917589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7eda65d0-9211-4949-8e44-0e2121946ed2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:50.920247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7eda65d0-9211-4949-8e44-0e2121946ed2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:50.935792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7eda65d0-9211-4949-8e44-0e2121946ed2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:50.938503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7eda65d0-9211-4949-8e44-0e2121946ed2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:50.939274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7eda65d0-9211-4949-8e44-0e2121946ed2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:50.945172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7eda65d0-9211-4949-8e44-0e2121946ed2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:50.945873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7eda65d0-9211-4949-8e44-0e2121946ed2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:50.946767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7eda65d0-9211-4949-8e44-0e2121946ed2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:51.179193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7eda65d0-9211-4949-8e44-0e2121946ed2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:51.189026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7eda65d0-9211-4949-8e44-0e2121946ed2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 1276 microversion: 2.1 time: 0.286691 Sep 10 10:40:51.195737 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 841/1347] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:50 2022] GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 1276 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:51.214093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb21bc10-56c8-416e-ad9c-2be190f5c347 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:51.215839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bb21bc10-56c8-416e-ad9c-2be190f5c347 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:51.222859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb21bc10-56c8-416e-ad9c-2be190f5c347 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:51.223720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb21bc10-56c8-416e-ad9c-2be190f5c347 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:51.224954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb21bc10-56c8-416e-ad9c-2be190f5c347 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:51.226312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb21bc10-56c8-416e-ad9c-2be190f5c347 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:51.227060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb21bc10-56c8-416e-ad9c-2be190f5c347 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:51.227962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb21bc10-56c8-416e-ad9c-2be190f5c347 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:51.730604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bb21bc10-56c8-416e-ad9c-2be190f5c347 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:51.745502 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb21bc10-56c8-416e-ad9c-2be190f5c347 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1354 microversion: 2.1 time: 0.547297 Sep 10 10:40:51.746433 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 842/1348] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:51 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1354 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:51.766779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:51.767419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:51.776641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:51.778175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:51.778642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:51.781864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:51.782492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:51.783874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:51.933145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:51.947995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:51.949596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:51.955690 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a2e71679-594e-4521-b185-f84ffc2ca9cd tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1364 microversion: 2.57 time: 0.205834 Sep 10 10:40:51.956683 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 843/1349] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:51 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:51.961405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb31b41f-3162-455b-8745-a94538b1737b tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:51.961905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb31b41f-3162-455b-8745-a94538b1737b tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:51.978221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb31b41f-3162-455b-8745-a94538b1737b tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:51.990461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb31b41f-3162-455b-8745-a94538b1737b tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:51.990925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb31b41f-3162-455b-8745-a94538b1737b tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:51.991725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb31b41f-3162-455b-8745-a94538b1737b tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:51.992125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb31b41f-3162-455b-8745-a94538b1737b tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:51.992554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb31b41f-3162-455b-8745-a94538b1737b tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:52.037356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb31b41f-3162-455b-8745-a94538b1737b tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:40:52.162749 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb31b41f-3162-455b-8745-a94538b1737b tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e" status: 204 len: 0 microversion: 2.1 time: 0.204647 Sep 10 10:40:52.163985 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 844/1350] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:40:51 2022] DELETE /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:40:52.172187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c80114c-e390-40d6-9231-5ab1c8834f73 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:52.172916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4c80114c-e390-40d6-9231-5ab1c8834f73 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:52.193666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c80114c-e390-40d6-9231-5ab1c8834f73 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:52.193905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c80114c-e390-40d6-9231-5ab1c8834f73 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:52.194537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c80114c-e390-40d6-9231-5ab1c8834f73 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:52.195445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c80114c-e390-40d6-9231-5ab1c8834f73 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:52.196077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c80114c-e390-40d6-9231-5ab1c8834f73 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:52.196701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c80114c-e390-40d6-9231-5ab1c8834f73 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:52.727221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4c80114c-e390-40d6-9231-5ab1c8834f73 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:52.744200 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c80114c-e390-40d6-9231-5ab1c8834f73 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1543 microversion: 2.1 time: 0.578372 Sep 10 10:40:52.745346 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 845/1351] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:52 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1543 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:52.751663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-cda422d2-9dc6-43ca-b01e-b018f7b533e4 req-705dfc7b-af6e-4c28-8341-c0637879aa7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115a3202-4538-4932-bc5c-155415678a28", "name": "network-vif-plugged", "status": "completed", "tag": "82fc5252-bf77-4de0-9696-26c9a450c003"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:52.765524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cda422d2-9dc6-43ca-b01e-b018f7b533e4 req-705dfc7b-af6e-4c28-8341-c0637879aa7e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:52.766531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cda422d2-9dc6-43ca-b01e-b018f7b533e4 req-705dfc7b-af6e-4c28-8341-c0637879aa7e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:52.768385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cda422d2-9dc6-43ca-b01e-b018f7b533e4 req-705dfc7b-af6e-4c28-8341-c0637879aa7e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:52.794831 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-cda422d2-9dc6-43ca-b01e-b018f7b533e4 req-705dfc7b-af6e-4c28-8341-c0637879aa7e service nova] Creating event network-vif-plugged:82fc5252-bf77-4de0-9696-26c9a450c003 for instance 115a3202-4538-4932-bc5c-155415678a28 on n-h1-856894-1 Sep 10 10:40:52.800526 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-cda422d2-9dc6-43ca-b01e-b018f7b533e4 req-705dfc7b-af6e-4c28-8341-c0637879aa7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053279 Sep 10 10:40:52.805968 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 846/1352] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:52.812358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02200217-6ad3-40bb-a861-1ef45fadcf08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:52.813442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02200217-6ad3-40bb-a861-1ef45fadcf08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:52.820556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02200217-6ad3-40bb-a861-1ef45fadcf08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:52.821359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02200217-6ad3-40bb-a861-1ef45fadcf08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:52.822060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02200217-6ad3-40bb-a861-1ef45fadcf08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:52.822932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02200217-6ad3-40bb-a861-1ef45fadcf08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:52.823612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02200217-6ad3-40bb-a861-1ef45fadcf08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:52.824281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02200217-6ad3-40bb-a861-1ef45fadcf08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:53.125430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02200217-6ad3-40bb-a861-1ef45fadcf08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:53.136040 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02200217-6ad3-40bb-a861-1ef45fadcf08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 200 len: 1307 microversion: 2.1 time: 0.328168 Sep 10 10:40:53.136641 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 847/1353] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:52 2022] GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 1307 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:53.141692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-525f5a95-96be-4864-b964-6898b6145cd7 req-02511711-1ac3-40d2-b228-9ed3d093e40d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7da2437-ac0b-4856-aaac-7bc243a710a5", "tag": "cf28e948-e9eb-4e6e-bc44-b91f790f0aec"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:53.162156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-525f5a95-96be-4864-b964-6898b6145cd7 req-02511711-1ac3-40d2-b228-9ed3d093e40d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:53.164508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-525f5a95-96be-4864-b964-6898b6145cd7 req-02511711-1ac3-40d2-b228-9ed3d093e40d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:53.164969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-525f5a95-96be-4864-b964-6898b6145cd7 req-02511711-1ac3-40d2-b228-9ed3d093e40d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:53.198770 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-525f5a95-96be-4864-b964-6898b6145cd7 req-02511711-1ac3-40d2-b228-9ed3d093e40d service nova] Creating event network-changed:cf28e948-e9eb-4e6e-bc44-b91f790f0aec for instance d7da2437-ac0b-4856-aaac-7bc243a710a5 on n-h2-856894-1 Sep 10 10:40:53.206500 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-525f5a95-96be-4864-b964-6898b6145cd7 req-02511711-1ac3-40d2-b228-9ed3d093e40d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068352 Sep 10 10:40:53.207723 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 848/1354] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:53.214088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dbb6c2f1-f36e-407b-bf09-9e47df0b8f8c tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:53.215061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dbb6c2f1-f36e-407b-bf09-9e47df0b8f8c tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:53.222697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbb6c2f1-f36e-407b-bf09-9e47df0b8f8c tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:53.223435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbb6c2f1-f36e-407b-bf09-9e47df0b8f8c tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:53.224125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbb6c2f1-f36e-407b-bf09-9e47df0b8f8c tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:53.225141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbb6c2f1-f36e-407b-bf09-9e47df0b8f8c tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:53.225845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbb6c2f1-f36e-407b-bf09-9e47df0b8f8c tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:53.226700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbb6c2f1-f36e-407b-bf09-9e47df0b8f8c tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:54.194777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dbb6c2f1-f36e-407b-bf09-9e47df0b8f8c tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2688e0179e93428cb8c196d389d2fc78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f49d607f6a4934a17b15d43755a0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:54.210850 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dbb6c2f1-f36e-407b-bf09-9e47df0b8f8c tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e" status: 200 len: 1667 microversion: 2.1 time: 1.001365 Sep 10 10:40:54.212427 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 849/1355] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:53 2022] GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e => generated 1667 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:54.219006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b227d739-b517-496d-ba63-50a7729fa56d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:54.220140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b227d739-b517-496d-ba63-50a7729fa56d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:54.231832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b227d739-b517-496d-ba63-50a7729fa56d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:54.232781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b227d739-b517-496d-ba63-50a7729fa56d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:54.233537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b227d739-b517-496d-ba63-50a7729fa56d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:54.234558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b227d739-b517-496d-ba63-50a7729fa56d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:54.235585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b227d739-b517-496d-ba63-50a7729fa56d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:54.236550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b227d739-b517-496d-ba63-50a7729fa56d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:54.771649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b227d739-b517-496d-ba63-50a7729fa56d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:54.779983 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b227d739-b517-496d-ba63-50a7729fa56d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 1318 microversion: 2.1 time: 0.566216 Sep 10 10:40:54.780843 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 850/1356] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:54 2022] GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:54.787739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1596061933", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "47147fcc-eb59-4f08-ae29-874c9998564e"}], "block_device_mapping_v2": [{"uuid": "e744b50d-c483-4b5c-842d-35aa2411bb4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:54.872824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] validate_networks() for [('47147fcc-eb59-4f08-ae29-874c9998564e', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:40:55.873771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:40:55.874385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:40:55.874672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:40:55.875087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:40:55.875508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:40:55.886949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:55.887938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:55.888182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:55.888954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:55.889660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:55.890295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:55.952864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Getting quotas for project 9c2ac1f5c5c843fc89294292d4489252. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:55.978033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Getting quotas for user 362b727b96934e58b180727eaad35e3b and project 9c2ac1f5c5c843fc89294292d4489252. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:56.080475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:40:56.082721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e744b50d-c483-4b5c-842d-35aa2411bb4e',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:40:56.275631 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b760c6f9-0ccf-4f79-a4e9-998879941ee0 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.493486 Sep 10 10:40:56.276297 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 851/1357] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:40:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 10:40:56.281585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9b15078-7130-40a0-8ee0-fb9dc2422011 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:56.282567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f9b15078-7130-40a0-8ee0-fb9dc2422011 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:56.290752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9b15078-7130-40a0-8ee0-fb9dc2422011 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:56.292019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9b15078-7130-40a0-8ee0-fb9dc2422011 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:56.293016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9b15078-7130-40a0-8ee0-fb9dc2422011 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:56.294563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9b15078-7130-40a0-8ee0-fb9dc2422011 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:56.298348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9b15078-7130-40a0-8ee0-fb9dc2422011 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:56.300469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9b15078-7130-40a0-8ee0-fb9dc2422011 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:56.802741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f9b15078-7130-40a0-8ee0-fb9dc2422011 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:56.816014 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f9b15078-7130-40a0-8ee0-fb9dc2422011 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1354 microversion: 2.1 time: 0.538366 Sep 10 10:40:56.819090 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 852/1358] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:56 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1354 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:56.835243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d42d0c9-969f-4ca5-b0ef-253a63dc8c14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:56.835759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d42d0c9-969f-4ca5-b0ef-253a63dc8c14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:56.860108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d42d0c9-969f-4ca5-b0ef-253a63dc8c14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:56.860604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d42d0c9-969f-4ca5-b0ef-253a63dc8c14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:56.861043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d42d0c9-969f-4ca5-b0ef-253a63dc8c14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:56.861769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d42d0c9-969f-4ca5-b0ef-253a63dc8c14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:56.886616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d42d0c9-969f-4ca5-b0ef-253a63dc8c14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:56.887350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d42d0c9-969f-4ca5-b0ef-253a63dc8c14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:57.264569 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d42d0c9-969f-4ca5-b0ef-253a63dc8c14 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.441426 Sep 10 10:40:57.266235 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 853/1359] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:40:56 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-interface => generated 284 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:57.284918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:57.288818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:57.309705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:57.310408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:57.310856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:57.311893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:57.312365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:57.312827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:57.509449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:57.520127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:57.522364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:57.523602 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05ecaa7f-7552-445b-a30b-6b4bb2386aa3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1370 microversion: 2.57 time: 0.255660 Sep 10 10:40:57.552525 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 854/1360] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:40:57 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:40:57.567776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3e6957dd-ee8d-4931-8317-af2971120966 req-e5ee8429-e563-42b7-b518-505e8d7578ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf886fd-0d8c-46b8-9afb-eec1edad2d96", "tag": "1b0e5ed5-e6b2-45f6-a1ac-df2eb4399a4b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:57.599403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e6957dd-ee8d-4931-8317-af2971120966 req-e5ee8429-e563-42b7-b518-505e8d7578ae service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:57.599750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e6957dd-ee8d-4931-8317-af2971120966 req-e5ee8429-e563-42b7-b518-505e8d7578ae service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:57.603608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e6957dd-ee8d-4931-8317-af2971120966 req-e5ee8429-e563-42b7-b518-505e8d7578ae service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:57.630281 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3e6957dd-ee8d-4931-8317-af2971120966 req-e5ee8429-e563-42b7-b518-505e8d7578ae service nova] Creating event network-changed:1b0e5ed5-e6b2-45f6-a1ac-df2eb4399a4b for instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 on n-h2-856894-1 Sep 10 10:40:57.640438 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3e6957dd-ee8d-4931-8317-af2971120966 req-e5ee8429-e563-42b7-b518-505e8d7578ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085824 Sep 10 10:40:57.641782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 855/1361] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:57.660632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f10a786c-a756-4c55-878a-06bdbdf29ce8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:57.662385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f10a786c-a756-4c55-878a-06bdbdf29ce8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:57.673366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f10a786c-a756-4c55-878a-06bdbdf29ce8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:57.673872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f10a786c-a756-4c55-878a-06bdbdf29ce8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:57.674386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f10a786c-a756-4c55-878a-06bdbdf29ce8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:57.675110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f10a786c-a756-4c55-878a-06bdbdf29ce8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:57.675570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f10a786c-a756-4c55-878a-06bdbdf29ce8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:57.680729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f10a786c-a756-4c55-878a-06bdbdf29ce8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:57.714695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:58.096978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f10a786c-a756-4c55-878a-06bdbdf29ce8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:40:58.123202 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f10a786c-a756-4c55-878a-06bdbdf29ce8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 200 len: 1486 microversion: 2.1 time: 0.475737 Sep 10 10:40:58.125063 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 856/1362] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:57 2022] GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 1486 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:40:58.330310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-492748770", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "34f34bc1-863d-4ae4-a386-793bd492d9c0"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:58.428469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] validate_networks() for [('34f34bc1-863d-4ae4-a386-793bd492d9c0', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:40:59.448403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:40:59.449599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:40:59.451095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:40:59.451898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:40:59.453022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:40:59.463587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:59.464073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:59.464538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:59.465813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:59.466467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:59.467204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:59.483656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:40:59.493601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Getting quotas for project 8c7136a8542b46e191366598596bf019. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:40:59.521053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Getting quotas for user f9577c0a863043e3883bf4c456edb44c and project 8c7136a8542b46e191366598596bf019. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:40:59.550155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:40:59.561634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:40:59.661966 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-224ca6c8-4e80-4f3e-bf0a-85eef6fefc36 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.527210 Sep 10 10:40:59.678541 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 857/1363] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:40:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:40:59.692919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:59.693608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] [instance: 1d9d635e-343c-4ec4-851d-7967c0f64f1e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:59.702802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:59.704750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:59.705515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:59.706419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:59.707049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:59.707663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:59.726346 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] HTTP exception thrown: Instance 1d9d635e-343c-4ec4-851d-7967c0f64f1e could not be found. Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Request method failure captured: Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e HTTP/1.1 Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGlva8ZUffSLD5rdfHupn6PvP8Y5C8VVzZUbJoFcUqKMEnjPJVg7L9SkZK2cagi9by3nfU620efz2LDN4LIQZsWbGiuBtGe6yc2HfXMHNBL_T2mHh0u0DGIEkxAC-LDedheiWAPEmuQuxoYaN3UftVcZc66OiaerYEnLfCaan6rx_4s Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 76f49d607f6a4934a17b15d43755a0d6 Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestFqdnHostnames-989585408 Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:40:59.730305 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/76f49d607f6a4934a17b15d43755a0d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/76f49d607f6a4934a17b15d43755a0d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/76f49d607f6a4934a17b15d43755a0d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_76f49d607f6a4934a17b15d43755a0d6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestFqdnHostnames-989585408 Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 76f49d607f6a4934a17b15d43755a0d6 Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-989585408 Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestFqdnHostnames-989585408-project Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 2688e0179e93428cb8c196d389d2fc78 Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestFqdnHostnames-989585408-project Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 1d9d635e-343c-4ec4-851d-7967c0f64f1e could not be found. Sep 10 10:40:59.731991 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '1d9d635e-343c-4ec4-851d-7967c0f64f1e'} Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9d635e-343c-4ec4-851d-7967c0f64f1e could not be found. Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:40:59.732843 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9d635e-343c-4ec4-851d-7967c0f64f1e could not be found. Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9d635e-343c-4ec4-851d-7967c0f64f1e could not be found. Sep 10 10:40:59.734327 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:40:59.737993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Returning 404 to user: Instance 1d9d635e-343c-4ec4-851d-7967c0f64f1e could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:40:59.739775 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cd23fc25-5263-463e-8c4e-3d59b43c33a0 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e" status: 404 len: 111 microversion: 2.1 time: 0.059427 Sep 10 10:40:59.740636 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 858/1364] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:59 2022] GET /compute/v2.1/servers/1d9d635e-343c-4ec4-851d-7967c0f64f1e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:40:59.747148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0188dfd4-4d34-4a6b-96b3-e8558c19f9ae req-348121b1-1a90-4609-98a7-4e137fac9a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7da2437-ac0b-4856-aaac-7bc243a710a5", "tag": "cf34f027-9f0e-43e5-83e8-81442fcb1b29"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:40:59.761458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0188dfd4-4d34-4a6b-96b3-e8558c19f9ae req-348121b1-1a90-4609-98a7-4e137fac9a9e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:59.762329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0188dfd4-4d34-4a6b-96b3-e8558c19f9ae req-348121b1-1a90-4609-98a7-4e137fac9a9e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:59.763193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0188dfd4-4d34-4a6b-96b3-e8558c19f9ae req-348121b1-1a90-4609-98a7-4e137fac9a9e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:59.784042 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0188dfd4-4d34-4a6b-96b3-e8558c19f9ae req-348121b1-1a90-4609-98a7-4e137fac9a9e service nova] Creating event network-changed:cf34f027-9f0e-43e5-83e8-81442fcb1b29 for instance d7da2437-ac0b-4856-aaac-7bc243a710a5 on n-h2-856894-1 Sep 10 10:40:59.789342 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0188dfd4-4d34-4a6b-96b3-e8558c19f9ae req-348121b1-1a90-4609-98a7-4e137fac9a9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047157 Sep 10 10:40:59.790842 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 859/1365] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:40:59.796713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe095864-d2d9-4058-b9b4-e7ed2e232ebb tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:40:59.797643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fe095864-d2d9-4058-b9b4-e7ed2e232ebb tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:40:59.805556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe095864-d2d9-4058-b9b4-e7ed2e232ebb tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:59.806302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe095864-d2d9-4058-b9b4-e7ed2e232ebb tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:59.806908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe095864-d2d9-4058-b9b4-e7ed2e232ebb tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:40:59.807927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe095864-d2d9-4058-b9b4-e7ed2e232ebb tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:40:59.808659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe095864-d2d9-4058-b9b4-e7ed2e232ebb tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:40:59.809333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe095864-d2d9-4058-b9b4-e7ed2e232ebb tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:00.187080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fe095864-d2d9-4058-b9b4-e7ed2e232ebb tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:00.198048 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe095864-d2d9-4058-b9b4-e7ed2e232ebb tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 1318 microversion: 2.1 time: 0.405689 Sep 10 10:41:00.213101 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 860/1366] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:40:59 2022] GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:00.223348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:00.226507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:00.239059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:00.240155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:00.240620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:00.246166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:00.247753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:00.248296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:00.378764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:00.388005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:00.389505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:00.396849 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d36c45b8-b8aa-4d04-9f68-5642c5f2a09f tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1251 microversion: 2.25 time: 0.183719 Sep 10 10:41:00.402066 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 861/1367] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:00 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1251 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:00.410631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-587f2932-c276-4a5b-9543-e678a9ec7818 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:00.411549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-587f2932-c276-4a5b-9543-e678a9ec7818 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:00.422720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-587f2932-c276-4a5b-9543-e678a9ec7818 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:00.423427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-587f2932-c276-4a5b-9543-e678a9ec7818 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:00.435927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-587f2932-c276-4a5b-9543-e678a9ec7818 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:00.436684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-587f2932-c276-4a5b-9543-e678a9ec7818 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:00.437873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-587f2932-c276-4a5b-9543-e678a9ec7818 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:00.438330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-587f2932-c276-4a5b-9543-e678a9ec7818 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:00.784828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-587f2932-c276-4a5b-9543-e678a9ec7818 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:00.794183 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-587f2932-c276-4a5b-9543-e678a9ec7818 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1354 microversion: 2.1 time: 0.390946 Sep 10 10:41:00.795509 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 862/1368] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:00 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1354 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:00.800841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-77b98cf0-be3f-4938-85c6-ffc246e708a8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:00.801512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-77b98cf0-be3f-4938-85c6-ffc246e708a8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:00.808836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77b98cf0-be3f-4938-85c6-ffc246e708a8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:00.809402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77b98cf0-be3f-4938-85c6-ffc246e708a8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:00.810763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77b98cf0-be3f-4938-85c6-ffc246e708a8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:00.811694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77b98cf0-be3f-4938-85c6-ffc246e708a8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:00.812171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77b98cf0-be3f-4938-85c6-ffc246e708a8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:00.812607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77b98cf0-be3f-4938-85c6-ffc246e708a8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:00.902789 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-77b98cf0-be3f-4938-85c6-ffc246e708a8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28/action" status: 202 len: 0 microversion: 2.1 time: 0.105567 Sep 10 10:41:00.903967 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 863/1369] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:41:00 2022] POST /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:41:00.909676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:00.911897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:00.919016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:00.919738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:00.920943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:00.922074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:00.923711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:00.924319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:01.324956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:01.334829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:01.337881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:01.339643 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36b4ea7e-20f9-4263-909d-34dbe219f6c5 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1355 microversion: 2.57 time: 0.434050 Sep 10 10:41:01.340819 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 864/1370] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:00 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1355 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:01.345644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-17c1b60f-ceea-4c0f-ae80-50294d268f5b req-9dfd95e5-880d-4002-a3dd-b679deb1108c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf886fd-0d8c-46b8-9afb-eec1edad2d96", "name": "network-vif-plugged", "status": "completed", "tag": "1b0e5ed5-e6b2-45f6-a1ac-df2eb4399a4b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:01.356995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-17c1b60f-ceea-4c0f-ae80-50294d268f5b req-9dfd95e5-880d-4002-a3dd-b679deb1108c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:01.357866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-17c1b60f-ceea-4c0f-ae80-50294d268f5b req-9dfd95e5-880d-4002-a3dd-b679deb1108c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:01.358539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-17c1b60f-ceea-4c0f-ae80-50294d268f5b req-9dfd95e5-880d-4002-a3dd-b679deb1108c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:01.373116 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-17c1b60f-ceea-4c0f-ae80-50294d268f5b req-9dfd95e5-880d-4002-a3dd-b679deb1108c service nova] Creating event network-vif-plugged:1b0e5ed5-e6b2-45f6-a1ac-df2eb4399a4b for instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 on n-h2-856894-1 Sep 10 10:41:01.381284 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-17c1b60f-ceea-4c0f-ae80-50294d268f5b req-9dfd95e5-880d-4002-a3dd-b679deb1108c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037867 Sep 10 10:41:01.381998 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 865/1371] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:01.390309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9c482ff9-591e-49da-b590-ce9c73595279 req-548ef7d6-6093-4dd0-99e3-5b56cb821c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5815be-a9f4-4a13-846f-d2f2d7384e00", "tag": "bb2be5dc-a2e7-4447-9939-ef537449e050"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:01.401055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9c482ff9-591e-49da-b590-ce9c73595279 req-548ef7d6-6093-4dd0-99e3-5b56cb821c71 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:01.402009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9c482ff9-591e-49da-b590-ce9c73595279 req-548ef7d6-6093-4dd0-99e3-5b56cb821c71 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:01.402679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9c482ff9-591e-49da-b590-ce9c73595279 req-548ef7d6-6093-4dd0-99e3-5b56cb821c71 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:01.419845 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9c482ff9-591e-49da-b590-ce9c73595279 req-548ef7d6-6093-4dd0-99e3-5b56cb821c71 service nova] Creating event network-changed:bb2be5dc-a2e7-4447-9939-ef537449e050 for instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 on n-h1-856894-1 Sep 10 10:41:01.426244 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9c482ff9-591e-49da-b590-ce9c73595279 req-548ef7d6-6093-4dd0-99e3-5b56cb821c71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042269 Sep 10 10:41:01.433721 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 866/1372] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:01.439688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-415ba9a3-eaea-4408-bd08-23f9bcd7f541 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:01.440703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-415ba9a3-eaea-4408-bd08-23f9bcd7f541 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:01.449206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-415ba9a3-eaea-4408-bd08-23f9bcd7f541 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:01.450009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-415ba9a3-eaea-4408-bd08-23f9bcd7f541 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:01.450669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-415ba9a3-eaea-4408-bd08-23f9bcd7f541 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:01.451601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-415ba9a3-eaea-4408-bd08-23f9bcd7f541 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:01.452384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-415ba9a3-eaea-4408-bd08-23f9bcd7f541 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:01.453188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-415ba9a3-eaea-4408-bd08-23f9bcd7f541 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:01.656578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-415ba9a3-eaea-4408-bd08-23f9bcd7f541 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:01.667763 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-415ba9a3-eaea-4408-bd08-23f9bcd7f541 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1276 microversion: 2.1 time: 0.232122 Sep 10 10:41:01.681108 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 867/1373] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:01 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:01.681108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-75adf65c-bd9c-43e6-87ff-ae9896c5ffc9 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] Calling method '.version_select at 0x7efcae7e2820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:01.702670 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-75adf65c-bd9c-43e6-87ff-ae9896c5ffc9 tempest-ServersTestFqdnHostnames-989585408 tempest-ServersTestFqdnHostnames-989585408-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061915880" status: 202 len: 0 microversion: 2.1 time: 0.032073 Sep 10 10:41:01.704139 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 868/1374] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 10:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061915880 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:41:01.733394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e6f213b-f4a3-4e65-9462-f98aee5a9688 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:01.734225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e6f213b-f4a3-4e65-9462-f98aee5a9688 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:01.744324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e6f213b-f4a3-4e65-9462-f98aee5a9688 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:01.748173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e6f213b-f4a3-4e65-9462-f98aee5a9688 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:01.750235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e6f213b-f4a3-4e65-9462-f98aee5a9688 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:01.752680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e6f213b-f4a3-4e65-9462-f98aee5a9688 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:01.755160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e6f213b-f4a3-4e65-9462-f98aee5a9688 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:01.756330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e6f213b-f4a3-4e65-9462-f98aee5a9688 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:02.258135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e6f213b-f4a3-4e65-9462-f98aee5a9688 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:02.266952 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e6f213b-f4a3-4e65-9462-f98aee5a9688 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 200 len: 1471 microversion: 2.1 time: 0.561698 Sep 10 10:41:02.272472 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 869/1375] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:01 2022] GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 1471 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:02.309993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2455d46f-129a-415b-9bc4-6c04bc2c971a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:02.310654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2455d46f-129a-415b-9bc4-6c04bc2c971a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:02.316846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2455d46f-129a-415b-9bc4-6c04bc2c971a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:02.318140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2455d46f-129a-415b-9bc4-6c04bc2c971a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:02.318577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2455d46f-129a-415b-9bc4-6c04bc2c971a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:02.319496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2455d46f-129a-415b-9bc4-6c04bc2c971a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:02.320116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2455d46f-129a-415b-9bc4-6c04bc2c971a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:02.320697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2455d46f-129a-415b-9bc4-6c04bc2c971a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:02.806760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2455d46f-129a-415b-9bc4-6c04bc2c971a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:02.816685 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2455d46f-129a-415b-9bc4-6c04bc2c971a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 1318 microversion: 2.1 time: 0.528008 Sep 10 10:41:02.829187 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 870/1376] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:02 2022] GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:02.839364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-91ba225e-b328-457e-b392-fd48bb17d6b3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:02.839364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-91ba225e-b328-457e-b392-fd48bb17d6b3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:02.847883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91ba225e-b328-457e-b392-fd48bb17d6b3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:02.850036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91ba225e-b328-457e-b392-fd48bb17d6b3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:02.851069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91ba225e-b328-457e-b392-fd48bb17d6b3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:02.852629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91ba225e-b328-457e-b392-fd48bb17d6b3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:02.853243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91ba225e-b328-457e-b392-fd48bb17d6b3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:02.853803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91ba225e-b328-457e-b392-fd48bb17d6b3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:02.888006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-91ba225e-b328-457e-b392-fd48bb17d6b3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:41:03.002410 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-91ba225e-b328-457e-b392-fd48bb17d6b3 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 204 len: 0 microversion: 2.57 time: 0.181952 Sep 10 10:41:03.003647 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 871/1377] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:41:02 2022] DELETE /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:41:03.010938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:03.011910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:03.019938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:03.021367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:03.022023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:03.022934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:03.023590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:03.024362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:03.533797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:03.543755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:03.545413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:03.546632 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0f99ec1-0730-42b6-9332-fba6da380551 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1293 microversion: 2.25 time: 0.540871 Sep 10 10:41:03.547397 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 872/1378] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:03 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1293 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:03.551868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-044c43a9-d45e-47e9-ba04-d3adf16a3f26 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:03.552554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-044c43a9-d45e-47e9-ba04-d3adf16a3f26 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:03.558592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-044c43a9-d45e-47e9-ba04-d3adf16a3f26 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:03.559152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-044c43a9-d45e-47e9-ba04-d3adf16a3f26 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:03.559661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-044c43a9-d45e-47e9-ba04-d3adf16a3f26 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:03.560419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-044c43a9-d45e-47e9-ba04-d3adf16a3f26 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:03.560942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-044c43a9-d45e-47e9-ba04-d3adf16a3f26 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:03.561772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-044c43a9-d45e-47e9-ba04-d3adf16a3f26 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:04.069826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-044c43a9-d45e-47e9-ba04-d3adf16a3f26 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:04.079146 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-044c43a9-d45e-47e9-ba04-d3adf16a3f26 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1354 microversion: 2.1 time: 0.530724 Sep 10 10:41:04.095111 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 873/1379] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:03 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1354 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:04.100367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-98b419bb-1dab-4f78-81f5-cecf02ce58f1 req-84bbc5b5-9bd9-42a5-a73b-0dc364afba1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5551819-7a95-48dc-837a-5b1b82fb6c2f", "tag": "cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba"}, {"server_uuid": "1d9d635e-343c-4ec4-851d-7967c0f64f1e", "name": "network-vif-deleted", "tag": "007043f4-be22-489b-9177-ce600e376823"}, {"name": "network-changed", "server_uuid": "d7da2437-ac0b-4856-aaac-7bc243a710a5", "tag": "eaf14b6b-2d99-4746-823a-f8b9249589fc"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:04.114087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-98b419bb-1dab-4f78-81f5-cecf02ce58f1 req-84bbc5b5-9bd9-42a5-a73b-0dc364afba1e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:04.114883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-98b419bb-1dab-4f78-81f5-cecf02ce58f1 req-84bbc5b5-9bd9-42a5-a73b-0dc364afba1e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:04.115515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-98b419bb-1dab-4f78-81f5-cecf02ce58f1 req-84bbc5b5-9bd9-42a5-a73b-0dc364afba1e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:04.136309 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-98b419bb-1dab-4f78-81f5-cecf02ce58f1 req-84bbc5b5-9bd9-42a5-a73b-0dc364afba1e service nova] Creating event network-changed:cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba for instance b5551819-7a95-48dc-837a-5b1b82fb6c2f on n-h1-856894-1 Sep 10 10:41:04.137135 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-98b419bb-1dab-4f78-81f5-cecf02ce58f1 req-84bbc5b5-9bd9-42a5-a73b-0dc364afba1e service nova] Creating event network-vif-deleted:007043f4-be22-489b-9177-ce600e376823 for instance 1d9d635e-343c-4ec4-851d-7967c0f64f1e on n-h1-856894-1 Sep 10 10:41:04.137885 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-98b419bb-1dab-4f78-81f5-cecf02ce58f1 req-84bbc5b5-9bd9-42a5-a73b-0dc364afba1e service nova] Creating event network-changed:eaf14b6b-2d99-4746-823a-f8b9249589fc for instance d7da2437-ac0b-4856-aaac-7bc243a710a5 on n-h2-856894-1 Sep 10 10:41:04.149778 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-98b419bb-1dab-4f78-81f5-cecf02ce58f1 req-84bbc5b5-9bd9-42a5-a73b-0dc364afba1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.052944 Sep 10 10:41:04.151125 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 874/1380] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:04.156913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e93f42df-4cbe-4683-84cc-06d4344b3342 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-16266276"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:04.160616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e93f42df-4cbe-4683-84cc-06d4344b3342 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:04.169394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93f42df-4cbe-4683-84cc-06d4344b3342 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:04.170749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93f42df-4cbe-4683-84cc-06d4344b3342 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:04.171466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93f42df-4cbe-4683-84cc-06d4344b3342 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:04.172454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93f42df-4cbe-4683-84cc-06d4344b3342 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:04.173160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93f42df-4cbe-4683-84cc-06d4344b3342 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:04.173809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93f42df-4cbe-4683-84cc-06d4344b3342 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:04.213299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:04.533258 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e93f42df-4cbe-4683-84cc-06d4344b3342 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28/action" status: 202 len: 0 microversion: 2.1 time: 0.380242 Sep 10 10:41:04.542941 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 875/1381] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:41:04 2022] POST /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 10:41:04.555958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6bf4847-4943-4848-9d5d-70d032867ebd tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:04.557909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e6bf4847-4943-4848-9d5d-70d032867ebd tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:04.587907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6bf4847-4943-4848-9d5d-70d032867ebd tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:04.588415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6bf4847-4943-4848-9d5d-70d032867ebd tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:04.588883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6bf4847-4943-4848-9d5d-70d032867ebd tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:04.589638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6bf4847-4943-4848-9d5d-70d032867ebd tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:04.590176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6bf4847-4943-4848-9d5d-70d032867ebd tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:04.598822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6bf4847-4943-4848-9d5d-70d032867ebd tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:05.712038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6bf4847-4943-4848-9d5d-70d032867ebd tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:05.733967 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6bf4847-4943-4848-9d5d-70d032867ebd tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1324 microversion: 2.1 time: 1.185293 Sep 10 10:41:05.750232 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 876/1382] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:04 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1324 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:05.763815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:05.767263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:05.784827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:05.785356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:05.785803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:05.789652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:05.790163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:05.790616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:06.027539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:06.046476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:06.048720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd0038233c64d7190e049d47372400b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445b7c0c716431895f3dc1a46db3c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:06.050637 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d257902-93cc-499d-8ffd-5f01471dbf78 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 200 len: 1361 microversion: 2.57 time: 0.298871 Sep 10 10:41:06.070361 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 877/1383] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:05 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:06.078404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-846415cc-65ee-4ef5-99b7-1b77d283afaa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:06.079289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-846415cc-65ee-4ef5-99b7-1b77d283afaa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:06.088260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846415cc-65ee-4ef5-99b7-1b77d283afaa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:06.088999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846415cc-65ee-4ef5-99b7-1b77d283afaa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:06.089648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846415cc-65ee-4ef5-99b7-1b77d283afaa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:06.090540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846415cc-65ee-4ef5-99b7-1b77d283afaa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:06.091174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846415cc-65ee-4ef5-99b7-1b77d283afaa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:06.092661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846415cc-65ee-4ef5-99b7-1b77d283afaa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:06.563642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-846415cc-65ee-4ef5-99b7-1b77d283afaa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:06.572829 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-846415cc-65ee-4ef5-99b7-1b77d283afaa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 1467 microversion: 2.1 time: 0.500787 Sep 10 10:41:06.573769 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 878/1384] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:06 2022] GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 1467 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:06.578388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ae136d70-2f35-4683-8d7d-d038c3764743 req-1119d249-5d54-423f-b994-e4ec08e850fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551819-7a95-48dc-837a-5b1b82fb6c2f", "name": "network-vif-plugged", "status": "completed", "tag": "cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:06.588778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae136d70-2f35-4683-8d7d-d038c3764743 req-1119d249-5d54-423f-b994-e4ec08e850fc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:06.589585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae136d70-2f35-4683-8d7d-d038c3764743 req-1119d249-5d54-423f-b994-e4ec08e850fc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:06.590207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae136d70-2f35-4683-8d7d-d038c3764743 req-1119d249-5d54-423f-b994-e4ec08e850fc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:06.610102 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ae136d70-2f35-4683-8d7d-d038c3764743 req-1119d249-5d54-423f-b994-e4ec08e850fc service nova] Creating event network-vif-plugged:cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba for instance b5551819-7a95-48dc-837a-5b1b82fb6c2f on n-h1-856894-1 Sep 10 10:41:06.616971 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ae136d70-2f35-4683-8d7d-d038c3764743 req-1119d249-5d54-423f-b994-e4ec08e850fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041832 Sep 10 10:41:06.618136 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 879/1385] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:06.626576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69792caa-edb8-4e42-a72e-527d6535ec3a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcaf06b700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:06.743248 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69792caa-edb8-4e42-a72e-527d6535ec3a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4" status: 200 len: 1412 microversion: 2.1 time: 0.122043 Sep 10 10:41:06.743248 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 880/1386] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:06 2022] GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:06.755898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:06.757184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:06.766800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:06.767312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:06.769132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:06.771787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:06.772294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:06.772754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:07.297104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:07.309764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:07.311613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:07.313562 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a5813851-9f87-42ec-bc78-807571a4f14b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1281 microversion: 2.25 time: 0.562509 Sep 10 10:41:07.330160 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 881/1387] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:06 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1281 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:07.335366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dffc6088-45a6-48cb-bb60-80dcbb69d766 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:07.339045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dffc6088-45a6-48cb-bb60-80dcbb69d766 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:07.346730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffc6088-45a6-48cb-bb60-80dcbb69d766 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:07.347678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffc6088-45a6-48cb-bb60-80dcbb69d766 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:07.348408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffc6088-45a6-48cb-bb60-80dcbb69d766 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:07.349368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffc6088-45a6-48cb-bb60-80dcbb69d766 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:07.350212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffc6088-45a6-48cb-bb60-80dcbb69d766 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:07.351057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffc6088-45a6-48cb-bb60-80dcbb69d766 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:07.701392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dffc6088-45a6-48cb-bb60-80dcbb69d766 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:07.710021 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dffc6088-45a6-48cb-bb60-80dcbb69d766 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1354 microversion: 2.1 time: 0.378543 Sep 10 10:41:07.710893 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 882/1388] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:07 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1354 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:07.715972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-60a1e55b-36f6-48e0-b0d4-68e88fcb8655 req-5af49b12-585e-47b1-ac06-2596eec3ff25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e", "tag": "a1e0c35c-8322-4531-8a36-a9889a2f4bf6"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:07.728829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-60a1e55b-36f6-48e0-b0d4-68e88fcb8655 req-5af49b12-585e-47b1-ac06-2596eec3ff25 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:07.729614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-60a1e55b-36f6-48e0-b0d4-68e88fcb8655 req-5af49b12-585e-47b1-ac06-2596eec3ff25 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:07.730053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-60a1e55b-36f6-48e0-b0d4-68e88fcb8655 req-5af49b12-585e-47b1-ac06-2596eec3ff25 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:07.742831 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-60a1e55b-36f6-48e0-b0d4-68e88fcb8655 req-5af49b12-585e-47b1-ac06-2596eec3ff25 service nova] Creating event network-changed:a1e0c35c-8322-4531-8a36-a9889a2f4bf6 for instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e on n-h1-856894-1 Sep 10 10:41:07.747797 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-60a1e55b-36f6-48e0-b0d4-68e88fcb8655 req-5af49b12-585e-47b1-ac06-2596eec3ff25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035450 Sep 10 10:41:07.748726 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 883/1389] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:07.754192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95eaa0c2-83cd-4fe5-bbcf-b2771b794ca2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:07.755088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95eaa0c2-83cd-4fe5-bbcf-b2771b794ca2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:07.763460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95eaa0c2-83cd-4fe5-bbcf-b2771b794ca2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:07.764067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95eaa0c2-83cd-4fe5-bbcf-b2771b794ca2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:07.764612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95eaa0c2-83cd-4fe5-bbcf-b2771b794ca2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:07.765569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95eaa0c2-83cd-4fe5-bbcf-b2771b794ca2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:07.775604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95eaa0c2-83cd-4fe5-bbcf-b2771b794ca2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:07.782677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95eaa0c2-83cd-4fe5-bbcf-b2771b794ca2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:08.459987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95eaa0c2-83cd-4fe5-bbcf-b2771b794ca2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:08.474227 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95eaa0c2-83cd-4fe5-bbcf-b2771b794ca2 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f" status: 200 len: 1317 microversion: 2.1 time: 0.721102 Sep 10 10:41:08.477148 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 884/1390] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:07 2022] GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f => generated 1317 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:08.485043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e5e7173-b562-4e39-9563-d0740ddf69ed tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:08.485950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e5e7173-b562-4e39-9563-d0740ddf69ed tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:08.531055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e5e7173-b562-4e39-9563-d0740ddf69ed tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:08.531476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e5e7173-b562-4e39-9563-d0740ddf69ed tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:08.533878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e5e7173-b562-4e39-9563-d0740ddf69ed tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:08.539191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e5e7173-b562-4e39-9563-d0740ddf69ed tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:08.541180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e5e7173-b562-4e39-9563-d0740ddf69ed tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:08.541637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e5e7173-b562-4e39-9563-d0740ddf69ed tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:09.411946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e5e7173-b562-4e39-9563-d0740ddf69ed tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:09.421296 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e5e7173-b562-4e39-9563-d0740ddf69ed tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1324 microversion: 2.1 time: 0.942762 Sep 10 10:41:09.424314 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 885/1391] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:08 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1324 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:09.430968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:09.431840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] [instance: f6516884-5521-4a51-8757-508fcfa1fbb4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:09.448879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:09.451434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:09.453716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:09.455332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:09.458513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:09.459263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:09.480216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:09.483840 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] HTTP exception thrown: Instance f6516884-5521-4a51-8757-508fcfa1fbb4 could not be found. Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Request method failure captured: Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 HTTP/1.1 Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmRpPjksBa4liQ1qBA2YNCcSdVnJufAFp13B7HpkCmEWCIMSVXjqtCFcv_cWqsTnZLEx-dRcluhT4RVSzH6xbu68G96SCBS8D0EAC7hC5OWd8LNA7ezHwDAPFzzEzS389iIHQrN7HvEaaewsmq5AU4rMz4eJMOwvaRP6YFEi28vwc0 Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.57 Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6445b7c0c716431895f3dc1a46db3c26 Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerShowV257Test-751944840 Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:41:09.486647 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6445b7c0c716431895f3dc1a46db3c26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6445b7c0c716431895f3dc1a46db3c26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6445b7c0c716431895f3dc1a46db3c26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6445b7c0c716431895f3dc1a46db3c26", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerShowV257Test-751944840 Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6445b7c0c716431895f3dc1a46db3c26 Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerShowV257Test-751944840 Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerShowV257Test-751944840-project Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 9bd0038233c64d7190e049d47372400b Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerShowV257Test-751944840-project Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f6516884-5521-4a51-8757-508fcfa1fbb4 could not be found. Sep 10 10:41:09.488581 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f6516884-5521-4a51-8757-508fcfa1fbb4'} Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6516884-5521-4a51-8757-508fcfa1fbb4 could not be found. Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:41:09.490396 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6516884-5521-4a51-8757-508fcfa1fbb4 could not be found. Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6516884-5521-4a51-8757-508fcfa1fbb4 could not be found. Sep 10 10:41:09.492139 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:09.493691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] Returning 404 to user: Instance f6516884-5521-4a51-8757-508fcfa1fbb4 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:41:09.493691 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1ba3c06-ffcb-47e1-a293-ad5b27326f97 tempest-ServerShowV257Test-751944840 tempest-ServerShowV257Test-751944840-project] 10.222.0.20 "GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4" status: 404 len: 111 microversion: 2.57 time: 0.064294 Sep 10 10:41:09.510927 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 886/1392] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:09 2022] GET /compute/v2.1/servers/f6516884-5521-4a51-8757-508fcfa1fbb4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:41:09.521054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-467bedf3-1399-4905-8ad3-990f2ec4c1d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcaea2ff70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:09.542661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=45 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:09.608055 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-467bedf3-1399-4905-8ad3-990f2ec4c1d0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4" status: 200 len: 1412 microversion: 2.1 time: 0.080555 Sep 10 10:41:09.610600 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 887/1393] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:09 2022] GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:09.622105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:09.622800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:09.630458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:09.631284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:09.631974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:09.632929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:09.633688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:09.637095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:10.265201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:10.277680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:10.279622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:10.281436 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3b99737-cdbc-408b-8342-ec6defea48f3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1281 microversion: 2.25 time: 0.668580 Sep 10 10:41:10.282560 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 888/1394] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:09 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1281 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:10.298915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd942c44-5262-44e7-9bf1-4314e65d1900 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:10.305163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd942c44-5262-44e7-9bf1-4314e65d1900 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:10.324495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd942c44-5262-44e7-9bf1-4314e65d1900 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:10.325421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd942c44-5262-44e7-9bf1-4314e65d1900 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:10.326580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd942c44-5262-44e7-9bf1-4314e65d1900 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:10.329731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd942c44-5262-44e7-9bf1-4314e65d1900 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:10.331112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd942c44-5262-44e7-9bf1-4314e65d1900 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:10.333664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd942c44-5262-44e7-9bf1-4314e65d1900 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:10.764749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd942c44-5262-44e7-9bf1-4314e65d1900 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:10.774538 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd942c44-5262-44e7-9bf1-4314e65d1900 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1354 microversion: 2.1 time: 0.490712 Sep 10 10:41:10.780902 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 889/1395] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:10 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1354 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:10.786466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee1a5946-efdb-456f-ad96-858299d27e11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:10.801868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ee1a5946-efdb-456f-ad96-858299d27e11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:10.808954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee1a5946-efdb-456f-ad96-858299d27e11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:10.809789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee1a5946-efdb-456f-ad96-858299d27e11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:10.810444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee1a5946-efdb-456f-ad96-858299d27e11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:10.811356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee1a5946-efdb-456f-ad96-858299d27e11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:10.812006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee1a5946-efdb-456f-ad96-858299d27e11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:10.812606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee1a5946-efdb-456f-ad96-858299d27e11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:11.108634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ee1a5946-efdb-456f-ad96-858299d27e11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:11.120195 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ee1a5946-efdb-456f-ad96-858299d27e11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f" status: 200 len: 1466 microversion: 2.1 time: 0.337870 Sep 10 10:41:11.121995 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 890/1396] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:10 2022] GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f => generated 1466 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:11.126852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-901826b5-a393-4d6b-b315-220be5c8acef req-f3cd8f2a-d273-437d-9968-622bc9514bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81", "tag": "c8533e91-8d6a-4b58-a8a2-80156993685b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:11.137494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-901826b5-a393-4d6b-b315-220be5c8acef req-f3cd8f2a-d273-437d-9968-622bc9514bdf service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:11.138242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-901826b5-a393-4d6b-b315-220be5c8acef req-f3cd8f2a-d273-437d-9968-622bc9514bdf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:11.138891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-901826b5-a393-4d6b-b315-220be5c8acef req-f3cd8f2a-d273-437d-9968-622bc9514bdf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:11.153519 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-901826b5-a393-4d6b-b315-220be5c8acef req-f3cd8f2a-d273-437d-9968-622bc9514bdf service nova] Creating event network-changed:c8533e91-8d6a-4b58-a8a2-80156993685b for instance 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 on n-h1-856894-1 Sep 10 10:41:11.159808 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-901826b5-a393-4d6b-b315-220be5c8acef req-f3cd8f2a-d273-437d-9968-622bc9514bdf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035729 Sep 10 10:41:11.166528 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 891/1397] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:11.172253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-aa46eea7-4672-4473-b2bd-b7e4a87b130a req-006cb04c-12d6-4434-b3c7-a2121f5ee826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115a3202-4538-4932-bc5c-155415678a28", "name": "network-vif-plugged", "status": "completed", "tag": "82fc5252-bf77-4de0-9696-26c9a450c003"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:11.183621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aa46eea7-4672-4473-b2bd-b7e4a87b130a req-006cb04c-12d6-4434-b3c7-a2121f5ee826 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:11.184594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aa46eea7-4672-4473-b2bd-b7e4a87b130a req-006cb04c-12d6-4434-b3c7-a2121f5ee826 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:11.185269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aa46eea7-4672-4473-b2bd-b7e4a87b130a req-006cb04c-12d6-4434-b3c7-a2121f5ee826 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:11.214375 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-aa46eea7-4672-4473-b2bd-b7e4a87b130a req-006cb04c-12d6-4434-b3c7-a2121f5ee826 service nova] Creating event network-vif-plugged:82fc5252-bf77-4de0-9696-26c9a450c003 for instance 115a3202-4538-4932-bc5c-155415678a28 on n-h1-856894-1 Sep 10 10:41:11.227882 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-aa46eea7-4672-4473-b2bd-b7e4a87b130a req-006cb04c-12d6-4434-b3c7-a2121f5ee826 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052739 Sep 10 10:41:11.229667 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 892/1398] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:11.239046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73d915de-f414-4d65-9851-829b31aef7cf tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:11.240692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73d915de-f414-4d65-9851-829b31aef7cf tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:11.251031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73d915de-f414-4d65-9851-829b31aef7cf tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:11.251892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73d915de-f414-4d65-9851-829b31aef7cf tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:11.252552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73d915de-f414-4d65-9851-829b31aef7cf tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:11.253518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73d915de-f414-4d65-9851-829b31aef7cf tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:11.254186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73d915de-f414-4d65-9851-829b31aef7cf tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:11.254871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73d915de-f414-4d65-9851-829b31aef7cf tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:11.503185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73d915de-f414-4d65-9851-829b31aef7cf tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:11.518182 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73d915de-f414-4d65-9851-829b31aef7cf tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1324 microversion: 2.1 time: 0.286340 Sep 10 10:41:11.519780 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 893/1399] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:11 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:11.527018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c935721d-24d2-427a-88b7-ecb222c7db21 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae96f430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:11.584147 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c935721d-24d2-427a-88b7-ecb222c7db21 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4" status: 200 len: 1412 microversion: 2.1 time: 0.063083 Sep 10 10:41:11.585314 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 894/1400] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:11 2022] GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 => generated 1412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:11.596503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1789672b-437b-47d9-b815-5b666ddf306d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-416340462"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:11.600756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1789672b-437b-47d9-b815-5b666ddf306d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:11.616578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1789672b-437b-47d9-b815-5b666ddf306d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:11.617507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1789672b-437b-47d9-b815-5b666ddf306d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:11.618187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1789672b-437b-47d9-b815-5b666ddf306d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:11.619118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1789672b-437b-47d9-b815-5b666ddf306d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:11.619845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1789672b-437b-47d9-b815-5b666ddf306d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:11.620628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1789672b-437b-47d9-b815-5b666ddf306d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:11.922220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:11.970436 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1789672b-437b-47d9-b815-5b666ddf306d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "POST /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f/action" status: 202 len: 0 microversion: 2.1 time: 0.377925 Sep 10 10:41:11.973254 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 895/1401] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:41:11 2022] POST /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 10:41:11.990061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:11.990782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:12.005933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:12.006428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:12.007184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:12.007564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:12.008014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:12.008436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:12.733101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:12.752178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:12.760338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:12.762045 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9fb37d16-d36e-4bd6-92dc-513c6f550502 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1281 microversion: 2.25 time: 0.787042 Sep 10 10:41:12.763583 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 896/1402] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:11 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1281 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:12.778824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f451608-2d2f-4755-aba1-1788be84b21d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:12.779788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f451608-2d2f-4755-aba1-1788be84b21d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:12.795506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f451608-2d2f-4755-aba1-1788be84b21d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:12.799982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f451608-2d2f-4755-aba1-1788be84b21d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:12.802136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f451608-2d2f-4755-aba1-1788be84b21d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:12.805304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f451608-2d2f-4755-aba1-1788be84b21d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:12.807369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f451608-2d2f-4755-aba1-1788be84b21d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:12.814466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f451608-2d2f-4755-aba1-1788be84b21d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:13.258352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3f451608-2d2f-4755-aba1-1788be84b21d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:13.273477 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f451608-2d2f-4755-aba1-1788be84b21d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1354 microversion: 2.1 time: 0.507162 Sep 10 10:41:13.277391 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 897/1403] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:12 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1354 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:13.287937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cf7c94e-9b2e-47e4-b967-e3eebead394e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcaee27f70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:13.410733 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cf7c94e-9b2e-47e4-b967-e3eebead394e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04" status: 200 len: 1452 microversion: 2.1 time: 0.131004 Sep 10 10:41:13.414760 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 898/1404] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:13 2022] GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:13.428633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5388501f-32b8-49e2-a504-231c2e40ba68 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:13.429702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5388501f-32b8-49e2-a504-231c2e40ba68 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:13.443107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5388501f-32b8-49e2-a504-231c2e40ba68 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:13.443931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5388501f-32b8-49e2-a504-231c2e40ba68 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:13.444568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5388501f-32b8-49e2-a504-231c2e40ba68 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:13.445646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5388501f-32b8-49e2-a504-231c2e40ba68 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:13.447148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5388501f-32b8-49e2-a504-231c2e40ba68 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:13.447931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5388501f-32b8-49e2-a504-231c2e40ba68 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:13.770882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5388501f-32b8-49e2-a504-231c2e40ba68 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:13.781785 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5388501f-32b8-49e2-a504-231c2e40ba68 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1324 microversion: 2.1 time: 0.365380 Sep 10 10:41:13.788536 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 899/1405] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:13 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:13.795129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-816bb079-4258-45ab-8970-aaae29ef89e8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcaebc0790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:13.852302 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-816bb079-4258-45ab-8970-aaae29ef89e8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4" status: 200 len: 1412 microversion: 2.1 time: 0.060448 Sep 10 10:41:13.863239 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 900/1406] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:13 2022] GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:14.053727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4fa6bb92-bd9a-4ed9-9656-67c3fce05d27 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Action: 'create', calling method: .version_select at 0x7efcaf06b820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1332702818"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:14.638045 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4fa6bb92-bd9a-4ed9-9656-67c3fce05d27 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.772862 Sep 10 10:41:14.650095 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 901/1407] 10.222.0.20 () {60 vars in 1155 bytes} [Sat Sep 10 10:41:13 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 786 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 10 10:41:14.657291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6dbdfb97-3734-4a6c-820b-5007d0a04b59 req-ccc0fc3e-a751-4713-a449-ded7e2c4e30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7da2437-ac0b-4856-aaac-7bc243a710a5", "name": "network-vif-plugged", "status": "completed", "tag": "eaf14b6b-2d99-4746-823a-f8b9249589fc"}, {"server_uuid": "d7da2437-ac0b-4856-aaac-7bc243a710a5", "name": "network-vif-plugged", "status": "completed", "tag": "cf34f027-9f0e-43e5-83e8-81442fcb1b29"}, {"server_uuid": "d7da2437-ac0b-4856-aaac-7bc243a710a5", "name": "network-vif-plugged", "status": "completed", "tag": "cf28e948-e9eb-4e6e-bc44-b91f790f0aec"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:14.676306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6dbdfb97-3734-4a6c-820b-5007d0a04b59 req-ccc0fc3e-a751-4713-a449-ded7e2c4e30b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:14.677500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6dbdfb97-3734-4a6c-820b-5007d0a04b59 req-ccc0fc3e-a751-4713-a449-ded7e2c4e30b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:14.678041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6dbdfb97-3734-4a6c-820b-5007d0a04b59 req-ccc0fc3e-a751-4713-a449-ded7e2c4e30b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:14.694215 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6dbdfb97-3734-4a6c-820b-5007d0a04b59 req-ccc0fc3e-a751-4713-a449-ded7e2c4e30b service nova] Creating event network-vif-plugged:eaf14b6b-2d99-4746-823a-f8b9249589fc for instance d7da2437-ac0b-4856-aaac-7bc243a710a5 on n-h2-856894-1 Sep 10 10:41:14.699337 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6dbdfb97-3734-4a6c-820b-5007d0a04b59 req-ccc0fc3e-a751-4713-a449-ded7e2c4e30b service nova] Creating event network-vif-plugged:cf34f027-9f0e-43e5-83e8-81442fcb1b29 for instance d7da2437-ac0b-4856-aaac-7bc243a710a5 on n-h2-856894-1 Sep 10 10:41:14.700767 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6dbdfb97-3734-4a6c-820b-5007d0a04b59 req-ccc0fc3e-a751-4713-a449-ded7e2c4e30b service nova] Creating event network-vif-plugged:cf28e948-e9eb-4e6e-bc44-b91f790f0aec for instance d7da2437-ac0b-4856-aaac-7bc243a710a5 on n-h2-856894-1 Sep 10 10:41:14.711732 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6dbdfb97-3734-4a6c-820b-5007d0a04b59 req-ccc0fc3e-a751-4713-a449-ded7e2c4e30b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.059916 Sep 10 10:41:14.715016 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 902/1408] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:14.723128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:14.724898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:14.734700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:14.735547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:14.736206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:14.737154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:14.737833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:14.738473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:15.443804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:15.453936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:15.457320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:15.459480 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-44892f24-77df-4254-be6b-ced3fb7f60c9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1281 microversion: 2.25 time: 0.742867 Sep 10 10:41:15.474565 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 903/1409] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:14 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1281 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:15.484673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4470f175-5d60-40cc-94c4-278cf4e7d859 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:15.485646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4470f175-5d60-40cc-94c4-278cf4e7d859 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:15.492911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:15.495832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4470f175-5d60-40cc-94c4-278cf4e7d859 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:15.496614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4470f175-5d60-40cc-94c4-278cf4e7d859 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:15.497273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4470f175-5d60-40cc-94c4-278cf4e7d859 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:15.498242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4470f175-5d60-40cc-94c4-278cf4e7d859 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:15.498892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4470f175-5d60-40cc-94c4-278cf4e7d859 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:15.499540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4470f175-5d60-40cc-94c4-278cf4e7d859 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:15.716289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4470f175-5d60-40cc-94c4-278cf4e7d859 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:15.733155 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4470f175-5d60-40cc-94c4-278cf4e7d859 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1354 microversion: 2.1 time: 0.255246 Sep 10 10:41:15.734539 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 904/1410] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:15 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1354 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:15.752334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4aa6bba9-e339-4331-b6fa-e403a0417923 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcaea2f310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:15.841106 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4aa6bba9-e339-4331-b6fa-e403a0417923 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04" status: 200 len: 1452 microversion: 2.1 time: 0.105196 Sep 10 10:41:15.842015 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 905/1411] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:15 2022] GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:15.848635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5e17b3e9-6d8f-4a98-bf7c-c4d514e5c781 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcaf06b310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:15.992968 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5e17b3e9-6d8f-4a98-bf7c-c4d514e5c781 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327" status: 200 len: 345 microversion: 2.1 time: 0.149516 Sep 10 10:41:15.995078 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 906/1412] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:41:15 2022] GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327 => generated 345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:16.007297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a9f6068-904a-4163-91aa-66cda769aa89 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:16.009316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a9f6068-904a-4163-91aa-66cda769aa89 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:16.024154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f6068-904a-4163-91aa-66cda769aa89 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:16.026860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f6068-904a-4163-91aa-66cda769aa89 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:16.029510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f6068-904a-4163-91aa-66cda769aa89 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:16.034086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f6068-904a-4163-91aa-66cda769aa89 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:16.034691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f6068-904a-4163-91aa-66cda769aa89 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:16.035351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f6068-904a-4163-91aa-66cda769aa89 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:16.385771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a9f6068-904a-4163-91aa-66cda769aa89 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:16.394052 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a9f6068-904a-4163-91aa-66cda769aa89 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1324 microversion: 2.1 time: 0.396934 Sep 10 10:41:16.394648 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 907/1413] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:15 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1324 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:16.429247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af5a825d-c397-4b8e-90b7-20602a309f98 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcaf06baf0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:16.506224 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af5a825d-c397-4b8e-90b7-20602a309f98 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4" status: 200 len: 1412 microversion: 2.1 time: 0.110385 Sep 10 10:41:16.508823 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 908/1414] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:16 2022] GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:16.528996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:16.529950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:16.548068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:16.549763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:16.550639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:16.552990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:16.553729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:16.556004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:16.803717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:16.813987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:16.815793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:16.817780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ded45fe3-96ab-45ba-9f9f-c39a69e814bd tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1281 microversion: 2.25 time: 0.307235 Sep 10 10:41:16.837254 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 909/1415] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:16 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1281 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:16.973301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1470673467", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "15abac29-c434-4802-9cd4-4bace1ac4f7e"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:24.401736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] validate_networks() for [('15abac29-c434-4802-9cd4-4bace1ac4f7e', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:41:24.879147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:41:24.880399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:41:24.881242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:41:24.881880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:41:24.882512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:41:24.893458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:24.894037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:24.894557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:24.895467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:24.895993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:24.896496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:24.917168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:41:24.922666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for user fa978e59fa334084b722d116c761380f and project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:41:24.939086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:41:24.941515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:41:24.993198 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b779eeb1-1967-4929-8613-b176add89faa tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.154535 Sep 10 10:41:25.003204 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 910/1416] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:41:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 8165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:41:25.008937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd21497f-4959-4474-8954-5263eae709d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:25.009665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd21497f-4959-4474-8954-5263eae709d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:25.021815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd21497f-4959-4474-8954-5263eae709d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:25.022596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd21497f-4959-4474-8954-5263eae709d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:25.023330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd21497f-4959-4474-8954-5263eae709d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:25.024068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd21497f-4959-4474-8954-5263eae709d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:25.024528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd21497f-4959-4474-8954-5263eae709d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:25.024955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd21497f-4959-4474-8954-5263eae709d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:25.209333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fd21497f-4959-4474-8954-5263eae709d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:25.221807 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fd21497f-4959-4474-8954-5263eae709d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1805 microversion: 2.1 time: 0.217075 Sep 10 10:41:25.233919 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 911/1417] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:25 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1805 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:25.246463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f59477d9-e7cd-4f58-b551-9c3af74567aa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae87c280>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:25.304486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f59477d9-e7cd-4f58-b551-9c3af74567aa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04" status: 200 len: 1452 microversion: 2.1 time: 0.080664 Sep 10 10:41:25.305101 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 912/1418] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:25 2022] GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:25.310836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ce308b0-c455-4e20-a06f-03ab7d9d2022 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcaebdc790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:25.371004 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ce308b0-c455-4e20-a06f-03ab7d9d2022 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327" status: 200 len: 346 microversion: 2.1 time: 0.063726 Sep 10 10:41:25.371960 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 913/1419] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:41:25 2022] GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327 => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:25.380309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c56dce7f-5559-4473-82d7-46f28211bb14 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:25.381148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c56dce7f-5559-4473-82d7-46f28211bb14 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:25.398033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dce7f-5559-4473-82d7-46f28211bb14 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:25.398535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dce7f-5559-4473-82d7-46f28211bb14 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:25.398981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dce7f-5559-4473-82d7-46f28211bb14 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:25.399755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dce7f-5559-4473-82d7-46f28211bb14 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:25.400218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dce7f-5559-4473-82d7-46f28211bb14 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:25.400647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dce7f-5559-4473-82d7-46f28211bb14 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:25.563637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c56dce7f-5559-4473-82d7-46f28211bb14 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:25.576104 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c56dce7f-5559-4473-82d7-46f28211bb14 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1324 microversion: 2.1 time: 0.202815 Sep 10 10:41:25.577124 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 914/1420] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:25 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1324 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:25.586705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-647a7bfc-f52d-42a5-ba89-bd1a39a64ca0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcaebdc1f0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:25.655154 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-647a7bfc-f52d-42a5-ba89-bd1a39a64ca0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4" status: 200 len: 1421 microversion: 2.1 time: 0.076290 Sep 10 10:41:25.655747 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 915/1421] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:25 2022] GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 => generated 1421 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:25.661964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:25.662781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:25.670098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:25.670803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:25.671432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:25.672315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:25.672950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:25.673568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:25.834362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:25.842640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:25.844075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:25.845427 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a3f2606-0b3b-444e-8d04-e3cfd8073b2d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1281 microversion: 2.25 time: 0.187924 Sep 10 10:41:25.846569 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 916/1422] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:25 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:25.871017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-16e2d30e-76fa-4c1d-b2b0-29ffc55da950 req-440d141f-9b1c-4b52-b5d1-547ad569ec88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551819-7a95-48dc-837a-5b1b82fb6c2f", "name": "network-vif-plugged", "status": "completed", "tag": "cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:25.891570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-16e2d30e-76fa-4c1d-b2b0-29ffc55da950 req-440d141f-9b1c-4b52-b5d1-547ad569ec88 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:25.891991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-16e2d30e-76fa-4c1d-b2b0-29ffc55da950 req-440d141f-9b1c-4b52-b5d1-547ad569ec88 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:25.892609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-16e2d30e-76fa-4c1d-b2b0-29ffc55da950 req-440d141f-9b1c-4b52-b5d1-547ad569ec88 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:25.907144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-16e2d30e-76fa-4c1d-b2b0-29ffc55da950 req-440d141f-9b1c-4b52-b5d1-547ad569ec88 service nova] Creating event network-vif-plugged:cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba for instance b5551819-7a95-48dc-837a-5b1b82fb6c2f on n-h1-856894-1 Sep 10 10:41:25.922661 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-16e2d30e-76fa-4c1d-b2b0-29ffc55da950 req-440d141f-9b1c-4b52-b5d1-547ad569ec88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059943 Sep 10 10:41:25.923271 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 917/1423] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:25.934492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5720d284-1212-422f-923e-2b7befa29938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:25.937268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5720d284-1212-422f-923e-2b7befa29938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:25.944041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5720d284-1212-422f-923e-2b7befa29938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:25.944533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5720d284-1212-422f-923e-2b7befa29938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:25.944960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5720d284-1212-422f-923e-2b7befa29938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:25.945721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5720d284-1212-422f-923e-2b7befa29938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:25.946168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5720d284-1212-422f-923e-2b7befa29938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:25.946582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5720d284-1212-422f-923e-2b7befa29938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:26.034057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5720d284-1212-422f-923e-2b7befa29938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:26.043996 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5720d284-1212-422f-923e-2b7befa29938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 200 len: 1267 microversion: 2.1 time: 0.119128 Sep 10 10:41:26.047795 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 918/1424] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:25 2022] GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:26.060602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-155159c2-0424-43e7-ae70-a66aeaf42c4b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:26.061286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-155159c2-0424-43e7-ae70-a66aeaf42c4b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:26.072429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-155159c2-0424-43e7-ae70-a66aeaf42c4b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:26.072935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-155159c2-0424-43e7-ae70-a66aeaf42c4b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:26.073412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-155159c2-0424-43e7-ae70-a66aeaf42c4b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:26.074126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-155159c2-0424-43e7-ae70-a66aeaf42c4b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:26.074587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-155159c2-0424-43e7-ae70-a66aeaf42c4b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:26.075195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-155159c2-0424-43e7-ae70-a66aeaf42c4b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:26.106405 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-155159c2-0424-43e7-ae70-a66aeaf42c4b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5/ips" status: 200 len: 219 microversion: 2.1 time: 0.057394 Sep 10 10:41:26.114078 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 919/1425] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:41:26 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5/ips => generated 219 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:26.121496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4245363c-f859-4fb3-9f41-48e1bd44d500 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Action: 'create', calling method: .version_select at 0x7efcaee70b80>, body: {"snapshot": {"volume_id": "30bdfb44-0707-484d-a173-ab9848b63327", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-33494006"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:26.368948 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4245363c-f859-4fb3-9f41-48e1bd44d500 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.258561 Sep 10 10:41:26.370225 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 920/1426] 10.222.0.20 () {60 vars in 1162 bytes} [Sat Sep 10 10:41:26 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:26.384863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fea173c8-c64b-46ce-a22d-25b6fb4a4d2c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcaee0f550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:26.470781 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fea173c8-c64b-46ce-a22d-25b6fb4a4d2c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4" status: 200 len: 1421 microversion: 2.1 time: 0.089601 Sep 10 10:41:26.485245 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 921/1427] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:26 2022] GET /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 => generated 1421 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:26.493324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1aa6147-6744-42bf-84f2-040bd0c8e9f6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:26.493962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1aa6147-6744-42bf-84f2-040bd0c8e9f6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:26.511078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1aa6147-6744-42bf-84f2-040bd0c8e9f6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:26.512864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1aa6147-6744-42bf-84f2-040bd0c8e9f6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:26.513611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1aa6147-6744-42bf-84f2-040bd0c8e9f6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:26.516040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1aa6147-6744-42bf-84f2-040bd0c8e9f6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:26.517415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1aa6147-6744-42bf-84f2-040bd0c8e9f6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:26.518072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1aa6147-6744-42bf-84f2-040bd0c8e9f6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:26.548487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1aa6147-6744-42bf-84f2-040bd0c8e9f6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:41:26.708231 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1aa6147-6744-42bf-84f2-040bd0c8e9f6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 204 len: 0 microversion: 2.1 time: 0.218500 Sep 10 10:41:26.708905 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 922/1428] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:41:26 2022] DELETE /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:41:26.728679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0fca16e6-714e-4c39-99f4-d8cf95418fdd tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcaee705e0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:26.793322 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0fca16e6-714e-4c39-99f4-d8cf95418fdd tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04" status: 200 len: 1452 microversion: 2.1 time: 0.074880 Sep 10 10:41:26.802879 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 923/1429] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:26 2022] GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:26.807994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-608a0e5c-9843-4c31-b046-a20e45eab15b tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcaebdc550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:26.888103 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-608a0e5c-9843-4c31-b046-a20e45eab15b tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f9d11a23-c53f-4d1b-8578-b9c405618ea6" status: 200 len: 285 microversion: 2.1 time: 0.083784 Sep 10 10:41:26.894592 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 924/1430] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Sep 10 10:41:26 2022] GET /compute/v2.1/os-snapshots/f9d11a23-c53f-4d1b-8578-b9c405618ea6 => generated 285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:26.909560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1766da50-c463-4f38-94b2-c91ed8645da0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae87cb80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:27.480298 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1766da50-c463-4f38-94b2-c91ed8645da0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4" status: 204 len: 0 microversion: 2.1 time: 0.589331 Sep 10 10:41:27.484590 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 925/1431] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:26 2022] DELETE /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:41:27.490444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1d149fb-a676-4db9-85a1-573c270c1509 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:27.491387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1d149fb-a676-4db9-85a1-573c270c1509 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:27.498911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d149fb-a676-4db9-85a1-573c270c1509 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:27.499726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d149fb-a676-4db9-85a1-573c270c1509 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:27.500341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d149fb-a676-4db9-85a1-573c270c1509 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:27.501318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d149fb-a676-4db9-85a1-573c270c1509 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:27.501941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d149fb-a676-4db9-85a1-573c270c1509 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:27.502536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d149fb-a676-4db9-85a1-573c270c1509 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:27.655608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b1d149fb-a676-4db9-85a1-573c270c1509 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:27.665143 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1d149fb-a676-4db9-85a1-573c270c1509 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1324 microversion: 2.1 time: 0.179234 Sep 10 10:41:27.666057 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 926/1432] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:27 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1324 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:27.681860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edac227f-0a1a-4bea-929f-7e9e9d57572b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:27.682575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-edac227f-0a1a-4bea-929f-7e9e9d57572b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:27.704489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edac227f-0a1a-4bea-929f-7e9e9d57572b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:27.705341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edac227f-0a1a-4bea-929f-7e9e9d57572b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:27.705679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edac227f-0a1a-4bea-929f-7e9e9d57572b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:27.706691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edac227f-0a1a-4bea-929f-7e9e9d57572b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:27.707125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edac227f-0a1a-4bea-929f-7e9e9d57572b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:27.708407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edac227f-0a1a-4bea-929f-7e9e9d57572b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:27.714572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:28.006722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-edac227f-0a1a-4bea-929f-7e9e9d57572b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:28.023502 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-edac227f-0a1a-4bea-929f-7e9e9d57572b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1811 microversion: 2.1 time: 0.349952 Sep 10 10:41:28.024712 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 927/1433] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:27 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1811 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:28.030892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:28.031813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:28.041154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:28.042044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:28.042665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:28.043559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:28.044178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:28.044771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:28.265675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:28.274993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:28.276643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:28.279518 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbc11ecd-0a5e-4117-b24a-94c2df0cf757 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1281 microversion: 2.25 time: 0.251199 Sep 10 10:41:28.282615 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 928/1434] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:28 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1281 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:28.326199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8e81cc8-1e4f-4e68-8c69-54421e4944e9 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcaeb775e0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:28.375709 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8e81cc8-1e4f-4e68-8c69-54421e4944e9 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.090896 Sep 10 10:41:28.384117 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 929/1435] 10.222.0.20 () {58 vars in 1140 bytes} [Sat Sep 10 10:41:28 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:28.387369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2904d90-f307-413b-8dda-705e4fa888a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:28.388025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2904d90-f307-413b-8dda-705e4fa888a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:28.395551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2904d90-f307-413b-8dda-705e4fa888a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:28.396214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2904d90-f307-413b-8dda-705e4fa888a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:28.396713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2904d90-f307-413b-8dda-705e4fa888a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:28.397418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2904d90-f307-413b-8dda-705e4fa888a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:28.397877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2904d90-f307-413b-8dda-705e4fa888a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:28.398303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2904d90-f307-413b-8dda-705e4fa888a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:28.517291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2904d90-f307-413b-8dda-705e4fa888a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:28.525456 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2904d90-f307-413b-8dda-705e4fa888a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 200 len: 1273 microversion: 2.1 time: 0.143131 Sep 10 10:41:28.532631 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 930/1436] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:28 2022] GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:28.537745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8519bc09-07bb-48f2-bedc-111c45a46eed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:28.541779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8519bc09-07bb-48f2-bedc-111c45a46eed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:28.552969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8519bc09-07bb-48f2-bedc-111c45a46eed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:28.553811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8519bc09-07bb-48f2-bedc-111c45a46eed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:28.554443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8519bc09-07bb-48f2-bedc-111c45a46eed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:28.555326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8519bc09-07bb-48f2-bedc-111c45a46eed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:28.555966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8519bc09-07bb-48f2-bedc-111c45a46eed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:28.556555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8519bc09-07bb-48f2-bedc-111c45a46eed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:28.590984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8519bc09-07bb-48f2-bedc-111c45a46eed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:41:28.712504 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8519bc09-07bb-48f2-bedc-111c45a46eed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 204 len: 0 microversion: 2.1 time: 0.178226 Sep 10 10:41:28.714166 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 931/1437] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:41:28 2022] DELETE /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:41:28.726379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8a309e4-639c-4788-870d-f23b9770d59c tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcaeb778b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:28.795440 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8a309e4-639c-4788-870d-f23b9770d59c tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04" status: 200 len: 1452 microversion: 2.1 time: 0.079634 Sep 10 10:41:28.803406 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 932/1438] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:28 2022] GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:28.803406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9a98e470-31ed-41b5-978c-87f6f305e890 req-e875ee0f-e5dc-44ff-9dc0-7340a152c4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81", "name": "network-vif-plugged", "status": "completed", "tag": "c8533e91-8d6a-4b58-a8a2-80156993685b"}, {"server_uuid": "3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e", "name": "network-vif-plugged", "status": "completed", "tag": "a1e0c35c-8322-4531-8a36-a9889a2f4bf6"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:28.818160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9a98e470-31ed-41b5-978c-87f6f305e890 req-e875ee0f-e5dc-44ff-9dc0-7340a152c4ba service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:28.818535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9a98e470-31ed-41b5-978c-87f6f305e890 req-e875ee0f-e5dc-44ff-9dc0-7340a152c4ba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:28.818974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9a98e470-31ed-41b5-978c-87f6f305e890 req-e875ee0f-e5dc-44ff-9dc0-7340a152c4ba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:28.841775 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9a98e470-31ed-41b5-978c-87f6f305e890 req-e875ee0f-e5dc-44ff-9dc0-7340a152c4ba service nova] Creating event network-vif-plugged:c8533e91-8d6a-4b58-a8a2-80156993685b for instance 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 on n-h1-856894-1 Sep 10 10:41:28.842320 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9a98e470-31ed-41b5-978c-87f6f305e890 req-e875ee0f-e5dc-44ff-9dc0-7340a152c4ba service nova] Creating event network-vif-plugged:a1e0c35c-8322-4531-8a36-a9889a2f4bf6 for instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e on n-h1-856894-1 Sep 10 10:41:28.853234 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9a98e470-31ed-41b5-978c-87f6f305e890 req-e875ee0f-e5dc-44ff-9dc0-7340a152c4ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055336 Sep 10 10:41:28.861196 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 933/1439] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:28.869782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-203b6588-cec5-42c0-a3f6-2025dfd14f4d tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcaebc0700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:28.910716 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-203b6588-cec5-42c0-a3f6-2025dfd14f4d tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f9d11a23-c53f-4d1b-8578-b9c405618ea6" status: 200 len: 286 microversion: 2.1 time: 0.048006 Sep 10 10:41:28.911677 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 934/1440] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Sep 10 10:41:28 2022] GET /compute/v2.1/os-snapshots/f9d11a23-c53f-4d1b-8578-b9c405618ea6 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:28.918739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2daaef98-ea9b-4d32-9e42-4c6d52e4ec59 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:28.919493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2daaef98-ea9b-4d32-9e42-4c6d52e4ec59 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:28.931253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2daaef98-ea9b-4d32-9e42-4c6d52e4ec59 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:28.931758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2daaef98-ea9b-4d32-9e42-4c6d52e4ec59 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:28.932203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2daaef98-ea9b-4d32-9e42-4c6d52e4ec59 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:28.932908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2daaef98-ea9b-4d32-9e42-4c6d52e4ec59 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:28.935402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2daaef98-ea9b-4d32-9e42-4c6d52e4ec59 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:28.935857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2daaef98-ea9b-4d32-9e42-4c6d52e4ec59 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:29.545459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2daaef98-ea9b-4d32-9e42-4c6d52e4ec59 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:29.553144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2daaef98-ea9b-4d32-9e42-4c6d52e4ec59 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1324 microversion: 2.1 time: 0.639374 Sep 10 10:41:29.553727 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 935/1441] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:28 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1324 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:29.572910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-722623208", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "6949200c-0a45-48d1-a5e5-5e687dfebc1f"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:29.626300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] validate_networks() for [('6949200c-0a45-48d1-a5e5-5e687dfebc1f', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:41:30.743201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:41:30.743789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:41:30.744153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:41:30.744569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:41:30.744981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:41:30.754213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:30.755206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:30.755648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:30.756385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:30.756958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:30.757285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:30.775599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Getting quotas for project 302151fe6dda436ca654252333e7fc7f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:41:30.781294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Getting quotas for user 75dc4bf3c30b42448e6dbea15579400e and project 302151fe6dda436ca654252333e7fc7f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:41:30.795431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:41:30.797812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:41:30.854818 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e93b78cc-afcd-426c-9735-4b97aa84a246 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285517 Sep 10 10:41:30.861982 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 936/1442] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:41:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:41:30.871243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-863f9292-de6d-4374-892c-600debc0d6df tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcaee704c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:30.954155 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-863f9292-de6d-4374-892c-600debc0d6df tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/f9d11a23-c53f-4d1b-8578-b9c405618ea6" status: 202 len: 0 microversion: 2.1 time: 0.090211 Sep 10 10:41:30.954787 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 937/1443] 10.222.0.20 () {58 vars in 1254 bytes} [Sat Sep 10 10:41:30 2022] DELETE /compute/v2.1/os-snapshots/f9d11a23-c53f-4d1b-8578-b9c405618ea6 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:41:30.966542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-184ec0b7-de29-4462-acdc-b0885ee8bd7e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:30.967181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-184ec0b7-de29-4462-acdc-b0885ee8bd7e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:30.983022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184ec0b7-de29-4462-acdc-b0885ee8bd7e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:30.983535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184ec0b7-de29-4462-acdc-b0885ee8bd7e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:30.987106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184ec0b7-de29-4462-acdc-b0885ee8bd7e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:30.987888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184ec0b7-de29-4462-acdc-b0885ee8bd7e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:30.988369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184ec0b7-de29-4462-acdc-b0885ee8bd7e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:30.988840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184ec0b7-de29-4462-acdc-b0885ee8bd7e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:31.335959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-184ec0b7-de29-4462-acdc-b0885ee8bd7e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:31.349748 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-184ec0b7-de29-4462-acdc-b0885ee8bd7e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1790 microversion: 2.1 time: 0.393585 Sep 10 10:41:31.350981 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 938/1444] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:30 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1790 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:31.359252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:31.364603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:31.386671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:31.387582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:31.388268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:31.389312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:31.390014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:31.390702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:31.861214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:31.871509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:31.873447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:31.874761 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f0a3c9df-5fc5-4b54-9d15-eb4397252cbc tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1281 microversion: 2.25 time: 0.521942 Sep 10 10:41:31.875649 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 939/1445] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:31 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1281 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:31.883550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b0f3e889-176c-472d-b5ec-69689a3e0b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:31.884490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b0f3e889-176c-472d-b5ec-69689a3e0b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:31.891869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0f3e889-176c-472d-b5ec-69689a3e0b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:31.892800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0f3e889-176c-472d-b5ec-69689a3e0b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:31.893478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0f3e889-176c-472d-b5ec-69689a3e0b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:31.897605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0f3e889-176c-472d-b5ec-69689a3e0b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:31.909794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0f3e889-176c-472d-b5ec-69689a3e0b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:31.910573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0f3e889-176c-472d-b5ec-69689a3e0b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:32.221750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b0f3e889-176c-472d-b5ec-69689a3e0b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:32.229897 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b0f3e889-176c-472d-b5ec-69689a3e0b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 200 len: 1315 microversion: 2.1 time: 0.353015 Sep 10 10:41:32.230782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 940/1446] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:31 2022] GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:32.235629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90f70287-8c82-4496-9c35-564daf142eca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae41c550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:32.284159 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90f70287-8c82-4496-9c35-564daf142eca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04" status: 200 len: 1461 microversion: 2.1 time: 0.052127 Sep 10 10:41:32.284766 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 941/1447] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:32 2022] GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04 => generated 1461 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:32.290540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b6587e8f-7a0d-461e-ac95-5464c43217c7 req-a3e626ae-fc70-418c-b4c8-45d57bfd4ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7da2437-ac0b-4856-aaac-7bc243a710a5", "name": "network-vif-deleted", "tag": "cf28e948-e9eb-4e6e-bc44-b91f790f0aec"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:32.313523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b6587e8f-7a0d-461e-ac95-5464c43217c7 req-a3e626ae-fc70-418c-b4c8-45d57bfd4ad1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:32.314266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b6587e8f-7a0d-461e-ac95-5464c43217c7 req-a3e626ae-fc70-418c-b4c8-45d57bfd4ad1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:32.314891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b6587e8f-7a0d-461e-ac95-5464c43217c7 req-a3e626ae-fc70-418c-b4c8-45d57bfd4ad1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:32.336376 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b6587e8f-7a0d-461e-ac95-5464c43217c7 req-a3e626ae-fc70-418c-b4c8-45d57bfd4ad1 service nova] Creating event network-vif-deleted:cf28e948-e9eb-4e6e-bc44-b91f790f0aec for instance d7da2437-ac0b-4856-aaac-7bc243a710a5 on n-h2-856894-1 Sep 10 10:41:32.343083 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b6587e8f-7a0d-461e-ac95-5464c43217c7 req-a3e626ae-fc70-418c-b4c8-45d57bfd4ad1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056162 Sep 10 10:41:32.343888 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 942/1448] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:32.349590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd404fea-bd56-4d42-a198-0f1d623f50d5 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:32.350306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd404fea-bd56-4d42-a198-0f1d623f50d5 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:32.358473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd404fea-bd56-4d42-a198-0f1d623f50d5 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:32.359287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd404fea-bd56-4d42-a198-0f1d623f50d5 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:32.365925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd404fea-bd56-4d42-a198-0f1d623f50d5 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:32.367418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd404fea-bd56-4d42-a198-0f1d623f50d5 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:32.370033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd404fea-bd56-4d42-a198-0f1d623f50d5 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:32.370553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd404fea-bd56-4d42-a198-0f1d623f50d5 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:32.790879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd404fea-bd56-4d42-a198-0f1d623f50d5 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:32.803745 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd404fea-bd56-4d42-a198-0f1d623f50d5 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1521 microversion: 2.1 time: 0.458817 Sep 10 10:41:32.805336 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 943/1449] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:32 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:32.813231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c1f0385-8470-40a7-9bff-6f559ae0a11a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:32.816059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c1f0385-8470-40a7-9bff-6f559ae0a11a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:32.845730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c1f0385-8470-40a7-9bff-6f559ae0a11a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:32.846235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c1f0385-8470-40a7-9bff-6f559ae0a11a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:32.846889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c1f0385-8470-40a7-9bff-6f559ae0a11a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:32.854986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c1f0385-8470-40a7-9bff-6f559ae0a11a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:32.856460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c1f0385-8470-40a7-9bff-6f559ae0a11a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:32.857424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c1f0385-8470-40a7-9bff-6f559ae0a11a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:32.966221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2c1f0385-8470-40a7-9bff-6f559ae0a11a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:32.977903 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c1f0385-8470-40a7-9bff-6f559ae0a11a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1277 microversion: 2.1 time: 0.169394 Sep 10 10:41:32.993099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 944/1450] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:32 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:32.993099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ea585e47-e044-4ab4-813f-8a0024d925c2 req-8720ae27-5e18-4a82-a3e5-13938e3f521a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115a3202-4538-4932-bc5c-155415678a28", "name": "network-vif-unplugged", "status": "completed", "tag": "82fc5252-bf77-4de0-9696-26c9a450c003"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:32.994200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ea585e47-e044-4ab4-813f-8a0024d925c2 req-8720ae27-5e18-4a82-a3e5-13938e3f521a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:32.994670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ea585e47-e044-4ab4-813f-8a0024d925c2 req-8720ae27-5e18-4a82-a3e5-13938e3f521a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:32.995177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ea585e47-e044-4ab4-813f-8a0024d925c2 req-8720ae27-5e18-4a82-a3e5-13938e3f521a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.008357 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ea585e47-e044-4ab4-813f-8a0024d925c2 req-8720ae27-5e18-4a82-a3e5-13938e3f521a service nova] Creating event network-vif-unplugged:82fc5252-bf77-4de0-9696-26c9a450c003 for instance 115a3202-4538-4932-bc5c-155415678a28 on n-h1-856894-1 Sep 10 10:41:33.013363 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ea585e47-e044-4ab4-813f-8a0024d925c2 req-8720ae27-5e18-4a82-a3e5-13938e3f521a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033238 Sep 10 10:41:33.014062 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 945/1451] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:33.020483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f80c7dac-2c59-477a-ba1c-4de951f91c6a tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcaea9f700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:33.052302 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f80c7dac-2c59-477a-ba1c-4de951f91c6a tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] HTTP exception thrown: Snapshot f9d11a23-c53f-4d1b-8578-b9c405618ea6 could not be found. Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f80c7dac-2c59-477a-ba1c-4de951f91c6a tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Request method failure captured: Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-snapshots/f9d11a23-c53f-4d1b-8578-b9c405618ea6 HTTP/1.1 Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnIXNrlq0FbEis8f9ZMGL-GWJgWBspycty9sWrhdzAzCzMYRRtntzsdSS_MzPgMJblGMEYAIP161G2_4lvZH3YIE5mhoWIXnX3v_uoeREaijAlX8tDEGMnGxufXco9lHdljyRp42Pn-NqNO_5SrUlWcH1LHIedni--5rIQbKeDRIWc Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 829d7a5a3bd04928a673b60fb94eb6de Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:41:33.060778 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_829d7a5a3bd04928a673b60fb94eb6de", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 829d7a5a3bd04928a673b60fb94eb6de Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesSnapshotsTestJSON-2112474361-project Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 11f3215c887745d5991a744e2496f256 Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112474361-project Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: exception: Snapshot f9d11a23-c53f-4d1b-8578-b9c405618ea6 could not be found. Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f9d11a23-c53f-4d1b-8578-b9c405618ea6'} Sep 10 10:41:33.062652 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f9d11a23-c53f-4d1b-8578-b9c405618ea6 could not be found. (HTTP 404) (Request-ID: req-cf114c2c-e650-487e-b08b-76258c57ce05) Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:33.063669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:41:33.065426 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f9d11a23-c53f-4d1b-8578-b9c405618ea6 could not be found. Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 10 10:41:33.067510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f9d11a23-c53f-4d1b-8578-b9c405618ea6 could not be found. Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f9d11a23-c53f-4d1b-8578-b9c405618ea6 could not be found. Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f80c7dac-2c59-477a-ba1c-4de951f91c6a tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Returning 404 to user: Snapshot f9d11a23-c53f-4d1b-8578-b9c405618ea6 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:41:33.069179 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f80c7dac-2c59-477a-ba1c-4de951f91c6a tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f9d11a23-c53f-4d1b-8578-b9c405618ea6" status: 404 len: 111 microversion: 2.1 time: 0.046955 Sep 10 10:41:33.070245 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 946/1452] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Sep 10 10:41:33 2022] GET /compute/v2.1/os-snapshots/f9d11a23-c53f-4d1b-8578-b9c405618ea6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:41:33.070245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5a201e42-ff89-42d7-897d-3334b7079a9d req-e716067d-f917-4bcc-9199-c8ef4144cb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115a3202-4538-4932-bc5c-155415678a28", "name": "network-vif-deleted", "tag": "82fc5252-bf77-4de0-9696-26c9a450c003"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:33.079394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5a201e42-ff89-42d7-897d-3334b7079a9d req-e716067d-f917-4bcc-9199-c8ef4144cb99 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.079828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5a201e42-ff89-42d7-897d-3334b7079a9d req-e716067d-f917-4bcc-9199-c8ef4144cb99 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.080261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5a201e42-ff89-42d7-897d-3334b7079a9d req-e716067d-f917-4bcc-9199-c8ef4144cb99 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.095565 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5a201e42-ff89-42d7-897d-3334b7079a9d req-e716067d-f917-4bcc-9199-c8ef4144cb99 service nova] Creating event network-vif-deleted:82fc5252-bf77-4de0-9696-26c9a450c003 for instance 115a3202-4538-4932-bc5c-155415678a28 on n-h1-856894-1 Sep 10 10:41:33.100842 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5a201e42-ff89-42d7-897d-3334b7079a9d req-e716067d-f917-4bcc-9199-c8ef4144cb99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036543 Sep 10 10:41:33.101617 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 947/1453] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:33.106829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-add5bb15-2023-4185-a39c-f8d74aaad9ef tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:33.107459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-add5bb15-2023-4185-a39c-f8d74aaad9ef tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:33.113886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-add5bb15-2023-4185-a39c-f8d74aaad9ef tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.114370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-add5bb15-2023-4185-a39c-f8d74aaad9ef tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.114796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-add5bb15-2023-4185-a39c-f8d74aaad9ef tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.115503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-add5bb15-2023-4185-a39c-f8d74aaad9ef tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.115958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-add5bb15-2023-4185-a39c-f8d74aaad9ef tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.116383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-add5bb15-2023-4185-a39c-f8d74aaad9ef tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.260669 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-add5bb15-2023-4185-a39c-f8d74aaad9ef tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1813 microversion: 2.1 time: 0.157811 Sep 10 10:41:33.261273 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 948/1454] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:33 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1813 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:33.265872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4dc1ddb4-9767-4cf8-a116-37e484d38bac tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcaf06b310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:33.314902 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4dc1ddb4-9767-4cf8-a116-37e484d38bac tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04" status: 200 len: 1461 microversion: 2.1 time: 0.052555 Sep 10 10:41:33.315477 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 949/1455] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:33 2022] GET /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04 => generated 1461 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:33.320468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:33.321108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:33.327160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.327663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.328120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.328806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.329287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.329715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.360855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.361365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.361800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.362245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lazy-loading 'fault' on Instance uuid d7da2437-ac0b-4856-aaac-7bc243a710a5 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:41:33.403013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:33.411174 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a0c79d75-c19c-4163-9636-8c34af5b5c07 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 200 len: 1302 microversion: 2.1 time: 0.094693 Sep 10 10:41:33.412004 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 950/1456] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:33 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:33.416762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:33.417183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:33.422856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:33.424421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.424943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.425530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.426601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.427060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.427484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.454822 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] HTTP exception thrown: Instance is not a member of specified network Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Request method failure captured: Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81/ips/invalid HTTP/1.1 Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGm2mWI02DvnmXzSo6TnHX-njvxEdwa7cQBKhRG0EtBLQCx0oHY47GU4DkmgM9xLAmqk9C2WV2nbM1wry2h2QBoJloUh7TvK4INyRTVCmn4TxbW8rlgEAUm1qiRM96r68xVm6ZmSgK_IbXH6i6w3JPtaue6KAsynFgxQ0zO3jOtW-mQ Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8c7136a8542b46e191366598596bf019 Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-810960670 Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:41:33.461733 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c7136a8542b46e191366598596bf019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c7136a8542b46e191366598596bf019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c7136a8542b46e191366598596bf019"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c7136a8542b46e191366598596bf019", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-810960670 Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8c7136a8542b46e191366598596bf019 Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-810960670 Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerAddressesNegativeTestJSON-810960670-project Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: f9577c0a863043e3883bf4c456edb44c Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-810960670-project Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance is not a member of specified network Sep 10 10:41:33.463535 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81', 'id': 'invalid'} Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 10 10:41:33.464515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:33.468430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:41:33.469564 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93079044-240f-45a3-a4a6-d69cb35550af tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.056606 Sep 10 10:41:33.476246 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 951/1457] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:41:33 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81/ips/invalid => generated 91 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:41:33.478561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:33.479606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:33.490220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.490832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.492656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.495445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.497134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.497787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.522033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:33.651851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:33.660044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:33.661815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:33.662981 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae0b2c47-4774-4052-b5ac-54f60f58305b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1477 microversion: 2.25 time: 0.191295 Sep 10 10:41:33.663540 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 952/1458] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:33 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1477 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:33.667955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b4b0c6fa-a8e3-4c83-904d-8468a2d0b751 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcae428820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:33.734739 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b4b0c6fa-a8e3-4c83-904d-8468a2d0b751 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327" status: 202 len: 0 microversion: 2.1 time: 0.070094 Sep 10 10:41:33.735497 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 953/1459] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:41:33 2022] DELETE /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:41:33.740690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93646d7a-f0c8-4fdb-a7b5-d9fbb8d0211e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:33.741346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93646d7a-f0c8-4fdb-a7b5-d9fbb8d0211e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:33.747536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93646d7a-f0c8-4fdb-a7b5-d9fbb8d0211e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.748029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93646d7a-f0c8-4fdb-a7b5-d9fbb8d0211e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.748520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93646d7a-f0c8-4fdb-a7b5-d9fbb8d0211e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.749292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93646d7a-f0c8-4fdb-a7b5-d9fbb8d0211e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.749759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93646d7a-f0c8-4fdb-a7b5-d9fbb8d0211e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.750180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93646d7a-f0c8-4fdb-a7b5-d9fbb8d0211e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.884134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93646d7a-f0c8-4fdb-a7b5-d9fbb8d0211e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:33.892026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93646d7a-f0c8-4fdb-a7b5-d9fbb8d0211e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 200 len: 1315 microversion: 2.1 time: 0.155677 Sep 10 10:41:33.892598 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 954/1460] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:33 2022] GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:33.899637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b4ba52b-784c-4aad-a117-6a976f1c5663 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:33.903472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b4ba52b-784c-4aad-a117-6a976f1c5663 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.903957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b4ba52b-784c-4aad-a117-6a976f1c5663 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.904398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b4ba52b-784c-4aad-a117-6a976f1c5663 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.905145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b4ba52b-784c-4aad-a117-6a976f1c5663 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.905612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b4ba52b-784c-4aad-a117-6a976f1c5663 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.906031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b4ba52b-784c-4aad-a117-6a976f1c5663 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.936214 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b4ba52b-784c-4aad-a117-6a976f1c5663 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039965 Sep 10 10:41:33.936841 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 955/1461] 10.222.0.20 () {58 vars in 1176 bytes} [Sat Sep 10 10:41:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:33.943515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f95b076d-ebd7-492e-abe8-29fc66d7e053 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:33.944432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f95b076d-ebd7-492e-abe8-29fc66d7e053 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:33.957529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95b076d-ebd7-492e-abe8-29fc66d7e053 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.958586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95b076d-ebd7-492e-abe8-29fc66d7e053 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.959718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95b076d-ebd7-492e-abe8-29fc66d7e053 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:33.961099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95b076d-ebd7-492e-abe8-29fc66d7e053 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:33.962219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95b076d-ebd7-492e-abe8-29fc66d7e053 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:33.962855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95b076d-ebd7-492e-abe8-29fc66d7e053 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:34.165343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f95b076d-ebd7-492e-abe8-29fc66d7e053 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:34.176077 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f95b076d-ebd7-492e-abe8-29fc66d7e053 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f" status: 200 len: 1466 microversion: 2.1 time: 0.235576 Sep 10 10:41:34.177427 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 956/1462] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:33 2022] GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f => generated 1466 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:34.196386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86d03b1d-70f1-4683-b8c4-c4def9668032 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:34.201588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86d03b1d-70f1-4683-b8c4-c4def9668032 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Failed to fetch instance by id 999 {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 10:41:34.203244 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-86d03b1d-70f1-4683-b8c4-c4def9668032 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] HTTP exception thrown: Instance 999 could not be found. Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86d03b1d-70f1-4683-b8c4-c4def9668032 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Request method failure captured: Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGm2mWI02DvnmXzSo6TnHX-njvxEdwa7cQBKhRG0EtBLQCx0oHY47GU4DkmgM9xLAmqk9C2WV2nbM1wry2h2QBoJloUh7TvK4INyRTVCmn4TxbW8rlgEAUm1qiRM96r68xVm6ZmSgK_IbXH6i6w3JPtaue6KAsynFgxQ0zO3jOtW-mQ Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8c7136a8542b46e191366598596bf019 Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-810960670 Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:41:34.204822 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c7136a8542b46e191366598596bf019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c7136a8542b46e191366598596bf019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c7136a8542b46e191366598596bf019"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c7136a8542b46e191366598596bf019", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-810960670 Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8c7136a8542b46e191366598596bf019 Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-810960670 Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerAddressesNegativeTestJSON-810960670-project Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: f9577c0a863043e3883bf4c456edb44c Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-810960670-project Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 999 could not be found. Sep 10 10:41:34.206629 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '999'} Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 10 10:41:34.208200 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 10 10:41:34.209838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:34.211434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86d03b1d-70f1-4683-b8c4-c4def9668032 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:41:34.212171 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86d03b1d-70f1-4683-b8c4-c4def9668032 tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.033512 Sep 10 10:41:34.218061 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 957/1463] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:41:34 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:41:34.223385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d96a7236-4222-4a28-bedf-a4b9ea83b8c4 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:34.224080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d96a7236-4222-4a28-bedf-a4b9ea83b8c4 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:34.230237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d96a7236-4222-4a28-bedf-a4b9ea83b8c4 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:34.230800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d96a7236-4222-4a28-bedf-a4b9ea83b8c4 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:34.231338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d96a7236-4222-4a28-bedf-a4b9ea83b8c4 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:34.232277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d96a7236-4222-4a28-bedf-a4b9ea83b8c4 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:34.232807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d96a7236-4222-4a28-bedf-a4b9ea83b8c4 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:34.233363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d96a7236-4222-4a28-bedf-a4b9ea83b8c4 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:34.403590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d96a7236-4222-4a28-bedf-a4b9ea83b8c4 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:41:34.419034 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d96a7236-4222-4a28-bedf-a4b9ea83b8c4 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1970 microversion: 2.25 time: 0.199474 Sep 10 10:41:34.430419 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 958/1464] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:34 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1970 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:34.430419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-882cee48-83eb-4cf9-8e19-d7a12fae8965 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcae81a8b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:34.517030 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-882cee48-83eb-4cf9-8e19-d7a12fae8965 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327" status: 200 len: 345 microversion: 2.1 time: 0.095957 Sep 10 10:41:34.518934 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 959/1465] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:41:34 2022] GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327 => generated 345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:34.529028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aea0d814-00ff-405b-95f1-669f75f093b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:34.529946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aea0d814-00ff-405b-95f1-669f75f093b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:34.537524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aea0d814-00ff-405b-95f1-669f75f093b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:34.538451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aea0d814-00ff-405b-95f1-669f75f093b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:34.539702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aea0d814-00ff-405b-95f1-669f75f093b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:34.540733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aea0d814-00ff-405b-95f1-669f75f093b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:34.541417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aea0d814-00ff-405b-95f1-669f75f093b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:34.542116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aea0d814-00ff-405b-95f1-669f75f093b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:34.754733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aea0d814-00ff-405b-95f1-669f75f093b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:34.764222 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aea0d814-00ff-405b-95f1-669f75f093b2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1307 microversion: 2.1 time: 0.243080 Sep 10 10:41:34.764741 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 960/1466] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:34 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1307 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:34.770453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-887edc04-8473-49f9-80c3-ef2b53b3b50e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-270777775"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:34.773229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-887edc04-8473-49f9-80c3-ef2b53b3b50e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:34.780192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-887edc04-8473-49f9-80c3-ef2b53b3b50e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:34.780693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-887edc04-8473-49f9-80c3-ef2b53b3b50e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:34.781262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-887edc04-8473-49f9-80c3-ef2b53b3b50e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:34.782210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-887edc04-8473-49f9-80c3-ef2b53b3b50e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:34.782645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-887edc04-8473-49f9-80c3-ef2b53b3b50e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:34.783068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-887edc04-8473-49f9-80c3-ef2b53b3b50e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:35.118601 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-887edc04-8473-49f9-80c3-ef2b53b3b50e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "POST /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96/action" status: 202 len: 0 microversion: 2.1 time: 0.352180 Sep 10 10:41:35.127864 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 961/1467] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:41:34 2022] POST /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 10:41:35.138206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfe61429-af4d-472d-94e6-a1105100c32a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:35.139144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfe61429-af4d-472d-94e6-a1105100c32a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:35.149995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe61429-af4d-472d-94e6-a1105100c32a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:35.162846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe61429-af4d-472d-94e6-a1105100c32a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:35.164330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe61429-af4d-472d-94e6-a1105100c32a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:35.168387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe61429-af4d-472d-94e6-a1105100c32a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:35.169552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe61429-af4d-472d-94e6-a1105100c32a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:35.170567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe61429-af4d-472d-94e6-a1105100c32a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:35.230432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfe61429-af4d-472d-94e6-a1105100c32a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:41:35.372965 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfe61429-af4d-472d-94e6-a1105100c32a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 204 len: 0 microversion: 2.1 time: 0.242638 Sep 10 10:41:35.374287 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 962/1468] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:41:35 2022] DELETE /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:41:35.382795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a5621fa8-13b0-490e-b445-43183a30f947 req-e51bace4-5117-42ad-934e-f5a7e4f44163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f322918c-30a0-409f-9873-1cc3ba8ef4fe", "tag": "b986db73-3ae8-466b-b075-a8b7cf074dfc"}, {"server_uuid": "d7da2437-ac0b-4856-aaac-7bc243a710a5", "name": "network-vif-deleted", "tag": "eaf14b6b-2d99-4746-823a-f8b9249589fc"}, {"server_uuid": "d7da2437-ac0b-4856-aaac-7bc243a710a5", "name": "network-vif-deleted", "tag": "cf34f027-9f0e-43e5-83e8-81442fcb1b29"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:35.397981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a5621fa8-13b0-490e-b445-43183a30f947 req-e51bace4-5117-42ad-934e-f5a7e4f44163 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:35.398669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a5621fa8-13b0-490e-b445-43183a30f947 req-e51bace4-5117-42ad-934e-f5a7e4f44163 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:35.399217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a5621fa8-13b0-490e-b445-43183a30f947 req-e51bace4-5117-42ad-934e-f5a7e4f44163 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:35.427368 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a5621fa8-13b0-490e-b445-43183a30f947 req-e51bace4-5117-42ad-934e-f5a7e4f44163 service nova] Creating event network-changed:b986db73-3ae8-466b-b075-a8b7cf074dfc for instance f322918c-30a0-409f-9873-1cc3ba8ef4fe on n-h2-856894-1 Sep 10 10:41:35.428030 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a5621fa8-13b0-490e-b445-43183a30f947 req-e51bace4-5117-42ad-934e-f5a7e4f44163 service nova] Creating event network-vif-deleted:eaf14b6b-2d99-4746-823a-f8b9249589fc for instance d7da2437-ac0b-4856-aaac-7bc243a710a5 on n-h2-856894-1 Sep 10 10:41:35.428801 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a5621fa8-13b0-490e-b445-43183a30f947 req-e51bace4-5117-42ad-934e-f5a7e4f44163 service nova] Creating event network-vif-deleted:cf34f027-9f0e-43e5-83e8-81442fcb1b29 for instance d7da2437-ac0b-4856-aaac-7bc243a710a5 on n-h2-856894-1 Sep 10 10:41:35.443572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a5621fa8-13b0-490e-b445-43183a30f947 req-e51bace4-5117-42ad-934e-f5a7e4f44163 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.067860 Sep 10 10:41:35.444293 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 963/1469] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:35.450190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:35.453698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:35.461597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:35.462182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:35.462865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:35.463723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:35.464223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:35.464805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:35.481979 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] HTTP exception thrown: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Request method failure captured: Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 HTTP/1.1 Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmc-yIdfviXHPYwjT9z1Y8ZWTBBLkziRg2lUYR8EaSNJ8zJolFb55CcfqBTGghyaWoV9eP__xeAUXHzsQB02o9Z4gEe90tmeMsEk_N4RB9zFBTzrUcUuOj9sJmvCgnIG1zUVYuhdLNk2UBSke60kzA5n-B1mjgS1ezd_7odwnAhGwA Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:41:35.483834 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebcf75baac6d4be481406daf0dd81e1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestMultiNic-1558727174 Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 47ee461c12bb4fae9792abbc067a71fa Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:41:35.485608 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd7da2437-ac0b-4856-aaac-7bc243a710a5'} Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:41:35.486782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:41:35.488420 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:35.490016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Returning 404 to user: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:41:35.490016 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6144e27-2aeb-4e9b-9412-ffc47bf9cf4f tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 404 len: 111 microversion: 2.1 time: 0.040836 Sep 10 10:41:35.490016 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 964/1470] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:35 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:41:35.492796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5727e539-e104-4a1e-838e-6211dbce7e66 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:35.493524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5727e539-e104-4a1e-838e-6211dbce7e66 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:35.499665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5727e539-e104-4a1e-838e-6211dbce7e66 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:35.500156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5727e539-e104-4a1e-838e-6211dbce7e66 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:35.500594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5727e539-e104-4a1e-838e-6211dbce7e66 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:35.502349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5727e539-e104-4a1e-838e-6211dbce7e66 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:35.502349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5727e539-e104-4a1e-838e-6211dbce7e66 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:35.502721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5727e539-e104-4a1e-838e-6211dbce7e66 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:35.855572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5727e539-e104-4a1e-838e-6211dbce7e66 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:41:35.888402 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5727e539-e104-4a1e-838e-6211dbce7e66 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1970 microversion: 2.25 time: 0.399431 Sep 10 10:41:35.890998 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 965/1471] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:35 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1970 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:35.900248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7216ab5a-9488-44b4-9b00-4ab725abf26a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:35.900873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7216ab5a-9488-44b4-9b00-4ab725abf26a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:35.913403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7216ab5a-9488-44b4-9b00-4ab725abf26a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:35.914130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7216ab5a-9488-44b4-9b00-4ab725abf26a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:35.919165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7216ab5a-9488-44b4-9b00-4ab725abf26a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:35.921022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7216ab5a-9488-44b4-9b00-4ab725abf26a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:35.921696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7216ab5a-9488-44b4-9b00-4ab725abf26a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:35.924200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7216ab5a-9488-44b4-9b00-4ab725abf26a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:36.474366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7216ab5a-9488-44b4-9b00-4ab725abf26a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:36.486154 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7216ab5a-9488-44b4-9b00-4ab725abf26a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 200 len: 1315 microversion: 2.1 time: 0.593970 Sep 10 10:41:36.501912 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 966/1472] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:35 2022] GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:36.508845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a8776211-4ded-459c-a5aa-d4d859b8a51c req-db8e442b-f186-457f-b7c8-db4f0f057ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551819-7a95-48dc-837a-5b1b82fb6c2f", "name": "network-vif-unplugged", "status": "completed", "tag": "cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:36.519235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a8776211-4ded-459c-a5aa-d4d859b8a51c req-db8e442b-f186-457f-b7c8-db4f0f057ed6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:36.520520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a8776211-4ded-459c-a5aa-d4d859b8a51c req-db8e442b-f186-457f-b7c8-db4f0f057ed6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:36.521138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a8776211-4ded-459c-a5aa-d4d859b8a51c req-db8e442b-f186-457f-b7c8-db4f0f057ed6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:36.534275 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a8776211-4ded-459c-a5aa-d4d859b8a51c req-db8e442b-f186-457f-b7c8-db4f0f057ed6 service nova] Creating event network-vif-unplugged:cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba for instance b5551819-7a95-48dc-837a-5b1b82fb6c2f on n-h1-856894-1 Sep 10 10:41:36.540826 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a8776211-4ded-459c-a5aa-d4d859b8a51c req-db8e442b-f186-457f-b7c8-db4f0f057ed6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037345 Sep 10 10:41:36.542081 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 967/1473] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:36.548069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57a6785f-e12a-4c4e-8997-399c20736ea1 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcaebc48b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:36.609635 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57a6785f-e12a-4c4e-8997-399c20736ea1 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1452 microversion: 2.1 time: 0.065945 Sep 10 10:41:36.614083 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 968/1474] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:36 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:36.628299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-800b63f0-1980-4f2f-9cbb-bfe865642d21 req-6ecbce09-974d-404a-8395-dba4f1ca38d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdbfd4c5-e209-4e86-a0dd-00738c53b9b3", "tag": "4348d2b9-1dca-4e41-826e-c604d9ea22da"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:36.640381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-800b63f0-1980-4f2f-9cbb-bfe865642d21 req-6ecbce09-974d-404a-8395-dba4f1ca38d4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:36.640985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-800b63f0-1980-4f2f-9cbb-bfe865642d21 req-6ecbce09-974d-404a-8395-dba4f1ca38d4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:36.641504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-800b63f0-1980-4f2f-9cbb-bfe865642d21 req-6ecbce09-974d-404a-8395-dba4f1ca38d4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:36.657145 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-800b63f0-1980-4f2f-9cbb-bfe865642d21 req-6ecbce09-974d-404a-8395-dba4f1ca38d4 service nova] Creating event network-changed:4348d2b9-1dca-4e41-826e-c604d9ea22da for instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 on n-h2-856894-1 Sep 10 10:41:36.665039 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-800b63f0-1980-4f2f-9cbb-bfe865642d21 req-6ecbce09-974d-404a-8395-dba4f1ca38d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048515 Sep 10 10:41:36.671432 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 969/1475] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:36.671432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ccd018a-1895-4244-82bd-3552ae690c4b tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:36.672423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ccd018a-1895-4244-82bd-3552ae690c4b tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:36.681696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccd018a-1895-4244-82bd-3552ae690c4b tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:36.682283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccd018a-1895-4244-82bd-3552ae690c4b tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:36.682813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccd018a-1895-4244-82bd-3552ae690c4b tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:36.684987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccd018a-1895-4244-82bd-3552ae690c4b tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:36.691095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccd018a-1895-4244-82bd-3552ae690c4b tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:36.691095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccd018a-1895-4244-82bd-3552ae690c4b tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:36.886839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5ccd018a-1895-4244-82bd-3552ae690c4b tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9577c0a863043e3883bf4c456edb44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7136a8542b46e191366598596bf019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:36.917735 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ccd018a-1895-4244-82bd-3552ae690c4b tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 200 len: 1527 microversion: 2.1 time: 0.250355 Sep 10 10:41:36.924096 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 970/1476] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:36 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 1527 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:36.929912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-13f05036-0b8e-4416-848a-95a2eb710a23 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcae3dcdc0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:36.971999 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-13f05036-0b8e-4416-848a-95a2eb710a23 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] HTTP exception thrown: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-13f05036-0b8e-4416-848a-95a2eb710a23 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Request method failure captured: Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327 HTTP/1.1 Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnIXNrlq0FbEis8f9ZMGL-GWJgWBspycty9sWrhdzAzCzMYRRtntzsdSS_MzPgMJblGMEYAIP161G2_4lvZH3YIE5mhoWIXnX3v_uoeREaijAlX8tDEGMnGxufXco9lHdljyRp42Pn-NqNO_5SrUlWcH1LHIedni--5rIQbKeDRIWc Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 829d7a5a3bd04928a673b60fb94eb6de Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:41:36.975448 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_829d7a5a3bd04928a673b60fb94eb6de", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 829d7a5a3bd04928a673b60fb94eb6de Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesSnapshotsTestJSON-2112474361-project Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 11f3215c887745d5991a744e2496f256 Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112474361-project Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: exception: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '30bdfb44-0707-484d-a173-ab9848b63327'} Sep 10 10:41:36.977010 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. (HTTP 404) (Request-ID: req-95703914-a253-4f1b-9e3a-c0461fcafecc) Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:36.978046 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:41:36.980946 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 10:41:36.983770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-13f05036-0b8e-4416-848a-95a2eb710a23 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Returning 404 to user: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-13f05036-0b8e-4416-848a-95a2eb710a23 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327" status: 404 len: 109 microversion: 2.1 time: 0.051592 Sep 10 10:41:36.986580 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 971/1477] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:41:36 2022] GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:41:36.989905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7711cf13-0a03-4c76-a271-4791ad3d13ed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:36.989905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7711cf13-0a03-4c76-a271-4791ad3d13ed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:36.995210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7711cf13-0a03-4c76-a271-4791ad3d13ed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:36.995702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7711cf13-0a03-4c76-a271-4791ad3d13ed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:36.996135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7711cf13-0a03-4c76-a271-4791ad3d13ed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:36.996836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7711cf13-0a03-4c76-a271-4791ad3d13ed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:36.997319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7711cf13-0a03-4c76-a271-4791ad3d13ed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:36.997741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7711cf13-0a03-4c76-a271-4791ad3d13ed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:37.187834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7711cf13-0a03-4c76-a271-4791ad3d13ed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:37.201090 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7711cf13-0a03-4c76-a271-4791ad3d13ed tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1307 microversion: 2.1 time: 0.222063 Sep 10 10:41:37.214406 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 972/1478] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:36 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:37.225456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d0be1c7-c024-4b38-ac29-641654fd1387 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:37.233928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0be1c7-c024-4b38-ac29-641654fd1387 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:37.234868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0be1c7-c024-4b38-ac29-641654fd1387 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:37.235503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0be1c7-c024-4b38-ac29-641654fd1387 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:37.236884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0be1c7-c024-4b38-ac29-641654fd1387 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:37.237567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0be1c7-c024-4b38-ac29-641654fd1387 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:37.239341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d0be1c7-c024-4b38-ac29-641654fd1387 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:37.274490 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d0be1c7-c024-4b38-ac29-641654fd1387 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.058619 Sep 10 10:41:37.282883 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 973/1479] 10.222.0.20 () {60 vars in 1217 bytes} [Sat Sep 10 10:41:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:41:37.288514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f01a53fc-fb85-45a0-8beb-79a529c0ead0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d01fd3bd-6f7b-41d4-8cc4-16c0179ad30f", "device": "/dev/xvdb"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:37.292465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f01a53fc-fb85-45a0-8beb-79a529c0ead0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:37.298901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01a53fc-fb85-45a0-8beb-79a529c0ead0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:37.299430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01a53fc-fb85-45a0-8beb-79a529c0ead0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:37.299864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01a53fc-fb85-45a0-8beb-79a529c0ead0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:37.300575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01a53fc-fb85-45a0-8beb-79a529c0ead0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:37.301585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01a53fc-fb85-45a0-8beb-79a529c0ead0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:37.302011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01a53fc-fb85-45a0-8beb-79a529c0ead0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:37.320607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:37.822834 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f01a53fc-fb85-45a0-8beb-79a529c0ead0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "POST /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538350 Sep 10 10:41:37.823986 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 974/1480] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 10:41:37 2022] POST /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:37.829903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2365e3d5-1022-4aa0-b91f-e2ede4e2d12e tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcaebc05e0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:37.883956 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2365e3d5-1022-4aa0-b91f-e2ede4e2d12e tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] HTTP exception thrown: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2365e3d5-1022-4aa0-b91f-e2ede4e2d12e tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Request method failure captured: Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327 HTTP/1.1 Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnIXNrlq0FbEis8f9ZMGL-GWJgWBspycty9sWrhdzAzCzMYRRtntzsdSS_MzPgMJblGMEYAIP161G2_4lvZH3YIE5mhoWIXnX3v_uoeREaijAlX8tDEGMnGxufXco9lHdljyRp42Pn-NqNO_5SrUlWcH1LHIedni--5rIQbKeDRIWc Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 829d7a5a3bd04928a673b60fb94eb6de Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:41:37.886532 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_829d7a5a3bd04928a673b60fb94eb6de", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 829d7a5a3bd04928a673b60fb94eb6de Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesSnapshotsTestJSON-2112474361-project Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 11f3215c887745d5991a744e2496f256 Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112474361-project Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: exception: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '30bdfb44-0707-484d-a173-ab9848b63327'} Sep 10 10:41:37.888300 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. (HTTP 404) (Request-ID: req-acfc9beb-df6c-40e6-81df-ec66a8efeeaf) Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:37.889295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 10:41:37.890687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 10:41:37.891976 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2365e3d5-1022-4aa0-b91f-e2ede4e2d12e tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Returning 404 to user: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:41:37.894094 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2365e3d5-1022-4aa0-b91f-e2ede4e2d12e tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327" status: 404 len: 109 microversion: 2.1 time: 0.062845 Sep 10 10:41:37.895403 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 975/1481] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:41:37 2022] DELETE /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:41:37.895403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-856894-1", "block_migration": "auto"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:37.908286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:37.927417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:37.928138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:37.928580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:37.930934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:37.931600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:37.933638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:38.003157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'flavor' on Instance uuid 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:41:38.061194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Going to try to live migrate instance to n-h2-856894-1 {{(pid=128788) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 10:41:40.096608 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d0f2e88-c591-4379-8620-d7231fc92da9 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e/action" status: 202 len: 0 microversion: 2.25 time: 2.206203 Sep 10 10:41:40.100542 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 976/1482] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:41:37 2022] POST /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e/action => generated 0 bytes in 2211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:41:40.116826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3ef048d-cfa4-44a8-b4c2-f718597c0bc1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:40.119337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f3ef048d-cfa4-44a8-b4c2-f718597c0bc1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:40.140560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3ef048d-cfa4-44a8-b4c2-f718597c0bc1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:40.141593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3ef048d-cfa4-44a8-b4c2-f718597c0bc1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:40.142819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3ef048d-cfa4-44a8-b4c2-f718597c0bc1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:40.159478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3ef048d-cfa4-44a8-b4c2-f718597c0bc1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:40.161206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3ef048d-cfa4-44a8-b4c2-f718597c0bc1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:40.162155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3ef048d-cfa4-44a8-b4c2-f718597c0bc1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:40.649322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f3ef048d-cfa4-44a8-b4c2-f718597c0bc1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:40.658188 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f3ef048d-cfa4-44a8-b4c2-f718597c0bc1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 200 len: 1315 microversion: 2.1 time: 0.554662 Sep 10 10:41:40.662471 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 977/1483] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:40 2022] GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:40.701914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1a82153-49c5-4d14-8e5e-47a58d8f3071 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae4059d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:40.789926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:40.827744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1a82153-49c5-4d14-8e5e-47a58d8f3071 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1452 microversion: 2.1 time: 0.128247 Sep 10 10:41:40.836158 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 978/1484] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:40 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:40.849145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3dbfef08-1686-46b9-98d4-10aec1e72c56 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Calling method '.version_select at 0x7efcae47e790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:40.894523 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-3dbfef08-1686-46b9-98d4-10aec1e72c56 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] HTTP exception thrown: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3dbfef08-1686-46b9-98d4-10aec1e72c56 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Request method failure captured: Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327 HTTP/1.1 Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnIXNrlq0FbEis8f9ZMGL-GWJgWBspycty9sWrhdzAzCzMYRRtntzsdSS_MzPgMJblGMEYAIP161G2_4lvZH3YIE5mhoWIXnX3v_uoeREaijAlX8tDEGMnGxufXco9lHdljyRp42Pn-NqNO_5SrUlWcH1LHIedni--5rIQbKeDRIWc Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 829d7a5a3bd04928a673b60fb94eb6de Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:41:40.898971 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/829d7a5a3bd04928a673b60fb94eb6de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_829d7a5a3bd04928a673b60fb94eb6de", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 829d7a5a3bd04928a673b60fb94eb6de Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112474361 Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesSnapshotsTestJSON-2112474361-project Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 11f3215c887745d5991a744e2496f256 Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112474361-project Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: exception: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '30bdfb44-0707-484d-a173-ab9848b63327'} Sep 10 10:41:40.900540 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. (HTTP 404) (Request-ID: req-b30f9ae5-8599-4dbd-945d-44473adeb461) Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:40.901645 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:41:40.902935 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 10:41:40.904280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3dbfef08-1686-46b9-98d4-10aec1e72c56 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] Returning 404 to user: Volume 30bdfb44-0707-484d-a173-ab9848b63327 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:41:40.907833 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3dbfef08-1686-46b9-98d4-10aec1e72c56 tempest-VolumesSnapshotsTestJSON-2112474361 tempest-VolumesSnapshotsTestJSON-2112474361-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327" status: 404 len: 109 microversion: 2.1 time: 0.063159 Sep 10 10:41:40.923458 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 979/1485] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:41:40 2022] GET /compute/v2.1/os-volumes/30bdfb44-0707-484d-a173-ab9848b63327 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:41:40.934796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:40.946375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] [instance: 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:40.971451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:40.974762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:40.977509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:40.984325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:40.985262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:40.988154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:41.041296 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] HTTP exception thrown: Instance 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 could not be found. Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Request method failure captured: Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 HTTP/1.1 Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGm2mWI02DvnmXzSo6TnHX-njvxEdwa7cQBKhRG0EtBLQCx0oHY47GU4DkmgM9xLAmqk9C2WV2nbM1wry2h2QBoJloUh7TvK4INyRTVCmn4TxbW8rlgEAUm1qiRM96r68xVm6ZmSgK_IbXH6i6w3JPtaue6KAsynFgxQ0zO3jOtW-mQ Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8c7136a8542b46e191366598596bf019 Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-810960670 Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:41:41.043478 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c7136a8542b46e191366598596bf019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8c7136a8542b46e191366598596bf019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8c7136a8542b46e191366598596bf019"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8c7136a8542b46e191366598596bf019", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-810960670 Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8c7136a8542b46e191366598596bf019 Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-810960670 Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerAddressesNegativeTestJSON-810960670-project Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: f9577c0a863043e3883bf4c456edb44c Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-810960670-project Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 could not be found. Sep 10 10:41:41.045000 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81'} Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 could not be found. Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:41:41.045885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 could not be found. Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 could not be found. Sep 10 10:41:41.049004 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:41.052467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] Returning 404 to user: Instance 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:41:41.054194 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-710b4b6f-6e5d-46ef-931f-23240728200a tempest-ServerAddressesNegativeTestJSON-810960670 tempest-ServerAddressesNegativeTestJSON-810960670-project] 10.222.0.20 "GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81" status: 404 len: 111 microversion: 2.1 time: 0.126191 Sep 10 10:41:41.061211 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 980/1486] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:40 2022] GET /compute/v2.1/servers/35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:41:41.084460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d1e45237-aa78-43ad-aaf1-2f5222d9b9c9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:41.086517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d1e45237-aa78-43ad-aaf1-2f5222d9b9c9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:41.097061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1e45237-aa78-43ad-aaf1-2f5222d9b9c9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:41.105112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1e45237-aa78-43ad-aaf1-2f5222d9b9c9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:41.106818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1e45237-aa78-43ad-aaf1-2f5222d9b9c9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:41.115161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1e45237-aa78-43ad-aaf1-2f5222d9b9c9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:41.117204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1e45237-aa78-43ad-aaf1-2f5222d9b9c9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:41.119620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1e45237-aa78-43ad-aaf1-2f5222d9b9c9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:41.525500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d1e45237-aa78-43ad-aaf1-2f5222d9b9c9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:41.539179 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d1e45237-aa78-43ad-aaf1-2f5222d9b9c9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1307 microversion: 2.1 time: 0.476004 Sep 10 10:41:41.540152 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 981/1487] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:41 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1307 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:41.546652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a1abb7ab-eeac-4df1-ba27-6b53218a9981 req-89200451-1005-4403-8fb8-273895c43e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f322918c-30a0-409f-9873-1cc3ba8ef4fe", "name": "network-vif-plugged", "status": "completed", "tag": "b986db73-3ae8-466b-b075-a8b7cf074dfc"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:41.564969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a1abb7ab-eeac-4df1-ba27-6b53218a9981 req-89200451-1005-4403-8fb8-273895c43e13 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:41.565784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a1abb7ab-eeac-4df1-ba27-6b53218a9981 req-89200451-1005-4403-8fb8-273895c43e13 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:41.566856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a1abb7ab-eeac-4df1-ba27-6b53218a9981 req-89200451-1005-4403-8fb8-273895c43e13 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:41.591770 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a1abb7ab-eeac-4df1-ba27-6b53218a9981 req-89200451-1005-4403-8fb8-273895c43e13 service nova] Creating event network-vif-plugged:b986db73-3ae8-466b-b075-a8b7cf074dfc for instance f322918c-30a0-409f-9873-1cc3ba8ef4fe on n-h2-856894-1 Sep 10 10:41:41.601369 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a1abb7ab-eeac-4df1-ba27-6b53218a9981 req-89200451-1005-4403-8fb8-273895c43e13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058265 Sep 10 10:41:41.609553 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 982/1488] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:41.619684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7ceb5fcd-6f02-493b-9406-c537f68291da req-a9bed577-9015-4b86-a002-29e7c1ffdf21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81", "name": "network-vif-deleted", "tag": "c8533e91-8d6a-4b58-a8a2-80156993685b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:41.645392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ceb5fcd-6f02-493b-9406-c537f68291da req-a9bed577-9015-4b86-a002-29e7c1ffdf21 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:41.648620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ceb5fcd-6f02-493b-9406-c537f68291da req-a9bed577-9015-4b86-a002-29e7c1ffdf21 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:41.652326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ceb5fcd-6f02-493b-9406-c537f68291da req-a9bed577-9015-4b86-a002-29e7c1ffdf21 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:41.681851 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7ceb5fcd-6f02-493b-9406-c537f68291da req-a9bed577-9015-4b86-a002-29e7c1ffdf21 service nova] Creating event network-vif-deleted:c8533e91-8d6a-4b58-a8a2-80156993685b for instance 35dabe8d-7ec9-4b55-8c4b-6b435c8a4e81 on n-h1-856894-1 Sep 10 10:41:41.701193 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7ceb5fcd-6f02-493b-9406-c537f68291da req-a9bed577-9015-4b86-a002-29e7c1ffdf21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088530 Sep 10 10:41:41.718328 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 983/1489] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:41.726097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:41.728149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:41.739930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:41.740954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:41.742035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:41.742928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:41.743564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:41.744183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:42.084758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:42.094942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:42.099252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:42.102759 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3beac6fc-4be8-4afb-a93b-7d9872b8d105 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1487 microversion: 2.25 time: 0.382912 Sep 10 10:41:42.107822 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 984/1490] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:41 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1487 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:42.117553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b0418c0-c3b2-4c1d-b7ca-611e9632f118 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:42.123552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b0418c0-c3b2-4c1d-b7ca-611e9632f118 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:42.139242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0418c0-c3b2-4c1d-b7ca-611e9632f118 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:42.141964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0418c0-c3b2-4c1d-b7ca-611e9632f118 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:42.143823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0418c0-c3b2-4c1d-b7ca-611e9632f118 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:42.147186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0418c0-c3b2-4c1d-b7ca-611e9632f118 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:42.148101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0418c0-c3b2-4c1d-b7ca-611e9632f118 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:42.148712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0418c0-c3b2-4c1d-b7ca-611e9632f118 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:42.519582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b0418c0-c3b2-4c1d-b7ca-611e9632f118 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:42.529624 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b0418c0-c3b2-4c1d-b7ca-611e9632f118 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 200 len: 1315 microversion: 2.1 time: 0.420425 Sep 10 10:41:42.532576 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 985/1491] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:42 2022] GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:42.558114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5246d2e8-053f-4de6-994d-a2624a90d17b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae3dc430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:42.648080 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5246d2e8-053f-4de6-994d-a2624a90d17b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1452 microversion: 2.1 time: 0.100510 Sep 10 10:41:42.659637 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 986/1492] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:42 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:42.676864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36997142-6be8-4f47-8ee5-4d9aea4aced5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:42.678318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36997142-6be8-4f47-8ee5-4d9aea4aced5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:42.716357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36997142-6be8-4f47-8ee5-4d9aea4aced5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:42.721758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36997142-6be8-4f47-8ee5-4d9aea4aced5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:42.723684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36997142-6be8-4f47-8ee5-4d9aea4aced5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:42.725782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36997142-6be8-4f47-8ee5-4d9aea4aced5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:42.730526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36997142-6be8-4f47-8ee5-4d9aea4aced5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:42.731254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36997142-6be8-4f47-8ee5-4d9aea4aced5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:43.161111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36997142-6be8-4f47-8ee5-4d9aea4aced5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:43.185719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36997142-6be8-4f47-8ee5-4d9aea4aced5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1307 microversion: 2.1 time: 0.505790 Sep 10 10:41:43.189790 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 987/1493] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:42 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1307 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:43.207570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:43.210156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:43.221259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:43.226319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:43.228631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:43.229695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:43.231480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:43.240410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:43.529270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:43.539842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:43.549679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:43.551367 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6d3a30c2-67c7-4d2e-8b41-beb6c7de7625 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1487 microversion: 2.25 time: 0.360220 Sep 10 10:41:43.555507 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 988/1494] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:43 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1487 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:43.562037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b853bdac-4a77-418a-a650-53868d012f80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:43.569587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b853bdac-4a77-418a-a650-53868d012f80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:43.583917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b853bdac-4a77-418a-a650-53868d012f80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:43.588763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b853bdac-4a77-418a-a650-53868d012f80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:43.590013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b853bdac-4a77-418a-a650-53868d012f80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:43.593342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b853bdac-4a77-418a-a650-53868d012f80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:43.594102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b853bdac-4a77-418a-a650-53868d012f80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:43.596951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b853bdac-4a77-418a-a650-53868d012f80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:43.937778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b853bdac-4a77-418a-a650-53868d012f80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:43.947436 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b853bdac-4a77-418a-a650-53868d012f80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 200 len: 1501 microversion: 2.1 time: 0.389137 Sep 10 10:41:43.968943 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 989/1495] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:43 2022] GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 1501 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:43.968943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-547a70d1-367d-40a9-ba57-3e7ce2dc5140 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae41c670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:44.086255 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-547a70d1-367d-40a9-ba57-3e7ce2dc5140 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1452 microversion: 2.1 time: 0.129984 Sep 10 10:41:44.094276 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 990/1496] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:43 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:44.112520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3fb34e3-6463-40bd-b6eb-3814455b3c3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:44.119739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c3fb34e3-6463-40bd-b6eb-3814455b3c3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:44.138892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fb34e3-6463-40bd-b6eb-3814455b3c3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:44.143351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fb34e3-6463-40bd-b6eb-3814455b3c3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:44.145673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fb34e3-6463-40bd-b6eb-3814455b3c3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:44.151120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fb34e3-6463-40bd-b6eb-3814455b3c3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:44.151942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fb34e3-6463-40bd-b6eb-3814455b3c3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:44.152622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fb34e3-6463-40bd-b6eb-3814455b3c3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:44.228862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c3fb34e3-6463-40bd-b6eb-3814455b3c3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:41:44.475686 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3fb34e3-6463-40bd-b6eb-3814455b3c3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 204 len: 0 microversion: 2.1 time: 0.387036 Sep 10 10:41:44.476499 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 991/1497] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:41:44 2022] DELETE /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:41:44.496737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c5b28fa4-c48c-41bf-a164-c6cf3113e3a2 req-e3e3b481-2e54-44fb-8964-eee2b23903b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbfd4c5-e209-4e86-a0dd-00738c53b9b3", "name": "network-vif-plugged", "status": "completed", "tag": "4348d2b9-1dca-4e41-826e-c604d9ea22da"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:44.514485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c5b28fa4-c48c-41bf-a164-c6cf3113e3a2 req-e3e3b481-2e54-44fb-8964-eee2b23903b3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:44.515826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c5b28fa4-c48c-41bf-a164-c6cf3113e3a2 req-e3e3b481-2e54-44fb-8964-eee2b23903b3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:44.516278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c5b28fa4-c48c-41bf-a164-c6cf3113e3a2 req-e3e3b481-2e54-44fb-8964-eee2b23903b3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:44.543342 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c5b28fa4-c48c-41bf-a164-c6cf3113e3a2 req-e3e3b481-2e54-44fb-8964-eee2b23903b3 service nova] Creating event network-vif-plugged:4348d2b9-1dca-4e41-826e-c604d9ea22da for instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 on n-h2-856894-1 Sep 10 10:41:44.549233 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c5b28fa4-c48c-41bf-a164-c6cf3113e3a2 req-e3e3b481-2e54-44fb-8964-eee2b23903b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066616 Sep 10 10:41:44.550235 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 992/1498] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:44.557780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c268c76-7920-4656-821c-fe643172324e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:44.558828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c268c76-7920-4656-821c-fe643172324e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:44.568620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c268c76-7920-4656-821c-fe643172324e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:44.569307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c268c76-7920-4656-821c-fe643172324e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:44.569852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c268c76-7920-4656-821c-fe643172324e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:44.570680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c268c76-7920-4656-821c-fe643172324e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:44.571277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c268c76-7920-4656-821c-fe643172324e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:44.571797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c268c76-7920-4656-821c-fe643172324e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:45.025108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9c268c76-7920-4656-821c-fe643172324e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:45.038278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:45.053043 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c268c76-7920-4656-821c-fe643172324e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1307 microversion: 2.1 time: 0.495404 Sep 10 10:41:45.065365 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 993/1499] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:44 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1307 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:45.338253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72dda615-8449-48fa-8ece-9d32758869fc tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] Action: 'create', calling method: .version_select at 0x7efcae3f6c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1844343542", "metadata": {"Type": "work"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:47.283427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:50.569101 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72dda615-8449-48fa-8ece-9d32758869fc tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 5.504947 Sep 10 10:41:50.569754 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 994/1500] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Sep 10 10:41:45 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 5513 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 10 10:41:50.583517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:50.585855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:50.601225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:50.601751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:50.602180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:50.602886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:50.607125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:50.607799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:50.640358 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe HTTP/1.1 Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:41:50.641979 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:41:50.644636 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f322918c-30a0-409f-9873-1cc3ba8ef4fe'} Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:41:50.645707 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:41:50.647198 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:41:50.650651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:41:50.651828 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d735167-02f3-40a4-bf63-e03b43d8c444 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 404 len: 111 microversion: 2.1 time: 0.073455 Sep 10 10:41:50.658048 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 995/1501] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:50 2022] GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:41:50.663662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-304243567", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "3c6c912e-f0c4-47dd-b364-f6175adea12a"}, {"uuid": "780e5746-482f-4a0e-b420-9869651aaa46"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:50.825158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] validate_networks() for [('3c6c912e-f0c4-47dd-b364-f6175adea12a', None, None, None, None, None), ('780e5746-482f-4a0e-b420-9869651aaa46', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:41:51.949745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:41:51.950345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:41:51.950643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:41:51.954840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:41:51.956007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:41:52.004923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:52.009477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:52.009958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:52.010742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:52.011211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:52.014340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:52.074038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Getting quotas for project ebcf75baac6d4be481406daf0dd81e1a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:41:52.091745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Getting quotas for user 47ee461c12bb4fae9792abbc067a71fa and project ebcf75baac6d4be481406daf0dd81e1a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:41:52.117293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:41:52.120084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:41:52.169476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:41:52.264066 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd3e82e6-df4e-45d8-a97e-248add215146 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604517 Sep 10 10:41:52.271042 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 996/1502] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:41:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:41:52.284153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:52.286993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:52.306277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:52.306775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:52.307284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:52.307915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:52.308564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:52.309243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:52.535927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:52.552245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:52.554326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:52.556364 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-257f29d9-e37a-4518-a708-7bf577ac81da tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1487 microversion: 2.25 time: 0.281793 Sep 10 10:41:52.556946 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 997/1503] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:52 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1487 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:52.563316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e6b5fbc-0e59-4238-a14d-5119a13401fa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae41c1f0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:52.652744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e6b5fbc-0e59-4238-a14d-5119a13401fa tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1452 microversion: 2.1 time: 0.094047 Sep 10 10:41:52.664149 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 998/1504] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:52 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:52.669672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d23d4bab-9ce1-4355-b42d-e98136d12d31 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:52.671331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d23d4bab-9ce1-4355-b42d-e98136d12d31 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:52.684356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23d4bab-9ce1-4355-b42d-e98136d12d31 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:52.685307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23d4bab-9ce1-4355-b42d-e98136d12d31 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:52.686512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23d4bab-9ce1-4355-b42d-e98136d12d31 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:52.688001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23d4bab-9ce1-4355-b42d-e98136d12d31 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:52.688698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23d4bab-9ce1-4355-b42d-e98136d12d31 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:52.689472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23d4bab-9ce1-4355-b42d-e98136d12d31 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:52.909142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d23d4bab-9ce1-4355-b42d-e98136d12d31 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:52.917903 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d23d4bab-9ce1-4355-b42d-e98136d12d31 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1486 microversion: 2.1 time: 0.252085 Sep 10 10:41:52.918505 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 999/1505] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:52 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1486 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:52.923096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e13481c8-ca90-46b1-92f4-ea81ef35d1e1 req-4ce56e99-b6a1-4fd2-9a8b-a1d04e199889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf886fd-0d8c-46b8-9afb-eec1edad2d96", "name": "network-vif-plugged", "status": "completed", "tag": "1b0e5ed5-e6b2-45f6-a1ac-df2eb4399a4b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:52.981431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e13481c8-ca90-46b1-92f4-ea81ef35d1e1 req-4ce56e99-b6a1-4fd2-9a8b-a1d04e199889 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:52.982502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e13481c8-ca90-46b1-92f4-ea81ef35d1e1 req-4ce56e99-b6a1-4fd2-9a8b-a1d04e199889 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:52.990745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e13481c8-ca90-46b1-92f4-ea81ef35d1e1 req-4ce56e99-b6a1-4fd2-9a8b-a1d04e199889 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:53.067507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e13481c8-ca90-46b1-92f4-ea81ef35d1e1 req-4ce56e99-b6a1-4fd2-9a8b-a1d04e199889 service nova] Creating event network-vif-plugged:1b0e5ed5-e6b2-45f6-a1ac-df2eb4399a4b for instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 on n-h2-856894-1 Sep 10 10:41:53.076170 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e13481c8-ca90-46b1-92f4-ea81ef35d1e1 req-4ce56e99-b6a1-4fd2-9a8b-a1d04e199889 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156412 Sep 10 10:41:53.077718 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1000/1506] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:53.083510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0e0936a1-88fb-4449-a723-625bdbf86081 req-40ceefc0-5860-445d-9fc7-4999df1494a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f322918c-30a0-409f-9873-1cc3ba8ef4fe", "name": "network-vif-deleted", "tag": "b986db73-3ae8-466b-b075-a8b7cf074dfc"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:53.096500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0e0936a1-88fb-4449-a723-625bdbf86081 req-40ceefc0-5860-445d-9fc7-4999df1494a9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:53.097038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0e0936a1-88fb-4449-a723-625bdbf86081 req-40ceefc0-5860-445d-9fc7-4999df1494a9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:53.097502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0e0936a1-88fb-4449-a723-625bdbf86081 req-40ceefc0-5860-445d-9fc7-4999df1494a9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:53.112185 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0e0936a1-88fb-4449-a723-625bdbf86081 req-40ceefc0-5860-445d-9fc7-4999df1494a9 service nova] Creating event network-vif-deleted:b986db73-3ae8-466b-b075-a8b7cf074dfc for instance f322918c-30a0-409f-9873-1cc3ba8ef4fe on n-h2-856894-1 Sep 10 10:41:53.119282 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0e0936a1-88fb-4449-a723-625bdbf86081 req-40ceefc0-5860-445d-9fc7-4999df1494a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039893 Sep 10 10:41:53.124064 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1001/1507] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:53.131599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8fe48f1-cc64-4834-b6ea-f32806a7c984 tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] Calling method '.version_select at 0x7efcae47e0d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:53.217559 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8fe48f1-cc64-4834-b6ea-f32806a7c984 tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9" status: 200 len: 354 microversion: 2.1 time: 0.090640 Sep 10 10:41:53.218789 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1002/1508] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:41:53 2022] GET /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:53.237268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1139888556", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "15abac29-c434-4802-9cd4-4bace1ac4f7e"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:53.348962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] validate_networks() for [('15abac29-c434-4802-9cd4-4bace1ac4f7e', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:41:53.902682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:41:53.903313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:41:53.903992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:41:53.904660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:41:53.905267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:41:53.921815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:53.922983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:53.923741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:53.927002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:53.927721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:53.928981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:53.952418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:41:53.959145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for user fa978e59fa334084b722d116c761380f and project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:41:53.978947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:41:53.998201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:41:54.130955 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dc6210ec-20f2-418f-931a-7c0dbb6da862 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899876 Sep 10 10:41:54.133263 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1003/1509] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:41:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:41:54.162356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-724a0707-ade6-47a6-98b8-74820c39c167 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:54.164789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-724a0707-ade6-47a6-98b8-74820c39c167 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:54.182074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724a0707-ade6-47a6-98b8-74820c39c167 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:54.182817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724a0707-ade6-47a6-98b8-74820c39c167 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:54.183448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724a0707-ade6-47a6-98b8-74820c39c167 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:54.184399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724a0707-ade6-47a6-98b8-74820c39c167 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:54.185017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724a0707-ade6-47a6-98b8-74820c39c167 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:54.186578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724a0707-ade6-47a6-98b8-74820c39c167 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:54.271614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-724a0707-ade6-47a6-98b8-74820c39c167 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:54.284015 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-724a0707-ade6-47a6-98b8-74820c39c167 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1272 microversion: 2.1 time: 0.146381 Sep 10 10:41:54.286567 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1004/1510] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:54 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:54.294402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f710b426-c057-46af-b4e9-38fe49e76ff8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:54.304017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f710b426-c057-46af-b4e9-38fe49e76ff8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:54.305235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f710b426-c057-46af-b4e9-38fe49e76ff8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:54.306254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f710b426-c057-46af-b4e9-38fe49e76ff8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:54.479920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f710b426-c057-46af-b4e9-38fe49e76ff8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Going to try to stop instance {{(pid=128788) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 10:41:54.578000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f710b426-c057-46af-b4e9-38fe49e76ff8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3/action" status: 202 len: 0 microversion: 2.1 time: 0.289806 Sep 10 10:41:54.579566 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1005/1511] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:41:54 2022] POST /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:41:54.602687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c48e557-8b22-4f0b-87b5-4cbb381d6878 tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] Calling method '.version_select at 0x7efcae3dc790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:54.734466 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c48e557-8b22-4f0b-87b5-4cbb381d6878 tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9" status: 200 len: 354 microversion: 2.1 time: 0.153162 Sep 10 10:41:54.735175 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1006/1512] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:41:54 2022] GET /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:54.741096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:54.741954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:54.762654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:54.771708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:54.775610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:54.777361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:54.778095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:54.779497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:55.321018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:55.335540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:55.337583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:55.339084 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e02297e6-04cc-476a-b721-ee168c81b5e5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1487 microversion: 2.25 time: 0.601877 Sep 10 10:41:55.345645 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1007/1513] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:54 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1487 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:55.351149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32b7ede4-fe61-4972-bdb2-3532bda3df11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae3f6820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:55.448295 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-32b7ede4-fe61-4972-bdb2-3532bda3df11 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1452 microversion: 2.1 time: 0.100872 Sep 10 10:41:55.459930 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1008/1514] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:55 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:55.465339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-679a6e67-079f-488c-bc12-c97ed21a592c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:55.465965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-679a6e67-079f-488c-bc12-c97ed21a592c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:55.474075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-679a6e67-079f-488c-bc12-c97ed21a592c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:55.474844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-679a6e67-079f-488c-bc12-c97ed21a592c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:55.475595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-679a6e67-079f-488c-bc12-c97ed21a592c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:55.476507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-679a6e67-079f-488c-bc12-c97ed21a592c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:55.477187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-679a6e67-079f-488c-bc12-c97ed21a592c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:55.477794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-679a6e67-079f-488c-bc12-c97ed21a592c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:55.599457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-679a6e67-079f-488c-bc12-c97ed21a592c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:55.610547 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-679a6e67-079f-488c-bc12-c97ed21a592c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1211 microversion: 2.1 time: 0.149316 Sep 10 10:41:55.613665 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1009/1515] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:55 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1211 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:55.641046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a3ca09d-ae1c-41bb-8eab-fe568167677e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:55.641708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a3ca09d-ae1c-41bb-8eab-fe568167677e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:55.663498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a3ca09d-ae1c-41bb-8eab-fe568167677e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:55.664142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a3ca09d-ae1c-41bb-8eab-fe568167677e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:55.668209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a3ca09d-ae1c-41bb-8eab-fe568167677e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:55.668209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a3ca09d-ae1c-41bb-8eab-fe568167677e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:55.668209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a3ca09d-ae1c-41bb-8eab-fe568167677e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:55.668209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a3ca09d-ae1c-41bb-8eab-fe568167677e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:56.314236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a3ca09d-ae1c-41bb-8eab-fe568167677e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:56.326562 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a3ca09d-ae1c-41bb-8eab-fe568167677e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1496 microversion: 2.1 time: 0.709721 Sep 10 10:41:56.328055 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1010/1516] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:55 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1496 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:56.334758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a842b5bc-a334-4dd7-9f2e-b22e74b0b0fc tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] Calling method '.version_select at 0x7efcae3c8160>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:56.456293 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a842b5bc-a334-4dd7-9f2e-b22e74b0b0fc tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9" status: 202 len: 0 microversion: 2.1 time: 0.124369 Sep 10 10:41:56.461048 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1011/1517] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:41:56 2022] DELETE /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:41:56.471332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90910c67-1f20-4a58-a21b-7ff5c132fb2e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:56.474380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-90910c67-1f20-4a58-a21b-7ff5c132fb2e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:56.481913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90910c67-1f20-4a58-a21b-7ff5c132fb2e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:56.482879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90910c67-1f20-4a58-a21b-7ff5c132fb2e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:56.483488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90910c67-1f20-4a58-a21b-7ff5c132fb2e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:56.484454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90910c67-1f20-4a58-a21b-7ff5c132fb2e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:56.485176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90910c67-1f20-4a58-a21b-7ff5c132fb2e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:56.487808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90910c67-1f20-4a58-a21b-7ff5c132fb2e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:57.423267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-90910c67-1f20-4a58-a21b-7ff5c132fb2e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:57.440333 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90910c67-1f20-4a58-a21b-7ff5c132fb2e tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1312 microversion: 2.1 time: 0.975969 Sep 10 10:41:57.441109 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1012/1518] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:56 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1312 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:57.453518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b340690f-c25f-4c1f-8172-e4bd99b562b0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:57.454657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b340690f-c25f-4c1f-8172-e4bd99b562b0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:57.473759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b340690f-c25f-4c1f-8172-e4bd99b562b0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:57.474369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b340690f-c25f-4c1f-8172-e4bd99b562b0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:57.475032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b340690f-c25f-4c1f-8172-e4bd99b562b0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:57.475847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b340690f-c25f-4c1f-8172-e4bd99b562b0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:57.477455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b340690f-c25f-4c1f-8172-e4bd99b562b0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:57.479126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b340690f-c25f-4c1f-8172-e4bd99b562b0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:57.832543 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b340690f-c25f-4c1f-8172-e4bd99b562b0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1859 microversion: 2.1 time: 0.389059 Sep 10 10:41:57.838545 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1013/1519] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:57 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1859 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:57.853561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:57.855626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:57.871472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:57.872058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:57.872510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:57.874561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:57.875059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:57.875503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:58.366105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:58.383298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:58.389178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:58.390648 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ffd4aadf-d50e-4942-9b68-69859aba3451 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1487 microversion: 2.25 time: 0.548655 Sep 10 10:41:58.419665 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1014/1520] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:41:57 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1487 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:41:58.430440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ca10eba-8933-4d62-8675-4041da44f207 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae38f8b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:58.569196 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ca10eba-8933-4d62-8675-4041da44f207 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1452 microversion: 2.1 time: 0.157943 Sep 10 10:41:58.569451 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1015/1521] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:41:58 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:58.579314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1cebb9d8-3822-40f1-92b7-6b2a386d111a tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] Calling method '.version_select at 0x7efcae3739d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:58.772584 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1cebb9d8-3822-40f1-92b7-6b2a386d111a tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9" status: 200 len: 353 microversion: 2.1 time: 0.201953 Sep 10 10:41:58.779824 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1016/1522] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:41:58 2022] GET /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:41:58.784900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26793705-9572-4116-bf86-b49e317e18bf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:58.785740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26793705-9572-4116-bf86-b49e317e18bf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:58.816561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26793705-9572-4116-bf86-b49e317e18bf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:58.817064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26793705-9572-4116-bf86-b49e317e18bf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:58.822465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26793705-9572-4116-bf86-b49e317e18bf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:58.823246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26793705-9572-4116-bf86-b49e317e18bf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:58.824590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26793705-9572-4116-bf86-b49e317e18bf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:58.825605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26793705-9572-4116-bf86-b49e317e18bf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:59.046509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-26793705-9572-4116-bf86-b49e317e18bf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:59.056766 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26793705-9572-4116-bf86-b49e317e18bf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1273 microversion: 2.1 time: 0.275299 Sep 10 10:41:59.057102 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1017/1523] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:58 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:59.092301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5b943c0-9a15-4546-b70b-c9bdb8d23373 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:41:59.092932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f5b943c0-9a15-4546-b70b-c9bdb8d23373 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:59.118056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5b943c0-9a15-4546-b70b-c9bdb8d23373 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:59.118571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5b943c0-9a15-4546-b70b-c9bdb8d23373 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:59.119011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5b943c0-9a15-4546-b70b-c9bdb8d23373 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:59.121206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5b943c0-9a15-4546-b70b-c9bdb8d23373 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:59.124291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5b943c0-9a15-4546-b70b-c9bdb8d23373 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:59.125133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5b943c0-9a15-4546-b70b-c9bdb8d23373 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:59.518363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f5b943c0-9a15-4546-b70b-c9bdb8d23373 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:41:59.531231 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f5b943c0-9a15-4546-b70b-c9bdb8d23373 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1496 microversion: 2.1 time: 0.463632 Sep 10 10:41:59.549280 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1018/1524] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:41:59 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1496 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:41:59.581741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-856894-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:41:59.594697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:41:59.619542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:59.620039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:59.620491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:59.633457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:41:59.634153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:41:59.635057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:41:59.735331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lazy-loading 'flavor' on Instance uuid 1b5815be-a9f4-4a13-846f-d2f2d7384e00 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:41:59.762027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Going to try to live migrate instance to n-h2-856894-1 {{(pid=128788) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 10:41:59.837061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:03.213441 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51cf4f09-6757-4ce2-af04-c5433b2ae5be tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/action" status: 202 len: 0 microversion: 2.1 time: 3.654401 Sep 10 10:42:03.214212 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1019/1525] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:41:59 2022] POST /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/action => generated 0 bytes in 3663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:42:03.219822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27692520-ef21-4560-825c-559a154d484b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:03.220839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-27692520-ef21-4560-825c-559a154d484b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:03.269173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27692520-ef21-4560-825c-559a154d484b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:03.270153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27692520-ef21-4560-825c-559a154d484b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:03.274915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27692520-ef21-4560-825c-559a154d484b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:03.275829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27692520-ef21-4560-825c-559a154d484b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:03.282029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27692520-ef21-4560-825c-559a154d484b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:03.284133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27692520-ef21-4560-825c-559a154d484b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:03.756735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-27692520-ef21-4560-825c-559a154d484b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:03.783014 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27692520-ef21-4560-825c-559a154d484b tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1333 microversion: 2.1 time: 0.561882 Sep 10 10:42:03.795591 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1020/1526] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:03 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1333 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:03.803788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:03.816792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:03.835180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:03.836404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:03.836956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:03.854625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:03.855420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:03.856825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:03.944354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:03.967808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:04.143708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:04.152300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:04.153806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:04.155005 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d8393c6-f6f2-4e19-bfc3-a14090ca5651 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1487 microversion: 2.25 time: 0.355703 Sep 10 10:42:04.169104 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1021/1527] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:03 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1487 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:04.190968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73b1269b-185e-4e99-a459-84d9c3d39712 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae30d4c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:04.278693 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73b1269b-185e-4e99-a459-84d9c3d39712 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1452 microversion: 2.1 time: 0.108131 Sep 10 10:42:04.280438 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1022/1528] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:04 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:04.291583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b15db84a-5b6f-4944-8683-81d2211cd832 tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] Calling method '.version_select at 0x7efcae47e430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:04.365637 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b15db84a-5b6f-4944-8683-81d2211cd832 tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] HTTP exception thrown: Volume 99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 could not be found. Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b15db84a-5b6f-4944-8683-81d2211cd832 tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] Request method failure captured: Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 HTTP/1.1 Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnoWd5HOrw_y0zIyTOk3zI5iAUqywIx9yJT_8gEpPxwqjg8lAQGCufbcWKj7pC2PSud-DJRr_P9bpBqM4O2mWci3PzHlZYJtSVzIau0jn9l4QzE8h8QPad3XGTma9O3LBv0dHcksfUZn6hW3AX2afQDhLbWnv36xya3wX3VbPo8ixU Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: f84721eecf9a4236ac6b1e8194f581ed Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesGetTestJSON-1613290109 Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:04.367802 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f84721eecf9a4236ac6b1e8194f581ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f84721eecf9a4236ac6b1e8194f581ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f84721eecf9a4236ac6b1e8194f581ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f84721eecf9a4236ac6b1e8194f581ed", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesGetTestJSON-1613290109 Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: f84721eecf9a4236ac6b1e8194f581ed Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesGetTestJSON-1613290109 Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesGetTestJSON-1613290109-project Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 995c8d4fe1ec4de69a9403783b13b413 Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesGetTestJSON-1613290109-project Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: exception: Volume 99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 could not be found. Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '99bef4fb-573a-48a8-8bf3-7a9bc5b355e9'} Sep 10 10:42:04.369694 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 could not be found. (HTTP 404) (Request-ID: req-e784bad9-9142-48a8-a642-9e35c02e837e) Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:04.370628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 10:42:04.371924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 could not be found. Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 10:42:04.373249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 could not be found. Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 could not be found. Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b15db84a-5b6f-4944-8683-81d2211cd832 tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] Returning 404 to user: Volume 99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b15db84a-5b6f-4944-8683-81d2211cd832 tempest-VolumesGetTestJSON-1613290109 tempest-VolumesGetTestJSON-1613290109-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9" status: 404 len: 109 microversion: 2.1 time: 0.088489 Sep 10 10:42:04.375710 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1023/1529] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:42:04 2022] GET /compute/v2.1/os-volumes/99bef4fb-573a-48a8-8bf3-7a9bc5b355e9 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:42:04.378480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5824864-f3db-4b14-8c8c-f506926b7e37 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:04.378480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f5824864-f3db-4b14-8c8c-f506926b7e37 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:04.407200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5824864-f3db-4b14-8c8c-f506926b7e37 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:04.407704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5824864-f3db-4b14-8c8c-f506926b7e37 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:04.414701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5824864-f3db-4b14-8c8c-f506926b7e37 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:04.415471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5824864-f3db-4b14-8c8c-f506926b7e37 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:04.418827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5824864-f3db-4b14-8c8c-f506926b7e37 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:04.423230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5824864-f3db-4b14-8c8c-f506926b7e37 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:04.820953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f5824864-f3db-4b14-8c8c-f506926b7e37 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:04.861469 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f5824864-f3db-4b14-8c8c-f506926b7e37 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1315 microversion: 2.1 time: 0.486943 Sep 10 10:42:04.865981 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1024/1530] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:04 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:04.889041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9dd5cb5d-53d1-4b33-a1c7-c0f0a4560daf tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:04.890844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9dd5cb5d-53d1-4b33-a1c7-c0f0a4560daf tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:04.922919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9dd5cb5d-53d1-4b33-a1c7-c0f0a4560daf tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:04.927455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9dd5cb5d-53d1-4b33-a1c7-c0f0a4560daf tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:04.929490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9dd5cb5d-53d1-4b33-a1c7-c0f0a4560daf tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:04.940739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9dd5cb5d-53d1-4b33-a1c7-c0f0a4560daf tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:04.941867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9dd5cb5d-53d1-4b33-a1c7-c0f0a4560daf tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:04.943156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9dd5cb5d-53d1-4b33-a1c7-c0f0a4560daf tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:05.607983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9dd5cb5d-53d1-4b33-a1c7-c0f0a4560daf tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:05.626481 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9dd5cb5d-53d1-4b33-a1c7-c0f0a4560daf tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1496 microversion: 2.1 time: 0.757809 Sep 10 10:42:05.630576 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1025/1531] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:04 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1496 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:05.645542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e06776b1-9681-410d-91b1-03514929f44f req-1e9d824e-7acc-42e1-939f-00c5c2c34504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb025b0-229f-4423-847a-851bbdddc697", "tag": "c27a5c35-d97c-4cd1-b95f-b60ade027d46"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:05.672618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e06776b1-9681-410d-91b1-03514929f44f req-1e9d824e-7acc-42e1-939f-00c5c2c34504 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:05.673994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e06776b1-9681-410d-91b1-03514929f44f req-1e9d824e-7acc-42e1-939f-00c5c2c34504 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:05.676476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e06776b1-9681-410d-91b1-03514929f44f req-1e9d824e-7acc-42e1-939f-00c5c2c34504 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:05.735892 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e06776b1-9681-410d-91b1-03514929f44f req-1e9d824e-7acc-42e1-939f-00c5c2c34504 service nova] Creating event network-changed:c27a5c35-d97c-4cd1-b95f-b60ade027d46 for instance efb025b0-229f-4423-847a-851bbdddc697 on n-h1-856894-1 Sep 10 10:42:05.744337 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e06776b1-9681-410d-91b1-03514929f44f req-1e9d824e-7acc-42e1-939f-00c5c2c34504 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112136 Sep 10 10:42:05.745749 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1026/1532] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:05.751955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d2b2b2f-6d9b-453d-898c-5a6daf2552b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:05.753895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d2b2b2f-6d9b-453d-898c-5a6daf2552b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:05.778557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d2b2b2f-6d9b-453d-898c-5a6daf2552b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:05.779633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d2b2b2f-6d9b-453d-898c-5a6daf2552b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:05.780446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d2b2b2f-6d9b-453d-898c-5a6daf2552b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:05.781454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d2b2b2f-6d9b-453d-898c-5a6daf2552b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:05.782183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d2b2b2f-6d9b-453d-898c-5a6daf2552b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:05.782905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d2b2b2f-6d9b-453d-898c-5a6daf2552b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:06.646367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d2b2b2f-6d9b-453d-898c-5a6daf2552b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:06.670025 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d2b2b2f-6d9b-453d-898c-5a6daf2552b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.920038 Sep 10 10:42:06.697123 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1027/1533] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:05 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:06.710144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-627ee1ad-f647-498f-9855-e4d7d15c80f1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:06.711139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-627ee1ad-f647-498f-9855-e4d7d15c80f1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:06.730880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-627ee1ad-f647-498f-9855-e4d7d15c80f1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:06.734548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-627ee1ad-f647-498f-9855-e4d7d15c80f1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:06.736132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-627ee1ad-f647-498f-9855-e4d7d15c80f1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:06.739785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-627ee1ad-f647-498f-9855-e4d7d15c80f1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:06.740502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-627ee1ad-f647-498f-9855-e4d7d15c80f1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:06.742581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-627ee1ad-f647-498f-9855-e4d7d15c80f1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:07.120931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-627ee1ad-f647-498f-9855-e4d7d15c80f1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:07.137811 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-627ee1ad-f647-498f-9855-e4d7d15c80f1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1333 microversion: 2.1 time: 0.439173 Sep 10 10:42:07.139123 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1028/1534] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:06 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1333 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:07.150551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:07.156902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:07.166027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:07.167553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:07.168181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:07.169281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:07.170038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:07.170774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:07.585193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:07.598813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:07.600277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:07.601473 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ce29f6c1-3cc6-4bf3-bcec-7d11b8829876 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1487 microversion: 2.25 time: 0.455541 Sep 10 10:42:07.602045 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1029/1535] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:07 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1487 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:07.650423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52a64b12-6698-4c02-b338-235ee94dad1f tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae373b80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:07.732196 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-52a64b12-6698-4c02-b338-235ee94dad1f tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1452 microversion: 2.1 time: 0.097749 Sep 10 10:42:07.734058 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1030/1536] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:07 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:08.189250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-664994444", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:08.267230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] validate_networks() for [('3020c12f-204d-40ae-a6ef-8e794c078d83', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:42:08.750533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:42:08.753130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:42:08.753833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:42:08.754738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:42:08.755172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:42:08.765353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:08.765906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:08.766351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:08.767080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:08.767528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:08.768475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:08.788496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Getting quotas for project 74bdbf1662bc4efd8059ff5ad298b4ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:42:08.794067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Getting quotas for user 0d28bb8f4375492681e5b4b30f1ca413 and project 74bdbf1662bc4efd8059ff5ad298b4ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:42:08.807160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:42:08.809450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:42:08.857567 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f43b7227-b89e-448a-a1ab-be13ae635711 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122122 Sep 10 10:42:08.858189 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1031/1537] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:42:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:42:08.863150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a2603cc-9306-41c8-bb8f-fc00fec83f44 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:08.863983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a2603cc-9306-41c8-bb8f-fc00fec83f44 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:08.870762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a2603cc-9306-41c8-bb8f-fc00fec83f44 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:08.871344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a2603cc-9306-41c8-bb8f-fc00fec83f44 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:08.871785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a2603cc-9306-41c8-bb8f-fc00fec83f44 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:08.872495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a2603cc-9306-41c8-bb8f-fc00fec83f44 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:08.872982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a2603cc-9306-41c8-bb8f-fc00fec83f44 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:08.873619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a2603cc-9306-41c8-bb8f-fc00fec83f44 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:09.084502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a2603cc-9306-41c8-bb8f-fc00fec83f44 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:09.108429 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a2603cc-9306-41c8-bb8f-fc00fec83f44 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1315 microversion: 2.1 time: 0.248690 Sep 10 10:42:09.118755 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1032/1538] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:08 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:09.138505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-003d9e47-e719-401f-ac8b-6eead09afa52 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:09.140361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-003d9e47-e719-401f-ac8b-6eead09afa52 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:09.152788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003d9e47-e719-401f-ac8b-6eead09afa52 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:09.153360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003d9e47-e719-401f-ac8b-6eead09afa52 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:09.153840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003d9e47-e719-401f-ac8b-6eead09afa52 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:09.154613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003d9e47-e719-401f-ac8b-6eead09afa52 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:09.155078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003d9e47-e719-401f-ac8b-6eead09afa52 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:09.155474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003d9e47-e719-401f-ac8b-6eead09afa52 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:09.356604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-003d9e47-e719-401f-ac8b-6eead09afa52 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:09.366817 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-003d9e47-e719-401f-ac8b-6eead09afa52 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1496 microversion: 2.1 time: 0.248029 Sep 10 10:42:09.368099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1033/1539] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:09 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1496 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:09.373236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-211c14fb-5c10-4cb4-b0b5-61f0e1183e01 req-bf242967-0441-4e81-b7c7-b13228b9113b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e", "name": "network-vif-unplugged", "status": "completed", "tag": "a1e0c35c-8322-4531-8a36-a9889a2f4bf6"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:09.387119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-211c14fb-5c10-4cb4-b0b5-61f0e1183e01 req-bf242967-0441-4e81-b7c7-b13228b9113b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:09.387973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-211c14fb-5c10-4cb4-b0b5-61f0e1183e01 req-bf242967-0441-4e81-b7c7-b13228b9113b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:09.388541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-211c14fb-5c10-4cb4-b0b5-61f0e1183e01 req-bf242967-0441-4e81-b7c7-b13228b9113b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:09.403041 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-211c14fb-5c10-4cb4-b0b5-61f0e1183e01 req-bf242967-0441-4e81-b7c7-b13228b9113b service nova] Creating event network-vif-unplugged:a1e0c35c-8322-4531-8a36-a9889a2f4bf6 for instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e on n-h1-856894-1 Sep 10 10:42:09.408604 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-211c14fb-5c10-4cb4-b0b5-61f0e1183e01 req-bf242967-0441-4e81-b7c7-b13228b9113b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039264 Sep 10 10:42:09.409485 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1034/1540] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:09.415732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f546a6b1-59d5-4b00-b1cb-7bd8162307ea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:09.416442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f546a6b1-59d5-4b00-b1cb-7bd8162307ea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:09.424610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f546a6b1-59d5-4b00-b1cb-7bd8162307ea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:09.425236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f546a6b1-59d5-4b00-b1cb-7bd8162307ea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:09.425682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f546a6b1-59d5-4b00-b1cb-7bd8162307ea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:09.426767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f546a6b1-59d5-4b00-b1cb-7bd8162307ea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:09.427233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f546a6b1-59d5-4b00-b1cb-7bd8162307ea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:09.427921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f546a6b1-59d5-4b00-b1cb-7bd8162307ea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:09.581148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f546a6b1-59d5-4b00-b1cb-7bd8162307ea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:09.590608 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f546a6b1-59d5-4b00-b1cb-7bd8162307ea tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.179599 Sep 10 10:42:09.605550 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1035/1541] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:09 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:09.613732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1fff3f9d-4e6e-4d5d-9f16-561796b61aae req-dc912e7e-1215-4845-bc10-46aa1120114c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20059d23-e6d5-4140-ac67-7ebf9534febc", "tag": "3431f20f-3f1d-4d78-b1c5-efe9c1726cc1"}, {"name": "network-changed", "server_uuid": "efb025b0-229f-4423-847a-851bbdddc697", "tag": "4bea308d-e61c-4f8e-8df6-c5eeb68bb884"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:09.625033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1fff3f9d-4e6e-4d5d-9f16-561796b61aae req-dc912e7e-1215-4845-bc10-46aa1120114c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:09.625880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1fff3f9d-4e6e-4d5d-9f16-561796b61aae req-dc912e7e-1215-4845-bc10-46aa1120114c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:09.626546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1fff3f9d-4e6e-4d5d-9f16-561796b61aae req-dc912e7e-1215-4845-bc10-46aa1120114c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:09.641034 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1fff3f9d-4e6e-4d5d-9f16-561796b61aae req-dc912e7e-1215-4845-bc10-46aa1120114c service nova] Creating event network-changed:3431f20f-3f1d-4d78-b1c5-efe9c1726cc1 for instance 20059d23-e6d5-4140-ac67-7ebf9534febc on n-h2-856894-1 Sep 10 10:42:09.641932 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1fff3f9d-4e6e-4d5d-9f16-561796b61aae req-dc912e7e-1215-4845-bc10-46aa1120114c service nova] Creating event network-changed:4bea308d-e61c-4f8e-8df6-c5eeb68bb884 for instance efb025b0-229f-4423-847a-851bbdddc697 on n-h1-856894-1 Sep 10 10:42:09.653718 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1fff3f9d-4e6e-4d5d-9f16-561796b61aae req-dc912e7e-1215-4845-bc10-46aa1120114c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046712 Sep 10 10:42:09.654469 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1036/1542] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:09.663058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-572c23a4-ba4a-4531-ba52-7b5cb2511914 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:09.663776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-572c23a4-ba4a-4531-ba52-7b5cb2511914 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:09.670453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-572c23a4-ba4a-4531-ba52-7b5cb2511914 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:09.671295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-572c23a4-ba4a-4531-ba52-7b5cb2511914 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:09.671892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-572c23a4-ba4a-4531-ba52-7b5cb2511914 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:09.672775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-572c23a4-ba4a-4531-ba52-7b5cb2511914 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:09.673513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-572c23a4-ba4a-4531-ba52-7b5cb2511914 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:09.674693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-572c23a4-ba4a-4531-ba52-7b5cb2511914 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:09.955721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-572c23a4-ba4a-4531-ba52-7b5cb2511914 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:09.965459 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-572c23a4-ba4a-4531-ba52-7b5cb2511914 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1333 microversion: 2.1 time: 0.309485 Sep 10 10:42:09.977573 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1037/1543] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:09 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1333 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:09.987816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:09.988677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:09.995689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:09.996385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:09.996991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:09.997900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:09.998516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:09.999104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:10.344954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:10.356289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:10.357670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:10.358819 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4523637a-1d9c-4d88-ab29-6a66bff2eff1 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1487 microversion: 2.25 time: 0.375075 Sep 10 10:42:10.373770 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1038/1544] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:09 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1487 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:10.373770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b995365c-4ad3-4900-944f-31f3e0f93bf8 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae37aca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:10.490721 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b995365c-4ad3-4900-944f-31f3e0f93bf8 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1461 microversion: 2.1 time: 0.123590 Sep 10 10:42:10.491467 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1039/1545] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:10 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1461 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:10.496045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d5d89391-85b7-4d5b-a439-b259e8f45a38 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:10.496846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d5d89391-85b7-4d5b-a439-b259e8f45a38 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:10.517597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5d89391-85b7-4d5b-a439-b259e8f45a38 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:10.518483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5d89391-85b7-4d5b-a439-b259e8f45a38 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:10.519172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5d89391-85b7-4d5b-a439-b259e8f45a38 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:10.520429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5d89391-85b7-4d5b-a439-b259e8f45a38 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:10.521265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5d89391-85b7-4d5b-a439-b259e8f45a38 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:10.522075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5d89391-85b7-4d5b-a439-b259e8f45a38 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:10.655151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d5d89391-85b7-4d5b-a439-b259e8f45a38 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d28bb8f4375492681e5b4b30f1ca413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bdbf1662bc4efd8059ff5ad298b4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:10.676572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d5d89391-85b7-4d5b-a439-b259e8f45a38 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 200 len: 1283 microversion: 2.1 time: 0.181590 Sep 10 10:42:10.681207 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1040/1546] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:10 2022] GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 1283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:10.694093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-022e9cb6-6f83-4697-8a52-27ecaea12f0e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:10.697919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-022e9cb6-6f83-4697-8a52-27ecaea12f0e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:10.716317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022e9cb6-6f83-4697-8a52-27ecaea12f0e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:10.716924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022e9cb6-6f83-4697-8a52-27ecaea12f0e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:10.717619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022e9cb6-6f83-4697-8a52-27ecaea12f0e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:10.718572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022e9cb6-6f83-4697-8a52-27ecaea12f0e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:10.719225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022e9cb6-6f83-4697-8a52-27ecaea12f0e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:10.719846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022e9cb6-6f83-4697-8a52-27ecaea12f0e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:10.985632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-022e9cb6-6f83-4697-8a52-27ecaea12f0e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:10.995095 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-022e9cb6-6f83-4697-8a52-27ecaea12f0e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1315 microversion: 2.1 time: 0.312439 Sep 10 10:42:11.010710 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1041/1547] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:10 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:11.015804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad09785e-2064-4a13-aea1-caffd1e6c172 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:11.016425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ad09785e-2064-4a13-aea1-caffd1e6c172 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:11.022809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:11.025265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad09785e-2064-4a13-aea1-caffd1e6c172 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:11.026036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad09785e-2064-4a13-aea1-caffd1e6c172 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:11.026758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad09785e-2064-4a13-aea1-caffd1e6c172 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:11.027568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad09785e-2064-4a13-aea1-caffd1e6c172 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:11.028061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad09785e-2064-4a13-aea1-caffd1e6c172 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:11.028713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad09785e-2064-4a13-aea1-caffd1e6c172 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:11.034948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:11.259458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ad09785e-2064-4a13-aea1-caffd1e6c172 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:11.271062 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad09785e-2064-4a13-aea1-caffd1e6c172 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 200 len: 1473 microversion: 2.1 time: 0.259131 Sep 10 10:42:11.285096 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1042/1548] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:11 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 1473 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:11.285096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1420d294-13bc-4f7b-a14e-095e3c9302ef tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae3f6ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:11.366478 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1420d294-13bc-4f7b-a14e-095e3c9302ef tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e5dc43da-1b03-43cb-86f3-d3be7881b07b" status: 200 len: 350 microversion: 2.1 time: 0.092889 Sep 10 10:42:11.367502 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1043/1549] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:42:11 2022] GET /compute/v2.1/os-volumes/e5dc43da-1b03-43cb-86f3-d3be7881b07b => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:11.372574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ca708d90-25e4-403b-b5c8-8a5265a49a7a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae38fe50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:11.454336 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ca708d90-25e4-403b-b5c8-8a5265a49a7a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 200 len: 1461 microversion: 2.1 time: 0.081619 Sep 10 10:42:11.455663 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1044/1550] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:11 2022] GET /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 1461 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:11.469132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-497d4fdf-9b79-4aa4-add0-3289d4ed724c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:11.470014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-497d4fdf-9b79-4aa4-add0-3289d4ed724c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:11.489275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-497d4fdf-9b79-4aa4-add0-3289d4ed724c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:11.489776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-497d4fdf-9b79-4aa4-add0-3289d4ed724c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:11.490218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-497d4fdf-9b79-4aa4-add0-3289d4ed724c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:11.490924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-497d4fdf-9b79-4aa4-add0-3289d4ed724c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:11.491378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-497d4fdf-9b79-4aa4-add0-3289d4ed724c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:11.491804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-497d4fdf-9b79-4aa4-add0-3289d4ed724c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:11.750752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-497d4fdf-9b79-4aa4-add0-3289d4ed724c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:11.774772 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-497d4fdf-9b79-4aa4-add0-3289d4ed724c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.315140 Sep 10 10:42:11.777634 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1045/1551] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:11 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:11.803468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-58e76bae-3bb3-4d08-a46e-a3f5d63ef6c3 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:11.803468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-58e76bae-3bb3-4d08-a46e-a3f5d63ef6c3 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:11.813653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58e76bae-3bb3-4d08-a46e-a3f5d63ef6c3 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:11.815484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58e76bae-3bb3-4d08-a46e-a3f5d63ef6c3 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:11.817372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58e76bae-3bb3-4d08-a46e-a3f5d63ef6c3 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:11.820087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58e76bae-3bb3-4d08-a46e-a3f5d63ef6c3 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:11.820568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58e76bae-3bb3-4d08-a46e-a3f5d63ef6c3 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:11.821003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58e76bae-3bb3-4d08-a46e-a3f5d63ef6c3 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:12.225964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-58e76bae-3bb3-4d08-a46e-a3f5d63ef6c3 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:12.239766 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-58e76bae-3bb3-4d08-a46e-a3f5d63ef6c3 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1333 microversion: 2.1 time: 0.459089 Sep 10 10:42:12.241713 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1046/1552] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:11 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1333 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:12.256601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-417fc913-ceb2-411e-86c0-cccd6dcb3c08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-428437689"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:12.259808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-417fc913-ceb2-411e-86c0-cccd6dcb3c08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:12.288992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-417fc913-ceb2-411e-86c0-cccd6dcb3c08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:12.291842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-417fc913-ceb2-411e-86c0-cccd6dcb3c08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:12.292681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-417fc913-ceb2-411e-86c0-cccd6dcb3c08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:12.294825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-417fc913-ceb2-411e-86c0-cccd6dcb3c08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:12.296813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-417fc913-ceb2-411e-86c0-cccd6dcb3c08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:12.298616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-417fc913-ceb2-411e-86c0-cccd6dcb3c08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:12.604042 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-417fc913-ceb2-411e-86c0-cccd6dcb3c08 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3/action" status: 202 len: 0 microversion: 2.1 time: 0.356761 Sep 10 10:42:12.609728 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1047/1553] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:42:12 2022] POST /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 10:42:12.617493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:12.618470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:12.627920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:12.628366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:12.628812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:12.629548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:12.630830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:12.631265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:12.945758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:12.957008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:12.962391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:12.963675 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c5bbac18-1048-43df-9db3-2bd66490aaf7 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1487 microversion: 2.25 time: 0.352203 Sep 10 10:42:12.964266 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1048/1554] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:12 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1487 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:12.994621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-bfa2b5ec-0ad1-43c5-88f6-4dd9bf9b82e6 req-195cbd2e-2f40-4d3a-9f5a-acbe61ac5f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e", "tag": "a1e0c35c-8322-4531-8a36-a9889a2f4bf6"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:13.009981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bfa2b5ec-0ad1-43c5-88f6-4dd9bf9b82e6 req-195cbd2e-2f40-4d3a-9f5a-acbe61ac5f03 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:13.010766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bfa2b5ec-0ad1-43c5-88f6-4dd9bf9b82e6 req-195cbd2e-2f40-4d3a-9f5a-acbe61ac5f03 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:13.011561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bfa2b5ec-0ad1-43c5-88f6-4dd9bf9b82e6 req-195cbd2e-2f40-4d3a-9f5a-acbe61ac5f03 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:13.028356 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-bfa2b5ec-0ad1-43c5-88f6-4dd9bf9b82e6 req-195cbd2e-2f40-4d3a-9f5a-acbe61ac5f03 service nova] Creating event network-changed:a1e0c35c-8322-4531-8a36-a9889a2f4bf6 for instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e on n-h1-856894-1 Sep 10 10:42:13.034658 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-bfa2b5ec-0ad1-43c5-88f6-4dd9bf9b82e6 req-195cbd2e-2f40-4d3a-9f5a-acbe61ac5f03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054493 Sep 10 10:42:13.035862 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1049/1555] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:13.041610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-022a89b1-6ecc-4b7b-8e16-7c3d60400eb9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:13.042906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-022a89b1-6ecc-4b7b-8e16-7c3d60400eb9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:13.051013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022a89b1-6ecc-4b7b-8e16-7c3d60400eb9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:13.051831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022a89b1-6ecc-4b7b-8e16-7c3d60400eb9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:13.052536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022a89b1-6ecc-4b7b-8e16-7c3d60400eb9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:13.053484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022a89b1-6ecc-4b7b-8e16-7c3d60400eb9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:13.054347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022a89b1-6ecc-4b7b-8e16-7c3d60400eb9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:13.055070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-022a89b1-6ecc-4b7b-8e16-7c3d60400eb9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:13.350049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-022a89b1-6ecc-4b7b-8e16-7c3d60400eb9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:13.362010 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-022a89b1-6ecc-4b7b-8e16-7c3d60400eb9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 1467 microversion: 2.1 time: 0.324379 Sep 10 10:42:13.366198 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1050/1556] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:13 2022] GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 1467 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:13.371160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51267616-a381-4d0f-8f4e-dad3f032c7f2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:13.372161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51267616-a381-4d0f-8f4e-dad3f032c7f2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:13.389776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51267616-a381-4d0f-8f4e-dad3f032c7f2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:13.390487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51267616-a381-4d0f-8f4e-dad3f032c7f2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:13.391027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51267616-a381-4d0f-8f4e-dad3f032c7f2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:13.391879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51267616-a381-4d0f-8f4e-dad3f032c7f2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:13.392624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51267616-a381-4d0f-8f4e-dad3f032c7f2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:13.393531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51267616-a381-4d0f-8f4e-dad3f032c7f2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:13.663048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-51267616-a381-4d0f-8f4e-dad3f032c7f2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d28bb8f4375492681e5b4b30f1ca413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bdbf1662bc4efd8059ff5ad298b4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:13.685673 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51267616-a381-4d0f-8f4e-dad3f032c7f2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 200 len: 1323 microversion: 2.1 time: 0.317319 Sep 10 10:42:13.686926 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1051/1557] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:13 2022] GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:13.693753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d5f6e06-459f-4a54-bfb1-5948445a18da tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:13.694890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9d5f6e06-459f-4a54-bfb1-5948445a18da tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:13.709179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d5f6e06-459f-4a54-bfb1-5948445a18da tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:13.710970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d5f6e06-459f-4a54-bfb1-5948445a18da tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:13.711964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d5f6e06-459f-4a54-bfb1-5948445a18da tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:13.713574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d5f6e06-459f-4a54-bfb1-5948445a18da tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:13.714061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d5f6e06-459f-4a54-bfb1-5948445a18da tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:13.714506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d5f6e06-459f-4a54-bfb1-5948445a18da tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:13.942222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d5f6e06-459f-4a54-bfb1-5948445a18da tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:13.950620 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d5f6e06-459f-4a54-bfb1-5948445a18da tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1315 microversion: 2.1 time: 0.261887 Sep 10 10:42:13.965578 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1052/1558] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:13 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:13.972752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-482d3f29-d8a5-403e-ae2c-90af399f3856 req-4e994409-23c9-44b3-a33b-05dd94c67539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20059d23-e6d5-4140-ac67-7ebf9534febc", "name": "network-vif-plugged", "status": "completed", "tag": "3431f20f-3f1d-4d78-b1c5-efe9c1726cc1"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:13.982932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-482d3f29-d8a5-403e-ae2c-90af399f3856 req-4e994409-23c9-44b3-a33b-05dd94c67539 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:13.983405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-482d3f29-d8a5-403e-ae2c-90af399f3856 req-4e994409-23c9-44b3-a33b-05dd94c67539 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:13.983828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-482d3f29-d8a5-403e-ae2c-90af399f3856 req-4e994409-23c9-44b3-a33b-05dd94c67539 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:13.996031 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-482d3f29-d8a5-403e-ae2c-90af399f3856 req-4e994409-23c9-44b3-a33b-05dd94c67539 service nova] Creating event network-vif-plugged:3431f20f-3f1d-4d78-b1c5-efe9c1726cc1 for instance 20059d23-e6d5-4140-ac67-7ebf9534febc on n-h2-856894-1 Sep 10 10:42:14.000701 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-482d3f29-d8a5-403e-ae2c-90af399f3856 req-4e994409-23c9-44b3-a33b-05dd94c67539 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033876 Sep 10 10:42:14.001327 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1053/1559] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:14.006758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fec9c139-538c-4e90-8d86-3bcbd6670f6f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae386f70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:14.068774 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fec9c139-538c-4e90-8d86-3bcbd6670f6f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07" status: 200 len: 1413 microversion: 2.1 time: 0.066151 Sep 10 10:42:14.069575 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1054/1560] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:14 2022] GET /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07 => generated 1413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:14.073904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac775582-fc5c-446b-bbd8-e44546aa300d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:14.074627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac775582-fc5c-446b-bbd8-e44546aa300d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:14.083166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac775582-fc5c-446b-bbd8-e44546aa300d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:14.083671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac775582-fc5c-446b-bbd8-e44546aa300d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:14.084103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac775582-fc5c-446b-bbd8-e44546aa300d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:14.084832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac775582-fc5c-446b-bbd8-e44546aa300d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:14.085497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac775582-fc5c-446b-bbd8-e44546aa300d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:14.086190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac775582-fc5c-446b-bbd8-e44546aa300d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:14.352672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ac775582-fc5c-446b-bbd8-e44546aa300d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:14.362277 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac775582-fc5c-446b-bbd8-e44546aa300d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.291825 Sep 10 10:42:14.363786 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1055/1561] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:14 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:14.368618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b83bf44-d6f3-47df-b6d9-69fca3b54744 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:14.369491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b83bf44-d6f3-47df-b6d9-69fca3b54744 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:14.387283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b83bf44-d6f3-47df-b6d9-69fca3b54744 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:14.388025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b83bf44-d6f3-47df-b6d9-69fca3b54744 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:14.388660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b83bf44-d6f3-47df-b6d9-69fca3b54744 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:14.389552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b83bf44-d6f3-47df-b6d9-69fca3b54744 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:14.390147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b83bf44-d6f3-47df-b6d9-69fca3b54744 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:14.390673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b83bf44-d6f3-47df-b6d9-69fca3b54744 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:14.534435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0b83bf44-d6f3-47df-b6d9-69fca3b54744 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:14.542994 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b83bf44-d6f3-47df-b6d9-69fca3b54744 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1333 microversion: 2.1 time: 0.178043 Sep 10 10:42:14.543578 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1056/1562] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:14 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1333 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:14.548136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f565d2b8-4b09-49d5-a4f9-93c731ec091a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-21558048"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:14.551101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f565d2b8-4b09-49d5-a4f9-93c731ec091a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:14.557151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f565d2b8-4b09-49d5-a4f9-93c731ec091a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:14.557641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f565d2b8-4b09-49d5-a4f9-93c731ec091a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:14.558373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f565d2b8-4b09-49d5-a4f9-93c731ec091a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:14.558774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f565d2b8-4b09-49d5-a4f9-93c731ec091a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:14.559231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f565d2b8-4b09-49d5-a4f9-93c731ec091a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:14.559658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f565d2b8-4b09-49d5-a4f9-93c731ec091a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:14.770955 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f565d2b8-4b09-49d5-a4f9-93c731ec091a tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "POST /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f/action" status: 202 len: 0 microversion: 2.1 time: 0.226150 Sep 10 10:42:14.777191 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1057/1563] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:42:14 2022] POST /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 10:42:14.777191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-29812344-091f-4717-8b86-995d639345e3 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae405e50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:14.845026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-29812344-091f-4717-8b86-995d639345e3 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7cc7d0a0-4c5f-425b-b9e7-dfbb926719f3" status: 200 len: 351 microversion: 2.1 time: 0.072190 Sep 10 10:42:14.845967 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1058/1564] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:42:14 2022] GET /compute/v2.1/os-volumes/7cc7d0a0-4c5f-425b-b9e7-dfbb926719f3 => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:14.850544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:14.851692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:14.865340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:14.865905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:14.866417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:14.867192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:14.867717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:14.868147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:15.028791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:15.040385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:15.041918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:15.043098 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21be2b91-f79a-423a-8d89-0e35350b8f45 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1487 microversion: 2.25 time: 0.196193 Sep 10 10:42:15.057294 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1059/1565] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:14 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1487 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:15.070555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-104c1ffb-261a-4bd4-8cfc-ff95cb393d7b tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:15.071190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-104c1ffb-261a-4bd4-8cfc-ff95cb393d7b tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:15.078210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104c1ffb-261a-4bd4-8cfc-ff95cb393d7b tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:15.078775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104c1ffb-261a-4bd4-8cfc-ff95cb393d7b tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:15.079342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104c1ffb-261a-4bd4-8cfc-ff95cb393d7b tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:15.080208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104c1ffb-261a-4bd4-8cfc-ff95cb393d7b tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:15.080671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104c1ffb-261a-4bd4-8cfc-ff95cb393d7b tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:15.081125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104c1ffb-261a-4bd4-8cfc-ff95cb393d7b tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:15.225301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-104c1ffb-261a-4bd4-8cfc-ff95cb393d7b tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d28bb8f4375492681e5b4b30f1ca413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bdbf1662bc4efd8059ff5ad298b4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:15.233377 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-104c1ffb-261a-4bd4-8cfc-ff95cb393d7b tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 200 len: 1323 microversion: 2.1 time: 0.174990 Sep 10 10:42:15.233953 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1060/1566] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:15 2022] GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 1323 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:15.238549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc7e969c-81b6-49f5-b179-26985b079637 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae38fa60>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:15.285335 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc7e969c-81b6-49f5-b179-26985b079637 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c" status: 200 len: 1451 microversion: 2.1 time: 0.050306 Sep 10 10:42:15.286179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1061/1567] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:15 2022] GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c => generated 1451 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:15.294335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-70fc2adf-2202-438f-a6ef-ea39305ce440 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:15.294335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-70fc2adf-2202-438f-a6ef-ea39305ce440 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:15.298085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc2adf-2202-438f-a6ef-ea39305ce440 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:15.298717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc2adf-2202-438f-a6ef-ea39305ce440 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:15.299229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc2adf-2202-438f-a6ef-ea39305ce440 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:15.300477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc2adf-2202-438f-a6ef-ea39305ce440 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:15.301278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc2adf-2202-438f-a6ef-ea39305ce440 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:15.301977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc2adf-2202-438f-a6ef-ea39305ce440 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:15.323751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:15.577967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-70fc2adf-2202-438f-a6ef-ea39305ce440 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:15.589913 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-70fc2adf-2202-438f-a6ef-ea39305ce440 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1315 microversion: 2.1 time: 0.302553 Sep 10 10:42:15.601139 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1062/1568] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:15 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:15.601139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c8e1534-80f7-406e-b50c-3a95d3c31011 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae37a8b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:15.678719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c8e1534-80f7-406e-b50c-3a95d3c31011 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07" status: 200 len: 1413 microversion: 2.1 time: 0.084585 Sep 10 10:42:15.690373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1063/1569] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:15 2022] GET /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:15.696009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9d3e5276-f916-45b0-b626-6e71ca596897 req-8fc51afb-e2e7-47c5-a4e2-e4ede15d203c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb", "tag": "44e7faec-bb94-47bd-bdc4-7b2daed724cb"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:15.710479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d3e5276-f916-45b0-b626-6e71ca596897 req-8fc51afb-e2e7-47c5-a4e2-e4ede15d203c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:15.711305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d3e5276-f916-45b0-b626-6e71ca596897 req-8fc51afb-e2e7-47c5-a4e2-e4ede15d203c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:15.711971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d3e5276-f916-45b0-b626-6e71ca596897 req-8fc51afb-e2e7-47c5-a4e2-e4ede15d203c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:15.723606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9d3e5276-f916-45b0-b626-6e71ca596897 req-8fc51afb-e2e7-47c5-a4e2-e4ede15d203c service nova] Creating event network-changed:44e7faec-bb94-47bd-bdc4-7b2daed724cb for instance 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb on n-h1-856894-1 Sep 10 10:42:15.730321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9d3e5276-f916-45b0-b626-6e71ca596897 req-8fc51afb-e2e7-47c5-a4e2-e4ede15d203c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038319 Sep 10 10:42:15.731620 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1064/1570] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:15.743261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa2aec29-d50e-4065-9b9c-4ec6b2277655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:15.744627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa2aec29-d50e-4065-9b9c-4ec6b2277655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:15.753753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa2aec29-d50e-4065-9b9c-4ec6b2277655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:15.754520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa2aec29-d50e-4065-9b9c-4ec6b2277655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:15.755210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa2aec29-d50e-4065-9b9c-4ec6b2277655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:15.756174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa2aec29-d50e-4065-9b9c-4ec6b2277655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:15.756872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa2aec29-d50e-4065-9b9c-4ec6b2277655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:15.757651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa2aec29-d50e-4065-9b9c-4ec6b2277655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:16.437523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fa2aec29-d50e-4065-9b9c-4ec6b2277655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:16.450369 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fa2aec29-d50e-4065-9b9c-4ec6b2277655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.716071 Sep 10 10:42:16.450793 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1065/1571] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:15 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:16.458901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b04e4cf-fd75-4bd6-8c1b-9f7b28d6f5b1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:16.459522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b04e4cf-fd75-4bd6-8c1b-9f7b28d6f5b1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:16.472732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b04e4cf-fd75-4bd6-8c1b-9f7b28d6f5b1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:16.476307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b04e4cf-fd75-4bd6-8c1b-9f7b28d6f5b1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:16.476860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b04e4cf-fd75-4bd6-8c1b-9f7b28d6f5b1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:16.478206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b04e4cf-fd75-4bd6-8c1b-9f7b28d6f5b1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:16.479173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b04e4cf-fd75-4bd6-8c1b-9f7b28d6f5b1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:16.480076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b04e4cf-fd75-4bd6-8c1b-9f7b28d6f5b1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:16.835611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b04e4cf-fd75-4bd6-8c1b-9f7b28d6f5b1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:16.851425 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b04e4cf-fd75-4bd6-8c1b-9f7b28d6f5b1 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1333 microversion: 2.1 time: 0.399537 Sep 10 10:42:16.854967 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1066/1572] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:16 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1333 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:16.861659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:16.870826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:16.883699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:16.884195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:16.888223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:16.889791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:16.890283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:16.891222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:17.245947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:17.280731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:17.287378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:17.291539 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-696d7c4f-f2ea-4502-b8b4-93875fcb5b63 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1477 microversion: 2.25 time: 0.434517 Sep 10 10:42:17.307579 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1067/1573] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:16 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1477 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:17.327615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6639f0e6-a88a-421a-8233-3d09f373f918 req-23c56373-90d7-4dc2-b5ce-e1f28234b146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf886fd-0d8c-46b8-9afb-eec1edad2d96", "name": "network-vif-unplugged", "status": "completed", "tag": "1b0e5ed5-e6b2-45f6-a1ac-df2eb4399a4b"}, {"server_uuid": "efb025b0-229f-4423-847a-851bbdddc697", "name": "network-vif-plugged", "status": "completed", "tag": "c27a5c35-d97c-4cd1-b95f-b60ade027d46"}, {"server_uuid": "efb025b0-229f-4423-847a-851bbdddc697", "name": "network-vif-plugged", "status": "completed", "tag": "4bea308d-e61c-4f8e-8df6-c5eeb68bb884"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:17.350885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6639f0e6-a88a-421a-8233-3d09f373f918 req-23c56373-90d7-4dc2-b5ce-e1f28234b146 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:17.351596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6639f0e6-a88a-421a-8233-3d09f373f918 req-23c56373-90d7-4dc2-b5ce-e1f28234b146 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:17.352601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6639f0e6-a88a-421a-8233-3d09f373f918 req-23c56373-90d7-4dc2-b5ce-e1f28234b146 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:17.388726 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6639f0e6-a88a-421a-8233-3d09f373f918 req-23c56373-90d7-4dc2-b5ce-e1f28234b146 service nova] Creating event network-vif-unplugged:1b0e5ed5-e6b2-45f6-a1ac-df2eb4399a4b for instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 on n-h2-856894-1 Sep 10 10:42:17.389524 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6639f0e6-a88a-421a-8233-3d09f373f918 req-23c56373-90d7-4dc2-b5ce-e1f28234b146 service nova] Creating event network-vif-plugged:c27a5c35-d97c-4cd1-b95f-b60ade027d46 for instance efb025b0-229f-4423-847a-851bbdddc697 on n-h1-856894-1 Sep 10 10:42:17.390235 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6639f0e6-a88a-421a-8233-3d09f373f918 req-23c56373-90d7-4dc2-b5ce-e1f28234b146 service nova] Creating event network-vif-plugged:4bea308d-e61c-4f8e-8df6-c5eeb68bb884 for instance efb025b0-229f-4423-847a-851bbdddc697 on n-h1-856894-1 Sep 10 10:42:17.401571 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6639f0e6-a88a-421a-8233-3d09f373f918 req-23c56373-90d7-4dc2-b5ce-e1f28234b146 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.088022 Sep 10 10:42:17.401571 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1068/1574] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:17.406344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe6dd84b-e1d9-4869-b3df-a10e38a35ce9 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:17.407398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fe6dd84b-e1d9-4869-b3df-a10e38a35ce9 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:17.415642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe6dd84b-e1d9-4869-b3df-a10e38a35ce9 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:17.416275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe6dd84b-e1d9-4869-b3df-a10e38a35ce9 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:17.416817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe6dd84b-e1d9-4869-b3df-a10e38a35ce9 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:17.417829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe6dd84b-e1d9-4869-b3df-a10e38a35ce9 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:17.418385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe6dd84b-e1d9-4869-b3df-a10e38a35ce9 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:17.418934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe6dd84b-e1d9-4869-b3df-a10e38a35ce9 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:17.578304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fe6dd84b-e1d9-4869-b3df-a10e38a35ce9 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d28bb8f4375492681e5b4b30f1ca413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bdbf1662bc4efd8059ff5ad298b4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:17.586649 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe6dd84b-e1d9-4869-b3df-a10e38a35ce9 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 200 len: 1323 microversion: 2.1 time: 0.184786 Sep 10 10:42:17.587384 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1069/1575] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:17 2022] GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 1323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:17.592271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d583b176-a5ef-4973-ad36-49946d7ae51b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2db550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:17.649633 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d583b176-a5ef-4973-ad36-49946d7ae51b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c" status: 200 len: 1451 microversion: 2.1 time: 0.060705 Sep 10 10:42:17.650787 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1070/1576] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:17 2022] GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c => generated 1451 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:17.655493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a51a262d-a513-40dc-8aae-2428b0ba2b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:17.656316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a51a262d-a513-40dc-8aae-2428b0ba2b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:17.663950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51a262d-a513-40dc-8aae-2428b0ba2b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:17.676611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51a262d-a513-40dc-8aae-2428b0ba2b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:17.677396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51a262d-a513-40dc-8aae-2428b0ba2b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:17.678349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51a262d-a513-40dc-8aae-2428b0ba2b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:17.678992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51a262d-a513-40dc-8aae-2428b0ba2b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:17.679615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51a262d-a513-40dc-8aae-2428b0ba2b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:17.913101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a51a262d-a513-40dc-8aae-2428b0ba2b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:17.924670 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a51a262d-a513-40dc-8aae-2428b0ba2b51 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1501 microversion: 2.1 time: 0.272641 Sep 10 10:42:17.949000 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1071/1577] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:17 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1501 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:17.955094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d56e0e7-4822-4ee3-bb70-39c556a8de36 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae343dc0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:18.008349 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d56e0e7-4822-4ee3-bb70-39c556a8de36 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07" status: 200 len: 1413 microversion: 2.1 time: 0.058096 Sep 10 10:42:18.009253 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1072/1578] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:17 2022] GET /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07 => generated 1413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:18.014046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-787b40a4-9bc7-43b3-beed-f3992e5736d1 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '.version_select at 0x7efcae2db670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:18.018166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-787b40a4-9bc7-43b3-beed-f3992e5736d1 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:18.019081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-787b40a4-9bc7-43b3-beed-f3992e5736d1 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:18.020075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-787b40a4-9bc7-43b3-beed-f3992e5736d1 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:18.035095 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-787b40a4-9bc7-43b3-beed-f3992e5736d1 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3443 microversion: 2.25 time: 0.024353 Sep 10 10:42:18.036379 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1073/1579] 10.222.0.20 () {60 vars in 1184 bytes} [Sat Sep 10 10:42:18 2022] GET /compute/v2.1/os-migrations => generated 3443 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:18.041490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f3d11ec-9d5d-4e38-b14b-d7834a3f6fdc tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae2db700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:18.124576 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f3d11ec-9d5d-4e38-b14b-d7834a3f6fdc tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c8696886-7583-41a6-bd68-838863e64cc8" status: 200 len: 350 microversion: 2.1 time: 0.086963 Sep 10 10:42:18.125774 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1074/1580] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 10:42:18 2022] GET /compute/v2.1/os-volumes/c8696886-7583-41a6-bd68-838863e64cc8 => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:18.130329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a1169dad-15c3-4b1c-b9b9-ff32c78e349f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:18.130941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a1169dad-15c3-4b1c-b9b9-ff32c78e349f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:18.147397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1169dad-15c3-4b1c-b9b9-ff32c78e349f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:18.153107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1169dad-15c3-4b1c-b9b9-ff32c78e349f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:18.154537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1169dad-15c3-4b1c-b9b9-ff32c78e349f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:18.156461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1169dad-15c3-4b1c-b9b9-ff32c78e349f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:18.156978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1169dad-15c3-4b1c-b9b9-ff32c78e349f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:18.157503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1169dad-15c3-4b1c-b9b9-ff32c78e349f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:18.426626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a1169dad-15c3-4b1c-b9b9-ff32c78e349f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:18.437608 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a1169dad-15c3-4b1c-b9b9-ff32c78e349f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.310637 Sep 10 10:42:18.438535 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1075/1581] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:18 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:18.444100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5fe0f8fd-6c32-4a41-a987-c45962fb8d3d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:18.444716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5fe0f8fd-6c32-4a41-a987-c45962fb8d3d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:18.451451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fe0f8fd-6c32-4a41-a987-c45962fb8d3d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:18.451945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fe0f8fd-6c32-4a41-a987-c45962fb8d3d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:18.452389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fe0f8fd-6c32-4a41-a987-c45962fb8d3d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:18.453114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fe0f8fd-6c32-4a41-a987-c45962fb8d3d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:18.453687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fe0f8fd-6c32-4a41-a987-c45962fb8d3d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:18.454245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fe0f8fd-6c32-4a41-a987-c45962fb8d3d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:18.668014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5fe0f8fd-6c32-4a41-a987-c45962fb8d3d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:18.678289 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5fe0f8fd-6c32-4a41-a987-c45962fb8d3d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1333 microversion: 2.1 time: 0.238103 Sep 10 10:42:18.679555 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1076/1582] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:18 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1333 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:18.686384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf333179-3c77-4c28-9cbe-13eb177b7f94 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:18.687584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf333179-3c77-4c28-9cbe-13eb177b7f94 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:18.708194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf333179-3c77-4c28-9cbe-13eb177b7f94 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:18.708510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf333179-3c77-4c28-9cbe-13eb177b7f94 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:18.708950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf333179-3c77-4c28-9cbe-13eb177b7f94 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:18.709687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf333179-3c77-4c28-9cbe-13eb177b7f94 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:18.710140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf333179-3c77-4c28-9cbe-13eb177b7f94 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:18.710566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf333179-3c77-4c28-9cbe-13eb177b7f94 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:18.778552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:18.800908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:18.912693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-cf333179-3c77-4c28-9cbe-13eb177b7f94 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] Lazy-loading 'services' on Instance uuid 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:42:18.931476 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf333179-3c77-4c28-9cbe-13eb177b7f94 tempest-LiveAutoBlockMigrationV225Test-252481177 tempest-LiveAutoBlockMigrationV225Test-252481177-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 200 len: 1970 microversion: 2.25 time: 0.250348 Sep 10 10:42:18.944840 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1077/1583] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:18 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 1970 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:18.961338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc5fd71e-abf7-4947-87b3-0e9456069520 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae37a4c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:19.101406 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc5fd71e-abf7-4947-87b3-0e9456069520 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.155220 Sep 10 10:42:19.102357 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1078/1584] 10.222.0.20 () {58 vars in 1134 bytes} [Sat Sep 10 10:42:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:19.111268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f8e8e81-ebed-408f-adf3-06bdef8ef9db tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:19.112260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f8e8e81-ebed-408f-adf3-06bdef8ef9db tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:19.130858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8e8e81-ebed-408f-adf3-06bdef8ef9db tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:19.136897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8e8e81-ebed-408f-adf3-06bdef8ef9db tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:19.138037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8e8e81-ebed-408f-adf3-06bdef8ef9db tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:19.140774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8e8e81-ebed-408f-adf3-06bdef8ef9db tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:19.143888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8e8e81-ebed-408f-adf3-06bdef8ef9db tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:19.144443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f8e8e81-ebed-408f-adf3-06bdef8ef9db tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:19.371575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f8e8e81-ebed-408f-adf3-06bdef8ef9db tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d28bb8f4375492681e5b4b30f1ca413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bdbf1662bc4efd8059ff5ad298b4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:19.448171 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f8e8e81-ebed-408f-adf3-06bdef8ef9db tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 200 len: 1323 microversion: 2.1 time: 0.344155 Sep 10 10:42:19.452199 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1079/1585] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:19 2022] GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 1323 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:19.465240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-857c8887-6f74-45c2-9de7-afa8ae12eb03 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae360a60>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:19.902349 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-857c8887-6f74-45c2-9de7-afa8ae12eb03 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c" status: 200 len: 1451 microversion: 2.1 time: 0.445675 Sep 10 10:42:19.902869 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1080/1586] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:19 2022] GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c => generated 1451 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:19.922448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d632b96c-0fa8-4d23-a561-c94a58fca61d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:19.923858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d632b96c-0fa8-4d23-a561-c94a58fca61d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:19.935117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d632b96c-0fa8-4d23-a561-c94a58fca61d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:19.936403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d632b96c-0fa8-4d23-a561-c94a58fca61d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:19.937269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d632b96c-0fa8-4d23-a561-c94a58fca61d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:19.938567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d632b96c-0fa8-4d23-a561-c94a58fca61d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:19.940112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d632b96c-0fa8-4d23-a561-c94a58fca61d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:19.941256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d632b96c-0fa8-4d23-a561-c94a58fca61d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:19.992096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d632b96c-0fa8-4d23-a561-c94a58fca61d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:42:20.141583 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d632b96c-0fa8-4d23-a561-c94a58fca61d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 204 len: 0 microversion: 2.25 time: 0.226778 Sep 10 10:42:20.144000 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1081/1587] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:42:19 2022] DELETE /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:42:20.154020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2796ee3-06bf-434e-bc4f-2fc2750911e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae37aaf0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:28.560069 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2796ee3-06bf-434e-bc4f-2fc2750911e7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07" status: 200 len: 1422 microversion: 2.1 time: 8.414001 Sep 10 10:42:28.560718 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1082/1588] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:20 2022] GET /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07 => generated 1422 bytes in 8416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:28.584299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dac77c57-bd09-4cc2-8f3f-4bb9ba13fb38 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae2d6ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:28.693825 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dac77c57-bd09-4cc2-8f3f-4bb9ba13fb38 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.122529 Sep 10 10:42:28.705978 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1083/1589] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:42:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:28.711127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-80a94f73-4404-4933-a253-d7a48b2c0ad4 req-b30a86a4-ddc9-4f3d-a98c-353c7b0c426d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbfd4c5-e209-4e86-a0dd-00738c53b9b3", "name": "network-vif-plugged", "status": "completed", "tag": "4348d2b9-1dca-4e41-826e-c604d9ea22da"}, {"server_uuid": "7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb", "name": "network-vif-plugged", "status": "completed", "tag": "44e7faec-bb94-47bd-bdc4-7b2daed724cb"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:28.723498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-80a94f73-4404-4933-a253-d7a48b2c0ad4 req-b30a86a4-ddc9-4f3d-a98c-353c7b0c426d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:28.724219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-80a94f73-4404-4933-a253-d7a48b2c0ad4 req-b30a86a4-ddc9-4f3d-a98c-353c7b0c426d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:28.724841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-80a94f73-4404-4933-a253-d7a48b2c0ad4 req-b30a86a4-ddc9-4f3d-a98c-353c7b0c426d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:28.739427 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-80a94f73-4404-4933-a253-d7a48b2c0ad4 req-b30a86a4-ddc9-4f3d-a98c-353c7b0c426d service nova] Creating event network-vif-plugged:4348d2b9-1dca-4e41-826e-c604d9ea22da for instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 on n-h2-856894-1 Sep 10 10:42:28.740224 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-80a94f73-4404-4933-a253-d7a48b2c0ad4 req-b30a86a4-ddc9-4f3d-a98c-353c7b0c426d service nova] Creating event network-vif-plugged:44e7faec-bb94-47bd-bdc4-7b2daed724cb for instance 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb on n-h1-856894-1 Sep 10 10:42:28.749570 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-80a94f73-4404-4933-a253-d7a48b2c0ad4 req-b30a86a4-ddc9-4f3d-a98c-353c7b0c426d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041912 Sep 10 10:42:28.750803 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1084/1590] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:28.769311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dab6ee34-a777-4c14-afb0-2780c0b426cb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:28.771359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dab6ee34-a777-4c14-afb0-2780c0b426cb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:28.780424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab6ee34-a777-4c14-afb0-2780c0b426cb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:28.781301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab6ee34-a777-4c14-afb0-2780c0b426cb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:28.781968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab6ee34-a777-4c14-afb0-2780c0b426cb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:28.783436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab6ee34-a777-4c14-afb0-2780c0b426cb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:28.784133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab6ee34-a777-4c14-afb0-2780c0b426cb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:28.784775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab6ee34-a777-4c14-afb0-2780c0b426cb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:29.054241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dab6ee34-a777-4c14-afb0-2780c0b426cb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:29.062684 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dab6ee34-a777-4c14-afb0-2780c0b426cb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.310561 Sep 10 10:42:29.063338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1085/1591] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:28 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:29.071251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b8c9f7e-7537-4295-8c5c-be82e6160b3c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:29.072127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b8c9f7e-7537-4295-8c5c-be82e6160b3c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:29.087130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f7e-7537-4295-8c5c-be82e6160b3c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:29.087646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f7e-7537-4295-8c5c-be82e6160b3c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:29.088095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f7e-7537-4295-8c5c-be82e6160b3c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:29.088822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f7e-7537-4295-8c5c-be82e6160b3c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:29.089318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f7e-7537-4295-8c5c-be82e6160b3c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:29.089751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f7e-7537-4295-8c5c-be82e6160b3c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:29.252753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b8c9f7e-7537-4295-8c5c-be82e6160b3c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:29.261704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b8c9f7e-7537-4295-8c5c-be82e6160b3c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1666 microversion: 2.1 time: 0.194086 Sep 10 10:42:29.273880 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1086/1592] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:29 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1666 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:29.290207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:29.291222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:29.300884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:29.302042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:29.302759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:29.303747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:29.304982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:29.305796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:29.323822 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] HTTP exception thrown: Instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e could not be found. Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Request method failure captured: Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e HTTP/1.1 Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiJm0D22NV-Z8qEdxR4XF2RPIGKQ50HB-p70fCdi_YFXzgyBPXKaq1rf3Fx__-5KYiBj5-XdAkTE-oI7chG3PnQ0mpJ7ywGO33P25HUSy7nxQpnspPUb_rE3PM5GDcBytPHtiJ_o3_hQxNRrILgPzvZv8rTkixPjN8fVkmTI50v-gg Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9c2ac1f5c5c843fc89294292d4489252 Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:29.326481 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c2ac1f5c5c843fc89294292d4489252", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9c2ac1f5c5c843fc89294292d4489252 Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-LiveAutoBlockMigrationV225Test-592704198-project Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 362b727b96934e58b180727eaad35e3b Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-592704198-project Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e could not be found. Sep 10 10:42:29.328291 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e'} Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e could not be found. Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:29.329858 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e could not be found. Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e could not be found. Sep 10 10:42:29.331345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:29.334088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Returning 404 to user: Instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:29.335500 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d067a463-0f55-40ac-b0e6-40a1b159d505 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e" status: 404 len: 111 microversion: 2.25 time: 0.060238 Sep 10 10:42:29.336540 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1087/1593] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:29 2022] GET /compute/v2.1/servers/3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:42:29.341642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a91f71f3-9241-473c-9455-1a5cd295a4b2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:29.343223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a91f71f3-9241-473c-9455-1a5cd295a4b2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:29.350334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a91f71f3-9241-473c-9455-1a5cd295a4b2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:29.351031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a91f71f3-9241-473c-9455-1a5cd295a4b2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:29.351670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a91f71f3-9241-473c-9455-1a5cd295a4b2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:29.352565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a91f71f3-9241-473c-9455-1a5cd295a4b2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:29.353275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a91f71f3-9241-473c-9455-1a5cd295a4b2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:29.353875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a91f71f3-9241-473c-9455-1a5cd295a4b2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:29.380391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:29.533896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a91f71f3-9241-473c-9455-1a5cd295a4b2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d28bb8f4375492681e5b4b30f1ca413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bdbf1662bc4efd8059ff5ad298b4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:29.543084 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a91f71f3-9241-473c-9455-1a5cd295a4b2 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 200 len: 1323 microversion: 2.1 time: 0.205262 Sep 10 10:42:29.543684 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1088/1594] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:29 2022] GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 1323 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:29.548374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-06a8ac54-db96-4a27-8f5e-8821d9beb4f9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffb6596d-40e9-4ace-aa4d-76d0ca0a8cc2"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:29.550901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-06a8ac54-db96-4a27-8f5e-8821d9beb4f9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:29.556964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06a8ac54-db96-4a27-8f5e-8821d9beb4f9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:29.557769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06a8ac54-db96-4a27-8f5e-8821d9beb4f9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:29.558050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06a8ac54-db96-4a27-8f5e-8821d9beb4f9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:29.558646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06a8ac54-db96-4a27-8f5e-8821d9beb4f9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:29.559107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06a8ac54-db96-4a27-8f5e-8821d9beb4f9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:29.559537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06a8ac54-db96-4a27-8f5e-8821d9beb4f9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:29.851396 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-06a8ac54-db96-4a27-8f5e-8821d9beb4f9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306468 Sep 10 10:42:29.874556 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1089/1595] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 10:42:29 2022] POST /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:29.882006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-982bf8d4-1be9-4f1a-9ac0-208a48717737 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2f9160>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:29.950704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-982bf8d4-1be9-4f1a-9ac0-208a48717737 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c" status: 200 len: 1451 microversion: 2.1 time: 0.074327 Sep 10 10:42:29.957160 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1090/1596] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:29 2022] GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c => generated 1451 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:29.958032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-fcfcf0a6-c6af-43e5-9bbe-e30c0a2ee05b req-826daa96-1260-4878-9e36-add337ad038e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e", "name": "network-vif-deleted", "tag": "a1e0c35c-8322-4531-8a36-a9889a2f4bf6"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:29.974304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fcfcf0a6-c6af-43e5-9bbe-e30c0a2ee05b req-826daa96-1260-4878-9e36-add337ad038e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:29.975019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fcfcf0a6-c6af-43e5-9bbe-e30c0a2ee05b req-826daa96-1260-4878-9e36-add337ad038e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:29.979483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fcfcf0a6-c6af-43e5-9bbe-e30c0a2ee05b req-826daa96-1260-4878-9e36-add337ad038e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:29.996795 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-fcfcf0a6-c6af-43e5-9bbe-e30c0a2ee05b req-826daa96-1260-4878-9e36-add337ad038e service nova] Creating event network-vif-deleted:a1e0c35c-8322-4531-8a36-a9889a2f4bf6 for instance 3b7c77f0-b1d7-4f9b-ad9d-4fdbec56908e on n-h2-856894-1 Sep 10 10:42:30.004545 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-fcfcf0a6-c6af-43e5-9bbe-e30c0a2ee05b req-826daa96-1260-4878-9e36-add337ad038e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051293 Sep 10 10:42:30.013674 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1091/1597] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:30.019616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c23bb86a-e33b-48be-9f98-0ce5d1c39bf5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae4050d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:30.112859 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c23bb86a-e33b-48be-9f98-0ce5d1c39bf5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07" status: 200 len: 1422 microversion: 2.1 time: 0.094059 Sep 10 10:42:30.113782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1092/1598] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:30 2022] GET /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07 => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:30.122803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-750fcbb8-0f6c-42c0-ae48-c2f6aa24140e tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae2fe670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:36.847286 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-750fcbb8-0f6c-42c0-ae48-c2f6aa24140e tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 6.731847 Sep 10 10:42:36.847918 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1093/1599] 10.222.0.20 () {58 vars in 1134 bytes} [Sat Sep 10 10:42:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 6734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:36.852641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38732208-1083-4327-88ce-75ab797c0d87 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:36.853282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38732208-1083-4327-88ce-75ab797c0d87 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:36.860199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38732208-1083-4327-88ce-75ab797c0d87 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:36.860716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38732208-1083-4327-88ce-75ab797c0d87 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:36.861181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38732208-1083-4327-88ce-75ab797c0d87 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:36.861891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38732208-1083-4327-88ce-75ab797c0d87 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:36.862345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38732208-1083-4327-88ce-75ab797c0d87 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:36.862770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38732208-1083-4327-88ce-75ab797c0d87 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:36.890663 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38732208-1083-4327-88ce-75ab797c0d87 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697/ips" status: 200 len: 177 microversion: 2.1 time: 0.041614 Sep 10 10:42:36.898850 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1094/1600] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:42:36 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697/ips => generated 177 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:36.898850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-200f37ab-1b14-4d41-96aa-0e7c75ff2804 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:36.898850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-200f37ab-1b14-4d41-96aa-0e7c75ff2804 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:36.903513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200f37ab-1b14-4d41-96aa-0e7c75ff2804 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:36.903937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200f37ab-1b14-4d41-96aa-0e7c75ff2804 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:36.904376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200f37ab-1b14-4d41-96aa-0e7c75ff2804 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:36.905082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200f37ab-1b14-4d41-96aa-0e7c75ff2804 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:36.905543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200f37ab-1b14-4d41-96aa-0e7c75ff2804 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:36.905967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-200f37ab-1b14-4d41-96aa-0e7c75ff2804 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:37.043389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-200f37ab-1b14-4d41-96aa-0e7c75ff2804 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:37.052311 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-200f37ab-1b14-4d41-96aa-0e7c75ff2804 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.159410 Sep 10 10:42:37.052979 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1095/1601] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:36 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:37.069548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6a9244a-f594-4ebf-8818-8c89898a772a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae2fe550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:37.490679 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b6a9244a-f594-4ebf-8818-8c89898a772a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07" status: 204 len: 0 microversion: 2.1 time: 0.424552 Sep 10 10:42:37.491257 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1096/1602] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:37 2022] DELETE /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:42:37.497004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4967f922-7a5e-4f96-88a8-5f3aacb01f62 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:37.497757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4967f922-7a5e-4f96-88a8-5f3aacb01f62 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:37.505510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4967f922-7a5e-4f96-88a8-5f3aacb01f62 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:37.505976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4967f922-7a5e-4f96-88a8-5f3aacb01f62 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:37.506413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4967f922-7a5e-4f96-88a8-5f3aacb01f62 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:37.507106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4967f922-7a5e-4f96-88a8-5f3aacb01f62 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:37.507691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4967f922-7a5e-4f96-88a8-5f3aacb01f62 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:37.508121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4967f922-7a5e-4f96-88a8-5f3aacb01f62 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:37.642004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4967f922-7a5e-4f96-88a8-5f3aacb01f62 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d28bb8f4375492681e5b4b30f1ca413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bdbf1662bc4efd8059ff5ad298b4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:37.649834 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4967f922-7a5e-4f96-88a8-5f3aacb01f62 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 200 len: 1520 microversion: 2.1 time: 0.157453 Sep 10 10:42:37.650407 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1097/1603] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:37 2022] GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:37.654753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-78893dd4-c968-44d1-8f25-ee8188c4f609 req-14848367-42dc-4f3d-b0ac-18fa0b2730cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551819-7a95-48dc-837a-5b1b82fb6c2f", "name": "network-vif-plugged", "status": "completed", "tag": "cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:37.664089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-78893dd4-c968-44d1-8f25-ee8188c4f609 req-14848367-42dc-4f3d-b0ac-18fa0b2730cc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:37.665004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-78893dd4-c968-44d1-8f25-ee8188c4f609 req-14848367-42dc-4f3d-b0ac-18fa0b2730cc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:37.665632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-78893dd4-c968-44d1-8f25-ee8188c4f609 req-14848367-42dc-4f3d-b0ac-18fa0b2730cc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:37.680147 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-78893dd4-c968-44d1-8f25-ee8188c4f609 req-14848367-42dc-4f3d-b0ac-18fa0b2730cc service nova] Creating event network-vif-plugged:cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba for instance b5551819-7a95-48dc-837a-5b1b82fb6c2f on n-h1-856894-1 Sep 10 10:42:37.686498 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-78893dd4-c968-44d1-8f25-ee8188c4f609 req-14848367-42dc-4f3d-b0ac-18fa0b2730cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034943 Sep 10 10:42:37.687600 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1098/1604] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:37.694602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8a6fcbd-f2e4-4eed-b602-b52e02e67cf5 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae386ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:37.743123 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8a6fcbd-f2e4-4eed-b602-b52e02e67cf5 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c" status: 200 len: 1460 microversion: 2.1 time: 0.053568 Sep 10 10:42:37.743847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1099/1605] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:37 2022] GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c => generated 1460 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:37.748496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b021f0e6-4f60-45e8-ba2b-4c706a127b6b tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae405b80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:37.840194 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b021f0e6-4f60-45e8-ba2b-4c706a127b6b tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095307 Sep 10 10:42:37.840772 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1100/1606] 10.222.0.20 () {58 vars in 1167 bytes} [Sat Sep 10 10:42:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:37.845329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b421483-47b6-4a62-9d08-81d450050d7b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:37.845927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b421483-47b6-4a62-9d08-81d450050d7b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:37.852875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b421483-47b6-4a62-9d08-81d450050d7b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:37.853499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b421483-47b6-4a62-9d08-81d450050d7b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:37.853812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b421483-47b6-4a62-9d08-81d450050d7b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:37.854508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b421483-47b6-4a62-9d08-81d450050d7b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:37.854972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b421483-47b6-4a62-9d08-81d450050d7b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:37.855387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b421483-47b6-4a62-9d08-81d450050d7b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:37.882278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b421483-47b6-4a62-9d08-81d450050d7b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:42:37.964338 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b421483-47b6-4a62-9d08-81d450050d7b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 204 len: 0 microversion: 2.25 time: 0.122086 Sep 10 10:42:37.966100 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1101/1607] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:42:37 2022] DELETE /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:42:37.973109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b0ef1a5-0f3d-4511-aa65-9448612e165d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:37.973962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b0ef1a5-0f3d-4511-aa65-9448612e165d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:37.981482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0ef1a5-0f3d-4511-aa65-9448612e165d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:37.981800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0ef1a5-0f3d-4511-aa65-9448612e165d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:37.982246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0ef1a5-0f3d-4511-aa65-9448612e165d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:37.982953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0ef1a5-0f3d-4511-aa65-9448612e165d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:37.983412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0ef1a5-0f3d-4511-aa65-9448612e165d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:37.983859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0ef1a5-0f3d-4511-aa65-9448612e165d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:38.012893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b0ef1a5-0f3d-4511-aa65-9448612e165d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:42:38.090926 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b0ef1a5-0f3d-4511-aa65-9448612e165d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "DELETE /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 204 len: 0 microversion: 2.1 time: 0.123077 Sep 10 10:42:38.091532 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1102/1608] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:42:37 2022] DELETE /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:42:38.096814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d149228-6b11-4753-9b0f-b618ade621c0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:38.097439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d149228-6b11-4753-9b0f-b618ade621c0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:38.099343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:38.104911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d149228-6b11-4753-9b0f-b618ade621c0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:38.105452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d149228-6b11-4753-9b0f-b618ade621c0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:38.105899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d149228-6b11-4753-9b0f-b618ade621c0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:38.106615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d149228-6b11-4753-9b0f-b618ade621c0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:38.107073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d149228-6b11-4753-9b0f-b618ade621c0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:38.107561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d149228-6b11-4753-9b0f-b618ade621c0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:38.139138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d149228-6b11-4753-9b0f-b618ade621c0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:42:38.219223 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d149228-6b11-4753-9b0f-b618ade621c0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 204 len: 0 microversion: 2.1 time: 0.126201 Sep 10 10:42:38.220109 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1103/1609] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:42:38 2022] DELETE /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:42:38.227598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-621c4b5b-2435-43ed-8632-9840103bab53 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2096677334", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-621c4b5b-2435-43ed-8632-9840103bab53 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Request method failure captured: Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 243 Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGn99dyIbtJrSpI9rz5vXil6qYfptL1-33qm9U0pCQAGW9NHeO2DjMRmwyUYJl2sEAPPRw8a4Zx-7-1cp55gTsAMWMboOLI52Cz_jUe3VrSpdNAYWpiHNZLtI5VGkHU68LY8S14qomF2el3GBjptUHF3yERPTwpbzgaAVrU1Tsws1IM Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:38.229803 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74bdbf1662bc4efd8059ff5ad298b4ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0d28bb8f4375492681e5b4b30f1ca413 Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:42:38.231832 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2096677334", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2096677334', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '3020c12f-204d-40ae-a6ef-8e794c078d83'}]}}} Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:42:38.232908 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:38.235879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-621c4b5b-2435-43ed-8632-9840103bab53 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-621c4b5b-2435-43ed-8632-9840103bab53 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.010320 Sep 10 10:42:38.243133 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1104/1610] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:42:38 2022] POST /compute/v2.1/servers => generated 175 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:42:38.245531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f984fc9-26c0-43a9-bebb-286478576a8b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae386dc0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:38.291747 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f984fc9-26c0-43a9-bebb-286478576a8b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c" status: 200 len: 1460 microversion: 2.1 time: 0.058622 Sep 10 10:42:38.292334 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1105/1611] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:38 2022] GET /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c => generated 1460 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:38.302313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d998982d-eb80-4ad9-9947-392c09980180 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae2d6c10>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:38.388772 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d998982d-eb80-4ad9-9947-392c09980180 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095168 Sep 10 10:42:38.389521 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1106/1612] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Sep 10 10:42:38 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:38.394431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:38.395273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:38.403446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:38.404054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:38.404493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:38.405208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:38.405659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:38.406075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:38.538945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:38.547153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:38.549116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:38.550274 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5e50ab6c-5457-45df-a0b8-978522670d5b tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1733 microversion: 2.25 time: 0.159581 Sep 10 10:42:38.550817 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1107/1613] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:38 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:38.555272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c79d1bf6-a7b9-431b-99db-9343a788f1a4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:38.555869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c79d1bf6-a7b9-431b-99db-9343a788f1a4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:38.561306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c79d1bf6-a7b9-431b-99db-9343a788f1a4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:38.561780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c79d1bf6-a7b9-431b-99db-9343a788f1a4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:38.562204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c79d1bf6-a7b9-431b-99db-9343a788f1a4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:38.562878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c79d1bf6-a7b9-431b-99db-9343a788f1a4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:38.563323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c79d1bf6-a7b9-431b-99db-9343a788f1a4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:38.563740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c79d1bf6-a7b9-431b-99db-9343a788f1a4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:38.700215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c79d1bf6-a7b9-431b-99db-9343a788f1a4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:38.702318 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c79d1bf6-a7b9-431b-99db-9343a788f1a4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.150534 Sep 10 10:42:38.702920 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1108/1614] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:38 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:38.707867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1012e3a0-504a-4d2d-a3d6-d38f919c98d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:38.708460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1012e3a0-504a-4d2d-a3d6-d38f919c98d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:38.713925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1012e3a0-504a-4d2d-a3d6-d38f919c98d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:38.714404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1012e3a0-504a-4d2d-a3d6-d38f919c98d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:38.714840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1012e3a0-504a-4d2d-a3d6-d38f919c98d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:38.715518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1012e3a0-504a-4d2d-a3d6-d38f919c98d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:38.715972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1012e3a0-504a-4d2d-a3d6-d38f919c98d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:38.716391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1012e3a0-504a-4d2d-a3d6-d38f919c98d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:38.734645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:38.855549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1012e3a0-504a-4d2d-a3d6-d38f919c98d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:38.863243 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1012e3a0-504a-4d2d-a3d6-d38f919c98d6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1672 microversion: 2.1 time: 0.158850 Sep 10 10:42:38.863805 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1109/1615] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:38 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:38.868238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-570ac437-8f7d-4824-8843-49fc3e59ade6 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:38.868722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-570ac437-8f7d-4824-8843-49fc3e59ade6 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 06c0c479-35cb-4cf9-aff0-7d53e7ecba01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:38.873714 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-570ac437-8f7d-4824-8843-49fc3e59ade6 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] HTTP exception thrown: Instance 06c0c479-35cb-4cf9-aff0-7d53e7ecba01 could not be found. Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-570ac437-8f7d-4824-8843-49fc3e59ade6 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Request method failure captured: Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/06c0c479-35cb-4cf9-aff0-7d53e7ecba01/metadata HTTP/1.1 Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGn99dyIbtJrSpI9rz5vXil6qYfptL1-33qm9U0pCQAGW9NHeO2DjMRmwyUYJl2sEAPPRw8a4Zx-7-1cp55gTsAMWMboOLI52Cz_jUe3VrSpdNAYWpiHNZLtI5VGkHU68LY8S14qomF2el3GBjptUHF3yERPTwpbzgaAVrU1Tsws1IM Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:38.880758 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74bdbf1662bc4efd8059ff5ad298b4ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0d28bb8f4375492681e5b4b30f1ca413 Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:38.882601 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 06c0c479-35cb-4cf9-aff0-7d53e7ecba01 could not be found. Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '06c0c479-35cb-4cf9-aff0-7d53e7ecba01'} Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c0c479-35cb-4cf9-aff0-7d53e7ecba01 could not be found. Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:38.883506 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c0c479-35cb-4cf9-aff0-7d53e7ecba01 could not be found. Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c0c479-35cb-4cf9-aff0-7d53e7ecba01 could not be found. Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:38.884937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-570ac437-8f7d-4824-8843-49fc3e59ade6 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Returning 404 to user: Instance 06c0c479-35cb-4cf9-aff0-7d53e7ecba01 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:38.886100 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-570ac437-8f7d-4824-8843-49fc3e59ade6 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c479-35cb-4cf9-aff0-7d53e7ecba01/metadata" status: 404 len: 111 microversion: 2.1 time: 0.017382 Sep 10 10:42:38.886100 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1110/1616] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:42:38 2022] GET /compute/v2.1/servers/06c0c479-35cb-4cf9-aff0-7d53e7ecba01/metadata => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:42:38.886745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aeb0b602-dacb-4be0-bfc0-3d17d2d1588e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:38.887345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aeb0b602-dacb-4be0-bfc0-3d17d2d1588e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:38.894489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb0b602-dacb-4be0-bfc0-3d17d2d1588e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:38.894976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb0b602-dacb-4be0-bfc0-3d17d2d1588e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:38.895405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb0b602-dacb-4be0-bfc0-3d17d2d1588e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:38.896172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb0b602-dacb-4be0-bfc0-3d17d2d1588e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:38.896521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb0b602-dacb-4be0-bfc0-3d17d2d1588e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:38.896941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb0b602-dacb-4be0-bfc0-3d17d2d1588e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:39.026682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aeb0b602-dacb-4be0-bfc0-3d17d2d1588e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:39.035564 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aeb0b602-dacb-4be0-bfc0-3d17d2d1588e tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f" status: 200 len: 1466 microversion: 2.1 time: 0.151814 Sep 10 10:42:39.036142 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1111/1617] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:38 2022] GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f => generated 1466 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:39.042634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-556259528", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "6949200c-0a45-48d1-a5e5-5e687dfebc1f"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:39.097406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] validate_networks() for [('6949200c-0a45-48d1-a5e5-5e687dfebc1f', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:42:39.452466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:42:39.452892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:42:39.453426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:42:39.453841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:42:39.454251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:42:39.463668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:39.464141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:39.464572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:39.465327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:39.465773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:39.466193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:39.482662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Getting quotas for project 302151fe6dda436ca654252333e7fc7f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:42:39.488285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Getting quotas for user 75dc4bf3c30b42448e6dbea15579400e and project 302151fe6dda436ca654252333e7fc7f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:42:39.501140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:42:39.503383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:42:39.549789 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b995d92-8106-4293-9229-ab31c98c2366 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511585 Sep 10 10:42:39.550358 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1112/1618] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:42:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:42:39.554795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8ad6b60-4423-4054-bd48-4a36fb73c594 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae360280>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:39.638782 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8ad6b60-4423-4054-bd48-4a36fb73c594 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087380 Sep 10 10:42:39.639353 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1113/1619] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:42:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:39.643943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6640fae-12c6-4e04-85f2-341547927ab7 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-598840187", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6640fae-12c6-4e04-85f2-341547927ab7 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Request method failure captured: Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 498 Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGn99dyIbtJrSpI9rz5vXil6qYfptL1-33qm9U0pCQAGW9NHeO2DjMRmwyUYJl2sEAPPRw8a4Zx-7-1cp55gTsAMWMboOLI52Cz_jUe3VrSpdNAYWpiHNZLtI5VGkHU68LY8S14qomF2el3GBjptUHF3yERPTwpbzgaAVrU1Tsws1IM Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:39.648174 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:39.649972 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74bdbf1662bc4efd8059ff5ad298b4ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:39.649972 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:39.649972 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:39.649972 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:39.649972 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:39.649972 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:39.649972 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:39.649972 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0d28bb8f4375492681e5b4b30f1ca413 Sep 10 10:42:39.649972 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:39.649972 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:42:39.650695 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-598840187", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} Sep 10 10:42:39.650695 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:39.650695 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:39.650695 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-598840187', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3020c12f-204d-40ae-a6ef-8e794c078d83'}]}}} Sep 10 10:42:39.650695 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:39.650695 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:39.651138 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:42:39.652509 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:42:39.653575 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:39.653575 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:39.653575 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:39.653575 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:39.653575 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:39.653575 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:39.653575 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:39.653575 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:42:39.653575 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:42:39.654213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:39.654213 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:39.654213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6640fae-12c6-4e04-85f2-341547927ab7 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:39.655217 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6640fae-12c6-4e04-85f2-341547927ab7 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.009295 Sep 10 10:42:39.655217 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1114/1620] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:42:39 2022] POST /compute/v2.1/servers => generated 687 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:42:39.655217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63d6942a-e6ad-4bfa-9261-f463f00ae0cd tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2fc5e0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:39.764718 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63d6942a-e6ad-4bfa-9261-f463f00ae0cd tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images?changes-since=2022-09-10T10%3A40%3A39Z" status: 200 len: 1899 microversion: 2.1 time: 0.112803 Sep 10 10:42:39.768606 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1115/1621] 10.222.0.20 () {58 vars in 1199 bytes} [Sat Sep 10 10:42:39 2022] GET /compute/v2.1/images?changes-since=2022-09-10T10%3A40%3A39Z => generated 1899 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:39.772452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-83ae3c10-3681-4389-be38-d5d46b8c79f1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:39.773042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-83ae3c10-3681-4389-be38-d5d46b8c79f1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:39.840863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-83ae3c10-3681-4389-be38-d5d46b8c79f1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:39.848552 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-83ae3c10-3681-4389-be38-d5d46b8c79f1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 200 len: 1207 microversion: 2.1 time: 0.082005 Sep 10 10:42:39.850093 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1116/1622] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:39 2022] GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 1207 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:39.855009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:39.855814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:39.864069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:39.864827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:39.865462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:39.866355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:39.866970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:39.867558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:40.105467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:40.118648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:40.131039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:40.131039 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-19e00aa9-f377-425a-9913-6f7f1cd1c10d tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1733 microversion: 2.25 time: 0.276885 Sep 10 10:42:40.131039 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1117/1623] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:39 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1733 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:40.161717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-68f32144-908e-47c9-a797-8328d2104733 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae2e6ca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:40.255424 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-68f32144-908e-47c9-a797-8328d2104733 tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.103160 Sep 10 10:42:40.256012 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1118/1624] 10.222.0.20 () {58 vars in 1188 bytes} [Sat Sep 10 10:42:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:40.260573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-511cda98-c34c-4fa2-a301-48a23030a23f tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1640798687", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-511cda98-c34c-4fa2-a301-48a23030a23f tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Request method failure captured: Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 500 Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGn99dyIbtJrSpI9rz5vXil6qYfptL1-33qm9U0pCQAGW9NHeO2DjMRmwyUYJl2sEAPPRw8a4Zx-7-1cp55gTsAMWMboOLI52Cz_jUe3VrSpdNAYWpiHNZLtI5VGkHU68LY8S14qomF2el3GBjptUHF3yERPTwpbzgaAVrU1Tsws1IM Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:40.264988 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:40.267100 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74bdbf1662bc4efd8059ff5ad298b4ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:40.267100 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:40.267100 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:40.267100 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:40.267100 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:40.267100 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:40.267100 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:40.267100 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0d28bb8f4375492681e5b4b30f1ca413 Sep 10 10:42:40.267100 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:40.267100 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:42:40.267918 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1640798687", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} Sep 10 10:42:40.267918 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:40.267918 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:40.267918 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1640798687', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3020c12f-204d-40ae-a6ef-8e794c078d83'}]}}} Sep 10 10:42:40.267918 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:40.267918 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:40.268392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:42:40.270619 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:42:40.273019 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:40.273019 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:40.273019 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:40.273019 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:40.273019 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:40.273019 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:40.273019 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:40.273019 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:42:40.273019 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:42:40.275099 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:40.275099 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:40.275099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-511cda98-c34c-4fa2-a301-48a23030a23f tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:40.275491 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-511cda98-c34c-4fa2-a301-48a23030a23f tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010005 Sep 10 10:42:40.275491 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1119/1625] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:42:40 2022] POST /compute/v2.1/servers => generated 689 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:42:40.275491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a20e5834-88f2-4d65-b498-71efbe1e7ca4 req-074ee5ef-00c4-4604-83f8-3ed3fb5acf44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbfd4c5-e209-4e86-a0dd-00738c53b9b3", "name": "network-vif-unplugged", "status": "completed", "tag": "4348d2b9-1dca-4e41-826e-c604d9ea22da"}, {"server_uuid": "b5551819-7a95-48dc-837a-5b1b82fb6c2f", "name": "network-vif-unplugged", "status": "completed", "tag": "cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:40.284594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a20e5834-88f2-4d65-b498-71efbe1e7ca4 req-074ee5ef-00c4-4604-83f8-3ed3fb5acf44 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:40.285365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a20e5834-88f2-4d65-b498-71efbe1e7ca4 req-074ee5ef-00c4-4604-83f8-3ed3fb5acf44 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:40.286000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a20e5834-88f2-4d65-b498-71efbe1e7ca4 req-074ee5ef-00c4-4604-83f8-3ed3fb5acf44 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:40.301481 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a20e5834-88f2-4d65-b498-71efbe1e7ca4 req-074ee5ef-00c4-4604-83f8-3ed3fb5acf44 service nova] Creating event network-vif-unplugged:4348d2b9-1dca-4e41-826e-c604d9ea22da for instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 on n-h2-856894-1 Sep 10 10:42:40.302160 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a20e5834-88f2-4d65-b498-71efbe1e7ca4 req-074ee5ef-00c4-4604-83f8-3ed3fb5acf44 service nova] Creating event network-vif-unplugged:cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba for instance b5551819-7a95-48dc-837a-5b1b82fb6c2f on n-h1-856894-1 Sep 10 10:42:40.313092 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a20e5834-88f2-4d65-b498-71efbe1e7ca4 req-074ee5ef-00c4-4604-83f8-3ed3fb5acf44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.043429 Sep 10 10:42:40.317781 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1120/1626] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:40.324108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8460fdb-d013-42c3-807b-af0de6e1912d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:40.325005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8460fdb-d013-42c3-807b-af0de6e1912d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:40.332861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8460fdb-d013-42c3-807b-af0de6e1912d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:40.333847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8460fdb-d013-42c3-807b-af0de6e1912d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:40.334774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8460fdb-d013-42c3-807b-af0de6e1912d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:40.335734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8460fdb-d013-42c3-807b-af0de6e1912d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:40.336557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8460fdb-d013-42c3-807b-af0de6e1912d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:40.337306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8460fdb-d013-42c3-807b-af0de6e1912d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:40.566256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8460fdb-d013-42c3-807b-af0de6e1912d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:40.575207 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8460fdb-d013-42c3-807b-af0de6e1912d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.255751 Sep 10 10:42:40.575712 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1121/1627] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:40 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:40.582169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dec49e4d-b199-4f93-8d01-401a23de0e88 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2fb550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:40.705507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dec49e4d-b199-4f93-8d01-401a23de0e88 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1673055100" status: 200 len: 485 microversion: 2.1 time: 0.128186 Sep 10 10:42:40.707029 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1122/1628] 10.222.0.20 () {58 vars in 1231 bytes} [Sat Sep 10 10:42:40 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1673055100 => generated 485 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:40.713583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e39d1e0-9639-4a7b-ac5c-cbe7cb7a0589 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:40.718126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e39d1e0-9639-4a7b-ac5c-cbe7cb7a0589 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:40.740346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e39d1e0-9639-4a7b-ac5c-cbe7cb7a0589 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:40.740839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e39d1e0-9639-4a7b-ac5c-cbe7cb7a0589 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:40.741311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e39d1e0-9639-4a7b-ac5c-cbe7cb7a0589 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:40.743913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e39d1e0-9639-4a7b-ac5c-cbe7cb7a0589 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:40.744404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e39d1e0-9639-4a7b-ac5c-cbe7cb7a0589 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:40.744838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e39d1e0-9639-4a7b-ac5c-cbe7cb7a0589 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:41.047714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e39d1e0-9639-4a7b-ac5c-cbe7cb7a0589 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:41.058486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e39d1e0-9639-4a7b-ac5c-cbe7cb7a0589 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1651 microversion: 2.1 time: 0.349596 Sep 10 10:42:41.078741 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1123/1629] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:40 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1651 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:41.086802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36765378-ea98-46da-bc59-aecab6cf996b tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] Calling method '.version_select at 0x7efcae2fbf70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:41.268308 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36765378-ea98-46da-bc59-aecab6cf996b tempest-VolumesTestJSON-804225986 tempest-VolumesTestJSON-804225986-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.186476 Sep 10 10:42:41.269640 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1124/1630] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 10:42:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:41.285635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6e8c12b-4150-4f69-9f3f-2b503e8cf165 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1923062251", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6e8c12b-4150-4f69-9f3f-2b503e8cf165 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Request method failure captured: Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 754 Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGn99dyIbtJrSpI9rz5vXil6qYfptL1-33qm9U0pCQAGW9NHeO2DjMRmwyUYJl2sEAPPRw8a4Zx-7-1cp55gTsAMWMboOLI52Cz_jUe3VrSpdNAYWpiHNZLtI5VGkHU68LY8S14qomF2el3GBjptUHF3yERPTwpbzgaAVrU1Tsws1IM Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:41.298554 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:41.300346 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74bdbf1662bc4efd8059ff5ad298b4ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:41.300346 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:41.300346 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:41.300346 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:41.300346 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:41.300346 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:41.300346 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:41.300346 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0d28bb8f4375492681e5b4b30f1ca413 Sep 10 10:42:41.300346 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:41.300346 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:42:41.301285 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1923062251", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} Sep 10 10:42:41.301285 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:41.301285 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:41.301610 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1923062251', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3020c12f-204d-40ae-a6ef-8e794c078d83'}]}}} Sep 10 10:42:41.301610 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:41.301610 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:41.301610 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:42:41.301610 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:42:41.301610 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:42:41.301610 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:42:41.301610 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:41.302348 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:41.303839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:41.303839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:41.303839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:42:41.303839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:42:41.303839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:42:41.303839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:42:41.303839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:42:41.303839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:42:41.303839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:42:41.303839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:42:41.304556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:41.304556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:41.304556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:41.304556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:41.304556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:41.304556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:41.304556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:41.304556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:42:41.304556 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:42:41.305385 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:41.305385 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:41.305597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6e8c12b-4150-4f69-9f3f-2b503e8cf165 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:41.306403 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b6e8c12b-4150-4f69-9f3f-2b503e8cf165 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.035191 Sep 10 10:42:41.307000 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1125/1631] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:42:41 2022] POST /compute/v2.1/servers => generated 1197 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 10 10:42:41.348202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-58567e3e-e69d-4b10-bc83-947ac2c87e16 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2e6040>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:41.547264 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-58567e3e-e69d-4b10-bc83-947ac2c87e16 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images?server=b5551819-7a95-48dc-837a-5b1b82fb6c2f" status: 200 len: 955 microversion: 2.1 time: 0.235099 Sep 10 10:42:41.547852 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1126/1632] 10.222.0.20 () {58 vars in 1209 bytes} [Sat Sep 10 10:42:41 2022] GET /compute/v2.1/images?server=b5551819-7a95-48dc-837a-5b1b82fb6c2f => generated 955 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:41.565920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b82733f6-cac9-47c5-9c2f-d6667077ef90 req-82de7dbc-c1c7-4c3f-8a48-dedf437f6ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbfd4c5-e209-4e86-a0dd-00738c53b9b3", "name": "network-vif-deleted", "tag": "4348d2b9-1dca-4e41-826e-c604d9ea22da"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:41.585507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b82733f6-cac9-47c5-9c2f-d6667077ef90 req-82de7dbc-c1c7-4c3f-8a48-dedf437f6ae0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:41.585988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b82733f6-cac9-47c5-9c2f-d6667077ef90 req-82de7dbc-c1c7-4c3f-8a48-dedf437f6ae0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:41.591530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b82733f6-cac9-47c5-9c2f-d6667077ef90 req-82de7dbc-c1c7-4c3f-8a48-dedf437f6ae0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:41.628902 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b82733f6-cac9-47c5-9c2f-d6667077ef90 req-82de7dbc-c1c7-4c3f-8a48-dedf437f6ae0 service nova] Creating event network-vif-deleted:4348d2b9-1dca-4e41-826e-c604d9ea22da for instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 on n-h2-856894-1 Sep 10 10:42:41.639045 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b82733f6-cac9-47c5-9c2f-d6667077ef90 req-82de7dbc-c1c7-4c3f-8a48-dedf437f6ae0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077028 Sep 10 10:42:41.639562 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1127/1633] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:41.644632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a34100f-e3cb-45aa-8924-b2ed1eb22a11 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:41.645353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a34100f-e3cb-45aa-8924-b2ed1eb22a11 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:41.661261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a34100f-e3cb-45aa-8924-b2ed1eb22a11 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:41.661755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a34100f-e3cb-45aa-8924-b2ed1eb22a11 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:41.662187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a34100f-e3cb-45aa-8924-b2ed1eb22a11 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:41.662883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a34100f-e3cb-45aa-8924-b2ed1eb22a11 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:41.663330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a34100f-e3cb-45aa-8924-b2ed1eb22a11 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:41.663746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a34100f-e3cb-45aa-8924-b2ed1eb22a11 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:41.789172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a34100f-e3cb-45aa-8924-b2ed1eb22a11 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:41.804560 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a34100f-e3cb-45aa-8924-b2ed1eb22a11 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 200 len: 1277 microversion: 2.1 time: 0.163763 Sep 10 10:42:41.805176 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1128/1634] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:41 2022] GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:41.818256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:41.819091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:41.848322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:41.848453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:41.848802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:41.849609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:41.849991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:41.850418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:41.934200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:41.941448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:41.942223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:41.942869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lazy-loading 'fault' on Instance uuid 7bf4f355-1582-4020-a738-9d8579be881b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:42:42.029721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:42.055657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:42.059129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:42.131856 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23857cfb-f854-4e7d-9bf8-8de960b083ea tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 200 len: 1376 microversion: 2.25 time: 0.245887 Sep 10 10:42:42.131856 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1129/1635] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:41 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 1376 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:42.131856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ae7aacc2-dac3-4b5f-bfe1-d587571260ba req-12d50837-68c8-4fbe-abdf-87c780d50d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf4f355-1582-4020-a738-9d8579be881b", "name": "network-vif-deleted", "tag": "5c9581bc-bf42-47dd-b446-4cf4841d36b7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:42.131856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae7aacc2-dac3-4b5f-bfe1-d587571260ba req-12d50837-68c8-4fbe-abdf-87c780d50d35 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:42.132362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae7aacc2-dac3-4b5f-bfe1-d587571260ba req-12d50837-68c8-4fbe-abdf-87c780d50d35 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:42.132362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae7aacc2-dac3-4b5f-bfe1-d587571260ba req-12d50837-68c8-4fbe-abdf-87c780d50d35 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:42.148668 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ae7aacc2-dac3-4b5f-bfe1-d587571260ba req-12d50837-68c8-4fbe-abdf-87c780d50d35 service nova] Creating event network-vif-deleted:5c9581bc-bf42-47dd-b446-4cf4841d36b7 for instance 7bf4f355-1582-4020-a738-9d8579be881b on n-h1-856894-1 Sep 10 10:42:42.155447 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ae7aacc2-dac3-4b5f-bfe1-d587571260ba req-12d50837-68c8-4fbe-abdf-87c780d50d35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087167 Sep 10 10:42:42.157290 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1130/1636] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:42.184044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-45cfc1a1-3949-4db2-acb6-ad97efea16ce tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2013181739", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-45cfc1a1-3949-4db2-acb6-ad97efea16ce tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Request method failure captured: Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 1266 Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGn99dyIbtJrSpI9rz5vXil6qYfptL1-33qm9U0pCQAGW9NHeO2DjMRmwyUYJl2sEAPPRw8a4Zx-7-1cp55gTsAMWMboOLI52Cz_jUe3VrSpdNAYWpiHNZLtI5VGkHU68LY8S14qomF2el3GBjptUHF3yERPTwpbzgaAVrU1Tsws1IM Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:42.193928 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:42.195677 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74bdbf1662bc4efd8059ff5ad298b4ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:42.195677 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:42.195677 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:42.195677 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:42.195677 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:42.195677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:42.195677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:42.195677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0d28bb8f4375492681e5b4b30f1ca413 Sep 10 10:42:42.195677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:42.195677 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:42:42.196272 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2013181739", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3020c12f-204d-40ae-a6ef-8e794c078d83"}]}} Sep 10 10:42:42.196272 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2013181739', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3020c12f-204d-40ae-a6ef-8e794c078d83'}]}}} Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.196406 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:42:42.197503 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:42:42.198880 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:42:42.198880 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.201328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-45cfc1a1-3949-4db2-acb6-ad97efea16ce tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:42.201556 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-45cfc1a1-3949-4db2-acb6-ad97efea16ce tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.042747 Sep 10 10:42:42.207295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1131/1637] 10.222.0.20 () {60 vars in 1148 bytes} [Sat Sep 10 10:42:42 2022] POST /compute/v2.1/servers => generated 2221 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 10 10:42:42.215352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8014d536-61f2-4c41-9b2f-32a8da06a63d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae3f6f70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:42.276513 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8014d536-61f2-4c41-9b2f-32a8da06a63d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 484 microversion: 2.1 time: 0.066891 Sep 10 10:42:42.277279 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1132/1638] 10.222.0.20 () {58 vars in 1317 bytes} [Sat Sep 10 10:42:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 484 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:42.283357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d1d555f6-9137-4474-b6ff-97e1dae37655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:42.284481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d1d555f6-9137-4474-b6ff-97e1dae37655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:42.291650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1d555f6-9137-4474-b6ff-97e1dae37655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:42.292539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1d555f6-9137-4474-b6ff-97e1dae37655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:42.293222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1d555f6-9137-4474-b6ff-97e1dae37655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:42.294084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1d555f6-9137-4474-b6ff-97e1dae37655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:42.294683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1d555f6-9137-4474-b6ff-97e1dae37655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:42.295253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1d555f6-9137-4474-b6ff-97e1dae37655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:42.501930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d1d555f6-9137-4474-b6ff-97e1dae37655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:42.520936 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d1d555f6-9137-4474-b6ff-97e1dae37655 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.242488 Sep 10 10:42:42.543752 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1133/1639] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:42 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:42.552639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:42.559122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:42.580236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:42.580658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:42.581122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:42.581877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:42.582341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:42.582775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:42.711063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:42.711554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:42.712033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:42.712489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lazy-loading 'fault' on Instance uuid efb025b0-229f-4423-847a-851bbdddc697 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:42:42.766704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47ee461c12bb4fae9792abbc067a71fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf75baac6d4be481406daf0dd81e1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:42.775712 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-077eb0de-991f-448a-ae14-0c371294e634 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 200 len: 1302 microversion: 2.1 time: 0.229699 Sep 10 10:42:42.776586 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1134/1640] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:42 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 1302 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:42.782073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f49ad1c6-4172-4393-bb3c-ac5b78bab36a tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:42.782570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f49ad1c6-4172-4393-bb3c-ac5b78bab36a tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: b17b9ee0-0bc2-4f90-a895-ac3f8f60a278] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:42.796661 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f49ad1c6-4172-4393-bb3c-ac5b78bab36a tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] HTTP exception thrown: Instance b17b9ee0-0bc2-4f90-a895-ac3f8f60a278 could not be found. Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f49ad1c6-4172-4393-bb3c-ac5b78bab36a tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Request method failure captured: Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/b17b9ee0-0bc2-4f90-a895-ac3f8f60a278/metadata/test2 HTTP/1.1 Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGn99dyIbtJrSpI9rz5vXil6qYfptL1-33qm9U0pCQAGW9NHeO2DjMRmwyUYJl2sEAPPRw8a4Zx-7-1cp55gTsAMWMboOLI52Cz_jUe3VrSpdNAYWpiHNZLtI5VGkHU68LY8S14qomF2el3GBjptUHF3yERPTwpbzgaAVrU1Tsws1IM Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74bdbf1662bc4efd8059ff5ad298b4ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0d28bb8f4375492681e5b4b30f1ca413 Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance b17b9ee0-0bc2-4f90-a895-ac3f8f60a278 could not be found. Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': 'b17b9ee0-0bc2-4f90-a895-ac3f8f60a278', 'id': 'test2'} Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b17b9ee0-0bc2-4f90-a895-ac3f8f60a278 could not be found. Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b17b9ee0-0bc2-4f90-a895-ac3f8f60a278 could not be found. Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:42.798467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:42.801324 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:42.801324 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:42.801324 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b17b9ee0-0bc2-4f90-a895-ac3f8f60a278 could not be found. Sep 10 10:42:42.801324 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:42.801324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f49ad1c6-4172-4393-bb3c-ac5b78bab36a tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Returning 404 to user: Instance b17b9ee0-0bc2-4f90-a895-ac3f8f60a278 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:42.801324 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f49ad1c6-4172-4393-bb3c-ac5b78bab36a tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/b17b9ee0-0bc2-4f90-a895-ac3f8f60a278/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.022495 Sep 10 10:42:42.810681 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1135/1641] 10.222.0.20 () {58 vars in 1281 bytes} [Sat Sep 10 10:42:42 2022] GET /compute/v2.1/servers/b17b9ee0-0bc2-4f90-a895-ac3f8f60a278/metadata/test2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:42:42.818743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f99e3d4-9692-43c3-911a-1ad83c29acb0 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2fcc10>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:42.879722 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f99e3d4-9692-43c3-911a-1ad83c29acb0 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 484 microversion: 2.1 time: 0.067332 Sep 10 10:42:42.881047 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1136/1642] 10.222.0.20 () {58 vars in 1303 bytes} [Sat Sep 10 10:42:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 484 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:42.886338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-55f440d7-acf7-48a4-84ec-3807408bdf81 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:42.887022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-55f440d7-acf7-48a4-84ec-3807408bdf81 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:42.898056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55f440d7-acf7-48a4-84ec-3807408bdf81 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:42.898572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55f440d7-acf7-48a4-84ec-3807408bdf81 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:42.899022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55f440d7-acf7-48a4-84ec-3807408bdf81 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:42.903508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55f440d7-acf7-48a4-84ec-3807408bdf81 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:42.904047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55f440d7-acf7-48a4-84ec-3807408bdf81 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:42.904506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55f440d7-acf7-48a4-84ec-3807408bdf81 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:42.959919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-55f440d7-acf7-48a4-84ec-3807408bdf81 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:42:43.073794 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-55f440d7-acf7-48a4-84ec-3807408bdf81 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 204 len: 0 microversion: 2.1 time: 0.190896 Sep 10 10:42:43.075698 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1137/1643] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:42:42 2022] DELETE /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:42:43.084436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a78ffc4-2e74-43b1-a9d5-7ffc2764caf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:43.085871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a78ffc4-2e74-43b1-a9d5-7ffc2764caf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:43.094384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a78ffc4-2e74-43b1-a9d5-7ffc2764caf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:43.095187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a78ffc4-2e74-43b1-a9d5-7ffc2764caf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:43.095931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a78ffc4-2e74-43b1-a9d5-7ffc2764caf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:43.096877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a78ffc4-2e74-43b1-a9d5-7ffc2764caf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:43.097713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a78ffc4-2e74-43b1-a9d5-7ffc2764caf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:43.098490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a78ffc4-2e74-43b1-a9d5-7ffc2764caf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:43.421209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a78ffc4-2e74-43b1-a9d5-7ffc2764caf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:43.435193 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a78ffc4-2e74-43b1-a9d5-7ffc2764caf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 200 len: 1307 microversion: 2.1 time: 0.357759 Sep 10 10:42:43.435811 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1138/1644] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:43 2022] GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:43.460671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-736e65f4-829b-4797-a01d-8e0c1a44f900 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2fcd30>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:43.619621 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-736e65f4-829b-4797-a01d-8e0c1a44f900 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3277 microversion: 2.1 time: 0.165140 Sep 10 10:42:43.620883 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1139/1645] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:42:43 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:43.637352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b55b9b22-266e-4cf8-b6d1-1054b256d371 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:43.638182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b55b9b22-266e-4cf8-b6d1-1054b256d371 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:43.647801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b55b9b22-266e-4cf8-b6d1-1054b256d371 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:43.650197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b55b9b22-266e-4cf8-b6d1-1054b256d371 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:43.652272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b55b9b22-266e-4cf8-b6d1-1054b256d371 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:43.653133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b55b9b22-266e-4cf8-b6d1-1054b256d371 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:43.662803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b55b9b22-266e-4cf8-b6d1-1054b256d371 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:43.663425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b55b9b22-266e-4cf8-b6d1-1054b256d371 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:43.950414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b55b9b22-266e-4cf8-b6d1-1054b256d371 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d28bb8f4375492681e5b4b30f1ca413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bdbf1662bc4efd8059ff5ad298b4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:43.958841 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b55b9b22-266e-4cf8-b6d1-1054b256d371 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 200 len: 1526 microversion: 2.1 time: 0.325950 Sep 10 10:42:43.974312 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1140/1646] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:43 2022] GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 1526 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:43.980700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:43.981512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 7bf4f355-1582-4020-a738-9d8579be881b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:43.988652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:43.989376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:43.989958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:43.990905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:43.991491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:43.992050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:44.011594 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] HTTP exception thrown: Instance 7bf4f355-1582-4020-a738-9d8579be881b could not be found. Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Request method failure captured: Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b HTTP/1.1 Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiJm0D22NV-Z8qEdxR4XF2RPIGKQ50HB-p70fCdi_YFXzgyBPXKaq1rf3Fx__-5KYiBj5-XdAkTE-oI7chG3PnQ0mpJ7ywGO33P25HUSy7nxQpnspPUb_rE3PM5GDcBytPHtiJ_o3_hQxNRrILgPzvZv8rTkixPjN8fVkmTI50v-gg Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9c2ac1f5c5c843fc89294292d4489252 Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c2ac1f5c5c843fc89294292d4489252", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9c2ac1f5c5c843fc89294292d4489252 Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-LiveAutoBlockMigrationV225Test-592704198-project Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 362b727b96934e58b180727eaad35e3b Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-592704198-project Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7bf4f355-1582-4020-a738-9d8579be881b could not be found. Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7bf4f355-1582-4020-a738-9d8579be881b'} Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf4f355-1582-4020-a738-9d8579be881b could not be found. Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf4f355-1582-4020-a738-9d8579be881b could not be found. Sep 10 10:42:44.013630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:44.017393 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:44.017393 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:44.017393 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:44.017393 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:44.017393 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:44.017393 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:44.017393 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:44.017393 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf4f355-1582-4020-a738-9d8579be881b could not be found. Sep 10 10:42:44.017393 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:44.018894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Returning 404 to user: Instance 7bf4f355-1582-4020-a738-9d8579be881b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:44.020493 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f90ad054-7834-4f19-8b42-055ef4f15f05 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b" status: 404 len: 111 microversion: 2.25 time: 0.044748 Sep 10 10:42:44.021344 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1141/1647] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:43 2022] GET /compute/v2.1/servers/7bf4f355-1582-4020-a738-9d8579be881b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:42:44.026121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb2d519f-af93-4872-bb1e-ebe65ff0962a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:44.026902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cb2d519f-af93-4872-bb1e-ebe65ff0962a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:44.034126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2d519f-af93-4872-bb1e-ebe65ff0962a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:44.035058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2d519f-af93-4872-bb1e-ebe65ff0962a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:44.035667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2d519f-af93-4872-bb1e-ebe65ff0962a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:44.036619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2d519f-af93-4872-bb1e-ebe65ff0962a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:44.037259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2d519f-af93-4872-bb1e-ebe65ff0962a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:44.037692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2d519f-af93-4872-bb1e-ebe65ff0962a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:44.687013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cb2d519f-af93-4872-bb1e-ebe65ff0962a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:44.702271 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb2d519f-af93-4872-bb1e-ebe65ff0962a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.679632 Sep 10 10:42:44.718242 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1142/1648] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:44 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:44.732307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cecfe98-3f40-4b31-89e6-572d00ab46a5 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2d6160>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:44.879548 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cecfe98-3f40-4b31-89e6-572d00ab46a5 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1427 microversion: 2.1 time: 0.154580 Sep 10 10:42:44.880357 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1143/1649] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:42:44 2022] GET /compute/v2.1/images?type=snapshot => generated 1427 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:44.886486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a9f4ba09-5301-4962-8ca1-29d229dc6d32 req-cd847910-474e-4dd0-ae7a-a439e70a259a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb025b0-229f-4423-847a-851bbdddc697", "name": "network-vif-deleted", "tag": "c27a5c35-d97c-4cd1-b95f-b60ade027d46"}, {"server_uuid": "efb025b0-229f-4423-847a-851bbdddc697", "name": "network-vif-deleted", "tag": "4bea308d-e61c-4f8e-8df6-c5eeb68bb884"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:44.903213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a9f4ba09-5301-4962-8ca1-29d229dc6d32 req-cd847910-474e-4dd0-ae7a-a439e70a259a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:44.903701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a9f4ba09-5301-4962-8ca1-29d229dc6d32 req-cd847910-474e-4dd0-ae7a-a439e70a259a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:44.904142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a9f4ba09-5301-4962-8ca1-29d229dc6d32 req-cd847910-474e-4dd0-ae7a-a439e70a259a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:44.916292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:44.918559 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a9f4ba09-5301-4962-8ca1-29d229dc6d32 req-cd847910-474e-4dd0-ae7a-a439e70a259a service nova] Creating event network-vif-deleted:c27a5c35-d97c-4cd1-b95f-b60ade027d46 for instance efb025b0-229f-4423-847a-851bbdddc697 on n-h1-856894-1 Sep 10 10:42:44.919191 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a9f4ba09-5301-4962-8ca1-29d229dc6d32 req-cd847910-474e-4dd0-ae7a-a439e70a259a service nova] Creating event network-vif-deleted:4bea308d-e61c-4f8e-8df6-c5eeb68bb884 for instance efb025b0-229f-4423-847a-851bbdddc697 on n-h1-856894-1 Sep 10 10:42:44.925268 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a9f4ba09-5301-4962-8ca1-29d229dc6d32 req-cd847910-474e-4dd0-ae7a-a439e70a259a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043466 Sep 10 10:42:44.926905 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1144/1650] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:44.933932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:44.934658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:44.951475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:44.952013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:44.952482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:44.953874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:44.954595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:44.957779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:44.976428 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] HTTP exception thrown: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Request method failure captured: Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 HTTP/1.1 Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmc-yIdfviXHPYwjT9z1Y8ZWTBBLkziRg2lUYR8EaSNJ8zJolFb55CcfqBTGghyaWoV9eP__xeAUXHzsQB02o9Z4gEe90tmeMsEk_N4RB9zFBTzrUcUuOj9sJmvCgnIG1zUVYuhdLNk2UBSke60kzA5n-B1mjgS1ezd_7odwnAhGwA Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebcf75baac6d4be481406daf0dd81e1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 47ee461c12bb4fae9792abbc067a71fa Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'efb025b0-229f-4423-847a-851bbdddc697'} Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:44.978566 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:44.983370 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:44.983370 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:44.983370 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:44.983370 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:44.983370 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:44.983370 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:44.983370 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:44.985287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Returning 404 to user: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:44.986466 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95fe67d4-635d-48d9-af3e-22e228f98c38 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 404 len: 111 microversion: 2.1 time: 0.058322 Sep 10 10:42:44.990811 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1145/1651] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:44 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:42:45.005343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-436b4c87-04ac-4fe3-b824-852d95d86087 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '.version_select at 0x7efcae2d6af0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:45.041863 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-436b4c87-04ac-4fe3-b824-852d95d86087 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091877618" status: 204 len: 0 microversion: 2.25 time: 0.051011 Sep 10 10:42:45.042764 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1146/1652] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 10:42:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091877618 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:42:45.051011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-88e79624-5daf-48cd-aaf9-9c1f59745841 req-c0bb16b8-b65a-432f-a028-89630a03fc4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5815be-a9f4-4a13-846f-d2f2d7384e00", "name": "network-vif-unplugged", "status": "completed", "tag": "bb2be5dc-a2e7-4447-9939-ef537449e050"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:45.085432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-88e79624-5daf-48cd-aaf9-9c1f59745841 req-c0bb16b8-b65a-432f-a028-89630a03fc4a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:45.085918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-88e79624-5daf-48cd-aaf9-9c1f59745841 req-c0bb16b8-b65a-432f-a028-89630a03fc4a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:45.086344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-88e79624-5daf-48cd-aaf9-9c1f59745841 req-c0bb16b8-b65a-432f-a028-89630a03fc4a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:45.119049 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-88e79624-5daf-48cd-aaf9-9c1f59745841 req-c0bb16b8-b65a-432f-a028-89630a03fc4a service nova] Creating event network-vif-unplugged:bb2be5dc-a2e7-4447-9939-ef537449e050 for instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 on n-h1-856894-1 Sep 10 10:42:45.126931 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-88e79624-5daf-48cd-aaf9-9c1f59745841 req-c0bb16b8-b65a-432f-a028-89630a03fc4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082899 Sep 10 10:42:45.127530 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1147/1653] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:45.144095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6317672-cab4-4bd2-9539-853866e96c9d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:45.144853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6317672-cab4-4bd2-9539-853866e96c9d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:45.159143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6317672-cab4-4bd2-9539-853866e96c9d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:45.159635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6317672-cab4-4bd2-9539-853866e96c9d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:45.163854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6317672-cab4-4bd2-9539-853866e96c9d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:45.164745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6317672-cab4-4bd2-9539-853866e96c9d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:45.165375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6317672-cab4-4bd2-9539-853866e96c9d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:45.172475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6317672-cab4-4bd2-9539-853866e96c9d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:45.825194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f6317672-cab4-4bd2-9539-853866e96c9d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:45.838527 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6317672-cab4-4bd2-9539-853866e96c9d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 200 len: 1307 microversion: 2.1 time: 0.709498 Sep 10 10:42:45.844809 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1148/1654] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:45 2022] GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 1307 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:45.850464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbe1d0a4-0c1e-44ed-9231-987294561036 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae343940>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:45.988147 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbe1d0a4-0c1e-44ed-9231-987294561036 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images?limit=1" status: 200 len: 620 microversion: 2.1 time: 0.141732 Sep 10 10:42:45.988835 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1149/1655] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:42:45 2022] GET /compute/v2.1/images?limit=1 => generated 620 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:46.001324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:46.006008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:46.019083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:46.019663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:46.020356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:46.021309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:46.021970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:46.022620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:46.100562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:46.101627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:46.102230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:46.103035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lazy-loading 'fault' on Instance uuid 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:42:46.184953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d28bb8f4375492681e5b4b30f1ca413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bdbf1662bc4efd8059ff5ad298b4ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:46.197661 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-602f8f36-f6b6-45bd-a914-aeca896fcdbf tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 200 len: 1313 microversion: 2.1 time: 0.205323 Sep 10 10:42:46.217736 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1150/1656] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:45 2022] GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:46.225513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dab4b9ab-53c1-4fe2-b812-647ddacd0af9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:46.226603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dab4b9ab-53c1-4fe2-b812-647ddacd0af9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:46.235201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab4b9ab-53c1-4fe2-b812-647ddacd0af9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:46.235935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab4b9ab-53c1-4fe2-b812-647ddacd0af9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:46.236552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab4b9ab-53c1-4fe2-b812-647ddacd0af9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:46.237624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab4b9ab-53c1-4fe2-b812-647ddacd0af9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:46.238490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab4b9ab-53c1-4fe2-b812-647ddacd0af9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:46.239170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dab4b9ab-53c1-4fe2-b812-647ddacd0af9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:46.594397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dab4b9ab-53c1-4fe2-b812-647ddacd0af9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:46.604934 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dab4b9ab-53c1-4fe2-b812-647ddacd0af9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.385614 Sep 10 10:42:46.617422 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1151/1657] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:46 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:46.625941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6b4d850-9414-4d7d-9e2a-4454ca0225a0 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2bb430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:46.963451 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6b4d850-9414-4d7d-9e2a-4454ca0225a0 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/detail?changes-since=2022-09-10T10%3A40%3A26Z" status: 200 len: 6324 microversion: 2.1 time: 0.344550 Sep 10 10:42:46.985298 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1152/1658] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Sep 10 10:42:46 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-10T10%3A40%3A26Z => generated 6324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:46.995934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3850b449-b0fe-4992-967f-77b804b9443d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:46.996575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3850b449-b0fe-4992-967f-77b804b9443d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:47.008403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3850b449-b0fe-4992-967f-77b804b9443d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.008833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3850b449-b0fe-4992-967f-77b804b9443d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.009321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3850b449-b0fe-4992-967f-77b804b9443d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.010021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3850b449-b0fe-4992-967f-77b804b9443d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.010477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3850b449-b0fe-4992-967f-77b804b9443d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.010901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3850b449-b0fe-4992-967f-77b804b9443d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.168382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3850b449-b0fe-4992-967f-77b804b9443d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:47.177982 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3850b449-b0fe-4992-967f-77b804b9443d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 200 len: 1307 microversion: 2.1 time: 0.191545 Sep 10 10:42:47.179984 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1153/1659] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:46 2022] GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 1307 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:47.184031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-91068ef2-dc3e-4b3f-b61c-1b1c84c6f2a2 req-890f408f-9cd5-4f2c-a708-38d271f59306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b22547-e130-45f7-8f9c-fb57446ab4c7", "tag": "9b3e5283-8ed5-4225-8495-f8cb4bf41ad3"}, {"server_uuid": "7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb", "name": "network-vif-deleted", "tag": "44e7faec-bb94-47bd-bdc4-7b2daed724cb"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:47.190294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:47.201893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-91068ef2-dc3e-4b3f-b61c-1b1c84c6f2a2 req-890f408f-9cd5-4f2c-a708-38d271f59306 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.202971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-91068ef2-dc3e-4b3f-b61c-1b1c84c6f2a2 req-890f408f-9cd5-4f2c-a708-38d271f59306 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.204387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-91068ef2-dc3e-4b3f-b61c-1b1c84c6f2a2 req-890f408f-9cd5-4f2c-a708-38d271f59306 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.227438 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-91068ef2-dc3e-4b3f-b61c-1b1c84c6f2a2 req-890f408f-9cd5-4f2c-a708-38d271f59306 service nova] Creating event network-changed:9b3e5283-8ed5-4225-8495-f8cb4bf41ad3 for instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 on n-h2-856894-1 Sep 10 10:42:47.227994 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-91068ef2-dc3e-4b3f-b61c-1b1c84c6f2a2 req-890f408f-9cd5-4f2c-a708-38d271f59306 service nova] Creating event network-vif-deleted:44e7faec-bb94-47bd-bdc4-7b2daed724cb for instance 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb on n-h1-856894-1 Sep 10 10:42:47.255017 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-91068ef2-dc3e-4b3f-b61c-1b1c84c6f2a2 req-890f408f-9cd5-4f2c-a708-38d271f59306 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.074511 Sep 10 10:42:47.255650 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1154/1660] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:47.262136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ffacf6d-aad4-4407-bb34-d1a6a6c28837 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:47.264198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ffacf6d-aad4-4407-bb34-d1a6a6c28837 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:47.272922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ffacf6d-aad4-4407-bb34-d1a6a6c28837 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.285750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ffacf6d-aad4-4407-bb34-d1a6a6c28837 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.286418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ffacf6d-aad4-4407-bb34-d1a6a6c28837 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.287182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ffacf6d-aad4-4407-bb34-d1a6a6c28837 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.287651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ffacf6d-aad4-4407-bb34-d1a6a6c28837 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.288090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ffacf6d-aad4-4407-bb34-d1a6a6c28837 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.317368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ffacf6d-aad4-4407-bb34-d1a6a6c28837 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:42:47.446552 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ffacf6d-aad4-4407-bb34-d1a6a6c28837 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 204 len: 0 microversion: 2.1 time: 0.189468 Sep 10 10:42:47.447577 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1155/1661] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:42:47 2022] DELETE /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:42:47.453155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b966ed77-c845-4160-ba59-7cbfd297b391 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2fa670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:47.535100 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b966ed77-c845-4160-ba59-7cbfd297b391 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1673055100" status: 200 len: 665 microversion: 2.1 time: 0.085709 Sep 10 10:42:47.535983 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1156/1662] 10.222.0.20 () {58 vars in 1252 bytes} [Sat Sep 10 10:42:47 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1673055100 => generated 665 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:47.540969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6b29deb-22f5-4fe6-b92c-12164636b814 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:47.541672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6b29deb-22f5-4fe6-b92c-12164636b814 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:47.555938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6b29deb-22f5-4fe6-b92c-12164636b814 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.556670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6b29deb-22f5-4fe6-b92c-12164636b814 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.557368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6b29deb-22f5-4fe6-b92c-12164636b814 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.561665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6b29deb-22f5-4fe6-b92c-12164636b814 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.562578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6b29deb-22f5-4fe6-b92c-12164636b814 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.563260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6b29deb-22f5-4fe6-b92c-12164636b814 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.589821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6b29deb-22f5-4fe6-b92c-12164636b814 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:42:47.684506 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6b29deb-22f5-4fe6-b92c-12164636b814 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 204 len: 0 microversion: 2.25 time: 0.146821 Sep 10 10:42:47.689719 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1157/1663] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:42:47 2022] DELETE /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:42:47.697548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-217fe973-0e89-47e8-ada2-d572f2211b7b req-f7acc191-23c0-4bc9-9c69-8d216d4e01f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5815be-a9f4-4a13-846f-d2f2d7384e00", "tag": "bb2be5dc-a2e7-4447-9939-ef537449e050"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:47.708885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-217fe973-0e89-47e8-ada2-d572f2211b7b req-f7acc191-23c0-4bc9-9c69-8d216d4e01f2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.709878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-217fe973-0e89-47e8-ada2-d572f2211b7b req-f7acc191-23c0-4bc9-9c69-8d216d4e01f2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.710661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-217fe973-0e89-47e8-ada2-d572f2211b7b req-f7acc191-23c0-4bc9-9c69-8d216d4e01f2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.726353 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-217fe973-0e89-47e8-ada2-d572f2211b7b req-f7acc191-23c0-4bc9-9c69-8d216d4e01f2 service nova] Creating event network-changed:bb2be5dc-a2e7-4447-9939-ef537449e050 for instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 on n-h1-856894-1 Sep 10 10:42:47.731745 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-217fe973-0e89-47e8-ada2-d572f2211b7b req-f7acc191-23c0-4bc9-9c69-8d216d4e01f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040413 Sep 10 10:42:47.732860 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1158/1664] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:47.738967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:47.739850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] [instance: 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:47.747379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.748115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.748772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.750321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.752044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.752044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.769251 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] HTTP exception thrown: Instance 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb could not be found. Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Request method failure captured: Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb HTTP/1.1 Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGn99dyIbtJrSpI9rz5vXil6qYfptL1-33qm9U0pCQAGW9NHeO2DjMRmwyUYJl2sEAPPRw8a4Zx-7-1cp55gTsAMWMboOLI52Cz_jUe3VrSpdNAYWpiHNZLtI5VGkHU68LY8S14qomF2el3GBjptUHF3yERPTwpbzgaAVrU1Tsws1IM Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74bdbf1662bc4efd8059ff5ad298b4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74bdbf1662bc4efd8059ff5ad298b4ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 74bdbf1662bc4efd8059ff5ad298b4ad Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1775482330 Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0d28bb8f4375492681e5b4b30f1ca413 Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1775482330-project Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb could not be found. Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb'} Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb could not be found. Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb could not be found. Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:47.771832 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:47.776078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:47.776078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:47.776078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:47.776078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:47.776078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:47.776078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:47.776078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb could not be found. Sep 10 10:42:47.776078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:47.776078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] Returning 404 to user: Instance 7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:47.777344 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-184cacb1-9b64-44f5-8583-e19899db4c14 tempest-ServerMetadataNegativeTestJSON-1775482330 tempest-ServerMetadataNegativeTestJSON-1775482330-project] 10.222.0.20 "GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb" status: 404 len: 111 microversion: 2.1 time: 0.043031 Sep 10 10:42:47.778197 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1159/1665] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:47 2022] GET /compute/v2.1/servers/7c5f0a1b-5afb-4fd7-958a-43b5bcd419eb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:42:47.787575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a0e7b9f-3fd5-4c02-b9d0-692f65f2cf22 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:47.788369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a0e7b9f-3fd5-4c02-b9d0-692f65f2cf22 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:47.794801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a0e7b9f-3fd5-4c02-b9d0-692f65f2cf22 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.795423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a0e7b9f-3fd5-4c02-b9d0-692f65f2cf22 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.795971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a0e7b9f-3fd5-4c02-b9d0-692f65f2cf22 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:47.797341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a0e7b9f-3fd5-4c02-b9d0-692f65f2cf22 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:47.797907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a0e7b9f-3fd5-4c02-b9d0-692f65f2cf22 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:47.798438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a0e7b9f-3fd5-4c02-b9d0-692f65f2cf22 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:48.160674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a0e7b9f-3fd5-4c02-b9d0-692f65f2cf22 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:48.189367 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a0e7b9f-3fd5-4c02-b9d0-692f65f2cf22 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1553 microversion: 2.1 time: 0.395105 Sep 10 10:42:48.190380 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1160/1666] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:47 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1553 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:48.216025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bbefd820-c1db-4fd5-a1e2-720a04c8d8ab tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2fc3a0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:48.342503 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bbefd820-c1db-4fd5-a1e2-720a04c8d8ab tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 1464 microversion: 2.1 time: 0.135446 Sep 10 10:42:48.348206 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1161/1667] 10.222.0.20 () {58 vars in 1338 bytes} [Sat Sep 10 10:42:48 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:48.353016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db8ff80c-354d-4f4f-b660-12bbd092c8b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:48.357636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db8ff80c-354d-4f4f-b660-12bbd092c8b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:48.384397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db8ff80c-354d-4f4f-b660-12bbd092c8b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:48.387584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db8ff80c-354d-4f4f-b660-12bbd092c8b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:48.388039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db8ff80c-354d-4f4f-b660-12bbd092c8b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:48.388779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db8ff80c-354d-4f4f-b660-12bbd092c8b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:48.389345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db8ff80c-354d-4f4f-b660-12bbd092c8b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:48.389772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db8ff80c-354d-4f4f-b660-12bbd092c8b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:49.009741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-db8ff80c-354d-4f4f-b660-12bbd092c8b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:49.032287 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db8ff80c-354d-4f4f-b660-12bbd092c8b4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.682809 Sep 10 10:42:49.045869 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1162/1668] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:48 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:49.055473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:49.056127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:49.074486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:49.076029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:49.076488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:49.077249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:49.077772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:49.078711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:49.475074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:49.547257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:49.566759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:49.572220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:49.580217 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4009976f-57ba-402b-95dd-eedfeff4d6a3 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1549 microversion: 2.25 time: 0.533532 Sep 10 10:42:49.580935 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1163/1669] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:49 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1549 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:49.590437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27a4669f-c035-44f4-950c-bab92f01114f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:49.598090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-27a4669f-c035-44f4-950c-bab92f01114f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:49.606424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27a4669f-c035-44f4-950c-bab92f01114f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:49.607247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27a4669f-c035-44f4-950c-bab92f01114f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:49.609611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27a4669f-c035-44f4-950c-bab92f01114f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:49.610588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27a4669f-c035-44f4-950c-bab92f01114f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:49.621194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27a4669f-c035-44f4-950c-bab92f01114f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:49.622101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27a4669f-c035-44f4-950c-bab92f01114f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:49.845878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:49.996985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-27a4669f-c035-44f4-950c-bab92f01114f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:50.010451 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27a4669f-c035-44f4-950c-bab92f01114f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 200 len: 1307 microversion: 2.1 time: 0.427659 Sep 10 10:42:50.021725 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1164/1670] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:49 2022] GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 1307 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:50.021725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b10dbc65-ca97-476c-974e-278a7f90c7f1 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2c3dc0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:50.093915 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b10dbc65-ca97-476c-974e-278a7f90c7f1 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 1464 microversion: 2.1 time: 0.081146 Sep 10 10:42:50.094520 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1165/1671] 10.222.0.20 () {58 vars in 1324 bytes} [Sat Sep 10 10:42:50 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 1464 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:50.110496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:50.110919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:50.123885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:50.127183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:50.127785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:50.128676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:50.129297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:50.131413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:50.698519 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] HTTP exception thrown: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Request method failure captured: Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 HTTP/1.1 Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmc-yIdfviXHPYwjT9z1Y8ZWTBBLkziRg2lUYR8EaSNJ8zJolFb55CcfqBTGghyaWoV9eP__xeAUXHzsQB02o9Z4gEe90tmeMsEk_N4RB9zFBTzrUcUuOj9sJmvCgnIG1zUVYuhdLNk2UBSke60kzA5n-B1mjgS1ezd_7odwnAhGwA Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebcf75baac6d4be481406daf0dd81e1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 47ee461c12bb4fae9792abbc067a71fa Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'efb025b0-229f-4423-847a-851bbdddc697'} Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:50.700331 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:50.704953 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:50.705798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Returning 404 to user: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:50.706737 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-560c0e9f-ee60-4e27-aa2b-dae235933b71 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "DELETE /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 404 len: 111 microversion: 2.1 time: 0.611263 Sep 10 10:42:50.707425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1166/1672] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:42:50 2022] DELETE /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 111 bytes in 612 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:42:50.713047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb6c34ad-a518-4c3d-8612-6ae047a4b631 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:50.713998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb6c34ad-a518-4c3d-8612-6ae047a4b631 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:50.723048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb6c34ad-a518-4c3d-8612-6ae047a4b631 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:50.723656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb6c34ad-a518-4c3d-8612-6ae047a4b631 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:50.724232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb6c34ad-a518-4c3d-8612-6ae047a4b631 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:50.725208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb6c34ad-a518-4c3d-8612-6ae047a4b631 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:50.725805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb6c34ad-a518-4c3d-8612-6ae047a4b631 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:50.726361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb6c34ad-a518-4c3d-8612-6ae047a4b631 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:50.867176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb6c34ad-a518-4c3d-8612-6ae047a4b631 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:50.871161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:50.884320 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb6c34ad-a518-4c3d-8612-6ae047a4b631 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1346 microversion: 2.1 time: 0.175624 Sep 10 10:42:50.889009 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1167/1673] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:50 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1346 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:50.894115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a61fe45-7a2d-41d4-97be-ab8b02e8c7e3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:50.921057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a61fe45-7a2d-41d4-97be-ab8b02e8c7e3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:50.928257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a61fe45-7a2d-41d4-97be-ab8b02e8c7e3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:50.929022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a61fe45-7a2d-41d4-97be-ab8b02e8c7e3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:50.929946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a61fe45-7a2d-41d4-97be-ab8b02e8c7e3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:50.937994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a61fe45-7a2d-41d4-97be-ab8b02e8c7e3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:50.938702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a61fe45-7a2d-41d4-97be-ab8b02e8c7e3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:50.939367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a61fe45-7a2d-41d4-97be-ab8b02e8c7e3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:51.166029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a61fe45-7a2d-41d4-97be-ab8b02e8c7e3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:51.176538 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a61fe45-7a2d-41d4-97be-ab8b02e8c7e3 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.286172 Sep 10 10:42:51.194716 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1168/1674] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:50 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:51.202655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76981477-69fd-47f2-b22b-f2aa24a4549d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2e6700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:51.371137 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76981477-69fd-47f2-b22b-f2aa24a4549d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7099 microversion: 2.1 time: 0.174872 Sep 10 10:42:51.371721 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1169/1675] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Sep 10 10:42:51 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7099 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:51.376558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e7fed7ec-2e5f-464e-ae4b-befe9a6f6c15 req-e4f68ddc-7a0f-4a2b-95a1-171e40ac6c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5fc162-ff4a-4020-97ca-7e9960c2f455", "name": "network-vif-deleted", "tag": "7696d8d6-82d0-49c4-a65c-99ae55b6449f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:51.386928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e7fed7ec-2e5f-464e-ae4b-befe9a6f6c15 req-e4f68ddc-7a0f-4a2b-95a1-171e40ac6c6a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:51.387409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e7fed7ec-2e5f-464e-ae4b-befe9a6f6c15 req-e4f68ddc-7a0f-4a2b-95a1-171e40ac6c6a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:51.387840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e7fed7ec-2e5f-464e-ae4b-befe9a6f6c15 req-e4f68ddc-7a0f-4a2b-95a1-171e40ac6c6a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:51.401708 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e7fed7ec-2e5f-464e-ae4b-befe9a6f6c15 req-e4f68ddc-7a0f-4a2b-95a1-171e40ac6c6a service nova] Creating event network-vif-deleted:7696d8d6-82d0-49c4-a65c-99ae55b6449f for instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 on n-h2-856894-1 Sep 10 10:42:51.408406 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e7fed7ec-2e5f-464e-ae4b-befe9a6f6c15 req-e4f68ddc-7a0f-4a2b-95a1-171e40ac6c6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035530 Sep 10 10:42:51.409989 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1170/1676] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:51.417357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3c61c5ef-07e1-425a-b712-3fbfbdc3a286 req-db8a4d3e-f92f-469c-b68b-f3e1a8ab87bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20059d23-e6d5-4140-ac67-7ebf9534febc", "name": "network-vif-deleted", "tag": "3431f20f-3f1d-4d78-b1c5-efe9c1726cc1"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:51.430998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3c61c5ef-07e1-425a-b712-3fbfbdc3a286 req-db8a4d3e-f92f-469c-b68b-f3e1a8ab87bf service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:51.431486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3c61c5ef-07e1-425a-b712-3fbfbdc3a286 req-db8a4d3e-f92f-469c-b68b-f3e1a8ab87bf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:51.431922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3c61c5ef-07e1-425a-b712-3fbfbdc3a286 req-db8a4d3e-f92f-469c-b68b-f3e1a8ab87bf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:51.443164 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3c61c5ef-07e1-425a-b712-3fbfbdc3a286 req-db8a4d3e-f92f-469c-b68b-f3e1a8ab87bf service nova] Creating event network-vif-deleted:3431f20f-3f1d-4d78-b1c5-efe9c1726cc1 for instance 20059d23-e6d5-4140-ac67-7ebf9534febc on n-h2-856894-1 Sep 10 10:42:51.448247 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3c61c5ef-07e1-425a-b712-3fbfbdc3a286 req-db8a4d3e-f92f-469c-b68b-f3e1a8ab87bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Sep 10 10:42:51.449230 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1171/1677] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:51.455700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:51.456713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:51.465001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:51.465533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:51.465972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:51.467466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:51.468098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:51.469097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:51.510267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:51.510426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:51.511008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:51.511639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lazy-loading 'fault' on Instance uuid ff5fc162-ff4a-4020-97ca-7e9960c2f455 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:42:51.669813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:51.688891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:51.690620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:51.691838 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80525673-309d-4470-b40f-00c1230ae380 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 200 len: 1352 microversion: 2.25 time: 0.241392 Sep 10 10:42:51.692405 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1172/1678] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:51 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 1352 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:51.721158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:51.721158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: efb025b0-229f-4423-847a-851bbdddc697] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:51.751045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:51.751696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:51.752163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:51.752914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:51.753450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:51.765746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:51.807897 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] HTTP exception thrown: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Request method failure captured: Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 HTTP/1.1 Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmc-yIdfviXHPYwjT9z1Y8ZWTBBLkziRg2lUYR8EaSNJ8zJolFb55CcfqBTGghyaWoV9eP__xeAUXHzsQB02o9Z4gEe90tmeMsEk_N4RB9zFBTzrUcUuOj9sJmvCgnIG1zUVYuhdLNk2UBSke60kzA5n-B1mjgS1ezd_7odwnAhGwA Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebcf75baac6d4be481406daf0dd81e1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 47ee461c12bb4fae9792abbc067a71fa Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'efb025b0-229f-4423-847a-851bbdddc697'} Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:51.809657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:51.813292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:51.813292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:51.813292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:51.813292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:51.813292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:51.813292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. Sep 10 10:42:51.813292 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:51.817163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Returning 404 to user: Instance efb025b0-229f-4423-847a-851bbdddc697 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:51.818110 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f628c23-b3a1-4c55-9308-da39fd8dac6c tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697" status: 404 len: 111 microversion: 2.1 time: 0.124732 Sep 10 10:42:51.818956 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1173/1679] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:51 2022] GET /compute/v2.1/servers/efb025b0-229f-4423-847a-851bbdddc697 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:42:51.828083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1d2f3c79-7242-4294-b443-253c9591a764 req-233815ce-6b7c-4fe4-87c5-4070f1e5883e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b22547-e130-45f7-8f9c-fb57446ab4c7", "name": "network-vif-plugged", "status": "completed", "tag": "9b3e5283-8ed5-4225-8495-f8cb4bf41ad3"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:51.846843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1d2f3c79-7242-4294-b443-253c9591a764 req-233815ce-6b7c-4fe4-87c5-4070f1e5883e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:51.847817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1d2f3c79-7242-4294-b443-253c9591a764 req-233815ce-6b7c-4fe4-87c5-4070f1e5883e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:51.849036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1d2f3c79-7242-4294-b443-253c9591a764 req-233815ce-6b7c-4fe4-87c5-4070f1e5883e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:51.866295 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1d2f3c79-7242-4294-b443-253c9591a764 req-233815ce-6b7c-4fe4-87c5-4070f1e5883e service nova] Creating event network-vif-plugged:9b3e5283-8ed5-4225-8495-f8cb4bf41ad3 for instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 on n-h2-856894-1 Sep 10 10:42:51.871821 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1d2f3c79-7242-4294-b443-253c9591a764 req-233815ce-6b7c-4fe4-87c5-4070f1e5883e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051250 Sep 10 10:42:51.872434 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1174/1680] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:51.881217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e177dd11-ae63-4055-b53f-3f1ee60233e2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:51.892855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e177dd11-ae63-4055-b53f-3f1ee60233e2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:51.899855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e177dd11-ae63-4055-b53f-3f1ee60233e2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:51.900136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e177dd11-ae63-4055-b53f-3f1ee60233e2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:51.900583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e177dd11-ae63-4055-b53f-3f1ee60233e2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:51.901546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e177dd11-ae63-4055-b53f-3f1ee60233e2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:51.901764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e177dd11-ae63-4055-b53f-3f1ee60233e2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:51.908625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e177dd11-ae63-4055-b53f-3f1ee60233e2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:52.490348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e177dd11-ae63-4055-b53f-3f1ee60233e2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:52.503182 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e177dd11-ae63-4055-b53f-3f1ee60233e2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 200 len: 1307 microversion: 2.1 time: 0.629363 Sep 10 10:42:52.504446 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1175/1681] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:51 2022] GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 1307 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:52.511690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aaa07ffc-4596-4a5c-b74a-bc70a7e69d8d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2c33a0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:52.609664 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aaa07ffc-4596-4a5c-b74a-bc70a7e69d8d tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4367 microversion: 2.1 time: 0.101949 Sep 10 10:42:52.610933 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1176/1682] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Sep 10 10:42:52 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4367 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:52.617065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:52.617748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:52.627276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:52.628434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:52.629204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:52.630112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:52.630621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:52.631100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:52.645910 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] HTTP exception thrown: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Request method failure captured: Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 HTTP/1.1 Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmc-yIdfviXHPYwjT9z1Y8ZWTBBLkziRg2lUYR8EaSNJ8zJolFb55CcfqBTGghyaWoV9eP__xeAUXHzsQB02o9Z4gEe90tmeMsEk_N4RB9zFBTzrUcUuOj9sJmvCgnIG1zUVYuhdLNk2UBSke60kzA5n-B1mjgS1ezd_7odwnAhGwA Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebcf75baac6d4be481406daf0dd81e1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 47ee461c12bb4fae9792abbc067a71fa Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd7da2437-ac0b-4856-aaac-7bc243a710a5'} Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:52.648320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:42:52.651608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:52.653324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Returning 404 to user: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:52.654328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94acabf1-0f73-430a-82ce-1ffe2a4b61e6 tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 404 len: 111 microversion: 2.1 time: 0.042330 Sep 10 10:42:52.655341 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1177/1683] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:42:52 2022] DELETE /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:42:52.661895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7dcd442e-3ede-4fc2-af3a-df7802abb9bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:52.662698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7dcd442e-3ede-4fc2-af3a-df7802abb9bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:52.676386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcd442e-3ede-4fc2-af3a-df7802abb9bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:52.677115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcd442e-3ede-4fc2-af3a-df7802abb9bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:52.677698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcd442e-3ede-4fc2-af3a-df7802abb9bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:52.678858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcd442e-3ede-4fc2-af3a-df7802abb9bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:52.679458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcd442e-3ede-4fc2-af3a-df7802abb9bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:52.680182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dcd442e-3ede-4fc2-af3a-df7802abb9bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:52.774448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7dcd442e-3ede-4fc2-af3a-df7802abb9bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:52.797904 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7dcd442e-3ede-4fc2-af3a-df7802abb9bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1346 microversion: 2.1 time: 0.140777 Sep 10 10:42:52.804535 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1178/1684] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:52 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:52.821525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57a479ee-5b1d-49d0-9f06-905fdb38635e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:52.826754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57a479ee-5b1d-49d0-9f06-905fdb38635e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:52.839895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57a479ee-5b1d-49d0-9f06-905fdb38635e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:52.840636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57a479ee-5b1d-49d0-9f06-905fdb38635e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:52.841340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57a479ee-5b1d-49d0-9f06-905fdb38635e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:52.842236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57a479ee-5b1d-49d0-9f06-905fdb38635e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:52.842848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57a479ee-5b1d-49d0-9f06-905fdb38635e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:52.843768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57a479ee-5b1d-49d0-9f06-905fdb38635e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:53.078365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-57a479ee-5b1d-49d0-9f06-905fdb38635e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:53.098395 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57a479ee-5b1d-49d0-9f06-905fdb38635e tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.287971 Sep 10 10:42:53.112220 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1179/1685] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:52 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:53.121835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a39e309-6630-4d3a-b5d4-cf25f1abf6ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae405940>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:53.182322 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a39e309-6630-4d3a-b5d4-cf25f1abf6ca tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/df822980-bfab-4f6c-b4bc-2e31dca2c2a5" status: 200 len: 784 microversion: 2.1 time: 0.068825 Sep 10 10:42:53.187482 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1180/1686] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:42:53 2022] GET /compute/v2.1/images/df822980-bfab-4f6c-b4bc-2e31dca2c2a5 => generated 784 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:53.211767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:53.213091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] [instance: d7da2437-ac0b-4856-aaac-7bc243a710a5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:53.238512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:53.239118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:53.239630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:53.240557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:53.241831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:53.242916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:53.275134 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] HTTP exception thrown: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Request method failure captured: Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 HTTP/1.1 Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmc-yIdfviXHPYwjT9z1Y8ZWTBBLkziRg2lUYR8EaSNJ8zJolFb55CcfqBTGghyaWoV9eP__xeAUXHzsQB02o9Z4gEe90tmeMsEk_N4RB9zFBTzrUcUuOj9sJmvCgnIG1zUVYuhdLNk2UBSke60kzA5n-B1mjgS1ezd_7odwnAhGwA Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebcf75baac6d4be481406daf0dd81e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebcf75baac6d4be481406daf0dd81e1a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ebcf75baac6d4be481406daf0dd81e1a Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestMultiNic-1558727174 Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 47ee461c12bb4fae9792abbc067a71fa Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestMultiNic-1558727174-project Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd7da2437-ac0b-4856-aaac-7bc243a710a5'} Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:53.276822 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:53.282195 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:53.282195 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:53.282195 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:53.282195 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:53.282195 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:53.282195 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. Sep 10 10:42:53.282195 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:53.282195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] Returning 404 to user: Instance d7da2437-ac0b-4856-aaac-7bc243a710a5 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:53.282195 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f7043582-a516-4d8c-97ad-f4c16b53578d tempest-ServersTestMultiNic-1558727174 tempest-ServersTestMultiNic-1558727174-project] 10.222.0.20 "GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5" status: 404 len: 111 microversion: 2.1 time: 0.078390 Sep 10 10:42:53.282195 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1181/1687] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:53 2022] GET /compute/v2.1/servers/d7da2437-ac0b-4856-aaac-7bc243a710a5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:42:53.289317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:53.290110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: ff5fc162-ff4a-4020-97ca-7e9960c2f455] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:53.305877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:53.306598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:53.307197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:53.308185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:53.308789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:53.309618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:53.337532 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] HTTP exception thrown: Instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 could not be found. Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Request method failure captured: Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 HTTP/1.1 Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiJm0D22NV-Z8qEdxR4XF2RPIGKQ50HB-p70fCdi_YFXzgyBPXKaq1rf3Fx__-5KYiBj5-XdAkTE-oI7chG3PnQ0mpJ7ywGO33P25HUSy7nxQpnspPUb_rE3PM5GDcBytPHtiJ_o3_hQxNRrILgPzvZv8rTkixPjN8fVkmTI50v-gg Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9c2ac1f5c5c843fc89294292d4489252 Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c2ac1f5c5c843fc89294292d4489252", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9c2ac1f5c5c843fc89294292d4489252 Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-LiveAutoBlockMigrationV225Test-592704198-project Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 362b727b96934e58b180727eaad35e3b Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-592704198-project Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 could not be found. Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'ff5fc162-ff4a-4020-97ca-7e9960c2f455'} Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 could not be found. Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 could not be found. Sep 10 10:42:53.339634 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:53.343260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:53.343260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:53.343260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:53.343260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:53.343260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:53.343260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:53.343260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:53.343260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 could not be found. Sep 10 10:42:53.343260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:53.352834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Returning 404 to user: Instance ff5fc162-ff4a-4020-97ca-7e9960c2f455 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:53.359872 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-df6a5036-5ebc-4a90-b6ad-3165020990d9 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455" status: 404 len: 111 microversion: 2.25 time: 0.079109 Sep 10 10:42:53.365114 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1182/1688] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:53 2022] GET /compute/v2.1/servers/ff5fc162-ff4a-4020-97ca-7e9960c2f455 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:42:53.381085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-34bd829f-e2ac-44fb-b265-7ae09bc26da9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2e6310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:53.474844 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-34bd829f-e2ac-44fb-b265-7ae09bc26da9 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1607 microversion: 2.1 time: 0.108336 Sep 10 10:42:53.490983 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1183/1689] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:42:53 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1607 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:53.499013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2d38e1e-ca57-4442-ad29-47799cbacbe2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:53.500167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2d38e1e-ca57-4442-ad29-47799cbacbe2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:53.513550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2d38e1e-ca57-4442-ad29-47799cbacbe2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:53.517865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2d38e1e-ca57-4442-ad29-47799cbacbe2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:53.518339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2d38e1e-ca57-4442-ad29-47799cbacbe2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:53.519096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2d38e1e-ca57-4442-ad29-47799cbacbe2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:53.519571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2d38e1e-ca57-4442-ad29-47799cbacbe2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:53.520002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2d38e1e-ca57-4442-ad29-47799cbacbe2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:53.555928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2d38e1e-ca57-4442-ad29-47799cbacbe2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:42:53.727294 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2d38e1e-ca57-4442-ad29-47799cbacbe2 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 204 len: 0 microversion: 2.25 time: 0.234652 Sep 10 10:42:53.739069 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1184/1690] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:42:53 2022] DELETE /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:42:53.762155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c34366d-1ba0-4702-abb4-50d75b2692cd tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae2db550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:54.445339 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c34366d-1ba0-4702-abb4-50d75b2692cd tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "DELETE /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c" status: 204 len: 0 microversion: 2.1 time: 0.699425 Sep 10 10:42:54.447164 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1185/1691] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:53 2022] DELETE /compute/v2.1/images/e42b8ab4-6009-4be2-b298-7ccd31c2c41c => generated 0 bytes in 706 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:42:54.453799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a006d50-e855-4131-ae16-b1aae4f7f856 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:54.455941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8a006d50-e855-4131-ae16-b1aae4f7f856 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:54.464858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a006d50-e855-4131-ae16-b1aae4f7f856 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:54.465959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a006d50-e855-4131-ae16-b1aae4f7f856 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:54.466650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a006d50-e855-4131-ae16-b1aae4f7f856 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:54.467557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a006d50-e855-4131-ae16-b1aae4f7f856 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:54.468841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a006d50-e855-4131-ae16-b1aae4f7f856 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:54.469504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a006d50-e855-4131-ae16-b1aae4f7f856 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:54.892634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a006d50-e855-4131-ae16-b1aae4f7f856 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:54.900672 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8a006d50-e855-4131-ae16-b1aae4f7f856 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 200 len: 1486 microversion: 2.1 time: 0.452736 Sep 10 10:42:54.904169 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1186/1692] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:54 2022] GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 1486 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:54.917081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:54.917849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:54.928692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:54.929407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:54.930006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:54.930900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:54.932213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:54.932802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:55.226235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:55.236884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:55.238496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '362b727b96934e58b180727eaad35e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ac1f5c5c843fc89294292d4489252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:55.239872 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10de9370-8668-438b-bcf8-d05cfaa40ea5 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 200 len: 1564 microversion: 2.25 time: 0.334460 Sep 10 10:42:55.261299 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1187/1693] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:54 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 1564 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:42:55.267447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aaffb7bf-fbc6-481c-aaa9-fb2dc530114d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:55.268171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aaffb7bf-fbc6-481c-aaa9-fb2dc530114d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:55.274956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaffb7bf-fbc6-481c-aaa9-fb2dc530114d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:55.275760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaffb7bf-fbc6-481c-aaa9-fb2dc530114d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:55.276298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaffb7bf-fbc6-481c-aaa9-fb2dc530114d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:55.277102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaffb7bf-fbc6-481c-aaa9-fb2dc530114d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:55.277636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaffb7bf-fbc6-481c-aaa9-fb2dc530114d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:55.278144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaffb7bf-fbc6-481c-aaa9-fb2dc530114d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:55.375103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aaffb7bf-fbc6-481c-aaa9-fb2dc530114d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:55.384605 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aaffb7bf-fbc6-481c-aaa9-fb2dc530114d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1346 microversion: 2.1 time: 0.121886 Sep 10 10:42:55.398458 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1188/1694] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:55 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:55.404224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6efe9c2-0a15-48ea-bd06-1f28ca5852bb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:55.405472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c6efe9c2-0a15-48ea-bd06-1f28ca5852bb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:55.412750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6efe9c2-0a15-48ea-bd06-1f28ca5852bb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:55.413277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6efe9c2-0a15-48ea-bd06-1f28ca5852bb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:55.413739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6efe9c2-0a15-48ea-bd06-1f28ca5852bb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:55.414435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6efe9c2-0a15-48ea-bd06-1f28ca5852bb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:55.414898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6efe9c2-0a15-48ea-bd06-1f28ca5852bb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:55.415328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6efe9c2-0a15-48ea-bd06-1f28ca5852bb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:55.660843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c6efe9c2-0a15-48ea-bd06-1f28ca5852bb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:55.680322 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c6efe9c2-0a15-48ea-bd06-1f28ca5852bb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.278809 Sep 10 10:42:55.682293 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1189/1695] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:55 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:55.692551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48277b15-6385-474b-87b4-895649882552 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae3dc820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:56.763026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-48277b15-6385-474b-87b4-895649882552 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "DELETE /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b" status: 204 len: 0 microversion: 2.1 time: 1.071527 Sep 10 10:42:56.764449 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1190/1696] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:55 2022] DELETE /compute/v2.1/images/974db164-877c-4d1e-ae75-e9696d7e197b => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:42:56.781859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7aff712d-382c-49a8-8a36-0ab84b1d9e2f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:56.784958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7aff712d-382c-49a8-8a36-0ab84b1d9e2f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:56.809966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aff712d-382c-49a8-8a36-0ab84b1d9e2f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:56.810834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aff712d-382c-49a8-8a36-0ab84b1d9e2f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:56.811235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aff712d-382c-49a8-8a36-0ab84b1d9e2f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:56.812151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aff712d-382c-49a8-8a36-0ab84b1d9e2f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:56.813844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aff712d-382c-49a8-8a36-0ab84b1d9e2f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:56.814448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aff712d-382c-49a8-8a36-0ab84b1d9e2f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:56.876129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-7aff712d-382c-49a8-8a36-0ab84b1d9e2f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lazy-loading 'flavor' on Instance uuid 69b22547-e130-45f7-8f9c-fb57446ab4c7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:42:57.105203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:42:57.151133 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7aff712d-382c-49a8-8a36-0ab84b1d9e2f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7/action" status: 202 len: 0 microversion: 2.1 time: 0.376452 Sep 10 10:42:57.160002 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1191/1697] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:42:56 2022] POST /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:42:57.176924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-eba644d2-a782-4dcd-90fd-7a1d64711148 req-9ecad7a1-b0ad-49e1-90a5-d11fbc7343d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0f0704-e44c-45ed-8cba-86d6ad048f12", "name": "network-vif-deleted", "tag": "2095cfbd-e6eb-4350-a71e-b4d08d9396b4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:42:57.192392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-eba644d2-a782-4dcd-90fd-7a1d64711148 req-9ecad7a1-b0ad-49e1-90a5-d11fbc7343d9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:57.193189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-eba644d2-a782-4dcd-90fd-7a1d64711148 req-9ecad7a1-b0ad-49e1-90a5-d11fbc7343d9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:57.193837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-eba644d2-a782-4dcd-90fd-7a1d64711148 req-9ecad7a1-b0ad-49e1-90a5-d11fbc7343d9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:57.243771 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-eba644d2-a782-4dcd-90fd-7a1d64711148 req-9ecad7a1-b0ad-49e1-90a5-d11fbc7343d9 service nova] Creating event network-vif-deleted:2095cfbd-e6eb-4350-a71e-b4d08d9396b4 for instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 on n-h2-856894-1 Sep 10 10:42:57.255182 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-eba644d2-a782-4dcd-90fd-7a1d64711148 req-9ecad7a1-b0ad-49e1-90a5-d11fbc7343d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091830 Sep 10 10:42:57.259621 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1192/1698] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:42:57.272673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:57.276107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] [instance: 6c0f0704-e44c-45ed-8cba-86d6ad048f12] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:57.289570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:57.291846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:57.293523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:57.295754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:57.296619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:57.298336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:57.335747 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] HTTP exception thrown: Instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 could not be found. Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Request method failure captured: Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 HTTP/1.1 Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGiJm0D22NV-Z8qEdxR4XF2RPIGKQ50HB-p70fCdi_YFXzgyBPXKaq1rf3Fx__-5KYiBj5-XdAkTE-oI7chG3PnQ0mpJ7ywGO33P25HUSy7nxQpnspPUb_rE3PM5GDcBytPHtiJ_o3_hQxNRrILgPzvZv8rTkixPjN8fVkmTI50v-gg Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9c2ac1f5c5c843fc89294292d4489252 Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c2ac1f5c5c843fc89294292d4489252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c2ac1f5c5c843fc89294292d4489252", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9c2ac1f5c5c843fc89294292d4489252 Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-592704198 Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-LiveAutoBlockMigrationV225Test-592704198-project Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 362b727b96934e58b180727eaad35e3b Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-592704198-project Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 could not be found. Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '6c0f0704-e44c-45ed-8cba-86d6ad048f12'} Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 could not be found. Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 could not be found. Sep 10 10:42:57.339845 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:57.343078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:42:57.343078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:57.343078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:42:57.343078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:42:57.343078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:42:57.343078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:42:57.343078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:42:57.343078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 could not be found. Sep 10 10:42:57.343078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:42:57.349035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] Returning 404 to user: Instance 6c0f0704-e44c-45ed-8cba-86d6ad048f12 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:42:57.350880 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a2c3f2b-3e7e-492b-af55-43bdc5e6f4e8 tempest-LiveAutoBlockMigrationV225Test-592704198 tempest-LiveAutoBlockMigrationV225Test-592704198-project] 10.222.0.20 "GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12" status: 404 len: 111 microversion: 2.25 time: 0.086865 Sep 10 10:42:57.357420 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1193/1699] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:42:57 2022] GET /compute/v2.1/servers/6c0f0704-e44c-45ed-8cba-86d6ad048f12 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:42:57.368597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:57.369319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:57.383506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:57.386062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:57.387151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:57.388078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:57.388563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:57.391579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:57.444439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:57.445238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:57.445902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:57.446612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lazy-loading 'fault' on Instance uuid 20059d23-e6d5-4140-ac67-7ebf9534febc {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:42:57.549871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:57.559766 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d0abeaa-d6f1-470a-b0c6-0834ee51fc33 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 200 len: 1351 microversion: 2.1 time: 0.200712 Sep 10 10:42:57.560080 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1194/1700] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:57 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 1351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:57.566681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2563b51-ef07-48e5-839a-f48b8dccd762 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:57.567961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2563b51-ef07-48e5-839a-f48b8dccd762 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:57.597822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2563b51-ef07-48e5-839a-f48b8dccd762 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:57.599239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2563b51-ef07-48e5-839a-f48b8dccd762 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:57.599694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2563b51-ef07-48e5-839a-f48b8dccd762 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:57.601673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2563b51-ef07-48e5-839a-f48b8dccd762 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:57.602160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2563b51-ef07-48e5-839a-f48b8dccd762 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:57.603816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2563b51-ef07-48e5-839a-f48b8dccd762 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:58.116489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2563b51-ef07-48e5-839a-f48b8dccd762 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:42:58.152237 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2563b51-ef07-48e5-839a-f48b8dccd762 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.589389 Sep 10 10:42:58.155641 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1195/1701] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:57 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:42:58.173929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-102fc4da-7799-4464-a1f8-2a8a1cbbb267 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcaf3f6af0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:59.685590 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-102fc4da-7799-4464-a1f8-2a8a1cbbb267 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "DELETE /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04" status: 204 len: 0 microversion: 2.1 time: 1.521666 Sep 10 10:42:59.692054 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1196/1702] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:58 2022] DELETE /compute/v2.1/images/9715a8b0-ce2e-4dfb-966b-addc8d8ffb04 => generated 0 bytes in 1526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:42:59.697427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f463b30-5654-4cd5-9fcd-11a3a7d1573f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:42:59.698307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f463b30-5654-4cd5-9fcd-11a3a7d1573f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:42:59.719476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f463b30-5654-4cd5-9fcd-11a3a7d1573f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:59.720044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f463b30-5654-4cd5-9fcd-11a3a7d1573f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:59.720502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f463b30-5654-4cd5-9fcd-11a3a7d1573f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:42:59.721283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f463b30-5654-4cd5-9fcd-11a3a7d1573f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:42:59.721747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f463b30-5654-4cd5-9fcd-11a3a7d1573f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:42:59.722190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f463b30-5654-4cd5-9fcd-11a3a7d1573f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:00.309184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3f463b30-5654-4cd5-9fcd-11a3a7d1573f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:00.322113 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f463b30-5654-4cd5-9fcd-11a3a7d1573f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 200 len: 1477 microversion: 2.1 time: 0.628629 Sep 10 10:43:00.337498 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1197/1703] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:42:59 2022] GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 1477 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:00.345852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:00.346482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:00.362781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:00.364314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:00.364887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:00.366808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:00.367272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:00.369376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:00.394815 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc HTTP/1.1 Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '20059d23-e6d5-4140-ac67-7ebf9534febc'} Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:00.396441 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:00.399565 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:00.399565 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:00.399565 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:00.399565 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:43:00.399565 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:43:00.399565 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:43:00.399565 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:00.399565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:43:00.399565 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5090212d-294e-4cb8-ba68-284e1dfda18f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 404 len: 111 microversion: 2.1 time: 0.059261 Sep 10 10:43:00.399565 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1198/1704] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:00 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:43:00.402767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-058d4757-0d67-414d-bc62-82872a58232c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:00.403376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-058d4757-0d67-414d-bc62-82872a58232c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:00.423485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-058d4757-0d67-414d-bc62-82872a58232c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:00.424847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-058d4757-0d67-414d-bc62-82872a58232c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:00.425510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-058d4757-0d67-414d-bc62-82872a58232c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:00.430022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-058d4757-0d67-414d-bc62-82872a58232c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:00.430985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-058d4757-0d67-414d-bc62-82872a58232c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:00.432140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-058d4757-0d67-414d-bc62-82872a58232c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:00.822117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-058d4757-0d67-414d-bc62-82872a58232c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:00.830802 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-058d4757-0d67-414d-bc62-82872a58232c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.431462 Sep 10 10:43:00.839715 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1199/1705] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:00 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:00.845277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a86b9258-1f4e-4cee-bbaa-b98a0976ec00 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:00.846070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a86b9258-1f4e-4cee-bbaa-b98a0976ec00 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:00.855703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86b9258-1f4e-4cee-bbaa-b98a0976ec00 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:00.856510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86b9258-1f4e-4cee-bbaa-b98a0976ec00 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:00.857232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86b9258-1f4e-4cee-bbaa-b98a0976ec00 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:00.859219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86b9258-1f4e-4cee-bbaa-b98a0976ec00 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:00.859891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86b9258-1f4e-4cee-bbaa-b98a0976ec00 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:00.860432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86b9258-1f4e-4cee-bbaa-b98a0976ec00 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:00.909197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a86b9258-1f4e-4cee-bbaa-b98a0976ec00 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:43:01.029305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:01.036023 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a86b9258-1f4e-4cee-bbaa-b98a0976ec00 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 204 len: 0 microversion: 2.1 time: 0.194632 Sep 10 10:43:01.037425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1200/1706] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:43:00 2022] DELETE /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:43:01.046666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-01ed2b07-ce32-4347-a79e-460739a1d633 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-502262528"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:01.049447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-01ed2b07-ce32-4347-a79e-460739a1d633 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:01.057450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed2b07-ce32-4347-a79e-460739a1d633 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:01.058128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed2b07-ce32-4347-a79e-460739a1d633 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:01.058666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed2b07-ce32-4347-a79e-460739a1d633 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:01.059473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed2b07-ce32-4347-a79e-460739a1d633 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:01.060030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed2b07-ce32-4347-a79e-460739a1d633 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:01.060960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed2b07-ce32-4347-a79e-460739a1d633 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:01.332125 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-01ed2b07-ce32-4347-a79e-460739a1d633 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7/action" status: 202 len: 0 microversion: 2.1 time: 0.292680 Sep 10 10:43:01.332707 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1201/1707] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:43:01 2022] POST /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 10:43:01.342537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:01.346146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:01.352803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:01.353803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:01.354446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:01.355336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:01.356018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:01.356623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:01.372609 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc/os-volume_attachments HTTP/1.1 Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '20059d23-e6d5-4140-ac67-7ebf9534febc'} Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:43:01.374851 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:43:01.377984 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:01.380157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:43:01.381270 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94530f7f-7729-4dd3-a172-0372ff18dbd0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045828 Sep 10 10:43:01.385470 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1202/1708] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:43:01 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:43:01.394080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d1ea51d-9b47-4a3c-9db4-c2f00384c126 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:01.397260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d1ea51d-9b47-4a3c-9db4-c2f00384c126 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:01.403793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d1ea51d-9b47-4a3c-9db4-c2f00384c126 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:01.404887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d1ea51d-9b47-4a3c-9db4-c2f00384c126 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:01.406122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d1ea51d-9b47-4a3c-9db4-c2f00384c126 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:01.407027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d1ea51d-9b47-4a3c-9db4-c2f00384c126 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:01.407679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d1ea51d-9b47-4a3c-9db4-c2f00384c126 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:01.408361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d1ea51d-9b47-4a3c-9db4-c2f00384c126 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:01.876257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d1ea51d-9b47-4a3c-9db4-c2f00384c126 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:01.892466 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d1ea51d-9b47-4a3c-9db4-c2f00384c126 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 1473 microversion: 2.1 time: 0.505665 Sep 10 10:43:01.893145 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1203/1709] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:01 2022] GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 1473 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:01.913383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe4c0ce5-6877-432e-878e-dd8363428a70 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae3dce50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:01.975495 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe4c0ce5-6877-432e-878e-dd8363428a70 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1439 microversion: 2.1 time: 0.067515 Sep 10 10:43:01.976297 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1204/1710] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:01 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1439 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:01.982829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2119123082", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "15abac29-c434-4802-9cd4-4bace1ac4f7e"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:02.065472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] validate_networks() for [('15abac29-c434-4802-9cd4-4bace1ac4f7e', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:43:03.762278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:43:03.762877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:43:03.763896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:43:03.765128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:43:03.766507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:43:03.778188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:03.778750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:03.779284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:03.780821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:03.781321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:03.781961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:03.805471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:03.811628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for user fa978e59fa334084b722d116c761380f and project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:03.825413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:43:03.829543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 0ac3602b-3a76-46ac-be5c-61337f66c441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:43:03.887954 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8b24fc03-fcdd-4b2f-b309-cafdd4c219bd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.910394 Sep 10 10:43:03.889411 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1205/1711] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:43:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:43:03.902672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb4e089a-1521-4309-8f99-a95afdd3112a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:03.904168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fb4e089a-1521-4309-8f99-a95afdd3112a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:03.919605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4e089a-1521-4309-8f99-a95afdd3112a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:03.933358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4e089a-1521-4309-8f99-a95afdd3112a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:03.934136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4e089a-1521-4309-8f99-a95afdd3112a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:03.935259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4e089a-1521-4309-8f99-a95afdd3112a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:03.938883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4e089a-1521-4309-8f99-a95afdd3112a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:03.941844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4e089a-1521-4309-8f99-a95afdd3112a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:04.542063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb4e089a-1521-4309-8f99-a95afdd3112a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:04.557155 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb4e089a-1521-4309-8f99-a95afdd3112a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1718 microversion: 2.1 time: 0.665685 Sep 10 10:43:04.571730 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1206/1712] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:03 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1718 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:04.583565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:04.584193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:04.624998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:04.629337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:04.630094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:04.633828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:04.634575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:04.635672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:04.792941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:04.794673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:04.798839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:04.798839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lazy-loading 'fault' on Instance uuid 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:43:05.018212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:05.038904 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-051ac624-642f-402d-a3f4-a123c593f308 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 200 len: 1308 microversion: 2.1 time: 0.464620 Sep 10 10:43:05.056474 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1207/1713] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:04 2022] GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:05.064166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2812aec8-1aff-4135-acfa-59b92fbf30c7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae488940>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:05.147362 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2812aec8-1aff-4135-acfa-59b92fbf30c7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1439 microversion: 2.1 time: 0.089495 Sep 10 10:43:05.149408 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1208/1714] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:05 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:05.189466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-fd30ec69-3402-4a98-aec5-d5b0a879f974 req-0190cb73-1a1a-410b-af91-9b99645dc373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf886fd-0d8c-46b8-9afb-eec1edad2d96", "name": "network-vif-deleted", "tag": "1b0e5ed5-e6b2-45f6-a1ac-df2eb4399a4b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:05.210346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd30ec69-3402-4a98-aec5-d5b0a879f974 req-0190cb73-1a1a-410b-af91-9b99645dc373 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:05.210836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd30ec69-3402-4a98-aec5-d5b0a879f974 req-0190cb73-1a1a-410b-af91-9b99645dc373 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:05.211272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd30ec69-3402-4a98-aec5-d5b0a879f974 req-0190cb73-1a1a-410b-af91-9b99645dc373 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:05.227692 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-fd30ec69-3402-4a98-aec5-d5b0a879f974 req-0190cb73-1a1a-410b-af91-9b99645dc373 service nova] Creating event network-vif-deleted:1b0e5ed5-e6b2-45f6-a1ac-df2eb4399a4b for instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 on n-h2-856894-1 Sep 10 10:43:05.238185 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-fd30ec69-3402-4a98-aec5-d5b0a879f974 req-0190cb73-1a1a-410b-af91-9b99645dc373 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080017 Sep 10 10:43:05.239406 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1209/1715] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:05.249530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-75d19467-7100-4735-ab15-7ca35ea1f363 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:05.250675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-75d19467-7100-4735-ab15-7ca35ea1f363 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 0ac3602b-3a76-46ac-be5c-61337f66c441] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:05.259993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75d19467-7100-4735-ab15-7ca35ea1f363 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:05.261640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75d19467-7100-4735-ab15-7ca35ea1f363 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:05.262862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75d19467-7100-4735-ab15-7ca35ea1f363 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:05.263761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75d19467-7100-4735-ab15-7ca35ea1f363 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:05.264291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75d19467-7100-4735-ab15-7ca35ea1f363 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:05.264918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75d19467-7100-4735-ab15-7ca35ea1f363 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:05.490069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-75d19467-7100-4735-ab15-7ca35ea1f363 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:05.507471 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-75d19467-7100-4735-ab15-7ca35ea1f363 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441" status: 200 len: 1267 microversion: 2.1 time: 0.264955 Sep 10 10:43:05.528216 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1210/1716] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:05 2022] GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:05.545243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-180a1a3b-7fd3-4fac-9714-2ca01a4bc47f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:05.546393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-180a1a3b-7fd3-4fac-9714-2ca01a4bc47f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 0ac3602b-3a76-46ac-be5c-61337f66c441] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:05.564370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180a1a3b-7fd3-4fac-9714-2ca01a4bc47f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:05.564897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180a1a3b-7fd3-4fac-9714-2ca01a4bc47f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:05.565374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180a1a3b-7fd3-4fac-9714-2ca01a4bc47f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:05.566102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180a1a3b-7fd3-4fac-9714-2ca01a4bc47f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:05.566728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180a1a3b-7fd3-4fac-9714-2ca01a4bc47f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:05.567362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180a1a3b-7fd3-4fac-9714-2ca01a4bc47f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:05.619220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:05.636915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-180a1a3b-7fd3-4fac-9714-2ca01a4bc47f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 0ac3602b-3a76-46ac-be5c-61337f66c441] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:43:05.860662 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-180a1a3b-7fd3-4fac-9714-2ca01a4bc47f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441" status: 204 len: 0 microversion: 2.1 time: 0.329565 Sep 10 10:43:05.866316 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1211/1717] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:43:05 2022] DELETE /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:43:05.877041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de4d731c-516b-420c-b579-24b5172b4c96 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:05.879555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de4d731c-516b-420c-b579-24b5172b4c96 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:05.919440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4d731c-516b-420c-b579-24b5172b4c96 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:05.926921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4d731c-516b-420c-b579-24b5172b4c96 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:05.929512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4d731c-516b-420c-b579-24b5172b4c96 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:05.933034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4d731c-516b-420c-b579-24b5172b4c96 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:05.933781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4d731c-516b-420c-b579-24b5172b4c96 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:05.934395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4d731c-516b-420c-b579-24b5172b4c96 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:06.577674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-de4d731c-516b-420c-b579-24b5172b4c96 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:06.589441 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de4d731c-516b-420c-b579-24b5172b4c96 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1708 microversion: 2.1 time: 0.721569 Sep 10 10:43:06.605103 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1212/1718] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:05 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1708 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:06.605103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1cb3cea-801b-4edf-9e1e-f4f3f86e746d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:06.605103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1cb3cea-801b-4edf-9e1e-f4f3f86e746d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 0ac3602b-3a76-46ac-be5c-61337f66c441] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:06.606276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1cb3cea-801b-4edf-9e1e-f4f3f86e746d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:06.606864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1cb3cea-801b-4edf-9e1e-f4f3f86e746d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:06.610026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1cb3cea-801b-4edf-9e1e-f4f3f86e746d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:06.625876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1cb3cea-801b-4edf-9e1e-f4f3f86e746d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:06.628320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1cb3cea-801b-4edf-9e1e-f4f3f86e746d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:06.629066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1cb3cea-801b-4edf-9e1e-f4f3f86e746d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:06.792185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c1cb3cea-801b-4edf-9e1e-f4f3f86e746d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:06.807747 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1cb3cea-801b-4edf-9e1e-f4f3f86e746d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441" status: 200 len: 1217 microversion: 2.1 time: 0.215094 Sep 10 10:43:06.818241 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1213/1719] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:06 2022] GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:06.829010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:06.829877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: 7bf886fd-0d8c-46b8-9afb-eec1edad2d96] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:06.847380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:06.848202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:06.848848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:06.849757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:06.850385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:06.856419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:06.886618 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] HTTP exception thrown: Instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 could not be found. Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Request method failure captured: Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 HTTP/1.1 Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmZlUvfnUDtgZPAlP_qbVgwRlmQuo0Cq7GWMTqQw-q2oXMUINlocY_yWkLgEncylWCDDujlmVrTuOBqSN1XEG_-R9rD_WpKW0yhwPFAmvRM0L71bUGhxZj4JOK9s0dnjIEu3SNeTUiiFyjzCHVV2fWwLSI58VkqhW-7LHDiSuF7QSs Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 0a13d3e6b7ed498da4fbde463f57214a Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListImageFiltersTestJSON-578486126 Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a13d3e6b7ed498da4fbde463f57214a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a13d3e6b7ed498da4fbde463f57214a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a13d3e6b7ed498da4fbde463f57214a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a13d3e6b7ed498da4fbde463f57214a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListImageFiltersTestJSON-578486126 Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 0a13d3e6b7ed498da4fbde463f57214a Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-578486126 Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListImageFiltersTestJSON-578486126-project Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3d8273421e8a4b74be0d3f6621a05f0a Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListImageFiltersTestJSON-578486126-project Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 could not be found. Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7bf886fd-0d8c-46b8-9afb-eec1edad2d96'} Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 could not be found. Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 could not be found. Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:06.893885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:06.898057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:06.898057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:06.898057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:06.898057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:43:06.898057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:43:06.898057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 could not be found. Sep 10 10:43:06.898057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:06.898555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Returning 404 to user: Instance 7bf886fd-0d8c-46b8-9afb-eec1edad2d96 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:43:06.918053 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-569d10c7-a668-4cee-8491-0c9edd953775 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96" status: 404 len: 111 microversion: 2.1 time: 0.089259 Sep 10 10:43:06.925150 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1214/1720] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:06 2022] GET /compute/v2.1/servers/7bf886fd-0d8c-46b8-9afb-eec1edad2d96 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:43:06.932868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21d4f1b2-c7d2-41d5-8dee-f2fa031e49af tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae300790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:07.058056 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21d4f1b2-c7d2-41d5-8dee-f2fa031e49af tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1439 microversion: 2.1 time: 0.131475 Sep 10 10:43:07.058740 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1215/1721] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:06 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1439 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:07.072558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-303bd9bc-9b66-49d7-af14-0303ae8809e0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '.version_select at 0x7efcae3869d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:07.084353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-303bd9bc-9b66-49d7-af14-0303ae8809e0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:07.086761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-303bd9bc-9b66-49d7-af14-0303ae8809e0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:07.089659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-303bd9bc-9b66-49d7-af14-0303ae8809e0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:07.108292 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-303bd9bc-9b66-49d7-af14-0303ae8809e0 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.039422 Sep 10 10:43:07.121095 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1216/1722] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:43:07 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:07.134617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-275b86ae-aa1e-4c1a-954c-3d6797bd8225 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:07.136192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-275b86ae-aa1e-4c1a-954c-3d6797bd8225 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:07.152050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-275b86ae-aa1e-4c1a-954c-3d6797bd8225 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:07.152894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-275b86ae-aa1e-4c1a-954c-3d6797bd8225 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:07.153532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-275b86ae-aa1e-4c1a-954c-3d6797bd8225 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:07.154413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-275b86ae-aa1e-4c1a-954c-3d6797bd8225 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:07.155568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-275b86ae-aa1e-4c1a-954c-3d6797bd8225 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:07.156171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-275b86ae-aa1e-4c1a-954c-3d6797bd8225 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:07.211792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-275b86ae-aa1e-4c1a-954c-3d6797bd8225 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:43:07.393848 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-275b86ae-aa1e-4c1a-954c-3d6797bd8225 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f" status: 204 len: 0 microversion: 2.1 time: 0.271132 Sep 10 10:43:07.397514 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1217/1723] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:43:07 2022] DELETE /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:43:07.405661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8312b2c-351d-47d6-8913-4922b2f033a5 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:07.406583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e8312b2c-351d-47d6-8913-4922b2f033a5 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:07.417900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8312b2c-351d-47d6-8913-4922b2f033a5 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:07.421633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8312b2c-351d-47d6-8913-4922b2f033a5 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:07.422214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8312b2c-351d-47d6-8913-4922b2f033a5 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:07.423046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8312b2c-351d-47d6-8913-4922b2f033a5 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:07.425320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8312b2c-351d-47d6-8913-4922b2f033a5 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:07.425996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8312b2c-351d-47d6-8913-4922b2f033a5 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:08.336339 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8312b2c-351d-47d6-8913-4922b2f033a5 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1859 microversion: 2.1 time: 0.937083 Sep 10 10:43:08.338064 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1218/1724] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:07 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1859 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:08.358863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cb9e655-7393-4843-910d-290bced6b950 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:08.359681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6cb9e655-7393-4843-910d-290bced6b950 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:08.380817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cb9e655-7393-4843-910d-290bced6b950 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:08.386031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cb9e655-7393-4843-910d-290bced6b950 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:08.388012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cb9e655-7393-4843-910d-290bced6b950 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:08.388903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cb9e655-7393-4843-910d-290bced6b950 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:08.390881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cb9e655-7393-4843-910d-290bced6b950 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:08.394091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cb9e655-7393-4843-910d-290bced6b950 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:08.760304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6cb9e655-7393-4843-910d-290bced6b950 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:08.778367 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cb9e655-7393-4843-910d-290bced6b950 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f" status: 200 len: 1472 microversion: 2.1 time: 0.438671 Sep 10 10:43:08.793520 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1219/1725] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:08 2022] GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f => generated 1472 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:08.800802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a749c43-2bc6-4523-baec-bb98f7d7ce82 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:08.801460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a749c43-2bc6-4523-baec-bb98f7d7ce82 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 0ac3602b-3a76-46ac-be5c-61337f66c441] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:08.815384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a749c43-2bc6-4523-baec-bb98f7d7ce82 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:08.815880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a749c43-2bc6-4523-baec-bb98f7d7ce82 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:08.819612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a749c43-2bc6-4523-baec-bb98f7d7ce82 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:08.820516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a749c43-2bc6-4523-baec-bb98f7d7ce82 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:08.829161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a749c43-2bc6-4523-baec-bb98f7d7ce82 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:08.829822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a749c43-2bc6-4523-baec-bb98f7d7ce82 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:08.968857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a749c43-2bc6-4523-baec-bb98f7d7ce82 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:08.982304 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a749c43-2bc6-4523-baec-bb98f7d7ce82 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441" status: 200 len: 1217 microversion: 2.1 time: 0.187266 Sep 10 10:43:08.983584 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1220/1726] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:08 2022] GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:08.999518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f34ad23c-305c-4fa9-b9f2-7825f3763798 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcaebdc550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:09.127089 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f34ad23c-305c-4fa9-b9f2-7825f3763798 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1439 microversion: 2.1 time: 0.141872 Sep 10 10:43:09.130632 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1221/1727] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:08 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1439 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:09.147151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5664b37f-261c-43f4-94ea-f977e7afddae tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:09.148075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5664b37f-261c-43f4-94ea-f977e7afddae tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:09.156707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5664b37f-261c-43f4-94ea-f977e7afddae tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:09.162002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5664b37f-261c-43f4-94ea-f977e7afddae tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:09.162002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5664b37f-261c-43f4-94ea-f977e7afddae tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:09.162002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5664b37f-261c-43f4-94ea-f977e7afddae tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:09.164337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5664b37f-261c-43f4-94ea-f977e7afddae tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:09.166028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5664b37f-261c-43f4-94ea-f977e7afddae tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:09.895645 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5664b37f-261c-43f4-94ea-f977e7afddae tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1859 microversion: 2.1 time: 0.752830 Sep 10 10:43:09.896298 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1222/1728] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:09 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1859 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:09.915372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-581b7fd6-4d76-4a41-8f8c-90014ab42f9b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:09.915999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-581b7fd6-4d76-4a41-8f8c-90014ab42f9b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:09.955931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-581b7fd6-4d76-4a41-8f8c-90014ab42f9b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:09.956418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-581b7fd6-4d76-4a41-8f8c-90014ab42f9b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:09.985558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-581b7fd6-4d76-4a41-8f8c-90014ab42f9b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:09.987182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-581b7fd6-4d76-4a41-8f8c-90014ab42f9b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:09.988084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-581b7fd6-4d76-4a41-8f8c-90014ab42f9b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:09.989012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-581b7fd6-4d76-4a41-8f8c-90014ab42f9b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:11.597015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-581b7fd6-4d76-4a41-8f8c-90014ab42f9b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8273421e8a4b74be0d3f6621a05f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a13d3e6b7ed498da4fbde463f57214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:11.607441 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-581b7fd6-4d76-4a41-8f8c-90014ab42f9b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f" status: 200 len: 1472 microversion: 2.1 time: 1.704704 Sep 10 10:43:11.616652 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1223/1729] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:09 2022] GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f => generated 1472 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:11.634492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-395a61f6-328b-4271-8fba-b954b2664918 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:11.635109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-395a61f6-328b-4271-8fba-b954b2664918 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 0ac3602b-3a76-46ac-be5c-61337f66c441] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:11.659379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-395a61f6-328b-4271-8fba-b954b2664918 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:11.659379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-395a61f6-328b-4271-8fba-b954b2664918 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:11.659379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-395a61f6-328b-4271-8fba-b954b2664918 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:11.659767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-395a61f6-328b-4271-8fba-b954b2664918 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:11.672824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-395a61f6-328b-4271-8fba-b954b2664918 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:11.673684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-395a61f6-328b-4271-8fba-b954b2664918 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:11.898223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-395a61f6-328b-4271-8fba-b954b2664918 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:11.909969 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-395a61f6-328b-4271-8fba-b954b2664918 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441" status: 200 len: 1217 microversion: 2.1 time: 0.291710 Sep 10 10:43:11.910567 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1224/1730] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:11 2022] GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 => generated 1217 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:11.925376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4da29847-0f29-46eb-ac3e-a75e5c752954 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:11.926039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4da29847-0f29-46eb-ac3e-a75e5c752954 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:11.977892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da29847-0f29-46eb-ac3e-a75e5c752954 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:11.978389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da29847-0f29-46eb-ac3e-a75e5c752954 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:11.978905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da29847-0f29-46eb-ac3e-a75e5c752954 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:11.989397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da29847-0f29-46eb-ac3e-a75e5c752954 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:11.989959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da29847-0f29-46eb-ac3e-a75e5c752954 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:11.990397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da29847-0f29-46eb-ac3e-a75e5c752954 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:12.240847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4da29847-0f29-46eb-ac3e-a75e5c752954 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lazy-loading 'services' on Instance uuid 1b5815be-a9f4-4a13-846f-d2f2d7384e00 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:43:12.476325 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4da29847-0f29-46eb-ac3e-a75e5c752954 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments/d01fd3bd-6f7b-41d4-8cc4-16c0179ad30f" status: 202 len: 0 microversion: 2.1 time: 0.564507 Sep 10 10:43:12.476944 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1225/1731] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 10:43:11 2022] DELETE /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments/d01fd3bd-6f7b-41d4-8cc4-16c0179ad30f => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:43:12.482200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-40c503f9-40b0-428a-850f-112e42cb2da4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae4280d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:12.586125 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-40c503f9-40b0-428a-850f-112e42cb2da4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1439 microversion: 2.1 time: 0.107933 Sep 10 10:43:12.586923 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1226/1732] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:12 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:12.601862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9f571001-28e0-47fd-908f-c485f8b48332 req-cd1f398a-5803-438c-a155-091156897343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b22547-e130-45f7-8f9c-fb57446ab4c7", "name": "network-vif-plugged", "status": "completed", "tag": "9b3e5283-8ed5-4225-8495-f8cb4bf41ad3"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:12.638046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9f571001-28e0-47fd-908f-c485f8b48332 req-cd1f398a-5803-438c-a155-091156897343 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:12.638530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9f571001-28e0-47fd-908f-c485f8b48332 req-cd1f398a-5803-438c-a155-091156897343 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:12.642496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9f571001-28e0-47fd-908f-c485f8b48332 req-cd1f398a-5803-438c-a155-091156897343 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:12.694961 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9f571001-28e0-47fd-908f-c485f8b48332 req-cd1f398a-5803-438c-a155-091156897343 service nova] Creating event network-vif-plugged:9b3e5283-8ed5-4225-8495-f8cb4bf41ad3 for instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 on n-h2-856894-1 Sep 10 10:43:12.708729 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9f571001-28e0-47fd-908f-c485f8b48332 req-cd1f398a-5803-438c-a155-091156897343 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120328 Sep 10 10:43:12.716110 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1227/1733] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:12.721785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b63effae-a4a8-4127-a871-0126a6e1b50f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:12.724078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b63effae-a4a8-4127-a871-0126a6e1b50f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:12.754553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b63effae-a4a8-4127-a871-0126a6e1b50f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:12.754553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b63effae-a4a8-4127-a871-0126a6e1b50f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:12.755012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b63effae-a4a8-4127-a871-0126a6e1b50f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:12.757983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b63effae-a4a8-4127-a871-0126a6e1b50f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:12.758486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b63effae-a4a8-4127-a871-0126a6e1b50f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:12.758910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b63effae-a4a8-4127-a871-0126a6e1b50f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:12.836991 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b63effae-a4a8-4127-a871-0126a6e1b50f tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119270 Sep 10 10:43:12.837944 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1228/1734] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:43:12 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:13.794483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:13.819316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:13.898645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1941698609", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:14.071109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] validate_networks() for [('2d6ae299-105b-4d06-b0cf-95c0099cfa6b', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:43:15.022979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:43:15.023641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:43:15.024378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:43:15.024805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:43:15.025318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:43:15.167501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:15.168404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:15.169131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:15.170988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:15.171690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:15.172371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:15.184868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:15.229581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Getting quotas for project 6eeb7998eb2f456c9d5fd8f2f3cacf41. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:15.243562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Getting quotas for user f47159487e9d490ebaba2d168f6c649c and project 6eeb7998eb2f456c9d5fd8f2f3cacf41. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:15.284984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:43:15.287902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:43:15.419471 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-81ab9e77-3946-42df-b7d8-7c769c090b26 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.580179 Sep 10 10:43:15.428261 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1229/1735] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:43:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:43:15.433258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:15.438930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] [instance: b5551819-7a95-48dc-837a-5b1b82fb6c2f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:15.454694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:15.459088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:15.459791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:15.460718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:15.461378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:15.462471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:15.496338 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] HTTP exception thrown: Instance b5551819-7a95-48dc-837a-5b1b82fb6c2f could not be found. Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Request method failure captured: Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f HTTP/1.1 Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmZlUvfnUDtgZPAlP_qbVgwRlmQuo0Cq7GWMTqQw-q2oXMUINlocY_yWkLgEncylWCDDujlmVrTuOBqSN1XEG_-R9rD_WpKW0yhwPFAmvRM0L71bUGhxZj4JOK9s0dnjIEu3SNeTUiiFyjzCHVV2fWwLSI58VkqhW-7LHDiSuF7QSs Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 0a13d3e6b7ed498da4fbde463f57214a Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListImageFiltersTestJSON-578486126 Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a13d3e6b7ed498da4fbde463f57214a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a13d3e6b7ed498da4fbde463f57214a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a13d3e6b7ed498da4fbde463f57214a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a13d3e6b7ed498da4fbde463f57214a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListImageFiltersTestJSON-578486126 Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 0a13d3e6b7ed498da4fbde463f57214a Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-578486126 Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListImageFiltersTestJSON-578486126-project Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3d8273421e8a4b74be0d3f6621a05f0a Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListImageFiltersTestJSON-578486126-project Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance b5551819-7a95-48dc-837a-5b1b82fb6c2f could not be found. Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'b5551819-7a95-48dc-837a-5b1b82fb6c2f'} Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5551819-7a95-48dc-837a-5b1b82fb6c2f could not be found. Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5551819-7a95-48dc-837a-5b1b82fb6c2f could not be found. Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:15.500353 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:15.503783 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:15.503783 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:15.503783 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:15.503783 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:43:15.503783 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:43:15.503783 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5551819-7a95-48dc-837a-5b1b82fb6c2f could not be found. Sep 10 10:43:15.503783 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:15.507341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Returning 404 to user: Instance b5551819-7a95-48dc-837a-5b1b82fb6c2f could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:43:15.510679 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b44bdd8-4936-455d-b463-12380181cc0b tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f" status: 404 len: 111 microversion: 2.1 time: 0.081340 Sep 10 10:43:15.514744 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1230/1736] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:15 2022] GET /compute/v2.1/servers/b5551819-7a95-48dc-837a-5b1b82fb6c2f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:43:15.524031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:15.530978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 0ac3602b-3a76-46ac-be5c-61337f66c441] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:15.542257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:15.543058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:15.543724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:15.544666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:15.545875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:15.546511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:15.583929 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 HTTP/1.1 Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '0ac3602b-3a76-46ac-be5c-61337f66c441'} Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:15.585544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:15.588869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:15.588869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:15.588869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:15.588869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:43:15.588869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:43:15.588869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:43:15.588869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:15.590564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:43:15.597362 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2c4b918-3d1d-41ae-a0db-c0ab064499bb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441" status: 404 len: 111 microversion: 2.1 time: 0.075932 Sep 10 10:43:15.608491 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1231/1737] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:15 2022] GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:43:15.613475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-46f19e4a-b348-4720-9352-0124ca90b58f req-10c8e817-ea4d-4c0b-be77-18ff7136fe96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5551819-7a95-48dc-837a-5b1b82fb6c2f", "name": "network-vif-deleted", "tag": "cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:15.634267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-46f19e4a-b348-4720-9352-0124ca90b58f req-10c8e817-ea4d-4c0b-be77-18ff7136fe96 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:15.634744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-46f19e4a-b348-4720-9352-0124ca90b58f req-10c8e817-ea4d-4c0b-be77-18ff7136fe96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:15.635173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-46f19e4a-b348-4720-9352-0124ca90b58f req-10c8e817-ea4d-4c0b-be77-18ff7136fe96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:15.657770 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-46f19e4a-b348-4720-9352-0124ca90b58f req-10c8e817-ea4d-4c0b-be77-18ff7136fe96 service nova] Creating event network-vif-deleted:cf9295fc-698a-41ee-85bd-d6f6dfb3e3ba for instance b5551819-7a95-48dc-837a-5b1b82fb6c2f on n-h1-856894-1 Sep 10 10:43:15.676792 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-46f19e4a-b348-4720-9352-0124ca90b58f req-10c8e817-ea4d-4c0b-be77-18ff7136fe96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066704 Sep 10 10:43:15.677391 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1232/1738] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:15.699455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23194c17-f8da-4a3b-9a23-76290313231c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae87c4c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:15.797577 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23194c17-f8da-4a3b-9a23-76290313231c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1439 microversion: 2.1 time: 0.118789 Sep 10 10:43:15.798458 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1233/1739] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:15 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1439 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:15.814612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-623d370e-1f75-4642-9962-4f56385218c8 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:15.818076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-623d370e-1f75-4642-9962-4f56385218c8 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:15.844780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-623d370e-1f75-4642-9962-4f56385218c8 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:15.845482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-623d370e-1f75-4642-9962-4f56385218c8 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:15.846298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-623d370e-1f75-4642-9962-4f56385218c8 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:15.846864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-623d370e-1f75-4642-9962-4f56385218c8 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:15.850586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-623d370e-1f75-4642-9962-4f56385218c8 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:15.851345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-623d370e-1f75-4642-9962-4f56385218c8 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:15.927525 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-623d370e-1f75-4642-9962-4f56385218c8 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124157 Sep 10 10:43:15.939766 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1234/1740] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:43:15 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:15.948125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-315dddcb-0c9b-493a-ad8f-74d31986d9bf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:15.949130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-315dddcb-0c9b-493a-ad8f-74d31986d9bf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:15.965670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:16.143903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-315dddcb-0c9b-493a-ad8f-74d31986d9bf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:16.152294 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-315dddcb-0c9b-493a-ad8f-74d31986d9bf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1223 microversion: 2.1 time: 0.210980 Sep 10 10:43:16.173876 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1235/1741] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:15 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1223 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:16.179117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-367cae4b-a7cd-4ffa-b5f5-0f1396060401 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcaef828b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:17.744848 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-367cae4b-a7cd-4ffa-b5f5-0f1396060401 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "DELETE /compute/v2.1/images/6aaa9c9a-6c6f-4304-a123-43f5b3e01bce" status: 204 len: 0 microversion: 2.1 time: 1.569439 Sep 10 10:43:17.745512 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1236/1742] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:16 2022] DELETE /compute/v2.1/images/6aaa9c9a-6c6f-4304-a123-43f5b3e01bce => generated 0 bytes in 1571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:43:17.754490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-954083153", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "15abac29-c434-4802-9cd4-4bace1ac4f7e"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:17.930252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] validate_networks() for [('15abac29-c434-4802-9cd4-4bace1ac4f7e', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:43:20.453118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:43:20.453722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:43:20.454550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:43:20.455255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:43:20.455846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:43:20.484243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:20.496849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:20.497368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:20.498725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:20.499302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:20.499730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:20.571238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:20.579101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for user fa978e59fa334084b722d116c761380f and project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:20.630634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:43:20.633364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:43:20.776338 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8faf327-2728-4b25-8748-7d9b8a38958d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.029785 Sep 10 10:43:20.783378 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1237/1743] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:43:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:43:20.794012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-55b1cd2d-2a5b-447a-adf7-d7c62bfd684a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcaf101ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:20.920544 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-55b1cd2d-2a5b-447a-adf7-d7c62bfd684a tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1439 microversion: 2.1 time: 0.135460 Sep 10 10:43:20.921608 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1238/1744] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:20 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1439 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:20.930283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc66a884-f357-4953-9cc2-219c0b0fabb1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:20.953497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc66a884-f357-4953-9cc2-219c0b0fabb1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:20.975297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc66a884-f357-4953-9cc2-219c0b0fabb1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:20.978279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc66a884-f357-4953-9cc2-219c0b0fabb1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:20.979398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc66a884-f357-4953-9cc2-219c0b0fabb1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:20.986548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc66a884-f357-4953-9cc2-219c0b0fabb1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:20.991534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc66a884-f357-4953-9cc2-219c0b0fabb1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:20.993873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc66a884-f357-4953-9cc2-219c0b0fabb1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:21.113269 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc66a884-f357-4953-9cc2-219c0b0fabb1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188022 Sep 10 10:43:21.114401 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1239/1745] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:43:20 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:21.119381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c796ebf8-b2e6-40c3-94d9-85cc87796c62 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:21.120372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c796ebf8-b2e6-40c3-94d9-85cc87796c62 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:21.127807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c796ebf8-b2e6-40c3-94d9-85cc87796c62 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:21.128589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c796ebf8-b2e6-40c3-94d9-85cc87796c62 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:21.130146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c796ebf8-b2e6-40c3-94d9-85cc87796c62 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:21.131093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c796ebf8-b2e6-40c3-94d9-85cc87796c62 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:21.131779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c796ebf8-b2e6-40c3-94d9-85cc87796c62 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:21.132416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c796ebf8-b2e6-40c3-94d9-85cc87796c62 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:21.573129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c796ebf8-b2e6-40c3-94d9-85cc87796c62 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:21.588287 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c796ebf8-b2e6-40c3-94d9-85cc87796c62 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1323 microversion: 2.1 time: 0.470306 Sep 10 10:43:21.602513 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1240/1746] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:21 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1323 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:21.619949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9fdfd593-d071-4040-94d5-65aedf299ed1 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcaf06b4c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:23.035952 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9fdfd593-d071-4040-94d5-65aedf299ed1 tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "DELETE /compute/v2.1/images/ce027d5f-b72a-4f2f-bcd2-7b18ebfa6f4a" status: 204 len: 0 microversion: 2.1 time: 1.426584 Sep 10 10:43:23.036544 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1241/1747] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:21 2022] DELETE /compute/v2.1/images/ce027d5f-b72a-4f2f-bcd2-7b18ebfa6f4a => generated 0 bytes in 1433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:43:23.437698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1337983988", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:23.626391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] validate_networks() for [('1246673f-7f9e-4286-a113-1b0102bfc8aa', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:43:25.188506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:43:25.189058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:43:25.189322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:43:25.189837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:43:25.190536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:43:25.208475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:25.209022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:25.210832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:25.213537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:25.214016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:25.218062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:25.263440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Getting quotas for project 52c98558e19447dfa54397d92f45dbb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:25.273191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Getting quotas for user 0682225a07764437b25009c061ac844d and project 52c98558e19447dfa54397d92f45dbb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:25.314000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:43:25.316249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:43:25.538896 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cee60fad-0394-4b09-bd2c-2d119ea334c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.487386 Sep 10 10:43:25.542682 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1242/1748] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:43:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:43:25.557111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8ba574c-e116-486f-ae93-0cbbbf988ef8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:25.565465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8ba574c-e116-486f-ae93-0cbbbf988ef8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:25.601866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ba574c-e116-486f-ae93-0cbbbf988ef8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:25.635280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ba574c-e116-486f-ae93-0cbbbf988ef8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:25.635280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ba574c-e116-486f-ae93-0cbbbf988ef8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:25.635280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ba574c-e116-486f-ae93-0cbbbf988ef8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:25.635280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ba574c-e116-486f-ae93-0cbbbf988ef8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:25.635280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ba574c-e116-486f-ae93-0cbbbf988ef8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:25.815335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8ba574c-e116-486f-ae93-0cbbbf988ef8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:25.866328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8ba574c-e116-486f-ae93-0cbbbf988ef8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1272 microversion: 2.1 time: 0.321115 Sep 10 10:43:25.870117 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1243/1749] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:25 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:25.892110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e530efdf-acfc-45d1-bbf1-df14e740e7e1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcaf1014c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:25.961035 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e530efdf-acfc-45d1-bbf1-df14e740e7e1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1439 microversion: 2.1 time: 0.073558 Sep 10 10:43:25.961883 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1244/1750] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:25 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:25.974548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-59d3595a-8e49-4357-a869-108f91e4c528 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:26.010093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-59d3595a-8e49-4357-a869-108f91e4c528 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:26.037491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59d3595a-8e49-4357-a869-108f91e4c528 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:26.040167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59d3595a-8e49-4357-a869-108f91e4c528 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:26.042572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59d3595a-8e49-4357-a869-108f91e4c528 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:26.043556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59d3595a-8e49-4357-a869-108f91e4c528 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:26.046612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59d3595a-8e49-4357-a869-108f91e4c528 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:26.047326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59d3595a-8e49-4357-a869-108f91e4c528 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:26.141560 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-59d3595a-8e49-4357-a869-108f91e4c528 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178372 Sep 10 10:43:26.144658 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1245/1751] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:43:25 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:26.161748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f4d8da4b-d07a-4317-9173-45ae6a6a674c tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:26.163050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f4d8da4b-d07a-4317-9173-45ae6a6a674c tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:26.172723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4d8da4b-d07a-4317-9173-45ae6a6a674c tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:26.173689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4d8da4b-d07a-4317-9173-45ae6a6a674c tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:26.174566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4d8da4b-d07a-4317-9173-45ae6a6a674c tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:26.175496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4d8da4b-d07a-4317-9173-45ae6a6a674c tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:26.176238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4d8da4b-d07a-4317-9173-45ae6a6a674c tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:26.176877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4d8da4b-d07a-4317-9173-45ae6a6a674c tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:27.050456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f4d8da4b-d07a-4317-9173-45ae6a6a674c tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:27.072056 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f4d8da4b-d07a-4317-9173-45ae6a6a674c tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1323 microversion: 2.1 time: 0.916962 Sep 10 10:43:27.078464 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1246/1752] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:26 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1323 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:27.103138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-75abd24c-efe0-419b-9b31-e9d05ea9ac1f tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] Calling method '.version_select at 0x7efcae3f6700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:28.152736 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-75abd24c-efe0-419b-9b31-e9d05ea9ac1f tempest-ListImageFiltersTestJSON-578486126 tempest-ListImageFiltersTestJSON-578486126-project] 10.222.0.20 "DELETE /compute/v2.1/images/3f6a6e8a-21ce-464a-b99d-58a844e5643e" status: 204 len: 0 microversion: 2.1 time: 1.071789 Sep 10 10:43:28.153355 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1247/1753] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:27 2022] DELETE /compute/v2.1/images/3f6a6e8a-21ce-464a-b99d-58a844e5643e => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:43:28.159190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1b9f21bc-3a6e-4b46-aee6-37b4d48fee27 req-a79fb3cf-616b-4063-b9e8-1f31ccfdf77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147a5ac3-709e-43e4-89d3-ce745514c377", "tag": "3086246d-f560-41ce-b858-9f9eb7fa8433"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:28.190892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b9f21bc-3a6e-4b46-aee6-37b4d48fee27 req-a79fb3cf-616b-4063-b9e8-1f31ccfdf77e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:28.191779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b9f21bc-3a6e-4b46-aee6-37b4d48fee27 req-a79fb3cf-616b-4063-b9e8-1f31ccfdf77e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:28.191926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b9f21bc-3a6e-4b46-aee6-37b4d48fee27 req-a79fb3cf-616b-4063-b9e8-1f31ccfdf77e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:28.252035 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1b9f21bc-3a6e-4b46-aee6-37b4d48fee27 req-a79fb3cf-616b-4063-b9e8-1f31ccfdf77e service nova] Creating event network-changed:3086246d-f560-41ce-b858-9f9eb7fa8433 for instance 147a5ac3-709e-43e4-89d3-ce745514c377 on n-h2-856894-1 Sep 10 10:43:28.275756 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1b9f21bc-3a6e-4b46-aee6-37b4d48fee27 req-a79fb3cf-616b-4063-b9e8-1f31ccfdf77e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120283 Sep 10 10:43:28.295207 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1248/1754] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:28.305693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ace83195-8d55-44ed-8236-5f08b791d13c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:28.320037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ace83195-8d55-44ed-8236-5f08b791d13c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:28.345508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace83195-8d55-44ed-8236-5f08b791d13c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:28.356254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace83195-8d55-44ed-8236-5f08b791d13c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:28.357541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace83195-8d55-44ed-8236-5f08b791d13c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:28.364774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace83195-8d55-44ed-8236-5f08b791d13c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:28.365249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace83195-8d55-44ed-8236-5f08b791d13c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:28.371335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace83195-8d55-44ed-8236-5f08b791d13c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:28.568448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ace83195-8d55-44ed-8236-5f08b791d13c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:28.590483 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ace83195-8d55-44ed-8236-5f08b791d13c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1282 microversion: 2.1 time: 0.288953 Sep 10 10:43:28.591903 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1249/1755] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:28 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1282 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:28.610478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-29a64ba8-79c3-48fb-8c1a-da1eb7f3feaf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:28.611436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-29a64ba8-79c3-48fb-8c1a-da1eb7f3feaf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:28.631165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29a64ba8-79c3-48fb-8c1a-da1eb7f3feaf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:28.633121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29a64ba8-79c3-48fb-8c1a-da1eb7f3feaf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:28.645367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29a64ba8-79c3-48fb-8c1a-da1eb7f3feaf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:28.649589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29a64ba8-79c3-48fb-8c1a-da1eb7f3feaf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:28.650382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29a64ba8-79c3-48fb-8c1a-da1eb7f3feaf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:28.651591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29a64ba8-79c3-48fb-8c1a-da1eb7f3feaf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:30.063340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-29a64ba8-79c3-48fb-8c1a-da1eb7f3feaf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:30.072810 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-29a64ba8-79c3-48fb-8c1a-da1eb7f3feaf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1314 microversion: 2.1 time: 1.479551 Sep 10 10:43:30.076588 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1250/1756] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:28 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1314 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:30.088376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-caff55a5-6986-4b03-9005-1e253ab0b9e0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcaeb37430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:30.208120 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-caff55a5-6986-4b03-9005-1e253ab0b9e0 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1439 microversion: 2.1 time: 0.130197 Sep 10 10:43:30.208706 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1251/1757] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:30 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1439 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:30.227248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ce7f5108-5bef-4a3f-9bbc-4d76048608ae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:30.238249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ce7f5108-5bef-4a3f-9bbc-4d76048608ae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:30.259885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7f5108-5bef-4a3f-9bbc-4d76048608ae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:30.260519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7f5108-5bef-4a3f-9bbc-4d76048608ae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:30.260976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7f5108-5bef-4a3f-9bbc-4d76048608ae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:30.266220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7f5108-5bef-4a3f-9bbc-4d76048608ae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:30.266220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7f5108-5bef-4a3f-9bbc-4d76048608ae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:30.266220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7f5108-5bef-4a3f-9bbc-4d76048608ae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:30.382485 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ce7f5108-5bef-4a3f-9bbc-4d76048608ae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.169555 Sep 10 10:43:30.391803 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1252/1758] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:43:30 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00/os-volume_attachments => generated 25 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:43:30.409876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de4fd100-1e19-45dc-8acc-9df36cde79d2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:30.420010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de4fd100-1e19-45dc-8acc-9df36cde79d2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:30.440647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4fd100-1e19-45dc-8acc-9df36cde79d2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:30.444296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4fd100-1e19-45dc-8acc-9df36cde79d2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:30.444993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4fd100-1e19-45dc-8acc-9df36cde79d2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:30.446002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4fd100-1e19-45dc-8acc-9df36cde79d2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:30.446654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4fd100-1e19-45dc-8acc-9df36cde79d2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:30.448710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de4fd100-1e19-45dc-8acc-9df36cde79d2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:30.976850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-de4fd100-1e19-45dc-8acc-9df36cde79d2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:30.985530 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de4fd100-1e19-45dc-8acc-9df36cde79d2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1323 microversion: 2.1 time: 0.601352 Sep 10 10:43:31.001782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1253/1759] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:30 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1323 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:31.009539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1691480265", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:31.104051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] validate_networks() for [('1246673f-7f9e-4286-a113-1b0102bfc8aa', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:43:32.050608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:43:32.051046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:43:32.051784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:43:32.052210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:43:32.052638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:43:32.070444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:32.071005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:32.071499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:32.072440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:32.072972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:32.073349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:32.099193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Getting quotas for project 52c98558e19447dfa54397d92f45dbb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:32.105864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Getting quotas for user 0682225a07764437b25009c061ac844d and project 52c98558e19447dfa54397d92f45dbb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:32.140653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:43:32.146324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:43:32.249258 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-983899a0-5e2d-47e1-8655-07d346756e07 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.244497 Sep 10 10:43:32.250664 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1254/1760] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:43:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:43:32.264547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7859053c-f2e3-42f3-b684-ea69ed5568df req-d8b7e4b7-feae-4351-b123-4f3b935d670f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8542d6bf-4373-44a8-9ffe-46f8e25a0ed7", "tag": "5acf41f0-9a08-4e65-b9df-83ff9815cf7f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:32.290254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7859053c-f2e3-42f3-b684-ea69ed5568df req-d8b7e4b7-feae-4351-b123-4f3b935d670f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:32.293831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7859053c-f2e3-42f3-b684-ea69ed5568df req-d8b7e4b7-feae-4351-b123-4f3b935d670f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:32.298578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7859053c-f2e3-42f3-b684-ea69ed5568df req-d8b7e4b7-feae-4351-b123-4f3b935d670f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:32.346822 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7859053c-f2e3-42f3-b684-ea69ed5568df req-d8b7e4b7-feae-4351-b123-4f3b935d670f service nova] Creating event network-changed:5acf41f0-9a08-4e65-b9df-83ff9815cf7f for instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 on n-h2-856894-1 Sep 10 10:43:32.358607 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7859053c-f2e3-42f3-b684-ea69ed5568df req-d8b7e4b7-feae-4351-b123-4f3b935d670f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105862 Sep 10 10:43:32.368082 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1255/1761] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:33.197348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-331236535", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:35.098369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:43:35.385936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:43:35.386668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:43:35.387478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:43:35.388282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:43:35.389050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:43:35.401969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:35.402896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:35.404552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:35.407946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:35.409232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:35.409892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:35.443906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for project 7c408248417b4deaaa26ef380da4bb90. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:35.452753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for user f5b257d1488141689c826efe484e4040 and project 7c408248417b4deaaa26ef380da4bb90. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:35.469559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:43:35.472414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:43:35.539009 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b7463230-b893-4941-94f4-5c334ad4e9e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.168291 Sep 10 10:43:35.539679 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1256/1762] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:43:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:43:35.553093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53a3b0be-acad-466b-8368-e6e0e0b88414 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:35.553957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53a3b0be-acad-466b-8368-e6e0e0b88414 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:35.561710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3b0be-acad-466b-8368-e6e0e0b88414 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:35.562842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3b0be-acad-466b-8368-e6e0e0b88414 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:35.563571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3b0be-acad-466b-8368-e6e0e0b88414 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:35.565135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3b0be-acad-466b-8368-e6e0e0b88414 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:35.565869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3b0be-acad-466b-8368-e6e0e0b88414 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:35.567024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3b0be-acad-466b-8368-e6e0e0b88414 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:35.782533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53a3b0be-acad-466b-8368-e6e0e0b88414 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:35.791596 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53a3b0be-acad-466b-8368-e6e0e0b88414 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1314 microversion: 2.1 time: 0.243430 Sep 10 10:43:35.792678 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1257/1763] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:35 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:35.798873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8865503d-c0d5-44ed-87ae-fee4bbdcc0df tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae87c040>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:35.891672 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8865503d-c0d5-44ed-87ae-fee4bbdcc0df tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1448 microversion: 2.1 time: 0.097638 Sep 10 10:43:35.892271 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1258/1764] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:35 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1448 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:35.913244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e427c66f-a85e-4f23-8d52-67bf081615a9 req-2e711e21-98eb-4163-aedf-488894653f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147a5ac3-709e-43e4-89d3-ce745514c377", "name": "network-vif-plugged", "status": "completed", "tag": "3086246d-f560-41ce-b858-9f9eb7fa8433"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:35.936796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e427c66f-a85e-4f23-8d52-67bf081615a9 req-2e711e21-98eb-4163-aedf-488894653f35 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:35.937455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e427c66f-a85e-4f23-8d52-67bf081615a9 req-2e711e21-98eb-4163-aedf-488894653f35 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:35.937906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e427c66f-a85e-4f23-8d52-67bf081615a9 req-2e711e21-98eb-4163-aedf-488894653f35 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:35.970025 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e427c66f-a85e-4f23-8d52-67bf081615a9 req-2e711e21-98eb-4163-aedf-488894653f35 service nova] Creating event network-vif-plugged:3086246d-f560-41ce-b858-9f9eb7fa8433 for instance 147a5ac3-709e-43e4-89d3-ce745514c377 on n-h2-856894-1 Sep 10 10:43:35.983119 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e427c66f-a85e-4f23-8d52-67bf081615a9 req-2e711e21-98eb-4163-aedf-488894653f35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089517 Sep 10 10:43:35.985402 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1259/1765] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:36.000969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ce3f4031-467a-46c4-89a0-c213a900cf7b req-b178471e-051f-49aa-96cb-e535acd8826f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0", "tag": "6b66707a-c5e9-468a-986c-6dcabdec9863"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:36.018852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ce3f4031-467a-46c4-89a0-c213a900cf7b req-b178471e-051f-49aa-96cb-e535acd8826f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:36.019603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ce3f4031-467a-46c4-89a0-c213a900cf7b req-b178471e-051f-49aa-96cb-e535acd8826f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:36.020200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ce3f4031-467a-46c4-89a0-c213a900cf7b req-b178471e-051f-49aa-96cb-e535acd8826f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:36.045826 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ce3f4031-467a-46c4-89a0-c213a900cf7b req-b178471e-051f-49aa-96cb-e535acd8826f service nova] Creating event network-changed:6b66707a-c5e9-468a-986c-6dcabdec9863 for instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 on n-h2-856894-1 Sep 10 10:43:36.069892 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ce3f4031-467a-46c4-89a0-c213a900cf7b req-b178471e-051f-49aa-96cb-e535acd8826f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082780 Sep 10 10:43:36.075890 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1260/1766] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:36.085990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec5159f6-3842-4601-b4b4-601d999dc2d8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:36.086762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec5159f6-3842-4601-b4b4-601d999dc2d8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:36.113465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec5159f6-3842-4601-b4b4-601d999dc2d8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:36.115932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec5159f6-3842-4601-b4b4-601d999dc2d8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:36.116381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec5159f6-3842-4601-b4b4-601d999dc2d8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:36.135607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec5159f6-3842-4601-b4b4-601d999dc2d8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:36.139842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec5159f6-3842-4601-b4b4-601d999dc2d8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:36.140567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec5159f6-3842-4601-b4b4-601d999dc2d8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:36.657631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec5159f6-3842-4601-b4b4-601d999dc2d8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:36.666949 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec5159f6-3842-4601-b4b4-601d999dc2d8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1323 microversion: 2.1 time: 0.589759 Sep 10 10:43:36.668869 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1261/1767] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:36 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1323 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:36.674327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-feeab112-890d-485c-a803-1cf75e28df95 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:36.675196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-feeab112-890d-485c-a803-1cf75e28df95 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:36.682868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-feeab112-890d-485c-a803-1cf75e28df95 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:36.683681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-feeab112-890d-485c-a803-1cf75e28df95 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:36.684164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-feeab112-890d-485c-a803-1cf75e28df95 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:36.685020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-feeab112-890d-485c-a803-1cf75e28df95 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:36.685653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-feeab112-890d-485c-a803-1cf75e28df95 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:36.686238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-feeab112-890d-485c-a803-1cf75e28df95 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:37.081057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-feeab112-890d-485c-a803-1cf75e28df95 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:37.085415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:37.097521 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-feeab112-890d-485c-a803-1cf75e28df95 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1322 microversion: 2.1 time: 0.425268 Sep 10 10:43:37.114533 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1262/1768] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:36 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:37.475217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0146351-cc57-4b33-bac2-4901ebdaa464 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Action: 'create', calling method: .version_select at 0x7efcae8e43a0>, body: {"keypair": {"name": "tempest-keypair-1126162177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgIdDFp3ZUoX0HZodp0T+7rgnf6dPeXCaK5ffOObwlvRYdUVDoIDpuTBNkCpxCJjWAb/bHumPv6Jyhm1Io0JPjnOrkvDIXISlHjmonUxAy4XUsW/Ic3PHgY/NuABVDWcA=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:37.487395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:37.495801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e0146351-cc57-4b33-bac2-4901ebdaa464 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:37.502457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e0146351-cc57-4b33-bac2-4901ebdaa464 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for user 7ba97c27347349dbac71f4e956a1c2b6 and project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:37.534166 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0146351-cc57-4b33-bac2-4901ebdaa464 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.416760 Sep 10 10:43:37.535126 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1263/1769] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:43:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:37.546325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c17fc58-acb3-45cb-bcd8-fe36217e8f8a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:37.547430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c17fc58-acb3-45cb-bcd8-fe36217e8f8a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:37.555724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c17fc58-acb3-45cb-bcd8-fe36217e8f8a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:37.556465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c17fc58-acb3-45cb-bcd8-fe36217e8f8a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:37.557569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c17fc58-acb3-45cb-bcd8-fe36217e8f8a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:37.558758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c17fc58-acb3-45cb-bcd8-fe36217e8f8a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:37.559934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c17fc58-acb3-45cb-bcd8-fe36217e8f8a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:37.561138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c17fc58-acb3-45cb-bcd8-fe36217e8f8a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:37.674812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3c17fc58-acb3-45cb-bcd8-fe36217e8f8a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:37.684908 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c17fc58-acb3-45cb-bcd8-fe36217e8f8a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1264 microversion: 2.1 time: 0.140257 Sep 10 10:43:37.686124 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1264/1770] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:37 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1264 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:37.691147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-16ff746d-0aeb-44c1-96b7-5743038b131d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae3dc040>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:37.756899 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-16ff746d-0aeb-44c1-96b7-5743038b131d tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 200 len: 1448 microversion: 2.1 time: 0.069416 Sep 10 10:43:37.764316 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1265/1771] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:43:37 2022] GET /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 1448 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:37.776326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b15613f-0c1a-4f49-95ea-58670d7afaea tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:37.778545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1b15613f-0c1a-4f49-95ea-58670d7afaea tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:37.786320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b15613f-0c1a-4f49-95ea-58670d7afaea tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:37.787001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b15613f-0c1a-4f49-95ea-58670d7afaea tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:37.787514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b15613f-0c1a-4f49-95ea-58670d7afaea tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:37.788298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b15613f-0c1a-4f49-95ea-58670d7afaea tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:37.788969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b15613f-0c1a-4f49-95ea-58670d7afaea tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:37.789792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b15613f-0c1a-4f49-95ea-58670d7afaea tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:38.097417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1b15613f-0c1a-4f49-95ea-58670d7afaea tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:38.105704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b15613f-0c1a-4f49-95ea-58670d7afaea tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1314 microversion: 2.1 time: 0.340327 Sep 10 10:43:38.108631 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1266/1772] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:37 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:38.116555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cabadc16-cda7-436d-b506-10b3f16a6c71 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Calling method '.version_select at 0x7efcaeb4e670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:38.126546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cabadc16-cda7-436d-b506-10b3f16a6c71 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1126162177" status: 200 len: 498 microversion: 2.1 time: 0.015393 Sep 10 10:43:38.127509 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1267/1773] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Sep 10 10:43:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1126162177 => generated 498 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:38.135758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-09c26b6c-2ea8-4b97-905a-8055d24aa04a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:38.142938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-09c26b6c-2ea8-4b97-905a-8055d24aa04a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:38.152494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c26b6c-2ea8-4b97-905a-8055d24aa04a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:38.159864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c26b6c-2ea8-4b97-905a-8055d24aa04a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:38.160732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c26b6c-2ea8-4b97-905a-8055d24aa04a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:38.161523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c26b6c-2ea8-4b97-905a-8055d24aa04a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:38.161996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c26b6c-2ea8-4b97-905a-8055d24aa04a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:38.162433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c26b6c-2ea8-4b97-905a-8055d24aa04a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:38.326320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-09c26b6c-2ea8-4b97-905a-8055d24aa04a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:38.336799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-09c26b6c-2ea8-4b97-905a-8055d24aa04a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1518 microversion: 2.1 time: 0.208242 Sep 10 10:43:38.337704 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1268/1774] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:38 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1518 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:38.362264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-835994b5-0b35-42c5-aa60-d923483b2f00 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae3dc940>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:39.211310 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-835994b5-0b35-42c5-aa60-d923483b2f00 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 204 len: 0 microversion: 2.1 time: 0.856165 Sep 10 10:43:39.215203 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1269/1775] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:38 2022] DELETE /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:43:39.220671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-52742651-f58c-4073-8e27-d56ed30729eb req-f6792695-abb8-481d-b8fb-04a2c68a69dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8542d6bf-4373-44a8-9ffe-46f8e25a0ed7", "name": "network-vif-plugged", "status": "completed", "tag": "5acf41f0-9a08-4e65-b9df-83ff9815cf7f"}, {"server_uuid": "01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0", "name": "network-vif-plugged", "status": "completed", "tag": "6b66707a-c5e9-468a-986c-6dcabdec9863"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:39.233949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-52742651-f58c-4073-8e27-d56ed30729eb req-f6792695-abb8-481d-b8fb-04a2c68a69dc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:39.235861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-52742651-f58c-4073-8e27-d56ed30729eb req-f6792695-abb8-481d-b8fb-04a2c68a69dc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:39.236501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-52742651-f58c-4073-8e27-d56ed30729eb req-f6792695-abb8-481d-b8fb-04a2c68a69dc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:39.255255 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-52742651-f58c-4073-8e27-d56ed30729eb req-f6792695-abb8-481d-b8fb-04a2c68a69dc service nova] Creating event network-vif-plugged:5acf41f0-9a08-4e65-b9df-83ff9815cf7f for instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 on n-h2-856894-1 Sep 10 10:43:39.256320 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-52742651-f58c-4073-8e27-d56ed30729eb req-f6792695-abb8-481d-b8fb-04a2c68a69dc service nova] Creating event network-vif-plugged:6b66707a-c5e9-468a-986c-6dcabdec9863 for instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 on n-h2-856894-1 Sep 10 10:43:39.265735 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-52742651-f58c-4073-8e27-d56ed30729eb req-f6792695-abb8-481d-b8fb-04a2c68a69dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048918 Sep 10 10:43:39.266998 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1270/1776] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:39.275323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d3d6e7b-dcc8-4d5d-b76a-8f6a55bdb648 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:39.276854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d3d6e7b-dcc8-4d5d-b76a-8f6a55bdb648 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:39.285357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d3d6e7b-dcc8-4d5d-b76a-8f6a55bdb648 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:39.286187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d3d6e7b-dcc8-4d5d-b76a-8f6a55bdb648 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:39.287128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d3d6e7b-dcc8-4d5d-b76a-8f6a55bdb648 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:39.288163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d3d6e7b-dcc8-4d5d-b76a-8f6a55bdb648 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:39.288814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d3d6e7b-dcc8-4d5d-b76a-8f6a55bdb648 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:39.289481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d3d6e7b-dcc8-4d5d-b76a-8f6a55bdb648 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:39.507099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d3d6e7b-dcc8-4d5d-b76a-8f6a55bdb648 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:39.540618 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d3d6e7b-dcc8-4d5d-b76a-8f6a55bdb648 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1322 microversion: 2.1 time: 0.251743 Sep 10 10:43:39.540618 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1271/1777] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:39 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:39.540618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d20b82e-e9ba-4dc9-a1f8-12060620a874 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Calling method '.version_select at 0x7efcae89a790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:39.560749 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d20b82e-e9ba-4dc9-a1f8-12060620a874 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126162177" status: 202 len: 0 microversion: 2.1 time: 0.037888 Sep 10 10:43:39.567916 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1272/1778] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 10:43:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126162177 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:43:39.567916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-71f1c390-0415-49cf-8e16-f4d84805bc6c req-12add7e7-fc64-46a7-b1dc-4c6dffad74b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf615daa-1aa8-4756-8b54-041304199609", "tag": "847262ac-e422-4b62-87d1-33447a795418"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:39.578253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-71f1c390-0415-49cf-8e16-f4d84805bc6c req-12add7e7-fc64-46a7-b1dc-4c6dffad74b4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:39.578730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-71f1c390-0415-49cf-8e16-f4d84805bc6c req-12add7e7-fc64-46a7-b1dc-4c6dffad74b4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:39.579158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-71f1c390-0415-49cf-8e16-f4d84805bc6c req-12add7e7-fc64-46a7-b1dc-4c6dffad74b4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:39.596726 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-71f1c390-0415-49cf-8e16-f4d84805bc6c req-12add7e7-fc64-46a7-b1dc-4c6dffad74b4 service nova] Creating event network-changed:847262ac-e422-4b62-87d1-33447a795418 for instance bf615daa-1aa8-4756-8b54-041304199609 on n-h2-856894-1 Sep 10 10:43:39.603875 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-71f1c390-0415-49cf-8e16-f4d84805bc6c req-12add7e7-fc64-46a7-b1dc-4c6dffad74b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041178 Sep 10 10:43:39.604581 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1273/1779] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:39.610425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15ff64ef-c79b-4d2e-ac78-b6f8e1775d38 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:39.615040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15ff64ef-c79b-4d2e-ac78-b6f8e1775d38 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:39.623812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ff64ef-c79b-4d2e-ac78-b6f8e1775d38 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:39.624525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ff64ef-c79b-4d2e-ac78-b6f8e1775d38 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:39.626480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ff64ef-c79b-4d2e-ac78-b6f8e1775d38 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:39.627228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ff64ef-c79b-4d2e-ac78-b6f8e1775d38 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:39.627688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ff64ef-c79b-4d2e-ac78-b6f8e1775d38 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:39.628110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ff64ef-c79b-4d2e-ac78-b6f8e1775d38 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:39.663768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-15ff64ef-c79b-4d2e-ac78-b6f8e1775d38 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lazy-loading 'flavor' on Instance uuid 147a5ac3-709e-43e4-89d3-ce745514c377 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:43:39.774429 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15ff64ef-c79b-4d2e-ac78-b6f8e1775d38 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "POST /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377/action" status: 200 len: 32 microversion: 2.1 time: 0.168429 Sep 10 10:43:39.779254 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1274/1780] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:43:39 2022] POST /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:43:39.781496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-08548cc6-e8f3-43d0-b185-5df9d1002b0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:39.782199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-08548cc6-e8f3-43d0-b185-5df9d1002b0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:39.791521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08548cc6-e8f3-43d0-b185-5df9d1002b0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:39.792897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08548cc6-e8f3-43d0-b185-5df9d1002b0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:39.795607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08548cc6-e8f3-43d0-b185-5df9d1002b0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:39.797914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08548cc6-e8f3-43d0-b185-5df9d1002b0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:39.798794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08548cc6-e8f3-43d0-b185-5df9d1002b0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:39.801497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08548cc6-e8f3-43d0-b185-5df9d1002b0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:39.881685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-08548cc6-e8f3-43d0-b185-5df9d1002b0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:39.932136 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-08548cc6-e8f3-43d0-b185-5df9d1002b0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1270 microversion: 2.1 time: 0.152774 Sep 10 10:43:39.933142 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1275/1781] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:39 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:39.942213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb1217ac-667c-4236-8364-8e7c4f3a4222 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:39.943339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb1217ac-667c-4236-8364-8e7c4f3a4222 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:39.953108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb1217ac-667c-4236-8364-8e7c4f3a4222 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:39.953779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb1217ac-667c-4236-8364-8e7c4f3a4222 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:39.954465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb1217ac-667c-4236-8364-8e7c4f3a4222 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:39.955124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb1217ac-667c-4236-8364-8e7c4f3a4222 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:39.955828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb1217ac-667c-4236-8364-8e7c4f3a4222 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:39.956363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb1217ac-667c-4236-8364-8e7c4f3a4222 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:40.489996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb1217ac-667c-4236-8364-8e7c4f3a4222 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:40.502318 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb1217ac-667c-4236-8364-8e7c4f3a4222 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1314 microversion: 2.1 time: 0.567946 Sep 10 10:43:40.506732 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1276/1782] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:39 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:40.521999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a69560c3-55f4-44c5-906d-8b9426db8031 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:40.522745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a69560c3-55f4-44c5-906d-8b9426db8031 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:40.532499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69560c3-55f4-44c5-906d-8b9426db8031 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:40.536427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69560c3-55f4-44c5-906d-8b9426db8031 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:40.537551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69560c3-55f4-44c5-906d-8b9426db8031 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:40.539947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69560c3-55f4-44c5-906d-8b9426db8031 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:40.540607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69560c3-55f4-44c5-906d-8b9426db8031 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:40.544322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69560c3-55f4-44c5-906d-8b9426db8031 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:40.600326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a69560c3-55f4-44c5-906d-8b9426db8031 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:43:40.701778 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a69560c3-55f4-44c5-906d-8b9426db8031 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 204 len: 0 microversion: 2.1 time: 0.193429 Sep 10 10:43:40.703158 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1277/1783] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:43:40 2022] DELETE /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:43:40.708682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-adc6dfb5-e8bc-48ea-8b5b-181b8ebc0edb tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Action: 'create', calling method: .version_select at 0x7efcae3dcd30>, body: {"keypair": {"name": "tempest-keypair-1173540180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2yNRJYBYMx4m5x+jNSsVvSHILH4IAN1VlZAn3pJlkVwr8tS7w0faM6bfRouj2GyhbWpKA5cCOafZ2BUtWLULad8MtV0u14h4ED1DY3tT7Necs9moNFVoFgOf+XCK0zew=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:40.728287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-adc6dfb5-e8bc-48ea-8b5b-181b8ebc0edb tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:40.736782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-adc6dfb5-e8bc-48ea-8b5b-181b8ebc0edb tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for user 7ba97c27347349dbac71f4e956a1c2b6 and project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:40.762603 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-adc6dfb5-e8bc-48ea-8b5b-181b8ebc0edb tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057968 Sep 10 10:43:40.768841 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1278/1784] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:43:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:40.768841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ca8bc83-7c22-425f-8cd3-4398fcbe96fc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:40.768841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8ca8bc83-7c22-425f-8cd3-4398fcbe96fc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:40.776153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ca8bc83-7c22-425f-8cd3-4398fcbe96fc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:40.776905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ca8bc83-7c22-425f-8cd3-4398fcbe96fc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:40.777388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ca8bc83-7c22-425f-8cd3-4398fcbe96fc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:40.778600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ca8bc83-7c22-425f-8cd3-4398fcbe96fc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:40.779053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ca8bc83-7c22-425f-8cd3-4398fcbe96fc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:40.779471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ca8bc83-7c22-425f-8cd3-4398fcbe96fc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:40.971140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8ca8bc83-7c22-425f-8cd3-4398fcbe96fc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:40.988862 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ca8bc83-7c22-425f-8cd3-4398fcbe96fc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.224469 Sep 10 10:43:40.991437 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1279/1785] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:40 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:41.000373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14c47159-9033-41d6-ad8c-8dd77a084d72 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:41.001097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14c47159-9033-41d6-ad8c-8dd77a084d72 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:41.019598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c47159-9033-41d6-ad8c-8dd77a084d72 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:41.020108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c47159-9033-41d6-ad8c-8dd77a084d72 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:41.020556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c47159-9033-41d6-ad8c-8dd77a084d72 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:41.030955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c47159-9033-41d6-ad8c-8dd77a084d72 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:41.031459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c47159-9033-41d6-ad8c-8dd77a084d72 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:41.031904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c47159-9033-41d6-ad8c-8dd77a084d72 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:41.345942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14c47159-9033-41d6-ad8c-8dd77a084d72 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:41.353763 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14c47159-9033-41d6-ad8c-8dd77a084d72 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1322 microversion: 2.1 time: 0.361139 Sep 10 10:43:41.354534 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1280/1786] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:40 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:41.373949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d15d206f-f29e-492e-b47a-af3f9820842b tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Calling method '.version_select at 0x7efcae2c38b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:41.398808 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d15d206f-f29e-492e-b47a-af3f9820842b tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173540180" status: 202 len: 0 microversion: 2.1 time: 0.028556 Sep 10 10:43:41.399799 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1281/1787] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 10:43:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173540180 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:43:41.411210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-728521386", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "6949200c-0a45-48d1-a5e5-5e687dfebc1f"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:41.634780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] validate_networks() for [('6949200c-0a45-48d1-a5e5-5e687dfebc1f', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:43:42.245499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:43:42.246291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:43:42.247424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:43:42.247840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:43:42.248284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:43:42.258280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:42.258786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:42.259117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:42.260130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:42.260589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:42.261015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:42.281300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Getting quotas for project 302151fe6dda436ca654252333e7fc7f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:42.287133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Getting quotas for user 75dc4bf3c30b42448e6dbea15579400e and project 302151fe6dda436ca654252333e7fc7f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:42.300449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:43:42.303001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:43:42.351251 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90eef999-2d02-4626-92cf-b9537b8328f9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949672 Sep 10 10:43:42.351907 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1282/1788] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:43:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:43:42.360487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf7ef9f9-b81a-4d07-b3b9-c6b760c21f75 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:42.362924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf7ef9f9-b81a-4d07-b3b9-c6b760c21f75 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:42.376841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf7ef9f9-b81a-4d07-b3b9-c6b760c21f75 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:42.378414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf7ef9f9-b81a-4d07-b3b9-c6b760c21f75 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:42.379767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf7ef9f9-b81a-4d07-b3b9-c6b760c21f75 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:42.380460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf7ef9f9-b81a-4d07-b3b9-c6b760c21f75 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:42.381107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf7ef9f9-b81a-4d07-b3b9-c6b760c21f75 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:42.381691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf7ef9f9-b81a-4d07-b3b9-c6b760c21f75 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:42.564587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cf7ef9f9-b81a-4d07-b3b9-c6b760c21f75 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:42.573470 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf7ef9f9-b81a-4d07-b3b9-c6b760c21f75 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1312 microversion: 2.1 time: 0.220476 Sep 10 10:43:42.574254 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1283/1789] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:42 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:42.590886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b4d773bc-e4e4-4d34-8971-07247b8fc420 req-50affaaf-52c1-4e69-bf85-8fea2cbce38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b22547-e130-45f7-8f9c-fb57446ab4c7", "name": "network-vif-unplugged", "status": "completed", "tag": "9b3e5283-8ed5-4225-8495-f8cb4bf41ad3"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:42.601956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b4d773bc-e4e4-4d34-8971-07247b8fc420 req-50affaaf-52c1-4e69-bf85-8fea2cbce38f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:42.602382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b4d773bc-e4e4-4d34-8971-07247b8fc420 req-50affaaf-52c1-4e69-bf85-8fea2cbce38f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:42.602871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b4d773bc-e4e4-4d34-8971-07247b8fc420 req-50affaaf-52c1-4e69-bf85-8fea2cbce38f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:42.619549 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b4d773bc-e4e4-4d34-8971-07247b8fc420 req-50affaaf-52c1-4e69-bf85-8fea2cbce38f service nova] Creating event network-vif-unplugged:9b3e5283-8ed5-4225-8495-f8cb4bf41ad3 for instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 on n-h2-856894-1 Sep 10 10:43:42.622442 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b4d773bc-e4e4-4d34-8971-07247b8fc420 req-50affaaf-52c1-4e69-bf85-8fea2cbce38f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035638 Sep 10 10:43:42.623071 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1284/1790] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:42.628278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a62b4c0-e614-4af2-b76f-bf237cb63a50 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Action: 'create', calling method: .version_select at 0x7efcaee0f0d0>, body: {"keypair": {"name": "tempest-keypair-346098923", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:42.646525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-9a62b4c0-e614-4af2-b76f-bf237cb63a50 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:42.654414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-9a62b4c0-e614-4af2-b76f-bf237cb63a50 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for user 7ba97c27347349dbac71f4e956a1c2b6 and project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:42.691110 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a62b4c0-e614-4af2-b76f-bf237cb63a50 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.066529 Sep 10 10:43:42.692531 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1285/1791] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:43:42 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:42.697885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-249cdd08-cb07-41be-a2f7-946426c61fb0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:42.698937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-249cdd08-cb07-41be-a2f7-946426c61fb0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:42.707083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-249cdd08-cb07-41be-a2f7-946426c61fb0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:42.707699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-249cdd08-cb07-41be-a2f7-946426c61fb0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:42.708307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-249cdd08-cb07-41be-a2f7-946426c61fb0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:42.709227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-249cdd08-cb07-41be-a2f7-946426c61fb0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:42.709684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-249cdd08-cb07-41be-a2f7-946426c61fb0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:42.710111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-249cdd08-cb07-41be-a2f7-946426c61fb0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:42.751570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:42.983161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-249cdd08-cb07-41be-a2f7-946426c61fb0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:42.992577 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-249cdd08-cb07-41be-a2f7-946426c61fb0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1314 microversion: 2.1 time: 0.298499 Sep 10 10:43:42.995041 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1286/1792] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:42 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:43.000581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eea91876-3e0f-4adc-a925-362f3c3424fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:43.001230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eea91876-3e0f-4adc-a925-362f3c3424fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:43.008920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea91876-3e0f-4adc-a925-362f3c3424fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:43.009698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea91876-3e0f-4adc-a925-362f3c3424fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:43.010154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea91876-3e0f-4adc-a925-362f3c3424fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:43.010843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea91876-3e0f-4adc-a925-362f3c3424fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:43.011304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea91876-3e0f-4adc-a925-362f3c3424fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:43.011761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea91876-3e0f-4adc-a925-362f3c3424fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:43.168511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eea91876-3e0f-4adc-a925-362f3c3424fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:43.182909 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eea91876-3e0f-4adc-a925-362f3c3424fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.187014 Sep 10 10:43:43.184869 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1287/1793] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:42 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:43.205883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ae8e9f50-08d6-4f3d-8d60-f8fb0cda1426 req-41ed2f76-d4d5-40d8-903f-d1826f80fa10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e93b86a-4f96-4e67-8d62-bc190286a2f9", "tag": "cc11e812-1e24-4e7c-8919-bcc89ad1958c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:43.218464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae8e9f50-08d6-4f3d-8d60-f8fb0cda1426 req-41ed2f76-d4d5-40d8-903f-d1826f80fa10 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:43.219207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae8e9f50-08d6-4f3d-8d60-f8fb0cda1426 req-41ed2f76-d4d5-40d8-903f-d1826f80fa10 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:43.219584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae8e9f50-08d6-4f3d-8d60-f8fb0cda1426 req-41ed2f76-d4d5-40d8-903f-d1826f80fa10 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:43.232541 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ae8e9f50-08d6-4f3d-8d60-f8fb0cda1426 req-41ed2f76-d4d5-40d8-903f-d1826f80fa10 service nova] Creating event network-changed:cc11e812-1e24-4e7c-8919-bcc89ad1958c for instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 on n-h2-856894-1 Sep 10 10:43:43.238000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ae8e9f50-08d6-4f3d-8d60-f8fb0cda1426 req-41ed2f76-d4d5-40d8-903f-d1826f80fa10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047735 Sep 10 10:43:43.238941 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1288/1794] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:43.245411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a7cdcd8b-0d5e-42e0-863c-f8d8df791e1c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:43.246582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a7cdcd8b-0d5e-42e0-863c-f8d8df791e1c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:43.249203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:43.256432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7cdcd8b-0d5e-42e0-863c-f8d8df791e1c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:43.256977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7cdcd8b-0d5e-42e0-863c-f8d8df791e1c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:43.258117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7cdcd8b-0d5e-42e0-863c-f8d8df791e1c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:43.261013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7cdcd8b-0d5e-42e0-863c-f8d8df791e1c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:43.261535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7cdcd8b-0d5e-42e0-863c-f8d8df791e1c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:43.262501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7cdcd8b-0d5e-42e0-863c-f8d8df791e1c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:43.359769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a7cdcd8b-0d5e-42e0-863c-f8d8df791e1c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:43.368502 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a7cdcd8b-0d5e-42e0-863c-f8d8df791e1c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1211 microversion: 2.1 time: 0.128140 Sep 10 10:43:43.369862 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1289/1795] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:43 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1211 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:43.374638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-924c46ac-ba5d-4ce1-82f2-3bd93fa614dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:43.375445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-924c46ac-ba5d-4ce1-82f2-3bd93fa614dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:43.381632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-924c46ac-ba5d-4ce1-82f2-3bd93fa614dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:43.382311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-924c46ac-ba5d-4ce1-82f2-3bd93fa614dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:43.382926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-924c46ac-ba5d-4ce1-82f2-3bd93fa614dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:43.384597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-924c46ac-ba5d-4ce1-82f2-3bd93fa614dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:43.385248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-924c46ac-ba5d-4ce1-82f2-3bd93fa614dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:43.385832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-924c46ac-ba5d-4ce1-82f2-3bd93fa614dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:43.623236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-924c46ac-ba5d-4ce1-82f2-3bd93fa614dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:43.632977 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-924c46ac-ba5d-4ce1-82f2-3bd93fa614dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1322 microversion: 2.1 time: 0.261901 Sep 10 10:43:43.633614 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1290/1796] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:43 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:43.639035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eec00460-7eb6-4c82-82f4-8888d985276c tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Calling method '.version_select at 0x7efcaf1014c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:43.693825 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eec00460-7eb6-4c82-82f4-8888d985276c tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-346098923" status: 202 len: 0 microversion: 2.1 time: 0.058417 Sep 10 10:43:43.695714 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1291/1797] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Sep 10 10:43:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-346098923 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:43:43.704461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07efc9cc-353f-4eab-ad92-c9700491dded tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:43.705516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07efc9cc-353f-4eab-ad92-c9700491dded tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:43.719272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07efc9cc-353f-4eab-ad92-c9700491dded tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:43.723698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07efc9cc-353f-4eab-ad92-c9700491dded tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:43.725637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07efc9cc-353f-4eab-ad92-c9700491dded tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:43.726649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07efc9cc-353f-4eab-ad92-c9700491dded tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:43.728656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07efc9cc-353f-4eab-ad92-c9700491dded tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:43.729678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07efc9cc-353f-4eab-ad92-c9700491dded tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:44.253784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-07efc9cc-353f-4eab-ad92-c9700491dded tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:44.274419 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07efc9cc-353f-4eab-ad92-c9700491dded tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1312 microversion: 2.1 time: 0.576949 Sep 10 10:43:44.276746 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1292/1798] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:43 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1312 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:44.281891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ba15f824-4dfd-47e8-8e97-7a806a80c569 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Action: 'create', calling method: .version_select at 0x7efcaf1011f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-61396690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxaUmOCjjrxY5CUJvC90cIm6YIcmxPESR7WNSGzygl4V3aLNTfphrKhoQ0vksI4rPdGRHzIHhLgMMc7QN2lNcnu6AeEdWYY0I+UA21ausQk0PUGMAe0rlv1UH6sQs0iWg=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:44.333688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=51 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:44.345119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ba15f824-4dfd-47e8-8e97-7a806a80c569 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:44.357007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ba15f824-4dfd-47e8-8e97-7a806a80c569 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for user 7ba97c27347349dbac71f4e956a1c2b6 and project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:44.422190 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ba15f824-4dfd-47e8-8e97-7a806a80c569 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.143321 Sep 10 10:43:44.431571 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1293/1799] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:43:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:44.452601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60f29666-5497-4e27-9a94-367b19edc03a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:44.456395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60f29666-5497-4e27-9a94-367b19edc03a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:44.469227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f29666-5497-4e27-9a94-367b19edc03a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:44.469911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f29666-5497-4e27-9a94-367b19edc03a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:44.470500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f29666-5497-4e27-9a94-367b19edc03a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:44.471626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f29666-5497-4e27-9a94-367b19edc03a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:44.472634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f29666-5497-4e27-9a94-367b19edc03a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:44.473237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f29666-5497-4e27-9a94-367b19edc03a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:44.725651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60f29666-5497-4e27-9a94-367b19edc03a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:44.737024 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60f29666-5497-4e27-9a94-367b19edc03a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1500 microversion: 2.1 time: 0.302948 Sep 10 10:43:44.737950 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1294/1800] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:44 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1500 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:44.742748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27ba6b40-cd74-4e2b-af9c-16278fc76a0b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:44.743560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-27ba6b40-cd74-4e2b-af9c-16278fc76a0b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:44.749760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ba6b40-cd74-4e2b-af9c-16278fc76a0b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:44.750439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ba6b40-cd74-4e2b-af9c-16278fc76a0b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:44.750878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ba6b40-cd74-4e2b-af9c-16278fc76a0b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:44.751567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ba6b40-cd74-4e2b-af9c-16278fc76a0b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:44.752016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ba6b40-cd74-4e2b-af9c-16278fc76a0b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:44.752441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27ba6b40-cd74-4e2b-af9c-16278fc76a0b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:44.995077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-27ba6b40-cd74-4e2b-af9c-16278fc76a0b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:45.003663 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27ba6b40-cd74-4e2b-af9c-16278fc76a0b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.264480 Sep 10 10:43:45.007331 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1295/1801] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:44 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:45.014087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-648288ff-b154-4a6f-9149-c0df5ff77765 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:45.014940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-648288ff-b154-4a6f-9149-c0df5ff77765 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:45.028457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-648288ff-b154-4a6f-9149-c0df5ff77765 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.028975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-648288ff-b154-4a6f-9149-c0df5ff77765 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.029579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-648288ff-b154-4a6f-9149-c0df5ff77765 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.030312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-648288ff-b154-4a6f-9149-c0df5ff77765 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.030762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-648288ff-b154-4a6f-9149-c0df5ff77765 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.031190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-648288ff-b154-4a6f-9149-c0df5ff77765 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.111642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-648288ff-b154-4a6f-9149-c0df5ff77765 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:45.119920 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-648288ff-b154-4a6f-9149-c0df5ff77765 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1259 microversion: 2.1 time: 0.111445 Sep 10 10:43:45.120735 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1296/1802] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:45 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1259 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:45.126475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1d1eea3-73af-469b-9b47-e8693d75b7f8 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Action: 'create', calling method: .version_select at 0x7efcae300b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-583176425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ0MlIZG8IXsTL16L/KgbjXFM0HWzm+M/jzqhuWuqCaZLiBXeoeBEPSm0oZ31dNl9zLYpGFSbQw74/dSI2YlFYxDLAEp4qu9cYydMwVTnpeStOOAbDsh64+gfmuEGiVjA=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:45.145530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-c1d1eea3-73af-469b-9b47-e8693d75b7f8 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:45.153156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-c1d1eea3-73af-469b-9b47-e8693d75b7f8 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for user 7ba97c27347349dbac71f4e956a1c2b6 and project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:45.179495 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1d1eea3-73af-469b-9b47-e8693d75b7f8 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.056686 Sep 10 10:43:45.180289 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1297/1803] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:43:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:45.189089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-63f6f414-7b3d-4710-841b-419023510069 req-7171c053-c4ed-465c-9afc-d8a97f27da30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf615daa-1aa8-4756-8b54-041304199609", "name": "network-vif-plugged", "status": "completed", "tag": "847262ac-e422-4b62-87d1-33447a795418"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:45.198195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-63f6f414-7b3d-4710-841b-419023510069 req-7171c053-c4ed-465c-9afc-d8a97f27da30 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.198871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-63f6f414-7b3d-4710-841b-419023510069 req-7171c053-c4ed-465c-9afc-d8a97f27da30 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.200613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-63f6f414-7b3d-4710-841b-419023510069 req-7171c053-c4ed-465c-9afc-d8a97f27da30 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.213645 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-63f6f414-7b3d-4710-841b-419023510069 req-7171c053-c4ed-465c-9afc-d8a97f27da30 service nova] Creating event network-vif-plugged:847262ac-e422-4b62-87d1-33447a795418 for instance bf615daa-1aa8-4756-8b54-041304199609 on n-h2-856894-1 Sep 10 10:43:45.219716 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-63f6f414-7b3d-4710-841b-419023510069 req-7171c053-c4ed-465c-9afc-d8a97f27da30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037855 Sep 10 10:43:45.221009 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1298/1804] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:45.226967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0780c540-cf73-4cd6-aaf4-b5b9e83af396 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:45.227670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0780c540-cf73-4cd6-aaf4-b5b9e83af396 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:45.234682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0780c540-cf73-4cd6-aaf4-b5b9e83af396 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.235177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0780c540-cf73-4cd6-aaf4-b5b9e83af396 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.235612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0780c540-cf73-4cd6-aaf4-b5b9e83af396 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.237208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0780c540-cf73-4cd6-aaf4-b5b9e83af396 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.237677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0780c540-cf73-4cd6-aaf4-b5b9e83af396 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.238092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0780c540-cf73-4cd6-aaf4-b5b9e83af396 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.385493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0780c540-cf73-4cd6-aaf4-b5b9e83af396 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:45.398989 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0780c540-cf73-4cd6-aaf4-b5b9e83af396 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1322 microversion: 2.1 time: 0.173547 Sep 10 10:43:45.399740 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1299/1805] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:45 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:45.407025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5c3a674-1257-4108-ac88-e0b272ab9ef5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:45.407785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e5c3a674-1257-4108-ac88-e0b272ab9ef5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:45.417210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c3a674-1257-4108-ac88-e0b272ab9ef5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.417785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c3a674-1257-4108-ac88-e0b272ab9ef5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.418346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c3a674-1257-4108-ac88-e0b272ab9ef5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.419462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c3a674-1257-4108-ac88-e0b272ab9ef5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.420018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c3a674-1257-4108-ac88-e0b272ab9ef5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.420456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c3a674-1257-4108-ac88-e0b272ab9ef5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.506095 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e5c3a674-1257-4108-ac88-e0b272ab9ef5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7/action" status: 202 len: 0 microversion: 2.1 time: 0.105052 Sep 10 10:43:45.506738 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1300/1806] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:43:45 2022] POST /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:43:45.515815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-91fbb4a2-46a2-4da2-926d-f2f925279fa6 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Action: 'create', calling method: .version_select at 0x7efcaee0f0d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-816665694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaxgm8mh7HNqbARKJ23D60GVIXrDM8J7FyHoBnGjI1xb2RCm3M6Wd17LfgAMylThmLKbuPZ0C8S3QpAEJdeSnIdnzW4Ks18L3jXMEhC2nGoZtmHwrPV8AeX82daKiXksw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:45.535997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-91fbb4a2-46a2-4da2-926d-f2f925279fa6 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:45.541621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-91fbb4a2-46a2-4da2-926d-f2f925279fa6 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Getting quotas for user 7ba97c27347349dbac71f4e956a1c2b6 and project 6e97965ade8a4bcfa77586eda77bed81. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:45.573860 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-91fbb4a2-46a2-4da2-926d-f2f925279fa6 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.065462 Sep 10 10:43:45.575122 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1301/1807] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:43:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:45.585411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7ab873a2-a960-4ce0-9b16-b0cefbff851b req-eb026581-8365-42a6-aef8-18ae36f8cdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b22547-e130-45f7-8f9c-fb57446ab4c7", "name": "network-vif-deleted", "tag": "9b3e5283-8ed5-4225-8495-f8cb4bf41ad3"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:45.599476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ab873a2-a960-4ce0-9b16-b0cefbff851b req-eb026581-8365-42a6-aef8-18ae36f8cdb9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.599954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ab873a2-a960-4ce0-9b16-b0cefbff851b req-eb026581-8365-42a6-aef8-18ae36f8cdb9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.600427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ab873a2-a960-4ce0-9b16-b0cefbff851b req-eb026581-8365-42a6-aef8-18ae36f8cdb9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.613378 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7ab873a2-a960-4ce0-9b16-b0cefbff851b req-eb026581-8365-42a6-aef8-18ae36f8cdb9 service nova] Creating event network-vif-deleted:9b3e5283-8ed5-4225-8495-f8cb4bf41ad3 for instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 on n-h2-856894-1 Sep 10 10:43:45.618739 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7ab873a2-a960-4ce0-9b16-b0cefbff851b req-eb026581-8365-42a6-aef8-18ae36f8cdb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042515 Sep 10 10:43:45.619479 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1302/1808] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:45.627635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a5aeadc-df3f-4825-97b3-b561f10d8ee8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:45.628346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a5aeadc-df3f-4825-97b3-b561f10d8ee8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:45.637753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a5aeadc-df3f-4825-97b3-b561f10d8ee8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.638249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a5aeadc-df3f-4825-97b3-b561f10d8ee8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.638686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a5aeadc-df3f-4825-97b3-b561f10d8ee8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.639393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a5aeadc-df3f-4825-97b3-b561f10d8ee8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.639840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a5aeadc-df3f-4825-97b3-b561f10d8ee8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.640273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a5aeadc-df3f-4825-97b3-b561f10d8ee8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.911185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a5aeadc-df3f-4825-97b3-b561f10d8ee8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:45.921188 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a5aeadc-df3f-4825-97b3-b561f10d8ee8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1312 microversion: 2.1 time: 0.297476 Sep 10 10:43:45.922074 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1303/1809] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:45 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1312 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:45.927004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c14a513c-de97-41fb-9888-598cf821549b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:45.927848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c14a513c-de97-41fb-9888-598cf821549b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:45.934371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14a513c-de97-41fb-9888-598cf821549b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.935117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14a513c-de97-41fb-9888-598cf821549b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.935800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14a513c-de97-41fb-9888-598cf821549b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:45.936712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14a513c-de97-41fb-9888-598cf821549b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:45.937198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14a513c-de97-41fb-9888-598cf821549b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:45.937925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14a513c-de97-41fb-9888-598cf821549b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:46.337333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c14a513c-de97-41fb-9888-598cf821549b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:46.351720 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c14a513c-de97-41fb-9888-598cf821549b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1505 microversion: 2.1 time: 0.428326 Sep 10 10:43:46.371154 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1304/1810] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:45 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:46.396808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f91a036-deb3-4555-b9e9-bdf76568e0e9 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Calling method '.version_select at 0x7efcaefdeee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:46.425963 n-d-856894-1 devstack@n-api.service[128788]: WARNING oslo_db.sqlalchemy.utils [None req-0f91a036-deb3-4555-b9e9-bdf76568e0e9 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 10:43:46.455279 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f91a036-deb3-4555-b9e9-bdf76568e0e9 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1090 microversion: 2.1 time: 0.076228 Sep 10 10:43:46.464716 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1305/1811] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:43:46 2022] GET /compute/v2.1/os-keypairs => generated 1090 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:46.473065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfd9518a-fdad-407e-a97c-1119376e00dd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:46.473876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfd9518a-fdad-407e-a97c-1119376e00dd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:46.481805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd9518a-fdad-407e-a97c-1119376e00dd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:46.482821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd9518a-fdad-407e-a97c-1119376e00dd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:46.483570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd9518a-fdad-407e-a97c-1119376e00dd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:46.484584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd9518a-fdad-407e-a97c-1119376e00dd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:46.485971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd9518a-fdad-407e-a97c-1119376e00dd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:46.486957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd9518a-fdad-407e-a97c-1119376e00dd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:47.188818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfd9518a-fdad-407e-a97c-1119376e00dd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:47.206352 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfd9518a-fdad-407e-a97c-1119376e00dd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.738318 Sep 10 10:43:47.209474 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1306/1812] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:46 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:47.219626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6a1fa752-233a-4bbd-8631-bf8cf396dbb7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:47.220994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6a1fa752-233a-4bbd-8631-bf8cf396dbb7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:47.249092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a1fa752-233a-4bbd-8631-bf8cf396dbb7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:47.251090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a1fa752-233a-4bbd-8631-bf8cf396dbb7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:47.251700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a1fa752-233a-4bbd-8631-bf8cf396dbb7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:47.252595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a1fa752-233a-4bbd-8631-bf8cf396dbb7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:47.253980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a1fa752-233a-4bbd-8631-bf8cf396dbb7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:47.254612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a1fa752-233a-4bbd-8631-bf8cf396dbb7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:47.504808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6a1fa752-233a-4bbd-8631-bf8cf396dbb7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:47.513916 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6a1fa752-233a-4bbd-8631-bf8cf396dbb7 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1307 microversion: 2.1 time: 0.301392 Sep 10 10:43:47.519354 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1307/1813] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:47 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:47.535917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26621ce0-2252-4d88-9e8b-906acf00a1d6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:47.546702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26621ce0-2252-4d88-9e8b-906acf00a1d6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:47.554769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26621ce0-2252-4d88-9e8b-906acf00a1d6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:47.555273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26621ce0-2252-4d88-9e8b-906acf00a1d6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:47.562059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26621ce0-2252-4d88-9e8b-906acf00a1d6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:47.563562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26621ce0-2252-4d88-9e8b-906acf00a1d6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:47.564441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26621ce0-2252-4d88-9e8b-906acf00a1d6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:47.565047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26621ce0-2252-4d88-9e8b-906acf00a1d6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:47.970179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-26621ce0-2252-4d88-9e8b-906acf00a1d6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:47.980120 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26621ce0-2252-4d88-9e8b-906acf00a1d6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1322 microversion: 2.1 time: 0.450151 Sep 10 10:43:47.981528 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1308/1814] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:47 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:48.001494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e49ccf96-f4ca-40b6-af70-7decc52caeae tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Calling method '.version_select at 0x7efcaf1014c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:48.037146 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e49ccf96-f4ca-40b6-af70-7decc52caeae tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-816665694" status: 202 len: 0 microversion: 2.1 time: 0.054200 Sep 10 10:43:48.038159 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1309/1815] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:43:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-816665694 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:43:48.044700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c560c16b-b3bc-4f94-b9dd-e7ab01913cac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:48.045889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c560c16b-b3bc-4f94-b9dd-e7ab01913cac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:48.053616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c560c16b-b3bc-4f94-b9dd-e7ab01913cac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:48.054283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c560c16b-b3bc-4f94-b9dd-e7ab01913cac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:48.054955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c560c16b-b3bc-4f94-b9dd-e7ab01913cac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:48.056278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c560c16b-b3bc-4f94-b9dd-e7ab01913cac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:48.056945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c560c16b-b3bc-4f94-b9dd-e7ab01913cac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:48.057718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c560c16b-b3bc-4f94-b9dd-e7ab01913cac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:48.063225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:48.259569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c560c16b-b3bc-4f94-b9dd-e7ab01913cac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:48.282714 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c560c16b-b3bc-4f94-b9dd-e7ab01913cac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1312 microversion: 2.1 time: 0.243240 Sep 10 10:43:48.285195 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1310/1816] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:48 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:48.290131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b9af399-4b95-4ca9-83e7-37478bd01d00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:48.291033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b9af399-4b95-4ca9-83e7-37478bd01d00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:48.298948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9af399-4b95-4ca9-83e7-37478bd01d00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:48.300334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9af399-4b95-4ca9-83e7-37478bd01d00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:48.312935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9af399-4b95-4ca9-83e7-37478bd01d00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:48.314052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9af399-4b95-4ca9-83e7-37478bd01d00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:48.314619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9af399-4b95-4ca9-83e7-37478bd01d00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:48.315584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9af399-4b95-4ca9-83e7-37478bd01d00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:48.511943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b9af399-4b95-4ca9-83e7-37478bd01d00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:48.520706 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b9af399-4b95-4ca9-83e7-37478bd01d00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1485 microversion: 2.1 time: 0.234234 Sep 10 10:43:48.521351 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1311/1817] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:48 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1485 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:48.527463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-369e54a6-1b17-44f1-933f-10f01ebc7604 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Calling method '.version_select at 0x7efcae8e4ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:48.552798 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-369e54a6-1b17-44f1-933f-10f01ebc7604 tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-583176425" status: 202 len: 0 microversion: 2.1 time: 0.029925 Sep 10 10:43:48.553447 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1312/1818] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:43:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-583176425 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:43:48.565746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cdd09400-e663-4a7f-8849-f979ef494be2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:48.566739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cdd09400-e663-4a7f-8849-f979ef494be2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:48.576620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdd09400-e663-4a7f-8849-f979ef494be2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:48.576620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdd09400-e663-4a7f-8849-f979ef494be2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:48.576620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdd09400-e663-4a7f-8849-f979ef494be2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:48.577189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdd09400-e663-4a7f-8849-f979ef494be2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:48.577707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdd09400-e663-4a7f-8849-f979ef494be2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:48.578141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdd09400-e663-4a7f-8849-f979ef494be2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:48.827721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cdd09400-e663-4a7f-8849-f979ef494be2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:48.837440 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cdd09400-e663-4a7f-8849-f979ef494be2 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.282229 Sep 10 10:43:48.838043 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1313/1819] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:48 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:48.845090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c16be65c-a148-41eb-b972-b8c475b8b580 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:48.845717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c16be65c-a148-41eb-b972-b8c475b8b580 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:48.858213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c16be65c-a148-41eb-b972-b8c475b8b580 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:48.858955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c16be65c-a148-41eb-b972-b8c475b8b580 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:48.859821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c16be65c-a148-41eb-b972-b8c475b8b580 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:48.860687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c16be65c-a148-41eb-b972-b8c475b8b580 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:48.861327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c16be65c-a148-41eb-b972-b8c475b8b580 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:48.861900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c16be65c-a148-41eb-b972-b8c475b8b580 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:49.033855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c16be65c-a148-41eb-b972-b8c475b8b580 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:49.044214 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c16be65c-a148-41eb-b972-b8c475b8b580 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1307 microversion: 2.1 time: 0.203828 Sep 10 10:43:49.045937 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1314/1820] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:48 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1307 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:49.051754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f436e9e5-1c92-449a-92da-0738c104291b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:49.052459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f436e9e5-1c92-449a-92da-0738c104291b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:49.058716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f436e9e5-1c92-449a-92da-0738c104291b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:49.059393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f436e9e5-1c92-449a-92da-0738c104291b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:49.059994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f436e9e5-1c92-449a-92da-0738c104291b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:49.060860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f436e9e5-1c92-449a-92da-0738c104291b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:49.061590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f436e9e5-1c92-449a-92da-0738c104291b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:49.062167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f436e9e5-1c92-449a-92da-0738c104291b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:49.109386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f436e9e5-1c92-449a-92da-0738c104291b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:43:49.293174 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f436e9e5-1c92-449a-92da-0738c104291b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 204 len: 0 microversion: 2.1 time: 0.244087 Sep 10 10:43:49.295722 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1315/1821] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:43:49 2022] DELETE /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:43:49.304630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c52354c-1249-423a-9443-88f06b1c3c9d tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] Calling method '.version_select at 0x7efcaefde700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:49.356619 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c52354c-1249-423a-9443-88f06b1c3c9d tempest-KeyPairsV2TestJSON-1516164039 tempest-KeyPairsV2TestJSON-1516164039-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-61396690" status: 202 len: 0 microversion: 2.1 time: 0.059148 Sep 10 10:43:49.357308 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1316/1822] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:43:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-61396690 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:43:49.376234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7389b6e0-e9bc-415f-bf72-611b1afacce5 req-4c3a4432-230c-4a0f-993f-8760439cc180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c", "tag": "0c509438-2c28-43d2-8814-2f51dec08ea5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:49.390294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:49.399754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7389b6e0-e9bc-415f-bf72-611b1afacce5 req-4c3a4432-230c-4a0f-993f-8760439cc180 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:49.400239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7389b6e0-e9bc-415f-bf72-611b1afacce5 req-4c3a4432-230c-4a0f-993f-8760439cc180 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:49.400663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7389b6e0-e9bc-415f-bf72-611b1afacce5 req-4c3a4432-230c-4a0f-993f-8760439cc180 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:49.419232 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7389b6e0-e9bc-415f-bf72-611b1afacce5 req-4c3a4432-230c-4a0f-993f-8760439cc180 service nova] Creating event network-changed:0c509438-2c28-43d2-8814-2f51dec08ea5 for instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c on n-h2-856894-1 Sep 10 10:43:49.425429 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7389b6e0-e9bc-415f-bf72-611b1afacce5 req-4c3a4432-230c-4a0f-993f-8760439cc180 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066874 Sep 10 10:43:49.427002 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1317/1823] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:49.434414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0aa97efd-ed82-4a79-93f5-17bfbf9fa2b6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:49.435297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0aa97efd-ed82-4a79-93f5-17bfbf9fa2b6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:49.456860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa97efd-ed82-4a79-93f5-17bfbf9fa2b6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:49.457534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa97efd-ed82-4a79-93f5-17bfbf9fa2b6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:49.457972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa97efd-ed82-4a79-93f5-17bfbf9fa2b6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:49.458965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa97efd-ed82-4a79-93f5-17bfbf9fa2b6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:49.459383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa97efd-ed82-4a79-93f5-17bfbf9fa2b6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:49.460026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa97efd-ed82-4a79-93f5-17bfbf9fa2b6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:49.622483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0aa97efd-ed82-4a79-93f5-17bfbf9fa2b6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:49.632248 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0aa97efd-ed82-4a79-93f5-17bfbf9fa2b6 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1516 microversion: 2.1 time: 0.203838 Sep 10 10:43:49.633980 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1318/1824] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:49 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:49.639491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-353a4a01-c484-495c-a080-4dd49dd476c1 req-c80469ee-fe3e-4aca-9825-2eaab0adcbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e93b86a-4f96-4e67-8d62-bc190286a2f9", "name": "network-vif-plugged", "status": "completed", "tag": "cc11e812-1e24-4e7c-8919-bcc89ad1958c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:49.692435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-353a4a01-c484-495c-a080-4dd49dd476c1 req-c80469ee-fe3e-4aca-9825-2eaab0adcbe4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:49.693286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-353a4a01-c484-495c-a080-4dd49dd476c1 req-c80469ee-fe3e-4aca-9825-2eaab0adcbe4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:49.693729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-353a4a01-c484-495c-a080-4dd49dd476c1 req-c80469ee-fe3e-4aca-9825-2eaab0adcbe4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:49.712937 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-353a4a01-c484-495c-a080-4dd49dd476c1 req-c80469ee-fe3e-4aca-9825-2eaab0adcbe4 service nova] Creating event network-vif-plugged:cc11e812-1e24-4e7c-8919-bcc89ad1958c for instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 on n-h2-856894-1 Sep 10 10:43:49.727648 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-353a4a01-c484-495c-a080-4dd49dd476c1 req-c80469ee-fe3e-4aca-9825-2eaab0adcbe4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092446 Sep 10 10:43:49.735444 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1319/1825] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:49.742213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d83fd992-db33-40af-8dff-e920255425fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:49.743720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d83fd992-db33-40af-8dff-e920255425fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:49.753700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d83fd992-db33-40af-8dff-e920255425fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:49.754194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d83fd992-db33-40af-8dff-e920255425fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:49.754647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d83fd992-db33-40af-8dff-e920255425fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:49.756240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d83fd992-db33-40af-8dff-e920255425fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:49.756983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d83fd992-db33-40af-8dff-e920255425fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:49.757636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d83fd992-db33-40af-8dff-e920255425fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:49.936828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d83fd992-db33-40af-8dff-e920255425fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:49.946868 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d83fd992-db33-40af-8dff-e920255425fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1491 microversion: 2.1 time: 0.209332 Sep 10 10:43:49.948193 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1320/1826] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:49 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1491 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:49.954814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71c8248e-42a4-4185-bb5c-ef02adae31ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:49.955704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-71c8248e-42a4-4185-bb5c-ef02adae31ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:49.963105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c8248e-42a4-4185-bb5c-ef02adae31ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:49.964014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c8248e-42a4-4185-bb5c-ef02adae31ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:49.964423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c8248e-42a4-4185-bb5c-ef02adae31ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:49.965273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c8248e-42a4-4185-bb5c-ef02adae31ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:49.965803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c8248e-42a4-4185-bb5c-ef02adae31ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:49.966308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c8248e-42a4-4185-bb5c-ef02adae31ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:50.177519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-71c8248e-42a4-4185-bb5c-ef02adae31ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:50.186312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71c8248e-42a4-4185-bb5c-ef02adae31ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1312 microversion: 2.1 time: 0.236929 Sep 10 10:43:50.186844 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1321/1827] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:49 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1312 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:50.191787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be24d7ea-6e11-41b9-8769-2238ec70cb63 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:50.194575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be24d7ea-6e11-41b9-8769-2238ec70cb63 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:50.202927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be24d7ea-6e11-41b9-8769-2238ec70cb63 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:50.203637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be24d7ea-6e11-41b9-8769-2238ec70cb63 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:50.204559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be24d7ea-6e11-41b9-8769-2238ec70cb63 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:50.205444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be24d7ea-6e11-41b9-8769-2238ec70cb63 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:50.206080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be24d7ea-6e11-41b9-8769-2238ec70cb63 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:50.206679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be24d7ea-6e11-41b9-8769-2238ec70cb63 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:50.237778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-be24d7ea-6e11-41b9-8769-2238ec70cb63 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lazy-loading 'flavor' on Instance uuid bf615daa-1aa8-4756-8b54-041304199609 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:43:50.364805 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be24d7ea-6e11-41b9-8769-2238ec70cb63 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609/action" status: 200 len: 32 microversion: 2.1 time: 0.176668 Sep 10 10:43:50.370040 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1322/1828] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:43:50 2022] POST /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:43:50.371699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c4ddd1d0-8e45-4074-940a-21079d430adf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:50.372405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4ddd1d0-8e45-4074-940a-21079d430adf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:50.379044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4ddd1d0-8e45-4074-940a-21079d430adf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:50.379535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4ddd1d0-8e45-4074-940a-21079d430adf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:50.380040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4ddd1d0-8e45-4074-940a-21079d430adf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:50.380733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4ddd1d0-8e45-4074-940a-21079d430adf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:50.381209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4ddd1d0-8e45-4074-940a-21079d430adf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:50.381632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4ddd1d0-8e45-4074-940a-21079d430adf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:50.625300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c4ddd1d0-8e45-4074-940a-21079d430adf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:50.635266 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c4ddd1d0-8e45-4074-940a-21079d430adf tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.268068 Sep 10 10:43:50.650457 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1323/1829] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:50 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:50.657025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd19d3f7-1054-4aeb-8d88-80fee249034e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:50.657963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd19d3f7-1054-4aeb-8d88-80fee249034e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:50.665327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd19d3f7-1054-4aeb-8d88-80fee249034e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:50.666085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd19d3f7-1054-4aeb-8d88-80fee249034e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:50.666726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd19d3f7-1054-4aeb-8d88-80fee249034e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:50.667578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd19d3f7-1054-4aeb-8d88-80fee249034e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:50.668733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd19d3f7-1054-4aeb-8d88-80fee249034e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:50.669346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd19d3f7-1054-4aeb-8d88-80fee249034e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:50.906560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd19d3f7-1054-4aeb-8d88-80fee249034e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:50.915780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd19d3f7-1054-4aeb-8d88-80fee249034e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1307 microversion: 2.1 time: 0.263985 Sep 10 10:43:50.940002 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1324/1830] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:50 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1307 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:50.952959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f7d7aa2-0700-4029-bfc2-2dc67e17762b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:50.954404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f7d7aa2-0700-4029-bfc2-2dc67e17762b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:50.973162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f7d7aa2-0700-4029-bfc2-2dc67e17762b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:50.973676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f7d7aa2-0700-4029-bfc2-2dc67e17762b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:50.975857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f7d7aa2-0700-4029-bfc2-2dc67e17762b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:50.977325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f7d7aa2-0700-4029-bfc2-2dc67e17762b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:50.977800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f7d7aa2-0700-4029-bfc2-2dc67e17762b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:50.978240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f7d7aa2-0700-4029-bfc2-2dc67e17762b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:51.151618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f7d7aa2-0700-4029-bfc2-2dc67e17762b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:51.165195 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f7d7aa2-0700-4029-bfc2-2dc67e17762b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.222664 Sep 10 10:43:51.165778 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1325/1831] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:50 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:51.170232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c916c6cc-b884-434a-887a-ae19be3aba14 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:51.170833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c916c6cc-b884-434a-887a-ae19be3aba14 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:51.177687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c916c6cc-b884-434a-887a-ae19be3aba14 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:51.178177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c916c6cc-b884-434a-887a-ae19be3aba14 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:51.178614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c916c6cc-b884-434a-887a-ae19be3aba14 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:51.179466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c916c6cc-b884-434a-887a-ae19be3aba14 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:51.179921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c916c6cc-b884-434a-887a-ae19be3aba14 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:51.180339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c916c6cc-b884-434a-887a-ae19be3aba14 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:51.203746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:51.365728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c916c6cc-b884-434a-887a-ae19be3aba14 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:51.377486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c916c6cc-b884-434a-887a-ae19be3aba14 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1491 microversion: 2.1 time: 0.210513 Sep 10 10:43:51.378418 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1326/1832] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:51 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1491 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:51.384891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de04a7d8-7ed1-4f7a-afb2-baf25c5286e5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:51.389779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de04a7d8-7ed1-4f7a-afb2-baf25c5286e5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:51.401136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de04a7d8-7ed1-4f7a-afb2-baf25c5286e5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:51.401800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de04a7d8-7ed1-4f7a-afb2-baf25c5286e5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:51.403022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de04a7d8-7ed1-4f7a-afb2-baf25c5286e5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:51.403818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de04a7d8-7ed1-4f7a-afb2-baf25c5286e5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:51.404739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de04a7d8-7ed1-4f7a-afb2-baf25c5286e5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:51.406618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de04a7d8-7ed1-4f7a-afb2-baf25c5286e5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:51.568143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-de04a7d8-7ed1-4f7a-afb2-baf25c5286e5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:51.580841 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de04a7d8-7ed1-4f7a-afb2-baf25c5286e5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1312 microversion: 2.1 time: 0.201246 Sep 10 10:43:51.582565 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1327/1833] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:51 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:51.659592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-817f376e-1186-4b89-8063-4354d6d61976 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:51.660240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-817f376e-1186-4b89-8063-4354d6d61976 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:51.666575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-817f376e-1186-4b89-8063-4354d6d61976 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:51.667072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-817f376e-1186-4b89-8063-4354d6d61976 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:51.667515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-817f376e-1186-4b89-8063-4354d6d61976 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:51.668752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-817f376e-1186-4b89-8063-4354d6d61976 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:51.669247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-817f376e-1186-4b89-8063-4354d6d61976 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:51.669675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-817f376e-1186-4b89-8063-4354d6d61976 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:51.829941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-817f376e-1186-4b89-8063-4354d6d61976 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:51.840340 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-817f376e-1186-4b89-8063-4354d6d61976 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.183974 Sep 10 10:43:51.841597 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1328/1834] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:51 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:43:51.939436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd18eb98-d0b3-4966-ad48-51790d21b1ec tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:51.940137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd18eb98-d0b3-4966-ad48-51790d21b1ec tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:51.947603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd18eb98-d0b3-4966-ad48-51790d21b1ec tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:51.948183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd18eb98-d0b3-4966-ad48-51790d21b1ec tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:51.948687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd18eb98-d0b3-4966-ad48-51790d21b1ec tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:51.949528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd18eb98-d0b3-4966-ad48-51790d21b1ec tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:51.950056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd18eb98-d0b3-4966-ad48-51790d21b1ec tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:51.950549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd18eb98-d0b3-4966-ad48-51790d21b1ec tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:52.270552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:52.415588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd18eb98-d0b3-4966-ad48-51790d21b1ec tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:52.436170 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd18eb98-d0b3-4966-ad48-51790d21b1ec tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1307 microversion: 2.1 time: 0.502213 Sep 10 10:43:52.438034 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1329/1835] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:51 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1307 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:52.490010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c777954d-532d-4b2b-975f-0a29f898320b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:52.490707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c777954d-532d-4b2b-975f-0a29f898320b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:52.512552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c777954d-532d-4b2b-975f-0a29f898320b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:52.518244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c777954d-532d-4b2b-975f-0a29f898320b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:52.519243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c777954d-532d-4b2b-975f-0a29f898320b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:52.521228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c777954d-532d-4b2b-975f-0a29f898320b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:52.522054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c777954d-532d-4b2b-975f-0a29f898320b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:52.523277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c777954d-532d-4b2b-975f-0a29f898320b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:52.853472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c777954d-532d-4b2b-975f-0a29f898320b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:52.873396 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c777954d-532d-4b2b-975f-0a29f898320b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.429341 Sep 10 10:43:52.878511 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1330/1836] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:52 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:52.890816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-03970c16-340d-47ce-ba57-d3488fe476fe tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:52.891663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-03970c16-340d-47ce-ba57-d3488fe476fe tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:52.906568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03970c16-340d-47ce-ba57-d3488fe476fe tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:52.907080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03970c16-340d-47ce-ba57-d3488fe476fe tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:52.907548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03970c16-340d-47ce-ba57-d3488fe476fe tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:52.908568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03970c16-340d-47ce-ba57-d3488fe476fe tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:52.909192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03970c16-340d-47ce-ba57-d3488fe476fe tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:52.915527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03970c16-340d-47ce-ba57-d3488fe476fe tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:53.216943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-03970c16-340d-47ce-ba57-d3488fe476fe tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:53.229143 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-03970c16-340d-47ce-ba57-d3488fe476fe tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1449 microversion: 2.1 time: 0.349394 Sep 10 10:43:53.229732 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1331/1837] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:52 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1449 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:53.234428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15f88040-d4b2-4253-b6e1-2157945db5a7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:53.235049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15f88040-d4b2-4253-b6e1-2157945db5a7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:53.261032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f88040-d4b2-4253-b6e1-2157945db5a7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:53.262077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f88040-d4b2-4253-b6e1-2157945db5a7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:53.262786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f88040-d4b2-4253-b6e1-2157945db5a7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:53.263635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f88040-d4b2-4253-b6e1-2157945db5a7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:53.264239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f88040-d4b2-4253-b6e1-2157945db5a7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:53.264810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f88040-d4b2-4253-b6e1-2157945db5a7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:53.616761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15f88040-d4b2-4253-b6e1-2157945db5a7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:53.632059 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15f88040-d4b2-4253-b6e1-2157945db5a7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1312 microversion: 2.1 time: 0.401209 Sep 10 10:43:53.632627 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1332/1838] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:53 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1312 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:53.644377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42e4521e-700d-4b07-a7c2-f6caa5a7db29 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:53.645218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42e4521e-700d-4b07-a7c2-f6caa5a7db29 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:53.652704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42e4521e-700d-4b07-a7c2-f6caa5a7db29 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:53.653553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42e4521e-700d-4b07-a7c2-f6caa5a7db29 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:53.654328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42e4521e-700d-4b07-a7c2-f6caa5a7db29 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:53.655350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42e4521e-700d-4b07-a7c2-f6caa5a7db29 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:53.656020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42e4521e-700d-4b07-a7c2-f6caa5a7db29 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:53.656590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42e4521e-700d-4b07-a7c2-f6caa5a7db29 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:53.734491 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:43:53.735154 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:43:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 10:43:53.774757 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:43:53.775176 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:43:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 10:43:53.934969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-42e4521e-700d-4b07-a7c2-f6caa5a7db29 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:53.944781 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42e4521e-700d-4b07-a7c2-f6caa5a7db29 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.310461 Sep 10 10:43:53.946758 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1333/1839] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:53 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:53.953703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6fd8df00-b55a-47bc-995b-31320dfcc43f req-f0565c8f-0234-48cc-aae1-0aa9f3f44fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8542d6bf-4373-44a8-9ffe-46f8e25a0ed7", "name": "network-vif-deleted", "tag": "5acf41f0-9a08-4e65-b9df-83ff9815cf7f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:53.966052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6fd8df00-b55a-47bc-995b-31320dfcc43f req-f0565c8f-0234-48cc-aae1-0aa9f3f44fcd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:53.966818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6fd8df00-b55a-47bc-995b-31320dfcc43f req-f0565c8f-0234-48cc-aae1-0aa9f3f44fcd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:53.967571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6fd8df00-b55a-47bc-995b-31320dfcc43f req-f0565c8f-0234-48cc-aae1-0aa9f3f44fcd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:53.986869 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6fd8df00-b55a-47bc-995b-31320dfcc43f req-f0565c8f-0234-48cc-aae1-0aa9f3f44fcd service nova] Creating event network-vif-deleted:5acf41f0-9a08-4e65-b9df-83ff9815cf7f for instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 on n-h2-856894-1 Sep 10 10:43:53.994245 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6fd8df00-b55a-47bc-995b-31320dfcc43f req-f0565c8f-0234-48cc-aae1-0aa9f3f44fcd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045670 Sep 10 10:43:53.995262 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1334/1840] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:54.001873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c29bbc97-5609-4ffa-81f3-982b4ca2637c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:54.004022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c29bbc97-5609-4ffa-81f3-982b4ca2637c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:54.012524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29bbc97-5609-4ffa-81f3-982b4ca2637c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:54.013342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29bbc97-5609-4ffa-81f3-982b4ca2637c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:54.014311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29bbc97-5609-4ffa-81f3-982b4ca2637c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:54.015582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29bbc97-5609-4ffa-81f3-982b4ca2637c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:54.016394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29bbc97-5609-4ffa-81f3-982b4ca2637c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:54.026713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c29bbc97-5609-4ffa-81f3-982b4ca2637c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:54.293912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c29bbc97-5609-4ffa-81f3-982b4ca2637c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:54.302906 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c29bbc97-5609-4ffa-81f3-982b4ca2637c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1307 microversion: 2.1 time: 0.306046 Sep 10 10:43:54.309693 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1335/1841] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:53 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1307 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:54.319720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f72c1fb-9182-4429-a2e1-de8de169a366 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:54.322987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f72c1fb-9182-4429-a2e1-de8de169a366 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:54.343259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f72c1fb-9182-4429-a2e1-de8de169a366 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:54.344098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f72c1fb-9182-4429-a2e1-de8de169a366 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:54.344768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f72c1fb-9182-4429-a2e1-de8de169a366 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:54.345721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f72c1fb-9182-4429-a2e1-de8de169a366 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:54.346418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f72c1fb-9182-4429-a2e1-de8de169a366 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:54.347045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f72c1fb-9182-4429-a2e1-de8de169a366 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:54.525492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f72c1fb-9182-4429-a2e1-de8de169a366 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:54.554349 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f72c1fb-9182-4429-a2e1-de8de169a366 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.243344 Sep 10 10:43:54.569318 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1336/1842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:54 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:54.580202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:54.581970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:54.590209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:54.590876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:54.591595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:54.593472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:54.594178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:54.594854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:54.647112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:54.649265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:54.650075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:54.650814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lazy-loading 'fault' on Instance uuid 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:43:54.768676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:54.781306 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-edaee7ba-d80d-4466-9696-54af1583c49e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 200 len: 1304 microversion: 2.1 time: 0.208738 Sep 10 10:43:54.781982 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1337/1843] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:54 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 1304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:54.807733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21d352b6-0cb5-4b33-8ae2-626bd5ec3b2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:54.808869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21d352b6-0cb5-4b33-8ae2-626bd5ec3b2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:54.825858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21d352b6-0cb5-4b33-8ae2-626bd5ec3b2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:54.829425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21d352b6-0cb5-4b33-8ae2-626bd5ec3b2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:54.829959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21d352b6-0cb5-4b33-8ae2-626bd5ec3b2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:54.830707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21d352b6-0cb5-4b33-8ae2-626bd5ec3b2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:54.831233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21d352b6-0cb5-4b33-8ae2-626bd5ec3b2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:54.831671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21d352b6-0cb5-4b33-8ae2-626bd5ec3b2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:55.088277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21d352b6-0cb5-4b33-8ae2-626bd5ec3b2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:55.098135 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21d352b6-0cb5-4b33-8ae2-626bd5ec3b2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1461 microversion: 2.1 time: 0.302995 Sep 10 10:43:55.113096 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1338/1844] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:54 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1461 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:55.113096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3e579b5b-dcab-4be6-b67d-68e153f37e17 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:55.113096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3e579b5b-dcab-4be6-b67d-68e153f37e17 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:55.113659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e579b5b-dcab-4be6-b67d-68e153f37e17 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:55.114362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e579b5b-dcab-4be6-b67d-68e153f37e17 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:55.114914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e579b5b-dcab-4be6-b67d-68e153f37e17 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:55.115647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e579b5b-dcab-4be6-b67d-68e153f37e17 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:55.118169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e579b5b-dcab-4be6-b67d-68e153f37e17 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:55.118169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e579b5b-dcab-4be6-b67d-68e153f37e17 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:55.366451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e579b5b-dcab-4be6-b67d-68e153f37e17 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:55.386729 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3e579b5b-dcab-4be6-b67d-68e153f37e17 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.283934 Sep 10 10:43:55.387851 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1339/1845] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:55 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:55.554375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=11 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:55.808013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f6fc51b-6870-477a-900c-ba8a74391f4b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:55.809234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f6fc51b-6870-477a-900c-ba8a74391f4b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:55.817386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f6fc51b-6870-477a-900c-ba8a74391f4b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:55.818154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f6fc51b-6870-477a-900c-ba8a74391f4b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:55.818653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f6fc51b-6870-477a-900c-ba8a74391f4b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:55.819925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f6fc51b-6870-477a-900c-ba8a74391f4b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:55.820568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f6fc51b-6870-477a-900c-ba8a74391f4b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:55.821043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f6fc51b-6870-477a-900c-ba8a74391f4b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:56.130932 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f6fc51b-6870-477a-900c-ba8a74391f4b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1612 microversion: 2.1 time: 0.740036 Sep 10 10:43:56.131578 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1340/1846] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:55 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1612 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:56.137753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c99bc79-3aac-48d7-8664-fa3da721ec8f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:56.138380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c99bc79-3aac-48d7-8664-fa3da721ec8f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:56.144602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c99bc79-3aac-48d7-8664-fa3da721ec8f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:56.145350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c99bc79-3aac-48d7-8664-fa3da721ec8f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:56.145639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c99bc79-3aac-48d7-8664-fa3da721ec8f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:56.146514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c99bc79-3aac-48d7-8664-fa3da721ec8f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:56.147009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c99bc79-3aac-48d7-8664-fa3da721ec8f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:56.147440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c99bc79-3aac-48d7-8664-fa3da721ec8f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:56.574865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3c99bc79-3aac-48d7-8664-fa3da721ec8f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:56.592315 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c99bc79-3aac-48d7-8664-fa3da721ec8f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1307 microversion: 2.1 time: 0.459591 Sep 10 10:43:56.596528 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1341/1847] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:56 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1307 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:56.617854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-35cddbd4-cc17-4b30-b2d3-4eb3e0094b7d req-4313f0d4-7af8-4d66-8c2b-59cbfc246748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c", "name": "network-vif-plugged", "status": "completed", "tag": "0c509438-2c28-43d2-8814-2f51dec08ea5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:56.646165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-35cddbd4-cc17-4b30-b2d3-4eb3e0094b7d req-4313f0d4-7af8-4d66-8c2b-59cbfc246748 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:56.647366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-35cddbd4-cc17-4b30-b2d3-4eb3e0094b7d req-4313f0d4-7af8-4d66-8c2b-59cbfc246748 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:56.651316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-35cddbd4-cc17-4b30-b2d3-4eb3e0094b7d req-4313f0d4-7af8-4d66-8c2b-59cbfc246748 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:56.684245 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-35cddbd4-cc17-4b30-b2d3-4eb3e0094b7d req-4313f0d4-7af8-4d66-8c2b-59cbfc246748 service nova] Creating event network-vif-plugged:0c509438-2c28-43d2-8814-2f51dec08ea5 for instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c on n-h2-856894-1 Sep 10 10:43:56.705918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-35cddbd4-cc17-4b30-b2d3-4eb3e0094b7d req-4313f0d4-7af8-4d66-8c2b-59cbfc246748 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104810 Sep 10 10:43:56.708623 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1342/1848] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:43:56.724787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26f406b1-ae05-430b-a8b2-27ddc91bfacd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:56.726883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26f406b1-ae05-430b-a8b2-27ddc91bfacd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:56.752614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f406b1-ae05-430b-a8b2-27ddc91bfacd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:56.754705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f406b1-ae05-430b-a8b2-27ddc91bfacd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:56.755235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f406b1-ae05-430b-a8b2-27ddc91bfacd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:56.757456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f406b1-ae05-430b-a8b2-27ddc91bfacd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:56.757999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f406b1-ae05-430b-a8b2-27ddc91bfacd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:56.758451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f406b1-ae05-430b-a8b2-27ddc91bfacd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:57.162095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-26f406b1-ae05-430b-a8b2-27ddc91bfacd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:57.170812 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26f406b1-ae05-430b-a8b2-27ddc91bfacd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.458656 Sep 10 10:43:57.193587 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1343/1849] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:56 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:57.201883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:57.202655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:57.209045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:57.209706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:57.210284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:57.211126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:57.211706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:57.212240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:57.217883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:43:57.229132 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 HTTP/1.1 Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '8542d6bf-4373-44a8-9ffe-46f8e25a0ed7'} Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:43:57.231057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:57.235795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:43:57.235795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:43:57.235795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:43:57.235795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:43:57.235795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:43:57.235795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:43:57.235795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:43:57.235795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:43:57.237324 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad5aa845-8fc2-4717-bd4a-0cff3b7c60be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 404 len: 111 microversion: 2.1 time: 0.042226 Sep 10 10:43:57.238057 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1344/1850] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:57 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:43:57.243091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:57.243586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:57.250526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:57.251167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:57.251725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:57.252855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:57.253749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:57.254617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:57.291434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c342890c5911447d97325fa697d9ee19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caebc84429e44c758c11555ad1f06d97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:57.293723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] flavor_id is None. Assuming migration. {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 10:43:57.294320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 10:43:57.929996 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-756a9b64-f0bf-43a5-b6cf-0bf2aeae412d tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9/action" status: 202 len: 0 microversion: 2.1 time: 0.690626 Sep 10 10:43:57.931986 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1345/1851] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:43:57 2022] POST /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:43:57.943774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb64338b-3918-47c5-bff8-f8f19f196cf0 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:43:57.944715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb64338b-3918-47c5-bff8-f8f19f196cf0 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:43:57.961539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb64338b-3918-47c5-bff8-f8f19f196cf0 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:57.962329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb64338b-3918-47c5-bff8-f8f19f196cf0 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:57.962833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb64338b-3918-47c5-bff8-f8f19f196cf0 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:57.965507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb64338b-3918-47c5-bff8-f8f19f196cf0 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:57.966271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb64338b-3918-47c5-bff8-f8f19f196cf0 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:57.966420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb64338b-3918-47c5-bff8-f8f19f196cf0 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:58.679729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb64338b-3918-47c5-bff8-f8f19f196cf0 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:43:58.692614 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb64338b-3918-47c5-bff8-f8f19f196cf0 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.759242 Sep 10 10:43:58.693473 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1346/1852] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:43:57 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:43:58.712119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-395704368", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "15abac29-c434-4802-9cd4-4bace1ac4f7e"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:43:58.825922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] validate_networks() for [('15abac29-c434-4802-9cd4-4bace1ac4f7e', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:43:59.778077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:43:59.778699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:43:59.779046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:43:59.779651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:43:59.780209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:43:59.802922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:59.805753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:59.806363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:59.807339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:43:59.809299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:43:59.810562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:43:59.864471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:43:59.878911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for user fa978e59fa334084b722d116c761380f and project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:43:59.918253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:43:59.921390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:44:00.062938 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b0d16215-908a-4d1a-8fc8-ce4bae1174ae tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.365010 Sep 10 10:44:00.065474 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1347/1853] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:44:00.076411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-89fb6577-ed1a-40d0-9fee-639dcd47da23 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:00.079572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-89fb6577-ed1a-40d0-9fee-639dcd47da23 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:00.101230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89fb6577-ed1a-40d0-9fee-639dcd47da23 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:00.101904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89fb6577-ed1a-40d0-9fee-639dcd47da23 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:00.103497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89fb6577-ed1a-40d0-9fee-639dcd47da23 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:00.106692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89fb6577-ed1a-40d0-9fee-639dcd47da23 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:00.107376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89fb6577-ed1a-40d0-9fee-639dcd47da23 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:00.107959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89fb6577-ed1a-40d0-9fee-639dcd47da23 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:01.240180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-89fb6577-ed1a-40d0-9fee-639dcd47da23 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:01.249847 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-89fb6577-ed1a-40d0-9fee-639dcd47da23 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1486 microversion: 2.1 time: 1.182988 Sep 10 10:44:01.250318 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1348/1854] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:00 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1486 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:01.265414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec0d535e-49a6-48b1-b610-704792361f1b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:01.265414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec0d535e-49a6-48b1-b610-704792361f1b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:01.278949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec0d535e-49a6-48b1-b610-704792361f1b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:01.279561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec0d535e-49a6-48b1-b610-704792361f1b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:01.280066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec0d535e-49a6-48b1-b610-704792361f1b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:01.281409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec0d535e-49a6-48b1-b610-704792361f1b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:01.282054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec0d535e-49a6-48b1-b610-704792361f1b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:01.282609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec0d535e-49a6-48b1-b610-704792361f1b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:01.592152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec0d535e-49a6-48b1-b610-704792361f1b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:01.602915 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec0d535e-49a6-48b1-b610-704792361f1b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1470 microversion: 2.1 time: 0.351475 Sep 10 10:44:01.603536 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1349/1855] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:01 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1470 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:01.610220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-188c0caf-18ad-4b01-b745-20b9a45cee23 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:01.611193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-188c0caf-18ad-4b01-b745-20b9a45cee23 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:01.630128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-188c0caf-18ad-4b01-b745-20b9a45cee23 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:01.630949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-188c0caf-18ad-4b01-b745-20b9a45cee23 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:01.631734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-188c0caf-18ad-4b01-b745-20b9a45cee23 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:01.632729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-188c0caf-18ad-4b01-b745-20b9a45cee23 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:01.635311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-188c0caf-18ad-4b01-b745-20b9a45cee23 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:01.635954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-188c0caf-18ad-4b01-b745-20b9a45cee23 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:01.863915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-188c0caf-18ad-4b01-b745-20b9a45cee23 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:01.872027 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-188c0caf-18ad-4b01-b745-20b9a45cee23 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.267043 Sep 10 10:44:01.872630 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1350/1856] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:01 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:01.877376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1207932838", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "739381d7-2276-4bb9-bb8a-d3d8569e8efc"}], "block_device_mapping_v2": [{"uuid": "8a495686-d231-460a-a046-98bf35d83552", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:01.947884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] validate_networks() for [('739381d7-2276-4bb9-bb8a-d3d8569e8efc', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:44:02.443230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:44:02.443804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:44:02.444118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:44:02.444532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:44:02.445106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:44:02.458841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:02.459337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:02.459778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:02.460507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:02.461161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:02.461761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:02.480469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Getting quotas for project bb350b19a7254f0bbffb6e5b8dc2bbe3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:44:02.485700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Getting quotas for user a1013c609b044cb781dd1691909db7bf and project bb350b19a7254f0bbffb6e5b8dc2bbe3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:44:02.552396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:44:02.554350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a495686-d231-460a-a046-98bf35d83552',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:44:02.681717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:02.727475 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-faa1b496-f939-448b-99e6-c2c8d0e19e1d tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853539 Sep 10 10:44:02.728265 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1351/1857] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:44:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:44:02.733174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7dd928e1-53b2-46a0-aa2d-d349b047a6fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:02.734698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7dd928e1-53b2-46a0-aa2d-d349b047a6fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:02.743926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dd928e1-53b2-46a0-aa2d-d349b047a6fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:02.744766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dd928e1-53b2-46a0-aa2d-d349b047a6fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:02.745510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dd928e1-53b2-46a0-aa2d-d349b047a6fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:02.747597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dd928e1-53b2-46a0-aa2d-d349b047a6fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:02.748667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dd928e1-53b2-46a0-aa2d-d349b047a6fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:02.749348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dd928e1-53b2-46a0-aa2d-d349b047a6fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:02.912566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7dd928e1-53b2-46a0-aa2d-d349b047a6fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:02.925900 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7dd928e1-53b2-46a0-aa2d-d349b047a6fd tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.195920 Sep 10 10:44:02.942632 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1352/1858] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:02 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:02.959860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-017114a7-7fed-4dfd-8c96-e5cb61292120 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:02.961129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-017114a7-7fed-4dfd-8c96-e5cb61292120 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:02.972282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017114a7-7fed-4dfd-8c96-e5cb61292120 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:02.973165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017114a7-7fed-4dfd-8c96-e5cb61292120 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:02.973809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017114a7-7fed-4dfd-8c96-e5cb61292120 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:02.977559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017114a7-7fed-4dfd-8c96-e5cb61292120 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:02.978813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017114a7-7fed-4dfd-8c96-e5cb61292120 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:02.980111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017114a7-7fed-4dfd-8c96-e5cb61292120 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:03.056468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-017114a7-7fed-4dfd-8c96-e5cb61292120 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:03.065965 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-017114a7-7fed-4dfd-8c96-e5cb61292120 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1272 microversion: 2.1 time: 0.121187 Sep 10 10:44:03.077970 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1353/1859] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:02 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:03.169000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-55d08d3f-caf1-4e9d-9fe7-975c3feae89c tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Action: 'create', calling method: .version_select at 0x7efcae7ec4c0>, body: {"keypair": {"name": "tempest-keypair-199307297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOOW+gzyFYBmtihwPU7DW2lgA7MHk27RQmELKSNpcIS1udXsl9/XRGoYUeI9eN/cVnAkwuQ7HGUPpNE2Ioxi5ttKF26Kxw3dqHgr1QYU71tlJeG39DK3xe0BqPDaFWKRw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:03.194193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-55d08d3f-caf1-4e9d-9fe7-975c3feae89c tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Getting quotas for project cb90ea98afcb4bb1820aafa111b44cd5. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:44:03.204496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-55d08d3f-caf1-4e9d-9fe7-975c3feae89c tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Getting quotas for user bf760aa8b40d443289a6186df5e23bb1 and project cb90ea98afcb4bb1820aafa111b44cd5. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:44:03.244332 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-55d08d3f-caf1-4e9d-9fe7-975c3feae89c tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164776 Sep 10 10:44:03.246563 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1354/1860] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:44:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:03.258735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ebb3f141-10c6-4803-b2dc-ff2cded15015 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1008666109"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:03.263100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ebb3f141-10c6-4803-b2dc-ff2cded15015 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:03.271479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebb3f141-10c6-4803-b2dc-ff2cded15015 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:03.272554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebb3f141-10c6-4803-b2dc-ff2cded15015 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:03.273202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebb3f141-10c6-4803-b2dc-ff2cded15015 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:03.275177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebb3f141-10c6-4803-b2dc-ff2cded15015 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:03.275638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebb3f141-10c6-4803-b2dc-ff2cded15015 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:03.276061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebb3f141-10c6-4803-b2dc-ff2cded15015 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:03.668710 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ebb3f141-10c6-4803-b2dc-ff2cded15015 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "POST /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c/action" status: 202 len: 0 microversion: 2.1 time: 0.415908 Sep 10 10:44:03.676493 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1355/1861] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:03 2022] POST /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 10:44:03.698668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22afd07d-8451-4068-96c2-5a770493a3d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:03.702011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-22afd07d-8451-4068-96c2-5a770493a3d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:03.715132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22afd07d-8451-4068-96c2-5a770493a3d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:03.717578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22afd07d-8451-4068-96c2-5a770493a3d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:03.719325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22afd07d-8451-4068-96c2-5a770493a3d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:03.721454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22afd07d-8451-4068-96c2-5a770493a3d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:03.722227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22afd07d-8451-4068-96c2-5a770493a3d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:03.722808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22afd07d-8451-4068-96c2-5a770493a3d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:03.959186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-22afd07d-8451-4068-96c2-5a770493a3d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:03.976872 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-22afd07d-8451-4068-96c2-5a770493a3d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.296273 Sep 10 10:44:03.977617 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1356/1862] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:03 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:03.996211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-271c1a4c-3c80-4212-ac45-057b2d6964e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:04.003564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-271c1a4c-3c80-4212-ac45-057b2d6964e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:04.021982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271c1a4c-3c80-4212-ac45-057b2d6964e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:04.025871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271c1a4c-3c80-4212-ac45-057b2d6964e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:04.027764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271c1a4c-3c80-4212-ac45-057b2d6964e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:04.029599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271c1a4c-3c80-4212-ac45-057b2d6964e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:04.030314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271c1a4c-3c80-4212-ac45-057b2d6964e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:04.030934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271c1a4c-3c80-4212-ac45-057b2d6964e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:04.143981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-271c1a4c-3c80-4212-ac45-057b2d6964e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:04.156049 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-271c1a4c-3c80-4212-ac45-057b2d6964e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1151 microversion: 2.1 time: 0.173572 Sep 10 10:44:04.168534 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1357/1863] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:03 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1151 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:04.188582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a6b1bf46-ead5-459a-812f-cd317c3c15e8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:04.192035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a6b1bf46-ead5-459a-812f-cd317c3c15e8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:04.209329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6b1bf46-ead5-459a-812f-cd317c3c15e8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:04.209830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6b1bf46-ead5-459a-812f-cd317c3c15e8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:04.210276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6b1bf46-ead5-459a-812f-cd317c3c15e8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:04.218138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6b1bf46-ead5-459a-812f-cd317c3c15e8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:04.218138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6b1bf46-ead5-459a-812f-cd317c3c15e8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:04.218138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6b1bf46-ead5-459a-812f-cd317c3c15e8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:04.526248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a6b1bf46-ead5-459a-812f-cd317c3c15e8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:04.543162 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a6b1bf46-ead5-459a-812f-cd317c3c15e8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.372653 Sep 10 10:44:04.543930 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1358/1864] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:04 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:04.552028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b3cb444-6c57-4e4c-b944-7716ddf53cde tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae7d6ca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:04.616175 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b3cb444-6c57-4e4c-b944-7716ddf53cde tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee" status: 200 len: 1414 microversion: 2.1 time: 0.068665 Sep 10 10:44:04.616627 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1359/1865] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:44:04 2022] GET /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:04.626458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c42bc59-a1b7-45d0-b857-af19945816f4 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:04.627105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c42bc59-a1b7-45d0-b857-af19945816f4 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:04.646221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c42bc59-a1b7-45d0-b857-af19945816f4 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:04.648832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c42bc59-a1b7-45d0-b857-af19945816f4 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:04.657134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c42bc59-a1b7-45d0-b857-af19945816f4 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:04.676852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c42bc59-a1b7-45d0-b857-af19945816f4 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:04.678901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c42bc59-a1b7-45d0-b857-af19945816f4 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:04.679349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c42bc59-a1b7-45d0-b857-af19945816f4 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:04.950712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c42bc59-a1b7-45d0-b857-af19945816f4 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:04.960393 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c42bc59-a1b7-45d0-b857-af19945816f4 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.342677 Sep 10 10:44:04.961001 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1360/1866] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:04 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:04.978504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52c46e3b-0865-4641-90c3-977782f2cf3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:04.978504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-52c46e3b-0865-4641-90c3-977782f2cf3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:04.978504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52c46e3b-0865-4641-90c3-977782f2cf3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:04.978504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52c46e3b-0865-4641-90c3-977782f2cf3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:04.993502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52c46e3b-0865-4641-90c3-977782f2cf3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:04.994677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52c46e3b-0865-4641-90c3-977782f2cf3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:04.995736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52c46e3b-0865-4641-90c3-977782f2cf3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:04.996234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52c46e3b-0865-4641-90c3-977782f2cf3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:05.458541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-52c46e3b-0865-4641-90c3-977782f2cf3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:05.462981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:05.477167 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-52c46e3b-0865-4641-90c3-977782f2cf3c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1314 microversion: 2.1 time: 0.513433 Sep 10 10:44:05.484940 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1361/1867] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:04 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:05.502718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbf1827c-c41d-429d-96d7-a37f6af96eb9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae9f70d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:05.566132 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbf1827c-c41d-429d-96d7-a37f6af96eb9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee" status: 200 len: 1414 microversion: 2.1 time: 0.079447 Sep 10 10:44:05.577429 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1362/1868] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:44:05 2022] GET /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:05.590280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97e4c6e0-f084-47e0-8f10-7224924c224e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:05.590626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-97e4c6e0-f084-47e0-8f10-7224924c224e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:05.597502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97e4c6e0-f084-47e0-8f10-7224924c224e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:05.598389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97e4c6e0-f084-47e0-8f10-7224924c224e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:05.599052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97e4c6e0-f084-47e0-8f10-7224924c224e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:05.600019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97e4c6e0-f084-47e0-8f10-7224924c224e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:05.600696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97e4c6e0-f084-47e0-8f10-7224924c224e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:05.601401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97e4c6e0-f084-47e0-8f10-7224924c224e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:05.920587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-97e4c6e0-f084-47e0-8f10-7224924c224e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:05.930581 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-97e4c6e0-f084-47e0-8f10-7224924c224e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.350839 Sep 10 10:44:05.933517 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1363/1869] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:05 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:05.950355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-574ab5ee-359e-46c3-ab8b-91faafe24660 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:05.951999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-574ab5ee-359e-46c3-ab8b-91faafe24660 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:05.966873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574ab5ee-359e-46c3-ab8b-91faafe24660 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:05.968078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574ab5ee-359e-46c3-ab8b-91faafe24660 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:05.970500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574ab5ee-359e-46c3-ab8b-91faafe24660 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:05.973208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574ab5ee-359e-46c3-ab8b-91faafe24660 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:05.975718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574ab5ee-359e-46c3-ab8b-91faafe24660 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:05.976174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574ab5ee-359e-46c3-ab8b-91faafe24660 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:06.054580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-574ab5ee-359e-46c3-ab8b-91faafe24660 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:06.066546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-574ab5ee-359e-46c3-ab8b-91faafe24660 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1169 microversion: 2.1 time: 0.127179 Sep 10 10:44:06.100818 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1364/1870] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:05 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1169 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:06.100818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8947b5b1-5605-463e-b975-29e2ad7935ff req-c28330dc-d84e-42aa-a42b-c3b99f2a5b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae35632-52bf-4dd6-88fb-b4419eab5073", "tag": "4ceb2860-1b4b-4bd8-ac7d-9b0d7e86c610"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:06.107993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8947b5b1-5605-463e-b975-29e2ad7935ff req-c28330dc-d84e-42aa-a42b-c3b99f2a5b74 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:06.108847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8947b5b1-5605-463e-b975-29e2ad7935ff req-c28330dc-d84e-42aa-a42b-c3b99f2a5b74 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:06.109496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8947b5b1-5605-463e-b975-29e2ad7935ff req-c28330dc-d84e-42aa-a42b-c3b99f2a5b74 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:06.127304 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8947b5b1-5605-463e-b975-29e2ad7935ff req-c28330dc-d84e-42aa-a42b-c3b99f2a5b74 service nova] Creating event network-changed:4ceb2860-1b4b-4bd8-ac7d-9b0d7e86c610 for instance aae35632-52bf-4dd6-88fb-b4419eab5073 on n-h2-856894-1 Sep 10 10:44:06.134226 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8947b5b1-5605-463e-b975-29e2ad7935ff req-c28330dc-d84e-42aa-a42b-c3b99f2a5b74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049429 Sep 10 10:44:06.134849 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1365/1871] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:06.141192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c47fcc6-ffb7-40a8-a0ad-af822f59b7bd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:06.142240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c47fcc6-ffb7-40a8-a0ad-af822f59b7bd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:06.153619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c47fcc6-ffb7-40a8-a0ad-af822f59b7bd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:06.155063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c47fcc6-ffb7-40a8-a0ad-af822f59b7bd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:06.155698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c47fcc6-ffb7-40a8-a0ad-af822f59b7bd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:06.156788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c47fcc6-ffb7-40a8-a0ad-af822f59b7bd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:06.157442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c47fcc6-ffb7-40a8-a0ad-af822f59b7bd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:06.158439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c47fcc6-ffb7-40a8-a0ad-af822f59b7bd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:06.751670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c47fcc6-ffb7-40a8-a0ad-af822f59b7bd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:06.772381 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c47fcc6-ffb7-40a8-a0ad-af822f59b7bd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.636037 Sep 10 10:44:06.777573 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1366/1872] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:06 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:06.795435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52ba826a-2ea4-41f3-87ad-8133ed470ce2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae934280>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:07.098633 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-52ba826a-2ea4-41f3-87ad-8133ed470ce2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee" status: 204 len: 0 microversion: 2.1 time: 0.315266 Sep 10 10:44:07.100343 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1367/1873] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:06 2022] DELETE /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:44:07.107322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f146a3f4-2a6c-4a2d-ad28-ac57e72905dc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:07.108544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f146a3f4-2a6c-4a2d-ad28-ac57e72905dc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:07.121109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f146a3f4-2a6c-4a2d-ad28-ac57e72905dc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:07.123845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f146a3f4-2a6c-4a2d-ad28-ac57e72905dc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:07.133758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f146a3f4-2a6c-4a2d-ad28-ac57e72905dc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:07.135416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f146a3f4-2a6c-4a2d-ad28-ac57e72905dc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:07.136635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f146a3f4-2a6c-4a2d-ad28-ac57e72905dc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:07.137315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f146a3f4-2a6c-4a2d-ad28-ac57e72905dc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:07.554355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f146a3f4-2a6c-4a2d-ad28-ac57e72905dc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:07.584819 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f146a3f4-2a6c-4a2d-ad28-ac57e72905dc tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.483076 Sep 10 10:44:07.587270 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1368/1874] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:07 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:07.595122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-106028625", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d288c196-d60c-44fa-aa65-e313b2a00bd2"}], "security_groups": [{"name": "tempest-securitygroup--2142935077"}], "key_name": "tempest-keypair-199307297", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:07.810242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] validate_networks() for [('d288c196-d60c-44fa-aa65-e313b2a00bd2', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:44:08.367116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Getting quotas for project cb90ea98afcb4bb1820aafa111b44cd5. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:44:08.383233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Getting quotas for user bf760aa8b40d443289a6186df5e23bb1 and project cb90ea98afcb4bb1820aafa111b44cd5. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:44:08.425650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:44:08.426238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:44:08.426943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:44:08.427611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:44:08.428120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:44:08.445004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:08.445530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:08.446161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:08.448470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:08.449141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:08.449740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:08.478812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Getting quotas for project cb90ea98afcb4bb1820aafa111b44cd5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:44:08.485297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Getting quotas for user bf760aa8b40d443289a6186df5e23bb1 and project cb90ea98afcb4bb1820aafa111b44cd5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:44:08.500908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:44:08.504244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:44:08.565162 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb85f707-318e-43f8-be8b-6fd41b39da83 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.976614 Sep 10 10:44:08.566141 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1369/1875] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:44:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:44:08.571048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-664c534a-39d3-4fd8-b2f9-76e4a319e704 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:08.571659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-664c534a-39d3-4fd8-b2f9-76e4a319e704 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:08.580213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-664c534a-39d3-4fd8-b2f9-76e4a319e704 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:08.580932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-664c534a-39d3-4fd8-b2f9-76e4a319e704 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:08.581591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-664c534a-39d3-4fd8-b2f9-76e4a319e704 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:08.582447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-664c534a-39d3-4fd8-b2f9-76e4a319e704 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:08.585750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-664c534a-39d3-4fd8-b2f9-76e4a319e704 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:08.586259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-664c534a-39d3-4fd8-b2f9-76e4a319e704 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:08.766186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-664c534a-39d3-4fd8-b2f9-76e4a319e704 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:08.779157 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-664c534a-39d3-4fd8-b2f9-76e4a319e704 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1314 microversion: 2.1 time: 0.211386 Sep 10 10:44:08.781428 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1370/1876] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:08 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:08.787065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a331206f-e01c-4957-8e24-4179c79df649 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:08.788054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a331206f-e01c-4957-8e24-4179c79df649 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:08.801571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a331206f-e01c-4957-8e24-4179c79df649 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:08.802485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a331206f-e01c-4957-8e24-4179c79df649 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:08.803176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a331206f-e01c-4957-8e24-4179c79df649 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:08.804347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a331206f-e01c-4957-8e24-4179c79df649 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:08.805014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a331206f-e01c-4957-8e24-4179c79df649 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:08.805538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a331206f-e01c-4957-8e24-4179c79df649 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:09.025181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a331206f-e01c-4957-8e24-4179c79df649 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:09.036210 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a331206f-e01c-4957-8e24-4179c79df649 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.253400 Sep 10 10:44:09.038041 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1371/1877] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:08 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:09.043476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c17ba54c-3e1b-4a3e-86ba-4f78327b3b57 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:09.044136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c17ba54c-3e1b-4a3e-86ba-4f78327b3b57 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:09.068367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c17ba54c-3e1b-4a3e-86ba-4f78327b3b57 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:09.070565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c17ba54c-3e1b-4a3e-86ba-4f78327b3b57 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:09.071247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c17ba54c-3e1b-4a3e-86ba-4f78327b3b57 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:09.074520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c17ba54c-3e1b-4a3e-86ba-4f78327b3b57 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:09.075291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c17ba54c-3e1b-4a3e-86ba-4f78327b3b57 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:09.077646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c17ba54c-3e1b-4a3e-86ba-4f78327b3b57 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:09.359937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c17ba54c-3e1b-4a3e-86ba-4f78327b3b57 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:09.377866 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c17ba54c-3e1b-4a3e-86ba-4f78327b3b57 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1211 microversion: 2.1 time: 0.338579 Sep 10 10:44:09.381270 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1372/1878] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:09 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1211 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:09.394890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57cf0eb7-e46a-4400-9206-67ee211139c4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae6dbca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:09.439387 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-57cf0eb7-e46a-4400-9206-67ee211139c4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Image not found. Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57cf0eb7-e46a-4400-9206-67ee211139c4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee HTTP/1.1 Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '62b16bbb-d9b0-4ec6-819e-7a0941c265ee'} Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 62b16bbb-d9b0-4ec6-819e-7a0941c265ee Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 10:44:09.441635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62b16bbb-d9b0-4ec6-819e-7a0941c265ee could not be found. Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57cf0eb7-e46a-4400-9206-67ee211139c4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:09.445924 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57cf0eb7-e46a-4400-9206-67ee211139c4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee" status: 404 len: 62 microversion: 2.1 time: 0.061220 Sep 10 10:44:09.449968 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1373/1879] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:44:09 2022] GET /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:44:09.463056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-efdfd290-554a-4433-beb0-a43c7a952f5d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:09.465982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-efdfd290-554a-4433-beb0-a43c7a952f5d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:09.486462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efdfd290-554a-4433-beb0-a43c7a952f5d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:09.487043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efdfd290-554a-4433-beb0-a43c7a952f5d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:09.489719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efdfd290-554a-4433-beb0-a43c7a952f5d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:09.493330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efdfd290-554a-4433-beb0-a43c7a952f5d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:09.494003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efdfd290-554a-4433-beb0-a43c7a952f5d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:09.494439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efdfd290-554a-4433-beb0-a43c7a952f5d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:09.731595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-efdfd290-554a-4433-beb0-a43c7a952f5d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:09.740813 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-efdfd290-554a-4433-beb0-a43c7a952f5d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.289910 Sep 10 10:44:09.757130 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1374/1880] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:09 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:09.757130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3e7bc6e5-320e-4472-bc2b-4733b27e5e6f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:09.757130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3e7bc6e5-320e-4472-bc2b-4733b27e5e6f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:09.757130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e7bc6e5-320e-4472-bc2b-4733b27e5e6f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:09.757863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e7bc6e5-320e-4472-bc2b-4733b27e5e6f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:09.758572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e7bc6e5-320e-4472-bc2b-4733b27e5e6f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:09.759471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e7bc6e5-320e-4472-bc2b-4733b27e5e6f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:09.760087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e7bc6e5-320e-4472-bc2b-4733b27e5e6f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:09.761550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e7bc6e5-320e-4472-bc2b-4733b27e5e6f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:09.868314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e7bc6e5-320e-4472-bc2b-4733b27e5e6f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:09.885699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3e7bc6e5-320e-4472-bc2b-4733b27e5e6f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1328 microversion: 2.1 time: 0.141182 Sep 10 10:44:09.886298 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1375/1881] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:09 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1328 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:09.893366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-557926ff-44d2-498c-b9e1-096870715b2d tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:09.893974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-557926ff-44d2-498c-b9e1-096870715b2d tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:09.904508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-557926ff-44d2-498c-b9e1-096870715b2d tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:09.905038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-557926ff-44d2-498c-b9e1-096870715b2d tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:09.905602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-557926ff-44d2-498c-b9e1-096870715b2d tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:09.906457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-557926ff-44d2-498c-b9e1-096870715b2d tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:09.906974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-557926ff-44d2-498c-b9e1-096870715b2d tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:09.907406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-557926ff-44d2-498c-b9e1-096870715b2d tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:10.242338 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:44:10.242871 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:44:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 10:44:10.422338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-557926ff-44d2-498c-b9e1-096870715b2d tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:10.432063 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-557926ff-44d2-498c-b9e1-096870715b2d tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.544430 Sep 10 10:44:10.432896 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1376/1882] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:09 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:10.438422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd672a0d-518f-475b-ad6e-4f9b0df312c6 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:10.439304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd672a0d-518f-475b-ad6e-4f9b0df312c6 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:10.447060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd672a0d-518f-475b-ad6e-4f9b0df312c6 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:10.448526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd672a0d-518f-475b-ad6e-4f9b0df312c6 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:10.449052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd672a0d-518f-475b-ad6e-4f9b0df312c6 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:10.450053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd672a0d-518f-475b-ad6e-4f9b0df312c6 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:10.450601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd672a0d-518f-475b-ad6e-4f9b0df312c6 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:10.451118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd672a0d-518f-475b-ad6e-4f9b0df312c6 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:10.603300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd672a0d-518f-475b-ad6e-4f9b0df312c6 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:10.620926 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd672a0d-518f-475b-ad6e-4f9b0df312c6 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1486 microversion: 2.1 time: 0.186621 Sep 10 10:44:10.622451 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1377/1883] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:10 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1486 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:10.631025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-bbaa17e7-b368-45fe-b4cd-93918276afa0 req-d7c80bb5-e552-4ca8-9534-8e6affe5017d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c", "name": "network-vif-plugged", "status": "completed", "tag": "0c509438-2c28-43d2-8814-2f51dec08ea5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:10.652896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bbaa17e7-b368-45fe-b4cd-93918276afa0 req-d7c80bb5-e552-4ca8-9534-8e6affe5017d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:10.653667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bbaa17e7-b368-45fe-b4cd-93918276afa0 req-d7c80bb5-e552-4ca8-9534-8e6affe5017d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:10.654756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bbaa17e7-b368-45fe-b4cd-93918276afa0 req-d7c80bb5-e552-4ca8-9534-8e6affe5017d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:10.721283 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-bbaa17e7-b368-45fe-b4cd-93918276afa0 req-d7c80bb5-e552-4ca8-9534-8e6affe5017d service nova] Creating event network-vif-plugged:0c509438-2c28-43d2-8814-2f51dec08ea5 for instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c on n-h2-856894-1 Sep 10 10:44:10.728396 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-bbaa17e7-b368-45fe-b4cd-93918276afa0 req-d7c80bb5-e552-4ca8-9534-8e6affe5017d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102455 Sep 10 10:44:10.729269 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1378/1884] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:10.737098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd612507-0254-4e04-839b-b9d89eb598c0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:10.738088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd612507-0254-4e04-839b-b9d89eb598c0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:10.747810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd612507-0254-4e04-839b-b9d89eb598c0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:10.748560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd612507-0254-4e04-839b-b9d89eb598c0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:10.749220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd612507-0254-4e04-839b-b9d89eb598c0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:10.750848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd612507-0254-4e04-839b-b9d89eb598c0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:10.751449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd612507-0254-4e04-839b-b9d89eb598c0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:10.752076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd612507-0254-4e04-839b-b9d89eb598c0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:11.236870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd612507-0254-4e04-839b-b9d89eb598c0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:11.247422 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd612507-0254-4e04-839b-b9d89eb598c0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1314 microversion: 2.1 time: 0.516525 Sep 10 10:44:11.248309 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1379/1885] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:10 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:11.270656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-083af1eb-345b-412b-8b20-b2f96a30a1c2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:11.271272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-083af1eb-345b-412b-8b20-b2f96a30a1c2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:11.285335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-083af1eb-345b-412b-8b20-b2f96a30a1c2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:11.285829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-083af1eb-345b-412b-8b20-b2f96a30a1c2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:11.286260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-083af1eb-345b-412b-8b20-b2f96a30a1c2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:11.286954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-083af1eb-345b-412b-8b20-b2f96a30a1c2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:11.287409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-083af1eb-345b-412b-8b20-b2f96a30a1c2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:11.287828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-083af1eb-345b-412b-8b20-b2f96a30a1c2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:11.535087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-083af1eb-345b-412b-8b20-b2f96a30a1c2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:11.549778 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-083af1eb-345b-412b-8b20-b2f96a30a1c2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.281726 Sep 10 10:44:11.553696 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1380/1886] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:11 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:11.563545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41275942-c8f4-4b78-8c04-f27f92e37118 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:11.564162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-41275942-c8f4-4b78-8c04-f27f92e37118 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:11.578000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41275942-c8f4-4b78-8c04-f27f92e37118 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:11.580703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41275942-c8f4-4b78-8c04-f27f92e37118 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:11.581528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41275942-c8f4-4b78-8c04-f27f92e37118 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:11.585016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41275942-c8f4-4b78-8c04-f27f92e37118 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:11.585495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41275942-c8f4-4b78-8c04-f27f92e37118 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:11.585919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41275942-c8f4-4b78-8c04-f27f92e37118 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:11.752829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-41275942-c8f4-4b78-8c04-f27f92e37118 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:11.762494 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41275942-c8f4-4b78-8c04-f27f92e37118 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1211 microversion: 2.1 time: 0.206715 Sep 10 10:44:11.764107 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1381/1887] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:11 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1211 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:11.770235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7aacd01f-c4f1-465c-8447-18bd51e72b75 req-1c6c6a95-27fe-479c-b68b-91df30890b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178b8f2f-5352-4ae4-9f3e-bef5e366456d", "tag": "f2494b11-7317-47ca-a893-5644f4502288"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:11.782877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7aacd01f-c4f1-465c-8447-18bd51e72b75 req-1c6c6a95-27fe-479c-b68b-91df30890b96 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:11.784234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7aacd01f-c4f1-465c-8447-18bd51e72b75 req-1c6c6a95-27fe-479c-b68b-91df30890b96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:11.784773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7aacd01f-c4f1-465c-8447-18bd51e72b75 req-1c6c6a95-27fe-479c-b68b-91df30890b96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:11.799171 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7aacd01f-c4f1-465c-8447-18bd51e72b75 req-1c6c6a95-27fe-479c-b68b-91df30890b96 service nova] Creating event network-changed:f2494b11-7317-47ca-a893-5644f4502288 for instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d on n-h2-856894-1 Sep 10 10:44:11.806309 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7aacd01f-c4f1-465c-8447-18bd51e72b75 req-1c6c6a95-27fe-479c-b68b-91df30890b96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039892 Sep 10 10:44:11.809138 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1382/1888] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:11.817715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5fb8f035-779e-4222-9c52-00f800cff126 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:11.818513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5fb8f035-779e-4222-9c52-00f800cff126 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:11.826401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fb8f035-779e-4222-9c52-00f800cff126 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:11.827262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fb8f035-779e-4222-9c52-00f800cff126 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:11.828206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fb8f035-779e-4222-9c52-00f800cff126 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:11.829860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fb8f035-779e-4222-9c52-00f800cff126 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:11.830566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fb8f035-779e-4222-9c52-00f800cff126 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:11.831594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fb8f035-779e-4222-9c52-00f800cff126 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:11.866403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5fb8f035-779e-4222-9c52-00f800cff126 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:44:11.885190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:11.970220 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5fb8f035-779e-4222-9c52-00f800cff126 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 204 len: 0 microversion: 2.1 time: 0.159253 Sep 10 10:44:11.970861 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1383/1889] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:44:11 2022] DELETE /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:44:11.979853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b8ba4bc-fac1-45ba-891d-27973f7c061a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:11.983727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b8ba4bc-fac1-45ba-891d-27973f7c061a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:11.993258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b8ba4bc-fac1-45ba-891d-27973f7c061a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:11.993750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b8ba4bc-fac1-45ba-891d-27973f7c061a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:11.994184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b8ba4bc-fac1-45ba-891d-27973f7c061a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:11.994927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b8ba4bc-fac1-45ba-891d-27973f7c061a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:11.995532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b8ba4bc-fac1-45ba-891d-27973f7c061a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:11.995966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b8ba4bc-fac1-45ba-891d-27973f7c061a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.191396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0b8ba4bc-fac1-45ba-891d-27973f7c061a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:12.202743 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b8ba4bc-fac1-45ba-891d-27973f7c061a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.227816 Sep 10 10:44:12.217944 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1384/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:11 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:12.217944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a765450d-2314-4507-871b-5d71767fd545 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:12.217944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a765450d-2314-4507-871b-5d71767fd545 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:12.219587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:12.222404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a765450d-2314-4507-871b-5d71767fd545 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:12.223189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a765450d-2314-4507-871b-5d71767fd545 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:12.223733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a765450d-2314-4507-871b-5d71767fd545 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.225596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a765450d-2314-4507-871b-5d71767fd545 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:12.227082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a765450d-2314-4507-871b-5d71767fd545 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:12.227636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a765450d-2314-4507-871b-5d71767fd545 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.324846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a765450d-2314-4507-871b-5d71767fd545 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:12.334263 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a765450d-2314-4507-871b-5d71767fd545 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1334 microversion: 2.1 time: 0.129378 Sep 10 10:44:12.335143 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1385/1891] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:12 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1334 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:12.341174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-176e0254-3cf3-46d7-a519-0b7f77c8e1a5 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:12.342045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-176e0254-3cf3-46d7-a519-0b7f77c8e1a5 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:12.348525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-176e0254-3cf3-46d7-a519-0b7f77c8e1a5 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:12.349026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-176e0254-3cf3-46d7-a519-0b7f77c8e1a5 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:12.349951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-176e0254-3cf3-46d7-a519-0b7f77c8e1a5 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.350620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-176e0254-3cf3-46d7-a519-0b7f77c8e1a5 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:12.351146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-176e0254-3cf3-46d7-a519-0b7f77c8e1a5 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:12.351573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-176e0254-3cf3-46d7-a519-0b7f77c8e1a5 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.512677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-176e0254-3cf3-46d7-a519-0b7f77c8e1a5 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:12.521971 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-176e0254-3cf3-46d7-a519-0b7f77c8e1a5 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.185706 Sep 10 10:44:12.522748 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1386/1892] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:12 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:12.536239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-785235b1-c575-4a52-88f7-4db257b43c3e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae747670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:12.563049 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-785235b1-c575-4a52-88f7-4db257b43c3e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Image not found. Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-785235b1-c575-4a52-88f7-4db257b43c3e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee HTTP/1.1 Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '62b16bbb-d9b0-4ec6-819e-7a0941c265ee'} Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 62b16bbb-d9b0-4ec6-819e-7a0941c265ee to delete Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62b16bbb-d9b0-4ec6-819e-7a0941c265ee could not be found. Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:12.565249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-785235b1-c575-4a52-88f7-4db257b43c3e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-785235b1-c575-4a52-88f7-4db257b43c3e tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee" status: 404 len: 62 microversion: 2.1 time: 0.036457 Sep 10 10:44:12.569594 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1387/1893] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:12 2022] DELETE /compute/v2.1/images/62b16bbb-d9b0-4ec6-819e-7a0941c265ee => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:44:12.575055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3e2ba6a5-b70c-49eb-828d-f10fc7d098a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:12.575055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3e2ba6a5-b70c-49eb-828d-f10fc7d098a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:12.580101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2ba6a5-b70c-49eb-828d-f10fc7d098a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:12.580617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2ba6a5-b70c-49eb-828d-f10fc7d098a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:12.581051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2ba6a5-b70c-49eb-828d-f10fc7d098a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.581775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2ba6a5-b70c-49eb-828d-f10fc7d098a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:12.582232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2ba6a5-b70c-49eb-828d-f10fc7d098a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:12.582855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2ba6a5-b70c-49eb-828d-f10fc7d098a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.761329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e2ba6a5-b70c-49eb-828d-f10fc7d098a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:12.769453 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3e2ba6a5-b70c-49eb-828d-f10fc7d098a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1314 microversion: 2.1 time: 0.201080 Sep 10 10:44:12.770043 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1388/1894] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:12 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:12.774653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b884e8e1-b6c8-4652-82cb-e2ceef802fa1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:12.775533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b884e8e1-b6c8-4652-82cb-e2ceef802fa1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:12.781401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b884e8e1-b6c8-4652-82cb-e2ceef802fa1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:12.781889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b884e8e1-b6c8-4652-82cb-e2ceef802fa1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:12.782328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b884e8e1-b6c8-4652-82cb-e2ceef802fa1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.783411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b884e8e1-b6c8-4652-82cb-e2ceef802fa1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:12.783740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b884e8e1-b6c8-4652-82cb-e2ceef802fa1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:12.784295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b884e8e1-b6c8-4652-82cb-e2ceef802fa1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.940956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b884e8e1-b6c8-4652-82cb-e2ceef802fa1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:12.948921 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b884e8e1-b6c8-4652-82cb-e2ceef802fa1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.177908 Sep 10 10:44:12.961098 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1389/1895] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:12 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:12.961098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:12.961098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:12.961098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:12.961098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:12.961729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.965917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:12.965917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:12.965917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:12.990422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:44:13.039967 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.compute.api [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Instance is already in deleting state, ignoring this request Sep 10 10:44:13.040799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-857e580c-b59a-4de7-ab2e-d23926f29401 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 204 len: 0 microversion: 2.1 time: 0.089891 Sep 10 10:44:13.041421 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1390/1896] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:44:12 2022] DELETE /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:44:13.046807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-12353990-b158-40d7-ab99-7915d4e966c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:13.047416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-12353990-b158-40d7-ab99-7915d4e966c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:13.053404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12353990-b158-40d7-ab99-7915d4e966c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.053893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12353990-b158-40d7-ab99-7915d4e966c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.054865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12353990-b158-40d7-ab99-7915d4e966c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.055563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12353990-b158-40d7-ab99-7915d4e966c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.056025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12353990-b158-40d7-ab99-7915d4e966c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.056456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12353990-b158-40d7-ab99-7915d4e966c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.188725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-12353990-b158-40d7-ab99-7915d4e966c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:13.196858 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-12353990-b158-40d7-ab99-7915d4e966c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1211 microversion: 2.1 time: 0.153600 Sep 10 10:44:13.197461 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1391/1897] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:13 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1211 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:13.202510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c49096d-aec8-4982-81b8-c7b75b7fcbc8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:13.203116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c49096d-aec8-4982-81b8-c7b75b7fcbc8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:13.208973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c49096d-aec8-4982-81b8-c7b75b7fcbc8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.209570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c49096d-aec8-4982-81b8-c7b75b7fcbc8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.210073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c49096d-aec8-4982-81b8-c7b75b7fcbc8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.210798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c49096d-aec8-4982-81b8-c7b75b7fcbc8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.211255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c49096d-aec8-4982-81b8-c7b75b7fcbc8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.211878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c49096d-aec8-4982-81b8-c7b75b7fcbc8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.346768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c49096d-aec8-4982-81b8-c7b75b7fcbc8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:13.359445 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c49096d-aec8-4982-81b8-c7b75b7fcbc8 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1492 microversion: 2.1 time: 0.160340 Sep 10 10:44:13.365372 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1392/1898] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:13 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1492 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:13.370959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eda61999-9ebc-49d4-a6a8-457bf4306062 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:13.371922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eda61999-9ebc-49d4-a6a8-457bf4306062 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:13.379302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eda61999-9ebc-49d4-a6a8-457bf4306062 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.379824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eda61999-9ebc-49d4-a6a8-457bf4306062 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.380324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eda61999-9ebc-49d4-a6a8-457bf4306062 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.380903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eda61999-9ebc-49d4-a6a8-457bf4306062 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.381383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eda61999-9ebc-49d4-a6a8-457bf4306062 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.381942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eda61999-9ebc-49d4-a6a8-457bf4306062 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.543995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eda61999-9ebc-49d4-a6a8-457bf4306062 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:13.552975 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eda61999-9ebc-49d4-a6a8-457bf4306062 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.190887 Sep 10 10:44:13.565094 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1393/1899] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:13 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:13.571002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f146019-b9c4-48ed-8dd2-53dea919475f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:13.571781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f146019-b9c4-48ed-8dd2-53dea919475f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:13.579221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f146019-b9c4-48ed-8dd2-53dea919475f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.579746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f146019-b9c4-48ed-8dd2-53dea919475f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.580204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f146019-b9c4-48ed-8dd2-53dea919475f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.581125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f146019-b9c4-48ed-8dd2-53dea919475f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.581752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f146019-b9c4-48ed-8dd2-53dea919475f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.582685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f146019-b9c4-48ed-8dd2-53dea919475f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.726333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1f146019-b9c4-48ed-8dd2-53dea919475f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:13.736172 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f146019-b9c4-48ed-8dd2-53dea919475f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1402 microversion: 2.1 time: 0.180465 Sep 10 10:44:13.737556 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1394/1900] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:13 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1402 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:13.744279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7ebe36ec-530c-4943-8658-1622f4d21ab1 req-e9ecbcef-2ac5-4d12-b70a-f36181ea201e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae35632-52bf-4dd6-88fb-b4419eab5073", "name": "network-vif-plugged", "status": "completed", "tag": "4ceb2860-1b4b-4bd8-ac7d-9b0d7e86c610"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:13.756208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ebe36ec-530c-4943-8658-1622f4d21ab1 req-e9ecbcef-2ac5-4d12-b70a-f36181ea201e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.756821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ebe36ec-530c-4943-8658-1622f4d21ab1 req-e9ecbcef-2ac5-4d12-b70a-f36181ea201e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.757519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ebe36ec-530c-4943-8658-1622f4d21ab1 req-e9ecbcef-2ac5-4d12-b70a-f36181ea201e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.771695 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7ebe36ec-530c-4943-8658-1622f4d21ab1 req-e9ecbcef-2ac5-4d12-b70a-f36181ea201e service nova] Creating event network-vif-plugged:4ceb2860-1b4b-4bd8-ac7d-9b0d7e86c610 for instance aae35632-52bf-4dd6-88fb-b4419eab5073 on n-h2-856894-1 Sep 10 10:44:13.776667 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7ebe36ec-530c-4943-8658-1622f4d21ab1 req-e9ecbcef-2ac5-4d12-b70a-f36181ea201e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037337 Sep 10 10:44:13.777666 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1395/1901] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:13.784046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd743242-dec0-4946-8119-d39e4cc5b2a6 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:13.784705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd743242-dec0-4946-8119-d39e4cc5b2a6 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:13.790881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd743242-dec0-4946-8119-d39e4cc5b2a6 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.791370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd743242-dec0-4946-8119-d39e4cc5b2a6 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.791849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd743242-dec0-4946-8119-d39e4cc5b2a6 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.792547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd743242-dec0-4946-8119-d39e4cc5b2a6 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.793006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd743242-dec0-4946-8119-d39e4cc5b2a6 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.793475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd743242-dec0-4946-8119-d39e4cc5b2a6 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.933388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd743242-dec0-4946-8119-d39e4cc5b2a6 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:13.941666 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd743242-dec0-4946-8119-d39e4cc5b2a6 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.162685 Sep 10 10:44:13.942440 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1396/1902] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:13 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:13.961948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bdabee33-2e01-4073-8937-a5b7f4406dde tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:13.962572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bdabee33-2e01-4073-8937-a5b7f4406dde tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:13.969172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdabee33-2e01-4073-8937-a5b7f4406dde tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.969668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdabee33-2e01-4073-8937-a5b7f4406dde tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.970111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdabee33-2e01-4073-8937-a5b7f4406dde tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:13.970806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdabee33-2e01-4073-8937-a5b7f4406dde tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:13.971263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdabee33-2e01-4073-8937-a5b7f4406dde tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:13.971693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdabee33-2e01-4073-8937-a5b7f4406dde tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:14.103778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bdabee33-2e01-4073-8937-a5b7f4406dde tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:14.112003 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bdabee33-2e01-4073-8937-a5b7f4406dde tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1314 microversion: 2.1 time: 0.153872 Sep 10 10:44:14.113133 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1397/1903] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:13 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:14.117550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-75944068-16a4-48d9-b654-302fadcf731c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:14.118168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-75944068-16a4-48d9-b654-302fadcf731c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:14.124317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75944068-16a4-48d9-b654-302fadcf731c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:14.124878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75944068-16a4-48d9-b654-302fadcf731c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:14.125411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75944068-16a4-48d9-b654-302fadcf731c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:14.126389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75944068-16a4-48d9-b654-302fadcf731c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:14.126918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75944068-16a4-48d9-b654-302fadcf731c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:14.127610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75944068-16a4-48d9-b654-302fadcf731c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:14.270545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-75944068-16a4-48d9-b654-302fadcf731c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:14.278909 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-75944068-16a4-48d9-b654-302fadcf731c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.165131 Sep 10 10:44:14.279494 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1398/1904] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:14 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:14.284201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c29618d-42ad-4aca-9010-f8264e21d255 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:14.284808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c29618d-42ad-4aca-9010-f8264e21d255 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:14.290448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c29618d-42ad-4aca-9010-f8264e21d255 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:14.290930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c29618d-42ad-4aca-9010-f8264e21d255 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:14.291363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c29618d-42ad-4aca-9010-f8264e21d255 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:14.292105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c29618d-42ad-4aca-9010-f8264e21d255 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:14.292562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c29618d-42ad-4aca-9010-f8264e21d255 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:14.292988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c29618d-42ad-4aca-9010-f8264e21d255 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:14.311235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:14.434106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c29618d-42ad-4aca-9010-f8264e21d255 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:14.442178 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c29618d-42ad-4aca-9010-f8264e21d255 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1211 microversion: 2.1 time: 0.161705 Sep 10 10:44:14.442753 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1399/1905] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:14 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1211 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:14.447422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d789cf63-9378-4a3b-b504-ba9b0be77ae4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:14.448286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d789cf63-9378-4a3b-b504-ba9b0be77ae4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:14.454350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d789cf63-9378-4a3b-b504-ba9b0be77ae4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:14.454957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d789cf63-9378-4a3b-b504-ba9b0be77ae4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:14.455516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d789cf63-9378-4a3b-b504-ba9b0be77ae4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:14.456215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d789cf63-9378-4a3b-b504-ba9b0be77ae4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:14.456678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d789cf63-9378-4a3b-b504-ba9b0be77ae4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:14.457127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d789cf63-9378-4a3b-b504-ba9b0be77ae4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:14.648084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d789cf63-9378-4a3b-b504-ba9b0be77ae4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:14.661631 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d789cf63-9378-4a3b-b504-ba9b0be77ae4 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1492 microversion: 2.1 time: 0.217819 Sep 10 10:44:14.662421 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1400/1906] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:14 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1492 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:14.677399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a337457a-072e-44fc-9d5b-4723b703ebc2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:14.678296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a337457a-072e-44fc-9d5b-4723b703ebc2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:14.684955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a337457a-072e-44fc-9d5b-4723b703ebc2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:14.685665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a337457a-072e-44fc-9d5b-4723b703ebc2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:14.686103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a337457a-072e-44fc-9d5b-4723b703ebc2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:14.686798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a337457a-072e-44fc-9d5b-4723b703ebc2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:14.687243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a337457a-072e-44fc-9d5b-4723b703ebc2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:14.687882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a337457a-072e-44fc-9d5b-4723b703ebc2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:14.884103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a337457a-072e-44fc-9d5b-4723b703ebc2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:14.894094 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a337457a-072e-44fc-9d5b-4723b703ebc2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.230348 Sep 10 10:44:14.895347 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1401/1907] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:14 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:14.899119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ba4f7e53-2246-41fd-b62b-50d001f567e5 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:14.899869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ba4f7e53-2246-41fd-b62b-50d001f567e5 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:14.906026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba4f7e53-2246-41fd-b62b-50d001f567e5 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:14.906523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba4f7e53-2246-41fd-b62b-50d001f567e5 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:14.906963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba4f7e53-2246-41fd-b62b-50d001f567e5 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:14.907664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba4f7e53-2246-41fd-b62b-50d001f567e5 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:14.908374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba4f7e53-2246-41fd-b62b-50d001f567e5 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:14.908797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba4f7e53-2246-41fd-b62b-50d001f567e5 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:15.059568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ba4f7e53-2246-41fd-b62b-50d001f567e5 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:15.067322 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ba4f7e53-2246-41fd-b62b-50d001f567e5 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1402 microversion: 2.1 time: 0.171650 Sep 10 10:44:15.068637 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1402/1908] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:14 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1402 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:15.073462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf66507e-a1a3-4eae-9115-4c9c2f7c9c61 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:15.074161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bf66507e-a1a3-4eae-9115-4c9c2f7c9c61 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:15.080432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66507e-a1a3-4eae-9115-4c9c2f7c9c61 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:15.080998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66507e-a1a3-4eae-9115-4c9c2f7c9c61 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:15.081696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66507e-a1a3-4eae-9115-4c9c2f7c9c61 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:15.082506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66507e-a1a3-4eae-9115-4c9c2f7c9c61 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:15.083457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66507e-a1a3-4eae-9115-4c9c2f7c9c61 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:15.083457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf66507e-a1a3-4eae-9115-4c9c2f7c9c61 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:15.248118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bf66507e-a1a3-4eae-9115-4c9c2f7c9c61 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:15.258479 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf66507e-a1a3-4eae-9115-4c9c2f7c9c61 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.189375 Sep 10 10:44:15.259190 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1403/1909] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:15 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:15.280219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-da7a12bb-015c-4ab6-ad79-31a0f5cdf053 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:15.281236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-da7a12bb-015c-4ab6-ad79-31a0f5cdf053 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:15.290020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7a12bb-015c-4ab6-ad79-31a0f5cdf053 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:15.293125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7a12bb-015c-4ab6-ad79-31a0f5cdf053 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:15.293125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7a12bb-015c-4ab6-ad79-31a0f5cdf053 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:15.293369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7a12bb-015c-4ab6-ad79-31a0f5cdf053 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:15.293865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7a12bb-015c-4ab6-ad79-31a0f5cdf053 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:15.294728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7a12bb-015c-4ab6-ad79-31a0f5cdf053 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:15.533997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-da7a12bb-015c-4ab6-ad79-31a0f5cdf053 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:15.542168 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-da7a12bb-015c-4ab6-ad79-31a0f5cdf053 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1314 microversion: 2.1 time: 0.269026 Sep 10 10:44:15.557325 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1404/1910] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:15 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:15.557325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7baa02c0-dd0c-42be-a3c2-7113ce30e4a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:15.557325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7baa02c0-dd0c-42be-a3c2-7113ce30e4a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:15.559507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7baa02c0-dd0c-42be-a3c2-7113ce30e4a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:15.560020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7baa02c0-dd0c-42be-a3c2-7113ce30e4a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:15.560812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7baa02c0-dd0c-42be-a3c2-7113ce30e4a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:15.562391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7baa02c0-dd0c-42be-a3c2-7113ce30e4a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:15.562874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7baa02c0-dd0c-42be-a3c2-7113ce30e4a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:15.563601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7baa02c0-dd0c-42be-a3c2-7113ce30e4a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:15.821555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7baa02c0-dd0c-42be-a3c2-7113ce30e4a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:15.831906 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7baa02c0-dd0c-42be-a3c2-7113ce30e4a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.288033 Sep 10 10:44:15.847557 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1405/1911] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:15 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:15.847557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ca9fcdec-f6a9-463d-85ae-f8b46c144e92 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:15.847557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ca9fcdec-f6a9-463d-85ae-f8b46c144e92 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:15.847557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9fcdec-f6a9-463d-85ae-f8b46c144e92 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:15.847557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9fcdec-f6a9-463d-85ae-f8b46c144e92 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:15.847557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9fcdec-f6a9-463d-85ae-f8b46c144e92 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:15.847557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9fcdec-f6a9-463d-85ae-f8b46c144e92 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:15.847557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9fcdec-f6a9-463d-85ae-f8b46c144e92 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:15.847557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9fcdec-f6a9-463d-85ae-f8b46c144e92 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:15.997915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ca9fcdec-f6a9-463d-85ae-f8b46c144e92 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:16.006220 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ca9fcdec-f6a9-463d-85ae-f8b46c144e92 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1199 microversion: 2.1 time: 0.172142 Sep 10 10:44:16.009126 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1406/1912] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:15 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1199 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:16.012488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d55d6869-a1c0-4b02-8f3b-4b36fe6a3805 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:16.013209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d55d6869-a1c0-4b02-8f3b-4b36fe6a3805 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:16.019498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55d6869-a1c0-4b02-8f3b-4b36fe6a3805 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.020285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55d6869-a1c0-4b02-8f3b-4b36fe6a3805 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.020749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55d6869-a1c0-4b02-8f3b-4b36fe6a3805 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.021551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55d6869-a1c0-4b02-8f3b-4b36fe6a3805 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.022074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55d6869-a1c0-4b02-8f3b-4b36fe6a3805 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.022595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55d6869-a1c0-4b02-8f3b-4b36fe6a3805 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.088025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d55d6869-a1c0-4b02-8f3b-4b36fe6a3805 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:16.096642 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d55d6869-a1c0-4b02-8f3b-4b36fe6a3805 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1450 microversion: 2.1 time: 0.088763 Sep 10 10:44:16.097261 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1407/1913] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:16 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1450 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:16.101904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-95f59ad1-1275-4cc8-9e8c-0611ab5e04f5 req-2794510b-c619-4aad-94e4-06580153bfaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c", "name": "network-vif-unplugged", "status": "completed", "tag": "0c509438-2c28-43d2-8814-2f51dec08ea5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:16.111260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-95f59ad1-1275-4cc8-9e8c-0611ab5e04f5 req-2794510b-c619-4aad-94e4-06580153bfaa service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.111747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-95f59ad1-1275-4cc8-9e8c-0611ab5e04f5 req-2794510b-c619-4aad-94e4-06580153bfaa service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.112183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-95f59ad1-1275-4cc8-9e8c-0611ab5e04f5 req-2794510b-c619-4aad-94e4-06580153bfaa service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.125245 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-95f59ad1-1275-4cc8-9e8c-0611ab5e04f5 req-2794510b-c619-4aad-94e4-06580153bfaa service nova] Creating event network-vif-unplugged:0c509438-2c28-43d2-8814-2f51dec08ea5 for instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c on n-h2-856894-1 Sep 10 10:44:16.130129 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-95f59ad1-1275-4cc8-9e8c-0611ab5e04f5 req-2794510b-c619-4aad-94e4-06580153bfaa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031775 Sep 10 10:44:16.130906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1408/1914] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:16.261045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-dd9ac12b-d38f-43cc-bc05-51ca364f435b req-ba0bf618-1569-49c8-b4aa-c58127c7c291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c", "name": "network-vif-deleted", "tag": "0c509438-2c28-43d2-8814-2f51dec08ea5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:16.271345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dd9ac12b-d38f-43cc-bc05-51ca364f435b req-ba0bf618-1569-49c8-b4aa-c58127c7c291 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.271823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dd9ac12b-d38f-43cc-bc05-51ca364f435b req-ba0bf618-1569-49c8-b4aa-c58127c7c291 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.272252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dd9ac12b-d38f-43cc-bc05-51ca364f435b req-ba0bf618-1569-49c8-b4aa-c58127c7c291 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.285666 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-dd9ac12b-d38f-43cc-bc05-51ca364f435b req-ba0bf618-1569-49c8-b4aa-c58127c7c291 service nova] Creating event network-vif-deleted:0c509438-2c28-43d2-8814-2f51dec08ea5 for instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c on n-h2-856894-1 Sep 10 10:44:16.290460 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-dd9ac12b-d38f-43cc-bc05-51ca364f435b req-ba0bf618-1569-49c8-b4aa-c58127c7c291 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158410 Sep 10 10:44:16.291096 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1409/1915] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:16.296678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb92dc90-fc23-4ce2-8df5-11c3de51cb43 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:16.297398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cb92dc90-fc23-4ce2-8df5-11c3de51cb43 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:16.303527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb92dc90-fc23-4ce2-8df5-11c3de51cb43 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.304016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb92dc90-fc23-4ce2-8df5-11c3de51cb43 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.304449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb92dc90-fc23-4ce2-8df5-11c3de51cb43 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.305164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb92dc90-fc23-4ce2-8df5-11c3de51cb43 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.305625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb92dc90-fc23-4ce2-8df5-11c3de51cb43 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.306053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb92dc90-fc23-4ce2-8df5-11c3de51cb43 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.443632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cb92dc90-fc23-4ce2-8df5-11c3de51cb43 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:16.451926 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb92dc90-fc23-4ce2-8df5-11c3de51cb43 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.159179 Sep 10 10:44:16.452509 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1410/1916] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:16 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:16.472854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-08c22158-46d7-4587-b863-99f052ae486b req-5339bc80-b8f7-4a66-a100-33a28262571d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405234b5-1d79-41cd-a7b3-39756579d91b", "tag": "2535e255-f38a-4ba7-9e5d-bb3080a3f2a2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:16.482780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-08c22158-46d7-4587-b863-99f052ae486b req-5339bc80-b8f7-4a66-a100-33a28262571d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.483256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-08c22158-46d7-4587-b863-99f052ae486b req-5339bc80-b8f7-4a66-a100-33a28262571d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.483687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-08c22158-46d7-4587-b863-99f052ae486b req-5339bc80-b8f7-4a66-a100-33a28262571d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.494968 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-08c22158-46d7-4587-b863-99f052ae486b req-5339bc80-b8f7-4a66-a100-33a28262571d service nova] Creating event network-changed:2535e255-f38a-4ba7-9e5d-bb3080a3f2a2 for instance 405234b5-1d79-41cd-a7b3-39756579d91b on n-h2-856894-1 Sep 10 10:44:16.499690 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-08c22158-46d7-4587-b863-99f052ae486b req-5339bc80-b8f7-4a66-a100-33a28262571d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033399 Sep 10 10:44:16.500285 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1411/1917] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:16.505405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c5d72ba6-a900-41af-94df-07e3b74704e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:16.506110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c5d72ba6-a900-41af-94df-07e3b74704e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:16.512692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5d72ba6-a900-41af-94df-07e3b74704e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.513204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5d72ba6-a900-41af-94df-07e3b74704e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.513644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5d72ba6-a900-41af-94df-07e3b74704e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.514333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5d72ba6-a900-41af-94df-07e3b74704e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.514789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5d72ba6-a900-41af-94df-07e3b74704e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.515214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5d72ba6-a900-41af-94df-07e3b74704e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.656140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5d72ba6-a900-41af-94df-07e3b74704e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:16.665687 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c5d72ba6-a900-41af-94df-07e3b74704e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1402 microversion: 2.1 time: 0.164129 Sep 10 10:44:16.666432 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1412/1918] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:16 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1402 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:16.672542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5740d88a-d190-4aed-9f19-1acacb3da5df tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:16.673458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5740d88a-d190-4aed-9f19-1acacb3da5df tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:16.680820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740d88a-d190-4aed-9f19-1acacb3da5df tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.681687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740d88a-d190-4aed-9f19-1acacb3da5df tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.682716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740d88a-d190-4aed-9f19-1acacb3da5df tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.683514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740d88a-d190-4aed-9f19-1acacb3da5df tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.684203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740d88a-d190-4aed-9f19-1acacb3da5df tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.684762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5740d88a-d190-4aed-9f19-1acacb3da5df tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.824516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5740d88a-d190-4aed-9f19-1acacb3da5df tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:16.833967 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5740d88a-d190-4aed-9f19-1acacb3da5df tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.165508 Sep 10 10:44:16.834676 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1413/1919] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:16 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:16.841799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ce2c9b4-9036-454f-b520-f3f21ea40a00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:16.842500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ce2c9b4-9036-454f-b520-f3f21ea40a00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:16.849997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ce2c9b4-9036-454f-b520-f3f21ea40a00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.849997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ce2c9b4-9036-454f-b520-f3f21ea40a00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.850236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ce2c9b4-9036-454f-b520-f3f21ea40a00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.850858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ce2c9b4-9036-454f-b520-f3f21ea40a00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:16.851388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ce2c9b4-9036-454f-b520-f3f21ea40a00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:16.851920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ce2c9b4-9036-454f-b520-f3f21ea40a00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:16.991470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ce2c9b4-9036-454f-b520-f3f21ea40a00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:16.999843 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ce2c9b4-9036-454f-b520-f3f21ea40a00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1314 microversion: 2.1 time: 0.163443 Sep 10 10:44:17.000432 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1414/1920] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:16 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:17.004920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8de0589c-eb00-42eb-b145-53c8f6fde27a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:17.005564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8de0589c-eb00-42eb-b145-53c8f6fde27a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:17.011319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de0589c-eb00-42eb-b145-53c8f6fde27a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.011812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de0589c-eb00-42eb-b145-53c8f6fde27a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.012255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de0589c-eb00-42eb-b145-53c8f6fde27a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.012949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de0589c-eb00-42eb-b145-53c8f6fde27a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.013435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de0589c-eb00-42eb-b145-53c8f6fde27a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.013873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de0589c-eb00-42eb-b145-53c8f6fde27a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.148245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8de0589c-eb00-42eb-b145-53c8f6fde27a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:17.156453 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8de0589c-eb00-42eb-b145-53c8f6fde27a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.154931 Sep 10 10:44:17.157048 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1415/1921] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:17 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:17.173346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e44e1d3-7276-4603-9e93-a605319c2b4a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:17.174053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e44e1d3-7276-4603-9e93-a605319c2b4a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:17.182733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e44e1d3-7276-4603-9e93-a605319c2b4a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.183717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e44e1d3-7276-4603-9e93-a605319c2b4a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.185332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e44e1d3-7276-4603-9e93-a605319c2b4a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.186458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e44e1d3-7276-4603-9e93-a605319c2b4a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.187244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e44e1d3-7276-4603-9e93-a605319c2b4a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.187868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e44e1d3-7276-4603-9e93-a605319c2b4a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.356614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e44e1d3-7276-4603-9e93-a605319c2b4a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:17.366541 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e44e1d3-7276-4603-9e93-a605319c2b4a tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1199 microversion: 2.1 time: 0.208216 Sep 10 10:44:17.381104 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1416/1922] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:17 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1199 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:17.381104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:17.381104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:17.381848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.382321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.382755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.384973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.384973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.385233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.421029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.421545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.421974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.422426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lazy-loading 'fault' on Instance uuid e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:44:17.468580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:17.472516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:17.480701 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb3f13e2-b5db-4bbd-9322-cfef280deaa5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1297 microversion: 2.1 time: 0.111849 Sep 10 10:44:17.488109 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1417/1923] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:17 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1297 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:17.491654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-168aa353-452b-444d-a550-d832f2aeee9a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:17.492327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-168aa353-452b-444d-a550-d832f2aeee9a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:17.498956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168aa353-452b-444d-a550-d832f2aeee9a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.499456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168aa353-452b-444d-a550-d832f2aeee9a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.499895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168aa353-452b-444d-a550-d832f2aeee9a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.500619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168aa353-452b-444d-a550-d832f2aeee9a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.501091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168aa353-452b-444d-a550-d832f2aeee9a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.501539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168aa353-452b-444d-a550-d832f2aeee9a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.645702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-168aa353-452b-444d-a550-d832f2aeee9a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:17.655101 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-168aa353-452b-444d-a550-d832f2aeee9a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.171786 Sep 10 10:44:17.655779 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1418/1924] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:17 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:17.689537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c45eb62b-e2cf-428d-918b-39cb555f4a13 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:17.691354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c45eb62b-e2cf-428d-918b-39cb555f4a13 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:17.699894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c45eb62b-e2cf-428d-918b-39cb555f4a13 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.700389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c45eb62b-e2cf-428d-918b-39cb555f4a13 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.700975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c45eb62b-e2cf-428d-918b-39cb555f4a13 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.701761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c45eb62b-e2cf-428d-918b-39cb555f4a13 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.702214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c45eb62b-e2cf-428d-918b-39cb555f4a13 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.702846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c45eb62b-e2cf-428d-918b-39cb555f4a13 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.856097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c45eb62b-e2cf-428d-918b-39cb555f4a13 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:17.867449 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c45eb62b-e2cf-428d-918b-39cb555f4a13 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1402 microversion: 2.1 time: 0.182162 Sep 10 10:44:17.868426 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1419/1925] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:17 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1402 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:44:17.874425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9962513-d209-45ff-ae33-014b3a90b563 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:17.875239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b9962513-d209-45ff-ae33-014b3a90b563 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:17.882146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9962513-d209-45ff-ae33-014b3a90b563 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.882872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9962513-d209-45ff-ae33-014b3a90b563 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.883693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9962513-d209-45ff-ae33-014b3a90b563 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:17.884701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9962513-d209-45ff-ae33-014b3a90b563 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:17.885241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9962513-d209-45ff-ae33-014b3a90b563 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:17.885961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9962513-d209-45ff-ae33-014b3a90b563 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.051457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9962513-d209-45ff-ae33-014b3a90b563 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:18.061018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b9962513-d209-45ff-ae33-014b3a90b563 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.191365 Sep 10 10:44:18.062005 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1420/1926] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:17 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:18.067576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f005293-5acc-4300-a325-c81555d974d9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:18.067576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f005293-5acc-4300-a325-c81555d974d9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:18.075334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f005293-5acc-4300-a325-c81555d974d9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.075957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f005293-5acc-4300-a325-c81555d974d9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.076556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f005293-5acc-4300-a325-c81555d974d9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.077335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f005293-5acc-4300-a325-c81555d974d9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.077861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f005293-5acc-4300-a325-c81555d974d9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.078295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f005293-5acc-4300-a325-c81555d974d9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.230067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3f005293-5acc-4300-a325-c81555d974d9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:18.240969 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f005293-5acc-4300-a325-c81555d974d9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1314 microversion: 2.1 time: 0.177645 Sep 10 10:44:18.241969 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1421/1927] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:18 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:18.247324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1aef5fbf-6889-44e9-a70c-4a6d6e54d845 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:18.247948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1aef5fbf-6889-44e9-a70c-4a6d6e54d845 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:18.256104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aef5fbf-6889-44e9-a70c-4a6d6e54d845 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.256627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aef5fbf-6889-44e9-a70c-4a6d6e54d845 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.257449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aef5fbf-6889-44e9-a70c-4a6d6e54d845 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.258458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aef5fbf-6889-44e9-a70c-4a6d6e54d845 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.258919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aef5fbf-6889-44e9-a70c-4a6d6e54d845 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.259381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aef5fbf-6889-44e9-a70c-4a6d6e54d845 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.421267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1aef5fbf-6889-44e9-a70c-4a6d6e54d845 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:18.429418 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1aef5fbf-6889-44e9-a70c-4a6d6e54d845 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.186354 Sep 10 10:44:18.430383 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1422/1928] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:18 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:18.435598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8dee1706-eba4-44de-91f4-efb304f33fc9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:18.436627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8dee1706-eba4-44de-91f4-efb304f33fc9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:18.443019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dee1706-eba4-44de-91f4-efb304f33fc9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.443508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dee1706-eba4-44de-91f4-efb304f33fc9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.443945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dee1706-eba4-44de-91f4-efb304f33fc9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.444880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dee1706-eba4-44de-91f4-efb304f33fc9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.445171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dee1706-eba4-44de-91f4-efb304f33fc9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.445731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dee1706-eba4-44de-91f4-efb304f33fc9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.462775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:18.510380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=26 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:18.628762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8dee1706-eba4-44de-91f4-efb304f33fc9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:18.655202 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8dee1706-eba4-44de-91f4-efb304f33fc9 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1199 microversion: 2.1 time: 0.222446 Sep 10 10:44:18.655826 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1423/1929] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:18 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1199 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:18.664483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:18.669920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:18.672704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.673452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.674146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.675232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.676094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.676743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.739587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.740540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.741255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.741898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lazy-loading 'fault' on Instance uuid e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:44:18.861188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75dc4bf3c30b42448e6dbea15579400e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302151fe6dda436ca654252333e7fc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:18.872902 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bdbb796b-a880-4ffa-bd00-948d3fdaefe9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 200 len: 1297 microversion: 2.1 time: 0.213237 Sep 10 10:44:18.883463 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1424/1930] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:18 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 1297 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:18.889623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed0e2615-0783-4396-b673-b21ebb2266b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:18.891383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed0e2615-0783-4396-b673-b21ebb2266b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:18.899423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0e2615-0783-4396-b673-b21ebb2266b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.901713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0e2615-0783-4396-b673-b21ebb2266b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.902180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0e2615-0783-4396-b673-b21ebb2266b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:18.902943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0e2615-0783-4396-b673-b21ebb2266b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:18.905996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0e2615-0783-4396-b673-b21ebb2266b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:18.917670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0e2615-0783-4396-b673-b21ebb2266b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:19.132083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed0e2615-0783-4396-b673-b21ebb2266b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:19.142441 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed0e2615-0783-4396-b673-b21ebb2266b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.257709 Sep 10 10:44:19.142942 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1425/1931] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:18 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:19.152033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f5ce71f-5bae-463c-b3a3-51502390db7a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:19.152649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f5ce71f-5bae-463c-b3a3-51502390db7a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:19.164856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f5ce71f-5bae-463c-b3a3-51502390db7a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:19.165391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f5ce71f-5bae-463c-b3a3-51502390db7a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:19.165826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f5ce71f-5bae-463c-b3a3-51502390db7a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:19.167352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f5ce71f-5bae-463c-b3a3-51502390db7a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:19.167805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f5ce71f-5bae-463c-b3a3-51502390db7a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:19.168378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f5ce71f-5bae-463c-b3a3-51502390db7a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:19.311958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f5ce71f-5bae-463c-b3a3-51502390db7a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:19.323330 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f5ce71f-5bae-463c-b3a3-51502390db7a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1402 microversion: 2.1 time: 0.179310 Sep 10 10:44:19.324236 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1426/1932] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:19 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1402 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:19.328686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ab77f10-1ba2-42a3-926b-c74e06fafa1f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:19.329334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3ab77f10-1ba2-42a3-926b-c74e06fafa1f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:19.342354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab77f10-1ba2-42a3-926b-c74e06fafa1f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:19.342854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab77f10-1ba2-42a3-926b-c74e06fafa1f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:19.343343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab77f10-1ba2-42a3-926b-c74e06fafa1f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:19.344039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab77f10-1ba2-42a3-926b-c74e06fafa1f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:19.344501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab77f10-1ba2-42a3-926b-c74e06fafa1f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:19.345131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab77f10-1ba2-42a3-926b-c74e06fafa1f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:19.534273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3ab77f10-1ba2-42a3-926b-c74e06fafa1f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:19.542865 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3ab77f10-1ba2-42a3-926b-c74e06fafa1f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1524 microversion: 2.1 time: 0.217815 Sep 10 10:44:19.543443 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1427/1933] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:19 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1524 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:19.573134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f148f1e5-3012-48c3-8f1c-42f4cb111f00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:19.573134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f148f1e5-3012-48c3-8f1c-42f4cb111f00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:19.579016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f148f1e5-3012-48c3-8f1c-42f4cb111f00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:19.579522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f148f1e5-3012-48c3-8f1c-42f4cb111f00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:19.579964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f148f1e5-3012-48c3-8f1c-42f4cb111f00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:19.580735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f148f1e5-3012-48c3-8f1c-42f4cb111f00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:19.581402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f148f1e5-3012-48c3-8f1c-42f4cb111f00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:19.581843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f148f1e5-3012-48c3-8f1c-42f4cb111f00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:19.861254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f148f1e5-3012-48c3-8f1c-42f4cb111f00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:19.870496 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f148f1e5-3012-48c3-8f1c-42f4cb111f00 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1500 microversion: 2.1 time: 0.311767 Sep 10 10:44:19.875771 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1428/1934] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:19 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1500 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:19.889911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6838d9ba-a167-4e92-82f3-5fdb818045f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:19.890729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6838d9ba-a167-4e92-82f3-5fdb818045f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:19.903645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6838d9ba-a167-4e92-82f3-5fdb818045f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:19.904476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6838d9ba-a167-4e92-82f3-5fdb818045f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:19.904991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6838d9ba-a167-4e92-82f3-5fdb818045f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:19.905803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6838d9ba-a167-4e92-82f3-5fdb818045f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:19.908228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6838d9ba-a167-4e92-82f3-5fdb818045f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:19.908855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6838d9ba-a167-4e92-82f3-5fdb818045f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.077273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6838d9ba-a167-4e92-82f3-5fdb818045f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:20.090434 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6838d9ba-a167-4e92-82f3-5fdb818045f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.213284 Sep 10 10:44:20.091314 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1429/1935] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:19 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:20.097671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-fd6fe17a-e92f-415a-afba-2aa5cb173226 req-366edbec-dcbb-46c8-92db-41cf69484bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178b8f2f-5352-4ae4-9f3e-bef5e366456d", "name": "network-vif-plugged", "status": "completed", "tag": "f2494b11-7317-47ca-a893-5644f4502288"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:20.109090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd6fe17a-e92f-415a-afba-2aa5cb173226 req-366edbec-dcbb-46c8-92db-41cf69484bb3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.109573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd6fe17a-e92f-415a-afba-2aa5cb173226 req-366edbec-dcbb-46c8-92db-41cf69484bb3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.110033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd6fe17a-e92f-415a-afba-2aa5cb173226 req-366edbec-dcbb-46c8-92db-41cf69484bb3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.122871 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-fd6fe17a-e92f-415a-afba-2aa5cb173226 req-366edbec-dcbb-46c8-92db-41cf69484bb3 service nova] Creating event network-vif-plugged:f2494b11-7317-47ca-a893-5644f4502288 for instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d on n-h2-856894-1 Sep 10 10:44:20.129309 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-fd6fe17a-e92f-415a-afba-2aa5cb173226 req-366edbec-dcbb-46c8-92db-41cf69484bb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036292 Sep 10 10:44:20.130230 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1430/1936] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:20.136346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7283a2b-2a32-490b-bd15-13607ed1c18c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:20.137059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7283a2b-2a32-490b-bd15-13607ed1c18c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:20.144204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7283a2b-2a32-490b-bd15-13607ed1c18c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.144676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7283a2b-2a32-490b-bd15-13607ed1c18c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.145140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7283a2b-2a32-490b-bd15-13607ed1c18c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.146002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7283a2b-2a32-490b-bd15-13607ed1c18c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.146562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7283a2b-2a32-490b-bd15-13607ed1c18c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.146995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7283a2b-2a32-490b-bd15-13607ed1c18c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.397242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e7283a2b-2a32-490b-bd15-13607ed1c18c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:20.412867 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7283a2b-2a32-490b-bd15-13607ed1c18c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1199 microversion: 2.1 time: 0.280822 Sep 10 10:44:20.425166 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1431/1937] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:20 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1199 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:20.433778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:20.434496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:20.445135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.446426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.446883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.448784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.449045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.449519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.468922 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c could not be found. Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c HTTP/1.1 Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c could not be found. Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c'} Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c could not be found. Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c could not be found. Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:20.470770 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:20.475513 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:20.475513 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:20.475513 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:20.475513 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:20.475513 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c could not be found. Sep 10 10:44:20.475513 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:20.475513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Instance e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:20.475513 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-04d0d509-b093-47e6-8d68-eb967df07ae5 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c" status: 404 len: 111 microversion: 2.1 time: 0.047089 Sep 10 10:44:20.476189 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1432/1938] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:20 2022] GET /compute/v2.1/servers/e4a00dd7-0f0c-4da7-b8c5-66a90a778c0c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:44:20.481558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc32c832-21d6-476c-89d8-5afd04948734 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:20.482254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fc32c832-21d6-476c-89d8-5afd04948734 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:20.490378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc32c832-21d6-476c-89d8-5afd04948734 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.491023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc32c832-21d6-476c-89d8-5afd04948734 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.491473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc32c832-21d6-476c-89d8-5afd04948734 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.492338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc32c832-21d6-476c-89d8-5afd04948734 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.492803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc32c832-21d6-476c-89d8-5afd04948734 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.493317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc32c832-21d6-476c-89d8-5afd04948734 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.526769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-fc32c832-21d6-476c-89d8-5afd04948734 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lazy-loading 'flavor' on Instance uuid aae35632-52bf-4dd6-88fb-b4419eab5073 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:44:20.595367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:20.739694 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc32c832-21d6-476c-89d8-5afd04948734 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073/action" status: 202 len: 0 microversion: 2.1 time: 0.262265 Sep 10 10:44:20.740278 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1433/1939] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:20 2022] POST /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:44:20.746656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-958495c8-9b26-4b52-9f92-acd98c60c63f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:20.747350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-958495c8-9b26-4b52-9f92-acd98c60c63f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:20.749310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:20.754919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-958495c8-9b26-4b52-9f92-acd98c60c63f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.755401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-958495c8-9b26-4b52-9f92-acd98c60c63f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.755835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-958495c8-9b26-4b52-9f92-acd98c60c63f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.756516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-958495c8-9b26-4b52-9f92-acd98c60c63f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.756965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-958495c8-9b26-4b52-9f92-acd98c60c63f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.757409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-958495c8-9b26-4b52-9f92-acd98c60c63f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.935117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-958495c8-9b26-4b52-9f92-acd98c60c63f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:20.945417 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-958495c8-9b26-4b52-9f92-acd98c60c63f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.203854 Sep 10 10:44:20.948591 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1434/1940] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:20 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:20.959838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32897838-7ef0-4fc3-a4eb-2a09ea51274f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:20.960688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-32897838-7ef0-4fc3-a4eb-2a09ea51274f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:20.976836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32897838-7ef0-4fc3-a4eb-2a09ea51274f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.977371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32897838-7ef0-4fc3-a4eb-2a09ea51274f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.977814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32897838-7ef0-4fc3-a4eb-2a09ea51274f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:20.979116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32897838-7ef0-4fc3-a4eb-2a09ea51274f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:20.979653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32897838-7ef0-4fc3-a4eb-2a09ea51274f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:20.980088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32897838-7ef0-4fc3-a4eb-2a09ea51274f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:21.123405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-32897838-7ef0-4fc3-a4eb-2a09ea51274f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:21.131320 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-32897838-7ef0-4fc3-a4eb-2a09ea51274f tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1402 microversion: 2.1 time: 0.179196 Sep 10 10:44:21.131912 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1435/1941] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:20 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1402 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:21.136428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56a126ec-82e0-469e-8ba8-d787605c296c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae7e0430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:21.159898 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-56a126ec-82e0-469e-8ba8-d787605c296c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Image not found. Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56a126ec-82e0-469e-8ba8-d787605c296c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 HTTP/1.1 Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '31b7fb06-6327-4131-9d35-25f45eb24799'} Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 31b7fb06-6327-4131-9d35-25f45eb24799 to delete Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 31b7fb06-6327-4131-9d35-25f45eb24799 could not be found. Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.161873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56a126ec-82e0-469e-8ba8-d787605c296c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56a126ec-82e0-469e-8ba8-d787605c296c tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799" status: 404 len: 62 microversion: 2.1 time: 0.030451 Sep 10 10:44:21.165474 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1436/1942] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:21 2022] DELETE /compute/v2.1/images/31b7fb06-6327-4131-9d35-25f45eb24799 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:44:21.169745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38f2849d-2bb2-4619-88e1-5883fbd40a2a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:21.170354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38f2849d-2bb2-4619-88e1-5883fbd40a2a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:21.177003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f2849d-2bb2-4619-88e1-5883fbd40a2a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:21.177771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f2849d-2bb2-4619-88e1-5883fbd40a2a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:21.177948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f2849d-2bb2-4619-88e1-5883fbd40a2a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:21.178637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f2849d-2bb2-4619-88e1-5883fbd40a2a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:21.179087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f2849d-2bb2-4619-88e1-5883fbd40a2a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:21.179507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f2849d-2bb2-4619-88e1-5883fbd40a2a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:21.307826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38f2849d-2bb2-4619-88e1-5883fbd40a2a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:21.315654 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38f2849d-2bb2-4619-88e1-5883fbd40a2a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1504 microversion: 2.1 time: 0.150891 Sep 10 10:44:21.316236 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1437/1943] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:21 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:21.320879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ecce214-43a6-4d41-aa39-4c7f605d7460 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:21.321520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ecce214-43a6-4d41-aa39-4c7f605d7460 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:21.328088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ecce214-43a6-4d41-aa39-4c7f605d7460 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:21.328577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ecce214-43a6-4d41-aa39-4c7f605d7460 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:21.329013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ecce214-43a6-4d41-aa39-4c7f605d7460 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:21.329741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ecce214-43a6-4d41-aa39-4c7f605d7460 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:21.330198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ecce214-43a6-4d41-aa39-4c7f605d7460 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:21.330625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ecce214-43a6-4d41-aa39-4c7f605d7460 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:21.477352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ecce214-43a6-4d41-aa39-4c7f605d7460 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:21.485667 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ecce214-43a6-4d41-aa39-4c7f605d7460 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.168467 Sep 10 10:44:21.486245 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1438/1944] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:21 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:21.490706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-726d5cb4-6a21-4add-aa70-ecd8a212bb21 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:21.491317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-726d5cb4-6a21-4add-aa70-ecd8a212bb21 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:21.498040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726d5cb4-6a21-4add-aa70-ecd8a212bb21 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:21.498531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726d5cb4-6a21-4add-aa70-ecd8a212bb21 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:21.498966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726d5cb4-6a21-4add-aa70-ecd8a212bb21 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:21.500172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726d5cb4-6a21-4add-aa70-ecd8a212bb21 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:21.500172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726d5cb4-6a21-4add-aa70-ecd8a212bb21 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:21.500516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726d5cb4-6a21-4add-aa70-ecd8a212bb21 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:21.639127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-726d5cb4-6a21-4add-aa70-ecd8a212bb21 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:21.647495 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-726d5cb4-6a21-4add-aa70-ecd8a212bb21 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.160199 Sep 10 10:44:21.661107 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1439/1945] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:21 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:21.661107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:21.661107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:21.661664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:21.662164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:21.662776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:21.663482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:21.663942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:21.664372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:21.679729 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 HTTP/1.1 Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '69b22547-e130-45f7-8f9c-fb57446ab4c7'} Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:44:21.681253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ebea37d4-4ba4-4e31-b33d-d4a04289ebf9 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 404 len: 111 microversion: 2.1 time: 0.033993 Sep 10 10:44:21.685476 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1440/1946] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:44:21 2022] DELETE /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:44:21.694003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05cf2d98-0a48-4c7b-8ad1-3978b67a7dba tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Action: 'create', calling method: .version_select at 0x7efcae7e01f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-288660967", "description": "tempest-description-1518556807"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:21.847341 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05cf2d98-0a48-4c7b-8ad1-3978b67a7dba tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.162362 Sep 10 10:44:21.849233 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1441/1947] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:44:21 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:21.858264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b7d81d8-5a88-4cd1-8e56-250234a90087 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:21.859026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b7d81d8-5a88-4cd1-8e56-250234a90087 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:21.866022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7d81d8-5a88-4cd1-8e56-250234a90087 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:21.866828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7d81d8-5a88-4cd1-8e56-250234a90087 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:21.868694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7d81d8-5a88-4cd1-8e56-250234a90087 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:21.869606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7d81d8-5a88-4cd1-8e56-250234a90087 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:21.870280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7d81d8-5a88-4cd1-8e56-250234a90087 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:21.871500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7d81d8-5a88-4cd1-8e56-250234a90087 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:22.012103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b7d81d8-5a88-4cd1-8e56-250234a90087 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:22.020046 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b7d81d8-5a88-4cd1-8e56-250234a90087 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1199 microversion: 2.1 time: 0.169384 Sep 10 10:44:22.036695 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1442/1948] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:21 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1199 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:22.036695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:22.036695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 69b22547-e130-45f7-8f9c-fb57446ab4c7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:22.045495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:22.047666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:22.047666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:22.048203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:22.048871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:22.049538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:22.066040 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 HTTP/1.1 Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '69b22547-e130-45f7-8f9c-fb57446ab4c7'} Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.067697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:22.071321 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:22.071321 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:22.071321 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:22.071321 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:22.071321 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. Sep 10 10:44:22.071321 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.071321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Instance 69b22547-e130-45f7-8f9c-fb57446ab4c7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:22.071321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf67aead-33aa-4ab5-9bb2-16eb0f3baf66 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7" status: 404 len: 111 microversion: 2.1 time: 0.047335 Sep 10 10:44:22.071321 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1443/1949] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:22 2022] GET /compute/v2.1/servers/69b22547-e130-45f7-8f9c-fb57446ab4c7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:44:22.075153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4296464e-653f-44bd-9755-cc651fd4b6a9 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-288660967"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:22.075706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4296464e-653f-44bd-9755-cc651fd4b6a9 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:22.081810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4296464e-653f-44bd-9755-cc651fd4b6a9 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:22.082573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4296464e-653f-44bd-9755-cc651fd4b6a9 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:22.083155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4296464e-653f-44bd-9755-cc651fd4b6a9 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:22.084100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4296464e-653f-44bd-9755-cc651fd4b6a9 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:22.084565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4296464e-653f-44bd-9755-cc651fd4b6a9 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:22.084999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4296464e-653f-44bd-9755-cc651fd4b6a9 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:22.217354 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.network.security_group_api [None req-4296464e-653f-44bd-9755-cc651fd4b6a9 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Adding security group 02f9e0d0-a869-4914-9b8a-57ad2df088c8 to port 3086246d-f560-41ce-b858-9f9eb7fa8433 Sep 10 10:44:22.591660 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4296464e-653f-44bd-9755-cc651fd4b6a9 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "POST /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377/action" status: 202 len: 0 microversion: 2.1 time: 0.519616 Sep 10 10:44:22.591660 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1444/1950] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:22 2022] POST /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:44:22.597779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e7df027-6c45-4ae2-9839-e9634bbab097 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:22.598411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e7df027-6c45-4ae2-9839-e9634bbab097 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:22.607765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e7df027-6c45-4ae2-9839-e9634bbab097 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:22.608459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e7df027-6c45-4ae2-9839-e9634bbab097 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:22.608897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e7df027-6c45-4ae2-9839-e9634bbab097 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:22.609795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e7df027-6c45-4ae2-9839-e9634bbab097 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:22.611016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e7df027-6c45-4ae2-9839-e9634bbab097 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:22.611760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e7df027-6c45-4ae2-9839-e9634bbab097 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:22.770229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e7df027-6c45-4ae2-9839-e9634bbab097 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:22.780861 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e7df027-6c45-4ae2-9839-e9634bbab097 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.187487 Sep 10 10:44:22.780861 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1445/1951] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:22 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:22.786678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f12baab5-427b-45bf-a8fd-1f0039012f4b tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae8358b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:22.810704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f12baab5-427b-45bf-a8fd-1f0039012f4b tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Image not found. Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f12baab5-427b-45bf-a8fd-1f0039012f4b tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07 HTTP/1.1 Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'c167faa6-43f7-427c-87e6-bebdd95bfd07'} Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c167faa6-43f7-427c-87e6-bebdd95bfd07 to delete Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c167faa6-43f7-427c-87e6-bebdd95bfd07 could not be found. Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.812593 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f12baab5-427b-45bf-a8fd-1f0039012f4b tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:22.817821 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f12baab5-427b-45bf-a8fd-1f0039012f4b tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07" status: 404 len: 62 microversion: 2.1 time: 0.035489 Sep 10 10:44:22.821396 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1446/1952] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:22 2022] DELETE /compute/v2.1/images/c167faa6-43f7-427c-87e6-bebdd95bfd07 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:44:22.826131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7d837920-b3e9-4694-955d-f00502df1efc tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:22.827003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7d837920-b3e9-4694-955d-f00502df1efc tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:22.834504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d837920-b3e9-4694-955d-f00502df1efc tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:22.834998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d837920-b3e9-4694-955d-f00502df1efc tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:22.835466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d837920-b3e9-4694-955d-f00502df1efc tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:22.836167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d837920-b3e9-4694-955d-f00502df1efc tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:22.836622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d837920-b3e9-4694-955d-f00502df1efc tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:22.837251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d837920-b3e9-4694-955d-f00502df1efc tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:22.988596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7d837920-b3e9-4694-955d-f00502df1efc tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:22.998337 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7d837920-b3e9-4694-955d-f00502df1efc tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1402 microversion: 2.1 time: 0.176011 Sep 10 10:44:22.999060 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1447/1953] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:22 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1402 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:23.005459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f2d23b5-8cce-412d-81db-f46a53f113c9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:23.006575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f2d23b5-8cce-412d-81db-f46a53f113c9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:23.016671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2d23b5-8cce-412d-81db-f46a53f113c9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:23.017353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2d23b5-8cce-412d-81db-f46a53f113c9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:23.017621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2d23b5-8cce-412d-81db-f46a53f113c9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:23.018332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2d23b5-8cce-412d-81db-f46a53f113c9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:23.018796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2d23b5-8cce-412d-81db-f46a53f113c9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:23.019230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2d23b5-8cce-412d-81db-f46a53f113c9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:23.150175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f2d23b5-8cce-412d-81db-f46a53f113c9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:23.158776 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f2d23b5-8cce-412d-81db-f46a53f113c9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.158185 Sep 10 10:44:23.159349 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1448/1954] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:22 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:23.163907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b733470-0801-419f-a11c-b100dcf2b476 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-288660967"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:23.164691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b733470-0801-419f-a11c-b100dcf2b476 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:23.171566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b733470-0801-419f-a11c-b100dcf2b476 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:23.172054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b733470-0801-419f-a11c-b100dcf2b476 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:23.172526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b733470-0801-419f-a11c-b100dcf2b476 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:23.173346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b733470-0801-419f-a11c-b100dcf2b476 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:23.173750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b733470-0801-419f-a11c-b100dcf2b476 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:23.174173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b733470-0801-419f-a11c-b100dcf2b476 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:23.303127 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.network.security_group_api [None req-0b733470-0801-419f-a11c-b100dcf2b476 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Removing security group 02f9e0d0-a869-4914-9b8a-57ad2df088c8 from port 3086246d-f560-41ce-b858-9f9eb7fa8433 Sep 10 10:44:23.642892 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b733470-0801-419f-a11c-b100dcf2b476 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "POST /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377/action" status: 202 len: 0 microversion: 2.1 time: 0.477111 Sep 10 10:44:23.648209 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1449/1955] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:23 2022] POST /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:44:23.653030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a8235750-159d-4d78-9679-c8f13d38b903 req-78f99120-375e-4328-b393-cece2d9c7960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147a5ac3-709e-43e4-89d3-ce745514c377", "tag": "3086246d-f560-41ce-b858-9f9eb7fa8433"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:23.662956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a8235750-159d-4d78-9679-c8f13d38b903 req-78f99120-375e-4328-b393-cece2d9c7960 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:23.663438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a8235750-159d-4d78-9679-c8f13d38b903 req-78f99120-375e-4328-b393-cece2d9c7960 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:23.664269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a8235750-159d-4d78-9679-c8f13d38b903 req-78f99120-375e-4328-b393-cece2d9c7960 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:23.679098 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a8235750-159d-4d78-9679-c8f13d38b903 req-78f99120-375e-4328-b393-cece2d9c7960 service nova] Creating event network-changed:3086246d-f560-41ce-b858-9f9eb7fa8433 for instance 147a5ac3-709e-43e4-89d3-ce745514c377 on n-h2-856894-1 Sep 10 10:44:23.686482 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a8235750-159d-4d78-9679-c8f13d38b903 req-78f99120-375e-4328-b393-cece2d9c7960 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036971 Sep 10 10:44:23.687474 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1450/1956] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:23.692772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-81483b6a-06d6-418e-90c5-f2c7b9c110ee tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:23.693688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-81483b6a-06d6-418e-90c5-f2c7b9c110ee tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:23.701046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81483b6a-06d6-418e-90c5-f2c7b9c110ee tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:23.701462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81483b6a-06d6-418e-90c5-f2c7b9c110ee tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:23.701844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81483b6a-06d6-418e-90c5-f2c7b9c110ee tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:23.702656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81483b6a-06d6-418e-90c5-f2c7b9c110ee tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:23.702993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81483b6a-06d6-418e-90c5-f2c7b9c110ee tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:23.703570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81483b6a-06d6-418e-90c5-f2c7b9c110ee tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:23.943041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-81483b6a-06d6-418e-90c5-f2c7b9c110ee tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:23.958693 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-81483b6a-06d6-418e-90c5-f2c7b9c110ee tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.269968 Sep 10 10:44:23.959899 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1451/1957] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:23 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:23.980844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:23.981785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:23.988644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:23.989174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:23.989621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:23.990323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:23.990782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:23.991208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:24.005798 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 HTTP/1.1 Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'bdbfd4c5-e209-4e86-a0dd-00738c53b9b3'} Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:44:24.007511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0124c059-cd67-4a55-bd95-58651340be35 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 404 len: 111 microversion: 2.1 time: 0.036807 Sep 10 10:44:24.011282 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1452/1958] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:44:23 2022] DELETE /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:44:24.014639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-993f547d-316b-4ccf-88f5-9905c58ce293 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:24.015269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-993f547d-316b-4ccf-88f5-9905c58ce293 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:24.021691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993f547d-316b-4ccf-88f5-9905c58ce293 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:24.022310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993f547d-316b-4ccf-88f5-9905c58ce293 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:24.022621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993f547d-316b-4ccf-88f5-9905c58ce293 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:24.023334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993f547d-316b-4ccf-88f5-9905c58ce293 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:24.023796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993f547d-316b-4ccf-88f5-9905c58ce293 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:24.024658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993f547d-316b-4ccf-88f5-9905c58ce293 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:24.202860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-993f547d-316b-4ccf-88f5-9905c58ce293 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:24.211371 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-993f547d-316b-4ccf-88f5-9905c58ce293 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1382 microversion: 2.1 time: 0.200597 Sep 10 10:44:24.211930 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1453/1959] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:24 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1382 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:24.216937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc0de85c-a17b-4620-8341-8a6a9e1aeb0e tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Action: 'create', calling method: .version_select at 0x7efcae8f8040>, body: {"pool": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:25.873921 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc0de85c-a17b-4620-8341-8a6a9e1aeb0e tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.660343 Sep 10 10:44:25.875297 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1454/1960] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:44:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:25.881590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c9bbeec-b347-4d73-a1ad-3b0dc3729635 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:25.882650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c9bbeec-b347-4d73-a1ad-3b0dc3729635 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:25.891264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c9bbeec-b347-4d73-a1ad-3b0dc3729635 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:25.891747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c9bbeec-b347-4d73-a1ad-3b0dc3729635 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:25.892364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c9bbeec-b347-4d73-a1ad-3b0dc3729635 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:25.893331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c9bbeec-b347-4d73-a1ad-3b0dc3729635 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:25.893937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c9bbeec-b347-4d73-a1ad-3b0dc3729635 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:25.894677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c9bbeec-b347-4d73-a1ad-3b0dc3729635 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:26.105194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c9bbeec-b347-4d73-a1ad-3b0dc3729635 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:26.113030 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c9bbeec-b347-4d73-a1ad-3b0dc3729635 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.236597 Sep 10 10:44:26.125275 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1455/1961] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:25 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:26.125275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:26.125275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: bdbfd4c5-e209-4e86-a0dd-00738c53b9b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:26.125606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:26.125940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:26.127047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:26.127754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:26.128215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:26.128706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:26.142752 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 HTTP/1.1 Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'bdbfd4c5-e209-4e86-a0dd-00738c53b9b3'} Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:26.144221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:26.148388 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:26.148388 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:26.148388 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:26.148388 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:26.148388 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. Sep 10 10:44:26.148388 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:26.148388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Instance bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:26.148388 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-16b41c84-4c93-4a9d-a753-3fbf3b68906f tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3" status: 404 len: 111 microversion: 2.1 time: 0.031096 Sep 10 10:44:26.148388 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1456/1962] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:26 2022] GET /compute/v2.1/servers/bdbfd4c5-e209-4e86-a0dd-00738c53b9b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:44:26.151031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e45628f-726f-48f6-922e-9816026ab56e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:26.151642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e45628f-726f-48f6-922e-9816026ab56e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:26.157563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e45628f-726f-48f6-922e-9816026ab56e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:26.158317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e45628f-726f-48f6-922e-9816026ab56e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:26.158759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e45628f-726f-48f6-922e-9816026ab56e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:26.159461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e45628f-726f-48f6-922e-9816026ab56e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:26.159920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e45628f-726f-48f6-922e-9816026ab56e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:26.160349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e45628f-726f-48f6-922e-9816026ab56e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:26.390513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e45628f-726f-48f6-922e-9816026ab56e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:26.404876 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e45628f-726f-48f6-922e-9816026ab56e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1402 microversion: 2.1 time: 0.257497 Sep 10 10:44:26.417104 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1457/1963] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:26 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1402 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:26.417104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7dc7f4d6-da39-4a6e-b32e-cb965e24c04a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:26.417104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7dc7f4d6-da39-4a6e-b32e-cb965e24c04a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:26.418459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dc7f4d6-da39-4a6e-b32e-cb965e24c04a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:26.419298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dc7f4d6-da39-4a6e-b32e-cb965e24c04a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:26.419884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dc7f4d6-da39-4a6e-b32e-cb965e24c04a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:26.420726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dc7f4d6-da39-4a6e-b32e-cb965e24c04a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:26.421686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dc7f4d6-da39-4a6e-b32e-cb965e24c04a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:26.422290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7dc7f4d6-da39-4a6e-b32e-cb965e24c04a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:26.427308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:26.631753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7dc7f4d6-da39-4a6e-b32e-cb965e24c04a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:26.639432 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7dc7f4d6-da39-4a6e-b32e-cb965e24c04a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.232894 Sep 10 10:44:26.653494 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1458/1964] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:26 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:26.757627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-75fa6ea3-85b8-4171-b670-8377a8a2fd83 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:26.758244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-75fa6ea3-85b8-4171-b670-8377a8a2fd83 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:26.766189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75fa6ea3-85b8-4171-b670-8377a8a2fd83 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:26.766677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75fa6ea3-85b8-4171-b670-8377a8a2fd83 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:26.767116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75fa6ea3-85b8-4171-b670-8377a8a2fd83 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:26.767818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75fa6ea3-85b8-4171-b670-8377a8a2fd83 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:26.768268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75fa6ea3-85b8-4171-b670-8377a8a2fd83 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:26.768985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75fa6ea3-85b8-4171-b670-8377a8a2fd83 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:26.925762 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-75fa6ea3-85b8-4171-b670-8377a8a2fd83 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1533 microversion: 2.1 time: 0.284726 Sep 10 10:44:26.941200 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1459/1965] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:26 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1533 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:26.941200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a5a099ad-34e7-4874-8293-e905ef4cedf7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:26.941200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a5a099ad-34e7-4874-8293-e905ef4cedf7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:26.941200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a099ad-34e7-4874-8293-e905ef4cedf7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:26.941200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a099ad-34e7-4874-8293-e905ef4cedf7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:26.941200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a099ad-34e7-4874-8293-e905ef4cedf7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:26.941200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a099ad-34e7-4874-8293-e905ef4cedf7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:26.941200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a099ad-34e7-4874-8293-e905ef4cedf7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:26.941200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a099ad-34e7-4874-8293-e905ef4cedf7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:27.148340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a5a099ad-34e7-4874-8293-e905ef4cedf7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:27.156585 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a5a099ad-34e7-4874-8293-e905ef4cedf7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.229081 Sep 10 10:44:27.157191 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1460/1966] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:26 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:27.161884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-df4ecb38-9274-4df1-91b7-31479bcece45 req-e45d6b8a-469b-4406-a3e9-2348761d3ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147a5ac3-709e-43e4-89d3-ce745514c377", "tag": "3086246d-f560-41ce-b858-9f9eb7fa8433"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:27.170932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-df4ecb38-9274-4df1-91b7-31479bcece45 req-e45d6b8a-469b-4406-a3e9-2348761d3ef0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:27.171408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-df4ecb38-9274-4df1-91b7-31479bcece45 req-e45d6b8a-469b-4406-a3e9-2348761d3ef0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:27.171840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-df4ecb38-9274-4df1-91b7-31479bcece45 req-e45d6b8a-469b-4406-a3e9-2348761d3ef0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:27.183709 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-df4ecb38-9274-4df1-91b7-31479bcece45 req-e45d6b8a-469b-4406-a3e9-2348761d3ef0 service nova] Creating event network-changed:3086246d-f560-41ce-b858-9f9eb7fa8433 for instance 147a5ac3-709e-43e4-89d3-ce745514c377 on n-h2-856894-1 Sep 10 10:44:27.188503 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-df4ecb38-9274-4df1-91b7-31479bcece45 req-e45d6b8a-469b-4406-a3e9-2348761d3ef0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029929 Sep 10 10:44:27.189116 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1461/1967] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:27.194150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.121"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:27.196663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:27.203375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:27.203861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:27.204302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:27.204999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:27.205484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:27.205915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:27.232289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "refresh_cache-147a5ac3-709e-43e4-89d3-ce745514c377" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:44:27.232689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquired lock "refresh_cache-147a5ac3-709e-43e4-89d3-ce745514c377" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:44:29.301987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Building network info cache for instance {{(pid=128788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 10:44:29.830525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Updating instance_info_cache with network_info: [{"id": "3086246d-f560-41ce-b858-9f9eb7fa8433", "address": "fa:16:3e:98:a6:65", "network": {"id": "2d6ae299-105b-4d06-b0cf-95c0099cfa6b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1866515175-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6eeb7998eb2f456c9d5fd8f2f3cacf41", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3086246d-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:44:29.851064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Releasing lock "refresh_cache-147a5ac3-709e-43e4-89d3-ce745514c377" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:44:29.852381 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb493923-42f1-481a-991c-4cb03744d118 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "POST /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377/action" status: 202 len: 0 microversion: 2.1 time: 2.661879 Sep 10 10:44:29.852954 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1462/1968] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:27 2022] POST /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377/action => generated 0 bytes in 2663 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 10:44:29.858994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e11b0e20-ded7-4005-8a08-418744522610 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '.version_select at 0x7efcae265dc0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:29.886925 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e11b0e20-ded7-4005-8a08-418744522610 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Image not found. Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e11b0e20-ded7-4005-8a08-418744522610 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 HTTP/1.1 Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4'} Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 to delete Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 could not be found. Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:29.888801 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e11b0e20-ded7-4005-8a08-418744522610 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:29.892412 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e11b0e20-ded7-4005-8a08-418744522610 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4" status: 404 len: 62 microversion: 2.1 time: 0.035388 Sep 10 10:44:29.894816 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1463/1969] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:29 2022] DELETE /compute/v2.1/images/608f5ce8-a585-40ea-a6a3-ddc6c1d58ab4 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:44:29.899248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9faa2013-e7c0-48b2-82a3-534e350ea141 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:29.899853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9faa2013-e7c0-48b2-82a3-534e350ea141 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:29.908401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9faa2013-e7c0-48b2-82a3-534e350ea141 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:29.909106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9faa2013-e7c0-48b2-82a3-534e350ea141 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:29.909722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9faa2013-e7c0-48b2-82a3-534e350ea141 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:29.910568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9faa2013-e7c0-48b2-82a3-534e350ea141 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:29.911026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9faa2013-e7c0-48b2-82a3-534e350ea141 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:29.911548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9faa2013-e7c0-48b2-82a3-534e350ea141 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.044699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9faa2013-e7c0-48b2-82a3-534e350ea141 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1533 microversion: 2.1 time: 0.148680 Sep 10 10:44:30.050367 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1464/1970] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:29 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1533 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:30.055227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ecf1fa1a-c398-46a7-abfb-f3569b826424 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:30.055851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ecf1fa1a-c398-46a7-abfb-f3569b826424 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:30.063000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf1fa1a-c398-46a7-abfb-f3569b826424 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:30.063740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf1fa1a-c398-46a7-abfb-f3569b826424 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:30.064343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf1fa1a-c398-46a7-abfb-f3569b826424 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.065587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf1fa1a-c398-46a7-abfb-f3569b826424 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:30.066230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf1fa1a-c398-46a7-abfb-f3569b826424 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:30.066667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecf1fa1a-c398-46a7-abfb-f3569b826424 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.210890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ecf1fa1a-c398-46a7-abfb-f3569b826424 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:30.224158 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ecf1fa1a-c398-46a7-abfb-f3569b826424 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.172583 Sep 10 10:44:30.233874 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1465/1971] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:30 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:30.233874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5c5b665f-c09a-48e4-9b9f-6bafd29811a1 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:30.233874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5c5b665f-c09a-48e4-9b9f-6bafd29811a1 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:30.236382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c5b665f-c09a-48e4-9b9f-6bafd29811a1 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:30.236876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c5b665f-c09a-48e4-9b9f-6bafd29811a1 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:30.241218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c5b665f-c09a-48e4-9b9f-6bafd29811a1 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.242045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c5b665f-c09a-48e4-9b9f-6bafd29811a1 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:30.242573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c5b665f-c09a-48e4-9b9f-6bafd29811a1 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:30.242938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c5b665f-c09a-48e4-9b9f-6bafd29811a1 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.387949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5c5b665f-c09a-48e4-9b9f-6bafd29811a1 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:30.396471 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5c5b665f-c09a-48e4-9b9f-6bafd29811a1 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1402 microversion: 2.1 time: 0.170597 Sep 10 10:44:30.397460 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1466/1972] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:30 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1402 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:30.401758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ce1995f1-cf2d-477f-9e0b-e231fb2563fe req-b286aec7-29c9-43a7-b878-61ffa8ac281f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405234b5-1d79-41cd-a7b3-39756579d91b", "name": "network-vif-plugged", "status": "completed", "tag": "2535e255-f38a-4ba7-9e5d-bb3080a3f2a2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:30.412539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ce1995f1-cf2d-477f-9e0b-e231fb2563fe req-b286aec7-29c9-43a7-b878-61ffa8ac281f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:30.413048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ce1995f1-cf2d-477f-9e0b-e231fb2563fe req-b286aec7-29c9-43a7-b878-61ffa8ac281f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:30.413536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ce1995f1-cf2d-477f-9e0b-e231fb2563fe req-b286aec7-29c9-43a7-b878-61ffa8ac281f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.425837 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ce1995f1-cf2d-477f-9e0b-e231fb2563fe req-b286aec7-29c9-43a7-b878-61ffa8ac281f service nova] Creating event network-vif-plugged:2535e255-f38a-4ba7-9e5d-bb3080a3f2a2 for instance 405234b5-1d79-41cd-a7b3-39756579d91b on n-h2-856894-1 Sep 10 10:44:30.430855 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ce1995f1-cf2d-477f-9e0b-e231fb2563fe req-b286aec7-29c9-43a7-b878-61ffa8ac281f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032577 Sep 10 10:44:30.432206 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1467/1973] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:30.437017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8a6f945-f1ab-4b71-9272-c8a4567e1bcf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:30.437818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8a6f945-f1ab-4b71-9272-c8a4567e1bcf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:30.444867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a6f945-f1ab-4b71-9272-c8a4567e1bcf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:30.445490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a6f945-f1ab-4b71-9272-c8a4567e1bcf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:30.446060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a6f945-f1ab-4b71-9272-c8a4567e1bcf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.446765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a6f945-f1ab-4b71-9272-c8a4567e1bcf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:30.447900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a6f945-f1ab-4b71-9272-c8a4567e1bcf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:30.448542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a6f945-f1ab-4b71-9272-c8a4567e1bcf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.604814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c8a6f945-f1ab-4b71-9272-c8a4567e1bcf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:30.613389 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8a6f945-f1ab-4b71-9272-c8a4567e1bcf tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.179925 Sep 10 10:44:30.614003 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1468/1974] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:30 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:30.623032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f334450-5d13-4e66-b841-c6c125bac818 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:30.624585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f334450-5d13-4e66-b841-c6c125bac818 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:30.633151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f334450-5d13-4e66-b841-c6c125bac818 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:30.633593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f334450-5d13-4e66-b841-c6c125bac818 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:30.634097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f334450-5d13-4e66-b841-c6c125bac818 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.635349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f334450-5d13-4e66-b841-c6c125bac818 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:30.635870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f334450-5d13-4e66-b841-c6c125bac818 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:30.636297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f334450-5d13-4e66-b841-c6c125bac818 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.797531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f334450-5d13-4e66-b841-c6c125bac818 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:30.811694 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f334450-5d13-4e66-b841-c6c125bac818 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.187294 Sep 10 10:44:30.812984 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1469/1975] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:30 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:30.817710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-91ad1346-01cf-46bc-83a2-7cd44ecb1198 req-b0627570-b92a-4ed2-9607-5a5c983c6367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147a5ac3-709e-43e4-89d3-ce745514c377", "tag": "3086246d-f560-41ce-b858-9f9eb7fa8433"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:30.827539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-91ad1346-01cf-46bc-83a2-7cd44ecb1198 req-b0627570-b92a-4ed2-9607-5a5c983c6367 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:30.828457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-91ad1346-01cf-46bc-83a2-7cd44ecb1198 req-b0627570-b92a-4ed2-9607-5a5c983c6367 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:30.829181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-91ad1346-01cf-46bc-83a2-7cd44ecb1198 req-b0627570-b92a-4ed2-9607-5a5c983c6367 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:30.841580 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-91ad1346-01cf-46bc-83a2-7cd44ecb1198 req-b0627570-b92a-4ed2-9607-5a5c983c6367 service nova] Creating event network-changed:3086246d-f560-41ce-b858-9f9eb7fa8433 for instance 147a5ac3-709e-43e4-89d3-ce745514c377 on n-h2-856894-1 Sep 10 10:44:30.846563 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-91ad1346-01cf-46bc-83a2-7cd44ecb1198 req-b0627570-b92a-4ed2-9607-5a5c983c6367 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032160 Sep 10 10:44:30.847184 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1470/1976] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:30.852310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.121"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:31.041512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:31.049334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:31.049830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:31.050270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:31.050980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:31.051434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:31.051859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:31.249372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "refresh_cache-147a5ac3-709e-43e4-89d3-ce745514c377" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:44:31.249801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquired lock "refresh_cache-147a5ac3-709e-43e4-89d3-ce745514c377" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:44:31.874936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Building network info cache for instance {{(pid=128788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 10:44:32.371586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Updating instance_info_cache with network_info: [{"id": "3086246d-f560-41ce-b858-9f9eb7fa8433", "address": "fa:16:3e:98:a6:65", "network": {"id": "2d6ae299-105b-4d06-b0cf-95c0099cfa6b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1866515175-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6eeb7998eb2f456c9d5fd8f2f3cacf41", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3086246d-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:44:32.400903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Releasing lock "refresh_cache-147a5ac3-709e-43e4-89d3-ce745514c377" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:44:32.401945 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0db07479-3273-40b2-96aa-57f6449a5e6f tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "POST /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377/action" status: 202 len: 0 microversion: 2.1 time: 1.553667 Sep 10 10:44:32.405557 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1471/1977] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:30 2022] POST /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377/action => generated 0 bytes in 1555 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 10:44:32.408272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:32.408778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:32.415215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:32.415897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:32.416355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:32.417093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:32.417556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:32.417989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:32.433819 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 HTTP/1.1 Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '115a3202-4538-4932-bc5c-155415678a28'} Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:44:32.435561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-549e5110-c4d5-4a03-9be3-b5252a951ca1 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 404 len: 111 microversion: 2.1 time: 0.033438 Sep 10 10:44:32.439974 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1472/1978] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:44:32 2022] DELETE /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:44:32.442591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79f321e0-e7e6-40bd-9f44-3fe6fa5e4d46 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:32.446563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f321e0-e7e6-40bd-9f44-3fe6fa5e4d46 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:32.447636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f321e0-e7e6-40bd-9f44-3fe6fa5e4d46 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:32.448090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f321e0-e7e6-40bd-9f44-3fe6fa5e4d46 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:32.448831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f321e0-e7e6-40bd-9f44-3fe6fa5e4d46 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:32.449316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f321e0-e7e6-40bd-9f44-3fe6fa5e4d46 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:32.449747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f321e0-e7e6-40bd-9f44-3fe6fa5e4d46 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:32.487998 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79f321e0-e7e6-40bd-9f44-3fe6fa5e4d46 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048916 Sep 10 10:44:32.489133 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1473/1979] 10.222.0.20 () {58 vars in 1176 bytes} [Sat Sep 10 10:44:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:32.494362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab0fb897-c6f9-43c7-a7bf-c5eca2c1617f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:32.495013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab0fb897-c6f9-43c7-a7bf-c5eca2c1617f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:32.501531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0fb897-c6f9-43c7-a7bf-c5eca2c1617f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:32.502030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0fb897-c6f9-43c7-a7bf-c5eca2c1617f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:32.502476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0fb897-c6f9-43c7-a7bf-c5eca2c1617f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:32.503184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0fb897-c6f9-43c7-a7bf-c5eca2c1617f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:32.503646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0fb897-c6f9-43c7-a7bf-c5eca2c1617f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:32.504080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0fb897-c6f9-43c7-a7bf-c5eca2c1617f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:32.666395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab0fb897-c6f9-43c7-a7bf-c5eca2c1617f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:32.676661 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab0fb897-c6f9-43c7-a7bf-c5eca2c1617f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1522 microversion: 2.1 time: 0.186468 Sep 10 10:44:32.680748 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1474/1980] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:32 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:32.686338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85d0296b-b796-4eed-9bc5-aca952128193 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:32.686950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-85d0296b-b796-4eed-9bc5-aca952128193 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:32.693821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85d0296b-b796-4eed-9bc5-aca952128193 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:32.694312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85d0296b-b796-4eed-9bc5-aca952128193 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:32.694752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85d0296b-b796-4eed-9bc5-aca952128193 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:32.695443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85d0296b-b796-4eed-9bc5-aca952128193 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:32.695892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85d0296b-b796-4eed-9bc5-aca952128193 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:32.696312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85d0296b-b796-4eed-9bc5-aca952128193 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:32.866483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-85d0296b-b796-4eed-9bc5-aca952128193 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:32.876768 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85d0296b-b796-4eed-9bc5-aca952128193 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1402 microversion: 2.1 time: 0.194038 Sep 10 10:44:32.877879 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1475/1981] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:32 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1402 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:32.882652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-036447c7-0430-4585-8f6d-d1b942979e4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:32.883932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-036447c7-0430-4585-8f6d-d1b942979e4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:32.891340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036447c7-0430-4585-8f6d-d1b942979e4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:32.891915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036447c7-0430-4585-8f6d-d1b942979e4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:32.892436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036447c7-0430-4585-8f6d-d1b942979e4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:32.893252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036447c7-0430-4585-8f6d-d1b942979e4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:32.893783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036447c7-0430-4585-8f6d-d1b942979e4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:32.894285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036447c7-0430-4585-8f6d-d1b942979e4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:33.106765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-036447c7-0430-4585-8f6d-d1b942979e4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:33.115180 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-036447c7-0430-4585-8f6d-d1b942979e4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.236201 Sep 10 10:44:33.125126 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1476/1982] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:32 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:33.125126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c03734ef-9f6b-4581-b373-c46ed88df604 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:33.125126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c03734ef-9f6b-4581-b373-c46ed88df604 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:33.133103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03734ef-9f6b-4581-b373-c46ed88df604 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:33.133103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03734ef-9f6b-4581-b373-c46ed88df604 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:33.144048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03734ef-9f6b-4581-b373-c46ed88df604 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:33.145960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03734ef-9f6b-4581-b373-c46ed88df604 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:33.150095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03734ef-9f6b-4581-b373-c46ed88df604 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:33.150668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03734ef-9f6b-4581-b373-c46ed88df604 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:33.172893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:33.311884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c03734ef-9f6b-4581-b373-c46ed88df604 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:33.320403 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c03734ef-9f6b-4581-b373-c46ed88df604 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1475 microversion: 2.1 time: 0.203125 Sep 10 10:44:33.321779 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1477/1983] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:33 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1475 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:33.329204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-98b5e30a-d07c-4066-93cc-04be6d732081 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '.version_select at 0x7efcb2dee0d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:34.409412 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-98b5e30a-d07c-4066-93cc-04be6d732081 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/6b1c943e-f3a4-4ebc-a61f-7db607472e6b" status: 202 len: 0 microversion: 2.1 time: 1.085185 Sep 10 10:44:34.410317 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1478/1984] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:44:33 2022] DELETE /compute/v2.1/os-floating-ips/6b1c943e-f3a4-4ebc-a61f-7db607472e6b => generated 0 bytes in 1087 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:44:34.414799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:34.415701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] [instance: 115a3202-4538-4932-bc5c-155415678a28] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:34.422291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:34.422796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:34.423239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:34.423952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:34.424414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:34.424903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:34.440201 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] HTTP exception thrown: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Request method failure captured: Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 HTTP/1.1 Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGmez9oXEAd5J22cVxWEefaSghe1f9DztG8Glz_COizdH8Lah8AMAj-_FUIvzkWSzkfSC1obKFmmYUV5WhhG7-dKwRy78GCf_R4t8PIk4k6p0YlskDtRhI8dhzaQ-QKKCCo68jT0mw8gKOPfuzbnuyIWM65LFEhJregtX3pxVAXEzrE Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302151fe6dda436ca654252333e7fc7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302151fe6dda436ca654252333e7fc7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 302151fe6dda436ca654252333e7fc7f Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesTestJSON-1829622054 Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 75dc4bf3c30b42448e6dbea15579400e Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesTestJSON-1829622054-project Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '115a3202-4538-4932-bc5c-155415678a28'} Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:34.441816 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:34.445394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:34.445394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:34.445394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:34.445394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:34.445394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. Sep 10 10:44:34.445394 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:34.445394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] Returning 404 to user: Instance 115a3202-4538-4932-bc5c-155415678a28 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:34.445394 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c62ba8c0-99d4-421f-a422-333530e811c2 tempest-ImagesTestJSON-1829622054 tempest-ImagesTestJSON-1829622054-project] 10.222.0.20 "GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28" status: 404 len: 111 microversion: 2.1 time: 0.032060 Sep 10 10:44:34.445394 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1479/1985] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:34 2022] GET /compute/v2.1/servers/115a3202-4538-4932-bc5c-155415678a28 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:44:34.462080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-856894-1", "block_migration": false, "disk_over_commit": false}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:34.467332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:34.481962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:34.489991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:34.490458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:34.491249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:34.491714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:34.492157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:34.529459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lazy-loading 'flavor' on Instance uuid 178b8f2f-5352-4ae4-9f3e-bef5e366456d {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:44:34.550128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Going to try to live migrate instance to n-h1-856894-1 {{(pid=128788) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 10:44:36.954034 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02312888-833f-4aa1-94b1-81321a93ceb7 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d/action" status: 202 len: 0 microversion: 2.1 time: 2.508146 Sep 10 10:44:36.956114 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1480/1986] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:34 2022] POST /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d/action => generated 0 bytes in 2511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:44:36.963125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6d33fc06-b34f-4ea6-9847-8740cc1050fa req-355612fd-3617-4ec6-87d5-8d68419202a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147a5ac3-709e-43e4-89d3-ce745514c377", "tag": "3086246d-f560-41ce-b858-9f9eb7fa8433"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:36.980724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d33fc06-b34f-4ea6-9847-8740cc1050fa req-355612fd-3617-4ec6-87d5-8d68419202a2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:36.982267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d33fc06-b34f-4ea6-9847-8740cc1050fa req-355612fd-3617-4ec6-87d5-8d68419202a2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:36.983293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d33fc06-b34f-4ea6-9847-8740cc1050fa req-355612fd-3617-4ec6-87d5-8d68419202a2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:36.998443 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6d33fc06-b34f-4ea6-9847-8740cc1050fa req-355612fd-3617-4ec6-87d5-8d68419202a2 service nova] Creating event network-changed:3086246d-f560-41ce-b858-9f9eb7fa8433 for instance 147a5ac3-709e-43e4-89d3-ce745514c377 on n-h2-856894-1 Sep 10 10:44:37.015857 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6d33fc06-b34f-4ea6-9847-8740cc1050fa req-355612fd-3617-4ec6-87d5-8d68419202a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057302 Sep 10 10:44:37.016677 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1481/1987] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:37.028076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a624430-898d-488a-a643-e0f10556dfb9 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:37.028819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a624430-898d-488a-a643-e0f10556dfb9 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:37.038084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a624430-898d-488a-a643-e0f10556dfb9 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:37.038957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a624430-898d-488a-a643-e0f10556dfb9 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:37.039876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a624430-898d-488a-a643-e0f10556dfb9 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:37.041040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a624430-898d-488a-a643-e0f10556dfb9 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:37.041852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a624430-898d-488a-a643-e0f10556dfb9 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:37.042616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a624430-898d-488a-a643-e0f10556dfb9 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:37.351175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a624430-898d-488a-a643-e0f10556dfb9 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:37.358960 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a624430-898d-488a-a643-e0f10556dfb9 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1502 microversion: 2.1 time: 0.340623 Sep 10 10:44:37.364957 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1482/1988] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:37 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1502 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:37.368760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae676a50-1c24-4465-b2a7-6af61c5a359b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:37.369429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ae676a50-1c24-4465-b2a7-6af61c5a359b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:37.376922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae676a50-1c24-4465-b2a7-6af61c5a359b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:37.377702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae676a50-1c24-4465-b2a7-6af61c5a359b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:37.378587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae676a50-1c24-4465-b2a7-6af61c5a359b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:37.379532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae676a50-1c24-4465-b2a7-6af61c5a359b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:37.380206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae676a50-1c24-4465-b2a7-6af61c5a359b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:37.380769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae676a50-1c24-4465-b2a7-6af61c5a359b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:37.862461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae676a50-1c24-4465-b2a7-6af61c5a359b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:37.873868 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae676a50-1c24-4465-b2a7-6af61c5a359b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1588 microversion: 2.1 time: 0.510870 Sep 10 10:44:37.875150 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1483/1989] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:37 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1588 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:37.880051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b43838d-5332-4a4f-9bd8-b9ed701eb794 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:37.880937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b43838d-5332-4a4f-9bd8-b9ed701eb794 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:37.888675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b43838d-5332-4a4f-9bd8-b9ed701eb794 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:37.890137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b43838d-5332-4a4f-9bd8-b9ed701eb794 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:37.890871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b43838d-5332-4a4f-9bd8-b9ed701eb794 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:37.891809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b43838d-5332-4a4f-9bd8-b9ed701eb794 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:37.892430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b43838d-5332-4a4f-9bd8-b9ed701eb794 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:37.892855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b43838d-5332-4a4f-9bd8-b9ed701eb794 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:38.238490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b43838d-5332-4a4f-9bd8-b9ed701eb794 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:38.267968 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b43838d-5332-4a4f-9bd8-b9ed701eb794 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.391646 Sep 10 10:44:38.268567 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1484/1990] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:37 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:38.285431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4135d949-283e-4a10-9731-9cbbe4d1e0ea tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:38.286131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4135d949-283e-4a10-9731-9cbbe4d1e0ea tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:38.292417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4135d949-283e-4a10-9731-9cbbe4d1e0ea tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:38.292916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4135d949-283e-4a10-9731-9cbbe4d1e0ea tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:38.293380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4135d949-283e-4a10-9731-9cbbe4d1e0ea tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:38.294092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4135d949-283e-4a10-9731-9cbbe4d1e0ea tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:38.294548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4135d949-283e-4a10-9731-9cbbe4d1e0ea tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:38.294973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4135d949-283e-4a10-9731-9cbbe4d1e0ea tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:38.640051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4135d949-283e-4a10-9731-9cbbe4d1e0ea tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:38.651634 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4135d949-283e-4a10-9731-9cbbe4d1e0ea tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1474 microversion: 2.1 time: 0.377258 Sep 10 10:44:38.652846 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1485/1991] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:38 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1474 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:38.660399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e70866bc-100d-4155-90df-2ee6e3bd00f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '.version_select at 0x7efcaea26040>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:39.357526 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e70866bc-100d-4155-90df-2ee6e3bd00f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/02f9e0d0-a869-4914-9b8a-57ad2df088c8" status: 202 len: 0 microversion: 2.1 time: 0.702777 Sep 10 10:44:39.360092 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1486/1992] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:44:38 2022] DELETE /compute/v2.1/os-security-groups/02f9e0d0-a869-4914-9b8a-57ad2df088c8 => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:44:39.367810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ac5d084-1c7b-4efd-89e5-cfcff45919dc tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:39.369423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7ac5d084-1c7b-4efd-89e5-cfcff45919dc tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:39.381729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ac5d084-1c7b-4efd-89e5-cfcff45919dc tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:39.383695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ac5d084-1c7b-4efd-89e5-cfcff45919dc tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:39.385296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ac5d084-1c7b-4efd-89e5-cfcff45919dc tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:39.386049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ac5d084-1c7b-4efd-89e5-cfcff45919dc tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:39.387005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ac5d084-1c7b-4efd-89e5-cfcff45919dc tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:39.388658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ac5d084-1c7b-4efd-89e5-cfcff45919dc tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:39.738707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7ac5d084-1c7b-4efd-89e5-cfcff45919dc tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:39.761974 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7ac5d084-1c7b-4efd-89e5-cfcff45919dc tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.398511 Sep 10 10:44:39.762611 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1487/1993] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:39 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:39.796208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3fa587eb-9ae5-4bb0-bd60-3b99f56c9c93 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:39.799232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3fa587eb-9ae5-4bb0-bd60-3b99f56c9c93 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:39.822027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa587eb-9ae5-4bb0-bd60-3b99f56c9c93 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:39.823930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa587eb-9ae5-4bb0-bd60-3b99f56c9c93 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:39.826342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa587eb-9ae5-4bb0-bd60-3b99f56c9c93 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:39.827807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa587eb-9ae5-4bb0-bd60-3b99f56c9c93 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:39.828501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa587eb-9ae5-4bb0-bd60-3b99f56c9c93 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:39.829172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa587eb-9ae5-4bb0-bd60-3b99f56c9c93 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:40.311090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3fa587eb-9ae5-4bb0-bd60-3b99f56c9c93 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:40.318985 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3fa587eb-9ae5-4bb0-bd60-3b99f56c9c93 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1516 microversion: 2.1 time: 0.543653 Sep 10 10:44:40.319568 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1488/1994] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:39 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1516 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:40.331600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa7d1461-4839-4bd0-ad9b-9450a8ded10e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:40.335360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa7d1461-4839-4bd0-ad9b-9450a8ded10e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:40.347405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:40.353416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7d1461-4839-4bd0-ad9b-9450a8ded10e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:40.359670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7d1461-4839-4bd0-ad9b-9450a8ded10e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:40.360240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7d1461-4839-4bd0-ad9b-9450a8ded10e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:40.360927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7d1461-4839-4bd0-ad9b-9450a8ded10e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:40.361425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7d1461-4839-4bd0-ad9b-9450a8ded10e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:40.361859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7d1461-4839-4bd0-ad9b-9450a8ded10e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:40.501727 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa7d1461-4839-4bd0-ad9b-9450a8ded10e tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178023 Sep 10 10:44:40.503243 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1489/1995] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:44:40 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:40.508590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2dfa01f1-070f-4839-848e-80a873a559be req-a03b2a01-4b73-463f-9f72-c7ca47926e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e93b86a-4f96-4e67-8d62-bc190286a2f9", "name": "network-vif-unplugged", "status": "completed", "tag": "cc11e812-1e24-4e7c-8919-bcc89ad1958c"}, {"name": "network-changed", "server_uuid": "8e93b86a-4f96-4e67-8d62-bc190286a2f9", "tag": "cc11e812-1e24-4e7c-8919-bcc89ad1958c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:40.520641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2dfa01f1-070f-4839-848e-80a873a559be req-a03b2a01-4b73-463f-9f72-c7ca47926e7d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:40.521424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2dfa01f1-070f-4839-848e-80a873a559be req-a03b2a01-4b73-463f-9f72-c7ca47926e7d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:40.522090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2dfa01f1-070f-4839-848e-80a873a559be req-a03b2a01-4b73-463f-9f72-c7ca47926e7d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:40.538177 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2dfa01f1-070f-4839-848e-80a873a559be req-a03b2a01-4b73-463f-9f72-c7ca47926e7d service nova] Creating event network-vif-unplugged:cc11e812-1e24-4e7c-8919-bcc89ad1958c for instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 on n-h1-856894-1 Sep 10 10:44:40.538942 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2dfa01f1-070f-4839-848e-80a873a559be req-a03b2a01-4b73-463f-9f72-c7ca47926e7d service nova] Creating event network-changed:cc11e812-1e24-4e7c-8919-bcc89ad1958c for instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 on n-h1-856894-1 Sep 10 10:44:40.548688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-2dfa01f1-070f-4839-848e-80a873a559be req-a03b2a01-4b73-463f-9f72-c7ca47926e7d service nova] Instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 10:44:40.561742 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2dfa01f1-070f-4839-848e-80a873a559be req-a03b2a01-4b73-463f-9f72-c7ca47926e7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.056607 Sep 10 10:44:40.562918 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1490/1996] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:40.569608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fad241c1-d72e-4bc7-8281-295c51c6fcc2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:40.570577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fad241c1-d72e-4bc7-8281-295c51c6fcc2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:40.577999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad241c1-d72e-4bc7-8281-295c51c6fcc2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:40.578730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad241c1-d72e-4bc7-8281-295c51c6fcc2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:40.579350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad241c1-d72e-4bc7-8281-295c51c6fcc2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:40.580213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad241c1-d72e-4bc7-8281-295c51c6fcc2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:40.580824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad241c1-d72e-4bc7-8281-295c51c6fcc2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:40.581450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad241c1-d72e-4bc7-8281-295c51c6fcc2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:40.866871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fad241c1-d72e-4bc7-8281-295c51c6fcc2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:40.876886 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fad241c1-d72e-4bc7-8281-295c51c6fcc2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.312413 Sep 10 10:44:40.895278 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1491/1997] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:40 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:40.901773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a921195e-63e7-408c-929f-f0358958cf78 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:40.902499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a921195e-63e7-408c-929f-f0358958cf78 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:40.913597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a921195e-63e7-408c-929f-f0358958cf78 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:40.916202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a921195e-63e7-408c-929f-f0358958cf78 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:40.917318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a921195e-63e7-408c-929f-f0358958cf78 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:40.918248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a921195e-63e7-408c-929f-f0358958cf78 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:40.919103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a921195e-63e7-408c-929f-f0358958cf78 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:40.920553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a921195e-63e7-408c-929f-f0358958cf78 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:40.958326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a921195e-63e7-408c-929f-f0358958cf78 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:44:41.093523 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a921195e-63e7-408c-929f-f0358958cf78 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "DELETE /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 204 len: 0 microversion: 2.1 time: 0.196466 Sep 10 10:44:41.095250 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1492/1998] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:44:40 2022] DELETE /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:44:41.107127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88ebc9c5-286e-4ecd-8532-be80df4e8c24 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:41.108078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88ebc9c5-286e-4ecd-8532-be80df4e8c24 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:41.118259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ebc9c5-286e-4ecd-8532-be80df4e8c24 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:41.119524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ebc9c5-286e-4ecd-8532-be80df4e8c24 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:41.120233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ebc9c5-286e-4ecd-8532-be80df4e8c24 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:41.121512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ebc9c5-286e-4ecd-8532-be80df4e8c24 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:41.122248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ebc9c5-286e-4ecd-8532-be80df4e8c24 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:41.123374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ebc9c5-286e-4ecd-8532-be80df4e8c24 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:41.304054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88ebc9c5-286e-4ecd-8532-be80df4e8c24 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:41.317110 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88ebc9c5-286e-4ecd-8532-be80df4e8c24 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1472 microversion: 2.1 time: 0.219760 Sep 10 10:44:41.319683 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1493/1999] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:41 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1472 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:41.326817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d7f0561-f975-40fe-b9ff-d2325879bc42 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:41.331682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d7f0561-f975-40fe-b9ff-d2325879bc42 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 4a10a200-bbc3-4aab-b6ef-8b1ef272685e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:41.340535 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-6d7f0561-f975-40fe-b9ff-d2325879bc42 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] HTTP exception thrown: Instance 4a10a200-bbc3-4aab-b6ef-8b1ef272685e could not be found. Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d7f0561-f975-40fe-b9ff-d2325879bc42 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Request method failure captured: Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/4a10a200-bbc3-4aab-b6ef-8b1ef272685e/action HTTP/1.1 Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 14 Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpHkAYnXeEeIkrvP5MU91LX1pHhCw1-X517wST7uI3nXMyFmEZF2-GrH_hD3-99qTj4dhIEoqm0d7-iBahX9spBGlFJJtEH3HGF62s1M_cLMl7ndO7Kwzn8XkzqLr7wv9Eh_FDYB9NepyfCMVt7SSvdhwxotJF7SX8u4upXel5-s6g Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52c98558e19447dfa54397d92f45dbb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0682225a07764437b25009c061ac844d Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: {"rescue": {}} Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 4a10a200-bbc3-4aab-b6ef-8b1ef272685e could not be found. Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '4a10a200-bbc3-4aab-b6ef-8b1ef272685e', 'body': {'rescue': {}}} Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a10a200-bbc3-4aab-b6ef-8b1ef272685e could not be found. Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a10a200-bbc3-4aab-b6ef-8b1ef272685e could not be found. Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:41.348434 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:41.353479 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:41.353479 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:41.353479 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:41.353479 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:41.353479 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a10a200-bbc3-4aab-b6ef-8b1ef272685e could not be found. Sep 10 10:44:41.353479 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:41.359543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d7f0561-f975-40fe-b9ff-d2325879bc42 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Returning 404 to user: Instance 4a10a200-bbc3-4aab-b6ef-8b1ef272685e could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:41.360734 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6d7f0561-f975-40fe-b9ff-d2325879bc42 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/4a10a200-bbc3-4aab-b6ef-8b1ef272685e/action" status: 404 len: 111 microversion: 2.1 time: 0.039469 Sep 10 10:44:41.362339 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1494/2000] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:41 2022] POST /compute/v2.1/servers/4a10a200-bbc3-4aab-b6ef-8b1ef272685e/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:44:41.369209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86ee6614-4960-492e-890d-cc234dd6a4e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:41.370264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86ee6614-4960-492e-890d-cc234dd6a4e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:41.382138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86ee6614-4960-492e-890d-cc234dd6a4e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:41.382862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86ee6614-4960-492e-890d-cc234dd6a4e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:41.383307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86ee6614-4960-492e-890d-cc234dd6a4e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:41.384610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86ee6614-4960-492e-890d-cc234dd6a4e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:41.385059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86ee6614-4960-492e-890d-cc234dd6a4e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:41.385572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86ee6614-4960-492e-890d-cc234dd6a4e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:41.422708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:41.635457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-86ee6614-4960-492e-890d-cc234dd6a4e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:41.648201 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86ee6614-4960-492e-890d-cc234dd6a4e1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.284402 Sep 10 10:44:41.661099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1495/2001] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:41 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:41.661099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9636102c-a19f-4ebf-ae9a-9e0609476e3b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:41.661099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9636102c-a19f-4ebf-ae9a-9e0609476e3b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:41.677957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9636102c-a19f-4ebf-ae9a-9e0609476e3b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:41.679797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9636102c-a19f-4ebf-ae9a-9e0609476e3b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:41.680260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9636102c-a19f-4ebf-ae9a-9e0609476e3b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:41.681444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9636102c-a19f-4ebf-ae9a-9e0609476e3b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:41.681578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9636102c-a19f-4ebf-ae9a-9e0609476e3b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:41.683088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9636102c-a19f-4ebf-ae9a-9e0609476e3b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:42.004180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9636102c-a19f-4ebf-ae9a-9e0609476e3b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:42.012464 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9636102c-a19f-4ebf-ae9a-9e0609476e3b tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1510 microversion: 2.1 time: 0.361586 Sep 10 10:44:42.021974 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1496/2002] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:41 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1510 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:42.029343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b640a0a-71a6-409a-a2af-9ba4b8908aca tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:42.029906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b640a0a-71a6-409a-a2af-9ba4b8908aca tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:42.036340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b640a0a-71a6-409a-a2af-9ba4b8908aca tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:42.036839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b640a0a-71a6-409a-a2af-9ba4b8908aca tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:42.037318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b640a0a-71a6-409a-a2af-9ba4b8908aca tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:42.038281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b640a0a-71a6-409a-a2af-9ba4b8908aca tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:42.038464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b640a0a-71a6-409a-a2af-9ba4b8908aca tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:42.038886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b640a0a-71a6-409a-a2af-9ba4b8908aca tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:42.151088 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b640a0a-71a6-409a-a2af-9ba4b8908aca tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action" status: 202 len: 0 microversion: 2.1 time: 0.128763 Sep 10 10:44:42.152342 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1497/2003] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:42 2022] POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:44:42.163733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b1c817f-4e23-4422-829e-a5d4e1edb636 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:42.179123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b1c817f-4e23-4422-829e-a5d4e1edb636 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:42.204214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b1c817f-4e23-4422-829e-a5d4e1edb636 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:42.204895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b1c817f-4e23-4422-829e-a5d4e1edb636 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:42.205645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b1c817f-4e23-4422-829e-a5d4e1edb636 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:42.208156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b1c817f-4e23-4422-829e-a5d4e1edb636 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:42.208635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b1c817f-4e23-4422-829e-a5d4e1edb636 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:42.211204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b1c817f-4e23-4422-829e-a5d4e1edb636 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:42.471739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:42.545643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b1c817f-4e23-4422-829e-a5d4e1edb636 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:42.562653 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b1c817f-4e23-4422-829e-a5d4e1edb636 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.407220 Sep 10 10:44:42.564591 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1498/2004] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:42 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:42.571887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d33235aa-4f25-415f-9c47-79b5f3674e7c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:42.584388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d33235aa-4f25-415f-9c47-79b5f3674e7c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:42.593110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d33235aa-4f25-415f-9c47-79b5f3674e7c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:42.594671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d33235aa-4f25-415f-9c47-79b5f3674e7c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:42.597451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d33235aa-4f25-415f-9c47-79b5f3674e7c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:42.599013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d33235aa-4f25-415f-9c47-79b5f3674e7c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:42.599617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d33235aa-4f25-415f-9c47-79b5f3674e7c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:42.602804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d33235aa-4f25-415f-9c47-79b5f3674e7c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:43.062887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d33235aa-4f25-415f-9c47-79b5f3674e7c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:43.077379 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d33235aa-4f25-415f-9c47-79b5f3674e7c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1521 microversion: 2.1 time: 0.509631 Sep 10 10:44:43.078102 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1499/2005] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:42 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:43.087368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d68fcfbc-349c-4b58-8427-1dbe9383ac1f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:43.088762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d68fcfbc-349c-4b58-8427-1dbe9383ac1f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:43.100859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68fcfbc-349c-4b58-8427-1dbe9383ac1f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:43.103237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68fcfbc-349c-4b58-8427-1dbe9383ac1f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:43.106800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68fcfbc-349c-4b58-8427-1dbe9383ac1f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:43.108023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68fcfbc-349c-4b58-8427-1dbe9383ac1f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:43.108544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68fcfbc-349c-4b58-8427-1dbe9383ac1f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:43.108976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68fcfbc-349c-4b58-8427-1dbe9383ac1f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:43.416099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d68fcfbc-349c-4b58-8427-1dbe9383ac1f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:43.431479 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d68fcfbc-349c-4b58-8427-1dbe9383ac1f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1469 microversion: 2.1 time: 0.352097 Sep 10 10:44:43.446802 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1500/2006] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:43 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1469 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:43.446802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dcd3f014-40b1-456f-9ab2-714421cc3447 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:43.446802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dcd3f014-40b1-456f-9ab2-714421cc3447 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:43.458193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dcd3f014-40b1-456f-9ab2-714421cc3447 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:43.458901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dcd3f014-40b1-456f-9ab2-714421cc3447 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:43.459177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dcd3f014-40b1-456f-9ab2-714421cc3447 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:43.459881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dcd3f014-40b1-456f-9ab2-714421cc3447 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:43.460336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dcd3f014-40b1-456f-9ab2-714421cc3447 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:43.460755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dcd3f014-40b1-456f-9ab2-714421cc3447 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:43.716009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dcd3f014-40b1-456f-9ab2-714421cc3447 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:43.727155 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dcd3f014-40b1-456f-9ab2-714421cc3447 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1588 microversion: 2.1 time: 0.292552 Sep 10 10:44:43.730150 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1501/2007] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:43 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1588 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:43.761253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6ed2ab53-3980-4c97-9c98-e62e95aae388 req-4f96545c-008c-48df-8121-4596918ed4da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405234b5-1d79-41cd-a7b3-39756579d91b", "tag": "2535e255-f38a-4ba7-9e5d-bb3080a3f2a2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:43.798690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6ed2ab53-3980-4c97-9c98-e62e95aae388 req-4f96545c-008c-48df-8121-4596918ed4da service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:43.800621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6ed2ab53-3980-4c97-9c98-e62e95aae388 req-4f96545c-008c-48df-8121-4596918ed4da service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:43.802232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6ed2ab53-3980-4c97-9c98-e62e95aae388 req-4f96545c-008c-48df-8121-4596918ed4da service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:43.834628 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6ed2ab53-3980-4c97-9c98-e62e95aae388 req-4f96545c-008c-48df-8121-4596918ed4da service nova] Creating event network-changed:2535e255-f38a-4ba7-9e5d-bb3080a3f2a2 for instance 405234b5-1d79-41cd-a7b3-39756579d91b on n-h2-856894-1 Sep 10 10:44:43.844375 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6ed2ab53-3980-4c97-9c98-e62e95aae388 req-4f96545c-008c-48df-8121-4596918ed4da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111779 Sep 10 10:44:43.847244 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1502/2008] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:43.853723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2fe2aa29-2fd9-4662-9db7-23c376ff6007 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:43.854909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2fe2aa29-2fd9-4662-9db7-23c376ff6007 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:43.863984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe2aa29-2fd9-4662-9db7-23c376ff6007 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:43.865205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe2aa29-2fd9-4662-9db7-23c376ff6007 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:43.865865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe2aa29-2fd9-4662-9db7-23c376ff6007 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:43.866680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe2aa29-2fd9-4662-9db7-23c376ff6007 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:43.867210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe2aa29-2fd9-4662-9db7-23c376ff6007 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:43.867705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe2aa29-2fd9-4662-9db7-23c376ff6007 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:44.334414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2fe2aa29-2fd9-4662-9db7-23c376ff6007 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:44.348283 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2fe2aa29-2fd9-4662-9db7-23c376ff6007 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.495354 Sep 10 10:44:44.349544 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1503/2009] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:43 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:44.360697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-83c6ece2-c542-461c-a736-9c7723fad8f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:44.361454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-83c6ece2-c542-461c-a736-9c7723fad8f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:44.376575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83c6ece2-c542-461c-a736-9c7723fad8f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:44.378141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83c6ece2-c542-461c-a736-9c7723fad8f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:44.379952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83c6ece2-c542-461c-a736-9c7723fad8f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:44.383665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83c6ece2-c542-461c-a736-9c7723fad8f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:44.384471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83c6ece2-c542-461c-a736-9c7723fad8f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:44.385159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83c6ece2-c542-461c-a736-9c7723fad8f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:44.688521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-83c6ece2-c542-461c-a736-9c7723fad8f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:44.698124 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-83c6ece2-c542-461c-a736-9c7723fad8f8 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1510 microversion: 2.1 time: 0.344456 Sep 10 10:44:44.701507 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1504/2010] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:44 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:44.713569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-348b1443-86fa-40cc-9b74-ce52bf420c33 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:44.714382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-348b1443-86fa-40cc-9b74-ce52bf420c33 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:44.724604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348b1443-86fa-40cc-9b74-ce52bf420c33 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:44.733142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348b1443-86fa-40cc-9b74-ce52bf420c33 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:44.734121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348b1443-86fa-40cc-9b74-ce52bf420c33 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:44.735027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348b1443-86fa-40cc-9b74-ce52bf420c33 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:44.735731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348b1443-86fa-40cc-9b74-ce52bf420c33 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:44.736440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348b1443-86fa-40cc-9b74-ce52bf420c33 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:44.886960 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-348b1443-86fa-40cc-9b74-ce52bf420c33 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9/action" status: 204 len: 0 microversion: 2.1 time: 0.182093 Sep 10 10:44:44.890483 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1505/2011] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:44 2022] POST /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9/action => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:44:44.903895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b7a7affb-7509-4aa3-bf46-7a65bf1e16a8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:44.904946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b7a7affb-7509-4aa3-bf46-7a65bf1e16a8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:44.922298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7a7affb-7509-4aa3-bf46-7a65bf1e16a8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:44.928708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7a7affb-7509-4aa3-bf46-7a65bf1e16a8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:44.929354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7a7affb-7509-4aa3-bf46-7a65bf1e16a8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:44.930258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7a7affb-7509-4aa3-bf46-7a65bf1e16a8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:44.930928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7a7affb-7509-4aa3-bf46-7a65bf1e16a8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:44.931514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7a7affb-7509-4aa3-bf46-7a65bf1e16a8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:45.331254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b7a7affb-7509-4aa3-bf46-7a65bf1e16a8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:45.354271 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b7a7affb-7509-4aa3-bf46-7a65bf1e16a8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.462043 Sep 10 10:44:45.358650 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1506/2012] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:44 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:45.375181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69866cb2-c664-47fd-b6f6-88955b89ea4c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:45.379396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69866cb2-c664-47fd-b6f6-88955b89ea4c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:45.400113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69866cb2-c664-47fd-b6f6-88955b89ea4c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:45.400641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69866cb2-c664-47fd-b6f6-88955b89ea4c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:45.401108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69866cb2-c664-47fd-b6f6-88955b89ea4c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:45.401826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69866cb2-c664-47fd-b6f6-88955b89ea4c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:45.406743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69866cb2-c664-47fd-b6f6-88955b89ea4c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:45.413443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69866cb2-c664-47fd-b6f6-88955b89ea4c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:46.060347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-69866cb2-c664-47fd-b6f6-88955b89ea4c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:46.072245 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69866cb2-c664-47fd-b6f6-88955b89ea4c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1501 microversion: 2.1 time: 0.708513 Sep 10 10:44:46.072938 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1507/2013] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:45 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1501 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:46.078801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05e6ab4a-f3ce-4675-854b-ea4fb59fdac4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:46.079693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05e6ab4a-f3ce-4675-854b-ea4fb59fdac4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:46.086376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6ab4a-f3ce-4675-854b-ea4fb59fdac4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:46.087147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6ab4a-f3ce-4675-854b-ea4fb59fdac4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:46.087836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6ab4a-f3ce-4675-854b-ea4fb59fdac4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:46.088909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6ab4a-f3ce-4675-854b-ea4fb59fdac4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:46.089783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6ab4a-f3ce-4675-854b-ea4fb59fdac4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:46.090495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6ab4a-f3ce-4675-854b-ea4fb59fdac4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:46.528160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05e6ab4a-f3ce-4675-854b-ea4fb59fdac4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:46.537708 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05e6ab4a-f3ce-4675-854b-ea4fb59fdac4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1469 microversion: 2.1 time: 0.463301 Sep 10 10:44:46.564002 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1508/2014] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:46 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1469 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:46.570179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfa4c1a0-45b0-4c69-bb05-2aa598f4f312 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:46.571766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfa4c1a0-45b0-4c69-bb05-2aa598f4f312 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:46.579261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfa4c1a0-45b0-4c69-bb05-2aa598f4f312 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:46.579993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfa4c1a0-45b0-4c69-bb05-2aa598f4f312 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:46.580575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfa4c1a0-45b0-4c69-bb05-2aa598f4f312 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:46.581513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfa4c1a0-45b0-4c69-bb05-2aa598f4f312 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:46.582249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfa4c1a0-45b0-4c69-bb05-2aa598f4f312 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:46.583042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfa4c1a0-45b0-4c69-bb05-2aa598f4f312 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.109538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfa4c1a0-45b0-4c69-bb05-2aa598f4f312 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:47.117640 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfa4c1a0-45b0-4c69-bb05-2aa598f4f312 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.552168 Sep 10 10:44:47.118297 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1509/2015] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:46 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:47.125364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:47.126415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:47.134320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.135039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.135659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.136538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.137176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.137770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.173118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.173616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.174062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.174511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lazy-loading 'fault' on Instance uuid 147a5ac3-709e-43e4-89d3-ce745514c377 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:44:47.177520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:47.277153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47159487e9d490ebaba2d168f6c649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eeb7998eb2f456c9d5fd8f2f3cacf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:47.294689 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db60e1a0-d186-4ef5-b440-6c4acca6d112 tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 200 len: 1313 microversion: 2.1 time: 0.173907 Sep 10 10:44:47.317276 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1510/2016] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:47 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:47.326566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5e4e962e-e180-4c5c-9895-4c047d2d6847 req-e6f86544-4979-40d9-94b6-98e1f5718636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e93b86a-4f96-4e67-8d62-bc190286a2f9", "name": "network-vif-plugged", "status": "completed", "tag": "cc11e812-1e24-4e7c-8919-bcc89ad1958c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:47.345830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5e4e962e-e180-4c5c-9895-4c047d2d6847 req-e6f86544-4979-40d9-94b6-98e1f5718636 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.346674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5e4e962e-e180-4c5c-9895-4c047d2d6847 req-e6f86544-4979-40d9-94b6-98e1f5718636 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.347181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5e4e962e-e180-4c5c-9895-4c047d2d6847 req-e6f86544-4979-40d9-94b6-98e1f5718636 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.361572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5e4e962e-e180-4c5c-9895-4c047d2d6847 req-e6f86544-4979-40d9-94b6-98e1f5718636 service nova] Creating event network-vif-plugged:cc11e812-1e24-4e7c-8919-bcc89ad1958c for instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 on n-h1-856894-1 Sep 10 10:44:47.369433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-5e4e962e-e180-4c5c-9895-4c047d2d6847 req-e6f86544-4979-40d9-94b6-98e1f5718636 service nova] Instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 10:44:47.381102 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5e4e962e-e180-4c5c-9895-4c047d2d6847 req-e6f86544-4979-40d9-94b6-98e1f5718636 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061689 Sep 10 10:44:47.382546 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1511/2017] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:47.389000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:47.391997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:47.400409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.400972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.401470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.402213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.402676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.403104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.430626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lazy-loading 'flavor' on Instance uuid 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:44:47.447567 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] HTTP exception thrown: Cannot 'rescue' instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 while it is in vm_state paused Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Request method failure captured: Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action HTTP/1.1 Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 14 Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpHkAYnXeEeIkrvP5MU91LX1pHhCw1-X517wST7uI3nXMyFmEZF2-GrH_hD3-99qTj4dhIEoqm0d7-iBahX9spBGlFJJtEH3HGF62s1M_cLMl7ndO7Kwzn8XkzqLr7wv9Eh_FDYB9NepyfCMVt7SSvdhwxotJF7SX8u4upXel5-s6g Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52c98558e19447dfa54397d92f45dbb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0682225a07764437b25009c061ac844d Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: {"rescue": {}} Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'rescue' instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 while it is in vm_state paused Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0', 'body': {'rescue': {}}} Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 in vm_state paused. Cannot rescue while the instance is in this state. Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 while it is in vm_state paused Sep 10 10:44:47.449397 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 while it is in vm_state paused Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Returning 409 to user: Cannot 'rescue' instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 while it is in vm_state paused {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-788a3dfa-6bca-433d-b6eb-f979d90e2f81 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action" status: 409 len: 144 microversion: 2.1 time: 0.067076 Sep 10 10:44:47.453387 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1512/2018] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:47 2022] POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action => generated 144 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:44:47.457685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a49cdae5-7ee0-4002-adaa-813971620813 req-e130e73a-f7dd-4e82-91ba-bf69ad2e491a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147a5ac3-709e-43e4-89d3-ce745514c377", "name": "network-vif-deleted", "tag": "3086246d-f560-41ce-b858-9f9eb7fa8433"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:47.469797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a49cdae5-7ee0-4002-adaa-813971620813 req-e130e73a-f7dd-4e82-91ba-bf69ad2e491a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.470551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a49cdae5-7ee0-4002-adaa-813971620813 req-e130e73a-f7dd-4e82-91ba-bf69ad2e491a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.471139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a49cdae5-7ee0-4002-adaa-813971620813 req-e130e73a-f7dd-4e82-91ba-bf69ad2e491a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.488869 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a49cdae5-7ee0-4002-adaa-813971620813 req-e130e73a-f7dd-4e82-91ba-bf69ad2e491a service nova] Creating event network-vif-deleted:3086246d-f560-41ce-b858-9f9eb7fa8433 for instance 147a5ac3-709e-43e4-89d3-ce745514c377 on n-h2-856894-1 Sep 10 10:44:47.494654 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a49cdae5-7ee0-4002-adaa-813971620813 req-e130e73a-f7dd-4e82-91ba-bf69ad2e491a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040889 Sep 10 10:44:47.495199 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1513/2019] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:47.501681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8151a114-35bb-4c90-ad2e-ad4d29a50bd7 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:47.503525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8151a114-35bb-4c90-ad2e-ad4d29a50bd7 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:47.510506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8151a114-35bb-4c90-ad2e-ad4d29a50bd7 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.511008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8151a114-35bb-4c90-ad2e-ad4d29a50bd7 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.511465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8151a114-35bb-4c90-ad2e-ad4d29a50bd7 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.512789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8151a114-35bb-4c90-ad2e-ad4d29a50bd7 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.513419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8151a114-35bb-4c90-ad2e-ad4d29a50bd7 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.514062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8151a114-35bb-4c90-ad2e-ad4d29a50bd7 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.860508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8151a114-35bb-4c90-ad2e-ad4d29a50bd7 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:47.869378 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8151a114-35bb-4c90-ad2e-ad4d29a50bd7 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.372768 Sep 10 10:44:47.873119 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1514/2020] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:47 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:47.875819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2663c59f-24ce-42d4-b456-ac0f3ee524b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:47.876718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2663c59f-24ce-42d4-b456-ac0f3ee524b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:47.882892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2663c59f-24ce-42d4-b456-ac0f3ee524b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.884016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2663c59f-24ce-42d4-b456-ac0f3ee524b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.884958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2663c59f-24ce-42d4-b456-ac0f3ee524b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.885940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2663c59f-24ce-42d4-b456-ac0f3ee524b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:47.886582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2663c59f-24ce-42d4-b456-ac0f3ee524b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:47.887201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2663c59f-24ce-42d4-b456-ac0f3ee524b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:47.980679 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2663c59f-24ce-42d4-b456-ac0f3ee524b7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action" status: 202 len: 0 microversion: 2.1 time: 0.108756 Sep 10 10:44:47.993670 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1515/2021] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:47 2022] POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:44:48.002837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b3a2d20-9fd3-40a4-a832-a6d596647494 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:48.007854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b3a2d20-9fd3-40a4-a832-a6d596647494 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:48.027915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b3a2d20-9fd3-40a4-a832-a6d596647494 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:48.033203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b3a2d20-9fd3-40a4-a832-a6d596647494 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:48.033770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b3a2d20-9fd3-40a4-a832-a6d596647494 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:48.034704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b3a2d20-9fd3-40a4-a832-a6d596647494 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:48.035898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b3a2d20-9fd3-40a4-a832-a6d596647494 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:48.036493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b3a2d20-9fd3-40a4-a832-a6d596647494 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:48.315855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b3a2d20-9fd3-40a4-a832-a6d596647494 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:48.332473 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b3a2d20-9fd3-40a4-a832-a6d596647494 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1469 microversion: 2.1 time: 0.336014 Sep 10 10:44:48.334248 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1516/2022] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:47 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:48.345106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9bdbfcb9-3194-4e5c-b518-ddddee205c5b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:48.349563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9bdbfcb9-3194-4e5c-b518-ddddee205c5b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:48.362440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bdbfcb9-3194-4e5c-b518-ddddee205c5b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:48.363218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bdbfcb9-3194-4e5c-b518-ddddee205c5b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:48.363655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bdbfcb9-3194-4e5c-b518-ddddee205c5b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:48.364351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bdbfcb9-3194-4e5c-b518-ddddee205c5b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:48.364801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bdbfcb9-3194-4e5c-b518-ddddee205c5b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:48.365269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bdbfcb9-3194-4e5c-b518-ddddee205c5b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:48.637629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9bdbfcb9-3194-4e5c-b518-ddddee205c5b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:48.648332 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9bdbfcb9-3194-4e5c-b518-ddddee205c5b tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1516 microversion: 2.1 time: 0.310427 Sep 10 10:44:48.650009 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1517/2023] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:48 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:48.654920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-867afc43-d862-4c50-ba70-892ff2e400de tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:48.655727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-867afc43-d862-4c50-ba70-892ff2e400de tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:48.662860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-867afc43-d862-4c50-ba70-892ff2e400de tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:48.663517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-867afc43-d862-4c50-ba70-892ff2e400de tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:48.664126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-867afc43-d862-4c50-ba70-892ff2e400de tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:48.665198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-867afc43-d862-4c50-ba70-892ff2e400de tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:48.665810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-867afc43-d862-4c50-ba70-892ff2e400de tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:48.666387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-867afc43-d862-4c50-ba70-892ff2e400de tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:48.912971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-867afc43-d862-4c50-ba70-892ff2e400de tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:48.927034 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-867afc43-d862-4c50-ba70-892ff2e400de tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.275579 Sep 10 10:44:48.927907 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1518/2024] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:48 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:48.934264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:48.935078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] [instance: 147a5ac3-709e-43e4-89d3-ce745514c377] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:48.952744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:48.953476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:48.954076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:48.954783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:48.955260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:48.955646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:48.981357 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] HTTP exception thrown: Instance 147a5ac3-709e-43e4-89d3-ce745514c377 could not be found. Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Request method failure captured: Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 HTTP/1.1 Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpAiVobdMhaRoHEMcE_K4_a2_diAYLZcFJOWi6OwWAAgEX5SfrlwzvcCzNN8gKd0vrgDPRlL41aDlQjtKfb7l593Km-kTz-4_taBPSCtdO_fYwXnfKjXVrwFe3rdrPkAvH_IvyrntKWOYxpXPcXx8n-_SStmghwvKIK9ygRqZLaWhE Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6eeb7998eb2f456c9d5fd8f2f3cacf41 Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-976982366 Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6eeb7998eb2f456c9d5fd8f2f3cacf41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6eeb7998eb2f456c9d5fd8f2f3cacf41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6eeb7998eb2f456c9d5fd8f2f3cacf41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6eeb7998eb2f456c9d5fd8f2f3cacf41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-976982366 Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6eeb7998eb2f456c9d5fd8f2f3cacf41 Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-976982366 Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueTestJSONUnderV235-976982366-project Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: f47159487e9d490ebaba2d168f6c649c Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-976982366-project Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 147a5ac3-709e-43e4-89d3-ce745514c377 could not be found. Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '147a5ac3-709e-43e4-89d3-ce745514c377'} Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147a5ac3-709e-43e4-89d3-ce745514c377 could not be found. Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147a5ac3-709e-43e4-89d3-ce745514c377 could not be found. Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:48.982464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:44:48.986957 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:48.986957 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:44:48.986957 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:44:48.986957 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:44:48.986957 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:44:48.986957 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:44:48.986957 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147a5ac3-709e-43e4-89d3-ce745514c377 could not be found. Sep 10 10:44:48.986957 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:44:48.986957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] Returning 404 to user: Instance 147a5ac3-709e-43e4-89d3-ce745514c377 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:44:48.986957 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a463b350-594d-4709-9ffb-f329c2b73f0a tempest-ServerRescueTestJSONUnderV235-976982366 tempest-ServerRescueTestJSONUnderV235-976982366-project] 10.222.0.20 "GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377" status: 404 len: 111 microversion: 2.1 time: 0.054271 Sep 10 10:44:48.996512 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1519/2025] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:48 2022] GET /compute/v2.1/servers/147a5ac3-709e-43e4-89d3-ce745514c377 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:44:49.005949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff0fef7d-39ca-44c4-9f42-e5ab25131a74 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:49.006570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff0fef7d-39ca-44c4-9f42-e5ab25131a74 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:49.018091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff0fef7d-39ca-44c4-9f42-e5ab25131a74 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:49.018573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff0fef7d-39ca-44c4-9f42-e5ab25131a74 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:49.026733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff0fef7d-39ca-44c4-9f42-e5ab25131a74 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:49.027495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff0fef7d-39ca-44c4-9f42-e5ab25131a74 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:49.027966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff0fef7d-39ca-44c4-9f42-e5ab25131a74 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:49.028395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff0fef7d-39ca-44c4-9f42-e5ab25131a74 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:49.404656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff0fef7d-39ca-44c4-9f42-e5ab25131a74 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:49.415867 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff0fef7d-39ca-44c4-9f42-e5ab25131a74 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.416841 Sep 10 10:44:49.417042 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1520/2026] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:48 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:49.424670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1bd71ab9-a965-4d2a-b65f-33d895ba1005 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:49.426962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1bd71ab9-a965-4d2a-b65f-33d895ba1005 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:49.440606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bd71ab9-a965-4d2a-b65f-33d895ba1005 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:49.441548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bd71ab9-a965-4d2a-b65f-33d895ba1005 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:49.442212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bd71ab9-a965-4d2a-b65f-33d895ba1005 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:49.443295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bd71ab9-a965-4d2a-b65f-33d895ba1005 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:49.446459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bd71ab9-a965-4d2a-b65f-33d895ba1005 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:49.450009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bd71ab9-a965-4d2a-b65f-33d895ba1005 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:49.881205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1bd71ab9-a965-4d2a-b65f-33d895ba1005 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:49.921251 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1bd71ab9-a965-4d2a-b65f-33d895ba1005 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1461 microversion: 2.1 time: 0.500472 Sep 10 10:44:49.921795 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1521/2027] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:49 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1461 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:49.956477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa096b11-0fdd-4878-a390-3249436fa96c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:49.957861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa096b11-0fdd-4878-a390-3249436fa96c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:49.975031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa096b11-0fdd-4878-a390-3249436fa96c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:49.978840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa096b11-0fdd-4878-a390-3249436fa96c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:49.979471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa096b11-0fdd-4878-a390-3249436fa96c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:49.984378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa096b11-0fdd-4878-a390-3249436fa96c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:49.988433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa096b11-0fdd-4878-a390-3249436fa96c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:49.989528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa096b11-0fdd-4878-a390-3249436fa96c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:50.463689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa096b11-0fdd-4878-a390-3249436fa96c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:50.473875 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa096b11-0fdd-4878-a390-3249436fa96c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.523702 Sep 10 10:44:50.491806 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1522/2028] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:49 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:50.506538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f33ae18b-82f0-4cf6-ac00-577868e3b37f tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:50.507464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f33ae18b-82f0-4cf6-ac00-577868e3b37f tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:50.522439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f33ae18b-82f0-4cf6-ac00-577868e3b37f tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:50.522951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f33ae18b-82f0-4cf6-ac00-577868e3b37f tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:50.526189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f33ae18b-82f0-4cf6-ac00-577868e3b37f tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:50.529028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f33ae18b-82f0-4cf6-ac00-577868e3b37f tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:50.531775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f33ae18b-82f0-4cf6-ac00-577868e3b37f tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:50.533332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f33ae18b-82f0-4cf6-ac00-577868e3b37f tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:50.954301 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f33ae18b-82f0-4cf6-ac00-577868e3b37f tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1612 microversion: 2.1 time: 0.456244 Sep 10 10:44:50.955891 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1523/2029] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:50 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1612 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:50.966707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86bbee96-a719-4b0e-aaf5-eea3a5497a25 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:50.969744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86bbee96-a719-4b0e-aaf5-eea3a5497a25 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:50.982390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86bbee96-a719-4b0e-aaf5-eea3a5497a25 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:50.983589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86bbee96-a719-4b0e-aaf5-eea3a5497a25 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:50.985612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86bbee96-a719-4b0e-aaf5-eea3a5497a25 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:50.986521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86bbee96-a719-4b0e-aaf5-eea3a5497a25 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:50.987246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86bbee96-a719-4b0e-aaf5-eea3a5497a25 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:50.987683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86bbee96-a719-4b0e-aaf5-eea3a5497a25 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:51.672848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-86bbee96-a719-4b0e-aaf5-eea3a5497a25 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:51.683560 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86bbee96-a719-4b0e-aaf5-eea3a5497a25 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.726183 Sep 10 10:44:51.685326 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1524/2030] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:50 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:51.690226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94262636-d145-4f47-b933-207bb7ff9c85 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '.version_select at 0x7efcae8f8790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:51.694932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94262636-d145-4f47-b933-207bb7ff9c85 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:51.696389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94262636-d145-4f47-b933-207bb7ff9c85 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:51.696989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94262636-d145-4f47-b933-207bb7ff9c85 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:51.717387 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94262636-d145-4f47-b933-207bb7ff9c85 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.030548 Sep 10 10:44:51.730011 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1525/2031] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:44:51 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:51.735486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-92182a13-6c66-42cc-bf71-37f48972fae0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:51.737917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-92182a13-6c66-42cc-bf71-37f48972fae0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:51.745704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92182a13-6c66-42cc-bf71-37f48972fae0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:51.746361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92182a13-6c66-42cc-bf71-37f48972fae0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:51.746888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92182a13-6c66-42cc-bf71-37f48972fae0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:51.747768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92182a13-6c66-42cc-bf71-37f48972fae0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:51.748378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92182a13-6c66-42cc-bf71-37f48972fae0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:51.749159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92182a13-6c66-42cc-bf71-37f48972fae0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:51.788049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-92182a13-6c66-42cc-bf71-37f48972fae0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lazy-loading 'flavor' on Instance uuid 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:44:51.887614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:51.919744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-92182a13-6c66-42cc-bf71-37f48972fae0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action" status: 200 len: 32 microversion: 2.1 time: 0.187554 Sep 10 10:44:51.920638 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1526/2032] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:44:51 2022] POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:44:51.953171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de52a459-cced-4aac-8b41-81e36aacaa45 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:51.955579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de52a459-cced-4aac-8b41-81e36aacaa45 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:51.968743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de52a459-cced-4aac-8b41-81e36aacaa45 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:51.971352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de52a459-cced-4aac-8b41-81e36aacaa45 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:51.971805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de52a459-cced-4aac-8b41-81e36aacaa45 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:51.972585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de52a459-cced-4aac-8b41-81e36aacaa45 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:51.973047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de52a459-cced-4aac-8b41-81e36aacaa45 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:51.975623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de52a459-cced-4aac-8b41-81e36aacaa45 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:52.350472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-de52a459-cced-4aac-8b41-81e36aacaa45 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:52.376621 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de52a459-cced-4aac-8b41-81e36aacaa45 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.454471 Sep 10 10:44:52.379092 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1527/2033] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:51 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:52.386948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e9150585-9eb7-421f-91f0-aac9eca66be2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:52.388073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e9150585-9eb7-421f-91f0-aac9eca66be2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:52.410047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9150585-9eb7-421f-91f0-aac9eca66be2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:52.412077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9150585-9eb7-421f-91f0-aac9eca66be2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:52.413757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9150585-9eb7-421f-91f0-aac9eca66be2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:52.431373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9150585-9eb7-421f-91f0-aac9eca66be2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:52.432464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9150585-9eb7-421f-91f0-aac9eca66be2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:52.433220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9150585-9eb7-421f-91f0-aac9eca66be2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:53.023945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9150585-9eb7-421f-91f0-aac9eca66be2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:53.037471 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e9150585-9eb7-421f-91f0-aac9eca66be2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.656905 Sep 10 10:44:53.038074 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1528/2034] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:52 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:53.064535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2145842076", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:53.151636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:44:53.724676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:44:53.725443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:44:53.726076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:44:53.726661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:44:53.727882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:44:53.747585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:53.751860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:53.752711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:53.753552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:53.754031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:53.754467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:53.804555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for project 7c408248417b4deaaa26ef380da4bb90. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:44:53.816406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for user f5b257d1488141689c826efe484e4040 and project 7c408248417b4deaaa26ef380da4bb90. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:44:53.850155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:44:53.853442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:44:53.905652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:44:53.972954 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f25ae5d-4ff2-4940-a670-831c998f1a53 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915878 Sep 10 10:44:53.974047 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1529/2035] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:44:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:44:53.984948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c6c930d9-7184-401c-a904-58ec26e28a5c req-eb31f5cc-6b44-480a-99dc-6c2a9853c173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178b8f2f-5352-4ae4-9f3e-bef5e366456d", "name": "network-vif-unplugged", "status": "completed", "tag": "f2494b11-7317-47ca-a893-5644f4502288"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:54.004298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c6c930d9-7184-401c-a904-58ec26e28a5c req-eb31f5cc-6b44-480a-99dc-6c2a9853c173 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:54.005344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c6c930d9-7184-401c-a904-58ec26e28a5c req-eb31f5cc-6b44-480a-99dc-6c2a9853c173 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:54.006024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c6c930d9-7184-401c-a904-58ec26e28a5c req-eb31f5cc-6b44-480a-99dc-6c2a9853c173 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:54.052303 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c6c930d9-7184-401c-a904-58ec26e28a5c req-eb31f5cc-6b44-480a-99dc-6c2a9853c173 service nova] Creating event network-vif-unplugged:f2494b11-7317-47ca-a893-5644f4502288 for instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d on n-h2-856894-1 Sep 10 10:44:54.064572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c6c930d9-7184-401c-a904-58ec26e28a5c req-eb31f5cc-6b44-480a-99dc-6c2a9853c173 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088647 Sep 10 10:44:54.065344 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1530/2036] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:54.077945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7d82964f-6d81-4898-bdf2-123d523c9c5f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:54.078667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7d82964f-6d81-4898-bdf2-123d523c9c5f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:54.112080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d82964f-6d81-4898-bdf2-123d523c9c5f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:54.112772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d82964f-6d81-4898-bdf2-123d523c9c5f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:54.115145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d82964f-6d81-4898-bdf2-123d523c9c5f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:54.116094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d82964f-6d81-4898-bdf2-123d523c9c5f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:54.121491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d82964f-6d81-4898-bdf2-123d523c9c5f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:54.122680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d82964f-6d81-4898-bdf2-123d523c9c5f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:54.436726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7d82964f-6d81-4898-bdf2-123d523c9c5f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:54.451403 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7d82964f-6d81-4898-bdf2-123d523c9c5f tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1506 microversion: 2.1 time: 0.383466 Sep 10 10:44:54.451899 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1531/2037] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:54 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:54.457027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-103623a9-85fb-476b-949b-a2e152ca4c60 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:54.457607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-103623a9-85fb-476b-949b-a2e152ca4c60 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:54.479378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-103623a9-85fb-476b-949b-a2e152ca4c60 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:54.479873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-103623a9-85fb-476b-949b-a2e152ca4c60 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:54.480306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-103623a9-85fb-476b-949b-a2e152ca4c60 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:54.489034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-103623a9-85fb-476b-949b-a2e152ca4c60 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:54.489556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-103623a9-85fb-476b-949b-a2e152ca4c60 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:54.490053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-103623a9-85fb-476b-949b-a2e152ca4c60 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:54.838372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-103623a9-85fb-476b-949b-a2e152ca4c60 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:54.856240 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-103623a9-85fb-476b-949b-a2e152ca4c60 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.402776 Sep 10 10:44:54.860655 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1532/2038] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:54 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:55.105258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1228963162", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "f1689f33-58e5-45ac-9fc5-3a833f4afde6"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:55.199235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] validate_networks() for [('f1689f33-58e5-45ac-9fc5-3a833f4afde6', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:44:55.989509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:44:55.989934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:44:55.990403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:44:55.991011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:44:55.991700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:44:56.035960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:56.037497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:56.038210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:56.041849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:56.042870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:56.046446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:56.077777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Getting quotas for project ee641ddfdc8a4ff6a9e9a58b705a1fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:44:56.084252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Getting quotas for user 3e6d3452f1dd4b7781f0f6d490115e6b and project ee641ddfdc8a4ff6a9e9a58b705a1fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:44:56.121873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:44:56.125333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:44:56.183318 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a5a679f0-499e-4f4b-8873-dd138c75093a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.321240 Sep 10 10:44:56.183992 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1533/2039] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:44:56.189030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21cb27a0-03bd-416e-9a11-7d6539c94d0b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:56.189883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21cb27a0-03bd-416e-9a11-7d6539c94d0b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:56.197251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21cb27a0-03bd-416e-9a11-7d6539c94d0b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:56.197893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21cb27a0-03bd-416e-9a11-7d6539c94d0b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:56.198398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21cb27a0-03bd-416e-9a11-7d6539c94d0b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:56.199105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21cb27a0-03bd-416e-9a11-7d6539c94d0b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:56.199657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21cb27a0-03bd-416e-9a11-7d6539c94d0b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:56.199985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21cb27a0-03bd-416e-9a11-7d6539c94d0b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:56.356498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21cb27a0-03bd-416e-9a11-7d6539c94d0b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:56.377751 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21cb27a0-03bd-416e-9a11-7d6539c94d0b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1209 microversion: 2.1 time: 0.189149 Sep 10 10:44:56.380143 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1534/2040] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:56 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1209 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:56.387445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-192f5148-e4ac-4cfe-9616-288533621ebb tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:56.389573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-192f5148-e4ac-4cfe-9616-288533621ebb tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:56.421490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-192f5148-e4ac-4cfe-9616-288533621ebb tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:56.422422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-192f5148-e4ac-4cfe-9616-288533621ebb tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:56.425258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-192f5148-e4ac-4cfe-9616-288533621ebb tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:56.426516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-192f5148-e4ac-4cfe-9616-288533621ebb tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:56.427137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-192f5148-e4ac-4cfe-9616-288533621ebb tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:56.429264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-192f5148-e4ac-4cfe-9616-288533621ebb tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:56.863875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-192f5148-e4ac-4cfe-9616-288533621ebb tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:56.892726 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-192f5148-e4ac-4cfe-9616-288533621ebb tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.511237 Sep 10 10:44:56.893743 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1535/2041] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:56 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:56.903164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6eb1a8c0-7a73-4c37-acbd-615e67556558 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:56.903854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6eb1a8c0-7a73-4c37-acbd-615e67556558 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:56.936100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb1a8c0-7a73-4c37-acbd-615e67556558 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:56.936605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb1a8c0-7a73-4c37-acbd-615e67556558 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:56.937041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb1a8c0-7a73-4c37-acbd-615e67556558 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:56.939665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb1a8c0-7a73-4c37-acbd-615e67556558 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:56.940152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb1a8c0-7a73-4c37-acbd-615e67556558 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:56.940589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb1a8c0-7a73-4c37-acbd-615e67556558 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:57.326955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6eb1a8c0-7a73-4c37-acbd-615e67556558 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:57.349199 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6eb1a8c0-7a73-4c37-acbd-615e67556558 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1522 microversion: 2.1 time: 0.454121 Sep 10 10:44:57.350049 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1536/2042] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:56 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:57.365555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-92ea9d6f-4c6c-4455-af16-1c44a507f302 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:57.366261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-92ea9d6f-4c6c-4455-af16-1c44a507f302 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:57.402667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92ea9d6f-4c6c-4455-af16-1c44a507f302 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:57.403236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92ea9d6f-4c6c-4455-af16-1c44a507f302 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:57.403691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92ea9d6f-4c6c-4455-af16-1c44a507f302 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:57.406067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92ea9d6f-4c6c-4455-af16-1c44a507f302 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:57.406869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92ea9d6f-4c6c-4455-af16-1c44a507f302 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:57.408724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92ea9d6f-4c6c-4455-af16-1c44a507f302 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:57.735060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-92ea9d6f-4c6c-4455-af16-1c44a507f302 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:57.747875 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-92ea9d6f-4c6c-4455-af16-1c44a507f302 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.394841 Sep 10 10:44:57.748705 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1537/2043] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:57 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:57.753457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4b69d8a8-eff1-4bcc-8b83-fd543f5af76e req-545f433a-6337-404d-8fba-5d6689144cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178b8f2f-5352-4ae4-9f3e-bef5e366456d", "tag": "f2494b11-7317-47ca-a893-5644f4502288"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:44:57.763873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4b69d8a8-eff1-4bcc-8b83-fd543f5af76e req-545f433a-6337-404d-8fba-5d6689144cb1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:57.767455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4b69d8a8-eff1-4bcc-8b83-fd543f5af76e req-545f433a-6337-404d-8fba-5d6689144cb1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:57.768163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4b69d8a8-eff1-4bcc-8b83-fd543f5af76e req-545f433a-6337-404d-8fba-5d6689144cb1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:57.794911 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4b69d8a8-eff1-4bcc-8b83-fd543f5af76e req-545f433a-6337-404d-8fba-5d6689144cb1 service nova] Creating event network-changed:f2494b11-7317-47ca-a893-5644f4502288 for instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d on n-h2-856894-1 Sep 10 10:44:57.807942 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4b69d8a8-eff1-4bcc-8b83-fd543f5af76e req-545f433a-6337-404d-8fba-5d6689144cb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057563 Sep 10 10:44:57.811425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1538/2044] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:44:57.821825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93cab214-e5eb-43f1-87f8-ddb4461a86ea tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:57.825263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93cab214-e5eb-43f1-87f8-ddb4461a86ea tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:57.846977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93cab214-e5eb-43f1-87f8-ddb4461a86ea tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:57.850857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93cab214-e5eb-43f1-87f8-ddb4461a86ea tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:57.851571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93cab214-e5eb-43f1-87f8-ddb4461a86ea tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:57.853180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93cab214-e5eb-43f1-87f8-ddb4461a86ea tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:57.855068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93cab214-e5eb-43f1-87f8-ddb4461a86ea tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:57.856922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93cab214-e5eb-43f1-87f8-ddb4461a86ea tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:58.095802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93cab214-e5eb-43f1-87f8-ddb4461a86ea tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:58.104806 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93cab214-e5eb-43f1-87f8-ddb4461a86ea tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1277 microversion: 2.1 time: 0.292039 Sep 10 10:44:58.108982 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1539/2045] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:57 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1277 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:58.126438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7aa89b28-e9f0-4cab-8f20-09d11f4af809 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:58.127286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7aa89b28-e9f0-4cab-8f20-09d11f4af809 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:58.138943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa89b28-e9f0-4cab-8f20-09d11f4af809 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:58.140041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa89b28-e9f0-4cab-8f20-09d11f4af809 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:58.141251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa89b28-e9f0-4cab-8f20-09d11f4af809 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:58.143881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa89b28-e9f0-4cab-8f20-09d11f4af809 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:58.144837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa89b28-e9f0-4cab-8f20-09d11f4af809 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:58.145574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa89b28-e9f0-4cab-8f20-09d11f4af809 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:58.392125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7aa89b28-e9f0-4cab-8f20-09d11f4af809 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:58.403756 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7aa89b28-e9f0-4cab-8f20-09d11f4af809 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1271 microversion: 2.1 time: 0.293323 Sep 10 10:44:58.404520 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1540/2046] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:58 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:58.410165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb2c431b-0308-427d-a0ea-3581f5784a35 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:58.410778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cb2c431b-0308-427d-a0ea-3581f5784a35 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:58.425294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2c431b-0308-427d-a0ea-3581f5784a35 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:58.426134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2c431b-0308-427d-a0ea-3581f5784a35 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:58.426860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2c431b-0308-427d-a0ea-3581f5784a35 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:58.427781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2c431b-0308-427d-a0ea-3581f5784a35 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:58.428597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2c431b-0308-427d-a0ea-3581f5784a35 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:58.429384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2c431b-0308-427d-a0ea-3581f5784a35 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:58.780890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cb2c431b-0308-427d-a0ea-3581f5784a35 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:58.799572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb2c431b-0308-427d-a0ea-3581f5784a35 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.385132 Sep 10 10:44:58.801817 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1541/2047] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:58 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:58.830065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed7d4b98-6ea0-4105-97fd-6a8e9df0b672 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:58.839969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed7d4b98-6ea0-4105-97fd-6a8e9df0b672 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:58.879029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed7d4b98-6ea0-4105-97fd-6a8e9df0b672 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:58.884494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed7d4b98-6ea0-4105-97fd-6a8e9df0b672 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:58.889135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed7d4b98-6ea0-4105-97fd-6a8e9df0b672 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:58.891440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed7d4b98-6ea0-4105-97fd-6a8e9df0b672 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:58.898969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed7d4b98-6ea0-4105-97fd-6a8e9df0b672 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:58.899525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed7d4b98-6ea0-4105-97fd-6a8e9df0b672 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:59.583598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed7d4b98-6ea0-4105-97fd-6a8e9df0b672 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:44:59.594532 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed7d4b98-6ea0-4105-97fd-6a8e9df0b672 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1522 microversion: 2.1 time: 0.791242 Sep 10 10:44:59.597155 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1542/2048] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:58 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1522 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:44:59.605832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a1d1525-9a39-4b62-8da3-159c3e77f790 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:44:59.608088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8a1d1525-9a39-4b62-8da3-159c3e77f790 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:44:59.619082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a1d1525-9a39-4b62-8da3-159c3e77f790 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:59.620312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a1d1525-9a39-4b62-8da3-159c3e77f790 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:59.620911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a1d1525-9a39-4b62-8da3-159c3e77f790 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:44:59.625000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a1d1525-9a39-4b62-8da3-159c3e77f790 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:44:59.625704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a1d1525-9a39-4b62-8da3-159c3e77f790 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:44:59.627744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a1d1525-9a39-4b62-8da3-159c3e77f790 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:00.106928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a1d1525-9a39-4b62-8da3-159c3e77f790 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:00.130196 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8a1d1525-9a39-4b62-8da3-159c3e77f790 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.528392 Sep 10 10:45:00.133918 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1543/2049] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:44:59 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:00.147973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:00.148618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:00.169947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:00.170451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:00.170888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:00.171608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:00.180171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:00.185743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:00.406824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:00.421538 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1283 microversion: 2.1 time: 0.284498 Sep 10 10:45:00.423537 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1544/2050] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:00 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1283 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:00.430607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:00.433942 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-033bebda-aaf4-4909-b507-18df274b3bd1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007597 Sep 10 10:45:00.436276 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1545/2051] 10.222.0.20 () {56 vars in 886 bytes} [Sat Sep 10 10:45:00 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 10:45:00.452303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7aaf5a3c-3602-43d7-9099-492da101a9cb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:00.454839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7aaf5a3c-3602-43d7-9099-492da101a9cb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:00.484940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aaf5a3c-3602-43d7-9099-492da101a9cb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:00.488746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aaf5a3c-3602-43d7-9099-492da101a9cb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:00.490294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aaf5a3c-3602-43d7-9099-492da101a9cb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:00.495183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aaf5a3c-3602-43d7-9099-492da101a9cb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:00.497473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aaf5a3c-3602-43d7-9099-492da101a9cb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:00.498853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aaf5a3c-3602-43d7-9099-492da101a9cb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:01.066440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7aaf5a3c-3602-43d7-9099-492da101a9cb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:01.068977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:01.080446 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7aaf5a3c-3602-43d7-9099-492da101a9cb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1313 microversion: 2.1 time: 0.640455 Sep 10 10:45:01.083478 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1546/2052] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:00 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:01.100895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a61ce49-b499-4604-92c9-652915d63b45 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:01.102210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a61ce49-b499-4604-92c9-652915d63b45 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:01.111339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a61ce49-b499-4604-92c9-652915d63b45 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:01.111829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a61ce49-b499-4604-92c9-652915d63b45 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:01.112293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a61ce49-b499-4604-92c9-652915d63b45 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:01.113064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a61ce49-b499-4604-92c9-652915d63b45 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:01.118020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a61ce49-b499-4604-92c9-652915d63b45 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:01.118513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a61ce49-b499-4604-92c9-652915d63b45 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:01.536504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a61ce49-b499-4604-92c9-652915d63b45 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:01.546642 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a61ce49-b499-4604-92c9-652915d63b45 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.461979 Sep 10 10:45:01.568026 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1547/2053] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:01 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:01.852306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3b58b413-b883-42e0-8eb5-77ae6e1a9bf8 req-a7e918d7-59d9-428d-9e37-a25f2b6aba10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae35632-52bf-4dd6-88fb-b4419eab5073", "name": "network-vif-plugged", "status": "completed", "tag": "4ceb2860-1b4b-4bd8-ac7d-9b0d7e86c610"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:01.876272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3b58b413-b883-42e0-8eb5-77ae6e1a9bf8 req-a7e918d7-59d9-428d-9e37-a25f2b6aba10 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:01.878272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3b58b413-b883-42e0-8eb5-77ae6e1a9bf8 req-a7e918d7-59d9-428d-9e37-a25f2b6aba10 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:01.878794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3b58b413-b883-42e0-8eb5-77ae6e1a9bf8 req-a7e918d7-59d9-428d-9e37-a25f2b6aba10 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:01.909225 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3b58b413-b883-42e0-8eb5-77ae6e1a9bf8 req-a7e918d7-59d9-428d-9e37-a25f2b6aba10 service nova] Creating event network-vif-plugged:4ceb2860-1b4b-4bd8-ac7d-9b0d7e86c610 for instance aae35632-52bf-4dd6-88fb-b4419eab5073 on n-h2-856894-1 Sep 10 10:45:01.923263 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3b58b413-b883-42e0-8eb5-77ae6e1a9bf8 req-a7e918d7-59d9-428d-9e37-a25f2b6aba10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350689 Sep 10 10:45:01.924212 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1548/2054] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:01.930699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3b58b413-b883-42e0-8eb5-77ae6e1a9bf8 req-a7e918d7-59d9-428d-9e37-a25f2b6aba10 service nova] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:01.933966 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3b58b413-b883-42e0-8eb5-77ae6e1a9bf8 req-a7e918d7-59d9-428d-9e37-a25f2b6aba10 service nova] 10.222.0.20 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004541 Sep 10 10:45:01.934450 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1549/2055] 10.222.0.20 () {54 vars in 1035 bytes} [Sat Sep 10 10:45:01 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 10 10:45:01.952878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88b3a667-8353-4b67-96a6-9fa462980cff tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:01.955103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88b3a667-8353-4b67-96a6-9fa462980cff tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:01.973879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88b3a667-8353-4b67-96a6-9fa462980cff tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:01.974431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88b3a667-8353-4b67-96a6-9fa462980cff tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:01.974873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88b3a667-8353-4b67-96a6-9fa462980cff tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:01.975587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88b3a667-8353-4b67-96a6-9fa462980cff tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:01.976538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88b3a667-8353-4b67-96a6-9fa462980cff tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:01.976965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88b3a667-8353-4b67-96a6-9fa462980cff tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:03.104484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88b3a667-8353-4b67-96a6-9fa462980cff tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:03.113385 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88b3a667-8353-4b67-96a6-9fa462980cff tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1522 microversion: 2.1 time: 1.170887 Sep 10 10:45:03.116744 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1550/2056] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:01 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1522 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:03.122017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8a01bbd-e993-43c5-95ba-8accd3aa2f3b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:03.124720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e8a01bbd-e993-43c5-95ba-8accd3aa2f3b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:03.146196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8a01bbd-e993-43c5-95ba-8accd3aa2f3b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:03.147821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8a01bbd-e993-43c5-95ba-8accd3aa2f3b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:03.151681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8a01bbd-e993-43c5-95ba-8accd3aa2f3b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:03.152711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8a01bbd-e993-43c5-95ba-8accd3aa2f3b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:03.153416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8a01bbd-e993-43c5-95ba-8accd3aa2f3b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:03.154073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8a01bbd-e993-43c5-95ba-8accd3aa2f3b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:03.418254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e8a01bbd-e993-43c5-95ba-8accd3aa2f3b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:03.430216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8a01bbd-e993-43c5-95ba-8accd3aa2f3b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.307919 Sep 10 10:45:03.444378 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1551/2057] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:03 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:03.444378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:03.444378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:03.457298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:03.459380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:03.461668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:03.462591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:03.463231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:03.466924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:03.744901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:03.766770 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1325 microversion: 2.1 time: 0.333586 Sep 10 10:45:03.780226 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1552/2058] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:03 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:03.782502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:03.788732 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-438551fe-2245-4ddd-a7af-c57ebf38b7bf tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.006843 Sep 10 10:45:03.790185 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1553/2059] 10.222.0.20 () {54 vars in 1041 bytes} [Sat Sep 10 10:45:03 2022] GET /compute/v2.1/ => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:03.798401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-25651c5c-0faa-4cdc-a55b-03060f30b818 req-8dc785af-ca0a-4b63-85f5-4d8888ccb64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda18caa-5a27-40b6-ae42-48a93b63825c", "tag": "a8d7b3d4-fa78-4890-8baa-75a8aff3caff"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:03.831279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-25651c5c-0faa-4cdc-a55b-03060f30b818 req-8dc785af-ca0a-4b63-85f5-4d8888ccb64f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:03.832137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-25651c5c-0faa-4cdc-a55b-03060f30b818 req-8dc785af-ca0a-4b63-85f5-4d8888ccb64f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:03.834392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-25651c5c-0faa-4cdc-a55b-03060f30b818 req-8dc785af-ca0a-4b63-85f5-4d8888ccb64f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:03.849533 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-25651c5c-0faa-4cdc-a55b-03060f30b818 req-8dc785af-ca0a-4b63-85f5-4d8888ccb64f service nova] Creating event network-changed:a8d7b3d4-fa78-4890-8baa-75a8aff3caff for instance fda18caa-5a27-40b6-ae42-48a93b63825c on n-h2-856894-1 Sep 10 10:45:03.856584 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-25651c5c-0faa-4cdc-a55b-03060f30b818 req-8dc785af-ca0a-4b63-85f5-4d8888ccb64f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065175 Sep 10 10:45:03.857782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1554/2060] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:03.864254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ae37fe1-8987-49fe-9058-ee7b01d01ace tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:03.865133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6ae37fe1-8987-49fe-9058-ee7b01d01ace tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:03.875012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae37fe1-8987-49fe-9058-ee7b01d01ace tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:03.876000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae37fe1-8987-49fe-9058-ee7b01d01ace tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:03.876673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae37fe1-8987-49fe-9058-ee7b01d01ace tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:03.877817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae37fe1-8987-49fe-9058-ee7b01d01ace tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:03.878776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae37fe1-8987-49fe-9058-ee7b01d01ace tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:03.881412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae37fe1-8987-49fe-9058-ee7b01d01ace tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:04.077635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6ae37fe1-8987-49fe-9058-ee7b01d01ace tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:04.092883 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ae37fe1-8987-49fe-9058-ee7b01d01ace tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1313 microversion: 2.1 time: 0.232679 Sep 10 10:45:04.094131 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1555/2061] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:03 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:04.102140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:04.102967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:04.109807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:04.111197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:04.113003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:04.114712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:04.115327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:04.116073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:04.556720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:04.567610 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.472189 Sep 10 10:45:04.582611 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1556/2062] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:04 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:04.582611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:04.582611 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a01b962-9899-4d60-9590-8c2534daf25c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001190 Sep 10 10:45:04.582611 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1557/2063] 10.222.0.20 () {56 vars in 886 bytes} [Sat Sep 10 10:45:04 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 10:45:04.615271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a634203-0fcd-4cd2-88e6-db37cea51b84 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:04.615271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a634203-0fcd-4cd2-88e6-db37cea51b84 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:04.632379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a634203-0fcd-4cd2-88e6-db37cea51b84 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:04.633019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a634203-0fcd-4cd2-88e6-db37cea51b84 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:04.633552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a634203-0fcd-4cd2-88e6-db37cea51b84 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:04.634261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a634203-0fcd-4cd2-88e6-db37cea51b84 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:04.634751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a634203-0fcd-4cd2-88e6-db37cea51b84 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:04.635181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a634203-0fcd-4cd2-88e6-db37cea51b84 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:05.111927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a634203-0fcd-4cd2-88e6-db37cea51b84 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:05.130048 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a634203-0fcd-4cd2-88e6-db37cea51b84 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1522 microversion: 2.1 time: 0.547395 Sep 10 10:45:05.162219 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1558/2064] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:04 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:05.172225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e87a140e-aa3f-4e99-9ef5-4adb686237bd tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:05.172861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e87a140e-aa3f-4e99-9ef5-4adb686237bd tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:05.189109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a140e-aa3f-4e99-9ef5-4adb686237bd tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:05.189608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a140e-aa3f-4e99-9ef5-4adb686237bd tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:05.190271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a140e-aa3f-4e99-9ef5-4adb686237bd tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:05.190997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a140e-aa3f-4e99-9ef5-4adb686237bd tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:05.191461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a140e-aa3f-4e99-9ef5-4adb686237bd tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:05.191892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a140e-aa3f-4e99-9ef5-4adb686237bd tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:05.537412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e87a140e-aa3f-4e99-9ef5-4adb686237bd tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:05.580599 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e87a140e-aa3f-4e99-9ef5-4adb686237bd tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1392 microversion: 2.1 time: 0.413491 Sep 10 10:45:05.584843 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1559/2065] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:05 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1392 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:05.591273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b0920c2-e3f1-4681-a0a3-dafed110b407 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:05.592250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b0920c2-e3f1-4681-a0a3-dafed110b407 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:05.600985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0920c2-e3f1-4681-a0a3-dafed110b407 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:05.602418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0920c2-e3f1-4681-a0a3-dafed110b407 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:05.603293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0920c2-e3f1-4681-a0a3-dafed110b407 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:05.605362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0920c2-e3f1-4681-a0a3-dafed110b407 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:05.606035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0920c2-e3f1-4681-a0a3-dafed110b407 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:05.606670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b0920c2-e3f1-4681-a0a3-dafed110b407 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:06.067277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:06.112388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:06.170334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b0920c2-e3f1-4681-a0a3-dafed110b407 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:06.185853 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b0920c2-e3f1-4681-a0a3-dafed110b407 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1325 microversion: 2.1 time: 0.598778 Sep 10 10:45:06.197563 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1560/2066] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:05 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1325 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:06.211206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41a63b77-7482-4909-b651-4260021afe3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:06.213567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-41a63b77-7482-4909-b651-4260021afe3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:06.229220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41a63b77-7482-4909-b651-4260021afe3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:06.230094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41a63b77-7482-4909-b651-4260021afe3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:06.230685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41a63b77-7482-4909-b651-4260021afe3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:06.233989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41a63b77-7482-4909-b651-4260021afe3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:06.234893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41a63b77-7482-4909-b651-4260021afe3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:06.235521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41a63b77-7482-4909-b651-4260021afe3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:06.522059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-41a63b77-7482-4909-b651-4260021afe3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:06.546946 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41a63b77-7482-4909-b651-4260021afe3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1313 microversion: 2.1 time: 0.340509 Sep 10 10:45:06.547732 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1561/2067] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:06 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:06.556801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86532b0f-d634-4522-9146-a62fba703207 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:06.557435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86532b0f-d634-4522-9146-a62fba703207 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:06.580014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86532b0f-d634-4522-9146-a62fba703207 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:06.580781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86532b0f-d634-4522-9146-a62fba703207 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:06.582285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86532b0f-d634-4522-9146-a62fba703207 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:06.584855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86532b0f-d634-4522-9146-a62fba703207 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:06.585692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86532b0f-d634-4522-9146-a62fba703207 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:06.586362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86532b0f-d634-4522-9146-a62fba703207 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:06.942178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-86532b0f-d634-4522-9146-a62fba703207 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:06.958682 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86532b0f-d634-4522-9146-a62fba703207 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.409514 Sep 10 10:45:06.961552 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1562/2068] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:06 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:06.972244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-95d89f1f-5a77-4a9b-8bb1-66e18b9a9217 req-9c826b43-8bdf-4ed8-9fc9-7321a38e94ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6630508-8b1c-4557-8929-dd226832f411", "tag": "e83d7995-92c7-445a-9a16-b0c007f460a7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:06.992002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-95d89f1f-5a77-4a9b-8bb1-66e18b9a9217 req-9c826b43-8bdf-4ed8-9fc9-7321a38e94ba service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:06.993015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-95d89f1f-5a77-4a9b-8bb1-66e18b9a9217 req-9c826b43-8bdf-4ed8-9fc9-7321a38e94ba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:06.993722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-95d89f1f-5a77-4a9b-8bb1-66e18b9a9217 req-9c826b43-8bdf-4ed8-9fc9-7321a38e94ba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:07.008527 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-95d89f1f-5a77-4a9b-8bb1-66e18b9a9217 req-9c826b43-8bdf-4ed8-9fc9-7321a38e94ba service nova] Creating event network-changed:e83d7995-92c7-445a-9a16-b0c007f460a7 for instance e6630508-8b1c-4557-8929-dd226832f411 on n-h2-856894-1 Sep 10 10:45:07.015206 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-95d89f1f-5a77-4a9b-8bb1-66e18b9a9217 req-9c826b43-8bdf-4ed8-9fc9-7321a38e94ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051179 Sep 10 10:45:07.016306 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1563/2069] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:07.022940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-517d19ff-bdc6-473b-8232-3ba8488d26a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:07.024781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-517d19ff-bdc6-473b-8232-3ba8488d26a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:07.035049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-517d19ff-bdc6-473b-8232-3ba8488d26a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:07.036372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-517d19ff-bdc6-473b-8232-3ba8488d26a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:07.037041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-517d19ff-bdc6-473b-8232-3ba8488d26a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:07.038340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-517d19ff-bdc6-473b-8232-3ba8488d26a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:07.039740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-517d19ff-bdc6-473b-8232-3ba8488d26a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:07.040763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-517d19ff-bdc6-473b-8232-3ba8488d26a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:07.320177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-517d19ff-bdc6-473b-8232-3ba8488d26a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:07.331516 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-517d19ff-bdc6-473b-8232-3ba8488d26a2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1522 microversion: 2.1 time: 0.313708 Sep 10 10:45:07.334242 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1564/2070] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:07 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:07.340121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6e00636-183c-4bc1-b638-643fbb22648b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:07.341008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e6e00636-183c-4bc1-b638-643fbb22648b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:07.348591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6e00636-183c-4bc1-b638-643fbb22648b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:07.349425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6e00636-183c-4bc1-b638-643fbb22648b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:07.350468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6e00636-183c-4bc1-b638-643fbb22648b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:07.361305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6e00636-183c-4bc1-b638-643fbb22648b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:07.375940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6e00636-183c-4bc1-b638-643fbb22648b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:07.377010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6e00636-183c-4bc1-b638-643fbb22648b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:07.629555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6e00636-183c-4bc1-b638-643fbb22648b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:07.640372 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6e00636-183c-4bc1-b638-643fbb22648b tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1382 microversion: 2.1 time: 0.304550 Sep 10 10:45:07.640964 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1565/2071] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:07 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1382 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:07.655801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2b965a5-5774-49f7-be8a-bb6cc1a651dd tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:07.656757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2b965a5-5774-49f7-be8a-bb6cc1a651dd tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:07.672638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2b965a5-5774-49f7-be8a-bb6cc1a651dd tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:07.674579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2b965a5-5774-49f7-be8a-bb6cc1a651dd tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:07.675888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2b965a5-5774-49f7-be8a-bb6cc1a651dd tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:07.677651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2b965a5-5774-49f7-be8a-bb6cc1a651dd tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:07.679968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2b965a5-5774-49f7-be8a-bb6cc1a651dd tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:07.683842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2b965a5-5774-49f7-be8a-bb6cc1a651dd tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:08.044957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2b965a5-5774-49f7-be8a-bb6cc1a651dd tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:08.064367 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2b965a5-5774-49f7-be8a-bb6cc1a651dd tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1325 microversion: 2.1 time: 0.417867 Sep 10 10:45:08.066080 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1566/2072] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:07 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1325 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:08.080603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e9404cef-bcc1-43c4-9ea6-645ef0fa0867 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:08.082150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e9404cef-bcc1-43c4-9ea6-645ef0fa0867 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:08.102442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9404cef-bcc1-43c4-9ea6-645ef0fa0867 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:08.103162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9404cef-bcc1-43c4-9ea6-645ef0fa0867 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:08.103861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9404cef-bcc1-43c4-9ea6-645ef0fa0867 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:08.109516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9404cef-bcc1-43c4-9ea6-645ef0fa0867 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:08.111050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9404cef-bcc1-43c4-9ea6-645ef0fa0867 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:08.112149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9404cef-bcc1-43c4-9ea6-645ef0fa0867 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:08.435754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9404cef-bcc1-43c4-9ea6-645ef0fa0867 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:08.448924 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e9404cef-bcc1-43c4-9ea6-645ef0fa0867 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1313 microversion: 2.1 time: 0.380130 Sep 10 10:45:08.464552 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1567/2073] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:08 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:08.484463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6773ba2a-1017-49e1-93bf-5dfa6d8aba40 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '.version_select at 0x7efcae8f8670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:08.491164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6773ba2a-1017-49e1-93bf-5dfa6d8aba40 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:08.495278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6773ba2a-1017-49e1-93bf-5dfa6d8aba40 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:08.496974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6773ba2a-1017-49e1-93bf-5dfa6d8aba40 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:08.527443 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6773ba2a-1017-49e1-93bf-5dfa6d8aba40 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.1 time: 0.052386 Sep 10 10:45:08.529961 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1568/2074] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:45:08 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:08.553253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a99050c-b25e-42bc-ba29-62ae2cbec7c4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:08.555612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a99050c-b25e-42bc-ba29-62ae2cbec7c4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:08.573244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a99050c-b25e-42bc-ba29-62ae2cbec7c4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:08.574807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a99050c-b25e-42bc-ba29-62ae2cbec7c4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:08.577728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a99050c-b25e-42bc-ba29-62ae2cbec7c4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:08.581439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a99050c-b25e-42bc-ba29-62ae2cbec7c4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:08.582277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a99050c-b25e-42bc-ba29-62ae2cbec7c4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:08.583642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a99050c-b25e-42bc-ba29-62ae2cbec7c4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:08.628678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:08.895403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a99050c-b25e-42bc-ba29-62ae2cbec7c4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:08.923808 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a99050c-b25e-42bc-ba29-62ae2cbec7c4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.387437 Sep 10 10:45:08.925251 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1569/2075] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:08 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:08.940959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-01db3008-b087-4fdb-8088-ccfa6dc62ee5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:08.941891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-01db3008-b087-4fdb-8088-ccfa6dc62ee5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:08.951614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01db3008-b087-4fdb-8088-ccfa6dc62ee5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:08.952628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01db3008-b087-4fdb-8088-ccfa6dc62ee5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:08.952628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01db3008-b087-4fdb-8088-ccfa6dc62ee5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:08.954609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01db3008-b087-4fdb-8088-ccfa6dc62ee5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:08.955479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01db3008-b087-4fdb-8088-ccfa6dc62ee5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:08.956054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01db3008-b087-4fdb-8088-ccfa6dc62ee5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:09.207500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-01db3008-b087-4fdb-8088-ccfa6dc62ee5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:09.217191 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-01db3008-b087-4fdb-8088-ccfa6dc62ee5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1522 microversion: 2.1 time: 0.290387 Sep 10 10:45:09.218077 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1570/2076] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:08 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:09.223493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d6a44d2d-1ed3-4e62-9c60-acf917dca9e5 req-f5fba494-7d2e-4289-984b-616a1cde751c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda18caa-5a27-40b6-ae42-48a93b63825c", "name": "network-vif-plugged", "status": "completed", "tag": "a8d7b3d4-fa78-4890-8baa-75a8aff3caff"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:09.234157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d6a44d2d-1ed3-4e62-9c60-acf917dca9e5 req-f5fba494-7d2e-4289-984b-616a1cde751c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:09.234903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d6a44d2d-1ed3-4e62-9c60-acf917dca9e5 req-f5fba494-7d2e-4289-984b-616a1cde751c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:09.235651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d6a44d2d-1ed3-4e62-9c60-acf917dca9e5 req-f5fba494-7d2e-4289-984b-616a1cde751c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:09.250352 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d6a44d2d-1ed3-4e62-9c60-acf917dca9e5 req-f5fba494-7d2e-4289-984b-616a1cde751c service nova] Creating event network-vif-plugged:a8d7b3d4-fa78-4890-8baa-75a8aff3caff for instance fda18caa-5a27-40b6-ae42-48a93b63825c on n-h2-856894-1 Sep 10 10:45:09.255952 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d6a44d2d-1ed3-4e62-9c60-acf917dca9e5 req-f5fba494-7d2e-4289-984b-616a1cde751c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036478 Sep 10 10:45:09.257018 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1571/2077] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:09.266690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a2e6568d-ec35-45fc-bfe7-1d4a71f23da2 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:09.267557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a2e6568d-ec35-45fc-bfe7-1d4a71f23da2 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:09.275337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e6568d-ec35-45fc-bfe7-1d4a71f23da2 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:09.275901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e6568d-ec35-45fc-bfe7-1d4a71f23da2 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:09.276348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e6568d-ec35-45fc-bfe7-1d4a71f23da2 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:09.277058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e6568d-ec35-45fc-bfe7-1d4a71f23da2 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:09.277603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e6568d-ec35-45fc-bfe7-1d4a71f23da2 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:09.278033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2e6568d-ec35-45fc-bfe7-1d4a71f23da2 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:09.490730 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a2e6568d-ec35-45fc-bfe7-1d4a71f23da2 tempest-LiveMigrationTest-65798772 tempest-LiveMigrationTest-65798772-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1533 microversion: 2.1 time: 0.229312 Sep 10 10:45:09.509238 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1572/2078] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:09 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1533 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:09.523255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9cfd1c44-133d-4053-8b10-de59a5b73589 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:09.524441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9cfd1c44-133d-4053-8b10-de59a5b73589 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:09.532483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cfd1c44-133d-4053-8b10-de59a5b73589 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:09.533390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cfd1c44-133d-4053-8b10-de59a5b73589 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:09.534630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cfd1c44-133d-4053-8b10-de59a5b73589 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:09.535512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cfd1c44-133d-4053-8b10-de59a5b73589 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:09.536683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cfd1c44-133d-4053-8b10-de59a5b73589 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:09.537351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cfd1c44-133d-4053-8b10-de59a5b73589 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:09.779006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9cfd1c44-133d-4053-8b10-de59a5b73589 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:09.799273 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9cfd1c44-133d-4053-8b10-de59a5b73589 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1325 microversion: 2.1 time: 0.286079 Sep 10 10:45:09.801627 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1573/2079] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:09 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:09.811751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-586e133c-45e8-4aea-a477-0fca2c4f2091 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:09.812772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-586e133c-45e8-4aea-a477-0fca2c4f2091 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:09.824581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586e133c-45e8-4aea-a477-0fca2c4f2091 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:09.825450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586e133c-45e8-4aea-a477-0fca2c4f2091 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:09.826227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586e133c-45e8-4aea-a477-0fca2c4f2091 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:09.828177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586e133c-45e8-4aea-a477-0fca2c4f2091 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:09.828924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586e133c-45e8-4aea-a477-0fca2c4f2091 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:09.829534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-586e133c-45e8-4aea-a477-0fca2c4f2091 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:10.126417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-586e133c-45e8-4aea-a477-0fca2c4f2091 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:10.137698 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-586e133c-45e8-4aea-a477-0fca2c4f2091 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1313 microversion: 2.1 time: 0.330994 Sep 10 10:45:10.157795 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1574/2080] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:09 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:10.168810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c968493-1982-4ab3-8a68-57af3881b0d1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:10.171208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c968493-1982-4ab3-8a68-57af3881b0d1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:10.185019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c968493-1982-4ab3-8a68-57af3881b0d1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:10.188364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c968493-1982-4ab3-8a68-57af3881b0d1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:10.190090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c968493-1982-4ab3-8a68-57af3881b0d1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:10.190882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c968493-1982-4ab3-8a68-57af3881b0d1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:10.192629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c968493-1982-4ab3-8a68-57af3881b0d1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:10.193124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c968493-1982-4ab3-8a68-57af3881b0d1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:10.264932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c968493-1982-4ab3-8a68-57af3881b0d1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:45:10.452390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:10.488556 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c968493-1982-4ab3-8a68-57af3881b0d1 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "DELETE /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 204 len: 0 microversion: 2.1 time: 0.329002 Sep 10 10:45:10.493893 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1575/2081] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:45:10 2022] DELETE /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:45:10.499987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd29d8df-9da1-4432-bb1c-87a89bc33554 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:10.500697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd29d8df-9da1-4432-bb1c-87a89bc33554 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:10.567461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd29d8df-9da1-4432-bb1c-87a89bc33554 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:10.569023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd29d8df-9da1-4432-bb1c-87a89bc33554 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:10.572408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd29d8df-9da1-4432-bb1c-87a89bc33554 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:10.574926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd29d8df-9da1-4432-bb1c-87a89bc33554 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:10.582706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd29d8df-9da1-4432-bb1c-87a89bc33554 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:10.584702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd29d8df-9da1-4432-bb1c-87a89bc33554 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:10.909259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd29d8df-9da1-4432-bb1c-87a89bc33554 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:10.919722 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd29d8df-9da1-4432-bb1c-87a89bc33554 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.422934 Sep 10 10:45:10.935647 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1576/2082] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:10 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:10.943640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3e6abfe7-97b8-4159-9f38-976ff71d20db tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:10.944805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3e6abfe7-97b8-4159-9f38-976ff71d20db tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:10.954512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e6abfe7-97b8-4159-9f38-976ff71d20db tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:10.956473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e6abfe7-97b8-4159-9f38-976ff71d20db tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:10.957941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e6abfe7-97b8-4159-9f38-976ff71d20db tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:10.959326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e6abfe7-97b8-4159-9f38-976ff71d20db tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:10.959873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e6abfe7-97b8-4159-9f38-976ff71d20db tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:10.960517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e6abfe7-97b8-4159-9f38-976ff71d20db tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:11.233151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e6abfe7-97b8-4159-9f38-976ff71d20db tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:11.246471 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3e6abfe7-97b8-4159-9f38-976ff71d20db tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1522 microversion: 2.1 time: 0.308426 Sep 10 10:45:11.265539 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1577/2083] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:10 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:11.267634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-874acc7e-98fe-4205-8a6e-275b7ad85100 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:11.268242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-874acc7e-98fe-4205-8a6e-275b7ad85100 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:11.291658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-874acc7e-98fe-4205-8a6e-275b7ad85100 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:11.292152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-874acc7e-98fe-4205-8a6e-275b7ad85100 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:11.292596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-874acc7e-98fe-4205-8a6e-275b7ad85100 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:11.293349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-874acc7e-98fe-4205-8a6e-275b7ad85100 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:11.293795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-874acc7e-98fe-4205-8a6e-275b7ad85100 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:11.294215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-874acc7e-98fe-4205-8a6e-275b7ad85100 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:11.709308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-874acc7e-98fe-4205-8a6e-275b7ad85100 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:11.719683 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-874acc7e-98fe-4205-8a6e-275b7ad85100 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1388 microversion: 2.1 time: 0.455741 Sep 10 10:45:11.722081 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1578/2084] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:11 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1388 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:11.732630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d3c21c16-b1b1-48b5-a670-652f95f30c1f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:11.733693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d3c21c16-b1b1-48b5-a670-652f95f30c1f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:11.749272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3c21c16-b1b1-48b5-a670-652f95f30c1f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:11.749750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3c21c16-b1b1-48b5-a670-652f95f30c1f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:11.750197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3c21c16-b1b1-48b5-a670-652f95f30c1f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:11.753746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3c21c16-b1b1-48b5-a670-652f95f30c1f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:11.754231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3c21c16-b1b1-48b5-a670-652f95f30c1f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:11.754963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3c21c16-b1b1-48b5-a670-652f95f30c1f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:12.090169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d3c21c16-b1b1-48b5-a670-652f95f30c1f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:12.098362 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d3c21c16-b1b1-48b5-a670-652f95f30c1f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1325 microversion: 2.1 time: 0.375473 Sep 10 10:45:12.104887 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1579/2085] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:11 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1325 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:12.117717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a3e95fc-5218-449d-9f15-ef7e1fe4a9cd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:12.118666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a3e95fc-5218-449d-9f15-ef7e1fe4a9cd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:12.128498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a3e95fc-5218-449d-9f15-ef7e1fe4a9cd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:12.129399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a3e95fc-5218-449d-9f15-ef7e1fe4a9cd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:12.130072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a3e95fc-5218-449d-9f15-ef7e1fe4a9cd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:12.142061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a3e95fc-5218-449d-9f15-ef7e1fe4a9cd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:12.142920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a3e95fc-5218-449d-9f15-ef7e1fe4a9cd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:12.143566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a3e95fc-5218-449d-9f15-ef7e1fe4a9cd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:12.499264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a3e95fc-5218-449d-9f15-ef7e1fe4a9cd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:12.510382 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a3e95fc-5218-449d-9f15-ef7e1fe4a9cd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1313 microversion: 2.1 time: 0.404078 Sep 10 10:45:12.510974 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1580/2086] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:12 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:12.527204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56845d0d-9f90-4cde-9866-f84bf4f7505e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:12.527832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56845d0d-9f90-4cde-9866-f84bf4f7505e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:12.549150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56845d0d-9f90-4cde-9866-f84bf4f7505e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:12.550100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56845d0d-9f90-4cde-9866-f84bf4f7505e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:12.550560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56845d0d-9f90-4cde-9866-f84bf4f7505e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:12.551300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56845d0d-9f90-4cde-9866-f84bf4f7505e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:12.551804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56845d0d-9f90-4cde-9866-f84bf4f7505e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:12.552787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56845d0d-9f90-4cde-9866-f84bf4f7505e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:12.910335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56845d0d-9f90-4cde-9866-f84bf4f7505e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:12.919099 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56845d0d-9f90-4cde-9866-f84bf4f7505e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.406871 Sep 10 10:45:12.937474 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1581/2087] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:12 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:12.966799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c2e4f0d-08b7-4e0b-a8b1-28da6d67e9ac tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:12.969472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c2e4f0d-08b7-4e0b-a8b1-28da6d67e9ac tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:12.998574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2e4f0d-08b7-4e0b-a8b1-28da6d67e9ac tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:13.004297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2e4f0d-08b7-4e0b-a8b1-28da6d67e9ac tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:13.008986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2e4f0d-08b7-4e0b-a8b1-28da6d67e9ac tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:13.010073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2e4f0d-08b7-4e0b-a8b1-28da6d67e9ac tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:13.012508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2e4f0d-08b7-4e0b-a8b1-28da6d67e9ac tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:13.017150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c2e4f0d-08b7-4e0b-a8b1-28da6d67e9ac tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:13.391323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c2e4f0d-08b7-4e0b-a8b1-28da6d67e9ac tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:13.406723 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c2e4f0d-08b7-4e0b-a8b1-28da6d67e9ac tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1522 microversion: 2.1 time: 0.459643 Sep 10 10:45:13.424907 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1582/2088] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:12 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:13.436172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8e488a49-7c89-4365-bcef-53006f8520b5 req-203ae910-a69b-4807-b6d2-987d0f918609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6630508-8b1c-4557-8929-dd226832f411", "name": "network-vif-plugged", "status": "completed", "tag": "e83d7995-92c7-445a-9a16-b0c007f460a7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:13.461039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8e488a49-7c89-4365-bcef-53006f8520b5 req-203ae910-a69b-4807-b6d2-987d0f918609 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:13.462900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8e488a49-7c89-4365-bcef-53006f8520b5 req-203ae910-a69b-4807-b6d2-987d0f918609 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:13.463380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8e488a49-7c89-4365-bcef-53006f8520b5 req-203ae910-a69b-4807-b6d2-987d0f918609 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:13.494090 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8e488a49-7c89-4365-bcef-53006f8520b5 req-203ae910-a69b-4807-b6d2-987d0f918609 service nova] Creating event network-vif-plugged:e83d7995-92c7-445a-9a16-b0c007f460a7 for instance e6630508-8b1c-4557-8929-dd226832f411 on n-h2-856894-1 Sep 10 10:45:13.508375 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8e488a49-7c89-4365-bcef-53006f8520b5 req-203ae910-a69b-4807-b6d2-987d0f918609 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076125 Sep 10 10:45:13.509569 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1583/2089] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:13.530258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a1f6a1a4-df27-4601-b0e3-5535ad859f21 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:13.533988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a1f6a1a4-df27-4601-b0e3-5535ad859f21 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:13.550265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1f6a1a4-df27-4601-b0e3-5535ad859f21 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:13.560647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1f6a1a4-df27-4601-b0e3-5535ad859f21 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:13.566687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1f6a1a4-df27-4601-b0e3-5535ad859f21 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:13.570984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1f6a1a4-df27-4601-b0e3-5535ad859f21 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:13.571665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1f6a1a4-df27-4601-b0e3-5535ad859f21 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:13.573244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1f6a1a4-df27-4601-b0e3-5535ad859f21 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:13.722731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a1f6a1a4-df27-4601-b0e3-5535ad859f21 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:13.735315 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a1f6a1a4-df27-4601-b0e3-5535ad859f21 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1184 microversion: 2.1 time: 0.222477 Sep 10 10:45:13.736443 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1584/2090] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:13 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1184 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:13.754331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b4a62486-d925-4ae2-88ef-4d19d0c4b95a req-b764bd66-70e9-49cc-8bed-d0ce04a516e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178b8f2f-5352-4ae4-9f3e-bef5e366456d", "name": "network-vif-deleted", "tag": "f2494b11-7317-47ca-a893-5644f4502288"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:13.773759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b4a62486-d925-4ae2-88ef-4d19d0c4b95a req-b764bd66-70e9-49cc-8bed-d0ce04a516e4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:13.777877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b4a62486-d925-4ae2-88ef-4d19d0c4b95a req-b764bd66-70e9-49cc-8bed-d0ce04a516e4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:13.778903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b4a62486-d925-4ae2-88ef-4d19d0c4b95a req-b764bd66-70e9-49cc-8bed-d0ce04a516e4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:13.814575 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b4a62486-d925-4ae2-88ef-4d19d0c4b95a req-b764bd66-70e9-49cc-8bed-d0ce04a516e4 service nova] Creating event network-vif-deleted:f2494b11-7317-47ca-a893-5644f4502288 for instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d on n-h1-856894-1 Sep 10 10:45:13.827669 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b4a62486-d925-4ae2-88ef-4d19d0c4b95a req-b764bd66-70e9-49cc-8bed-d0ce04a516e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089817 Sep 10 10:45:13.828940 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1585/2091] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:13.840800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f9689bf-bfc3-47df-919f-fa7e779e9a1d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:13.848951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f9689bf-bfc3-47df-919f-fa7e779e9a1d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:13.859437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f9689bf-bfc3-47df-919f-fa7e779e9a1d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:13.860239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f9689bf-bfc3-47df-919f-fa7e779e9a1d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:13.860960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f9689bf-bfc3-47df-919f-fa7e779e9a1d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:13.861913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f9689bf-bfc3-47df-919f-fa7e779e9a1d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:13.863100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f9689bf-bfc3-47df-919f-fa7e779e9a1d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:13.865761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f9689bf-bfc3-47df-919f-fa7e779e9a1d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:13.873018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:14.112249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3f9689bf-bfc3-47df-919f-fa7e779e9a1d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:14.125647 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f9689bf-bfc3-47df-919f-fa7e779e9a1d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1325 microversion: 2.1 time: 0.294656 Sep 10 10:45:14.126621 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1586/2092] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:13 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1325 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:14.132963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-46e5a3e3-7613-42c3-a184-afe03e6d36d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:14.133698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-46e5a3e3-7613-42c3-a184-afe03e6d36d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:14.147629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46e5a3e3-7613-42c3-a184-afe03e6d36d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:14.148202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46e5a3e3-7613-42c3-a184-afe03e6d36d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:14.148597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46e5a3e3-7613-42c3-a184-afe03e6d36d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:14.154691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46e5a3e3-7613-42c3-a184-afe03e6d36d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:14.155213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46e5a3e3-7613-42c3-a184-afe03e6d36d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:14.155632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46e5a3e3-7613-42c3-a184-afe03e6d36d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:14.462321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-46e5a3e3-7613-42c3-a184-afe03e6d36d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:14.471467 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-46e5a3e3-7613-42c3-a184-afe03e6d36d6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1463 microversion: 2.1 time: 0.343762 Sep 10 10:45:14.504186 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1587/2093] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:14 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1463 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:14.518819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8b8e1916-d28d-47d7-8c30-ca5be662d472 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:14.519669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8b8e1916-d28d-47d7-8c30-ca5be662d472 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:14.538647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b8e1916-d28d-47d7-8c30-ca5be662d472 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:14.541045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b8e1916-d28d-47d7-8c30-ca5be662d472 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:14.541693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b8e1916-d28d-47d7-8c30-ca5be662d472 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:14.542564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b8e1916-d28d-47d7-8c30-ca5be662d472 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:14.544109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b8e1916-d28d-47d7-8c30-ca5be662d472 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:14.548368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b8e1916-d28d-47d7-8c30-ca5be662d472 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:14.817612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8b8e1916-d28d-47d7-8c30-ca5be662d472 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:14.831816 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8b8e1916-d28d-47d7-8c30-ca5be662d472 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1502 microversion: 2.1 time: 0.324158 Sep 10 10:45:14.834279 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1588/2094] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:14 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1502 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:14.852399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6da73c6-c42e-4b24-8309-bf53c561b91e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:14.853935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e6da73c6-c42e-4b24-8309-bf53c561b91e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:14.886134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6da73c6-c42e-4b24-8309-bf53c561b91e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:14.887612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6da73c6-c42e-4b24-8309-bf53c561b91e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:14.888067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6da73c6-c42e-4b24-8309-bf53c561b91e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:14.890707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6da73c6-c42e-4b24-8309-bf53c561b91e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:14.892580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6da73c6-c42e-4b24-8309-bf53c561b91e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:14.893036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6da73c6-c42e-4b24-8309-bf53c561b91e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:15.098217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6da73c6-c42e-4b24-8309-bf53c561b91e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:15.109368 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6da73c6-c42e-4b24-8309-bf53c561b91e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1522 microversion: 2.1 time: 0.272760 Sep 10 10:45:15.109963 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1589/2095] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:14 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:15.131545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:15.134438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:15.141998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:15.142566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:15.143012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:15.144035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:15.146285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:15.146868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:15.269019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:15.276592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 10:45:15.285547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:45:15.286283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:45:15.287000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:45:15.287570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:45:15.288248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:45:15.505051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e5217218-da77-4040-a4a3-809e8c6a162c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c/action" status: 202 len: 0 microversion: 2.1 time: 0.381783 Sep 10 10:45:15.506439 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1590/2096] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:45:15 2022] POST /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:45:15.520132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f719209-fbdb-4e2c-b970-cee99d9d44f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:15.523711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f719209-fbdb-4e2c-b970-cee99d9d44f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:15.541373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f719209-fbdb-4e2c-b970-cee99d9d44f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:15.541880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f719209-fbdb-4e2c-b970-cee99d9d44f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:15.542327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f719209-fbdb-4e2c-b970-cee99d9d44f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:15.543051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f719209-fbdb-4e2c-b970-cee99d9d44f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:15.543513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f719209-fbdb-4e2c-b970-cee99d9d44f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:15.544303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f719209-fbdb-4e2c-b970-cee99d9d44f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:15.660780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f719209-fbdb-4e2c-b970-cee99d9d44f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:15.672621 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f719209-fbdb-4e2c-b970-cee99d9d44f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1184 microversion: 2.1 time: 0.164035 Sep 10 10:45:15.685102 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1591/2097] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:15 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1184 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:15.701895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a745de8-ea71-4d70-bcac-964b4b0a14f1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:15.701895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:15.706626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:15.707474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:15.717273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:15.717273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:15.717273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:15.717273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:15.741920 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] HTTP exception thrown: Cannot 'attach_volume' instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 while it is in vm_state rescued Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Request method failure captured: Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/os-volume_attachments HTTP/1.1 Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 74 Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpHkAYnXeEeIkrvP5MU91LX1pHhCw1-X517wST7uI3nXMyFmEZF2-GrH_hD3-99qTj4dhIEoqm0d7-iBahX9spBGlFJJtEH3HGF62s1M_cLMl7ndO7Kwzn8XkzqLr7wv9Eh_FDYB9NepyfCMVt7SSvdhwxotJF7SX8u4upXel5-s6g Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52c98558e19447dfa54397d92f45dbb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0682225a07764437b25009c061ac844d Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: {"volumeAttachment": {"volumeId": "9a745de8-ea71-4d70-bcac-964b4b0a14f1"}} Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'attach_volume' instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 while it is in vm_state rescued Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0', 'body': {'volumeAttachment': {'volumeId': '9a745de8-ea71-4d70-bcac-964b4b0a14f1'}}} Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 10 10:45:15.744280 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 while it is in vm_state rescued Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 while it is in vm_state rescued Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Returning 409 to user: Cannot 'attach_volume' instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 while it is in vm_state rescued {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6501e5d-ffec-49d6-a21c-59ef0cd6a2dc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.070400 Sep 10 10:45:15.748179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1592/2098] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 10:45:15 2022] POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:45:15.761431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6acdb15b-a054-4945-902b-056b44acfaad tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:15.762141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6acdb15b-a054-4945-902b-056b44acfaad tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:15.778704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6acdb15b-a054-4945-902b-056b44acfaad tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:15.779132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6acdb15b-a054-4945-902b-056b44acfaad tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:15.781529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6acdb15b-a054-4945-902b-056b44acfaad tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:15.781529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6acdb15b-a054-4945-902b-056b44acfaad tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:15.781529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6acdb15b-a054-4945-902b-056b44acfaad tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:15.782521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6acdb15b-a054-4945-902b-056b44acfaad tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:15.992276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6acdb15b-a054-4945-902b-056b44acfaad tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:16.004086 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6acdb15b-a054-4945-902b-056b44acfaad tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1522 microversion: 2.1 time: 0.255165 Sep 10 10:45:16.008735 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1593/2099] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:15 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:16.026501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5fb7d80-7bbe-4769-bf6b-61a9793cab13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:16.027471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e5fb7d80-7bbe-4769-bf6b-61a9793cab13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:16.049385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5fb7d80-7bbe-4769-bf6b-61a9793cab13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:16.049891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5fb7d80-7bbe-4769-bf6b-61a9793cab13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:16.060362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5fb7d80-7bbe-4769-bf6b-61a9793cab13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:16.063480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5fb7d80-7bbe-4769-bf6b-61a9793cab13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:16.067404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5fb7d80-7bbe-4769-bf6b-61a9793cab13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:16.067404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5fb7d80-7bbe-4769-bf6b-61a9793cab13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:16.382289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e5fb7d80-7bbe-4769-bf6b-61a9793cab13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:16.393669 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e5fb7d80-7bbe-4769-bf6b-61a9793cab13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1472 microversion: 2.1 time: 0.379801 Sep 10 10:45:16.395056 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1594/2100] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:16 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1472 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:16.418671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-165b3b81-3a10-48a2-bde5-2a2f1388a905 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:16.419478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-165b3b81-3a10-48a2-bde5-2a2f1388a905 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:16.427860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-165b3b81-3a10-48a2-bde5-2a2f1388a905 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:16.428529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-165b3b81-3a10-48a2-bde5-2a2f1388a905 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:16.429666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-165b3b81-3a10-48a2-bde5-2a2f1388a905 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:16.430485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-165b3b81-3a10-48a2-bde5-2a2f1388a905 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:16.431166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-165b3b81-3a10-48a2-bde5-2a2f1388a905 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:16.431821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-165b3b81-3a10-48a2-bde5-2a2f1388a905 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:16.594792 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-165b3b81-3a10-48a2-bde5-2a2f1388a905 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action" status: 202 len: 0 microversion: 2.1 time: 0.185637 Sep 10 10:45:16.600284 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1595/2101] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:45:16 2022] POST /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:45:16.611030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-939f2c88-bec5-4278-900b-628aab1c23b5 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:16.611748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-939f2c88-bec5-4278-900b-628aab1c23b5 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:16.618882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939f2c88-bec5-4278-900b-628aab1c23b5 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:16.619504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939f2c88-bec5-4278-900b-628aab1c23b5 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:16.620147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939f2c88-bec5-4278-900b-628aab1c23b5 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:16.621295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939f2c88-bec5-4278-900b-628aab1c23b5 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:16.621828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939f2c88-bec5-4278-900b-628aab1c23b5 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:16.622673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-939f2c88-bec5-4278-900b-628aab1c23b5 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:17.014793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-939f2c88-bec5-4278-900b-628aab1c23b5 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:17.026271 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-939f2c88-bec5-4278-900b-628aab1c23b5 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1522 microversion: 2.1 time: 0.423658 Sep 10 10:45:17.034174 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1596/2102] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:16 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:17.052120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48d517fe-1e23-4742-b86b-09a6873cffb1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:17.053823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-48d517fe-1e23-4742-b86b-09a6873cffb1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:17.072516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48d517fe-1e23-4742-b86b-09a6873cffb1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:17.073023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48d517fe-1e23-4742-b86b-09a6873cffb1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:17.073520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48d517fe-1e23-4742-b86b-09a6873cffb1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:17.074228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48d517fe-1e23-4742-b86b-09a6873cffb1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:17.074689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48d517fe-1e23-4742-b86b-09a6873cffb1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:17.075113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48d517fe-1e23-4742-b86b-09a6873cffb1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:17.989323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-48d517fe-1e23-4742-b86b-09a6873cffb1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:18.000137 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-48d517fe-1e23-4742-b86b-09a6873cffb1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1522 microversion: 2.1 time: 0.964611 Sep 10 10:45:18.015062 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1597/2103] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:17 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1522 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:18.033347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fdbf85d4-25cc-4a97-8ffe-f85ff7696ae8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:18.034307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fdbf85d4-25cc-4a97-8ffe-f85ff7696ae8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:18.049200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf85d4-25cc-4a97-8ffe-f85ff7696ae8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:18.055282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf85d4-25cc-4a97-8ffe-f85ff7696ae8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:18.057063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf85d4-25cc-4a97-8ffe-f85ff7696ae8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:18.060280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf85d4-25cc-4a97-8ffe-f85ff7696ae8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:18.060781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf85d4-25cc-4a97-8ffe-f85ff7696ae8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:18.061270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf85d4-25cc-4a97-8ffe-f85ff7696ae8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:18.469847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fdbf85d4-25cc-4a97-8ffe-f85ff7696ae8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:18.481871 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fdbf85d4-25cc-4a97-8ffe-f85ff7696ae8 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1510 microversion: 2.1 time: 0.465397 Sep 10 10:45:18.483042 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1598/2104] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:18 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1510 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:18.492107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82ce819b-29af-4f5e-bae8-31a06459d07c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:18.494490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82ce819b-29af-4f5e-bae8-31a06459d07c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:18.509127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ce819b-29af-4f5e-bae8-31a06459d07c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:18.510988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ce819b-29af-4f5e-bae8-31a06459d07c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:18.512623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ce819b-29af-4f5e-bae8-31a06459d07c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:18.513617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ce819b-29af-4f5e-bae8-31a06459d07c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:18.517805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ce819b-29af-4f5e-bae8-31a06459d07c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:18.518301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ce819b-29af-4f5e-bae8-31a06459d07c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:18.691997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-82ce819b-29af-4f5e-bae8-31a06459d07c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:18.709480 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82ce819b-29af-4f5e-bae8-31a06459d07c tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1184 microversion: 2.1 time: 0.224949 Sep 10 10:45:18.711137 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1599/2105] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:18 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1184 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:18.727852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3bd65da-4e8f-468a-8c9e-0a874b498a50 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1580922186", "metadata": {"": ""}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3bd65da-4e8f-468a-8c9e-0a874b498a50 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action HTTP/1.1 Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 107 Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1580922186", "metadata": {"": ""}}} Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e6630508-8b1c-4557-8929-dd226832f411', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1580922186', 'metadata': {'': ''}}}} Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'': ''} Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:45:18.739057 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:45:18.743894 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:18.749649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3bd65da-4e8f-468a-8c9e-0a874b498a50 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:18.753392 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3bd65da-4e8f-468a-8c9e-0a874b498a50 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action" status: 400 len: 170 microversion: 2.1 time: 0.037916 Sep 10 10:45:18.757702 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1600/2106] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Sep 10 10:45:18 2022] POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action => generated 170 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:45:18.765453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-510d4ccd-336d-4c2e-a3d6-f8f7380b5291 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:18.766781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-510d4ccd-336d-4c2e-a3d6-f8f7380b5291 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:18.777782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-510d4ccd-336d-4c2e-a3d6-f8f7380b5291 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:18.778803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-510d4ccd-336d-4c2e-a3d6-f8f7380b5291 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:18.780113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-510d4ccd-336d-4c2e-a3d6-f8f7380b5291 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:18.780848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-510d4ccd-336d-4c2e-a3d6-f8f7380b5291 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:18.782570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-510d4ccd-336d-4c2e-a3d6-f8f7380b5291 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:18.783325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-510d4ccd-336d-4c2e-a3d6-f8f7380b5291 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:18.935846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-510d4ccd-336d-4c2e-a3d6-f8f7380b5291 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:18.943791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:18.946960 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-510d4ccd-336d-4c2e-a3d6-f8f7380b5291 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1472 microversion: 2.1 time: 0.187936 Sep 10 10:45:18.947595 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1601/2107] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:18 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:18.953350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-03887c27-7272-4a38-9ab1-cd7f39970c9d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:18.953975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-03887c27-7272-4a38-9ab1-cd7f39970c9d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:18.961288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03887c27-7272-4a38-9ab1-cd7f39970c9d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:18.962019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03887c27-7272-4a38-9ab1-cd7f39970c9d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:18.962541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03887c27-7272-4a38-9ab1-cd7f39970c9d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:18.963248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03887c27-7272-4a38-9ab1-cd7f39970c9d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:18.964843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03887c27-7272-4a38-9ab1-cd7f39970c9d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:18.965328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03887c27-7272-4a38-9ab1-cd7f39970c9d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:19.152851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-03887c27-7272-4a38-9ab1-cd7f39970c9d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:19.165197 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-03887c27-7272-4a38-9ab1-cd7f39970c9d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1522 microversion: 2.1 time: 0.216134 Sep 10 10:45:19.166116 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1602/2108] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:18 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:19.172035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f74816c1-db27-4d2f-a29b-cabee65e3cd4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:19.172663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f74816c1-db27-4d2f-a29b-cabee65e3cd4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:19.180774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74816c1-db27-4d2f-a29b-cabee65e3cd4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:19.181313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74816c1-db27-4d2f-a29b-cabee65e3cd4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:19.181748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74816c1-db27-4d2f-a29b-cabee65e3cd4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:19.182447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74816c1-db27-4d2f-a29b-cabee65e3cd4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:19.182897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74816c1-db27-4d2f-a29b-cabee65e3cd4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:19.183372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74816c1-db27-4d2f-a29b-cabee65e3cd4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:19.436950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f74816c1-db27-4d2f-a29b-cabee65e3cd4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:19.447899 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f74816c1-db27-4d2f-a29b-cabee65e3cd4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1504 microversion: 2.1 time: 0.280494 Sep 10 10:45:19.461102 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1603/2109] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:19 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:19.461102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a6babd7-65e1-4a9e-8a6d-32442119ccbb tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:19.461102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8a6babd7-65e1-4a9e-8a6d-32442119ccbb tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:19.469544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a6babd7-65e1-4a9e-8a6d-32442119ccbb tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:19.469544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a6babd7-65e1-4a9e-8a6d-32442119ccbb tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:19.469544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a6babd7-65e1-4a9e-8a6d-32442119ccbb tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:19.469544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a6babd7-65e1-4a9e-8a6d-32442119ccbb tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:19.469544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a6babd7-65e1-4a9e-8a6d-32442119ccbb tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:19.469544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a6babd7-65e1-4a9e-8a6d-32442119ccbb tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:19.643385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a6babd7-65e1-4a9e-8a6d-32442119ccbb tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:19.655008 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8a6babd7-65e1-4a9e-8a6d-32442119ccbb tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1522 microversion: 2.1 time: 0.203998 Sep 10 10:45:19.657465 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1604/2110] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:19 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:19.679590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d3774f1b-7250-4f88-ad4c-29d7593cafec tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:19.680962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d3774f1b-7250-4f88-ad4c-29d7593cafec tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:19.695263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3774f1b-7250-4f88-ad4c-29d7593cafec tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:19.695729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3774f1b-7250-4f88-ad4c-29d7593cafec tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:19.696356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3774f1b-7250-4f88-ad4c-29d7593cafec tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:19.697056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3774f1b-7250-4f88-ad4c-29d7593cafec tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:19.697700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3774f1b-7250-4f88-ad4c-29d7593cafec tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:19.698279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3774f1b-7250-4f88-ad4c-29d7593cafec tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:19.861441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d3774f1b-7250-4f88-ad4c-29d7593cafec tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:19.871950 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d3774f1b-7250-4f88-ad4c-29d7593cafec tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1510 microversion: 2.1 time: 0.212403 Sep 10 10:45:19.872739 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1605/2111] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:19 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:19.894394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22b533a2-5443-4654-9aba-df634145a65c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-51055783", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22b533a2-5443-4654-9aba-df634145a65c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action HTTP/1.1 Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 617 Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-51055783", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e6630508-8b1c-4557-8929-dd226832f411', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-51055783', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:45:19.901258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 10:45:19.904332 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:19.908185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22b533a2-5443-4654-9aba-df634145a65c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:19.908185 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-22b533a2-5443-4654-9aba-df634145a65c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action" status: 400 len: 938 microversion: 2.1 time: 0.012991 Sep 10 10:45:19.908185 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1606/2112] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Sep 10 10:45:19 2022] POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action => generated 938 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:45:19.909754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02b0e11d-086d-4c07-9cb2-12adf8aa5b69 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:19.910698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02b0e11d-086d-4c07-9cb2-12adf8aa5b69 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:19.918339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02b0e11d-086d-4c07-9cb2-12adf8aa5b69 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:19.918866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02b0e11d-086d-4c07-9cb2-12adf8aa5b69 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:19.919455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02b0e11d-086d-4c07-9cb2-12adf8aa5b69 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:19.920165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02b0e11d-086d-4c07-9cb2-12adf8aa5b69 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:19.920640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02b0e11d-086d-4c07-9cb2-12adf8aa5b69 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:19.921056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02b0e11d-086d-4c07-9cb2-12adf8aa5b69 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:19.996156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02b0e11d-086d-4c07-9cb2-12adf8aa5b69 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:20.004012 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02b0e11d-086d-4c07-9cb2-12adf8aa5b69 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 200 len: 1184 microversion: 2.1 time: 0.099818 Sep 10 10:45:20.004803 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1607/2113] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:19 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 1184 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:20.009864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4fc84b1c-ad29-4f99-b2fa-c39fffb1ca78 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:20.010311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4fc84b1c-ad29-4f99-b2fa-c39fffb1ca78 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:20.024937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4fc84b1c-ad29-4f99-b2fa-c39fffb1ca78 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:20.025417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4fc84b1c-ad29-4f99-b2fa-c39fffb1ca78 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:20.025965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4fc84b1c-ad29-4f99-b2fa-c39fffb1ca78 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:20.026719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4fc84b1c-ad29-4f99-b2fa-c39fffb1ca78 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:20.027180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4fc84b1c-ad29-4f99-b2fa-c39fffb1ca78 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:20.027617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4fc84b1c-ad29-4f99-b2fa-c39fffb1ca78 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:20.265043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4fc84b1c-ad29-4f99-b2fa-c39fffb1ca78 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:20.276734 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4fc84b1c-ad29-4f99-b2fa-c39fffb1ca78 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1522 microversion: 2.1 time: 0.271013 Sep 10 10:45:20.281120 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1608/2114] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:20 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:20.284820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7c1c540c-c913-4e1a-aede-a409b0f5671a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:20.285736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7c1c540c-c913-4e1a-aede-a409b0f5671a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:20.301952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1c540c-c913-4e1a-aede-a409b0f5671a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:20.302463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1c540c-c913-4e1a-aede-a409b0f5671a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:20.302921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1c540c-c913-4e1a-aede-a409b0f5671a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:20.304237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1c540c-c913-4e1a-aede-a409b0f5671a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:20.304978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1c540c-c913-4e1a-aede-a409b0f5671a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:20.305645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1c540c-c913-4e1a-aede-a409b0f5671a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:20.692158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c1c540c-c913-4e1a-aede-a409b0f5671a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:20.703064 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7c1c540c-c913-4e1a-aede-a409b0f5671a tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1472 microversion: 2.1 time: 0.422948 Sep 10 10:45:20.703903 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1609/2115] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:20 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:20.709464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f12f114-3eed-40f5-a8e2-13405938f75a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:20.710364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f12f114-3eed-40f5-a8e2-13405938f75a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:20.717360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f12f114-3eed-40f5-a8e2-13405938f75a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:20.718134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f12f114-3eed-40f5-a8e2-13405938f75a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:20.718769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f12f114-3eed-40f5-a8e2-13405938f75a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:20.719701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f12f114-3eed-40f5-a8e2-13405938f75a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:20.720317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f12f114-3eed-40f5-a8e2-13405938f75a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:20.721163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f12f114-3eed-40f5-a8e2-13405938f75a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:21.034482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f12f114-3eed-40f5-a8e2-13405938f75a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:21.048611 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f12f114-3eed-40f5-a8e2-13405938f75a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1522 microversion: 2.1 time: 0.343348 Sep 10 10:45:21.049496 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1610/2116] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:20 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:21.055486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-da7efbda-87a2-488f-86f2-36bfa36be22b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:21.056048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-da7efbda-87a2-488f-86f2-36bfa36be22b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:21.062279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7efbda-87a2-488f-86f2-36bfa36be22b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:21.062798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7efbda-87a2-488f-86f2-36bfa36be22b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:21.063238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7efbda-87a2-488f-86f2-36bfa36be22b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:21.064010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7efbda-87a2-488f-86f2-36bfa36be22b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:21.064469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7efbda-87a2-488f-86f2-36bfa36be22b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:21.064891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da7efbda-87a2-488f-86f2-36bfa36be22b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:21.305231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-da7efbda-87a2-488f-86f2-36bfa36be22b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:21.313144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-da7efbda-87a2-488f-86f2-36bfa36be22b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1504 microversion: 2.1 time: 0.262589 Sep 10 10:45:21.317510 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1611/2117] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:21 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:21.322608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73fc8374-28a8-444b-890a-33009de0e751 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:21.323462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73fc8374-28a8-444b-890a-33009de0e751 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:21.330448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73fc8374-28a8-444b-890a-33009de0e751 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:21.331802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73fc8374-28a8-444b-890a-33009de0e751 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:21.332501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73fc8374-28a8-444b-890a-33009de0e751 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:21.333711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73fc8374-28a8-444b-890a-33009de0e751 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:21.334577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73fc8374-28a8-444b-890a-33009de0e751 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:21.335963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73fc8374-28a8-444b-890a-33009de0e751 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:21.549224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73fc8374-28a8-444b-890a-33009de0e751 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:21.560784 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73fc8374-28a8-444b-890a-33009de0e751 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1510 microversion: 2.1 time: 0.241963 Sep 10 10:45:21.577669 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1612/2118] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:21 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:21.577669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:21.577669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 178b8f2f-5352-4ae4-9f3e-bef5e366456d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:21.593841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:21.594447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:21.595003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:21.597776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:21.598632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:21.599291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:21.629426 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] HTTP exception thrown: Instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d could not be found. Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Request method failure captured: Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d HTTP/1.1 Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkjVK2ZOmRVIPSrEr-Ye_0gUyEODKCdugm9a-s8uz52g6eXKFW6yjW0bBlpd5C05VHBUklnWpDq0KYbWL3nwKXXbXSfAKn6rkwfXTci8a5Sxjqj-SL6HNnpuSFx7xURL39B3fb3Sb9cfZvOv1Oh_DqO7hul8pvepuk9PG9hu8PRc8E Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: bb350b19a7254f0bbffb6e5b8dc2bbe3 Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-LiveMigrationTest-834273095 Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb350b19a7254f0bbffb6e5b8dc2bbe3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-LiveMigrationTest-834273095 Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: bb350b19a7254f0bbffb6e5b8dc2bbe3 Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-LiveMigrationTest-834273095 Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-LiveMigrationTest-834273095-project Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: a1013c609b044cb781dd1691909db7bf Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-LiveMigrationTest-834273095-project Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d could not be found. Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '178b8f2f-5352-4ae4-9f3e-bef5e366456d'} Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d could not be found. Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d could not be found. Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:21.632494 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.637203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:21.637203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:21.637203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:21.637203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:45:21.637203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:45:21.637203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d could not be found. Sep 10 10:45:21.637203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.648395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Returning 404 to user: Instance 178b8f2f-5352-4ae4-9f3e-bef5e366456d could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:21.649517 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f3bbb78e-648a-4461-9e99-1b7e4bd208f5 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d" status: 404 len: 111 microversion: 2.1 time: 0.082071 Sep 10 10:45:21.650576 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1613/2119] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:21 2022] GET /compute/v2.1/servers/178b8f2f-5352-4ae4-9f3e-bef5e366456d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:45:21.665348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e348fdb0-507a-42f5-9b88-d4ecf8f32d20 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e348fdb0-507a-42f5-9b88-d4ecf8f32d20 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action HTTP/1.1 Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 285 Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e6630508-8b1c-4557-8929-dd226832f411', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:21.684430 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e348fdb0-507a-42f5-9b88-d4ecf8f32d20 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:21.688337 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e348fdb0-507a-42f5-9b88-d4ecf8f32d20 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action" status: 400 len: 619 microversion: 2.1 time: 0.036689 Sep 10 10:45:21.696377 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1614/2120] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Sep 10 10:45:21 2022] POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:45:21.712987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a8aaa50-3644-4d17-a260-09168cd2e27a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:21.713665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8a8aaa50-3644-4d17-a260-09168cd2e27a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:21.732906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8aaa50-3644-4d17-a260-09168cd2e27a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:21.735403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8aaa50-3644-4d17-a260-09168cd2e27a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:21.735838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8aaa50-3644-4d17-a260-09168cd2e27a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:21.738919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8aaa50-3644-4d17-a260-09168cd2e27a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:21.741020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8aaa50-3644-4d17-a260-09168cd2e27a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:21.744319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8aaa50-3644-4d17-a260-09168cd2e27a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:22.180679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a8aaa50-3644-4d17-a260-09168cd2e27a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:22.196856 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8a8aaa50-3644-4d17-a260-09168cd2e27a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1522 microversion: 2.1 time: 0.499283 Sep 10 10:45:22.202642 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1615/2121] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:21 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:22.234245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d7c4a7e2-7de4-4ab1-b45a-f8cc437e06ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:22.237648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d7c4a7e2-7de4-4ab1-b45a-f8cc437e06ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:22.259265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7c4a7e2-7de4-4ab1-b45a-f8cc437e06ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:22.261980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7c4a7e2-7de4-4ab1-b45a-f8cc437e06ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:22.262992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7c4a7e2-7de4-4ab1-b45a-f8cc437e06ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:22.267546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7c4a7e2-7de4-4ab1-b45a-f8cc437e06ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:22.268133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7c4a7e2-7de4-4ab1-b45a-f8cc437e06ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:22.268690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7c4a7e2-7de4-4ab1-b45a-f8cc437e06ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:22.609927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7c4a7e2-7de4-4ab1-b45a-f8cc437e06ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:22.621543 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d7c4a7e2-7de4-4ab1-b45a-f8cc437e06ed tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1472 microversion: 2.1 time: 0.415888 Sep 10 10:45:22.624917 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1616/2122] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:22 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1472 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:22.641171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb5bac1b-15b6-4bc3-90db-3b896e90c11b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:22.642054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cb5bac1b-15b6-4bc3-90db-3b896e90c11b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:22.654797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb5bac1b-15b6-4bc3-90db-3b896e90c11b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:22.656493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb5bac1b-15b6-4bc3-90db-3b896e90c11b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:22.658508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb5bac1b-15b6-4bc3-90db-3b896e90c11b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:22.659435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb5bac1b-15b6-4bc3-90db-3b896e90c11b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:22.661623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb5bac1b-15b6-4bc3-90db-3b896e90c11b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:22.662260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb5bac1b-15b6-4bc3-90db-3b896e90c11b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:22.921443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cb5bac1b-15b6-4bc3-90db-3b896e90c11b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:22.937772 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb5bac1b-15b6-4bc3-90db-3b896e90c11b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1522 microversion: 2.1 time: 0.311403 Sep 10 10:45:22.950059 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1617/2123] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:22 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:22.963621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b90f42a9-7b70-421e-9b9d-d6a6a3e58bc0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:22.965158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b90f42a9-7b70-421e-9b9d-d6a6a3e58bc0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:22.983902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b90f42a9-7b70-421e-9b9d-d6a6a3e58bc0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:22.984478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b90f42a9-7b70-421e-9b9d-d6a6a3e58bc0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:22.985162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b90f42a9-7b70-421e-9b9d-d6a6a3e58bc0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:22.989832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b90f42a9-7b70-421e-9b9d-d6a6a3e58bc0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:22.991984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b90f42a9-7b70-421e-9b9d-d6a6a3e58bc0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:22.993337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b90f42a9-7b70-421e-9b9d-d6a6a3e58bc0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:23.183192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b90f42a9-7b70-421e-9b9d-d6a6a3e58bc0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:23.195053 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b90f42a9-7b70-421e-9b9d-d6a6a3e58bc0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1504 microversion: 2.1 time: 0.243666 Sep 10 10:45:23.196002 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1618/2124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:22 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:23.202429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a9d61d8d-38c7-490c-bf0b-85daa8a3da6a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:23.203335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a9d61d8d-38c7-490c-bf0b-85daa8a3da6a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:23.210438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9d61d8d-38c7-490c-bf0b-85daa8a3da6a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:23.211170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9d61d8d-38c7-490c-bf0b-85daa8a3da6a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:23.211775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9d61d8d-38c7-490c-bf0b-85daa8a3da6a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:23.213178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9d61d8d-38c7-490c-bf0b-85daa8a3da6a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:23.213936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9d61d8d-38c7-490c-bf0b-85daa8a3da6a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:23.214524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9d61d8d-38c7-490c-bf0b-85daa8a3da6a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:23.367228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a9d61d8d-38c7-490c-bf0b-85daa8a3da6a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:23.375973 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a9d61d8d-38c7-490c-bf0b-85daa8a3da6a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1516 microversion: 2.1 time: 0.178446 Sep 10 10:45:23.376559 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1619/2125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:23 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:23.381607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc660e0d-fc5b-4504-8a96-d7bdd08230d8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-816780114"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:23.384159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dc660e0d-fc5b-4504-8a96-d7bdd08230d8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:23.390797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc660e0d-fc5b-4504-8a96-d7bdd08230d8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:23.391294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc660e0d-fc5b-4504-8a96-d7bdd08230d8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:23.391738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc660e0d-fc5b-4504-8a96-d7bdd08230d8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:23.392443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc660e0d-fc5b-4504-8a96-d7bdd08230d8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:23.392905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc660e0d-fc5b-4504-8a96-d7bdd08230d8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:23.393369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc660e0d-fc5b-4504-8a96-d7bdd08230d8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:23.598750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:23.709044 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dc660e0d-fc5b-4504-8a96-d7bdd08230d8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action" status: 202 len: 0 microversion: 2.1 time: 0.325564 Sep 10 10:45:23.710418 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1620/2126] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:45:23 2022] POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 10:45:23.719247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb108a9d-d8f0-42f9-a337-6a9488cbde6e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:23.721940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bb108a9d-d8f0-42f9-a337-6a9488cbde6e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:23.735121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb108a9d-d8f0-42f9-a337-6a9488cbde6e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:23.735858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb108a9d-d8f0-42f9-a337-6a9488cbde6e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:23.736452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb108a9d-d8f0-42f9-a337-6a9488cbde6e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:23.739145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb108a9d-d8f0-42f9-a337-6a9488cbde6e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:23.739781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb108a9d-d8f0-42f9-a337-6a9488cbde6e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:23.740384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb108a9d-d8f0-42f9-a337-6a9488cbde6e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:24.002487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bb108a9d-d8f0-42f9-a337-6a9488cbde6e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:24.013733 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb108a9d-d8f0-42f9-a337-6a9488cbde6e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1472 microversion: 2.1 time: 0.301772 Sep 10 10:45:24.015306 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1621/2127] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:23 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1472 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:24.019975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-206416898"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:24.044396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:24.062707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:24.063688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:24.065605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:24.069717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:24.070201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:24.070618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:24.211061 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Cannot 'createImage' instance e6630508-8b1c-4557-8929-dd226832f411 while it is in task_state image_snapshot_pending Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action HTTP/1.1 Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 84 Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-206416898"}} Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'createImage' instance e6630508-8b1c-4557-8929-dd226832f411 while it is in task_state image_snapshot_pending Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e6630508-8b1c-4557-8929-dd226832f411', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-206416898'}}} Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6630508-8b1c-4557-8929-dd226832f411 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:45:24.227772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e6630508-8b1c-4557-8929-dd226832f411 while it is in task_state image_snapshot_pending Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e6630508-8b1c-4557-8929-dd226832f411 while it is in task_state image_snapshot_pending Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 409 to user: Cannot 'createImage' instance e6630508-8b1c-4557-8929-dd226832f411 while it is in task_state image_snapshot_pending {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:24.231201 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de9de75d-83c7-427d-81d4-9bb5001e96b7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action" status: 409 len: 167 microversion: 2.1 time: 0.213274 Sep 10 10:45:24.232812 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1622/2128] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:45:24 2022] POST /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411/action => generated 167 bytes in 217 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:45:24.255562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-15c21b62-6f50-4006-9ddd-82c9ea858ae7 req-9009a6dd-12f0-467c-adc3-081543ad46ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae35632-52bf-4dd6-88fb-b4419eab5073", "name": "network-vif-unplugged", "status": "completed", "tag": "4ceb2860-1b4b-4bd8-ac7d-9b0d7e86c610"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:24.279330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-15c21b62-6f50-4006-9ddd-82c9ea858ae7 req-9009a6dd-12f0-467c-adc3-081543ad46ba service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:24.279822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-15c21b62-6f50-4006-9ddd-82c9ea858ae7 req-9009a6dd-12f0-467c-adc3-081543ad46ba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:24.280256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-15c21b62-6f50-4006-9ddd-82c9ea858ae7 req-9009a6dd-12f0-467c-adc3-081543ad46ba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:24.311535 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-15c21b62-6f50-4006-9ddd-82c9ea858ae7 req-9009a6dd-12f0-467c-adc3-081543ad46ba service nova] Creating event network-vif-unplugged:4ceb2860-1b4b-4bd8-ac7d-9b0d7e86c610 for instance aae35632-52bf-4dd6-88fb-b4419eab5073 on n-h2-856894-1 Sep 10 10:45:24.332055 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-15c21b62-6f50-4006-9ddd-82c9ea858ae7 req-9009a6dd-12f0-467c-adc3-081543ad46ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092559 Sep 10 10:45:24.333090 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1623/2129] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:24.338569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e6bb256-bc27-405a-b731-5619269fef4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:24.341188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e6bb256-bc27-405a-b731-5619269fef4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:24.354292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e6bb256-bc27-405a-b731-5619269fef4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:24.354785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e6bb256-bc27-405a-b731-5619269fef4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:24.355224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e6bb256-bc27-405a-b731-5619269fef4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:24.355970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e6bb256-bc27-405a-b731-5619269fef4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:24.356425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e6bb256-bc27-405a-b731-5619269fef4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:24.356852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e6bb256-bc27-405a-b731-5619269fef4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:24.684510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e6bb256-bc27-405a-b731-5619269fef4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:24.695614 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e6bb256-bc27-405a-b731-5619269fef4e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1504 microversion: 2.1 time: 0.361599 Sep 10 10:45:24.712148 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1624/2130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:24 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:24.717975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ecc219d7-d5ac-49d2-b97d-2846bd68a9ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '.version_select at 0x7efcb2d74310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:25.031500 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ecc219d7-d5ac-49d2-b97d-2846bd68a9ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "DELETE /compute/v2.1/images/f184d0b8-ed74-43c7-b442-2d16ab381809" status: 204 len: 0 microversion: 2.1 time: 0.317098 Sep 10 10:45:25.033229 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1625/2131] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:24 2022] DELETE /compute/v2.1/images/f184d0b8-ed74-43c7-b442-2d16ab381809 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:45:25.044281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8dd9797b-59b0-450b-9823-1e80a6790217 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:25.045130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8dd9797b-59b0-450b-9823-1e80a6790217 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:25.055506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:25.069591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dd9797b-59b0-450b-9823-1e80a6790217 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:25.072916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dd9797b-59b0-450b-9823-1e80a6790217 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:25.074239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dd9797b-59b0-450b-9823-1e80a6790217 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:25.075651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dd9797b-59b0-450b-9823-1e80a6790217 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:25.078716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dd9797b-59b0-450b-9823-1e80a6790217 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:25.080447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dd9797b-59b0-450b-9823-1e80a6790217 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:25.367195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8dd9797b-59b0-450b-9823-1e80a6790217 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:25.380359 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8dd9797b-59b0-450b-9823-1e80a6790217 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.342973 Sep 10 10:45:25.381360 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1626/2132] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:25 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:25.389029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e10420ed-a924-4d34-a032-96d73532be5c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:25.396813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e10420ed-a924-4d34-a032-96d73532be5c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:25.408269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e10420ed-a924-4d34-a032-96d73532be5c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:25.413976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e10420ed-a924-4d34-a032-96d73532be5c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:25.414887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e10420ed-a924-4d34-a032-96d73532be5c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:25.415888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e10420ed-a924-4d34-a032-96d73532be5c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:25.416827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e10420ed-a924-4d34-a032-96d73532be5c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:25.417513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e10420ed-a924-4d34-a032-96d73532be5c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:25.656130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e10420ed-a924-4d34-a032-96d73532be5c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:25.668972 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e10420ed-a924-4d34-a032-96d73532be5c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1540 microversion: 2.1 time: 0.285689 Sep 10 10:45:25.699716 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1627/2133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:25 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1540 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:25.718643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02d43bea-b629-436a-a6c1-e7140c700e67 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:25.719354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02d43bea-b629-436a-a6c1-e7140c700e67 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:25.738767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02d43bea-b629-436a-a6c1-e7140c700e67 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:25.739549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02d43bea-b629-436a-a6c1-e7140c700e67 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:25.740016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02d43bea-b629-436a-a6c1-e7140c700e67 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:25.747051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02d43bea-b629-436a-a6c1-e7140c700e67 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:25.747859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02d43bea-b629-436a-a6c1-e7140c700e67 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:25.748542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02d43bea-b629-436a-a6c1-e7140c700e67 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:25.934329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02d43bea-b629-436a-a6c1-e7140c700e67 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:25.943618 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02d43bea-b629-436a-a6c1-e7140c700e67 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 200 len: 1447 microversion: 2.1 time: 0.228757 Sep 10 10:45:25.945383 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1628/2134] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:25 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 1447 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:25.973141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:25.973945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:25.981019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:25.982990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:25.983701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:25.984441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:25.984903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:25.985425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:26.027132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:45:26.039784 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.compute.api [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Working on deleting snapshot 528d0986-c515-4f34-bb70-7cdbe571dbc1 from shelved instance... Sep 10 10:45:27.036497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Doing local delete in cell de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) {{(pid=128788) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 10 10:45:27.038409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:27.040246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:27.041294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:27.043446 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.compute.api [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 10 10:45:27.060195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] deallocate_for_instance() {{(pid=128788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 10 10:45:27.884930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Updating instance_info_cache with network_info: [] {{(pid=128788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:45:28.173932 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa083c4a-d516-4e49-a698-7666fbbfbae5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 204 len: 0 microversion: 2.1 time: 2.208631 Sep 10 10:45:28.175950 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1629/2135] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:45:25 2022] DELETE /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 0 bytes in 2211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:45:28.183879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec0e6a7b-f6e3-4729-ba97-c3040fde94ff tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'create', calling method: .version_select at 0x7efcb2d9f5e0>, body: {"keypair": {"name": "tempest-keypair-824773763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJTPbaFxctwIt5QO1glC2DIgEkwRIcs8T6y5hJe+HQnvFo+pUqB4VkFpX36S6T3PDb5n8Ju6BgyNTl4Fcr3+KBoLC924Uw74UcnPQ/lnuJunOy2zjARGUBv783ojG5EoA=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:28.204266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ec0e6a7b-f6e3-4729-ba97-c3040fde94ff tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Getting quotas for project 52c98558e19447dfa54397d92f45dbb9. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:45:28.210682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ec0e6a7b-f6e3-4729-ba97-c3040fde94ff tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Getting quotas for user 0682225a07764437b25009c061ac844d and project 52c98558e19447dfa54397d92f45dbb9. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:45:28.241363 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec0e6a7b-f6e3-4729-ba97-c3040fde94ff tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063150 Sep 10 10:45:28.242149 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1630/2136] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:45:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:28.254157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-793fd6f0-2b5b-47cd-ad7f-54082e890728 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:28.254929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-793fd6f0-2b5b-47cd-ad7f-54082e890728 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:28.273340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-793fd6f0-2b5b-47cd-ad7f-54082e890728 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:28.273859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-793fd6f0-2b5b-47cd-ad7f-54082e890728 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:28.277273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-793fd6f0-2b5b-47cd-ad7f-54082e890728 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:28.278327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-793fd6f0-2b5b-47cd-ad7f-54082e890728 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:28.297342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-793fd6f0-2b5b-47cd-ad7f-54082e890728 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:28.298128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-793fd6f0-2b5b-47cd-ad7f-54082e890728 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:28.599890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-793fd6f0-2b5b-47cd-ad7f-54082e890728 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:28.615852 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-793fd6f0-2b5b-47cd-ad7f-54082e890728 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.372371 Sep 10 10:45:28.634567 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1631/2137] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:28 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:28.643962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05c61d9f-2b89-4e89-a05a-7d75708b94ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:28.645106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05c61d9f-2b89-4e89-a05a-7d75708b94ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:28.653601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05c61d9f-2b89-4e89-a05a-7d75708b94ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:28.654330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05c61d9f-2b89-4e89-a05a-7d75708b94ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:28.655314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05c61d9f-2b89-4e89-a05a-7d75708b94ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:28.656208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05c61d9f-2b89-4e89-a05a-7d75708b94ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:28.657294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05c61d9f-2b89-4e89-a05a-7d75708b94ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:28.657893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05c61d9f-2b89-4e89-a05a-7d75708b94ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:28.857346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05c61d9f-2b89-4e89-a05a-7d75708b94ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:28.863369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:28.875430 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05c61d9f-2b89-4e89-a05a-7d75708b94ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1522 microversion: 2.1 time: 0.239440 Sep 10 10:45:28.878586 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1632/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:28 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:28.885464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6a285911-04a6-46bd-84c3-1106853ea0aa tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:28.886187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6a285911-04a6-46bd-84c3-1106853ea0aa tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:28.896026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a285911-04a6-46bd-84c3-1106853ea0aa tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:28.897863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a285911-04a6-46bd-84c3-1106853ea0aa tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:28.898112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a285911-04a6-46bd-84c3-1106853ea0aa tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:28.899132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a285911-04a6-46bd-84c3-1106853ea0aa tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:28.900030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a285911-04a6-46bd-84c3-1106853ea0aa tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:28.900491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a285911-04a6-46bd-84c3-1106853ea0aa tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:28.936353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6a285911-04a6-46bd-84c3-1106853ea0aa tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:45:29.045289 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6a285911-04a6-46bd-84c3-1106853ea0aa tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 204 len: 0 microversion: 2.1 time: 0.165059 Sep 10 10:45:29.046161 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1633/2139] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:45:28 2022] DELETE /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:45:29.054490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2d2fce61-5ce9-4e32-a667-70d31a1d3aa2 req-15467c93-7f32-4932-99c2-03ab1410fc69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae35632-52bf-4dd6-88fb-b4419eab5073", "name": "network-vif-deleted", "tag": "4ceb2860-1b4b-4bd8-ac7d-9b0d7e86c610"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:29.080792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2d2fce61-5ce9-4e32-a667-70d31a1d3aa2 req-15467c93-7f32-4932-99c2-03ab1410fc69 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.081261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2d2fce61-5ce9-4e32-a667-70d31a1d3aa2 req-15467c93-7f32-4932-99c2-03ab1410fc69 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.083435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2d2fce61-5ce9-4e32-a667-70d31a1d3aa2 req-15467c93-7f32-4932-99c2-03ab1410fc69 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.096986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.server_external_events [req-2d2fce61-5ce9-4e32-a667-70d31a1d3aa2 req-15467c93-7f32-4932-99c2-03ab1410fc69 service nova] Unable to find a host for instance aae35632-52bf-4dd6-88fb-b4419eab5073. Dropping event network-vif-deleted {{(pid=128788) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 10:45:29.098319 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2d2fce61-5ce9-4e32-a667-70d31a1d3aa2 req-15467c93-7f32-4932-99c2-03ab1410fc69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.050575 Sep 10 10:45:29.099114 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1634/2140] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 10:45:29.107008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:29.113019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:29.113891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Searching by: {'deleted': False, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:45:29.121170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.122031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.122657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.123667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.124286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.124887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.154645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:45:29.190009 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-948c6416-92d3-4ad4-ad92-7400d1ea241b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.089290 Sep 10 10:45:29.194045 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1635/2141] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 10:45:29 2022] GET /compute/v2.1/servers => generated 339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:29.200304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:29.201458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:29.210002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.211266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.212083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.213635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.214522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.215418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.243366 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 HTTP/1.1 Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'aae35632-52bf-4dd6-88fb-b4419eab5073'} Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:29.245329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:29.249678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:29.249678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:29.249678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:29.249678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:45:29.249678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:45:29.249678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:45:29.249678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:29.249678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:29.249678 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-49b65910-e58a-45a5-9534-b897bc0dec28 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 404 len: 111 microversion: 2.1 time: 0.051337 Sep 10 10:45:29.249678 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1636/2142] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:29 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:45:29.260348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8cbe799-021d-4c01-9c0a-0f89e3597441 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:29.260348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8cbe799-021d-4c01-9c0a-0f89e3597441 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:29.278148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8cbe799-021d-4c01-9c0a-0f89e3597441 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.279617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8cbe799-021d-4c01-9c0a-0f89e3597441 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.283388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8cbe799-021d-4c01-9c0a-0f89e3597441 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.286521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8cbe799-021d-4c01-9c0a-0f89e3597441 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.287279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8cbe799-021d-4c01-9c0a-0f89e3597441 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.288248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8cbe799-021d-4c01-9c0a-0f89e3597441 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.344083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8cbe799-021d-4c01-9c0a-0f89e3597441 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:45:29.461579 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8cbe799-021d-4c01-9c0a-0f89e3597441 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 204 len: 0 microversion: 2.1 time: 0.212481 Sep 10 10:45:29.463044 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1637/2143] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:45:29 2022] DELETE /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:45:29.470492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-053f7303-0a2e-4b58-8457-7b55696ec498 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:29.471426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-053f7303-0a2e-4b58-8457-7b55696ec498 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:29.478321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-053f7303-0a2e-4b58-8457-7b55696ec498 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.479009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-053f7303-0a2e-4b58-8457-7b55696ec498 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.479812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-053f7303-0a2e-4b58-8457-7b55696ec498 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.480522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-053f7303-0a2e-4b58-8457-7b55696ec498 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.480979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-053f7303-0a2e-4b58-8457-7b55696ec498 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.481435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-053f7303-0a2e-4b58-8457-7b55696ec498 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.699242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-053f7303-0a2e-4b58-8457-7b55696ec498 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:29.722879 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-053f7303-0a2e-4b58-8457-7b55696ec498 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1668 microversion: 2.1 time: 0.258187 Sep 10 10:45:29.723842 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1638/2144] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:29 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1668 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:29.749498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:29.755540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:29.757276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Searching by: {'deleted': False, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:45:29.765762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.766922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.768063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.769103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.771126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.771781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:29.822007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:45:29.883440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:29.892333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:29.893118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:29.893921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:30.103311 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36ae80a5-1cc1-49b2-90d3-c81508450b87 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.362880 Sep 10 10:45:30.105541 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1639/2145] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:45:29 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:30.111988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-366586923", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "15abac29-c434-4802-9cd4-4bace1ac4f7e"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:30.234748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] validate_networks() for [('15abac29-c434-4802-9cd4-4bace1ac4f7e', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:45:30.933807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:45:30.934350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:45:30.934829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:45:30.935512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:45:30.935891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:45:30.945847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:30.946433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:30.946875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:30.947601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:30.948240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:30.948669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:30.971627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:45:30.977997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for user fa978e59fa334084b722d116c761380f and project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:45:30.993207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:45:30.996193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:45:31.046691 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1ea86321-5a94-4372-9292-030c4b236716 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939483 Sep 10 10:45:31.054124 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1640/2146] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:45:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:45:31.054124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db20a8ac-1206-43cc-9fa5-55c53ccc603d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:31.054124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db20a8ac-1206-43cc-9fa5-55c53ccc603d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:31.060193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db20a8ac-1206-43cc-9fa5-55c53ccc603d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:31.060677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db20a8ac-1206-43cc-9fa5-55c53ccc603d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:31.061135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db20a8ac-1206-43cc-9fa5-55c53ccc603d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:31.061833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db20a8ac-1206-43cc-9fa5-55c53ccc603d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:31.062283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db20a8ac-1206-43cc-9fa5-55c53ccc603d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:31.062712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db20a8ac-1206-43cc-9fa5-55c53ccc603d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:31.219667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-db20a8ac-1206-43cc-9fa5-55c53ccc603d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:31.232172 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db20a8ac-1206-43cc-9fa5-55c53ccc603d tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 200 len: 1528 microversion: 2.1 time: 0.183787 Sep 10 10:45:31.233006 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1641/2147] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:31 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 1528 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:31.255003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2fe47e7f-9749-4d75-a698-d9f49f84f1fb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:31.255647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2fe47e7f-9749-4d75-a698-d9f49f84f1fb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:31.263557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe47e7f-9749-4d75-a698-d9f49f84f1fb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:31.264062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe47e7f-9749-4d75-a698-d9f49f84f1fb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:31.265050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe47e7f-9749-4d75-a698-d9f49f84f1fb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:31.265976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe47e7f-9749-4d75-a698-d9f49f84f1fb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:31.266677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe47e7f-9749-4d75-a698-d9f49f84f1fb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:31.267256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fe47e7f-9749-4d75-a698-d9f49f84f1fb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:31.509392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2fe47e7f-9749-4d75-a698-d9f49f84f1fb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:31.518486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2fe47e7f-9749-4d75-a698-d9f49f84f1fb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.268162 Sep 10 10:45:31.519744 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1642/2148] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:31 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:31.529225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-bd105f81-aeee-4388-bfdf-9cc4ce8bac34 req-e685d0c5-4521-4e66-90d0-b8d9ac097216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6630508-8b1c-4557-8929-dd226832f411", "name": "network-vif-plugged", "status": "completed", "tag": "e83d7995-92c7-445a-9a16-b0c007f460a7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:31.541231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bd105f81-aeee-4388-bfdf-9cc4ce8bac34 req-e685d0c5-4521-4e66-90d0-b8d9ac097216 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:31.541774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bd105f81-aeee-4388-bfdf-9cc4ce8bac34 req-e685d0c5-4521-4e66-90d0-b8d9ac097216 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:31.542387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bd105f81-aeee-4388-bfdf-9cc4ce8bac34 req-e685d0c5-4521-4e66-90d0-b8d9ac097216 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:31.554125 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-bd105f81-aeee-4388-bfdf-9cc4ce8bac34 req-e685d0c5-4521-4e66-90d0-b8d9ac097216 service nova] Creating event network-vif-plugged:e83d7995-92c7-445a-9a16-b0c007f460a7 for instance e6630508-8b1c-4557-8929-dd226832f411 on n-h2-856894-1 Sep 10 10:45:31.567560 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-bd105f81-aeee-4388-bfdf-9cc4ce8bac34 req-e685d0c5-4521-4e66-90d0-b8d9ac097216 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046206 Sep 10 10:45:31.568802 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1643/2149] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:31.575303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-25bf0a50-bc4f-47a9-90fe-a08e5a026670 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:31.585143 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-25bf0a50-bc4f-47a9-90fe-a08e5a026670 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014204 Sep 10 10:45:31.586148 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1644/2150] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:45:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:31.592317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-367469566", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1246673f-7f9e-4286-a113-1b0102bfc8aa"}], "security_groups": [{"name": "tempest-securitygroup--651910655"}], "key_name": "tempest-keypair-824773763", "user_data": "}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:32.085686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] validate_networks() for [('1246673f-7f9e-4286-a113-1b0102bfc8aa', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:45:33.152913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:45:33.154349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:45:33.155099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:45:33.155986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:45:33.157196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:45:33.169893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:33.170988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:33.172052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:33.173010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:33.174005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:33.175763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:33.201442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Getting quotas for project 52c98558e19447dfa54397d92f45dbb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:45:33.210955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Getting quotas for user 0682225a07764437b25009c061ac844d and project 52c98558e19447dfa54397d92f45dbb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:45:33.229238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:45:33.232281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:45:33.279028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:33.362216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a462bd3-afef-45d6-b147-6b6ef478f6e2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.774729 Sep 10 10:45:33.369679 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1645/2151] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:45:31 2022] POST /compute/v2.1/servers => generated 408 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:45:33.374232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa28baa3-25b8-4b33-808c-607ced69daae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:33.374864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa28baa3-25b8-4b33-808c-607ced69daae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:33.393407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa28baa3-25b8-4b33-808c-607ced69daae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:33.393924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa28baa3-25b8-4b33-808c-607ced69daae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:33.394376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa28baa3-25b8-4b33-808c-607ced69daae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:33.395105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa28baa3-25b8-4b33-808c-607ced69daae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:33.395552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa28baa3-25b8-4b33-808c-607ced69daae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:33.395982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa28baa3-25b8-4b33-808c-607ced69daae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:33.665545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fa28baa3-25b8-4b33-808c-607ced69daae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:33.695518 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fa28baa3-25b8-4b33-808c-607ced69daae tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1600 microversion: 2.1 time: 0.331091 Sep 10 10:45:33.709555 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1646/2152] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:33 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1600 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:33.709555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e4ab340b-ee42-46b9-b5e6-c453c9c19e98 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:33.713450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e4ab340b-ee42-46b9-b5e6-c453c9c19e98 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:33.727747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ab340b-ee42-46b9-b5e6-c453c9c19e98 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:33.731310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ab340b-ee42-46b9-b5e6-c453c9c19e98 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:33.732079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ab340b-ee42-46b9-b5e6-c453c9c19e98 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:33.732991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ab340b-ee42-46b9-b5e6-c453c9c19e98 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:33.734034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ab340b-ee42-46b9-b5e6-c453c9c19e98 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:33.735813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ab340b-ee42-46b9-b5e6-c453c9c19e98 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:33.911477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e4ab340b-ee42-46b9-b5e6-c453c9c19e98 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:33.925605 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e4ab340b-ee42-46b9-b5e6-c453c9c19e98 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1272 microversion: 2.1 time: 0.225577 Sep 10 10:45:33.926211 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1647/2153] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:33 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:33.955206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3b5d27b-5ca9-45cd-b581-450fecba9588 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:33.955743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e3b5d27b-5ca9-45cd-b581-450fecba9588 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:33.980109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3b5d27b-5ca9-45cd-b581-450fecba9588 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:33.997916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3b5d27b-5ca9-45cd-b581-450fecba9588 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:33.998490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3b5d27b-5ca9-45cd-b581-450fecba9588 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:33.999255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3b5d27b-5ca9-45cd-b581-450fecba9588 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:33.999736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3b5d27b-5ca9-45cd-b581-450fecba9588 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:34.000171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3b5d27b-5ca9-45cd-b581-450fecba9588 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:34.074326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e3b5d27b-5ca9-45cd-b581-450fecba9588 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:45:34.144096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:34.331620 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3b5d27b-5ca9-45cd-b581-450fecba9588 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "DELETE /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 204 len: 0 microversion: 2.1 time: 0.403592 Sep 10 10:45:34.333827 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1648/2154] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:45:33 2022] DELETE /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:45:34.340555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:34.341828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:34.351010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:34.351892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:34.352500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:34.353479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:34.356385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:34.356998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:34.378259 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 HTTP/1.1 Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e6630508-8b1c-4557-8929-dd226832f411'} Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:34.380210 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:34.385238 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:34.385238 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:34.385238 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:34.385238 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:34.385238 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:45:34.385238 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:45:34.385238 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:45:34.385238 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:34.387424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 404 to user: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:34.389454 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-35207e52-aaf4-4c0c-a451-9fefd756ace6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 404 len: 111 microversion: 2.1 time: 0.052842 Sep 10 10:45:34.391242 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1649/2155] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:34 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:45:34.408431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-58d3790f-4ecc-4857-a085-d4aed5a8889c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:34.408693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-58d3790f-4ecc-4857-a085-d4aed5a8889c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:34.432521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58d3790f-4ecc-4857-a085-d4aed5a8889c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:34.434718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58d3790f-4ecc-4857-a085-d4aed5a8889c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:34.435539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58d3790f-4ecc-4857-a085-d4aed5a8889c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:34.436641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58d3790f-4ecc-4857-a085-d4aed5a8889c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:34.441838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58d3790f-4ecc-4857-a085-d4aed5a8889c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:34.442463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58d3790f-4ecc-4857-a085-d4aed5a8889c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:34.833486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-58d3790f-4ecc-4857-a085-d4aed5a8889c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:34.846518 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-58d3790f-4ecc-4857-a085-d4aed5a8889c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.453936 Sep 10 10:45:34.847639 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1650/2156] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:34 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:34.866243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ddc6eae2-39b5-443c-9f90-89ce0af45a10 req-f8d94ce2-3430-4696-ba7d-352a08df3414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6630508-8b1c-4557-8929-dd226832f411", "name": "network-vif-deleted", "tag": "e83d7995-92c7-445a-9a16-b0c007f460a7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:34.884947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ddc6eae2-39b5-443c-9f90-89ce0af45a10 req-f8d94ce2-3430-4696-ba7d-352a08df3414 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:34.887355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ddc6eae2-39b5-443c-9f90-89ce0af45a10 req-f8d94ce2-3430-4696-ba7d-352a08df3414 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:34.888408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ddc6eae2-39b5-443c-9f90-89ce0af45a10 req-f8d94ce2-3430-4696-ba7d-352a08df3414 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:34.904840 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ddc6eae2-39b5-443c-9f90-89ce0af45a10 req-f8d94ce2-3430-4696-ba7d-352a08df3414 service nova] Creating event network-vif-deleted:e83d7995-92c7-445a-9a16-b0c007f460a7 for instance e6630508-8b1c-4557-8929-dd226832f411 on n-h2-856894-1 Sep 10 10:45:34.915250 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ddc6eae2-39b5-443c-9f90-89ce0af45a10 req-f8d94ce2-3430-4696-ba7d-352a08df3414 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065999 Sep 10 10:45:34.916497 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1651/2157] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:35.102248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1f532c9c-60a0-4441-9754-8bcf4fe2e9bf req-7b6e6f8f-c959-4b26-be99-6a747fe59194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5815be-a9f4-4a13-846f-d2f2d7384e00", "name": "network-vif-deleted", "tag": "bb2be5dc-a2e7-4447-9939-ef537449e050"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:35.121907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1f532c9c-60a0-4441-9754-8bcf4fe2e9bf req-7b6e6f8f-c959-4b26-be99-6a747fe59194 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:35.122404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1f532c9c-60a0-4441-9754-8bcf4fe2e9bf req-7b6e6f8f-c959-4b26-be99-6a747fe59194 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:35.124057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1f532c9c-60a0-4441-9754-8bcf4fe2e9bf req-7b6e6f8f-c959-4b26-be99-6a747fe59194 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:35.152328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1f532c9c-60a0-4441-9754-8bcf4fe2e9bf req-7b6e6f8f-c959-4b26-be99-6a747fe59194 service nova] Creating event network-vif-deleted:bb2be5dc-a2e7-4447-9939-ef537449e050 for instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 on n-h2-856894-1 Sep 10 10:45:35.164603 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1f532c9c-60a0-4441-9754-8bcf4fe2e9bf req-7b6e6f8f-c959-4b26-be99-6a747fe59194 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244430 Sep 10 10:45:35.166418 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1652/2158] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:35.179821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-59c6ba39-3c27-426e-b1d7-a635bf952937 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:35.181989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-59c6ba39-3c27-426e-b1d7-a635bf952937 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:35.192967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59c6ba39-3c27-426e-b1d7-a635bf952937 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:35.194805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59c6ba39-3c27-426e-b1d7-a635bf952937 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:35.195271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59c6ba39-3c27-426e-b1d7-a635bf952937 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:35.196019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59c6ba39-3c27-426e-b1d7-a635bf952937 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:35.199836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59c6ba39-3c27-426e-b1d7-a635bf952937 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:35.200362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59c6ba39-3c27-426e-b1d7-a635bf952937 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:35.338344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-59c6ba39-3c27-426e-b1d7-a635bf952937 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:35.349549 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-59c6ba39-3c27-426e-b1d7-a635bf952937 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1240 microversion: 2.1 time: 0.178774 Sep 10 10:45:35.351296 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1653/2159] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:35 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1240 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:35.358328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63a5d7b2-2b89-4c2d-8c17-395e3d3d2825 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:35.359151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63a5d7b2-2b89-4c2d-8c17-395e3d3d2825 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:35.365406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a5d7b2-2b89-4c2d-8c17-395e3d3d2825 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:35.365910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a5d7b2-2b89-4c2d-8c17-395e3d3d2825 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:35.366356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a5d7b2-2b89-4c2d-8c17-395e3d3d2825 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:35.367118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a5d7b2-2b89-4c2d-8c17-395e3d3d2825 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:35.367630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a5d7b2-2b89-4c2d-8c17-395e3d3d2825 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:35.368071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a5d7b2-2b89-4c2d-8c17-395e3d3d2825 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:35.611730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63a5d7b2-2b89-4c2d-8c17-395e3d3d2825 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:35.620098 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63a5d7b2-2b89-4c2d-8c17-395e3d3d2825 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1713 microversion: 2.1 time: 0.265798 Sep 10 10:45:35.620998 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1654/2160] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:35 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1713 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:35.625729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6df6820a-a7e7-4b8d-b05f-ecd560d32d6f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Action: 'create', calling method: .version_select at 0x7efcb2dd99d0>, body: {"keypair": {"name": "tempest-keypair-1617909047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFO1kW/lk3+Dnd4Vmq1OdCvaG5QG5AQRMI6M9iQlUIYSpRUURO1Kvf1UmrPdKqrAuq4jOCrDtHQmoioTr6Zaq5+DHXVPwiJY2KFr4vPmZsPtFU95rSxCgRitI+HS4vqfUQ=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:35.643216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-6df6820a-a7e7-4b8d-b05f-ecd560d32d6f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Getting quotas for project ee641ddfdc8a4ff6a9e9a58b705a1fb6. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:45:35.651818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-6df6820a-a7e7-4b8d-b05f-ecd560d32d6f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Getting quotas for user 3e6d3452f1dd4b7781f0f6d490115e6b and project ee641ddfdc8a4ff6a9e9a58b705a1fb6. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:45:35.683472 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6df6820a-a7e7-4b8d-b05f-ecd560d32d6f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061215 Sep 10 10:45:35.684195 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1655/2161] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:45:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:35.689128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:35.689771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:35.698296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:35.698792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:35.699229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:35.699982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:35.700367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:35.700791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:35.745956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:35.746726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:35.747170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:35.747623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lazy-loading 'fault' on Instance uuid 1b5815be-a9f4-4a13-846f-d2f2d7384e00 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:45:35.815620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:35.824099 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a36aa30a-cfa5-4a26-ab73-2797be0ab107 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 200 len: 1324 microversion: 2.1 time: 0.138641 Sep 10 10:45:35.825415 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1656/2162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:35 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 1324 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:35.851416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9cba8cad-2010-443b-b152-70b1b101aa8a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:35.852594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9cba8cad-2010-443b-b152-70b1b101aa8a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:35.861261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cba8cad-2010-443b-b152-70b1b101aa8a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:35.861856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cba8cad-2010-443b-b152-70b1b101aa8a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:35.862492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cba8cad-2010-443b-b152-70b1b101aa8a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:35.872804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cba8cad-2010-443b-b152-70b1b101aa8a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:35.872804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cba8cad-2010-443b-b152-70b1b101aa8a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:35.873882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cba8cad-2010-443b-b152-70b1b101aa8a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:36.397211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9cba8cad-2010-443b-b152-70b1b101aa8a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:36.405056 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9cba8cad-2010-443b-b152-70b1b101aa8a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1314 microversion: 2.1 time: 0.578301 Sep 10 10:45:36.419963 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1657/2163] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:35 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:36.432119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-154e8c9b-29df-48dd-8e4c-c195fd0f930c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:36.432945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-154e8c9b-29df-48dd-8e4c-c195fd0f930c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:36.463748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-154e8c9b-29df-48dd-8e4c-c195fd0f930c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:36.464293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-154e8c9b-29df-48dd-8e4c-c195fd0f930c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:36.465733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-154e8c9b-29df-48dd-8e4c-c195fd0f930c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:36.469505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-154e8c9b-29df-48dd-8e4c-c195fd0f930c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:36.470021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-154e8c9b-29df-48dd-8e4c-c195fd0f930c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:36.470470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-154e8c9b-29df-48dd-8e4c-c195fd0f930c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:36.848557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-154e8c9b-29df-48dd-8e4c-c195fd0f930c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:36.868120 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-154e8c9b-29df-48dd-8e4c-c195fd0f930c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.453216 Sep 10 10:45:36.876254 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1658/2164] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:36 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:36.885699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c80b27dc-15e3-4999-9b7a-c0c6e22cf57d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:36.887127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c80b27dc-15e3-4999-9b7a-c0c6e22cf57d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:36.908436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c80b27dc-15e3-4999-9b7a-c0c6e22cf57d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:36.908947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c80b27dc-15e3-4999-9b7a-c0c6e22cf57d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:36.909421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c80b27dc-15e3-4999-9b7a-c0c6e22cf57d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:36.912190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c80b27dc-15e3-4999-9b7a-c0c6e22cf57d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:36.912689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c80b27dc-15e3-4999-9b7a-c0c6e22cf57d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:36.914727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c80b27dc-15e3-4999-9b7a-c0c6e22cf57d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:37.097416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c80b27dc-15e3-4999-9b7a-c0c6e22cf57d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:37.124375 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c80b27dc-15e3-4999-9b7a-c0c6e22cf57d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1296 microversion: 2.1 time: 0.244059 Sep 10 10:45:37.130475 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1659/2165] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:36 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1296 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:37.146776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6573b869-6e7a-44d9-a91f-ceb7573abb5d tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:37.149837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6573b869-6e7a-44d9-a91f-ceb7573abb5d tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:37.188185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6573b869-6e7a-44d9-a91f-ceb7573abb5d tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:37.188695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6573b869-6e7a-44d9-a91f-ceb7573abb5d tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:37.189176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6573b869-6e7a-44d9-a91f-ceb7573abb5d tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:37.189896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6573b869-6e7a-44d9-a91f-ceb7573abb5d tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:37.190359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6573b869-6e7a-44d9-a91f-ceb7573abb5d tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:37.190789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6573b869-6e7a-44d9-a91f-ceb7573abb5d tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:37.451899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6573b869-6e7a-44d9-a91f-ceb7573abb5d tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:37.473499 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6573b869-6e7a-44d9-a91f-ceb7573abb5d tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1713 microversion: 2.1 time: 0.339086 Sep 10 10:45:37.477960 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1660/2166] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:37 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1713 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:37.487461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:37.494290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 1b5815be-a9f4-4a13-846f-d2f2d7384e00] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:37.507701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:37.508602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:37.510546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:37.512705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:37.514763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:37.515229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:37.538262 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] HTTP exception thrown: Instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 could not be found. Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Request method failure captured: Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 HTTP/1.1 Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkjVK2ZOmRVIPSrEr-Ye_0gUyEODKCdugm9a-s8uz52g6eXKFW6yjW0bBlpd5C05VHBUklnWpDq0KYbWL3nwKXXbXSfAKn6rkwfXTci8a5Sxjqj-SL6HNnpuSFx7xURL39B3fb3Sb9cfZvOv1Oh_DqO7hul8pvepuk9PG9hu8PRc8E Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: bb350b19a7254f0bbffb6e5b8dc2bbe3 Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-LiveMigrationTest-834273095 Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb350b19a7254f0bbffb6e5b8dc2bbe3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-LiveMigrationTest-834273095 Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: bb350b19a7254f0bbffb6e5b8dc2bbe3 Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-LiveMigrationTest-834273095 Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-LiveMigrationTest-834273095-project Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: a1013c609b044cb781dd1691909db7bf Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-LiveMigrationTest-834273095-project Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 could not be found. Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '1b5815be-a9f4-4a13-846f-d2f2d7384e00'} Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 could not be found. Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 could not be found. Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:37.540228 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:37.544470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:37.544470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:37.544470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:37.544470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:45:37.544470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:45:37.544470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 could not be found. Sep 10 10:45:37.544470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:37.546975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Returning 404 to user: Instance 1b5815be-a9f4-4a13-846f-d2f2d7384e00 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:37.548339 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-28867fda-80f8-4601-9186-499839b280c4 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00" status: 404 len: 111 microversion: 2.1 time: 0.068952 Sep 10 10:45:37.553305 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1661/2167] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:37 2022] GET /compute/v2.1/servers/1b5815be-a9f4-4a13-846f-d2f2d7384e00 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:45:37.563086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90be17b0-2b1c-4565-b7d5-abaa8b60aaef tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:37.564186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-90be17b0-2b1c-4565-b7d5-abaa8b60aaef tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:37.572247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90be17b0-2b1c-4565-b7d5-abaa8b60aaef tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:37.573045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90be17b0-2b1c-4565-b7d5-abaa8b60aaef tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:37.573873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90be17b0-2b1c-4565-b7d5-abaa8b60aaef tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:37.574872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90be17b0-2b1c-4565-b7d5-abaa8b60aaef tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:37.575554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90be17b0-2b1c-4565-b7d5-abaa8b60aaef tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:37.576886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90be17b0-2b1c-4565-b7d5-abaa8b60aaef tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:37.832574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-90be17b0-2b1c-4565-b7d5-abaa8b60aaef tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:37.843093 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90be17b0-2b1c-4565-b7d5-abaa8b60aaef tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1314 microversion: 2.1 time: 0.288252 Sep 10 10:45:37.844359 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1662/2168] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:37 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:37.862623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-34abc19a-4c5f-44ec-9cd9-47da91531742 req-f4d05471-b118-4ae2-afbf-34086c037af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18610e7e-0f81-4038-abc9-9772929a13fe", "tag": "ff189d0a-d720-4fbe-8d12-7755848bd470"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:37.884398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-34abc19a-4c5f-44ec-9cd9-47da91531742 req-f4d05471-b118-4ae2-afbf-34086c037af9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:37.885091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-34abc19a-4c5f-44ec-9cd9-47da91531742 req-f4d05471-b118-4ae2-afbf-34086c037af9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:37.885585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-34abc19a-4c5f-44ec-9cd9-47da91531742 req-f4d05471-b118-4ae2-afbf-34086c037af9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:37.903831 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-34abc19a-4c5f-44ec-9cd9-47da91531742 req-f4d05471-b118-4ae2-afbf-34086c037af9 service nova] Creating event network-changed:ff189d0a-d720-4fbe-8d12-7755848bd470 for instance 18610e7e-0f81-4038-abc9-9772929a13fe on n-h2-856894-1 Sep 10 10:45:37.909604 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-34abc19a-4c5f-44ec-9cd9-47da91531742 req-f4d05471-b118-4ae2-afbf-34086c037af9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062030 Sep 10 10:45:37.919580 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1663/2169] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:37.929297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8ea2c44-8a9b-4b6c-8b64-4096916be3c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '.version_select at 0x7efcb2deea60>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:37.960813 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8ea2c44-8a9b-4b6c-8b64-4096916be3c0 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-800861784" status: 202 len: 0 microversion: 2.1 time: 0.038096 Sep 10 10:45:37.966562 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1664/2170] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Sep 10 10:45:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-800861784 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:45:37.974158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c117479-3a0d-43f8-9732-2a723912e9f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:37.975180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c117479-3a0d-43f8-9732-2a723912e9f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:37.982300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c117479-3a0d-43f8-9732-2a723912e9f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:37.983096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c117479-3a0d-43f8-9732-2a723912e9f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:37.983723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c117479-3a0d-43f8-9732-2a723912e9f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:37.984599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c117479-3a0d-43f8-9732-2a723912e9f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:37.985299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c117479-3a0d-43f8-9732-2a723912e9f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:37.985884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c117479-3a0d-43f8-9732-2a723912e9f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:38.332060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c117479-3a0d-43f8-9732-2a723912e9f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:38.346142 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c117479-3a0d-43f8-9732-2a723912e9f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.376877 Sep 10 10:45:38.347601 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1665/2171] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:37 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:38.357806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-653854b8-a387-4489-92ab-ffb4a5f64829 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:38.358893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-653854b8-a387-4489-92ab-ffb4a5f64829 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:38.375484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653854b8-a387-4489-92ab-ffb4a5f64829 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:38.381699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653854b8-a387-4489-92ab-ffb4a5f64829 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:38.383716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653854b8-a387-4489-92ab-ffb4a5f64829 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:38.384887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653854b8-a387-4489-92ab-ffb4a5f64829 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:38.387004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653854b8-a387-4489-92ab-ffb4a5f64829 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:38.387900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653854b8-a387-4489-92ab-ffb4a5f64829 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:38.517973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-653854b8-a387-4489-92ab-ffb4a5f64829 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:38.526867 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-653854b8-a387-4489-92ab-ffb4a5f64829 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1302 microversion: 2.1 time: 0.177817 Sep 10 10:45:38.527513 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1666/2172] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:38 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1302 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:38.539987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd3783b6-3d0e-496d-abd9-9e0fddbe345b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:38.541789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd3783b6-3d0e-496d-abd9-9e0fddbe345b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:38.551710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd3783b6-3d0e-496d-abd9-9e0fddbe345b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:38.552218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd3783b6-3d0e-496d-abd9-9e0fddbe345b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:38.552700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd3783b6-3d0e-496d-abd9-9e0fddbe345b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:38.553528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd3783b6-3d0e-496d-abd9-9e0fddbe345b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:38.554312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd3783b6-3d0e-496d-abd9-9e0fddbe345b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:38.554778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd3783b6-3d0e-496d-abd9-9e0fddbe345b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:38.665218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd3783b6-3d0e-496d-abd9-9e0fddbe345b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:38.697581 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd3783b6-3d0e-496d-abd9-9e0fddbe345b tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1645 microversion: 2.1 time: 0.168952 Sep 10 10:45:38.702674 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1667/2173] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:38 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1645 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:38.837234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4892dea8-758e-43d8-adf7-2b5a16950feb req-97c1bf03-fc38-4502-85b2-438819a48e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405234b5-1d79-41cd-a7b3-39756579d91b", "name": "network-vif-deleted", "tag": "2535e255-f38a-4ba7-9e5d-bb3080a3f2a2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:38.870439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4892dea8-758e-43d8-adf7-2b5a16950feb req-97c1bf03-fc38-4502-85b2-438819a48e18 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:38.870952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4892dea8-758e-43d8-adf7-2b5a16950feb req-97c1bf03-fc38-4502-85b2-438819a48e18 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:38.871380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4892dea8-758e-43d8-adf7-2b5a16950feb req-97c1bf03-fc38-4502-85b2-438819a48e18 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:38.888827 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4892dea8-758e-43d8-adf7-2b5a16950feb req-97c1bf03-fc38-4502-85b2-438819a48e18 service nova] Creating event network-vif-deleted:2535e255-f38a-4ba7-9e5d-bb3080a3f2a2 for instance 405234b5-1d79-41cd-a7b3-39756579d91b on n-h2-856894-1 Sep 10 10:45:38.895479 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4892dea8-758e-43d8-adf7-2b5a16950feb req-97c1bf03-fc38-4502-85b2-438819a48e18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080449 Sep 10 10:45:38.897241 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1668/2174] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:38.907782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9eacfe73-42b8-4202-a1c7-4a992eca2e2c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:38.908933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9eacfe73-42b8-4202-a1c7-4a992eca2e2c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:38.917686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9eacfe73-42b8-4202-a1c7-4a992eca2e2c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:38.920640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9eacfe73-42b8-4202-a1c7-4a992eca2e2c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:38.921893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9eacfe73-42b8-4202-a1c7-4a992eca2e2c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:38.922866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9eacfe73-42b8-4202-a1c7-4a992eca2e2c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:38.923503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9eacfe73-42b8-4202-a1c7-4a992eca2e2c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:38.924648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9eacfe73-42b8-4202-a1c7-4a992eca2e2c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:39.489382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9eacfe73-42b8-4202-a1c7-4a992eca2e2c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:39.504207 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9eacfe73-42b8-4202-a1c7-4a992eca2e2c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1314 microversion: 2.1 time: 0.604633 Sep 10 10:45:39.517172 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1669/2175] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:38 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:39.530202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19175583-4651-413d-b990-09bee79e17b5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:39.530977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-19175583-4651-413d-b990-09bee79e17b5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:39.553291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19175583-4651-413d-b990-09bee79e17b5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:39.555530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19175583-4651-413d-b990-09bee79e17b5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:39.556221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19175583-4651-413d-b990-09bee79e17b5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:39.558267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19175583-4651-413d-b990-09bee79e17b5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:39.558944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19175583-4651-413d-b990-09bee79e17b5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:39.559692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19175583-4651-413d-b990-09bee79e17b5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:39.567243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:39.745093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19175583-4651-413d-b990-09bee79e17b5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:39.756018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-19175583-4651-413d-b990-09bee79e17b5 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.248588 Sep 10 10:45:39.770429 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1670/2176] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:39 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:39.770429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d34af78-029b-432c-8abf-4bb472ba12d2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:39.770429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d34af78-029b-432c-8abf-4bb472ba12d2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:39.770801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d34af78-029b-432c-8abf-4bb472ba12d2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:39.771041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d34af78-029b-432c-8abf-4bb472ba12d2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:39.771740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d34af78-029b-432c-8abf-4bb472ba12d2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:39.772775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d34af78-029b-432c-8abf-4bb472ba12d2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:39.773983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d34af78-029b-432c-8abf-4bb472ba12d2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:39.774797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d34af78-029b-432c-8abf-4bb472ba12d2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:39.847780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d34af78-029b-432c-8abf-4bb472ba12d2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:39.857297 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d34af78-029b-432c-8abf-4bb472ba12d2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1302 microversion: 2.1 time: 0.097642 Sep 10 10:45:39.858127 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1671/2177] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:39 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1302 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:39.874016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:39.874726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:39.882587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:39.883082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:39.883520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:39.884222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:39.884679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:39.885127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:39.920304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:39.920807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:39.921281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:39.921742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lazy-loading 'fault' on Instance uuid 405234b5-1d79-41cd-a7b3-39756579d91b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:45:39.981463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf760aa8b40d443289a6186df5e23bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb90ea98afcb4bb1820aafa111b44cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:39.991470 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e633c06-ecec-43d2-b0a2-1379fb48c2a6 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 200 len: 1366 microversion: 2.1 time: 0.131667 Sep 10 10:45:39.992513 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1672/2178] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:39 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:40.290881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1773944257", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:40.349135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] validate_networks() for [('f1689f33-58e5-45ac-9fc5-3a833f4afde6', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:45:40.854058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:45:40.855372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:45:40.855977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:45:40.856461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:45:40.857293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:45:40.868432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:40.868993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:40.869532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:40.870333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:40.871014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:40.871539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:40.891463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Getting quotas for project ee641ddfdc8a4ff6a9e9a58b705a1fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:45:40.898036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Getting quotas for user 3e6d3452f1dd4b7781f0f6d490115e6b and project ee641ddfdc8a4ff6a9e9a58b705a1fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:45:40.913599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:45:40.916462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:45:40.986493 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5cb91a2a-b813-4f4a-9ba2-bbaa949e1cf0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.701031 Sep 10 10:45:40.987364 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1673/2179] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:45:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 10:45:40.987364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a856f0f-7d28-427d-bf4a-f7934e9190ed tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:40.987364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1a856f0f-7d28-427d-bf4a-f7934e9190ed tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:41.001779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a856f0f-7d28-427d-bf4a-f7934e9190ed tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:41.002492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a856f0f-7d28-427d-bf4a-f7934e9190ed tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:41.003215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a856f0f-7d28-427d-bf4a-f7934e9190ed tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:41.004179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a856f0f-7d28-427d-bf4a-f7934e9190ed tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:41.004834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a856f0f-7d28-427d-bf4a-f7934e9190ed tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:41.005483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a856f0f-7d28-427d-bf4a-f7934e9190ed tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:41.223506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1a856f0f-7d28-427d-bf4a-f7934e9190ed tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:41.235427 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a856f0f-7d28-427d-bf4a-f7934e9190ed tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1314 microversion: 2.1 time: 0.246814 Sep 10 10:45:41.237858 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1674/2180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:40 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:41.246488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a498c64-f24f-40dc-8f04-b39083af116d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:41.247300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a498c64-f24f-40dc-8f04-b39083af116d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:41.258830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a498c64-f24f-40dc-8f04-b39083af116d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:41.259524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a498c64-f24f-40dc-8f04-b39083af116d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:41.260764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a498c64-f24f-40dc-8f04-b39083af116d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:41.261869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a498c64-f24f-40dc-8f04-b39083af116d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:41.262344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a498c64-f24f-40dc-8f04-b39083af116d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:41.262781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a498c64-f24f-40dc-8f04-b39083af116d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:41.442990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a498c64-f24f-40dc-8f04-b39083af116d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:41.453351 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a498c64-f24f-40dc-8f04-b39083af116d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.213822 Sep 10 10:45:41.454611 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1675/2181] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:41 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:41.463834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1ca515a0-a52d-4cea-b88a-b5450c7a138f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:41.464779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1ca515a0-a52d-4cea-b88a-b5450c7a138f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:41.472495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ca515a0-a52d-4cea-b88a-b5450c7a138f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:41.473173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ca515a0-a52d-4cea-b88a-b5450c7a138f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:41.473984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ca515a0-a52d-4cea-b88a-b5450c7a138f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:41.476728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ca515a0-a52d-4cea-b88a-b5450c7a138f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:41.477889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ca515a0-a52d-4cea-b88a-b5450c7a138f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:41.478002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ca515a0-a52d-4cea-b88a-b5450c7a138f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:41.687344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1ca515a0-a52d-4cea-b88a-b5450c7a138f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:41.696453 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1ca515a0-a52d-4cea-b88a-b5450c7a138f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1369 microversion: 2.1 time: 0.240489 Sep 10 10:45:41.701648 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1676/2182] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:41 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1369 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:41.706454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-723bcb3e-64c0-4408-9131-96fd663ac335 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:41.706979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-723bcb3e-64c0-4408-9131-96fd663ac335 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:41.713394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:41.718428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723bcb3e-64c0-4408-9131-96fd663ac335 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:41.720650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723bcb3e-64c0-4408-9131-96fd663ac335 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:41.721321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723bcb3e-64c0-4408-9131-96fd663ac335 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:41.722194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723bcb3e-64c0-4408-9131-96fd663ac335 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:41.722813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723bcb3e-64c0-4408-9131-96fd663ac335 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:41.723386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723bcb3e-64c0-4408-9131-96fd663ac335 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:41.754944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-723bcb3e-64c0-4408-9131-96fd663ac335 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:45:41.872239 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-723bcb3e-64c0-4408-9131-96fd663ac335 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "DELETE /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 204 len: 0 microversion: 2.1 time: 0.169162 Sep 10 10:45:41.876728 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1677/2183] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:45:41 2022] DELETE /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:45:41.883549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6953688-82fd-47c9-ae5e-ff98e0defd17 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:41.884739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6953688-82fd-47c9-ae5e-ff98e0defd17 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:41.891427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6953688-82fd-47c9-ae5e-ff98e0defd17 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:41.891950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6953688-82fd-47c9-ae5e-ff98e0defd17 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:41.892395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6953688-82fd-47c9-ae5e-ff98e0defd17 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:41.893107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6953688-82fd-47c9-ae5e-ff98e0defd17 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:41.893571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6953688-82fd-47c9-ae5e-ff98e0defd17 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:41.894192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6953688-82fd-47c9-ae5e-ff98e0defd17 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:41.987194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f6953688-82fd-47c9-ae5e-ff98e0defd17 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:41.998604 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6953688-82fd-47c9-ae5e-ff98e0defd17 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1221 microversion: 2.1 time: 0.119959 Sep 10 10:45:41.999893 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1678/2184] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:41 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1221 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:42.005769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:42.006668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] [instance: 405234b5-1d79-41cd-a7b3-39756579d91b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:42.014300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:42.015082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:42.015723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:42.016700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:42.017243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:42.017839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:42.035500 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] HTTP exception thrown: Instance 405234b5-1d79-41cd-a7b3-39756579d91b could not be found. Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Request method failure captured: Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b HTTP/1.1 Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpwmidN3yDF5-0-EiRsy6ymG0BKCSNcmPkRQAXknzP8Mz6-u__ZdybamStNLpo7sdV2yYrBDqjoc1Tyys6WUGcbPOgPOGlZZcpozwH6vqzcMH_JCGZeX0Z0CoghiR06CpXc_VOCf_XyeLRRzdCsG97-gaASF8JmK-klADi86sQKhPE Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: cb90ea98afcb4bb1820aafa111b44cd5 Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestManualDisk-704974272 Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb90ea98afcb4bb1820aafa111b44cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cb90ea98afcb4bb1820aafa111b44cd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cb90ea98afcb4bb1820aafa111b44cd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cb90ea98afcb4bb1820aafa111b44cd5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestManualDisk-704974272 Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: cb90ea98afcb4bb1820aafa111b44cd5 Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestManualDisk-704974272 Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestManualDisk-704974272-project Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: bf760aa8b40d443289a6186df5e23bb1 Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestManualDisk-704974272-project Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 405234b5-1d79-41cd-a7b3-39756579d91b could not be found. Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '405234b5-1d79-41cd-a7b3-39756579d91b'} Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405234b5-1d79-41cd-a7b3-39756579d91b could not be found. Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405234b5-1d79-41cd-a7b3-39756579d91b could not be found. Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:42.038165 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:42.042470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:42.042470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:42.042470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:42.042470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:45:42.042470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:45:42.042470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405234b5-1d79-41cd-a7b3-39756579d91b could not be found. Sep 10 10:45:42.042470 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:42.045504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Returning 404 to user: Instance 405234b5-1d79-41cd-a7b3-39756579d91b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:42.046729 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b3ee276-18ea-48f2-ac6c-1b9dd24548e4 tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b" status: 404 len: 111 microversion: 2.1 time: 0.045067 Sep 10 10:45:42.047511 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1679/2185] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:42 2022] GET /compute/v2.1/servers/405234b5-1d79-41cd-a7b3-39756579d91b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:45:42.062309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e611cb6f-662a-4c4a-b4c3-66c3fa9c9efb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:42.063276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e611cb6f-662a-4c4a-b4c3-66c3fa9c9efb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:42.072760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e611cb6f-662a-4c4a-b4c3-66c3fa9c9efb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:42.073387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e611cb6f-662a-4c4a-b4c3-66c3fa9c9efb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:42.073840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e611cb6f-662a-4c4a-b4c3-66c3fa9c9efb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:42.074810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e611cb6f-662a-4c4a-b4c3-66c3fa9c9efb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:42.075056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e611cb6f-662a-4c4a-b4c3-66c3fa9c9efb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:42.075682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e611cb6f-662a-4c4a-b4c3-66c3fa9c9efb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:42.300971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e611cb6f-662a-4c4a-b4c3-66c3fa9c9efb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:42.316040 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e611cb6f-662a-4c4a-b4c3-66c3fa9c9efb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1485 microversion: 2.1 time: 0.267146 Sep 10 10:45:42.316798 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1680/2186] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:42 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1485 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:42.325116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-317fa59c-138c-4952-b2c2-78218ae01f3a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] Calling method '.version_select at 0x7efcaf037ca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:42.355896 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-317fa59c-138c-4952-b2c2-78218ae01f3a tempest-ServersTestManualDisk-704974272 tempest-ServersTestManualDisk-704974272-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-199307297" status: 202 len: 0 microversion: 2.1 time: 0.037543 Sep 10 10:45:42.357009 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1681/2187] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Sep 10 10:45:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-199307297 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:45:42.367396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6be9cc6-68b9-4f41-9be6-b241f21eaee9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:42.372501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c6be9cc6-68b9-4f41-9be6-b241f21eaee9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:42.392614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6be9cc6-68b9-4f41-9be6-b241f21eaee9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:42.393186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6be9cc6-68b9-4f41-9be6-b241f21eaee9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:42.393862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6be9cc6-68b9-4f41-9be6-b241f21eaee9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:42.394867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6be9cc6-68b9-4f41-9be6-b241f21eaee9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:42.396346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6be9cc6-68b9-4f41-9be6-b241f21eaee9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:42.396346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6be9cc6-68b9-4f41-9be6-b241f21eaee9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:42.619251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c6be9cc6-68b9-4f41-9be6-b241f21eaee9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:42.629143 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c6be9cc6-68b9-4f41-9be6-b241f21eaee9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1314 microversion: 2.1 time: 0.270879 Sep 10 10:45:42.630878 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1682/2188] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:42 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:42.649120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b2445636-639d-4ec5-8b0c-f74dd171ce46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:42.652754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b2445636-639d-4ec5-8b0c-f74dd171ce46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:42.669338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2445636-639d-4ec5-8b0c-f74dd171ce46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:42.670034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2445636-639d-4ec5-8b0c-f74dd171ce46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:42.670695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2445636-639d-4ec5-8b0c-f74dd171ce46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:42.671569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2445636-639d-4ec5-8b0c-f74dd171ce46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:42.672025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2445636-639d-4ec5-8b0c-f74dd171ce46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:42.672506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2445636-639d-4ec5-8b0c-f74dd171ce46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:42.906960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b2445636-639d-4ec5-8b0c-f74dd171ce46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:42.918545 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b2445636-639d-4ec5-8b0c-f74dd171ce46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.286415 Sep 10 10:45:42.934901 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1683/2189] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:42 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:42.941834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c7bac56-86c8-4235-a442-0ca35a037e1e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:42.942740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c7bac56-86c8-4235-a442-0ca35a037e1e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:42.959900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c7bac56-86c8-4235-a442-0ca35a037e1e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:42.960737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c7bac56-86c8-4235-a442-0ca35a037e1e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:42.961370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c7bac56-86c8-4235-a442-0ca35a037e1e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:42.962502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c7bac56-86c8-4235-a442-0ca35a037e1e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:42.963194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c7bac56-86c8-4235-a442-0ca35a037e1e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:42.963848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c7bac56-86c8-4235-a442-0ca35a037e1e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:43.408024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c7bac56-86c8-4235-a442-0ca35a037e1e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:43.421453 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c7bac56-86c8-4235-a442-0ca35a037e1e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1369 microversion: 2.1 time: 0.480282 Sep 10 10:45:43.422199 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1684/2190] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:42 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1369 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:43.432520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53965077-3b38-42aa-97a9-8575e43959e4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:43.433256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53965077-3b38-42aa-97a9-8575e43959e4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:43.440843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53965077-3b38-42aa-97a9-8575e43959e4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:43.441405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53965077-3b38-42aa-97a9-8575e43959e4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:43.442139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53965077-3b38-42aa-97a9-8575e43959e4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:43.442842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53965077-3b38-42aa-97a9-8575e43959e4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:43.443897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53965077-3b38-42aa-97a9-8575e43959e4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:43.444469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53965077-3b38-42aa-97a9-8575e43959e4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:43.545671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53965077-3b38-42aa-97a9-8575e43959e4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:43.555307 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53965077-3b38-42aa-97a9-8575e43959e4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1283 microversion: 2.1 time: 0.131956 Sep 10 10:45:43.555898 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1685/2191] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:43 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:43.578099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5353a5fa-db44-4fe0-8551-3412183a0fdb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:43.578715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5353a5fa-db44-4fe0-8551-3412183a0fdb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:43.586159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5353a5fa-db44-4fe0-8551-3412183a0fdb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:43.586689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5353a5fa-db44-4fe0-8551-3412183a0fdb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:43.587146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5353a5fa-db44-4fe0-8551-3412183a0fdb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:43.587912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5353a5fa-db44-4fe0-8551-3412183a0fdb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:43.588380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5353a5fa-db44-4fe0-8551-3412183a0fdb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:43.588835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5353a5fa-db44-4fe0-8551-3412183a0fdb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:43.989507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5353a5fa-db44-4fe0-8551-3412183a0fdb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:44.032722 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5353a5fa-db44-4fe0-8551-3412183a0fdb tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 200 len: 1485 microversion: 2.1 time: 0.453650 Sep 10 10:45:44.049423 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1686/2192] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:43 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 1485 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:44.056332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8bfe0149-73a6-40cf-a1f6-c7340beda5cd req-11852732-0e21-45a7-be89-4abe2603f569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47a8a03-72e3-4db7-8e43-a1992a5f6ece", "tag": "d82ae4f2-aa8d-42e7-9522-1732c70f4f3a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:44.076197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8bfe0149-73a6-40cf-a1f6-c7340beda5cd req-11852732-0e21-45a7-be89-4abe2603f569 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:44.076887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8bfe0149-73a6-40cf-a1f6-c7340beda5cd req-11852732-0e21-45a7-be89-4abe2603f569 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:44.077543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8bfe0149-73a6-40cf-a1f6-c7340beda5cd req-11852732-0e21-45a7-be89-4abe2603f569 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:44.105722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:44.126037 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8bfe0149-73a6-40cf-a1f6-c7340beda5cd req-11852732-0e21-45a7-be89-4abe2603f569 service nova] Creating event network-changed:d82ae4f2-aa8d-42e7-9522-1732c70f4f3a for instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece on n-h2-856894-1 Sep 10 10:45:44.131954 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8bfe0149-73a6-40cf-a1f6-c7340beda5cd req-11852732-0e21-45a7-be89-4abe2603f569 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085450 Sep 10 10:45:44.145484 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1687/2193] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:44.159070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e456f7d2-d18f-49ca-8638-2d0f03283d0c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:44.159346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e456f7d2-d18f-49ca-8638-2d0f03283d0c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:44.175692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e456f7d2-d18f-49ca-8638-2d0f03283d0c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:44.176659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e456f7d2-d18f-49ca-8638-2d0f03283d0c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:44.176659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e456f7d2-d18f-49ca-8638-2d0f03283d0c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:44.177357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e456f7d2-d18f-49ca-8638-2d0f03283d0c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:44.178433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e456f7d2-d18f-49ca-8638-2d0f03283d0c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:44.178765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e456f7d2-d18f-49ca-8638-2d0f03283d0c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:45.096730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e456f7d2-d18f-49ca-8638-2d0f03283d0c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:45.104433 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e456f7d2-d18f-49ca-8638-2d0f03283d0c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1314 microversion: 2.1 time: 0.957098 Sep 10 10:45:45.105012 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1688/2194] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:44 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:45.109595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2038d74c-61d2-4918-a0fb-534715f3d3a3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:45.110382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2038d74c-61d2-4918-a0fb-534715f3d3a3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:45.118084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2038d74c-61d2-4918-a0fb-534715f3d3a3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:45.118454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2038d74c-61d2-4918-a0fb-534715f3d3a3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:45.118976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2038d74c-61d2-4918-a0fb-534715f3d3a3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:45.119790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2038d74c-61d2-4918-a0fb-534715f3d3a3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:45.120615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2038d74c-61d2-4918-a0fb-534715f3d3a3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:45.120908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2038d74c-61d2-4918-a0fb-534715f3d3a3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:45.723987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2038d74c-61d2-4918-a0fb-534715f3d3a3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:45.734281 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2038d74c-61d2-4918-a0fb-534715f3d3a3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.628092 Sep 10 10:45:45.735034 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1689/2195] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:45 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:45.760617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c30a85d9-5cd2-4c00-829d-23b5c4cd10f7 req-97d689af-0655-4fe9-b1d2-60195ebb555b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18610e7e-0f81-4038-abc9-9772929a13fe", "name": "network-vif-plugged", "status": "completed", "tag": "ff189d0a-d720-4fbe-8d12-7755848bd470"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:45.771771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c30a85d9-5cd2-4c00-829d-23b5c4cd10f7 req-97d689af-0655-4fe9-b1d2-60195ebb555b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:45.772266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c30a85d9-5cd2-4c00-829d-23b5c4cd10f7 req-97d689af-0655-4fe9-b1d2-60195ebb555b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:45.772806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c30a85d9-5cd2-4c00-829d-23b5c4cd10f7 req-97d689af-0655-4fe9-b1d2-60195ebb555b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:45.786481 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c30a85d9-5cd2-4c00-829d-23b5c4cd10f7 req-97d689af-0655-4fe9-b1d2-60195ebb555b service nova] Creating event network-vif-plugged:ff189d0a-d720-4fbe-8d12-7755848bd470 for instance 18610e7e-0f81-4038-abc9-9772929a13fe on n-h2-856894-1 Sep 10 10:45:45.793336 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c30a85d9-5cd2-4c00-829d-23b5c4cd10f7 req-97d689af-0655-4fe9-b1d2-60195ebb555b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037533 Sep 10 10:45:45.794158 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1690/2196] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:45.800415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-379431df-42ab-43fd-a401-162e333a7a74 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:45.801314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-379431df-42ab-43fd-a401-162e333a7a74 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:45.808775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-379431df-42ab-43fd-a401-162e333a7a74 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:45.809404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-379431df-42ab-43fd-a401-162e333a7a74 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:45.809805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-379431df-42ab-43fd-a401-162e333a7a74 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:45.810663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-379431df-42ab-43fd-a401-162e333a7a74 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:45.811217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-379431df-42ab-43fd-a401-162e333a7a74 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:45.811977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-379431df-42ab-43fd-a401-162e333a7a74 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:46.657424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-379431df-42ab-43fd-a401-162e333a7a74 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:46.666863 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-379431df-42ab-43fd-a401-162e333a7a74 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1369 microversion: 2.1 time: 0.870908 Sep 10 10:45:46.682633 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1691/2197] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:45 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1369 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:46.689576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50810fc3-0d21-46ab-88b3-46b15c4209e2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:46.697893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50810fc3-0d21-46ab-88b3-46b15c4209e2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:46.705213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50810fc3-0d21-46ab-88b3-46b15c4209e2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:46.705903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50810fc3-0d21-46ab-88b3-46b15c4209e2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:46.706504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50810fc3-0d21-46ab-88b3-46b15c4209e2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:46.707367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50810fc3-0d21-46ab-88b3-46b15c4209e2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:46.707959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50810fc3-0d21-46ab-88b3-46b15c4209e2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:46.708590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50810fc3-0d21-46ab-88b3-46b15c4209e2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:47.255275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50810fc3-0d21-46ab-88b3-46b15c4209e2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:47.264413 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50810fc3-0d21-46ab-88b3-46b15c4209e2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1325 microversion: 2.1 time: 0.580339 Sep 10 10:45:47.264988 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1692/2198] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:46 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1325 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:47.270361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:47.271196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 677f76e1-63ef-4c0a-806d-7c965e2fca1d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:47.277475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:47.277959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:47.278390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:47.279282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:47.279896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:47.280317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:47.296461 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] HTTP exception thrown: Instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d could not be found. Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Request method failure captured: Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d HTTP/1.1 Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkjVK2ZOmRVIPSrEr-Ye_0gUyEODKCdugm9a-s8uz52g6eXKFW6yjW0bBlpd5C05VHBUklnWpDq0KYbWL3nwKXXbXSfAKn6rkwfXTci8a5Sxjqj-SL6HNnpuSFx7xURL39B3fb3Sb9cfZvOv1Oh_DqO7hul8pvepuk9PG9hu8PRc8E Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: bb350b19a7254f0bbffb6e5b8dc2bbe3 Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-LiveMigrationTest-834273095 Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb350b19a7254f0bbffb6e5b8dc2bbe3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-LiveMigrationTest-834273095 Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: bb350b19a7254f0bbffb6e5b8dc2bbe3 Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-LiveMigrationTest-834273095 Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-LiveMigrationTest-834273095-project Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: a1013c609b044cb781dd1691909db7bf Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-LiveMigrationTest-834273095-project Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d could not be found. Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '677f76e1-63ef-4c0a-806d-7c965e2fca1d'} Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d could not be found. Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d could not be found. Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:47.298412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:47.303310 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:47.303310 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:47.303310 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:47.303310 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:45:47.303310 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:45:47.303310 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d could not be found. Sep 10 10:45:47.303310 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:47.303310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Returning 404 to user: Instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:47.303310 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eabe6b93-a176-472f-aea6-3589689af876 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d" status: 404 len: 111 microversion: 2.1 time: 0.033995 Sep 10 10:45:47.304679 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1693/2199] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:47 2022] GET /compute/v2.1/servers/677f76e1-63ef-4c0a-806d-7c965e2fca1d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:45:47.309135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e782910-0797-46f1-b5ca-cae50ea4e5dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:47.309741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e782910-0797-46f1-b5ca-cae50ea4e5dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:47.315553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e782910-0797-46f1-b5ca-cae50ea4e5dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:47.316072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e782910-0797-46f1-b5ca-cae50ea4e5dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:47.316516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e782910-0797-46f1-b5ca-cae50ea4e5dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:47.317220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e782910-0797-46f1-b5ca-cae50ea4e5dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:47.317698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e782910-0797-46f1-b5ca-cae50ea4e5dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:47.318132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e782910-0797-46f1-b5ca-cae50ea4e5dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:47.887253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e782910-0797-46f1-b5ca-cae50ea4e5dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:47.895599 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e782910-0797-46f1-b5ca-cae50ea4e5dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1314 microversion: 2.1 time: 0.590085 Sep 10 10:45:47.896296 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1694/2200] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:47 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:47.900725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3c7a01cf-9a10-4a42-8493-2f870462f124 req-5ac8b3f8-b539-492d-83b3-161c198c60e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f76e1-63ef-4c0a-806d-7c965e2fca1d", "name": "network-vif-deleted", "tag": "735d8dd5-9665-43f6-887a-972fb6ed4a3f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:47.926347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3c7a01cf-9a10-4a42-8493-2f870462f124 req-5ac8b3f8-b539-492d-83b3-161c198c60e2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:47.926829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3c7a01cf-9a10-4a42-8493-2f870462f124 req-5ac8b3f8-b539-492d-83b3-161c198c60e2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:47.927828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3c7a01cf-9a10-4a42-8493-2f870462f124 req-5ac8b3f8-b539-492d-83b3-161c198c60e2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:47.942957 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3c7a01cf-9a10-4a42-8493-2f870462f124 req-5ac8b3f8-b539-492d-83b3-161c198c60e2 service nova] Creating event network-vif-deleted:735d8dd5-9665-43f6-887a-972fb6ed4a3f for instance 677f76e1-63ef-4c0a-806d-7c965e2fca1d on n-h2-856894-1 Sep 10 10:45:47.949687 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3c7a01cf-9a10-4a42-8493-2f870462f124 req-5ac8b3f8-b539-492d-83b3-161c198c60e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051348 Sep 10 10:45:47.950324 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1695/2201] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:47.962281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cd605f2d-d8bb-49ef-a6ca-fb5d4c5a8995 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:47.963062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cd605f2d-d8bb-49ef-a6ca-fb5d4c5a8995 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:47.971891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd605f2d-d8bb-49ef-a6ca-fb5d4c5a8995 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:47.972384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd605f2d-d8bb-49ef-a6ca-fb5d4c5a8995 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:47.972824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd605f2d-d8bb-49ef-a6ca-fb5d4c5a8995 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:47.973583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd605f2d-d8bb-49ef-a6ca-fb5d4c5a8995 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:47.974621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd605f2d-d8bb-49ef-a6ca-fb5d4c5a8995 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:47.975044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd605f2d-d8bb-49ef-a6ca-fb5d4c5a8995 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:48.688985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cd605f2d-d8bb-49ef-a6ca-fb5d4c5a8995 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:48.697960 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cd605f2d-d8bb-49ef-a6ca-fb5d4c5a8995 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.746315 Sep 10 10:45:48.709951 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1696/2202] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:47 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:48.721137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfe8ee52-3c1e-4de7-9554-a52639f59376 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:48.721896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfe8ee52-3c1e-4de7-9554-a52639f59376 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:48.728730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe8ee52-3c1e-4de7-9554-a52639f59376 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:48.729476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe8ee52-3c1e-4de7-9554-a52639f59376 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:48.730076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe8ee52-3c1e-4de7-9554-a52639f59376 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:48.730972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe8ee52-3c1e-4de7-9554-a52639f59376 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:48.731605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe8ee52-3c1e-4de7-9554-a52639f59376 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:48.732507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfe8ee52-3c1e-4de7-9554-a52639f59376 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:48.763701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfe8ee52-3c1e-4de7-9554-a52639f59376 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:45:48.859912 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfe8ee52-3c1e-4de7-9554-a52639f59376 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 204 len: 0 microversion: 2.1 time: 0.148485 Sep 10 10:45:48.860519 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1697/2203] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:45:48 2022] DELETE /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:45:48.866191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73ef6d4a-6707-420f-9373-fb0b5d298f8e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:48.866909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73ef6d4a-6707-420f-9373-fb0b5d298f8e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:48.872876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73ef6d4a-6707-420f-9373-fb0b5d298f8e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:48.873603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73ef6d4a-6707-420f-9373-fb0b5d298f8e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:48.874207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73ef6d4a-6707-420f-9373-fb0b5d298f8e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:48.875078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73ef6d4a-6707-420f-9373-fb0b5d298f8e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:48.875693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73ef6d4a-6707-420f-9373-fb0b5d298f8e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:48.876280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73ef6d4a-6707-420f-9373-fb0b5d298f8e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:49.412841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73ef6d4a-6707-420f-9373-fb0b5d298f8e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:49.420658 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73ef6d4a-6707-420f-9373-fb0b5d298f8e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1369 microversion: 2.1 time: 0.558824 Sep 10 10:45:49.421277 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1698/2204] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:48 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1369 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:49.425704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1cb91ed8-fffe-4fc8-9fda-04e12df8ec3c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:49.426328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1cb91ed8-fffe-4fc8-9fda-04e12df8ec3c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:49.432112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb91ed8-fffe-4fc8-9fda-04e12df8ec3c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:49.432602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb91ed8-fffe-4fc8-9fda-04e12df8ec3c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:49.433041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb91ed8-fffe-4fc8-9fda-04e12df8ec3c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:49.433766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb91ed8-fffe-4fc8-9fda-04e12df8ec3c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:49.434223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb91ed8-fffe-4fc8-9fda-04e12df8ec3c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:49.434648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1cb91ed8-fffe-4fc8-9fda-04e12df8ec3c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:49.964167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1cb91ed8-fffe-4fc8-9fda-04e12df8ec3c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:49.974647 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1cb91ed8-fffe-4fc8-9fda-04e12df8ec3c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1325 microversion: 2.1 time: 0.551692 Sep 10 10:45:49.975541 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1699/2205] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:49 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1325 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:49.980478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-863af949-dbb2-4666-9dd0-ec5231ce6fde tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:49.981383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-863af949-dbb2-4666-9dd0-ec5231ce6fde tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:49.987364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863af949-dbb2-4666-9dd0-ec5231ce6fde tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:49.988070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863af949-dbb2-4666-9dd0-ec5231ce6fde tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:49.988668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863af949-dbb2-4666-9dd0-ec5231ce6fde tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:49.989403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863af949-dbb2-4666-9dd0-ec5231ce6fde tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:49.990390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863af949-dbb2-4666-9dd0-ec5231ce6fde tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:49.990809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863af949-dbb2-4666-9dd0-ec5231ce6fde tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:50.718263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-863af949-dbb2-4666-9dd0-ec5231ce6fde tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1013c609b044cb781dd1691909db7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb350b19a7254f0bbffb6e5b8dc2bbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:50.730607 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-863af949-dbb2-4666-9dd0-ec5231ce6fde tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 200 len: 1500 microversion: 2.1 time: 0.753809 Sep 10 10:45:50.731249 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1700/2206] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:49 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 1500 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:50.744429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d316096d-79f0-414b-ac26-f65aaa841d7a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:50.745106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d316096d-79f0-414b-ac26-f65aaa841d7a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:50.753647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d316096d-79f0-414b-ac26-f65aaa841d7a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:50.754385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d316096d-79f0-414b-ac26-f65aaa841d7a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:50.754990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d316096d-79f0-414b-ac26-f65aaa841d7a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:50.756396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d316096d-79f0-414b-ac26-f65aaa841d7a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:50.757047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d316096d-79f0-414b-ac26-f65aaa841d7a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:50.757701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d316096d-79f0-414b-ac26-f65aaa841d7a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:50.882409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=10 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:50.907904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=28 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:51.059634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d316096d-79f0-414b-ac26-f65aaa841d7a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:51.076671 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d316096d-79f0-414b-ac26-f65aaa841d7a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1501 microversion: 2.1 time: 0.344143 Sep 10 10:45:51.080602 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1701/2207] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:50 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1501 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:51.098745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b01c15cf-3a70-4c6a-a5c3-7a0dc395abac req-3b699669-0c0e-4333-8973-4b6667e50ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adc3f2b0-25a8-42f2-b97b-84024a960024", "tag": "bf36f825-d938-49a9-92d5-e4b309dc9e8c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:51.142953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b01c15cf-3a70-4c6a-a5c3-7a0dc395abac req-3b699669-0c0e-4333-8973-4b6667e50ed7 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:51.143624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b01c15cf-3a70-4c6a-a5c3-7a0dc395abac req-3b699669-0c0e-4333-8973-4b6667e50ed7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:51.144397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b01c15cf-3a70-4c6a-a5c3-7a0dc395abac req-3b699669-0c0e-4333-8973-4b6667e50ed7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:51.163197 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b01c15cf-3a70-4c6a-a5c3-7a0dc395abac req-3b699669-0c0e-4333-8973-4b6667e50ed7 service nova] Creating event network-changed:bf36f825-d938-49a9-92d5-e4b309dc9e8c for instance adc3f2b0-25a8-42f2-b97b-84024a960024 on n-h2-856894-1 Sep 10 10:45:51.169313 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b01c15cf-3a70-4c6a-a5c3-7a0dc395abac req-3b699669-0c0e-4333-8973-4b6667e50ed7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086428 Sep 10 10:45:51.170046 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1702/2208] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:51.179842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f576e99-15f0-4f6f-a455-87fe6a554ddd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:51.180821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f576e99-15f0-4f6f-a455-87fe6a554ddd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:51.189265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f576e99-15f0-4f6f-a455-87fe6a554ddd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:51.190040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f576e99-15f0-4f6f-a455-87fe6a554ddd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:51.190641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f576e99-15f0-4f6f-a455-87fe6a554ddd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:51.191554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f576e99-15f0-4f6f-a455-87fe6a554ddd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:51.194085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f576e99-15f0-4f6f-a455-87fe6a554ddd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:51.194702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f576e99-15f0-4f6f-a455-87fe6a554ddd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:51.384677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f576e99-15f0-4f6f-a455-87fe6a554ddd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:51.399551 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f576e99-15f0-4f6f-a455-87fe6a554ddd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.222080 Sep 10 10:45:51.401372 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1703/2209] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:51 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:51.406962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-cf7a1651-b3a4-4578-8a43-712177facdac req-5ee4086c-3588-439c-94aa-e8c1a8d3d4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47a8a03-72e3-4db7-8e43-a1992a5f6ece", "name": "network-vif-plugged", "status": "completed", "tag": "d82ae4f2-aa8d-42e7-9522-1732c70f4f3a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:51.418391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf7a1651-b3a4-4578-8a43-712177facdac req-5ee4086c-3588-439c-94aa-e8c1a8d3d4f1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:51.418880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf7a1651-b3a4-4578-8a43-712177facdac req-5ee4086c-3588-439c-94aa-e8c1a8d3d4f1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:51.419320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf7a1651-b3a4-4578-8a43-712177facdac req-5ee4086c-3588-439c-94aa-e8c1a8d3d4f1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:51.431463 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-cf7a1651-b3a4-4578-8a43-712177facdac req-5ee4086c-3588-439c-94aa-e8c1a8d3d4f1 service nova] Creating event network-vif-plugged:d82ae4f2-aa8d-42e7-9522-1732c70f4f3a for instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece on n-h2-856894-1 Sep 10 10:45:51.439827 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-cf7a1651-b3a4-4578-8a43-712177facdac req-5ee4086c-3588-439c-94aa-e8c1a8d3d4f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037100 Sep 10 10:45:51.444752 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1704/2210] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:51.452521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e0e86f7-ad14-4100-a150-8585df59f02a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:51.453280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e0e86f7-ad14-4100-a150-8585df59f02a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:51.462444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0e86f7-ad14-4100-a150-8585df59f02a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:51.462949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0e86f7-ad14-4100-a150-8585df59f02a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:51.463477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0e86f7-ad14-4100-a150-8585df59f02a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:51.464784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0e86f7-ad14-4100-a150-8585df59f02a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:51.465164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0e86f7-ad14-4100-a150-8585df59f02a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:51.465653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e0e86f7-ad14-4100-a150-8585df59f02a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:51.623889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e0e86f7-ad14-4100-a150-8585df59f02a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:51.632938 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e0e86f7-ad14-4100-a150-8585df59f02a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1369 microversion: 2.1 time: 0.185790 Sep 10 10:45:51.633733 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1705/2211] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:51 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:51.638729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a7dc9191-4393-4f76-b06f-b0f7ba5dd40b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:51.639354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a7dc9191-4393-4f76-b06f-b0f7ba5dd40b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:51.646292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7dc9191-4393-4f76-b06f-b0f7ba5dd40b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:51.646783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7dc9191-4393-4f76-b06f-b0f7ba5dd40b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:51.647298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7dc9191-4393-4f76-b06f-b0f7ba5dd40b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:51.647932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7dc9191-4393-4f76-b06f-b0f7ba5dd40b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:51.648391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7dc9191-4393-4f76-b06f-b0f7ba5dd40b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:51.648849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7dc9191-4393-4f76-b06f-b0f7ba5dd40b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:51.652046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:51.897032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a7dc9191-4393-4f76-b06f-b0f7ba5dd40b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:51.906015 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a7dc9191-4393-4f76-b06f-b0f7ba5dd40b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1325 microversion: 2.1 time: 0.271195 Sep 10 10:45:51.906905 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1706/2212] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:51 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:51.922141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-18b090ab-7992-4789-9f9e-da38506e4bfc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:51.922141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18b090ab-7992-4789-9f9e-da38506e4bfc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:51.922141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18b090ab-7992-4789-9f9e-da38506e4bfc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:51.922141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18b090ab-7992-4789-9f9e-da38506e4bfc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:51.950125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-18b090ab-7992-4789-9f9e-da38506e4bfc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Going to try to stop instance {{(pid=128788) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 10:45:52.006845 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-18b090ab-7992-4789-9f9e-da38506e4bfc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe/action" status: 202 len: 0 microversion: 2.1 time: 0.097786 Sep 10 10:45:52.010739 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1707/2213] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:45:51 2022] POST /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:45:52.032524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:52.033458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] [instance: 5751da7d-3075-4105-9e33-9b923dff4ca2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:52.047177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:52.048078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:52.048625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:52.049479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:52.050046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:52.051256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:52.070509 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] HTTP exception thrown: Instance 5751da7d-3075-4105-9e33-9b923dff4ca2 could not be found. Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Request method failure captured: Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 HTTP/1.1 Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGkjVK2ZOmRVIPSrEr-Ye_0gUyEODKCdugm9a-s8uz52g6eXKFW6yjW0bBlpd5C05VHBUklnWpDq0KYbWL3nwKXXbXSfAKn6rkwfXTci8a5Sxjqj-SL6HNnpuSFx7xURL39B3fb3Sb9cfZvOv1Oh_DqO7hul8pvepuk9PG9hu8PRc8E Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: bb350b19a7254f0bbffb6e5b8dc2bbe3 Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-LiveMigrationTest-834273095 Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb350b19a7254f0bbffb6e5b8dc2bbe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb350b19a7254f0bbffb6e5b8dc2bbe3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-LiveMigrationTest-834273095 Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: bb350b19a7254f0bbffb6e5b8dc2bbe3 Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-LiveMigrationTest-834273095 Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-LiveMigrationTest-834273095-project Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: a1013c609b044cb781dd1691909db7bf Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-LiveMigrationTest-834273095-project Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 5751da7d-3075-4105-9e33-9b923dff4ca2 could not be found. Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '5751da7d-3075-4105-9e33-9b923dff4ca2'} Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5751da7d-3075-4105-9e33-9b923dff4ca2 could not be found. Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5751da7d-3075-4105-9e33-9b923dff4ca2 could not be found. Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:45:52.074938 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:52.079174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:45:52.079174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:45:52.079174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:45:52.079174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:45:52.079174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:45:52.079174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5751da7d-3075-4105-9e33-9b923dff4ca2 could not be found. Sep 10 10:45:52.079174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:45:52.079174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] Returning 404 to user: Instance 5751da7d-3075-4105-9e33-9b923dff4ca2 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:45:52.079174 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10946043-b3d7-4f06-9871-ba648df1cb30 tempest-LiveMigrationTest-834273095 tempest-LiveMigrationTest-834273095-project] 10.222.0.20 "GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2" status: 404 len: 111 microversion: 2.1 time: 0.064311 Sep 10 10:45:52.079174 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1708/2214] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:52 2022] GET /compute/v2.1/servers/5751da7d-3075-4105-9e33-9b923dff4ca2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:45:52.086301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d51df155-a224-49eb-aeef-a216f3a8e6e3 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:52.087072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d51df155-a224-49eb-aeef-a216f3a8e6e3 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:52.096458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d51df155-a224-49eb-aeef-a216f3a8e6e3 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:52.097064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d51df155-a224-49eb-aeef-a216f3a8e6e3 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:52.097666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d51df155-a224-49eb-aeef-a216f3a8e6e3 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:52.098489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d51df155-a224-49eb-aeef-a216f3a8e6e3 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:52.100030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d51df155-a224-49eb-aeef-a216f3a8e6e3 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:52.100579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d51df155-a224-49eb-aeef-a216f3a8e6e3 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:52.571706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d51df155-a224-49eb-aeef-a216f3a8e6e3 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:52.585018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d51df155-a224-49eb-aeef-a216f3a8e6e3 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.506826 Sep 10 10:45:52.594537 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1709/2215] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:52 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:52.602364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23d74a34-33f0-4335-84f6-da52652810d2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:52.603617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23d74a34-33f0-4335-84f6-da52652810d2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:52.611892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d74a34-33f0-4335-84f6-da52652810d2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:52.613257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d74a34-33f0-4335-84f6-da52652810d2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:52.613787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d74a34-33f0-4335-84f6-da52652810d2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:52.615187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d74a34-33f0-4335-84f6-da52652810d2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:52.615677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d74a34-33f0-4335-84f6-da52652810d2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:52.616110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d74a34-33f0-4335-84f6-da52652810d2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:53.015404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23d74a34-33f0-4335-84f6-da52652810d2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:53.027873 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23d74a34-33f0-4335-84f6-da52652810d2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.429623 Sep 10 10:45:53.045862 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1710/2216] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:52 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:53.051415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c79a5b7-8e1b-454d-aad5-82d42750d4bc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:53.052042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c79a5b7-8e1b-454d-aad5-82d42750d4bc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:53.058461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c79a5b7-8e1b-454d-aad5-82d42750d4bc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:53.058954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c79a5b7-8e1b-454d-aad5-82d42750d4bc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:53.059399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c79a5b7-8e1b-454d-aad5-82d42750d4bc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:53.060192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c79a5b7-8e1b-454d-aad5-82d42750d4bc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:53.060661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c79a5b7-8e1b-454d-aad5-82d42750d4bc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:53.061173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c79a5b7-8e1b-454d-aad5-82d42750d4bc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:53.387265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9c79a5b7-8e1b-454d-aad5-82d42750d4bc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:53.401530 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c79a5b7-8e1b-454d-aad5-82d42750d4bc tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1369 microversion: 2.1 time: 0.353652 Sep 10 10:45:53.417097 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1711/2217] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:53 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1369 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:53.417097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a2f26714-5892-456a-b37c-8567c066ade8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:53.418225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a2f26714-5892-456a-b37c-8567c066ade8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:53.431749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2f26714-5892-456a-b37c-8567c066ade8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:53.432674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2f26714-5892-456a-b37c-8567c066ade8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:53.433462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2f26714-5892-456a-b37c-8567c066ade8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:53.434237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2f26714-5892-456a-b37c-8567c066ade8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:53.435453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2f26714-5892-456a-b37c-8567c066ade8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:53.435995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2f26714-5892-456a-b37c-8567c066ade8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:53.683601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a2f26714-5892-456a-b37c-8567c066ade8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:53.705093 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a2f26714-5892-456a-b37c-8567c066ade8 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1325 microversion: 2.1 time: 0.297002 Sep 10 10:45:53.724276 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1712/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:53 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:53.724276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-20f8793e-59c2-436a-a108-251cc9da833a req-0711cc2f-0ddd-4f5a-9412-80d617aa684a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5751da7d-3075-4105-9e33-9b923dff4ca2", "name": "network-vif-deleted", "tag": "03bced10-8ebd-4323-9fca-0c8b0be79660"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:53.739326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-20f8793e-59c2-436a-a108-251cc9da833a req-0711cc2f-0ddd-4f5a-9412-80d617aa684a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:53.740776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-20f8793e-59c2-436a-a108-251cc9da833a req-0711cc2f-0ddd-4f5a-9412-80d617aa684a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:53.741392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-20f8793e-59c2-436a-a108-251cc9da833a req-0711cc2f-0ddd-4f5a-9412-80d617aa684a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:53.761368 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-20f8793e-59c2-436a-a108-251cc9da833a req-0711cc2f-0ddd-4f5a-9412-80d617aa684a service nova] Creating event network-vif-deleted:03bced10-8ebd-4323-9fca-0c8b0be79660 for instance 5751da7d-3075-4105-9e33-9b923dff4ca2 on n-h1-856894-1 Sep 10 10:45:53.767442 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-20f8793e-59c2-436a-a108-251cc9da833a req-0711cc2f-0ddd-4f5a-9412-80d617aa684a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057029 Sep 10 10:45:53.768587 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1713/2219] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:53.774098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e4de30f-7baf-4346-bde3-789e788f99fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:53.775735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e4de30f-7baf-4346-bde3-789e788f99fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:53.783706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e4de30f-7baf-4346-bde3-789e788f99fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:53.784455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e4de30f-7baf-4346-bde3-789e788f99fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:53.795927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e4de30f-7baf-4346-bde3-789e788f99fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:53.797244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e4de30f-7baf-4346-bde3-789e788f99fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:53.798445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e4de30f-7baf-4346-bde3-789e788f99fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:53.798445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e4de30f-7baf-4346-bde3-789e788f99fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:54.353135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e4de30f-7baf-4346-bde3-789e788f99fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:54.366291 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e4de30f-7baf-4346-bde3-789e788f99fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.596244 Sep 10 10:45:54.370931 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1714/2220] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:53 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:54.383562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1132d568-737f-44db-825d-fc4256b84903 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:54.405763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1132d568-737f-44db-825d-fc4256b84903 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:54.420714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1132d568-737f-44db-825d-fc4256b84903 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:54.426055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1132d568-737f-44db-825d-fc4256b84903 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:54.426786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1132d568-737f-44db-825d-fc4256b84903 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:54.429846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1132d568-737f-44db-825d-fc4256b84903 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:54.430566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1132d568-737f-44db-825d-fc4256b84903 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:54.432196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1132d568-737f-44db-825d-fc4256b84903 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:54.800758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1132d568-737f-44db-825d-fc4256b84903 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:54.812280 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1132d568-737f-44db-825d-fc4256b84903 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.439893 Sep 10 10:45:54.828213 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1715/2221] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:54 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:54.834756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-31535d0b-69ad-4361-bd1c-3ccef604e464 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:54.835667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-31535d0b-69ad-4361-bd1c-3ccef604e464 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:54.842842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31535d0b-69ad-4361-bd1c-3ccef604e464 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:54.844909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31535d0b-69ad-4361-bd1c-3ccef604e464 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:54.845696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31535d0b-69ad-4361-bd1c-3ccef604e464 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:54.846631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31535d0b-69ad-4361-bd1c-3ccef604e464 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:54.847314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31535d0b-69ad-4361-bd1c-3ccef604e464 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:54.847995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31535d0b-69ad-4361-bd1c-3ccef604e464 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:55.199245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-31535d0b-69ad-4361-bd1c-3ccef604e464 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:55.207469 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-31535d0b-69ad-4361-bd1c-3ccef604e464 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1564 microversion: 2.1 time: 0.377671 Sep 10 10:45:55.208307 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1716/2222] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:54 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1564 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:55.229953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-872f7235-6172-4128-afd1-0ceab73527a2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:55.230957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-872f7235-6172-4128-afd1-0ceab73527a2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:55.238458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872f7235-6172-4128-afd1-0ceab73527a2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:55.239252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872f7235-6172-4128-afd1-0ceab73527a2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:55.240499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872f7235-6172-4128-afd1-0ceab73527a2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:55.241441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872f7235-6172-4128-afd1-0ceab73527a2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:55.242062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872f7235-6172-4128-afd1-0ceab73527a2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:55.242491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872f7235-6172-4128-afd1-0ceab73527a2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:55.506082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-872f7235-6172-4128-afd1-0ceab73527a2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:55.516753 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-872f7235-6172-4128-afd1-0ceab73527a2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1325 microversion: 2.1 time: 0.307079 Sep 10 10:45:55.518512 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1717/2223] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:55 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1325 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:55.537040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52342ef7-b64a-4930-bd60-227e2c7f8ede tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:55.538110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-52342ef7-b64a-4930-bd60-227e2c7f8ede tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:55.546419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52342ef7-b64a-4930-bd60-227e2c7f8ede tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:55.546960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52342ef7-b64a-4930-bd60-227e2c7f8ede tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:55.547387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52342ef7-b64a-4930-bd60-227e2c7f8ede tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:55.548224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52342ef7-b64a-4930-bd60-227e2c7f8ede tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:55.548677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52342ef7-b64a-4930-bd60-227e2c7f8ede tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:55.549114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52342ef7-b64a-4930-bd60-227e2c7f8ede tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:55.678299 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-52342ef7-b64a-4930-bd60-227e2c7f8ede tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150813 Sep 10 10:45:55.680215 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1718/2224] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:45:55 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:55.700930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4eee9b57-ceba-49af-9866-ed47dbdb0d0d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:55.702609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4eee9b57-ceba-49af-9866-ed47dbdb0d0d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:55.710597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eee9b57-ceba-49af-9866-ed47dbdb0d0d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:55.711316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eee9b57-ceba-49af-9866-ed47dbdb0d0d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:55.712629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eee9b57-ceba-49af-9866-ed47dbdb0d0d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:55.715566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eee9b57-ceba-49af-9866-ed47dbdb0d0d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:55.716204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eee9b57-ceba-49af-9866-ed47dbdb0d0d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:55.716791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eee9b57-ceba-49af-9866-ed47dbdb0d0d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:56.048066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4eee9b57-ceba-49af-9866-ed47dbdb0d0d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:56.059466 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4eee9b57-ceba-49af-9866-ed47dbdb0d0d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.377880 Sep 10 10:45:56.074755 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1719/2225] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:55 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:56.079008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e204697-f8d7-40c6-a1f5-b7c7d604aece tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:56.079644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e204697-f8d7-40c6-a1f5-b7c7d604aece tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:56.085365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:56.086869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e204697-f8d7-40c6-a1f5-b7c7d604aece tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:56.088096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e204697-f8d7-40c6-a1f5-b7c7d604aece tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:56.088096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e204697-f8d7-40c6-a1f5-b7c7d604aece tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:56.088523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e204697-f8d7-40c6-a1f5-b7c7d604aece tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:56.088995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e204697-f8d7-40c6-a1f5-b7c7d604aece tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:56.089453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e204697-f8d7-40c6-a1f5-b7c7d604aece tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:56.648848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e204697-f8d7-40c6-a1f5-b7c7d604aece tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:56.659271 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e204697-f8d7-40c6-a1f5-b7c7d604aece tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.598124 Sep 10 10:45:56.664491 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1720/2226] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:56 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:56.679731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5608a776-0700-4415-a17c-9ca0ad954a96 req-ec53f22f-a716-4fdc-a6f9-bffd98761a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc3f2b0-25a8-42f2-b97b-84024a960024", "name": "network-vif-plugged", "status": "completed", "tag": "bf36f825-d938-49a9-92d5-e4b309dc9e8c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:56.702438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5608a776-0700-4415-a17c-9ca0ad954a96 req-ec53f22f-a716-4fdc-a6f9-bffd98761a0a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:56.703036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5608a776-0700-4415-a17c-9ca0ad954a96 req-ec53f22f-a716-4fdc-a6f9-bffd98761a0a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:56.703566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5608a776-0700-4415-a17c-9ca0ad954a96 req-ec53f22f-a716-4fdc-a6f9-bffd98761a0a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:56.739280 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5608a776-0700-4415-a17c-9ca0ad954a96 req-ec53f22f-a716-4fdc-a6f9-bffd98761a0a service nova] Creating event network-vif-plugged:bf36f825-d938-49a9-92d5-e4b309dc9e8c for instance adc3f2b0-25a8-42f2-b97b-84024a960024 on n-h2-856894-1 Sep 10 10:45:56.756888 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5608a776-0700-4415-a17c-9ca0ad954a96 req-ec53f22f-a716-4fdc-a6f9-bffd98761a0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086993 Sep 10 10:45:56.758085 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1721/2227] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:56.769059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-391f1ddd-3844-4bc4-b678-20233ccdf6ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:56.770316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-391f1ddd-3844-4bc4-b678-20233ccdf6ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:56.778791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-391f1ddd-3844-4bc4-b678-20233ccdf6ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:56.779896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-391f1ddd-3844-4bc4-b678-20233ccdf6ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:56.780555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-391f1ddd-3844-4bc4-b678-20233ccdf6ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:56.781756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-391f1ddd-3844-4bc4-b678-20233ccdf6ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:56.782448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-391f1ddd-3844-4bc4-b678-20233ccdf6ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:56.783101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-391f1ddd-3844-4bc4-b678-20233ccdf6ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:57.251673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-391f1ddd-3844-4bc4-b678-20233ccdf6ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:57.279201 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-391f1ddd-3844-4bc4-b678-20233ccdf6ae tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1325 microversion: 2.1 time: 0.519236 Sep 10 10:45:57.296235 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1722/2228] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:56 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1325 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:57.304500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc2cead6-7afe-4b28-8b5a-71826d896846 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:57.305482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc2cead6-7afe-4b28-8b5a-71826d896846 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:57.316858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cead6-7afe-4b28-8b5a-71826d896846 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:57.320106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cead6-7afe-4b28-8b5a-71826d896846 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:57.321383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cead6-7afe-4b28-8b5a-71826d896846 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:57.322362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cead6-7afe-4b28-8b5a-71826d896846 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:57.323476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cead6-7afe-4b28-8b5a-71826d896846 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:57.324164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cead6-7afe-4b28-8b5a-71826d896846 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:57.675903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc2cead6-7afe-4b28-8b5a-71826d896846 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:57.695094 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc2cead6-7afe-4b28-8b5a-71826d896846 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.396220 Sep 10 10:45:57.695620 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1723/2229] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:57 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:57.701359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-15acf705-272c-4b57-92f0-133983dccb83 req-d16723b5-537e-4236-8806-fc3e04525404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47a8a03-72e3-4db7-8e43-a1992a5f6ece", "tag": "d82ae4f2-aa8d-42e7-9522-1732c70f4f3a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:45:57.712663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-15acf705-272c-4b57-92f0-133983dccb83 req-d16723b5-537e-4236-8806-fc3e04525404 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:57.713179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-15acf705-272c-4b57-92f0-133983dccb83 req-d16723b5-537e-4236-8806-fc3e04525404 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:57.713607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-15acf705-272c-4b57-92f0-133983dccb83 req-d16723b5-537e-4236-8806-fc3e04525404 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:57.718459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:45:57.729213 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-15acf705-272c-4b57-92f0-133983dccb83 req-d16723b5-537e-4236-8806-fc3e04525404 service nova] Creating event network-changed:d82ae4f2-aa8d-42e7-9522-1732c70f4f3a for instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece on n-h2-856894-1 Sep 10 10:45:57.740780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-15acf705-272c-4b57-92f0-133983dccb83 req-d16723b5-537e-4236-8806-fc3e04525404 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043128 Sep 10 10:45:57.742323 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1724/2230] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:45:57.754519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc4a58ee-dd63-4fc0-ba9e-17e982ec11f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:57.755798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fc4a58ee-dd63-4fc0-ba9e-17e982ec11f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:57.762813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4a58ee-dd63-4fc0-ba9e-17e982ec11f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:57.763542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4a58ee-dd63-4fc0-ba9e-17e982ec11f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:57.764420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4a58ee-dd63-4fc0-ba9e-17e982ec11f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:57.765378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4a58ee-dd63-4fc0-ba9e-17e982ec11f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:57.766018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4a58ee-dd63-4fc0-ba9e-17e982ec11f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:57.766735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc4a58ee-dd63-4fc0-ba9e-17e982ec11f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:57.916854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fc4a58ee-dd63-4fc0-ba9e-17e982ec11f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:57.928054 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc4a58ee-dd63-4fc0-ba9e-17e982ec11f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1477 microversion: 2.1 time: 0.183537 Sep 10 10:45:57.928823 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1725/2231] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:57 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1477 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:58.304033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a839438e-a3cf-4a62-bc80-61e053867e88 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:58.304950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a839438e-a3cf-4a62-bc80-61e053867e88 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:58.314148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a839438e-a3cf-4a62-bc80-61e053867e88 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:58.314887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a839438e-a3cf-4a62-bc80-61e053867e88 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:58.315520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a839438e-a3cf-4a62-bc80-61e053867e88 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:58.316626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a839438e-a3cf-4a62-bc80-61e053867e88 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:58.318962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a839438e-a3cf-4a62-bc80-61e053867e88 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:58.319529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a839438e-a3cf-4a62-bc80-61e053867e88 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:58.672259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a839438e-a3cf-4a62-bc80-61e053867e88 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:58.687580 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a839438e-a3cf-4a62-bc80-61e053867e88 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1325 microversion: 2.1 time: 0.387872 Sep 10 10:45:58.689401 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1726/2232] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:58 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1325 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:45:58.720427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bda272c8-3b2b-4b7e-821c-64cffbf6e815 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:58.720959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bda272c8-3b2b-4b7e-821c-64cffbf6e815 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:58.731730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bda272c8-3b2b-4b7e-821c-64cffbf6e815 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:58.732702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bda272c8-3b2b-4b7e-821c-64cffbf6e815 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:58.734644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bda272c8-3b2b-4b7e-821c-64cffbf6e815 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:58.735541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bda272c8-3b2b-4b7e-821c-64cffbf6e815 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:58.737271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bda272c8-3b2b-4b7e-821c-64cffbf6e815 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:58.738019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bda272c8-3b2b-4b7e-821c-64cffbf6e815 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:59.095393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bda272c8-3b2b-4b7e-821c-64cffbf6e815 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:59.109779 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bda272c8-3b2b-4b7e-821c-64cffbf6e815 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.390270 Sep 10 10:45:59.111272 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1727/2233] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:58 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:45:59.131605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db70fb7d-4eb5-42cf-a64e-89dd02c19d13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:59.132483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db70fb7d-4eb5-42cf-a64e-89dd02c19d13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:59.144417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db70fb7d-4eb5-42cf-a64e-89dd02c19d13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:59.145942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db70fb7d-4eb5-42cf-a64e-89dd02c19d13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:59.146653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db70fb7d-4eb5-42cf-a64e-89dd02c19d13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:59.148375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db70fb7d-4eb5-42cf-a64e-89dd02c19d13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:59.150220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db70fb7d-4eb5-42cf-a64e-89dd02c19d13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:59.150758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db70fb7d-4eb5-42cf-a64e-89dd02c19d13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:59.678354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-db70fb7d-4eb5-42cf-a64e-89dd02c19d13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:45:59.693550 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db70fb7d-4eb5-42cf-a64e-89dd02c19d13 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1476 microversion: 2.1 time: 0.580823 Sep 10 10:45:59.707056 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1728/2234] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:59 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1476 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:45:59.721636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a785b9ea-d3f1-47e2-b162-1d024a8f6de7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:45:59.722682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a785b9ea-d3f1-47e2-b162-1d024a8f6de7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:45:59.738630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a785b9ea-d3f1-47e2-b162-1d024a8f6de7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:59.739516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a785b9ea-d3f1-47e2-b162-1d024a8f6de7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:59.740675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a785b9ea-d3f1-47e2-b162-1d024a8f6de7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:45:59.741665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a785b9ea-d3f1-47e2-b162-1d024a8f6de7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:45:59.742335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a785b9ea-d3f1-47e2-b162-1d024a8f6de7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:45:59.742976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a785b9ea-d3f1-47e2-b162-1d024a8f6de7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:00.397972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a785b9ea-d3f1-47e2-b162-1d024a8f6de7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:00.412642 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a785b9ea-d3f1-47e2-b162-1d024a8f6de7 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1522 microversion: 2.1 time: 0.704343 Sep 10 10:46:00.413301 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1729/2235] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:45:59 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1522 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:00.433536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30f2b6ec-a539-4db5-91a0-720efffdc347 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:00.434173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30f2b6ec-a539-4db5-91a0-720efffdc347 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:00.441675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f2b6ec-a539-4db5-91a0-720efffdc347 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:00.442642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f2b6ec-a539-4db5-91a0-720efffdc347 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:00.443223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f2b6ec-a539-4db5-91a0-720efffdc347 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:00.443990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f2b6ec-a539-4db5-91a0-720efffdc347 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:00.444556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f2b6ec-a539-4db5-91a0-720efffdc347 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:00.444986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f2b6ec-a539-4db5-91a0-720efffdc347 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:01.211425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30f2b6ec-a539-4db5-91a0-720efffdc347 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:01.222516 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30f2b6ec-a539-4db5-91a0-720efffdc347 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.795317 Sep 10 10:46:01.237102 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1730/2236] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:00 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:01.237102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57b83b1c-ebeb-4b73-a54e-9b0a20ddb6ee tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:01.237102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57b83b1c-ebeb-4b73-a54e-9b0a20ddb6ee tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:01.237102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57b83b1c-ebeb-4b73-a54e-9b0a20ddb6ee tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:01.237546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57b83b1c-ebeb-4b73-a54e-9b0a20ddb6ee tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:01.239887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57b83b1c-ebeb-4b73-a54e-9b0a20ddb6ee tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:01.242205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57b83b1c-ebeb-4b73-a54e-9b0a20ddb6ee tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:01.243956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57b83b1c-ebeb-4b73-a54e-9b0a20ddb6ee tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:01.245496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57b83b1c-ebeb-4b73-a54e-9b0a20ddb6ee tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:01.593852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-57b83b1c-ebeb-4b73-a54e-9b0a20ddb6ee tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:01.605658 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57b83b1c-ebeb-4b73-a54e-9b0a20ddb6ee tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1522 microversion: 2.1 time: 0.377674 Sep 10 10:46:01.622298 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1731/2237] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:01 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:01.632433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3dd2d76d-4a57-4f5a-90ea-8b8b21338f66 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:01.633334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3dd2d76d-4a57-4f5a-90ea-8b8b21338f66 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:01.639915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd2d76d-4a57-4f5a-90ea-8b8b21338f66 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:01.640737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd2d76d-4a57-4f5a-90ea-8b8b21338f66 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:01.644075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd2d76d-4a57-4f5a-90ea-8b8b21338f66 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:01.646612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd2d76d-4a57-4f5a-90ea-8b8b21338f66 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:01.647307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd2d76d-4a57-4f5a-90ea-8b8b21338f66 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:01.647975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd2d76d-4a57-4f5a-90ea-8b8b21338f66 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:01.958705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3dd2d76d-4a57-4f5a-90ea-8b8b21338f66 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:01.966598 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3dd2d76d-4a57-4f5a-90ea-8b8b21338f66 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1476 microversion: 2.1 time: 0.342789 Sep 10 10:46:01.967191 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1732/2238] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:01 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1476 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:01.972624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-13a5baea-742a-4a4d-9af7-d89fbd2c4777 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1555610871"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:01.976732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-13a5baea-742a-4a4d-9af7-d89fbd2c4777 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:01.984020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13a5baea-742a-4a4d-9af7-d89fbd2c4777 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:01.984808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13a5baea-742a-4a4d-9af7-d89fbd2c4777 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:01.985476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13a5baea-742a-4a4d-9af7-d89fbd2c4777 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:01.987030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13a5baea-742a-4a4d-9af7-d89fbd2c4777 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:01.987761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13a5baea-742a-4a4d-9af7-d89fbd2c4777 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:01.988310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13a5baea-742a-4a4d-9af7-d89fbd2c4777 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:02.259677 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-13a5baea-742a-4a4d-9af7-d89fbd2c4777 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "POST /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024/action" status: 202 len: 0 microversion: 2.1 time: 0.290950 Sep 10 10:46:02.261891 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1733/2239] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:46:01 2022] POST /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 10:46:02.275045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed366a29-2a25-4a9a-ad4b-c9906f469c8e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:02.275826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed366a29-2a25-4a9a-ad4b-c9906f469c8e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:02.289372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed366a29-2a25-4a9a-ad4b-c9906f469c8e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:02.289878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed366a29-2a25-4a9a-ad4b-c9906f469c8e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:02.290319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed366a29-2a25-4a9a-ad4b-c9906f469c8e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:02.296978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed366a29-2a25-4a9a-ad4b-c9906f469c8e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:02.297589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed366a29-2a25-4a9a-ad4b-c9906f469c8e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:02.298052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed366a29-2a25-4a9a-ad4b-c9906f469c8e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:02.611964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed366a29-2a25-4a9a-ad4b-c9906f469c8e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:02.624123 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed366a29-2a25-4a9a-ad4b-c9906f469c8e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.360580 Sep 10 10:46:02.626257 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1734/2240] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:02 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:02.639157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bbbd43de-9e52-49fa-8984-5acc7ea2286b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '.version_select at 0x7efcae83d8b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:02.916827 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bbbd43de-9e52-49fa-8984-5acc7ea2286b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "DELETE /compute/v2.1/images/2145ca67-fac1-4bea-a73e-5cee369e145e" status: 204 len: 0 microversion: 2.1 time: 0.287384 Sep 10 10:46:02.918350 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1735/2241] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:02 2022] DELETE /compute/v2.1/images/2145ca67-fac1-4bea-a73e-5cee369e145e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:46:02.927946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-734fc32c-e210-4b90-9954-01e4b2881d8b req-bc70d3b0-bf43-4004-a21a-a609636de131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda18caa-5a27-40b6-ae42-48a93b63825c", "name": "network-vif-unplugged", "status": "completed", "tag": "a8d7b3d4-fa78-4890-8baa-75a8aff3caff"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:02.946158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-734fc32c-e210-4b90-9954-01e4b2881d8b req-bc70d3b0-bf43-4004-a21a-a609636de131 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:02.948621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-734fc32c-e210-4b90-9954-01e4b2881d8b req-bc70d3b0-bf43-4004-a21a-a609636de131 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:02.949089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-734fc32c-e210-4b90-9954-01e4b2881d8b req-bc70d3b0-bf43-4004-a21a-a609636de131 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:02.971939 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-734fc32c-e210-4b90-9954-01e4b2881d8b req-bc70d3b0-bf43-4004-a21a-a609636de131 service nova] Creating event network-vif-unplugged:a8d7b3d4-fa78-4890-8baa-75a8aff3caff for instance fda18caa-5a27-40b6-ae42-48a93b63825c on n-h2-856894-1 Sep 10 10:46:02.985688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-734fc32c-e210-4b90-9954-01e4b2881d8b req-bc70d3b0-bf43-4004-a21a-a609636de131 service nova] Instance fda18caa-5a27-40b6-ae42-48a93b63825c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 10:46:02.999447 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-734fc32c-e210-4b90-9954-01e4b2881d8b req-bc70d3b0-bf43-4004-a21a-a609636de131 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078882 Sep 10 10:46:03.002572 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1736/2242] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:03.016393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95b44159-e092-4a72-a485-2c5a00560e07 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '.version_select at 0x7efcae81a5e0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:03.050239 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-95b44159-e092-4a72-a485-2c5a00560e07 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Image not found. Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95b44159-e092-4a72-a485-2c5a00560e07 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/images/2145ca67-fac1-4bea-a73e-5cee369e145e HTTP/1.1 Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '2145ca67-fac1-4bea-a73e-5cee369e145e'} Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2145ca67-fac1-4bea-a73e-5cee369e145e Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 10:46:03.054024 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2145ca67-fac1-4bea-a73e-5cee369e145e could not be found. Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:46:03.058654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:03.063849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95b44159-e092-4a72-a485-2c5a00560e07 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:03.064733 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95b44159-e092-4a72-a485-2c5a00560e07 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/images/2145ca67-fac1-4bea-a73e-5cee369e145e" status: 404 len: 62 microversion: 2.1 time: 0.055111 Sep 10 10:46:03.065661 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1737/2243] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:46:03 2022] GET /compute/v2.1/images/2145ca67-fac1-4bea-a73e-5cee369e145e => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:46:03.071641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9db356b-b767-4667-b1d5-4d9d2f11c129 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:03.072450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9db356b-b767-4667-b1d5-4d9d2f11c129 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:03.080299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9db356b-b767-4667-b1d5-4d9d2f11c129 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:03.080795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9db356b-b767-4667-b1d5-4d9d2f11c129 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:03.081262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9db356b-b767-4667-b1d5-4d9d2f11c129 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:03.081962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9db356b-b767-4667-b1d5-4d9d2f11c129 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:03.082434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9db356b-b767-4667-b1d5-4d9d2f11c129 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:03.083599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9db356b-b767-4667-b1d5-4d9d2f11c129 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:03.324503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9db356b-b767-4667-b1d5-4d9d2f11c129 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:03.336261 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9db356b-b767-4667-b1d5-4d9d2f11c129 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1474 microversion: 2.1 time: 0.269434 Sep 10 10:46:03.339256 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1738/2244] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:03 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1474 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:03.354630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c1c0d2c-fff7-45ff-a1f8-fda510e885ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:03.355648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4c1c0d2c-fff7-45ff-a1f8-fda510e885ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:03.371218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1c0d2c-fff7-45ff-a1f8-fda510e885ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:03.373761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1c0d2c-fff7-45ff-a1f8-fda510e885ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:03.374232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1c0d2c-fff7-45ff-a1f8-fda510e885ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:03.374985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1c0d2c-fff7-45ff-a1f8-fda510e885ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:03.377174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1c0d2c-fff7-45ff-a1f8-fda510e885ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:03.381283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1c0d2c-fff7-45ff-a1f8-fda510e885ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:03.602296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4c1c0d2c-fff7-45ff-a1f8-fda510e885ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:03.627324 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c1c0d2c-fff7-45ff-a1f8-fda510e885ca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1534 microversion: 2.1 time: 0.282831 Sep 10 10:46:03.633640 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1739/2245] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:03 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1534 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:03.650917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b11be042-53e5-41c6-a46d-12df12398a2d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:03.651823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b11be042-53e5-41c6-a46d-12df12398a2d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:03.678325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b11be042-53e5-41c6-a46d-12df12398a2d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:03.681306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b11be042-53e5-41c6-a46d-12df12398a2d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:03.681832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b11be042-53e5-41c6-a46d-12df12398a2d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:03.682602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b11be042-53e5-41c6-a46d-12df12398a2d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:03.683072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b11be042-53e5-41c6-a46d-12df12398a2d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:03.683545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b11be042-53e5-41c6-a46d-12df12398a2d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:03.980388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b11be042-53e5-41c6-a46d-12df12398a2d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:04.001992 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b11be042-53e5-41c6-a46d-12df12398a2d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.356340 Sep 10 10:46:04.004670 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1740/2246] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:03 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:04.366095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c4e68fff-feea-4dd0-bfaa-0e70a5f1d588 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:04.367430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4e68fff-feea-4dd0-bfaa-0e70a5f1d588 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:04.383709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4e68fff-feea-4dd0-bfaa-0e70a5f1d588 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:04.385134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4e68fff-feea-4dd0-bfaa-0e70a5f1d588 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:04.385720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4e68fff-feea-4dd0-bfaa-0e70a5f1d588 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:04.392024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4e68fff-feea-4dd0-bfaa-0e70a5f1d588 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:04.393419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4e68fff-feea-4dd0-bfaa-0e70a5f1d588 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:04.394470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4e68fff-feea-4dd0-bfaa-0e70a5f1d588 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:04.695734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c4e68fff-feea-4dd0-bfaa-0e70a5f1d588 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:04.713593 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c4e68fff-feea-4dd0-bfaa-0e70a5f1d588 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1471 microversion: 2.1 time: 0.352155 Sep 10 10:46:04.714751 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1741/2247] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:04 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1471 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:04.719711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4dc3bdfd-cb72-4a25-a3c8-99d2d51e3189 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:04.722035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4dc3bdfd-cb72-4a25-a3c8-99d2d51e3189 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:04.731663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dc3bdfd-cb72-4a25-a3c8-99d2d51e3189 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:04.733383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dc3bdfd-cb72-4a25-a3c8-99d2d51e3189 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:04.738722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dc3bdfd-cb72-4a25-a3c8-99d2d51e3189 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:04.740396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dc3bdfd-cb72-4a25-a3c8-99d2d51e3189 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:04.744082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dc3bdfd-cb72-4a25-a3c8-99d2d51e3189 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:04.744826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dc3bdfd-cb72-4a25-a3c8-99d2d51e3189 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:04.771849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:05.021499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4dc3bdfd-cb72-4a25-a3c8-99d2d51e3189 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:05.031805 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4dc3bdfd-cb72-4a25-a3c8-99d2d51e3189 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1540 microversion: 2.1 time: 0.315367 Sep 10 10:46:05.034846 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1742/2248] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:04 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1540 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:05.046018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-821990da-9ce6-4ae2-ab3c-ba8e1fe01ac9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:05.048715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-821990da-9ce6-4ae2-ab3c-ba8e1fe01ac9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:05.063275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-821990da-9ce6-4ae2-ab3c-ba8e1fe01ac9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:05.063993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-821990da-9ce6-4ae2-ab3c-ba8e1fe01ac9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:05.066488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-821990da-9ce6-4ae2-ab3c-ba8e1fe01ac9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:05.067495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-821990da-9ce6-4ae2-ab3c-ba8e1fe01ac9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:05.069667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-821990da-9ce6-4ae2-ab3c-ba8e1fe01ac9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:05.070327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-821990da-9ce6-4ae2-ab3c-ba8e1fe01ac9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:05.223286 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-821990da-9ce6-4ae2-ab3c-ba8e1fe01ac9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c/action" status: 204 len: 0 microversion: 2.1 time: 0.186879 Sep 10 10:46:05.224311 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1743/2249] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:46:05 2022] POST /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c/action => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:46:05.235539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-54b08b9d-fd97-4739-9d24-0f7eded3b2f2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:05.237995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54b08b9d-fd97-4739-9d24-0f7eded3b2f2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:05.250501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54b08b9d-fd97-4739-9d24-0f7eded3b2f2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:05.253334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54b08b9d-fd97-4739-9d24-0f7eded3b2f2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:05.254015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54b08b9d-fd97-4739-9d24-0f7eded3b2f2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:05.255494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54b08b9d-fd97-4739-9d24-0f7eded3b2f2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:05.258369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54b08b9d-fd97-4739-9d24-0f7eded3b2f2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:05.259210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54b08b9d-fd97-4739-9d24-0f7eded3b2f2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:05.904669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54b08b9d-fd97-4739-9d24-0f7eded3b2f2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:05.915916 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-54b08b9d-fd97-4739-9d24-0f7eded3b2f2 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.690318 Sep 10 10:46:05.919386 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1744/2250] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:05 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:05.932784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-16653407-5af7-46e1-8ca8-9ee50d4e5ea7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:05.933850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-16653407-5af7-46e1-8ca8-9ee50d4e5ea7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:05.950212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16653407-5af7-46e1-8ca8-9ee50d4e5ea7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:05.951030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16653407-5af7-46e1-8ca8-9ee50d4e5ea7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:05.951641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16653407-5af7-46e1-8ca8-9ee50d4e5ea7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:05.952673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16653407-5af7-46e1-8ca8-9ee50d4e5ea7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:05.953348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16653407-5af7-46e1-8ca8-9ee50d4e5ea7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:05.954419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16653407-5af7-46e1-8ca8-9ee50d4e5ea7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:06.439334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-16653407-5af7-46e1-8ca8-9ee50d4e5ea7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:06.455891 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-16653407-5af7-46e1-8ca8-9ee50d4e5ea7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1471 microversion: 2.1 time: 0.534000 Sep 10 10:46:06.496273 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1745/2251] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:05 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1471 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:06.512264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5434060e-7669-4374-891b-cf88ed77a5d6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:06.513942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5434060e-7669-4374-891b-cf88ed77a5d6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:06.530932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5434060e-7669-4374-891b-cf88ed77a5d6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:06.531900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5434060e-7669-4374-891b-cf88ed77a5d6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:06.532501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5434060e-7669-4374-891b-cf88ed77a5d6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:06.533540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5434060e-7669-4374-891b-cf88ed77a5d6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:06.534162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5434060e-7669-4374-891b-cf88ed77a5d6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:06.534776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5434060e-7669-4374-891b-cf88ed77a5d6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:06.875672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5434060e-7669-4374-891b-cf88ed77a5d6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:06.891259 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5434060e-7669-4374-891b-cf88ed77a5d6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1522 microversion: 2.1 time: 0.393462 Sep 10 10:46:06.892708 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1746/2252] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:06 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:07.220104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1983995965", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "e16fdb70-a8d2-41fa-bc5f-970cd4223df8"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:07.401330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] validate_networks() for [('e16fdb70-a8d2-41fa-bc5f-970cd4223df8', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:46:08.135095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:46:08.135402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:46:08.135886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:46:08.136298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:46:08.136858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:46:08.153355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:08.154054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:08.154656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:08.155732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:08.156600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:08.157352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:08.179042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Getting quotas for project 329a84c6505b4cdeae51c66bf0008ef0. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:46:08.185051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Getting quotas for user 5d0a41557e8148d7bc2ae4530132b80c and project 329a84c6505b4cdeae51c66bf0008ef0. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:46:08.211716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:46:08.215842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:46:08.296562 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30dd56c5-f377-44e3-b74b-a8edf9654710 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402500 Sep 10 10:46:08.299414 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1747/2253] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:46:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:46:08.315203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d60cfe1a-45df-4016-8c6f-5842a8495ac6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:08.317413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d60cfe1a-45df-4016-8c6f-5842a8495ac6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:08.353291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d60cfe1a-45df-4016-8c6f-5842a8495ac6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:08.356055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d60cfe1a-45df-4016-8c6f-5842a8495ac6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:08.356713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d60cfe1a-45df-4016-8c6f-5842a8495ac6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:08.365863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d60cfe1a-45df-4016-8c6f-5842a8495ac6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:08.366385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d60cfe1a-45df-4016-8c6f-5842a8495ac6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:08.369326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d60cfe1a-45df-4016-8c6f-5842a8495ac6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:08.413727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d60cfe1a-45df-4016-8c6f-5842a8495ac6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:46:08.573018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d60cfe1a-45df-4016-8c6f-5842a8495ac6 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "DELETE /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 204 len: 0 microversion: 2.1 time: 0.270309 Sep 10 10:46:08.576802 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1748/2254] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:46:08 2022] DELETE /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:46:08.581632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-180ba31d-a508-4c51-8939-79d5bcda33eb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:08.582507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-180ba31d-a508-4c51-8939-79d5bcda33eb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:08.601870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180ba31d-a508-4c51-8939-79d5bcda33eb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:08.602767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180ba31d-a508-4c51-8939-79d5bcda33eb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:08.603557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180ba31d-a508-4c51-8939-79d5bcda33eb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:08.604876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180ba31d-a508-4c51-8939-79d5bcda33eb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:08.605580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180ba31d-a508-4c51-8939-79d5bcda33eb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:08.606257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180ba31d-a508-4c51-8939-79d5bcda33eb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:09.081650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-180ba31d-a508-4c51-8939-79d5bcda33eb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:09.091153 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-180ba31d-a508-4c51-8939-79d5bcda33eb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.515634 Sep 10 10:46:09.095932 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1749/2255] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:08 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:09.115945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad116589-1500-4064-ac17-b76f130d1ff4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:09.116815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ad116589-1500-4064-ac17-b76f130d1ff4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:09.133176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad116589-1500-4064-ac17-b76f130d1ff4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:09.133858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad116589-1500-4064-ac17-b76f130d1ff4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:09.134433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad116589-1500-4064-ac17-b76f130d1ff4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:09.139384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad116589-1500-4064-ac17-b76f130d1ff4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:09.140884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad116589-1500-4064-ac17-b76f130d1ff4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:09.141387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad116589-1500-4064-ac17-b76f130d1ff4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:09.468980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ad116589-1500-4064-ac17-b76f130d1ff4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:09.490955 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad116589-1500-4064-ac17-b76f130d1ff4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1463 microversion: 2.1 time: 0.388182 Sep 10 10:46:09.492806 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1750/2256] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:09 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1463 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:09.517474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8dbe2fe9-902d-48ba-9f59-a71b68146801 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:09.519134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8dbe2fe9-902d-48ba-9f59-a71b68146801 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:09.534773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbe2fe9-902d-48ba-9f59-a71b68146801 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:09.537250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbe2fe9-902d-48ba-9f59-a71b68146801 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:09.541220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbe2fe9-902d-48ba-9f59-a71b68146801 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:09.542781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbe2fe9-902d-48ba-9f59-a71b68146801 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:09.543272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbe2fe9-902d-48ba-9f59-a71b68146801 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:09.543824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbe2fe9-902d-48ba-9f59-a71b68146801 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:09.751659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8dbe2fe9-902d-48ba-9f59-a71b68146801 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:09.767377 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8dbe2fe9-902d-48ba-9f59-a71b68146801 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1229 microversion: 2.1 time: 0.268892 Sep 10 10:46:09.770722 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1751/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:09 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1229 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:09.777709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f949c2a-c175-48d1-8325-456a8bb16094 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:09.778653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f949c2a-c175-48d1-8325-456a8bb16094 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:09.805286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f949c2a-c175-48d1-8325-456a8bb16094 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:09.805790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f949c2a-c175-48d1-8325-456a8bb16094 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:09.806233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f949c2a-c175-48d1-8325-456a8bb16094 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:09.806949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f949c2a-c175-48d1-8325-456a8bb16094 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:09.807401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f949c2a-c175-48d1-8325-456a8bb16094 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:09.808021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f949c2a-c175-48d1-8325-456a8bb16094 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:10.090029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3f949c2a-c175-48d1-8325-456a8bb16094 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:10.103700 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f949c2a-c175-48d1-8325-456a8bb16094 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1528 microversion: 2.1 time: 0.331548 Sep 10 10:46:10.104313 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1752/2258] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:09 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1528 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:10.112693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4da33f83-5a70-424c-bb61-ca37b76a5fe6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:10.112693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4da33f83-5a70-424c-bb61-ca37b76a5fe6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:10.118638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da33f83-5a70-424c-bb61-ca37b76a5fe6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:10.119128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da33f83-5a70-424c-bb61-ca37b76a5fe6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:10.119769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da33f83-5a70-424c-bb61-ca37b76a5fe6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:10.120648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da33f83-5a70-424c-bb61-ca37b76a5fe6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:10.121298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da33f83-5a70-424c-bb61-ca37b76a5fe6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:10.121906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4da33f83-5a70-424c-bb61-ca37b76a5fe6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:10.649471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4da33f83-5a70-424c-bb61-ca37b76a5fe6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:10.666993 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4da33f83-5a70-424c-bb61-ca37b76a5fe6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1463 microversion: 2.1 time: 0.555877 Sep 10 10:46:10.670649 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1753/2259] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:10 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1463 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:10.688483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ffbeb03d-c377-42dd-a3c5-3dfb013da9d4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:10.700838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ffbeb03d-c377-42dd-a3c5-3dfb013da9d4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:10.730334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffbeb03d-c377-42dd-a3c5-3dfb013da9d4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:10.730768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffbeb03d-c377-42dd-a3c5-3dfb013da9d4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:10.731216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffbeb03d-c377-42dd-a3c5-3dfb013da9d4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:10.731937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffbeb03d-c377-42dd-a3c5-3dfb013da9d4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:10.732581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffbeb03d-c377-42dd-a3c5-3dfb013da9d4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:10.733208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffbeb03d-c377-42dd-a3c5-3dfb013da9d4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:11.167349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffbeb03d-c377-42dd-a3c5-3dfb013da9d4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:11.177374 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ffbeb03d-c377-42dd-a3c5-3dfb013da9d4 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.505452 Sep 10 10:46:11.177973 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1754/2260] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:10 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:11.197107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f188ca99-a816-48e1-91e8-cc0eed8f1441 req-22b188a5-9cbf-477c-9234-90f54011ae96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda18caa-5a27-40b6-ae42-48a93b63825c", "name": "network-vif-plugged", "status": "completed", "tag": "a8d7b3d4-fa78-4890-8baa-75a8aff3caff"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:11.215947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f188ca99-a816-48e1-91e8-cc0eed8f1441 req-22b188a5-9cbf-477c-9234-90f54011ae96 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:11.217253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f188ca99-a816-48e1-91e8-cc0eed8f1441 req-22b188a5-9cbf-477c-9234-90f54011ae96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:11.218773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f188ca99-a816-48e1-91e8-cc0eed8f1441 req-22b188a5-9cbf-477c-9234-90f54011ae96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:11.236023 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f188ca99-a816-48e1-91e8-cc0eed8f1441 req-22b188a5-9cbf-477c-9234-90f54011ae96 service nova] Creating event network-vif-plugged:a8d7b3d4-fa78-4890-8baa-75a8aff3caff for instance fda18caa-5a27-40b6-ae42-48a93b63825c on n-h2-856894-1 Sep 10 10:46:11.242557 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f188ca99-a816-48e1-91e8-cc0eed8f1441 req-22b188a5-9cbf-477c-9234-90f54011ae96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063322 Sep 10 10:46:11.243492 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1755/2261] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:11.249172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7320fd50-2024-45ea-8a03-bfb28df1dd0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'create', calling method: .version_select at 0x7efcae747af0>, body: {"keypair": {"name": "tempest-keypair-1329288233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDZ0wOV99W9Uc2Ue7GREJE8MdH5QJ0NGheyzCyLmbuTMLoFULKdd+zYqM17MeSeAlA6Fjc4pXFQOjUtHqDkcFo5KKxiJoT3zo4xKQfFKlB8q5KoMLu34TrocgpS2eNr4g=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:11.267104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7320fd50-2024-45ea-8a03-bfb28df1dd0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for project 7c408248417b4deaaa26ef380da4bb90. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:46:11.274865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7320fd50-2024-45ea-8a03-bfb28df1dd0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for user f5b257d1488141689c826efe484e4040 and project 7c408248417b4deaaa26ef380da4bb90. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:46:11.312014 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7320fd50-2024-45ea-8a03-bfb28df1dd0c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066531 Sep 10 10:46:11.313574 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1756/2262] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:46:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:11.331602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-655f620a-3b16-47c1-b56a-8eabbd5dc381 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:11.335798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-655f620a-3b16-47c1-b56a-8eabbd5dc381 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:11.361497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:11.363171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-655f620a-3b16-47c1-b56a-8eabbd5dc381 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:11.365920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-655f620a-3b16-47c1-b56a-8eabbd5dc381 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:11.366757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-655f620a-3b16-47c1-b56a-8eabbd5dc381 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:11.367681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-655f620a-3b16-47c1-b56a-8eabbd5dc381 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:11.369661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-655f620a-3b16-47c1-b56a-8eabbd5dc381 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:11.370101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-655f620a-3b16-47c1-b56a-8eabbd5dc381 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:11.525588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-655f620a-3b16-47c1-b56a-8eabbd5dc381 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:11.537977 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-655f620a-3b16-47c1-b56a-8eabbd5dc381 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1277 microversion: 2.1 time: 0.222600 Sep 10 10:46:11.543599 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1757/2263] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:11 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:11.556050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ca45b5c4-a02b-4cf4-bb94-4c34465cf343 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:11.556685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ca45b5c4-a02b-4cf4-bb94-4c34465cf343 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:11.573728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca45b5c4-a02b-4cf4-bb94-4c34465cf343 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:11.574688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca45b5c4-a02b-4cf4-bb94-4c34465cf343 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:11.575369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca45b5c4-a02b-4cf4-bb94-4c34465cf343 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:11.576362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca45b5c4-a02b-4cf4-bb94-4c34465cf343 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:11.577346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca45b5c4-a02b-4cf4-bb94-4c34465cf343 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:11.577624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca45b5c4-a02b-4cf4-bb94-4c34465cf343 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:11.639788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:12.280597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ca45b5c4-a02b-4cf4-bb94-4c34465cf343 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:12.291986 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ca45b5c4-a02b-4cf4-bb94-4c34465cf343 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1528 microversion: 2.1 time: 0.746263 Sep 10 10:46:12.293916 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1758/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:11 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1528 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:12.313183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd977bf2-3480-473a-9404-b868c3c2b660 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:12.313970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd977bf2-3480-473a-9404-b868c3c2b660 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:12.332352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd977bf2-3480-473a-9404-b868c3c2b660 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:12.332973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd977bf2-3480-473a-9404-b868c3c2b660 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:12.333906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd977bf2-3480-473a-9404-b868c3c2b660 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:12.334858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd977bf2-3480-473a-9404-b868c3c2b660 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:12.335569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd977bf2-3480-473a-9404-b868c3c2b660 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:12.336106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd977bf2-3480-473a-9404-b868c3c2b660 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:12.806030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fd977bf2-3480-473a-9404-b868c3c2b660 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:12.826954 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fd977bf2-3480-473a-9404-b868c3c2b660 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.530784 Sep 10 10:46:12.829650 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1759/2265] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:12 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:12.836356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9fd7e59c-62ac-46da-86f3-c2b59a4dee23 req-fc284455-65a6-435e-998a-ae4424e8b890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc3f2b0-25a8-42f2-b97b-84024a960024", "name": "network-vif-deleted", "tag": "bf36f825-d938-49a9-92d5-e4b309dc9e8c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:12.850535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9fd7e59c-62ac-46da-86f3-c2b59a4dee23 req-fc284455-65a6-435e-998a-ae4424e8b890 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:12.851359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9fd7e59c-62ac-46da-86f3-c2b59a4dee23 req-fc284455-65a6-435e-998a-ae4424e8b890 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:12.851969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9fd7e59c-62ac-46da-86f3-c2b59a4dee23 req-fc284455-65a6-435e-998a-ae4424e8b890 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:12.900962 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9fd7e59c-62ac-46da-86f3-c2b59a4dee23 req-fc284455-65a6-435e-998a-ae4424e8b890 service nova] Creating event network-vif-deleted:bf36f825-d938-49a9-92d5-e4b309dc9e8c for instance adc3f2b0-25a8-42f2-b97b-84024a960024 on n-h2-856894-1 Sep 10 10:46:12.909190 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9fd7e59c-62ac-46da-86f3-c2b59a4dee23 req-fc284455-65a6-435e-998a-ae4424e8b890 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077410 Sep 10 10:46:12.911778 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1760/2266] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:12.924376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d7786a1-a705-4d13-a0aa-31dace0e6803 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:12.925305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9d7786a1-a705-4d13-a0aa-31dace0e6803 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:12.933368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d7786a1-a705-4d13-a0aa-31dace0e6803 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:12.934062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d7786a1-a705-4d13-a0aa-31dace0e6803 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:12.934664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d7786a1-a705-4d13-a0aa-31dace0e6803 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:12.935520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d7786a1-a705-4d13-a0aa-31dace0e6803 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:12.936514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d7786a1-a705-4d13-a0aa-31dace0e6803 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:12.937119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d7786a1-a705-4d13-a0aa-31dace0e6803 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:13.054728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d7786a1-a705-4d13-a0aa-31dace0e6803 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:13.067478 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d7786a1-a705-4d13-a0aa-31dace0e6803 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1283 microversion: 2.1 time: 0.153436 Sep 10 10:46:13.074263 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1761/2267] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:12 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:13.320210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:13.320736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:13.333562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:13.334789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:13.336515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:13.339035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:13.340953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:13.342220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:13.432580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:13.435018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:13.435722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:13.437635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lazy-loading 'fault' on Instance uuid adc3f2b0-25a8-42f2-b97b-84024a960024 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:46:13.516015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:13.539170 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c8704e6-f687-4243-8ae6-f91026259401 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 200 len: 1315 microversion: 2.1 time: 0.210264 Sep 10 10:46:13.543135 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1762/2268] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:13 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:13.554643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9d4f73d4-adee-449a-8adb-b366b848b938 req-ac90e695-f41c-48d9-85b5-8ba60a5170e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc3f2b0-25a8-42f2-b97b-84024a960024", "name": "network-vif-plugged", "status": "completed", "tag": "bf36f825-d938-49a9-92d5-e4b309dc9e8c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:13.586856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d4f73d4-adee-449a-8adb-b366b848b938 req-ac90e695-f41c-48d9-85b5-8ba60a5170e3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:13.592076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d4f73d4-adee-449a-8adb-b366b848b938 req-ac90e695-f41c-48d9-85b5-8ba60a5170e3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:13.594551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d4f73d4-adee-449a-8adb-b366b848b938 req-ac90e695-f41c-48d9-85b5-8ba60a5170e3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:13.613989 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9d4f73d4-adee-449a-8adb-b366b848b938 req-ac90e695-f41c-48d9-85b5-8ba60a5170e3 service nova] Creating event network-vif-plugged:bf36f825-d938-49a9-92d5-e4b309dc9e8c for instance adc3f2b0-25a8-42f2-b97b-84024a960024 on n-h2-856894-1 Sep 10 10:46:13.627634 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9d4f73d4-adee-449a-8adb-b366b848b938 req-ac90e695-f41c-48d9-85b5-8ba60a5170e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079890 Sep 10 10:46:13.629319 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1763/2269] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:13.857797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74e50099-53d4-467f-ba66-3613c0b7c173 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:13.858579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74e50099-53d4-467f-ba66-3613c0b7c173 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:13.875518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74e50099-53d4-467f-ba66-3613c0b7c173 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:13.876330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74e50099-53d4-467f-ba66-3613c0b7c173 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:13.877698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74e50099-53d4-467f-ba66-3613c0b7c173 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:13.880666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74e50099-53d4-467f-ba66-3613c0b7c173 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:13.881508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74e50099-53d4-467f-ba66-3613c0b7c173 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:13.884665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74e50099-53d4-467f-ba66-3613c0b7c173 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:14.257035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74e50099-53d4-467f-ba66-3613c0b7c173 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:14.266337 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74e50099-53d4-467f-ba66-3613c0b7c173 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.414551 Sep 10 10:46:14.269475 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1764/2270] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:13 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:46:14.295603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d247938f-a551-4a1a-8499-2b43fd914744 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:14.299629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d247938f-a551-4a1a-8499-2b43fd914744 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:14.312099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d247938f-a551-4a1a-8499-2b43fd914744 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:14.312624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d247938f-a551-4a1a-8499-2b43fd914744 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:14.313097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d247938f-a551-4a1a-8499-2b43fd914744 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:14.313809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d247938f-a551-4a1a-8499-2b43fd914744 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:14.320228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d247938f-a551-4a1a-8499-2b43fd914744 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:14.321937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d247938f-a551-4a1a-8499-2b43fd914744 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:14.563433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d247938f-a551-4a1a-8499-2b43fd914744 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:14.577468 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d247938f-a551-4a1a-8499-2b43fd914744 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1325 microversion: 2.1 time: 0.287506 Sep 10 10:46:14.578698 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1765/2271] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:14 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1325 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:14.586181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:14.587105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:14.595353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:14.596496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:14.597246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:14.599477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:14.600448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:14.602681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:14.627646 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 HTTP/1.1 Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'adc3f2b0-25a8-42f2-b97b-84024a960024'} Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:14.630979 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:14.635787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:14.635787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:14.635787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:14.635787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:14.635787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:14.635787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:14.635787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:14.635787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:14.636496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 404 to user: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:14.638768 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a3ffc36-f078-497f-a77d-3e363e5407ed tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 404 len: 111 microversion: 2.1 time: 0.058693 Sep 10 10:46:14.647531 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1766/2272] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:14 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:46:14.812497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1700047386", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:14.928511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] validate_networks() for [('f1689f33-58e5-45ac-9fc5-3a833f4afde6', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:46:15.688760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:46:15.688760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:46:15.689534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:46:15.690185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:46:15.690706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:46:15.701027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:15.706140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:15.707139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:15.708003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:15.708548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:15.709043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:15.729738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Getting quotas for project ee641ddfdc8a4ff6a9e9a58b705a1fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:46:15.735442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Getting quotas for user 3e6d3452f1dd4b7781f0f6d490115e6b and project ee641ddfdc8a4ff6a9e9a58b705a1fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:46:15.750102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:46:15.752930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:46:15.808217 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e28043eb-9d7e-43d7-8960-fc898afb12db tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.000997 Sep 10 10:46:15.809298 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1767/2273] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:46:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:46:15.816965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76ef5063-cd03-423a-8bcc-0f864cccabd6 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '.version_select at 0x7efcae96f430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:15.821316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ef5063-cd03-423a-8bcc-0f864cccabd6 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:15.822128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ef5063-cd03-423a-8bcc-0f864cccabd6 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:15.822771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ef5063-cd03-423a-8bcc-0f864cccabd6 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:15.833951 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76ef5063-cd03-423a-8bcc-0f864cccabd6 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.023097 Sep 10 10:46:15.844665 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1768/2274] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:46:15 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:15.854565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ed8a66c-ab62-47df-9128-19bd2cb74757 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:15.856006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8ed8a66c-ab62-47df-9128-19bd2cb74757 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:15.863729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed8a66c-ab62-47df-9128-19bd2cb74757 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:15.865150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed8a66c-ab62-47df-9128-19bd2cb74757 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:15.865712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed8a66c-ab62-47df-9128-19bd2cb74757 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:15.866527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed8a66c-ab62-47df-9128-19bd2cb74757 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:15.867569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed8a66c-ab62-47df-9128-19bd2cb74757 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:15.868199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed8a66c-ab62-47df-9128-19bd2cb74757 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:16.074781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8ed8a66c-ab62-47df-9128-19bd2cb74757 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:16.091114 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ed8a66c-ab62-47df-9128-19bd2cb74757 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.252238 Sep 10 10:46:16.092257 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1769/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:15 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:16.098872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e929589b-7b82-4cb9-b09d-a3b030fd7578 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:16.099501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e929589b-7b82-4cb9-b09d-a3b030fd7578 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:16.109616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e929589b-7b82-4cb9-b09d-a3b030fd7578 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:16.110866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e929589b-7b82-4cb9-b09d-a3b030fd7578 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:16.112204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e929589b-7b82-4cb9-b09d-a3b030fd7578 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:16.114552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e929589b-7b82-4cb9-b09d-a3b030fd7578 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:16.115030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e929589b-7b82-4cb9-b09d-a3b030fd7578 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:16.116227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e929589b-7b82-4cb9-b09d-a3b030fd7578 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:16.319284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e929589b-7b82-4cb9-b09d-a3b030fd7578 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:16.329629 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e929589b-7b82-4cb9-b09d-a3b030fd7578 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1325 microversion: 2.1 time: 0.235998 Sep 10 10:46:16.341793 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1770/2276] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:16 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1325 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:16.596961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53ea4c8a-18c3-43a6-a1e0-d0069f93d923 tempest-SecurityGroupsTestAdminJSON-1260786154 tempest-SecurityGroupsTestAdminJSON-1260786154-project] Action: 'create', calling method: .version_select at 0x7efcaeb4edc0>, body: {"security_group": {"name": "tempest-securitygroup-76949475", "description": "tempest-description-832364926"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:16.914916 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53ea4c8a-18c3-43a6-a1e0-d0069f93d923 tempest-SecurityGroupsTestAdminJSON-1260786154 tempest-SecurityGroupsTestAdminJSON-1260786154-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.571527 Sep 10 10:46:16.915732 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1771/2277] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:46:16 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:16.920745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-876c90c2-79be-4ed4-b037-7515903d8129 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:16.921812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-876c90c2-79be-4ed4-b037-7515903d8129 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:16.949236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-876c90c2-79be-4ed4-b037-7515903d8129 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:16.949493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-876c90c2-79be-4ed4-b037-7515903d8129 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:16.949936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-876c90c2-79be-4ed4-b037-7515903d8129 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:16.950675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-876c90c2-79be-4ed4-b037-7515903d8129 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:16.951304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-876c90c2-79be-4ed4-b037-7515903d8129 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:16.951997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-876c90c2-79be-4ed4-b037-7515903d8129 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:17.055859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-876c90c2-79be-4ed4-b037-7515903d8129 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:17.069227 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-876c90c2-79be-4ed4-b037-7515903d8129 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1277 microversion: 2.1 time: 0.151988 Sep 10 10:46:17.084043 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1772/2278] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:16 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:17.084043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ad11f27-a4f4-4adc-ae2a-fee650ca6a16 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:17.086945 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ad11f27-a4f4-4adc-ae2a-fee650ca6a16 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013738 Sep 10 10:46:17.088890 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1773/2279] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:46:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:17.094174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c0a492b1-7241-408f-baec-1166f34b2983 req-8bcd8abf-ae47-486c-9167-971c541ed4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3376e479-fd19-4d2f-8503-5381a31ac818", "tag": "e3a82977-524e-4482-8f95-466ac6f9fb31"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:17.110691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c0a492b1-7241-408f-baec-1166f34b2983 req-8bcd8abf-ae47-486c-9167-971c541ed4d2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:17.111648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c0a492b1-7241-408f-baec-1166f34b2983 req-8bcd8abf-ae47-486c-9167-971c541ed4d2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:17.112331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c0a492b1-7241-408f-baec-1166f34b2983 req-8bcd8abf-ae47-486c-9167-971c541ed4d2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:17.127250 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c0a492b1-7241-408f-baec-1166f34b2983 req-8bcd8abf-ae47-486c-9167-971c541ed4d2 service nova] Creating event network-changed:e3a82977-524e-4482-8f95-466ac6f9fb31 for instance 3376e479-fd19-4d2f-8503-5381a31ac818 on n-h2-856894-1 Sep 10 10:46:17.133205 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c0a492b1-7241-408f-baec-1166f34b2983 req-8bcd8abf-ae47-486c-9167-971c541ed4d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042858 Sep 10 10:46:17.133982 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1774/2280] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:17.139851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cf24c37-4b61-45e6-a345-ed04a673965a tempest-SecurityGroupsTestAdminJSON-1260786154 tempest-SecurityGroupsTestAdminJSON-1260786154-project] Action: 'create', calling method: .version_select at 0x7efcae84b940>, body: {"security_group": {"name": "tempest-securitygroup-960077123", "description": "tempest-description-2016018666"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:17.430825 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4cf24c37-4b61-45e6-a345-ed04a673965a tempest-SecurityGroupsTestAdminJSON-1260786154 tempest-SecurityGroupsTestAdminJSON-1260786154-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.295403 Sep 10 10:46:17.439974 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1775/2281] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:46:17 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:17.444344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94524e94-f849-49be-8980-cc1959569394 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-109971037", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:17.477130 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94524e94-f849-49be-8980-cc1959569394 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.040405 Sep 10 10:46:17.477970 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1776/2282] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Sep 10 10:46:17 2022] POST /compute/v2.1/flavors => generated 498 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:17.806906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-75c13625-5216-42e6-b24b-37921a6b543d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:17.807829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-75c13625-5216-42e6-b24b-37921a6b543d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:17.814561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75c13625-5216-42e6-b24b-37921a6b543d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:17.815037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75c13625-5216-42e6-b24b-37921a6b543d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:17.815469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75c13625-5216-42e6-b24b-37921a6b543d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:17.816368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75c13625-5216-42e6-b24b-37921a6b543d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:17.817186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75c13625-5216-42e6-b24b-37921a6b543d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:17.817786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75c13625-5216-42e6-b24b-37921a6b543d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:18.094925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-75c13625-5216-42e6-b24b-37921a6b543d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:18.103481 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-75c13625-5216-42e6-b24b-37921a6b543d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.623758 Sep 10 10:46:18.113248 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1777/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:17 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:18.113248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-16a4933b-8d5e-4084-a20b-0a51665e9baf tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:18.113248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-16a4933b-8d5e-4084-a20b-0a51665e9baf tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:18.116240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16a4933b-8d5e-4084-a20b-0a51665e9baf tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:18.116741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16a4933b-8d5e-4084-a20b-0a51665e9baf tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:18.117823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16a4933b-8d5e-4084-a20b-0a51665e9baf tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:18.118518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16a4933b-8d5e-4084-a20b-0a51665e9baf tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:18.118976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16a4933b-8d5e-4084-a20b-0a51665e9baf tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:18.119391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16a4933b-8d5e-4084-a20b-0a51665e9baf tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:18.364196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-16a4933b-8d5e-4084-a20b-0a51665e9baf tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:18.372936 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-16a4933b-8d5e-4084-a20b-0a51665e9baf tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1325 microversion: 2.1 time: 0.267322 Sep 10 10:46:18.373838 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1778/2284] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:18 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:18.768955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1453c92-2915-4beb-a1cc-ee65756fc8ef tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Action: 'create', calling method: .version_select at 0x7efcae81a040>, body: {"security_group": {"name": "tempest-securitygroup-349599801", "description": "tempest-description-255576323"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:19.738443 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1453c92-2915-4beb-a1cc-ee65756fc8ef tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.362513 Sep 10 10:46:19.741862 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1779/2285] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:46:18 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:19.747149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-002a4d0c-cc86-4431-880b-f1e51083f332 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:19.755554 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-002a4d0c-cc86-4431-880b-f1e51083f332 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012097 Sep 10 10:46:19.766618 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1780/2286] 10.222.0.20 () {58 vars in 1182 bytes} [Sat Sep 10 10:46:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:46:19.779910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6a9788a-20a4-4d32-94fa-b01c0a4cd392 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:19.780532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c6a9788a-20a4-4d32-94fa-b01c0a4cd392 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:19.791118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6a9788a-20a4-4d32-94fa-b01c0a4cd392 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:19.792166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6a9788a-20a4-4d32-94fa-b01c0a4cd392 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:19.793031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6a9788a-20a4-4d32-94fa-b01c0a4cd392 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:19.794003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6a9788a-20a4-4d32-94fa-b01c0a4cd392 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:19.794682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6a9788a-20a4-4d32-94fa-b01c0a4cd392 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:19.795206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6a9788a-20a4-4d32-94fa-b01c0a4cd392 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:19.935887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c6a9788a-20a4-4d32-94fa-b01c0a4cd392 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:19.946718 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c6a9788a-20a4-4d32-94fa-b01c0a4cd392 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1283 microversion: 2.1 time: 0.178836 Sep 10 10:46:19.947507 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1781/2287] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:19 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1283 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:19.952298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ba5e7793-0cd3-418f-ad9a-39110fb47403 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:19.953458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ba5e7793-0cd3-418f-ad9a-39110fb47403 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:19.962166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba5e7793-0cd3-418f-ad9a-39110fb47403 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:19.963026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba5e7793-0cd3-418f-ad9a-39110fb47403 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:19.964197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba5e7793-0cd3-418f-ad9a-39110fb47403 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:19.964732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba5e7793-0cd3-418f-ad9a-39110fb47403 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:19.965309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba5e7793-0cd3-418f-ad9a-39110fb47403 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:19.965802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba5e7793-0cd3-418f-ad9a-39110fb47403 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:20.506160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ba5e7793-0cd3-418f-ad9a-39110fb47403 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:20.525581 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ba5e7793-0cd3-418f-ad9a-39110fb47403 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.576724 Sep 10 10:46:20.528260 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1782/2288] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:19 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:20.537650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f0abe1bf-e155-4b19-b169-e010b2d254d6 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:20.541462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f0abe1bf-e155-4b19-b169-e010b2d254d6 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:20.564387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0abe1bf-e155-4b19-b169-e010b2d254d6 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:20.565255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0abe1bf-e155-4b19-b169-e010b2d254d6 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:20.566145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0abe1bf-e155-4b19-b169-e010b2d254d6 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:20.567874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0abe1bf-e155-4b19-b169-e010b2d254d6 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:20.568646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0abe1bf-e155-4b19-b169-e010b2d254d6 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:20.571444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0abe1bf-e155-4b19-b169-e010b2d254d6 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:21.106270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f0abe1bf-e155-4b19-b169-e010b2d254d6 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:21.139135 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f0abe1bf-e155-4b19-b169-e010b2d254d6 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1325 microversion: 2.1 time: 0.609046 Sep 10 10:46:21.141513 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1783/2289] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:20 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1325 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:21.159107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7aabcb58-3200-4a5e-ad56-03ced470312e tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Action: 'create', calling method: .version_select at 0x7efcae8fc3a0>, body: {"security_group": {"name": "tempest-securitygroup-859559027", "description": "tempest-description-297540443"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:21.777154 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7aabcb58-3200-4a5e-ad56-03ced470312e tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.634148 Sep 10 10:46:21.777772 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1784/2290] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:46:21 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:21.782968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-204177181", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "d3000ce6-d5ed-4e3f-9eae-b1e603273624"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:21.856029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:46:22.496311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:46:22.496942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:46:22.497223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:46:22.497636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:46:22.498048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:46:22.510817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:22.511559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:22.512268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:22.513175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:22.516788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:22.517414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:22.545328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for project 7c408248417b4deaaa26ef380da4bb90. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:46:22.554102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for user f5b257d1488141689c826efe484e4040 and project 7c408248417b4deaaa26ef380da4bb90. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:46:22.580820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:46:22.584361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:46:22.657011 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fd9860e0-de9d-4ddb-a7da-09af5d3ecd0e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877967 Sep 10 10:46:22.661867 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1785/2291] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:46:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:46:22.680018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49e21a82-9cf8-4baf-b7f0-5f7337b3bcd4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:22.680649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-49e21a82-9cf8-4baf-b7f0-5f7337b3bcd4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:22.699235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49e21a82-9cf8-4baf-b7f0-5f7337b3bcd4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:22.699677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49e21a82-9cf8-4baf-b7f0-5f7337b3bcd4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:22.700113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49e21a82-9cf8-4baf-b7f0-5f7337b3bcd4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:22.700815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49e21a82-9cf8-4baf-b7f0-5f7337b3bcd4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:22.701295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49e21a82-9cf8-4baf-b7f0-5f7337b3bcd4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:22.701711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49e21a82-9cf8-4baf-b7f0-5f7337b3bcd4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:22.745617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:23.159421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-49e21a82-9cf8-4baf-b7f0-5f7337b3bcd4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:23.178467 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-49e21a82-9cf8-4baf-b7f0-5f7337b3bcd4 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1325 microversion: 2.1 time: 0.514760 Sep 10 10:46:23.179078 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1786/2292] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:22 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1325 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:23.183725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36717473-4826-4332-9663-d4d4385d37dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:23.184352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36717473-4826-4332-9663-d4d4385d37dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:23.203040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36717473-4826-4332-9663-d4d4385d37dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:23.203740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36717473-4826-4332-9663-d4d4385d37dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:23.204371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36717473-4826-4332-9663-d4d4385d37dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:23.205321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36717473-4826-4332-9663-d4d4385d37dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:23.205945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36717473-4826-4332-9663-d4d4385d37dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:23.206554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36717473-4826-4332-9663-d4d4385d37dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:24.063869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36717473-4826-4332-9663-d4d4385d37dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:24.086959 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36717473-4826-4332-9663-d4d4385d37dd tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1511 microversion: 2.1 time: 0.906798 Sep 10 10:46:24.087560 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1787/2293] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:23 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1511 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:24.110319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c7aa57c0-0166-44bb-aae0-42b986edd40a tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Calling method '.version_select at 0x7efcae84ba60>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:25.702795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-c7aa57c0-0166-44bb-aae0-42b986edd40a tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9c7ff07f-7c5a-4a0d-bc76-54395b5774a2 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:46:25.703666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-c7aa57c0-0166-44bb-aae0-42b986edd40a tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Neutron security group 9c7ff07f-7c5a-4a0d-bc76-54395b5774a2 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:46:25.704438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.security_groups [None req-c7aa57c0-0166-44bb-aae0-42b986edd40a tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Security Group ID 9c7ff07f-7c5a-4a0d-bc76-54395b5774a2 does not exist {{(pid=128788) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 10 10:46:25.767494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-c7aa57c0-0166-44bb-aae0-42b986edd40a tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9c7ff07f-7c5a-4a0d-bc76-54395b5774a2 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:46:25.767799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-c7aa57c0-0166-44bb-aae0-42b986edd40a tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Neutron security group 9c7ff07f-7c5a-4a0d-bc76-54395b5774a2 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:46:25.768353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.security_groups [None req-c7aa57c0-0166-44bb-aae0-42b986edd40a tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Security Group ID 9c7ff07f-7c5a-4a0d-bc76-54395b5774a2 does not exist {{(pid=128788) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 10 10:46:26.462728 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c7aa57c0-0166-44bb-aae0-42b986edd40a tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11090 microversion: 2.1 time: 2.371990 Sep 10 10:46:26.463865 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1788/2294] 10.222.0.20 () {58 vars in 1191 bytes} [Sat Sep 10 10:46:24 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11090 bytes in 2375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:46:26.479281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f530415-20d2-4e86-90e0-502efa85636e tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:26.482961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f530415-20d2-4e86-90e0-502efa85636e tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:26.494177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f530415-20d2-4e86-90e0-502efa85636e tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:26.495482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f530415-20d2-4e86-90e0-502efa85636e tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:26.496069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f530415-20d2-4e86-90e0-502efa85636e tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:26.496958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f530415-20d2-4e86-90e0-502efa85636e tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:26.497596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f530415-20d2-4e86-90e0-502efa85636e tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:26.498156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f530415-20d2-4e86-90e0-502efa85636e tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:26.798127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3f530415-20d2-4e86-90e0-502efa85636e tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:26.807870 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f530415-20d2-4e86-90e0-502efa85636e tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1325 microversion: 2.1 time: 0.342762 Sep 10 10:46:26.833617 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1789/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:26 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1325 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:26.838810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-482a4138-17f4-42ab-a17a-e166021752f8 req-e1b22425-01f3-43cc-9d09-d3576cfa03cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3376e479-fd19-4d2f-8503-5381a31ac818", "name": "network-vif-plugged", "status": "completed", "tag": "e3a82977-524e-4482-8f95-466ac6f9fb31"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:26.859889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-482a4138-17f4-42ab-a17a-e166021752f8 req-e1b22425-01f3-43cc-9d09-d3576cfa03cd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:26.860752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-482a4138-17f4-42ab-a17a-e166021752f8 req-e1b22425-01f3-43cc-9d09-d3576cfa03cd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:26.861430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-482a4138-17f4-42ab-a17a-e166021752f8 req-e1b22425-01f3-43cc-9d09-d3576cfa03cd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:26.891981 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-482a4138-17f4-42ab-a17a-e166021752f8 req-e1b22425-01f3-43cc-9d09-d3576cfa03cd service nova] Creating event network-vif-plugged:e3a82977-524e-4482-8f95-466ac6f9fb31 for instance 3376e479-fd19-4d2f-8503-5381a31ac818 on n-h2-856894-1 Sep 10 10:46:26.899493 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-482a4138-17f4-42ab-a17a-e166021752f8 req-e1b22425-01f3-43cc-9d09-d3576cfa03cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064095 Sep 10 10:46:26.900146 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1790/2296] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:26.914391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f5071d4-5905-4128-b69d-d6cb15c40ccd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:26.917728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f5071d4-5905-4128-b69d-d6cb15c40ccd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:26.938358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5071d4-5905-4128-b69d-d6cb15c40ccd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:26.939169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5071d4-5905-4128-b69d-d6cb15c40ccd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:26.941854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5071d4-5905-4128-b69d-d6cb15c40ccd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:26.942647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5071d4-5905-4128-b69d-d6cb15c40ccd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:26.953457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5071d4-5905-4128-b69d-d6cb15c40ccd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:26.955638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5071d4-5905-4128-b69d-d6cb15c40ccd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:27.326338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1f5071d4-5905-4128-b69d-d6cb15c40ccd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:27.339014 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f5071d4-5905-4128-b69d-d6cb15c40ccd tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1378 microversion: 2.1 time: 0.437193 Sep 10 10:46:27.356403 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1791/2297] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:26 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1378 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:27.364626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9f2ae7a4-7499-425a-a9b2-2ae487209569 req-c1236a4a-928d-4212-b404-52d5df8c544a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea77fa94-0bb5-4a1a-ac83-f52354bd8bab", "tag": "483657b3-9983-4615-b9d4-edc08a9355f5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:27.383921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9f2ae7a4-7499-425a-a9b2-2ae487209569 req-c1236a4a-928d-4212-b404-52d5df8c544a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:27.384813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9f2ae7a4-7499-425a-a9b2-2ae487209569 req-c1236a4a-928d-4212-b404-52d5df8c544a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:27.386001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9f2ae7a4-7499-425a-a9b2-2ae487209569 req-c1236a4a-928d-4212-b404-52d5df8c544a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:27.411043 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9f2ae7a4-7499-425a-a9b2-2ae487209569 req-c1236a4a-928d-4212-b404-52d5df8c544a service nova] Creating event network-changed:483657b3-9983-4615-b9d4-edc08a9355f5 for instance ea77fa94-0bb5-4a1a-ac83-f52354bd8bab on n-h2-856894-1 Sep 10 10:46:27.420490 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9f2ae7a4-7499-425a-a9b2-2ae487209569 req-c1236a4a-928d-4212-b404-52d5df8c544a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062612 Sep 10 10:46:27.421662 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1792/2298] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:27.432903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72dcf405-0ced-438e-82f6-a3bd69d91aa9 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:27.437744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-72dcf405-0ced-438e-82f6-a3bd69d91aa9 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:27.449835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72dcf405-0ced-438e-82f6-a3bd69d91aa9 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:27.450916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72dcf405-0ced-438e-82f6-a3bd69d91aa9 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:27.451475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72dcf405-0ced-438e-82f6-a3bd69d91aa9 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:27.452394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72dcf405-0ced-438e-82f6-a3bd69d91aa9 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:27.452964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72dcf405-0ced-438e-82f6-a3bd69d91aa9 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:27.453540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72dcf405-0ced-438e-82f6-a3bd69d91aa9 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:27.770659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-72dcf405-0ced-438e-82f6-a3bd69d91aa9 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:27.780551 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72dcf405-0ced-438e-82f6-a3bd69d91aa9 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1325 microversion: 2.1 time: 0.357148 Sep 10 10:46:27.782024 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1793/2299] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:27 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1325 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:27.787970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a0c2705-c694-4a9b-a603-a015bf968813 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:27.789150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a0c2705-c694-4a9b-a603-a015bf968813 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:27.796521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c2705-c694-4a9b-a603-a015bf968813 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:27.797450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c2705-c694-4a9b-a603-a015bf968813 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:27.798233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c2705-c694-4a9b-a603-a015bf968813 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:27.799570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c2705-c694-4a9b-a603-a015bf968813 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:27.800872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c2705-c694-4a9b-a603-a015bf968813 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:27.801483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c2705-c694-4a9b-a603-a015bf968813 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:27.946917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a0c2705-c694-4a9b-a603-a015bf968813 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:27.955598 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a0c2705-c694-4a9b-a603-a015bf968813 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1488 microversion: 2.1 time: 0.172482 Sep 10 10:46:27.956356 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1794/2300] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:27 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1488 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:27.961950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c7425af0-dab8-44c5-936b-00e19169c02b tempest-SecurityGroupsTestAdminJSON-1260786154 tempest-SecurityGroupsTestAdminJSON-1260786154-project] Calling method '.version_select at 0x7efcae835310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:28.236410 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c7425af0-dab8-44c5-936b-00e19169c02b tempest-SecurityGroupsTestAdminJSON-1260786154 tempest-SecurityGroupsTestAdminJSON-1260786154-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.277888 Sep 10 10:46:28.237005 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1795/2301] 10.222.0.20 () {58 vars in 1191 bytes} [Sat Sep 10 10:46:27 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:28.242531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-442f4245-5e38-48bd-9212-bad15aed079a req-25fc6473-5134-41a0-957c-25fa592011b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee459b93-4eb4-4aef-a49a-932de04dd93c", "tag": "39589cf4-02b9-4961-8e0c-79680b9855a0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:28.272939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-442f4245-5e38-48bd-9212-bad15aed079a req-25fc6473-5134-41a0-957c-25fa592011b2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:28.273474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-442f4245-5e38-48bd-9212-bad15aed079a req-25fc6473-5134-41a0-957c-25fa592011b2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:28.273906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-442f4245-5e38-48bd-9212-bad15aed079a req-25fc6473-5134-41a0-957c-25fa592011b2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:28.302349 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-442f4245-5e38-48bd-9212-bad15aed079a req-25fc6473-5134-41a0-957c-25fa592011b2 service nova] Creating event network-changed:39589cf4-02b9-4961-8e0c-79680b9855a0 for instance ee459b93-4eb4-4aef-a49a-932de04dd93c on n-h2-856894-1 Sep 10 10:46:28.312656 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-442f4245-5e38-48bd-9212-bad15aed079a req-25fc6473-5134-41a0-957c-25fa592011b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073652 Sep 10 10:46:28.313311 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1796/2302] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:28.328032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-25a1bda2-32ff-463e-8acb-b681e08e98dd tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:28.328723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-25a1bda2-32ff-463e-8acb-b681e08e98dd tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:28.342526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25a1bda2-32ff-463e-8acb-b681e08e98dd tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:28.343046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25a1bda2-32ff-463e-8acb-b681e08e98dd tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:28.343477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25a1bda2-32ff-463e-8acb-b681e08e98dd tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:28.344171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25a1bda2-32ff-463e-8acb-b681e08e98dd tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:28.344806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25a1bda2-32ff-463e-8acb-b681e08e98dd tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:28.345050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25a1bda2-32ff-463e-8acb-b681e08e98dd tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:28.708964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25a1bda2-32ff-463e-8acb-b681e08e98dd tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:28.723190 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-25a1bda2-32ff-463e-8acb-b681e08e98dd tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1325 microversion: 2.1 time: 0.406923 Sep 10 10:46:28.724179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1797/2303] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:28 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:28.749660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6faba79d-f2cb-4561-9d2a-aa0fa9224ab0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:28.751569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6faba79d-f2cb-4561-9d2a-aa0fa9224ab0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:28.766264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:28.771376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6faba79d-f2cb-4561-9d2a-aa0fa9224ab0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:28.772138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6faba79d-f2cb-4561-9d2a-aa0fa9224ab0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:28.772775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6faba79d-f2cb-4561-9d2a-aa0fa9224ab0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:28.773725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6faba79d-f2cb-4561-9d2a-aa0fa9224ab0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:28.776276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6faba79d-f2cb-4561-9d2a-aa0fa9224ab0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:28.777129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6faba79d-f2cb-4561-9d2a-aa0fa9224ab0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:28.823208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6faba79d-f2cb-4561-9d2a-aa0fa9224ab0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:46:28.962699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6faba79d-f2cb-4561-9d2a-aa0fa9224ab0 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 204 len: 0 microversion: 2.1 time: 0.221963 Sep 10 10:46:28.963568 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1798/2304] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:46:28 2022] DELETE /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:46:28.968674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50865e4f-48dc-4903-84a8-25f2cabe6176 tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Calling method '.version_select at 0x7efcb2e19ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:29.355151 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50865e4f-48dc-4903-84a8-25f2cabe6176 tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/012868a8-196d-4d45-82bc-0a10151ff5c9" status: 202 len: 0 microversion: 2.1 time: 0.390152 Sep 10 10:46:29.355762 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1799/2305] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:46:28 2022] DELETE /compute/v2.1/os-security-groups/012868a8-196d-4d45-82bc-0a10151ff5c9 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:46:29.361492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79c5f527-eef0-40d9-8d24-f6baec22cbba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:29.362239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79c5f527-eef0-40d9-8d24-f6baec22cbba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:29.373789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79c5f527-eef0-40d9-8d24-f6baec22cbba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:29.374394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79c5f527-eef0-40d9-8d24-f6baec22cbba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:29.375621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79c5f527-eef0-40d9-8d24-f6baec22cbba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:29.376338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79c5f527-eef0-40d9-8d24-f6baec22cbba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:29.376793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79c5f527-eef0-40d9-8d24-f6baec22cbba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:29.377799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79c5f527-eef0-40d9-8d24-f6baec22cbba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:29.568263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79c5f527-eef0-40d9-8d24-f6baec22cbba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:29.576122 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79c5f527-eef0-40d9-8d24-f6baec22cbba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1378 microversion: 2.1 time: 0.219361 Sep 10 10:46:29.576875 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1800/2306] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:29 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1378 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:29.582292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e600b3f-5a53-4c3d-98f6-67af6720c812 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:29.583100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e600b3f-5a53-4c3d-98f6-67af6720c812 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:29.592312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e600b3f-5a53-4c3d-98f6-67af6720c812 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:29.592809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e600b3f-5a53-4c3d-98f6-67af6720c812 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:29.593283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e600b3f-5a53-4c3d-98f6-67af6720c812 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:29.594169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e600b3f-5a53-4c3d-98f6-67af6720c812 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:29.594630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e600b3f-5a53-4c3d-98f6-67af6720c812 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:29.595070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e600b3f-5a53-4c3d-98f6-67af6720c812 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:29.742713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e600b3f-5a53-4c3d-98f6-67af6720c812 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:29.750948 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e600b3f-5a53-4c3d-98f6-67af6720c812 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1325 microversion: 2.1 time: 0.172718 Sep 10 10:46:29.751556 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1801/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:29 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:29.757325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd9af12b-f1e6-4507-9b86-5c327d9dd10d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:29.757731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd9af12b-f1e6-4507-9b86-5c327d9dd10d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:29.765161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd9af12b-f1e6-4507-9b86-5c327d9dd10d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:29.766052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd9af12b-f1e6-4507-9b86-5c327d9dd10d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:29.766651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd9af12b-f1e6-4507-9b86-5c327d9dd10d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:29.767387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd9af12b-f1e6-4507-9b86-5c327d9dd10d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:29.767866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd9af12b-f1e6-4507-9b86-5c327d9dd10d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:29.768296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd9af12b-f1e6-4507-9b86-5c327d9dd10d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:29.938477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd9af12b-f1e6-4507-9b86-5c327d9dd10d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:29.947377 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd9af12b-f1e6-4507-9b86-5c327d9dd10d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1494 microversion: 2.1 time: 0.194172 Sep 10 10:46:29.948069 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1802/2308] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:29 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1494 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:29.952596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56f48cd5-fdbb-4f1a-9cba-3fd620760e16 tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] Calling method '.version_select at 0x7efcaefb0e50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:30.157908 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56f48cd5-fdbb-4f1a-9cba-3fd620760e16 tempest-SecurityGroupsTestAdminJSON-475118836 tempest-SecurityGroupsTestAdminJSON-475118836-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/dd2371f2-6026-4118-b4a4-1198aa811328" status: 202 len: 0 microversion: 2.1 time: 0.208099 Sep 10 10:46:30.164324 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1803/2309] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:46:29 2022] DELETE /compute/v2.1/os-security-groups/dd2371f2-6026-4118-b4a4-1198aa811328 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:46:30.171921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79d0bae2-fdc9-4d4b-8c8d-87a345bba505 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:30.172832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79d0bae2-fdc9-4d4b-8c8d-87a345bba505 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:30.180306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79d0bae2-fdc9-4d4b-8c8d-87a345bba505 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:30.180884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79d0bae2-fdc9-4d4b-8c8d-87a345bba505 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:30.181608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79d0bae2-fdc9-4d4b-8c8d-87a345bba505 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:30.182372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79d0bae2-fdc9-4d4b-8c8d-87a345bba505 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:30.182905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79d0bae2-fdc9-4d4b-8c8d-87a345bba505 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:30.183393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79d0bae2-fdc9-4d4b-8c8d-87a345bba505 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:30.622608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79d0bae2-fdc9-4d4b-8c8d-87a345bba505 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:30.631321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79d0bae2-fdc9-4d4b-8c8d-87a345bba505 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1522 microversion: 2.1 time: 0.464586 Sep 10 10:46:30.631912 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1804/2310] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:30 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:30.636626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aaeb7095-1d2a-4677-973b-477b6dc64f32 tempest-SecurityGroupsTestAdminJSON-1260786154 tempest-SecurityGroupsTestAdminJSON-1260786154-project] Calling method '.version_select at 0x7efcaebc4700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:31.003234 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aaeb7095-1d2a-4677-973b-477b6dc64f32 tempest-SecurityGroupsTestAdminJSON-1260786154 tempest-SecurityGroupsTestAdminJSON-1260786154-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9a9311b3-bcfc-48fa-bb30-b8ca04716de6" status: 202 len: 0 microversion: 2.1 time: 0.370170 Sep 10 10:46:31.004433 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1805/2311] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:46:30 2022] DELETE /compute/v2.1/os-security-groups/9a9311b3-bcfc-48fa-bb30-b8ca04716de6 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:46:31.009684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5e0e2603-cf5d-442d-a78a-f5af7acdba5c req-edca7683-e201-4def-b2ed-516c68fe624b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea77fa94-0bb5-4a1a-ac83-f52354bd8bab", "name": "network-vif-plugged", "status": "completed", "tag": "483657b3-9983-4615-b9d4-edc08a9355f5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:31.020161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5e0e2603-cf5d-442d-a78a-f5af7acdba5c req-edca7683-e201-4def-b2ed-516c68fe624b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:31.020685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5e0e2603-cf5d-442d-a78a-f5af7acdba5c req-edca7683-e201-4def-b2ed-516c68fe624b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:31.021140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5e0e2603-cf5d-442d-a78a-f5af7acdba5c req-edca7683-e201-4def-b2ed-516c68fe624b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:31.033555 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5e0e2603-cf5d-442d-a78a-f5af7acdba5c req-edca7683-e201-4def-b2ed-516c68fe624b service nova] Creating event network-vif-plugged:483657b3-9983-4615-b9d4-edc08a9355f5 for instance ea77fa94-0bb5-4a1a-ac83-f52354bd8bab on n-h2-856894-1 Sep 10 10:46:31.056829 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5e0e2603-cf5d-442d-a78a-f5af7acdba5c req-edca7683-e201-4def-b2ed-516c68fe624b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049138 Sep 10 10:46:31.058605 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1806/2312] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:31.068940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6d919da-fabb-4337-85c4-3d2530839ac7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:31.070478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b6d919da-fabb-4337-85c4-3d2530839ac7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:31.078327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6d919da-fabb-4337-85c4-3d2530839ac7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:31.079044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6d919da-fabb-4337-85c4-3d2530839ac7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:31.079488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6d919da-fabb-4337-85c4-3d2530839ac7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:31.080878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6d919da-fabb-4337-85c4-3d2530839ac7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:31.081709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6d919da-fabb-4337-85c4-3d2530839ac7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:31.082153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6d919da-fabb-4337-85c4-3d2530839ac7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:31.241890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b6d919da-fabb-4337-85c4-3d2530839ac7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:31.250507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b6d919da-fabb-4337-85c4-3d2530839ac7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1378 microversion: 2.1 time: 0.188625 Sep 10 10:46:31.251123 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1807/2313] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:31 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1378 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:31.256985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:31.257752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:31.271005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:31.271773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:31.272429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:31.273381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:31.273918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:31.274537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:31.305342 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] HTTP exception thrown: Action 999 not found Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Request method failure captured: Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818/os-instance-actions/999 HTTP/1.1 Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGru-hYMsFzP0EKdPsN9apxvB7Bu7S3Ym8C-yELYZmHX2VeUx7Hq4hTDvX1xFWiujCB3W8MS1oVYPrf-I9HPKP2wPyEGq1oF94zhKNw604A4ZOWaXlJqlrZcLKTK9PBXgxdi0hWVHBbBXEFX3_Trf9ZcT7O61LMRHcHE8Gl2egsZ4Cs Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 329a84c6505b4cdeae51c66bf0008ef0 Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-732358278 Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/329a84c6505b4cdeae51c66bf0008ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/329a84c6505b4cdeae51c66bf0008ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/329a84c6505b4cdeae51c66bf0008ef0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_329a84c6505b4cdeae51c66bf0008ef0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-732358278 Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 329a84c6505b4cdeae51c66bf0008ef0 Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-732358278 Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-InstanceActionsNegativeTestJSON-732358278-project Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 5d0a41557e8148d7bc2ae4530132b80c Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-732358278-project Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: exception: Action 999 not found Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '3376e479-fd19-4d2f-8503-5381a31ac818', 'id': '999'} Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 10 10:46:31.313563 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:31.317462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Returning 404 to user: Action 999 not found {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:31.317462 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a536ba0b-2cb7-4a6a-a977-6e77d421254b tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.063337 Sep 10 10:46:31.317462 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1808/2314] 10.222.0.20 () {58 vars in 1308 bytes} [Sat Sep 10 10:46:31 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818/os-instance-actions/999 => generated 66 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:46:31.323072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69b591cb-62dc-4533-9b76-4017262f8604 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:31.323766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69b591cb-62dc-4533-9b76-4017262f8604 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:31.330123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b591cb-62dc-4533-9b76-4017262f8604 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:31.331300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b591cb-62dc-4533-9b76-4017262f8604 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:31.332609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b591cb-62dc-4533-9b76-4017262f8604 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:31.333697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b591cb-62dc-4533-9b76-4017262f8604 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:31.334473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b591cb-62dc-4533-9b76-4017262f8604 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:31.335092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b591cb-62dc-4533-9b76-4017262f8604 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:31.340783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:31.574194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-69b591cb-62dc-4533-9b76-4017262f8604 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:31.586110 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69b591cb-62dc-4533-9b76-4017262f8604 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1325 microversion: 2.1 time: 0.267865 Sep 10 10:46:31.586808 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1809/2315] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:31 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:31.592061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c5cab059-98c6-48d5-bcec-c94e7ff05789 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:31.592983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c5cab059-98c6-48d5-bcec-c94e7ff05789 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:31.601313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5cab059-98c6-48d5-bcec-c94e7ff05789 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:31.602128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5cab059-98c6-48d5-bcec-c94e7ff05789 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:31.602783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5cab059-98c6-48d5-bcec-c94e7ff05789 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:31.605716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5cab059-98c6-48d5-bcec-c94e7ff05789 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:31.606666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5cab059-98c6-48d5-bcec-c94e7ff05789 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:31.607334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5cab059-98c6-48d5-bcec-c94e7ff05789 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:31.859653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5cab059-98c6-48d5-bcec-c94e7ff05789 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:31.867521 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c5cab059-98c6-48d5-bcec-c94e7ff05789 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1494 microversion: 2.1 time: 0.279281 Sep 10 10:46:31.868100 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1810/2316] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:31 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1494 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:31.875584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37c361a3-a46f-41bf-81ac-e62c355c82ac tempest-SecurityGroupsTestAdminJSON-1260786154 tempest-SecurityGroupsTestAdminJSON-1260786154-project] Calling method '.version_select at 0x7efcaefb0f70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:32.131565 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-37c361a3-a46f-41bf-81ac-e62c355c82ac tempest-SecurityGroupsTestAdminJSON-1260786154 tempest-SecurityGroupsTestAdminJSON-1260786154-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b4dd6cf0-ed5b-415b-81d5-a3dfa2132a12" status: 202 len: 0 microversion: 2.1 time: 0.262324 Sep 10 10:46:32.134605 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1811/2317] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:46:31 2022] DELETE /compute/v2.1/os-security-groups/b4dd6cf0-ed5b-415b-81d5-a3dfa2132a12 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:46:32.145379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a79dea1-0426-43c6-a123-150585d49eb2 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '.version_select at 0x7efcaf19edc0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:32.146953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a79dea1-0426-43c6-a123-150585d49eb2 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: a894d368-e38b-42a5-a9cd-42d852689dfc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:32.156327 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-7a79dea1-0426-43c6-a123-150585d49eb2 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] HTTP exception thrown: Instance a894d368-e38b-42a5-a9cd-42d852689dfc could not be found. Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a79dea1-0426-43c6-a123-150585d49eb2 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Request method failure captured: Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/a894d368-e38b-42a5-a9cd-42d852689dfc/os-instance-actions HTTP/1.1 Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGru-hYMsFzP0EKdPsN9apxvB7Bu7S3Ym8C-yELYZmHX2VeUx7Hq4hTDvX1xFWiujCB3W8MS1oVYPrf-I9HPKP2wPyEGq1oF94zhKNw604A4ZOWaXlJqlrZcLKTK9PBXgxdi0hWVHBbBXEFX3_Trf9ZcT7O61LMRHcHE8Gl2egsZ4Cs Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 329a84c6505b4cdeae51c66bf0008ef0 Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-732358278 Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/329a84c6505b4cdeae51c66bf0008ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/329a84c6505b4cdeae51c66bf0008ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/329a84c6505b4cdeae51c66bf0008ef0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_329a84c6505b4cdeae51c66bf0008ef0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-732358278 Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 329a84c6505b4cdeae51c66bf0008ef0 Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-732358278 Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-InstanceActionsNegativeTestJSON-732358278-project Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 5d0a41557e8148d7bc2ae4530132b80c Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-732358278-project Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance a894d368-e38b-42a5-a9cd-42d852689dfc could not be found. Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': 'a894d368-e38b-42a5-a9cd-42d852689dfc'} Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a894d368-e38b-42a5-a9cd-42d852689dfc could not be found. Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:46:32.159149 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a894d368-e38b-42a5-a9cd-42d852689dfc could not be found. Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a894d368-e38b-42a5-a9cd-42d852689dfc could not be found. Sep 10 10:46:32.165727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:32.169348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a79dea1-0426-43c6-a123-150585d49eb2 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Returning 404 to user: Instance a894d368-e38b-42a5-a9cd-42d852689dfc could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:32.170483 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a79dea1-0426-43c6-a123-150585d49eb2 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/a894d368-e38b-42a5-a9cd-42d852689dfc/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.034478 Sep 10 10:46:32.177160 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1812/2318] 10.222.0.20 () {58 vars in 1296 bytes} [Sat Sep 10 10:46:32 2022] GET /compute/v2.1/servers/a894d368-e38b-42a5-a9cd-42d852689dfc/os-instance-actions => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:46:32.183271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-466a3ada-4923-4933-a8bf-86310b357ad3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:32.185381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-466a3ada-4923-4933-a8bf-86310b357ad3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:32.198882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-466a3ada-4923-4933-a8bf-86310b357ad3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:32.200281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-466a3ada-4923-4933-a8bf-86310b357ad3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:32.201879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-466a3ada-4923-4933-a8bf-86310b357ad3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:32.205510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-466a3ada-4923-4933-a8bf-86310b357ad3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:32.206334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-466a3ada-4923-4933-a8bf-86310b357ad3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:32.207572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-466a3ada-4923-4933-a8bf-86310b357ad3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:32.250208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-466a3ada-4923-4933-a8bf-86310b357ad3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:46:32.403208 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-466a3ada-4923-4933-a8bf-86310b357ad3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 204 len: 0 microversion: 2.1 time: 0.223866 Sep 10 10:46:32.404119 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1813/2319] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:46:32 2022] DELETE /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:46:32.413015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-399dab5b-cb0b-4df3-8afd-8c94cf022351 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:32.413962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-399dab5b-cb0b-4df3-8afd-8c94cf022351 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:32.426688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-399dab5b-cb0b-4df3-8afd-8c94cf022351 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:32.427599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-399dab5b-cb0b-4df3-8afd-8c94cf022351 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:32.429558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-399dab5b-cb0b-4df3-8afd-8c94cf022351 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:32.430727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-399dab5b-cb0b-4df3-8afd-8c94cf022351 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:32.431198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-399dab5b-cb0b-4df3-8afd-8c94cf022351 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:32.433250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-399dab5b-cb0b-4df3-8afd-8c94cf022351 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:32.529485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:32.574402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=22 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:32.765192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-399dab5b-cb0b-4df3-8afd-8c94cf022351 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:32.774875 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-399dab5b-cb0b-4df3-8afd-8c94cf022351 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1378 microversion: 2.1 time: 0.369270 Sep 10 10:46:32.776422 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1814/2320] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:32 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1378 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:32.782193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07831a5a-aac0-4d39-87c7-b65bcc5612c9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:32.783005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07831a5a-aac0-4d39-87c7-b65bcc5612c9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:32.798028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07831a5a-aac0-4d39-87c7-b65bcc5612c9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:32.798527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07831a5a-aac0-4d39-87c7-b65bcc5612c9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:32.799980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07831a5a-aac0-4d39-87c7-b65bcc5612c9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:32.801550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07831a5a-aac0-4d39-87c7-b65bcc5612c9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:32.802201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07831a5a-aac0-4d39-87c7-b65bcc5612c9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:32.802805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07831a5a-aac0-4d39-87c7-b65bcc5612c9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:33.026083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-07831a5a-aac0-4d39-87c7-b65bcc5612c9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:33.036544 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07831a5a-aac0-4d39-87c7-b65bcc5612c9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1528 microversion: 2.1 time: 0.258135 Sep 10 10:46:33.049454 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1815/2321] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:32 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1528 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:33.067387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a2822c5-f6d9-4edd-99e1-c8bc1d0a399c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:33.068304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1a2822c5-f6d9-4edd-99e1-c8bc1d0a399c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:33.075872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a2822c5-f6d9-4edd-99e1-c8bc1d0a399c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:33.076599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a2822c5-f6d9-4edd-99e1-c8bc1d0a399c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:33.077230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a2822c5-f6d9-4edd-99e1-c8bc1d0a399c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:33.078300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a2822c5-f6d9-4edd-99e1-c8bc1d0a399c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:33.078933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a2822c5-f6d9-4edd-99e1-c8bc1d0a399c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:33.079564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a2822c5-f6d9-4edd-99e1-c8bc1d0a399c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:33.230439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1a2822c5-f6d9-4edd-99e1-c8bc1d0a399c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:33.238490 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a2822c5-f6d9-4edd-99e1-c8bc1d0a399c tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1325 microversion: 2.1 time: 0.192153 Sep 10 10:46:33.239073 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1816/2322] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:33 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1325 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:33.243669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-63869d93-98c1-42e0-b557-b21652728b44 req-d3b8ce9f-8c25-4dad-b5d1-12c60c70cdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18610e7e-0f81-4038-abc9-9772929a13fe", "name": "network-vif-deleted", "tag": "ff189d0a-d720-4fbe-8d12-7755848bd470"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:33.252939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-63869d93-98c1-42e0-b557-b21652728b44 req-d3b8ce9f-8c25-4dad-b5d1-12c60c70cdec service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:33.253489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-63869d93-98c1-42e0-b557-b21652728b44 req-d3b8ce9f-8c25-4dad-b5d1-12c60c70cdec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:33.253922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-63869d93-98c1-42e0-b557-b21652728b44 req-d3b8ce9f-8c25-4dad-b5d1-12c60c70cdec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:33.266185 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-63869d93-98c1-42e0-b557-b21652728b44 req-d3b8ce9f-8c25-4dad-b5d1-12c60c70cdec service nova] Creating event network-vif-deleted:ff189d0a-d720-4fbe-8d12-7755848bd470 for instance 18610e7e-0f81-4038-abc9-9772929a13fe on n-h2-856894-1 Sep 10 10:46:33.271918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-63869d93-98c1-42e0-b557-b21652728b44 req-d3b8ce9f-8c25-4dad-b5d1-12c60c70cdec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031686 Sep 10 10:46:33.272521 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1817/2323] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:33.277630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f731367f-9449-4df2-b8d4-f3321eb509b9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:33.278288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f731367f-9449-4df2-b8d4-f3321eb509b9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:33.285133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f731367f-9449-4df2-b8d4-f3321eb509b9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:33.285625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f731367f-9449-4df2-b8d4-f3321eb509b9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:33.286485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f731367f-9449-4df2-b8d4-f3321eb509b9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:33.286743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f731367f-9449-4df2-b8d4-f3321eb509b9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:33.287238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f731367f-9449-4df2-b8d4-f3321eb509b9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:33.287690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f731367f-9449-4df2-b8d4-f3321eb509b9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:33.364408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f731367f-9449-4df2-b8d4-f3321eb509b9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:33.374355 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f731367f-9449-4df2-b8d4-f3321eb509b9 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1452 microversion: 2.1 time: 0.100539 Sep 10 10:46:33.375485 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1818/2324] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:33 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:33.799743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7e1edd24-9392-4ed1-abbf-80b202d0c132 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:33.800896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e1edd24-9392-4ed1-abbf-80b202d0c132 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:33.811280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1edd24-9392-4ed1-abbf-80b202d0c132 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:33.811786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1edd24-9392-4ed1-abbf-80b202d0c132 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:33.812212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1edd24-9392-4ed1-abbf-80b202d0c132 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:33.813432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1edd24-9392-4ed1-abbf-80b202d0c132 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:33.814093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1edd24-9392-4ed1-abbf-80b202d0c132 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:33.815132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1edd24-9392-4ed1-abbf-80b202d0c132 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:34.057956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e1edd24-9392-4ed1-abbf-80b202d0c132 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:34.067804 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7e1edd24-9392-4ed1-abbf-80b202d0c132 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1378 microversion: 2.1 time: 0.271324 Sep 10 10:46:34.083468 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1819/2325] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:33 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1378 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:46:34.088534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0725113e-5cdc-45b5-88b1-cbad6f398bc3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:34.089201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0725113e-5cdc-45b5-88b1-cbad6f398bc3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:34.095478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0725113e-5cdc-45b5-88b1-cbad6f398bc3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:34.096068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0725113e-5cdc-45b5-88b1-cbad6f398bc3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:34.096574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0725113e-5cdc-45b5-88b1-cbad6f398bc3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:34.097550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0725113e-5cdc-45b5-88b1-cbad6f398bc3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:34.098189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0725113e-5cdc-45b5-88b1-cbad6f398bc3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:34.098692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0725113e-5cdc-45b5-88b1-cbad6f398bc3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:34.493763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0725113e-5cdc-45b5-88b1-cbad6f398bc3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:34.504662 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0725113e-5cdc-45b5-88b1-cbad6f398bc3 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1528 microversion: 2.1 time: 0.419943 Sep 10 10:46:34.510957 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1820/2326] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:34 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1528 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:34.515840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78887824-7be1-43fd-8f52-05312edc6bfe tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:34.516453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78887824-7be1-43fd-8f52-05312edc6bfe tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:34.526143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78887824-7be1-43fd-8f52-05312edc6bfe tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:34.544787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78887824-7be1-43fd-8f52-05312edc6bfe tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:34.545297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78887824-7be1-43fd-8f52-05312edc6bfe tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:34.546056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78887824-7be1-43fd-8f52-05312edc6bfe tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:34.546541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78887824-7be1-43fd-8f52-05312edc6bfe tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:34.546974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78887824-7be1-43fd-8f52-05312edc6bfe tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:34.823227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-78887824-7be1-43fd-8f52-05312edc6bfe tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:34.835092 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78887824-7be1-43fd-8f52-05312edc6bfe tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1523 microversion: 2.1 time: 0.322774 Sep 10 10:46:34.835775 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1821/2327] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:34 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:34.861639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:34.862534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:34.871169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:34.871944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:34.873046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:34.874190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:34.874874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:34.875519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:34.953717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:34.955650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:34.956149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:34.956623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lazy-loading 'fault' on Instance uuid 18610e7e-0f81-4038-abc9-9772929a13fe {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:46:35.040573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:35.052547 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-84b09f02-7681-4ffd-8165-de91463008e5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 200 len: 1304 microversion: 2.1 time: 0.198515 Sep 10 10:46:35.065897 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1822/2328] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:34 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 1304 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:35.087693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-88311402-9ae1-4177-875a-00734ee90d0e req-e49815bb-b459-418a-8468-107da2666446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee459b93-4eb4-4aef-a49a-932de04dd93c", "name": "network-vif-plugged", "status": "completed", "tag": "39589cf4-02b9-4961-8e0c-79680b9855a0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:35.113868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-88311402-9ae1-4177-875a-00734ee90d0e req-e49815bb-b459-418a-8468-107da2666446 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.114468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-88311402-9ae1-4177-875a-00734ee90d0e req-e49815bb-b459-418a-8468-107da2666446 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.114915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-88311402-9ae1-4177-875a-00734ee90d0e req-e49815bb-b459-418a-8468-107da2666446 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.152925 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-88311402-9ae1-4177-875a-00734ee90d0e req-e49815bb-b459-418a-8468-107da2666446 service nova] Creating event network-vif-plugged:39589cf4-02b9-4961-8e0c-79680b9855a0 for instance ee459b93-4eb4-4aef-a49a-932de04dd93c on n-h2-856894-1 Sep 10 10:46:35.164556 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-88311402-9ae1-4177-875a-00734ee90d0e req-e49815bb-b459-418a-8468-107da2666446 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088563 Sep 10 10:46:35.165810 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1823/2329] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:35.172279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c90cf24-7858-46d4-a922-daa413a6120a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:35.173613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c90cf24-7858-46d4-a922-daa413a6120a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:35.182358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c90cf24-7858-46d4-a922-daa413a6120a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.183160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c90cf24-7858-46d4-a922-daa413a6120a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.184261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c90cf24-7858-46d4-a922-daa413a6120a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.185634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c90cf24-7858-46d4-a922-daa413a6120a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.186947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c90cf24-7858-46d4-a922-daa413a6120a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.187621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c90cf24-7858-46d4-a922-daa413a6120a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.233277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c90cf24-7858-46d4-a922-daa413a6120a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:46:35.445671 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c90cf24-7858-46d4-a922-daa413a6120a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 204 len: 0 microversion: 2.1 time: 0.278014 Sep 10 10:46:35.450103 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1824/2330] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:46:35 2022] DELETE /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:46:35.452446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05d20656-9517-4b7c-ac4d-afd0bd734625 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:35.453627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05d20656-9517-4b7c-ac4d-afd0bd734625 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:35.466112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05d20656-9517-4b7c-ac4d-afd0bd734625 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.467078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05d20656-9517-4b7c-ac4d-afd0bd734625 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.467749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05d20656-9517-4b7c-ac4d-afd0bd734625 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.468782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05d20656-9517-4b7c-ac4d-afd0bd734625 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.469371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05d20656-9517-4b7c-ac4d-afd0bd734625 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.470212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05d20656-9517-4b7c-ac4d-afd0bd734625 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.504913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:35.652502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05d20656-9517-4b7c-ac4d-afd0bd734625 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:35.661974 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05d20656-9517-4b7c-ac4d-afd0bd734625 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1378 microversion: 2.1 time: 0.213980 Sep 10 10:46:35.662737 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1825/2331] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:35 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1378 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:35.678596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ebe9cb72-0026-4583-a36e-8286934ec23f req-2df7c84f-5a5d-4da6-ac57-ae271b947277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3376e479-fd19-4d2f-8503-5381a31ac818", "name": "network-vif-deleted", "tag": "e3a82977-524e-4482-8f95-466ac6f9fb31"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:35.691968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ebe9cb72-0026-4583-a36e-8286934ec23f req-2df7c84f-5a5d-4da6-ac57-ae271b947277 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.692657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ebe9cb72-0026-4583-a36e-8286934ec23f req-2df7c84f-5a5d-4da6-ac57-ae271b947277 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.693320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ebe9cb72-0026-4583-a36e-8286934ec23f req-2df7c84f-5a5d-4da6-ac57-ae271b947277 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.709626 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ebe9cb72-0026-4583-a36e-8286934ec23f req-2df7c84f-5a5d-4da6-ac57-ae271b947277 service nova] Creating event network-vif-deleted:e3a82977-524e-4482-8f95-466ac6f9fb31 for instance 3376e479-fd19-4d2f-8503-5381a31ac818 on n-h2-856894-1 Sep 10 10:46:35.714453 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ebe9cb72-0026-4583-a36e-8286934ec23f req-2df7c84f-5a5d-4da6-ac57-ae271b947277 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041048 Sep 10 10:46:35.715394 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1826/2332] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:35.720497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71ed0187-e064-45fb-ad51-3ff3d0a7608a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:35.721289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-71ed0187-e064-45fb-ad51-3ff3d0a7608a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:35.728813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71ed0187-e064-45fb-ad51-3ff3d0a7608a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.729332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71ed0187-e064-45fb-ad51-3ff3d0a7608a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.729770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71ed0187-e064-45fb-ad51-3ff3d0a7608a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.730469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71ed0187-e064-45fb-ad51-3ff3d0a7608a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.730921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71ed0187-e064-45fb-ad51-3ff3d0a7608a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.731344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71ed0187-e064-45fb-ad51-3ff3d0a7608a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.887045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-71ed0187-e064-45fb-ad51-3ff3d0a7608a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:35.895927 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71ed0187-e064-45fb-ad51-3ff3d0a7608a tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1529 microversion: 2.1 time: 0.179094 Sep 10 10:46:35.904347 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1827/2333] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:35 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1529 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:35.910139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:35.910875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:35.918670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.919417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.919963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.921258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.921835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.922802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.959944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:35.960861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:35.961340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:35.961831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lazy-loading 'fault' on Instance uuid 3376e479-fd19-4d2f-8503-5381a31ac818 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:46:36.002684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:36.017311 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-713733fb-cf8d-4598-afa5-e621146ad5ae tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1315 microversion: 2.1 time: 0.111269 Sep 10 10:46:36.018356 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1828/2334] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:35 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1315 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:36.082291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:36.083230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:36.090171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:36.090657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:36.091165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:36.091931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:36.092476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:36.092971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:36.108678 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe HTTP/1.1 Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '18610e7e-0f81-4038-abc9-9772929a13fe'} Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:36.110753 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:36.115211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:36.115211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:36.115211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:36.115211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:36.115211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:36.115211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:46:36.115211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:36.115211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:36.115900 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f363cfad-057e-4bf5-81b8-5074d71b30fb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 404 len: 111 microversion: 2.1 time: 0.035432 Sep 10 10:46:36.116704 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1829/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:36 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:46:36.245377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1642209153", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "15abac29-c434-4802-9cd4-4bace1ac4f7e"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:36.311112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] validate_networks() for [('15abac29-c434-4802-9cd4-4bace1ac4f7e', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:46:36.772147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:46:36.772743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:46:36.773028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:46:36.773456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:46:36.773866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:46:36.785478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:36.786329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:36.786925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:36.787817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:36.788441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:36.789024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:36.810499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:46:36.817507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Getting quotas for user fa978e59fa334084b722d116c761380f and project 1749f9d599ef467e84f306202e2a6b6e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:46:36.839201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:46:36.842497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:46:36.895394 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8eeceba0-b921-404d-ba3c-5b855ba9c390 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653889 Sep 10 10:46:36.896147 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1830/2336] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:46:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:46:36.910525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3cf5d16-9738-48c4-96eb-1db7442d4f63 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:36.911385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c3cf5d16-9738-48c4-96eb-1db7442d4f63 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:36.919735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3cf5d16-9738-48c4-96eb-1db7442d4f63 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:36.920374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3cf5d16-9738-48c4-96eb-1db7442d4f63 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:36.920822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3cf5d16-9738-48c4-96eb-1db7442d4f63 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:36.921695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3cf5d16-9738-48c4-96eb-1db7442d4f63 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:36.922403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3cf5d16-9738-48c4-96eb-1db7442d4f63 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:36.923150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3cf5d16-9738-48c4-96eb-1db7442d4f63 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:37.117378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3cf5d16-9738-48c4-96eb-1db7442d4f63 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:37.126832 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3cf5d16-9738-48c4-96eb-1db7442d4f63 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1378 microversion: 2.1 time: 0.222294 Sep 10 10:46:37.127641 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1831/2337] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:36 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1378 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:37.133995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d044c5d6-2b99-4af1-9874-52b85f820e3b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:37.135623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d044c5d6-2b99-4af1-9874-52b85f820e3b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:37.208783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d044c5d6-2b99-4af1-9874-52b85f820e3b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:37.216782 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d044c5d6-2b99-4af1-9874-52b85f820e3b tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1215 microversion: 2.1 time: 0.087369 Sep 10 10:46:37.229342 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1832/2338] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:37 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:37.229342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e695e75c-0696-4407-b5a5-84b8e22731b0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:37.229342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e695e75c-0696-4407-b5a5-84b8e22731b0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:37.229342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:37.231908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e695e75c-0696-4407-b5a5-84b8e22731b0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:37.232619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e695e75c-0696-4407-b5a5-84b8e22731b0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:37.233452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e695e75c-0696-4407-b5a5-84b8e22731b0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:37.234329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e695e75c-0696-4407-b5a5-84b8e22731b0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:37.234969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e695e75c-0696-4407-b5a5-84b8e22731b0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:37.235399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e695e75c-0696-4407-b5a5-84b8e22731b0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:37.441924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e695e75c-0696-4407-b5a5-84b8e22731b0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:37.460053 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e695e75c-0696-4407-b5a5-84b8e22731b0 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1529 microversion: 2.1 time: 0.239860 Sep 10 10:46:37.460979 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1833/2339] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:37 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1529 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:37.803571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-979605433", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:37.876374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:46:38.199113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:46:38.199849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:46:38.200124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:46:38.200683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:46:38.201117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:46:38.210807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:38.211296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:38.211730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:38.212447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:38.213245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:38.213860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:38.235910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Getting quotas for project 4381e6e48cd540d89039afd241f4b570. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:46:38.241523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Getting quotas for user 6a9f563e69c34220a28739a06e7abbd5 and project 4381e6e48cd540d89039afd241f4b570. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:46:38.258796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:46:38.262396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:46:38.322461 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-455ccdb0-07ce-4c9e-8b68-875ab76ed13e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859596 Sep 10 10:46:38.323404 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1834/2340] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:46:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:46:38.328911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:38.329860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:38.341643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:38.342767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:38.343935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:38.345098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:38.345848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:38.346707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:38.387566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:38.388303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:38.388955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:38.389703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lazy-loading 'fault' on Instance uuid 3376e479-fd19-4d2f-8503-5381a31ac818 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:46:38.555984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0a41557e8148d7bc2ae4530132b80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329a84c6505b4cdeae51c66bf0008ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:38.568592 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c4f2e70-f999-4c12-b3bf-3a742dcd89a9 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 200 len: 1315 microversion: 2.1 time: 0.243778 Sep 10 10:46:38.569967 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1835/2341] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:38 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:38.586343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c712ab43-b21c-4128-ba02-9835341bbbd2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:38.586985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c712ab43-b21c-4128-ba02-9835341bbbd2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:38.601012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c712ab43-b21c-4128-ba02-9835341bbbd2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:38.601539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c712ab43-b21c-4128-ba02-9835341bbbd2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:38.601972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c712ab43-b21c-4128-ba02-9835341bbbd2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:38.602674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c712ab43-b21c-4128-ba02-9835341bbbd2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:38.603124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c712ab43-b21c-4128-ba02-9835341bbbd2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:38.603551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c712ab43-b21c-4128-ba02-9835341bbbd2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:39.355225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c712ab43-b21c-4128-ba02-9835341bbbd2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:39.363755 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c712ab43-b21c-4128-ba02-9835341bbbd2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1528 microversion: 2.1 time: 0.792567 Sep 10 10:46:39.368967 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1836/2342] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:38 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1528 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:39.383027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a3fd2fd1-4c3c-4455-a901-f86d3f35f78a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:39.384253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a3fd2fd1-4c3c-4455-a901-f86d3f35f78a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:39.397465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3fd2fd1-4c3c-4455-a901-f86d3f35f78a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:39.398738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3fd2fd1-4c3c-4455-a901-f86d3f35f78a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:39.399427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3fd2fd1-4c3c-4455-a901-f86d3f35f78a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:39.400614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3fd2fd1-4c3c-4455-a901-f86d3f35f78a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:39.401848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3fd2fd1-4c3c-4455-a901-f86d3f35f78a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:39.402496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3fd2fd1-4c3c-4455-a901-f86d3f35f78a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:39.513092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3fd2fd1-4c3c-4455-a901-f86d3f35f78a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:39.527786 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a3fd2fd1-4c3c-4455-a901-f86d3f35f78a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1285 microversion: 2.1 time: 0.149373 Sep 10 10:46:39.528478 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1837/2343] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:39 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:39.554616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2dbeb98-d4a7-4d2c-b031-768a1277b5bb tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:39.555480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2dbeb98-d4a7-4d2c-b031-768a1277b5bb tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:39.563183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2dbeb98-d4a7-4d2c-b031-768a1277b5bb tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:39.563784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2dbeb98-d4a7-4d2c-b031-768a1277b5bb tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:39.564333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2dbeb98-d4a7-4d2c-b031-768a1277b5bb tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:39.564937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2dbeb98-d4a7-4d2c-b031-768a1277b5bb tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:39.566110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2dbeb98-d4a7-4d2c-b031-768a1277b5bb tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:39.566547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2dbeb98-d4a7-4d2c-b031-768a1277b5bb tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:39.687532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2dbeb98-d4a7-4d2c-b031-768a1277b5bb tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:39.696565 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2dbeb98-d4a7-4d2c-b031-768a1277b5bb tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1218 microversion: 2.1 time: 0.166697 Sep 10 10:46:39.712480 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1838/2344] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:39 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:39.714633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:39.715265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:39.722266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:39.722760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:39.723197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:39.724150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:39.724614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:39.725047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:39.760824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:39.761364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:39.761966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:39.762602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lazy-loading 'fault' on Instance uuid ea77fa94-0bb5-4a1a-ac83-f52354bd8bab {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:46:39.829713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d3452f1dd4b7781f0f6d490115e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee641ddfdc8a4ff6a9e9a58b705a1fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:39.843252 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-40f17bf8-fde5-43f4-983a-9b011dd03a2e tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 200 len: 1315 microversion: 2.1 time: 0.132448 Sep 10 10:46:39.853421 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1839/2345] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:39 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:39.858314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-aed408d5-0925-46af-ba13-1e38755d8c75 req-35184ac9-1fd0-458e-b270-138fbc1b99cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea77fa94-0bb5-4a1a-ac83-f52354bd8bab", "name": "network-vif-deleted", "tag": "483657b3-9983-4615-b9d4-edc08a9355f5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:39.868438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aed408d5-0925-46af-ba13-1e38755d8c75 req-35184ac9-1fd0-458e-b270-138fbc1b99cc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:39.868923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aed408d5-0925-46af-ba13-1e38755d8c75 req-35184ac9-1fd0-458e-b270-138fbc1b99cc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:39.869568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-aed408d5-0925-46af-ba13-1e38755d8c75 req-35184ac9-1fd0-458e-b270-138fbc1b99cc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:39.882190 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-aed408d5-0925-46af-ba13-1e38755d8c75 req-35184ac9-1fd0-458e-b270-138fbc1b99cc service nova] Creating event network-vif-deleted:483657b3-9983-4615-b9d4-edc08a9355f5 for instance ea77fa94-0bb5-4a1a-ac83-f52354bd8bab on n-h2-856894-1 Sep 10 10:46:39.887115 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-aed408d5-0925-46af-ba13-1e38755d8c75 req-35184ac9-1fd0-458e-b270-138fbc1b99cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032475 Sep 10 10:46:39.888028 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1840/2346] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:39.893913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d14ea6d-f313-4c20-8302-39af1aeefb15 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:39.894612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d14ea6d-f313-4c20-8302-39af1aeefb15 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:39.901743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d14ea6d-f313-4c20-8302-39af1aeefb15 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:39.902229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d14ea6d-f313-4c20-8302-39af1aeefb15 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:39.902660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d14ea6d-f313-4c20-8302-39af1aeefb15 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:39.903354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d14ea6d-f313-4c20-8302-39af1aeefb15 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:39.903802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d14ea6d-f313-4c20-8302-39af1aeefb15 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:39.904222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d14ea6d-f313-4c20-8302-39af1aeefb15 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:40.194295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d14ea6d-f313-4c20-8302-39af1aeefb15 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:40.213287 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d14ea6d-f313-4c20-8302-39af1aeefb15 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1528 microversion: 2.1 time: 0.323815 Sep 10 10:46:40.229712 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1841/2347] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:39 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1528 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:40.229712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:40.229712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] [instance: 3376e479-fd19-4d2f-8503-5381a31ac818] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:40.237548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:40.237548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:40.237548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:40.237548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:40.237548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:40.237548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:40.252124 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] HTTP exception thrown: Instance 3376e479-fd19-4d2f-8503-5381a31ac818 could not be found. Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Request method failure captured: Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 HTTP/1.1 Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGru-hYMsFzP0EKdPsN9apxvB7Bu7S3Ym8C-yELYZmHX2VeUx7Hq4hTDvX1xFWiujCB3W8MS1oVYPrf-I9HPKP2wPyEGq1oF94zhKNw604A4ZOWaXlJqlrZcLKTK9PBXgxdi0hWVHBbBXEFX3_Trf9ZcT7O61LMRHcHE8Gl2egsZ4Cs Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 329a84c6505b4cdeae51c66bf0008ef0 Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-732358278 Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/329a84c6505b4cdeae51c66bf0008ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/329a84c6505b4cdeae51c66bf0008ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/329a84c6505b4cdeae51c66bf0008ef0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_329a84c6505b4cdeae51c66bf0008ef0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-732358278 Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 329a84c6505b4cdeae51c66bf0008ef0 Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-732358278 Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-InstanceActionsNegativeTestJSON-732358278-project Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 5d0a41557e8148d7bc2ae4530132b80c Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-732358278-project Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 3376e479-fd19-4d2f-8503-5381a31ac818 could not be found. Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '3376e479-fd19-4d2f-8503-5381a31ac818'} Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3376e479-fd19-4d2f-8503-5381a31ac818 could not be found. Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3376e479-fd19-4d2f-8503-5381a31ac818 could not be found. Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:40.254514 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:40.260351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:40.260351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:40.260351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:40.260351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:40.260351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:40.260351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:40.260351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3376e479-fd19-4d2f-8503-5381a31ac818 could not be found. Sep 10 10:46:40.260351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:40.260351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] Returning 404 to user: Instance 3376e479-fd19-4d2f-8503-5381a31ac818 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:40.260351 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f9670ab9-2c6d-44a7-8214-bbf580ca6295 tempest-InstanceActionsNegativeTestJSON-732358278 tempest-InstanceActionsNegativeTestJSON-732358278-project] 10.222.0.20 "GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818" status: 404 len: 111 microversion: 2.1 time: 0.035749 Sep 10 10:46:40.261621 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1842/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:40 2022] GET /compute/v2.1/servers/3376e479-fd19-4d2f-8503-5381a31ac818 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:46:40.266986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-31feb782-d8be-4865-a752-3edf3f69edcf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5066c150-ffdd-492d-9f94-a558840e6cdd"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:40.271065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-31feb782-d8be-4865-a752-3edf3f69edcf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:40.277661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31feb782-d8be-4865-a752-3edf3f69edcf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:40.278162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31feb782-d8be-4865-a752-3edf3f69edcf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:40.278607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31feb782-d8be-4865-a752-3edf3f69edcf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:40.279319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31feb782-d8be-4865-a752-3edf3f69edcf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:40.279781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31feb782-d8be-4865-a752-3edf3f69edcf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:40.280212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31feb782-d8be-4865-a752-3edf3f69edcf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:40.891276 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-31feb782-d8be-4865-a752-3edf3f69edcf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627335 Sep 10 10:46:40.898025 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1843/2349] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 10:46:40 2022] POST /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments => generated 194 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:40.915680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e56bad5f-0481-4b69-8a66-e8864451a161 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:40.972363 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e56bad5f-0481-4b69-8a66-e8864451a161 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/d3000ce6-d5ed-4e3f-9eae-b1e603273624" status: 202 len: 0 microversion: 2.1 time: 0.069420 Sep 10 10:46:40.973897 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1844/2350] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:46:40 2022] DELETE /compute/v2.1/flavors/d3000ce6-d5ed-4e3f-9eae-b1e603273624 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:46:40.979901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2aaa094-bfa8-4308-b234-cb165b01d817 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:40.988248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2aaa094-bfa8-4308-b234-cb165b01d817 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:41.009219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2aaa094-bfa8-4308-b234-cb165b01d817 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:41.010919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2aaa094-bfa8-4308-b234-cb165b01d817 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:41.015124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2aaa094-bfa8-4308-b234-cb165b01d817 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:41.016588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2aaa094-bfa8-4308-b234-cb165b01d817 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:41.019124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2aaa094-bfa8-4308-b234-cb165b01d817 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:41.021927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2aaa094-bfa8-4308-b234-cb165b01d817 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:41.483607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d2aaa094-bfa8-4308-b234-cb165b01d817 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:41.488473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:41.493780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2aaa094-bfa8-4308-b234-cb165b01d817 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1315 microversion: 2.1 time: 0.518541 Sep 10 10:46:41.509671 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1845/2351] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:40 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:41.512459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1d0f365f-5b6c-4fc2-afaa-fe92a7d7666b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:41.513174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1d0f365f-5b6c-4fc2-afaa-fe92a7d7666b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:41.528438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d0f365f-5b6c-4fc2-afaa-fe92a7d7666b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:41.529029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d0f365f-5b6c-4fc2-afaa-fe92a7d7666b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:41.530040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d0f365f-5b6c-4fc2-afaa-fe92a7d7666b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:41.531027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d0f365f-5b6c-4fc2-afaa-fe92a7d7666b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:41.531500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d0f365f-5b6c-4fc2-afaa-fe92a7d7666b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:41.535072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d0f365f-5b6c-4fc2-afaa-fe92a7d7666b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:41.722402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1d0f365f-5b6c-4fc2-afaa-fe92a7d7666b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:41.734639 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1d0f365f-5b6c-4fc2-afaa-fe92a7d7666b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1280 microversion: 2.1 time: 0.239151 Sep 10 10:46:41.740436 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1846/2352] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:41 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1280 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:41.747173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:41.752558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: ea77fa94-0bb5-4a1a-ac83-f52354bd8bab] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:41.777182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:41.778415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:41.779386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:41.781227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:41.792546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:41.793574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:41.832513 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Instance ea77fa94-0bb5-4a1a-ac83-f52354bd8bab could not be found. Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab HTTP/1.1 Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance ea77fa94-0bb5-4a1a-ac83-f52354bd8bab could not be found. Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'ea77fa94-0bb5-4a1a-ac83-f52354bd8bab'} Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea77fa94-0bb5-4a1a-ac83-f52354bd8bab could not be found. Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea77fa94-0bb5-4a1a-ac83-f52354bd8bab could not be found. Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.835839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:41.840032 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.840032 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:41.840032 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:41.840032 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:41.840032 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:41.840032 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:41.840032 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea77fa94-0bb5-4a1a-ac83-f52354bd8bab could not be found. Sep 10 10:46:41.840032 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.853320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 404 to user: Instance ea77fa94-0bb5-4a1a-ac83-f52354bd8bab could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:41.854635 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56a15968-9311-4383-94df-11d09dc07955 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab" status: 404 len: 111 microversion: 2.1 time: 0.112593 Sep 10 10:46:41.858952 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1847/2353] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:41 2022] GET /compute/v2.1/servers/ea77fa94-0bb5-4a1a-ac83-f52354bd8bab => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:46:41.864627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-96b1cce7-e283-4f9e-bd9a-bfe5a6a45b58 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:41.906979 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-96b1cce7-e283-4f9e-bd9a-bfe5a6a45b58 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046560 Sep 10 10:46:41.925831 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1848/2354] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:46:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:41.939819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15103711-8912-4d1e-b21a-9ed2921b74b2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '.version_select at 0x7efcae96fa60>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:41.974877 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-15103711-8912-4d1e-b21a-9ed2921b74b2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Image not found. Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15103711-8912-4d1e-b21a-9ed2921b74b2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/images/2145ca67-fac1-4bea-a73e-5cee369e145e HTTP/1.1 Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '2145ca67-fac1-4bea-a73e-5cee369e145e'} Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2145ca67-fac1-4bea-a73e-5cee369e145e to delete Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2145ca67-fac1-4bea-a73e-5cee369e145e could not be found. Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:41.976881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:46:41.981522 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:41.983991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15103711-8912-4d1e-b21a-9ed2921b74b2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:41.986563 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15103711-8912-4d1e-b21a-9ed2921b74b2 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "DELETE /compute/v2.1/images/2145ca67-fac1-4bea-a73e-5cee369e145e" status: 404 len: 62 microversion: 2.1 time: 0.059207 Sep 10 10:46:41.988757 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1849/2355] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:41 2022] DELETE /compute/v2.1/images/2145ca67-fac1-4bea-a73e-5cee369e145e => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:46:41.996407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:41.999349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:42.008492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:42.008992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:42.009519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:42.010229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:42.010743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:42.011172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:42.093408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:42.110766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Old instance type tempest-test_resize_flavor_-109971037, new instance type m1.heat {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 10:46:42.141724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:46:42.145273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:46:42.145930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:46:42.146560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:46:42.146983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:46:42.282944 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21a9a2bb-4a83-48c7-ae33-35bf2d78589f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c/action" status: 202 len: 0 microversion: 2.1 time: 0.290999 Sep 10 10:46:42.289176 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1850/2356] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:46:41 2022] POST /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:46:42.304953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:42.305646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:42.312012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:42.312579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:42.313130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:42.314045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:42.315002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:42.316781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:42.341030 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 HTTP/1.1 Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'adc3f2b0-25a8-42f2-b97b-84024a960024'} Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:46:42.343735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:42.348518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:42.349599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 404 to user: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:42.350170 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f01237d5-e09f-47dd-a151-61affa04cf59 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "DELETE /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 404 len: 111 microversion: 2.1 time: 0.062358 Sep 10 10:46:42.354049 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1851/2357] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:46:42 2022] DELETE /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:46:42.360028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-06b0376d-02a0-4142-b12c-a26c54707715 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:42.360827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-06b0376d-02a0-4142-b12c-a26c54707715 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:42.370656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06b0376d-02a0-4142-b12c-a26c54707715 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:42.371363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06b0376d-02a0-4142-b12c-a26c54707715 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:42.371859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06b0376d-02a0-4142-b12c-a26c54707715 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:42.372735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06b0376d-02a0-4142-b12c-a26c54707715 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:42.375032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06b0376d-02a0-4142-b12c-a26c54707715 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:42.375755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06b0376d-02a0-4142-b12c-a26c54707715 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:43.031569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-06b0376d-02a0-4142-b12c-a26c54707715 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:43.051120 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-06b0376d-02a0-4142-b12c-a26c54707715 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1537 microversion: 2.1 time: 0.698443 Sep 10 10:46:43.051716 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1852/2358] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:42 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1537 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:43.056228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:43.056840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: adc3f2b0-25a8-42f2-b97b-84024a960024] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:43.072892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:43.073234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:43.073548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:43.074253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:43.077670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:43.078125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:43.107541 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 HTTP/1.1 Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'adc3f2b0-25a8-42f2-b97b-84024a960024'} Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:43.109047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:43.113442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:43.113442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:43.113442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:43.113442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:43.113442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:43.113442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:43.113442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. Sep 10 10:46:43.113442 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:43.117850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 404 to user: Instance adc3f2b0-25a8-42f2-b97b-84024a960024 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:43.118746 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d103257a-d51d-4ef2-8ba0-ea02944f3448 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024" status: 404 len: 111 microversion: 2.1 time: 0.066099 Sep 10 10:46:43.119338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1853/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:43 2022] GET /compute/v2.1/servers/adc3f2b0-25a8-42f2-b97b-84024a960024 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:46:43.127375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-16cf971e-a189-458a-87ce-0e219b5d3d39 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:43.128657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-16cf971e-a189-458a-87ce-0e219b5d3d39 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:43.150911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16cf971e-a189-458a-87ce-0e219b5d3d39 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:43.151415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16cf971e-a189-458a-87ce-0e219b5d3d39 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:43.151861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16cf971e-a189-458a-87ce-0e219b5d3d39 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:43.152575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16cf971e-a189-458a-87ce-0e219b5d3d39 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:43.153040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16cf971e-a189-458a-87ce-0e219b5d3d39 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:43.153492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16cf971e-a189-458a-87ce-0e219b5d3d39 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:43.557673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-16cf971e-a189-458a-87ce-0e219b5d3d39 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:43.571395 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-16cf971e-a189-458a-87ce-0e219b5d3d39 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1315 microversion: 2.1 time: 0.450968 Sep 10 10:46:43.585297 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1854/2360] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:43 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:43.585297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b2527af1-0c10-4e83-9cf1-14295785e7df req-dd4696cf-3c79-47f3-bfad-b77acd05b839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23234f05-7a83-4d00-be4d-deaca2a67637", "tag": "721e1b09-8f77-4410-b81d-7a7cad3ebe63"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:43.609971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b2527af1-0c10-4e83-9cf1-14295785e7df req-dd4696cf-3c79-47f3-bfad-b77acd05b839 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:43.613315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b2527af1-0c10-4e83-9cf1-14295785e7df req-dd4696cf-3c79-47f3-bfad-b77acd05b839 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:43.618735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b2527af1-0c10-4e83-9cf1-14295785e7df req-dd4696cf-3c79-47f3-bfad-b77acd05b839 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:43.638507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b2527af1-0c10-4e83-9cf1-14295785e7df req-dd4696cf-3c79-47f3-bfad-b77acd05b839 service nova] Creating event network-changed:721e1b09-8f77-4410-b81d-7a7cad3ebe63 for instance 23234f05-7a83-4d00-be4d-deaca2a67637 on n-h2-856894-1 Sep 10 10:46:43.644183 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b2527af1-0c10-4e83-9cf1-14295785e7df req-dd4696cf-3c79-47f3-bfad-b77acd05b839 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069568 Sep 10 10:46:43.645410 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1855/2361] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:43.651040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6439f07-9cdb-47a2-b2cf-ab1ac3c7f770 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:43.651852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c6439f07-9cdb-47a2-b2cf-ab1ac3c7f770 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:43.659738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6439f07-9cdb-47a2-b2cf-ab1ac3c7f770 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:43.660345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6439f07-9cdb-47a2-b2cf-ab1ac3c7f770 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:43.660894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6439f07-9cdb-47a2-b2cf-ab1ac3c7f770 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:43.661727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6439f07-9cdb-47a2-b2cf-ab1ac3c7f770 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:43.662424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6439f07-9cdb-47a2-b2cf-ab1ac3c7f770 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:43.663072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6439f07-9cdb-47a2-b2cf-ab1ac3c7f770 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:44.529989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c6439f07-9cdb-47a2-b2cf-ab1ac3c7f770 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:44.544892 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c6439f07-9cdb-47a2-b2cf-ab1ac3c7f770 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1322 microversion: 2.1 time: 0.898141 Sep 10 10:46:44.558446 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1856/2362] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:43 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1322 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:44.569308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff3baed0-0b56-4eb6-8fda-a79bd4a352b1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '.version_select at 0x7efcae934550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:44.612451 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff3baed0-0b56-4eb6-8fda-a79bd4a352b1 tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617909047" status: 202 len: 0 microversion: 2.1 time: 0.052717 Sep 10 10:46:44.615402 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1857/2363] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 10:46:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617909047 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:46:44.623602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6f3ee18-0654-42d6-8716-e08943526554 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:44.624750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d6f3ee18-0654-42d6-8716-e08943526554 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:44.633412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f3ee18-0654-42d6-8716-e08943526554 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:44.634236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f3ee18-0654-42d6-8716-e08943526554 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:44.635596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f3ee18-0654-42d6-8716-e08943526554 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:44.636574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f3ee18-0654-42d6-8716-e08943526554 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:44.637327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f3ee18-0654-42d6-8716-e08943526554 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:44.638615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f3ee18-0654-42d6-8716-e08943526554 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:45.238015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d6f3ee18-0654-42d6-8716-e08943526554 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:45.257890 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6f3ee18-0654-42d6-8716-e08943526554 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1537 microversion: 2.1 time: 0.641291 Sep 10 10:46:45.258493 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1858/2364] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:44 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1537 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:45.263709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c85508c-006b-4a89-b475-c9035fffc994 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:45.265890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c85508c-006b-4a89-b475-c9035fffc994 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:45.293927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c85508c-006b-4a89-b475-c9035fffc994 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:45.295073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c85508c-006b-4a89-b475-c9035fffc994 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:45.296115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c85508c-006b-4a89-b475-c9035fffc994 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:45.297405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c85508c-006b-4a89-b475-c9035fffc994 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:45.309674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c85508c-006b-4a89-b475-c9035fffc994 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:45.310172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c85508c-006b-4a89-b475-c9035fffc994 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:45.623102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c85508c-006b-4a89-b475-c9035fffc994 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:45.645551 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c85508c-006b-4a89-b475-c9035fffc994 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1315 microversion: 2.1 time: 0.379193 Sep 10 10:46:45.646316 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1859/2365] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:45 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:45.657678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be081835-248a-44e5-a4eb-4c1bb6132177 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:45.660532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be081835-248a-44e5-a4eb-4c1bb6132177 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:45.671999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be081835-248a-44e5-a4eb-4c1bb6132177 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:45.673730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be081835-248a-44e5-a4eb-4c1bb6132177 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:45.674535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be081835-248a-44e5-a4eb-4c1bb6132177 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:45.676403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be081835-248a-44e5-a4eb-4c1bb6132177 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:45.679014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be081835-248a-44e5-a4eb-4c1bb6132177 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:45.681754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be081835-248a-44e5-a4eb-4c1bb6132177 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:46.085936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be081835-248a-44e5-a4eb-4c1bb6132177 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:46.103813 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be081835-248a-44e5-a4eb-4c1bb6132177 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1322 microversion: 2.1 time: 0.451283 Sep 10 10:46:46.106449 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1860/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:45 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:46.284946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6bfc4dbf-6e94-4915-a291-ed95cee79c32 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:46.286369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6bfc4dbf-6e94-4915-a291-ed95cee79c32 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:46.296580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bfc4dbf-6e94-4915-a291-ed95cee79c32 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:46.300323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bfc4dbf-6e94-4915-a291-ed95cee79c32 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:46.300997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bfc4dbf-6e94-4915-a291-ed95cee79c32 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:46.301960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bfc4dbf-6e94-4915-a291-ed95cee79c32 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:46.303349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bfc4dbf-6e94-4915-a291-ed95cee79c32 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:46.305344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bfc4dbf-6e94-4915-a291-ed95cee79c32 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:46.750539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6bfc4dbf-6e94-4915-a291-ed95cee79c32 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:46.766901 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6bfc4dbf-6e94-4915-a291-ed95cee79c32 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1537 microversion: 2.1 time: 0.486791 Sep 10 10:46:46.769172 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1861/2367] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:46 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1537 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:46:46.775146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c04c411a-5a92-4473-aa57-9871d36e515d req-0cea42a5-00d2-4172-8213-3117a8b9acbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdeda520-f083-4aa8-81c8-baba06d8771d", "tag": "7cc5805f-04ae-481c-a914-42ebc2b10924"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:46.794278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c04c411a-5a92-4473-aa57-9871d36e515d req-0cea42a5-00d2-4172-8213-3117a8b9acbf service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:46.795717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c04c411a-5a92-4473-aa57-9871d36e515d req-0cea42a5-00d2-4172-8213-3117a8b9acbf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:46.796932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c04c411a-5a92-4473-aa57-9871d36e515d req-0cea42a5-00d2-4172-8213-3117a8b9acbf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:46.813759 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c04c411a-5a92-4473-aa57-9871d36e515d req-0cea42a5-00d2-4172-8213-3117a8b9acbf service nova] Creating event network-changed:7cc5805f-04ae-481c-a914-42ebc2b10924 for instance bdeda520-f083-4aa8-81c8-baba06d8771d on n-h2-856894-1 Sep 10 10:46:46.821649 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c04c411a-5a92-4473-aa57-9871d36e515d req-0cea42a5-00d2-4172-8213-3117a8b9acbf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050031 Sep 10 10:46:46.823129 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1862/2368] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:46.829675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ebc6b5c4-74ea-44ac-a815-06c8269a39ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:46.831209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ebc6b5c4-74ea-44ac-a815-06c8269a39ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:46.839378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebc6b5c4-74ea-44ac-a815-06c8269a39ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:46.840158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebc6b5c4-74ea-44ac-a815-06c8269a39ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:46.840789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebc6b5c4-74ea-44ac-a815-06c8269a39ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:46.841732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebc6b5c4-74ea-44ac-a815-06c8269a39ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:46.842354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebc6b5c4-74ea-44ac-a815-06c8269a39ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:46.842936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebc6b5c4-74ea-44ac-a815-06c8269a39ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:47.339352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ebc6b5c4-74ea-44ac-a815-06c8269a39ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:47.351168 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ebc6b5c4-74ea-44ac-a815-06c8269a39ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1315 microversion: 2.1 time: 0.526740 Sep 10 10:46:47.352960 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1863/2369] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:46 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:47.358794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2bc16529-3683-4348-bf4f-748677709aca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '.version_select at 0x7efcae3009d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:47.412888 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2bc16529-3683-4348-bf4f-748677709aca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Image not found. Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2bc16529-3683-4348-bf4f-748677709aca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/images/f184d0b8-ed74-43c7-b442-2d16ab381809 HTTP/1.1 Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: exception: Image not found. Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f184d0b8-ed74-43c7-b442-2d16ab381809'} Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f184d0b8-ed74-43c7-b442-2d16ab381809 to delete Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f184d0b8-ed74-43c7-b442-2d16ab381809 could not be found. Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:47.418241 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 10:46:47.422914 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.427661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2bc16529-3683-4348-bf4f-748677709aca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 404 to user: Image not found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:47.428874 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2bc16529-3683-4348-bf4f-748677709aca tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "DELETE /compute/v2.1/images/f184d0b8-ed74-43c7-b442-2d16ab381809" status: 404 len: 62 microversion: 2.1 time: 0.074504 Sep 10 10:46:47.433204 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1864/2370] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:47 2022] DELETE /compute/v2.1/images/f184d0b8-ed74-43c7-b442-2d16ab381809 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:46:47.439932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a289645d-0d7e-4b38-80b6-9cdcf8c615ef tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:47.441189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a289645d-0d7e-4b38-80b6-9cdcf8c615ef tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:47.453253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289645d-0d7e-4b38-80b6-9cdcf8c615ef tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:47.453994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289645d-0d7e-4b38-80b6-9cdcf8c615ef tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:47.454678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289645d-0d7e-4b38-80b6-9cdcf8c615ef tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:47.457989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289645d-0d7e-4b38-80b6-9cdcf8c615ef tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:47.458945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289645d-0d7e-4b38-80b6-9cdcf8c615ef tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:47.460702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289645d-0d7e-4b38-80b6-9cdcf8c615ef tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:47.646804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a289645d-0d7e-4b38-80b6-9cdcf8c615ef tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:47.661656 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a289645d-0d7e-4b38-80b6-9cdcf8c615ef tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1322 microversion: 2.1 time: 0.227043 Sep 10 10:46:47.670850 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1865/2371] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:47 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:47.678068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:47.680332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:47.701676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:47.702166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:47.702686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:47.703565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:47.704021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:47.704443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:47.719132 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 HTTP/1.1 Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e6630508-8b1c-4557-8929-dd226832f411'} Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:46:47.721592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:46:47.726021 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.727509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 404 to user: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:47.728514 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9571eb16-ff77-4047-a895-bfd46f21ba1b tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 404 len: 111 microversion: 2.1 time: 0.056421 Sep 10 10:46:47.729568 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1866/2372] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:46:47 2022] DELETE /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:46:47.737604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:47.738845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] [instance: e6630508-8b1c-4557-8929-dd226832f411] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:47.745668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:47.746367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:47.747128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:47.748325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:47.748930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:47.749533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:47.765025 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] HTTP exception thrown: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Request method failure captured: Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 HTTP/1.1 Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGql_6qW6e1cA5mTr91ZvZjO33cM0nBhjyv-SsoRLWY9MUU4pmYYBaREbUGpW_5wbj02E44vU4QGaZOLujKp0VaBZnqBNX65oxvJh59ukFGuoRwc8mjMy8-GT1LLjT30rFL-vfBK8LLleOZRwuiiEM0jQTB9-VbrBrk7deml4H2ZPV8 Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee641ddfdc8a4ff6a9e9a58b705a1fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee641ddfdc8a4ff6a9e9a58b705a1fb6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: ee641ddfdc8a4ff6a9e9a58b705a1fb6 Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709 Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3e6d3452f1dd4b7781f0f6d490115e6b Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2145433709-project Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e6630508-8b1c-4557-8929-dd226832f411'} Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.767283 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:46:47.771852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.771852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:46:47.771852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:46:47.771852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:46:47.771852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:46:47.771852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:46:47.771852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. Sep 10 10:46:47.771852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:46:47.773214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] Returning 404 to user: Instance e6630508-8b1c-4557-8929-dd226832f411 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:46:47.774205 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4794d473-910b-49be-8e80-e4bd2ae6b77f tempest-ImagesOneServerNegativeTestJSON-2145433709 tempest-ImagesOneServerNegativeTestJSON-2145433709-project] 10.222.0.20 "GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411" status: 404 len: 111 microversion: 2.1 time: 0.040995 Sep 10 10:46:47.775234 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1867/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:47 2022] GET /compute/v2.1/servers/e6630508-8b1c-4557-8929-dd226832f411 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:46:47.794583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56ef68e0-9aad-4c21-b1dc-c39620a0c9f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:47.795671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56ef68e0-9aad-4c21-b1dc-c39620a0c9f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:47.806477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56ef68e0-9aad-4c21-b1dc-c39620a0c9f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:47.807909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56ef68e0-9aad-4c21-b1dc-c39620a0c9f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:47.808963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56ef68e0-9aad-4c21-b1dc-c39620a0c9f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:47.810526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56ef68e0-9aad-4c21-b1dc-c39620a0c9f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:47.811214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56ef68e0-9aad-4c21-b1dc-c39620a0c9f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:47.811866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56ef68e0-9aad-4c21-b1dc-c39620a0c9f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:48.107317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56ef68e0-9aad-4c21-b1dc-c39620a0c9f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:48.120490 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56ef68e0-9aad-4c21-b1dc-c39620a0c9f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1537 microversion: 2.1 time: 0.330017 Sep 10 10:46:48.121457 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1868/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:47 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1537 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:48.386325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8d40a6b-f582-41d3-b17a-70c026b160b5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:48.387641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8d40a6b-f582-41d3-b17a-70c026b160b5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:48.400554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:48.402655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=14 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:48.406929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8d40a6b-f582-41d3-b17a-70c026b160b5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:48.407661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8d40a6b-f582-41d3-b17a-70c026b160b5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:48.408479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8d40a6b-f582-41d3-b17a-70c026b160b5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:48.409982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8d40a6b-f582-41d3-b17a-70c026b160b5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:48.410641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8d40a6b-f582-41d3-b17a-70c026b160b5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:48.411841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8d40a6b-f582-41d3-b17a-70c026b160b5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:49.169101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c8d40a6b-f582-41d3-b17a-70c026b160b5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:49.172796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:49.179586 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8d40a6b-f582-41d3-b17a-70c026b160b5 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1315 microversion: 2.1 time: 0.800253 Sep 10 10:46:49.191078 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1869/2375] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:48 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:49.205131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec81bab1-9011-4325-918e-a53a7e6c7bf8 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:49.206719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec81bab1-9011-4325-918e-a53a7e6c7bf8 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:49.210557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:49.222306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec81bab1-9011-4325-918e-a53a7e6c7bf8 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:49.222937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec81bab1-9011-4325-918e-a53a7e6c7bf8 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:49.229780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec81bab1-9011-4325-918e-a53a7e6c7bf8 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:49.230686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec81bab1-9011-4325-918e-a53a7e6c7bf8 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:49.231268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec81bab1-9011-4325-918e-a53a7e6c7bf8 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:49.231829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec81bab1-9011-4325-918e-a53a7e6c7bf8 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:49.954615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec81bab1-9011-4325-918e-a53a7e6c7bf8 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:50.000307 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec81bab1-9011-4325-918e-a53a7e6c7bf8 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1322 microversion: 2.1 time: 0.807783 Sep 10 10:46:50.000933 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1870/2376] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:49 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1322 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:50.022032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95cc44b2-2d97-41ab-b4a1-f5b4d3ff0254 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:50.030230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95cc44b2-2d97-41ab-b4a1-f5b4d3ff0254 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:50.046159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95cc44b2-2d97-41ab-b4a1-f5b4d3ff0254 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:50.046654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95cc44b2-2d97-41ab-b4a1-f5b4d3ff0254 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:50.047093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95cc44b2-2d97-41ab-b4a1-f5b4d3ff0254 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:50.047812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95cc44b2-2d97-41ab-b4a1-f5b4d3ff0254 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:50.048271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95cc44b2-2d97-41ab-b4a1-f5b4d3ff0254 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:50.048703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95cc44b2-2d97-41ab-b4a1-f5b4d3ff0254 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:51.125455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95cc44b2-2d97-41ab-b4a1-f5b4d3ff0254 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:51.135878 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95cc44b2-2d97-41ab-b4a1-f5b4d3ff0254 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1542 microversion: 2.1 time: 1.130344 Sep 10 10:46:51.140916 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1871/2377] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:50 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1542 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:51.155153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c59f728c-9fdb-44f8-a32b-9662ee7880c6 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:51.158327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c59f728c-9fdb-44f8-a32b-9662ee7880c6 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:51.186415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c59f728c-9fdb-44f8-a32b-9662ee7880c6 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:51.187221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c59f728c-9fdb-44f8-a32b-9662ee7880c6 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:51.187833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c59f728c-9fdb-44f8-a32b-9662ee7880c6 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:51.190988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c59f728c-9fdb-44f8-a32b-9662ee7880c6 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:51.191682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c59f728c-9fdb-44f8-a32b-9662ee7880c6 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:51.192451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c59f728c-9fdb-44f8-a32b-9662ee7880c6 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:51.862616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c59f728c-9fdb-44f8-a32b-9662ee7880c6 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:51.875413 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c59f728c-9fdb-44f8-a32b-9662ee7880c6 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1315 microversion: 2.1 time: 0.733375 Sep 10 10:46:51.878899 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1872/2378] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:51 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:51.886854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4308281d-ae57-4f87-9d44-9a7af134b7a9 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:51.891613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4308281d-ae57-4f87-9d44-9a7af134b7a9 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:51.913730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4308281d-ae57-4f87-9d44-9a7af134b7a9 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:51.914510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4308281d-ae57-4f87-9d44-9a7af134b7a9 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:51.915443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4308281d-ae57-4f87-9d44-9a7af134b7a9 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:51.915654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4308281d-ae57-4f87-9d44-9a7af134b7a9 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:51.916110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4308281d-ae57-4f87-9d44-9a7af134b7a9 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:51.916533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4308281d-ae57-4f87-9d44-9a7af134b7a9 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:53.120173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4308281d-ae57-4f87-9d44-9a7af134b7a9 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:53.150709 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4308281d-ae57-4f87-9d44-9a7af134b7a9 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1322 microversion: 2.1 time: 1.260610 Sep 10 10:46:53.161729 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1873/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:51 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1322 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:53.177324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f8f3b6da-a730-4960-94f2-a09e705cfbbd req-f2646f65-48ce-49c6-a747-a4af338f1d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23234f05-7a83-4d00-be4d-deaca2a67637", "name": "network-vif-plugged", "status": "completed", "tag": "721e1b09-8f77-4410-b81d-7a7cad3ebe63"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:53.205398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f8f3b6da-a730-4960-94f2-a09e705cfbbd req-f2646f65-48ce-49c6-a747-a4af338f1d77 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:53.210967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f8f3b6da-a730-4960-94f2-a09e705cfbbd req-f2646f65-48ce-49c6-a747-a4af338f1d77 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:53.219162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f8f3b6da-a730-4960-94f2-a09e705cfbbd req-f2646f65-48ce-49c6-a747-a4af338f1d77 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:53.246763 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f8f3b6da-a730-4960-94f2-a09e705cfbbd req-f2646f65-48ce-49c6-a747-a4af338f1d77 service nova] Creating event network-vif-plugged:721e1b09-8f77-4410-b81d-7a7cad3ebe63 for instance 23234f05-7a83-4d00-be4d-deaca2a67637 on n-h2-856894-1 Sep 10 10:46:53.259163 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f8f3b6da-a730-4960-94f2-a09e705cfbbd req-f2646f65-48ce-49c6-a747-a4af338f1d77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096083 Sep 10 10:46:53.260303 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1874/2380] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:53.265716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-792bdbd2-a1fd-4cf7-a8f6-dd00c6eeb43e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:53.266439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-792bdbd2-a1fd-4cf7-a8f6-dd00c6eeb43e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:53.288701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-792bdbd2-a1fd-4cf7-a8f6-dd00c6eeb43e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:53.289233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-792bdbd2-a1fd-4cf7-a8f6-dd00c6eeb43e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:53.289679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-792bdbd2-a1fd-4cf7-a8f6-dd00c6eeb43e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:53.290393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-792bdbd2-a1fd-4cf7-a8f6-dd00c6eeb43e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:53.290839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-792bdbd2-a1fd-4cf7-a8f6-dd00c6eeb43e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:53.291440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-792bdbd2-a1fd-4cf7-a8f6-dd00c6eeb43e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:53.648920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-792bdbd2-a1fd-4cf7-a8f6-dd00c6eeb43e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:53.673985 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-792bdbd2-a1fd-4cf7-a8f6-dd00c6eeb43e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1542 microversion: 2.1 time: 0.412276 Sep 10 10:46:53.686254 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1875/2381] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:53 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1542 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:53.699996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3903ea7f-46f2-4dab-a2ec-6abb92cdc76a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:53.705016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3903ea7f-46f2-4dab-a2ec-6abb92cdc76a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:53.718931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3903ea7f-46f2-4dab-a2ec-6abb92cdc76a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:53.720397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3903ea7f-46f2-4dab-a2ec-6abb92cdc76a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:53.722573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3903ea7f-46f2-4dab-a2ec-6abb92cdc76a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:53.723488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3903ea7f-46f2-4dab-a2ec-6abb92cdc76a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:53.724117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3903ea7f-46f2-4dab-a2ec-6abb92cdc76a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:53.724770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3903ea7f-46f2-4dab-a2ec-6abb92cdc76a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:54.100075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3903ea7f-46f2-4dab-a2ec-6abb92cdc76a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:54.111964 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3903ea7f-46f2-4dab-a2ec-6abb92cdc76a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1315 microversion: 2.1 time: 0.419414 Sep 10 10:46:54.114656 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1876/2382] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:53 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:54.183369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-327a4f82-4def-4b68-be8c-1e2665796d73 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:54.184904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-327a4f82-4def-4b68-be8c-1e2665796d73 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:54.197735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a4f82-4def-4b68-be8c-1e2665796d73 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:54.199339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a4f82-4def-4b68-be8c-1e2665796d73 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:54.202122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a4f82-4def-4b68-be8c-1e2665796d73 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:54.204020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a4f82-4def-4b68-be8c-1e2665796d73 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:54.206771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a4f82-4def-4b68-be8c-1e2665796d73 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:54.208151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327a4f82-4def-4b68-be8c-1e2665796d73 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:54.593364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-327a4f82-4def-4b68-be8c-1e2665796d73 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:54.603249 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-327a4f82-4def-4b68-be8c-1e2665796d73 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1322 microversion: 2.1 time: 0.424673 Sep 10 10:46:54.604001 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1877/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:54 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:46:54.703043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87e75357-8766-441d-802b-6c1906196571 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:54.704138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87e75357-8766-441d-802b-6c1906196571 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:54.711639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e75357-8766-441d-802b-6c1906196571 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:54.712171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e75357-8766-441d-802b-6c1906196571 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:54.712715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e75357-8766-441d-802b-6c1906196571 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:54.713666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e75357-8766-441d-802b-6c1906196571 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:54.714977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e75357-8766-441d-802b-6c1906196571 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:54.716026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e75357-8766-441d-802b-6c1906196571 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:55.236032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-87e75357-8766-441d-802b-6c1906196571 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:55.259128 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87e75357-8766-441d-802b-6c1906196571 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1542 microversion: 2.1 time: 0.557258 Sep 10 10:46:55.262722 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1878/2384] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:54 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1542 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:46:55.288980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-445804d2-4ffd-4cd2-a0d4-4e226ad1946a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:55.289660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-445804d2-4ffd-4cd2-a0d4-4e226ad1946a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:55.321657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-445804d2-4ffd-4cd2-a0d4-4e226ad1946a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:55.322887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-445804d2-4ffd-4cd2-a0d4-4e226ad1946a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:55.323572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-445804d2-4ffd-4cd2-a0d4-4e226ad1946a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:55.325796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-445804d2-4ffd-4cd2-a0d4-4e226ad1946a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:55.327653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-445804d2-4ffd-4cd2-a0d4-4e226ad1946a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:55.329021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-445804d2-4ffd-4cd2-a0d4-4e226ad1946a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:55.992622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-445804d2-4ffd-4cd2-a0d4-4e226ad1946a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:56.007270 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-445804d2-4ffd-4cd2-a0d4-4e226ad1946a tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1315 microversion: 2.1 time: 0.743343 Sep 10 10:46:56.009608 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1879/2385] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:55 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:56.038033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0cf8f229-83b3-46b1-a93f-5ffb0192e0e6 req-7b16d6fc-4c5b-4a4c-9595-ab09caeee5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdeda520-f083-4aa8-81c8-baba06d8771d", "name": "network-vif-plugged", "status": "completed", "tag": "7cc5805f-04ae-481c-a914-42ebc2b10924"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:56.060757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0cf8f229-83b3-46b1-a93f-5ffb0192e0e6 req-7b16d6fc-4c5b-4a4c-9595-ab09caeee5a1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:56.061472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0cf8f229-83b3-46b1-a93f-5ffb0192e0e6 req-7b16d6fc-4c5b-4a4c-9595-ab09caeee5a1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:56.062591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0cf8f229-83b3-46b1-a93f-5ffb0192e0e6 req-7b16d6fc-4c5b-4a4c-9595-ab09caeee5a1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:56.081699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0cf8f229-83b3-46b1-a93f-5ffb0192e0e6 req-7b16d6fc-4c5b-4a4c-9595-ab09caeee5a1 service nova] Creating event network-vif-plugged:7cc5805f-04ae-481c-a914-42ebc2b10924 for instance bdeda520-f083-4aa8-81c8-baba06d8771d on n-h2-856894-1 Sep 10 10:46:56.087903 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0cf8f229-83b3-46b1-a93f-5ffb0192e0e6 req-7b16d6fc-4c5b-4a4c-9595-ab09caeee5a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059546 Sep 10 10:46:56.089179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1880/2386] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:46:56.094555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f701be5-6502-4a5f-bf88-1cd45373b68a tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:56.095521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f701be5-6502-4a5f-bf88-1cd45373b68a tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:56.102843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f701be5-6502-4a5f-bf88-1cd45373b68a tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:56.103584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f701be5-6502-4a5f-bf88-1cd45373b68a tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:56.104827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f701be5-6502-4a5f-bf88-1cd45373b68a tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:56.105787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f701be5-6502-4a5f-bf88-1cd45373b68a tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:56.106435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f701be5-6502-4a5f-bf88-1cd45373b68a tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:56.107292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f701be5-6502-4a5f-bf88-1cd45373b68a tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:56.648135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f701be5-6502-4a5f-bf88-1cd45373b68a tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:56.658523 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f701be5-6502-4a5f-bf88-1cd45373b68a tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1322 microversion: 2.1 time: 0.567884 Sep 10 10:46:56.659412 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1881/2387] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:56 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1322 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:56.665091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88fc35b1-6509-4613-854c-c6553c9ed5a2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:56.667758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88fc35b1-6509-4613-854c-c6553c9ed5a2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:56.678646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fc35b1-6509-4613-854c-c6553c9ed5a2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:56.679277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fc35b1-6509-4613-854c-c6553c9ed5a2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:56.679827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fc35b1-6509-4613-854c-c6553c9ed5a2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:56.680661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fc35b1-6509-4613-854c-c6553c9ed5a2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:56.681414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fc35b1-6509-4613-854c-c6553c9ed5a2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:56.681986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fc35b1-6509-4613-854c-c6553c9ed5a2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:56.735034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-88fc35b1-6509-4613-854c-c6553c9ed5a2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lazy-loading 'flavor' on Instance uuid a47a8a03-72e3-4db7-8e43-a1992a5f6ece {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:46:56.949405 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88fc35b1-6509-4613-854c-c6553c9ed5a2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/action" status: 200 len: 32 microversion: 2.1 time: 0.288207 Sep 10 10:46:56.952675 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1882/2388] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:46:56 2022] POST /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:46:56.962624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66dbb093-7ac6-4d51-bf55-c2c4cadadab9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:56.963976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66dbb093-7ac6-4d51-bf55-c2c4cadadab9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:56.975985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66dbb093-7ac6-4d51-bf55-c2c4cadadab9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:56.976483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66dbb093-7ac6-4d51-bf55-c2c4cadadab9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:56.976965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66dbb093-7ac6-4d51-bf55-c2c4cadadab9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:56.977764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66dbb093-7ac6-4d51-bf55-c2c4cadadab9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:56.978222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66dbb093-7ac6-4d51-bf55-c2c4cadadab9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:56.978649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66dbb093-7ac6-4d51-bf55-c2c4cadadab9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:57.282145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-66dbb093-7ac6-4d51-bf55-c2c4cadadab9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:57.293719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66dbb093-7ac6-4d51-bf55-c2c4cadadab9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1542 microversion: 2.1 time: 0.339414 Sep 10 10:46:57.294563 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1883/2389] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:56 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1542 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:57.324488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b8e660b-815b-4768-9336-fb8550b133d7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:57.325112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b8e660b-815b-4768-9336-fb8550b133d7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:57.339642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b8e660b-815b-4768-9336-fb8550b133d7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:57.340344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b8e660b-815b-4768-9336-fb8550b133d7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:57.340955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b8e660b-815b-4768-9336-fb8550b133d7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:57.345559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b8e660b-815b-4768-9336-fb8550b133d7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:57.346285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b8e660b-815b-4768-9336-fb8550b133d7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:57.346742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b8e660b-815b-4768-9336-fb8550b133d7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:57.973737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b8e660b-815b-4768-9336-fb8550b133d7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:57.994471 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b8e660b-815b-4768-9336-fb8550b133d7 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.693290 Sep 10 10:46:57.995801 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1884/2390] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:57 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:58.014796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-196d9133-9f83-413c-8506-9ff9389f8830 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:58.015799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-196d9133-9f83-413c-8506-9ff9389f8830 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:58.023230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-196d9133-9f83-413c-8506-9ff9389f8830 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:58.023991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-196d9133-9f83-413c-8506-9ff9389f8830 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:58.024809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-196d9133-9f83-413c-8506-9ff9389f8830 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:58.025592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-196d9133-9f83-413c-8506-9ff9389f8830 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:58.026330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-196d9133-9f83-413c-8506-9ff9389f8830 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:58.026941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-196d9133-9f83-413c-8506-9ff9389f8830 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:58.417667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-196d9133-9f83-413c-8506-9ff9389f8830 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:58.421856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:46:58.427739 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-196d9133-9f83-413c-8506-9ff9389f8830 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1502 microversion: 2.1 time: 0.430561 Sep 10 10:46:58.437809 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1885/2391] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:57 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1502 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:58.443595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-40268a81-8729-4831-b84c-ef6c8688019f tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:58.446390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-40268a81-8729-4831-b84c-ef6c8688019f tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:58.459005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40268a81-8729-4831-b84c-ef6c8688019f tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:58.459862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40268a81-8729-4831-b84c-ef6c8688019f tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:58.460494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40268a81-8729-4831-b84c-ef6c8688019f tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:58.461480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40268a81-8729-4831-b84c-ef6c8688019f tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:58.462105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40268a81-8729-4831-b84c-ef6c8688019f tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:58.462770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40268a81-8729-4831-b84c-ef6c8688019f tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:59.012439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-40268a81-8729-4831-b84c-ef6c8688019f tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:59.024418 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-40268a81-8729-4831-b84c-ef6c8688019f tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1472 microversion: 2.1 time: 0.584785 Sep 10 10:46:59.026792 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1886/2392] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:58 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1472 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:59.041900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f34171e6-3f60-47e1-8ef1-bbe979bfd7a0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:59.042778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f34171e6-3f60-47e1-8ef1-bbe979bfd7a0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:59.055118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f34171e6-3f60-47e1-8ef1-bbe979bfd7a0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:59.055623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f34171e6-3f60-47e1-8ef1-bbe979bfd7a0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:59.056061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f34171e6-3f60-47e1-8ef1-bbe979bfd7a0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:59.056754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f34171e6-3f60-47e1-8ef1-bbe979bfd7a0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:59.057235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f34171e6-3f60-47e1-8ef1-bbe979bfd7a0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:59.057668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f34171e6-3f60-47e1-8ef1-bbe979bfd7a0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:59.350797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f34171e6-3f60-47e1-8ef1-bbe979bfd7a0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:46:59.365680 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f34171e6-3f60-47e1-8ef1-bbe979bfd7a0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1542 microversion: 2.1 time: 0.333267 Sep 10 10:46:59.382891 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1887/2393] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:59 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1542 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:46:59.391303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e94d3142-0204-41e3-8b55-72cf5572f519 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:46:59.391853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e94d3142-0204-41e3-8b55-72cf5572f519 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:59.402840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e94d3142-0204-41e3-8b55-72cf5572f519 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:59.403335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e94d3142-0204-41e3-8b55-72cf5572f519 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:59.403780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e94d3142-0204-41e3-8b55-72cf5572f519 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:59.404489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e94d3142-0204-41e3-8b55-72cf5572f519 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:59.405020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e94d3142-0204-41e3-8b55-72cf5572f519 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:59.405823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e94d3142-0204-41e3-8b55-72cf5572f519 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:59.454589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-e94d3142-0204-41e3-8b55-72cf5572f519 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lazy-loading 'flavor' on Instance uuid 23234f05-7a83-4d00-be4d-deaca2a67637 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:46:59.666854 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e94d3142-0204-41e3-8b55-72cf5572f519 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "POST /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637/action" status: 202 len: 0 microversion: 2.1 time: 0.282536 Sep 10 10:46:59.670677 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1888/2394] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:46:59 2022] POST /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:46:59.697558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a3391d09-322a-4158-87e6-8fba2fd55933 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:46:59.704953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a3391d09-322a-4158-87e6-8fba2fd55933 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:46:59.723220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3391d09-322a-4158-87e6-8fba2fd55933 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:59.723800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3391d09-322a-4158-87e6-8fba2fd55933 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:59.724931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3391d09-322a-4158-87e6-8fba2fd55933 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:46:59.725818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3391d09-322a-4158-87e6-8fba2fd55933 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:46:59.726540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3391d09-322a-4158-87e6-8fba2fd55933 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:46:59.727030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3391d09-322a-4158-87e6-8fba2fd55933 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:00.030308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3391d09-322a-4158-87e6-8fba2fd55933 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:00.047721 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a3391d09-322a-4158-87e6-8fba2fd55933 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.378409 Sep 10 10:47:00.049574 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1889/2395] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:46:59 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:00.064740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:00.065816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:00.093629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:00.094430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:00.097615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:00.101688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:00.102393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:00.105642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:00.170060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Request method failure captured: Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d/diagnostics HTTP/1.1 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGsLYYWp2NnxzARWwhL7M5x-2RmiWa8uhUBP1vMdmvQSe2YGI-Wi4-E5vBQkmANz2kWSp4uDOHadfdvl6uUa8WhiDZBBSz9wDm8npDU8Mqy1lLfjzkarzpaMncYmiYUlV23Q44yQnY8hKF556hyPlRrfU9No4F1LAYH5fPtNKqj4IG4 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 4381e6e48cd540d89039afd241f4b570 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-318767653 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4381e6e48cd540d89039afd241f4b570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4381e6e48cd540d89039afd241f4b570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4381e6e48cd540d89039afd241f4b570"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4381e6e48cd540d89039afd241f4b570", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-318767653 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 4381e6e48cd540d89039afd241f4b570 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-318767653 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerDiagnosticsNegativeTest-318767653-project Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 6a9f563e69c34220a28739a06e7abbd5 Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-318767653-project Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': 'bdeda520-f083-4aa8-81c8-baba06d8771d'} Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:00.176485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:00.181773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:00.181773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:00.181773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:47:00.181773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:47:00.181773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 10 10:47:00.181773 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:00.183183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:00.184962 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae669038-20a8-46a8-a60c-e39f3413e6dd tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.133940 Sep 10 10:47:00.191899 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1890/2396] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:47:00 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d/diagnostics => generated 117 bytes in 141 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:00.198855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f67236f-4e2f-4786-87b7-da47369be4be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:00.199745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f67236f-4e2f-4786-87b7-da47369be4be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:00.209597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f67236f-4e2f-4786-87b7-da47369be4be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:00.210482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f67236f-4e2f-4786-87b7-da47369be4be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:00.211100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f67236f-4e2f-4786-87b7-da47369be4be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:00.211953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f67236f-4e2f-4786-87b7-da47369be4be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:00.212561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f67236f-4e2f-4786-87b7-da47369be4be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:00.213179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f67236f-4e2f-4786-87b7-da47369be4be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:00.607438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f67236f-4e2f-4786-87b7-da47369be4be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:00.617754 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f67236f-4e2f-4786-87b7-da47369be4be tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1510 microversion: 2.1 time: 0.423995 Sep 10 10:47:00.618471 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1891/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:00 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:00.625795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0873004-19d9-4333-a084-79cd1b41ff35 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:00.626935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0873004-19d9-4333-a084-79cd1b41ff35 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:00.634424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0873004-19d9-4333-a084-79cd1b41ff35 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:00.635415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0873004-19d9-4333-a084-79cd1b41ff35 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:00.635914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0873004-19d9-4333-a084-79cd1b41ff35 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:00.636789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0873004-19d9-4333-a084-79cd1b41ff35 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:00.637419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0873004-19d9-4333-a084-79cd1b41ff35 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:00.638091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0873004-19d9-4333-a084-79cd1b41ff35 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:00.684674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0873004-19d9-4333-a084-79cd1b41ff35 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:47:00.798643 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0873004-19d9-4333-a084-79cd1b41ff35 tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 204 len: 0 microversion: 2.1 time: 0.176849 Sep 10 10:47:00.800546 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1892/2398] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:00 2022] DELETE /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:47:00.808040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-59531635-06c7-4688-a49b-90c4abcdaebb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:00.808988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-59531635-06c7-4688-a49b-90c4abcdaebb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:00.816040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59531635-06c7-4688-a49b-90c4abcdaebb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:00.816790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59531635-06c7-4688-a49b-90c4abcdaebb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:00.817298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59531635-06c7-4688-a49b-90c4abcdaebb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:00.818359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59531635-06c7-4688-a49b-90c4abcdaebb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:00.818994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59531635-06c7-4688-a49b-90c4abcdaebb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:00.819585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59531635-06c7-4688-a49b-90c4abcdaebb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:01.009833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-59531635-06c7-4688-a49b-90c4abcdaebb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:01.034678 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-59531635-06c7-4688-a49b-90c4abcdaebb tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1542 microversion: 2.1 time: 0.221555 Sep 10 10:47:01.037163 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1893/2399] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:00 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1542 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:01.043210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8cb5551d-3b8c-4400-b025-9086a10ec45e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:01.047125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8cb5551d-3b8c-4400-b025-9086a10ec45e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:01.056757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cb5551d-3b8c-4400-b025-9086a10ec45e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:01.057705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cb5551d-3b8c-4400-b025-9086a10ec45e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:01.058317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cb5551d-3b8c-4400-b025-9086a10ec45e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:01.059252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cb5551d-3b8c-4400-b025-9086a10ec45e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:01.059886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cb5551d-3b8c-4400-b025-9086a10ec45e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:01.060490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cb5551d-3b8c-4400-b025-9086a10ec45e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:01.222544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8cb5551d-3b8c-4400-b025-9086a10ec45e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:01.231086 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8cb5551d-3b8c-4400-b025-9086a10ec45e tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1478 microversion: 2.1 time: 0.191618 Sep 10 10:47:01.231667 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1894/2400] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:01 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1478 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:01.262178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a3e456c5-c08e-42d8-a415-28ea735004e5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:01.263047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a3e456c5-c08e-42d8-a415-28ea735004e5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:01.270476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e456c5-c08e-42d8-a415-28ea735004e5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:01.271085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e456c5-c08e-42d8-a415-28ea735004e5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:01.272556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e456c5-c08e-42d8-a415-28ea735004e5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:01.273259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e456c5-c08e-42d8-a415-28ea735004e5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:01.273692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e456c5-c08e-42d8-a415-28ea735004e5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:01.274220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e456c5-c08e-42d8-a415-28ea735004e5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:01.442563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3e456c5-c08e-42d8-a415-28ea735004e5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:01.459159 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a3e456c5-c08e-42d8-a415-28ea735004e5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.225564 Sep 10 10:47:01.460551 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1895/2401] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:01 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:01.648110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ee14725-b914-40db-a943-65147e3388ac tempest-AZV2TestJSON-2094742912 tempest-AZV2TestJSON-2094742912-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:01.650273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee14725-b914-40db-a943-65147e3388ac tempest-AZV2TestJSON-2094742912 tempest-AZV2TestJSON-2094742912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:01.652181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee14725-b914-40db-a943-65147e3388ac tempest-AZV2TestJSON-2094742912 tempest-AZV2TestJSON-2094742912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:01.652838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee14725-b914-40db-a943-65147e3388ac tempest-AZV2TestJSON-2094742912 tempest-AZV2TestJSON-2094742912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:01.653851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee14725-b914-40db-a943-65147e3388ac tempest-AZV2TestJSON-2094742912 tempest-AZV2TestJSON-2094742912-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:01.660344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee14725-b914-40db-a943-65147e3388ac tempest-AZV2TestJSON-2094742912 tempest-AZV2TestJSON-2094742912-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:01.662379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee14725-b914-40db-a943-65147e3388ac tempest-AZV2TestJSON-2094742912 tempest-AZV2TestJSON-2094742912-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:01.701842 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ee14725-b914-40db-a943-65147e3388ac tempest-AZV2TestJSON-2094742912 tempest-AZV2TestJSON-2094742912-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.225442 Sep 10 10:47:01.717057 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1896/2402] 10.222.0.20 () {58 vars in 1164 bytes} [Sat Sep 10 10:47:01 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 10:47:01.730161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef2e54aa-26cc-4bb4-bea1-d089ba1db514 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:01.731968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef2e54aa-26cc-4bb4-bea1-d089ba1db514 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:01.748558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2e54aa-26cc-4bb4-bea1-d089ba1db514 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:01.749024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2e54aa-26cc-4bb4-bea1-d089ba1db514 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:01.749508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2e54aa-26cc-4bb4-bea1-d089ba1db514 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:01.750217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2e54aa-26cc-4bb4-bea1-d089ba1db514 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:01.750682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2e54aa-26cc-4bb4-bea1-d089ba1db514 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:01.751123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2e54aa-26cc-4bb4-bea1-d089ba1db514 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:02.120453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef2e54aa-26cc-4bb4-bea1-d089ba1db514 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:02.133969 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef2e54aa-26cc-4bb4-bea1-d089ba1db514 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1493 microversion: 2.1 time: 0.414236 Sep 10 10:47:02.135440 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1897/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:01 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1493 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:02.145448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-328f7bb2-837f-4182-9fce-b66221037824 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:02.146070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-328f7bb2-837f-4182-9fce-b66221037824 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:02.168049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-328f7bb2-837f-4182-9fce-b66221037824 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:02.168554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-328f7bb2-837f-4182-9fce-b66221037824 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:02.172443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-328f7bb2-837f-4182-9fce-b66221037824 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:02.180327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-328f7bb2-837f-4182-9fce-b66221037824 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:02.190543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-328f7bb2-837f-4182-9fce-b66221037824 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:02.191181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-328f7bb2-837f-4182-9fce-b66221037824 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:02.866672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-328f7bb2-837f-4182-9fce-b66221037824 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:02.875703 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-328f7bb2-837f-4182-9fce-b66221037824 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1542 microversion: 2.1 time: 0.739162 Sep 10 10:47:02.885491 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1898/2404] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:02 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1542 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:02.892770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-110fc6d7-2382-4080-8c81-7e888bb4b345 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:02.894421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-110fc6d7-2382-4080-8c81-7e888bb4b345 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:02.903068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-110fc6d7-2382-4080-8c81-7e888bb4b345 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:02.911330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-110fc6d7-2382-4080-8c81-7e888bb4b345 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:02.912303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-110fc6d7-2382-4080-8c81-7e888bb4b345 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:02.913520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-110fc6d7-2382-4080-8c81-7e888bb4b345 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:02.914176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-110fc6d7-2382-4080-8c81-7e888bb4b345 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:02.917189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-110fc6d7-2382-4080-8c81-7e888bb4b345 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:02.981713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-110fc6d7-2382-4080-8c81-7e888bb4b345 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:47:03.070450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:03.167504 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-110fc6d7-2382-4080-8c81-7e888bb4b345 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 204 len: 0 microversion: 2.1 time: 0.280268 Sep 10 10:47:03.168322 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1899/2405] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:02 2022] DELETE /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:47:03.179068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9c270ca-cc78-43e1-8a1e-bd6d287cee1b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:03.184466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b9c270ca-cc78-43e1-8a1e-bd6d287cee1b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:03.196902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c270ca-cc78-43e1-8a1e-bd6d287cee1b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:03.197762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c270ca-cc78-43e1-8a1e-bd6d287cee1b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:03.199014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c270ca-cc78-43e1-8a1e-bd6d287cee1b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:03.199889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c270ca-cc78-43e1-8a1e-bd6d287cee1b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:03.200671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c270ca-cc78-43e1-8a1e-bd6d287cee1b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:03.201420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c270ca-cc78-43e1-8a1e-bd6d287cee1b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:04.272931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9c270ca-cc78-43e1-8a1e-bd6d287cee1b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9f563e69c34220a28739a06e7abbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381e6e48cd540d89039afd241f4b570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:04.288486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b9c270ca-cc78-43e1-8a1e-bd6d287cee1b tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 200 len: 1478 microversion: 2.1 time: 1.115905 Sep 10 10:47:04.301326 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1900/2406] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:03 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 1478 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:04.301700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-151a0cc2-ed10-420a-8d6b-f53a85d38786 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:04.306162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-151a0cc2-ed10-420a-8d6b-f53a85d38786 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:04.322425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-151a0cc2-ed10-420a-8d6b-f53a85d38786 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:04.322931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-151a0cc2-ed10-420a-8d6b-f53a85d38786 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:04.323373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-151a0cc2-ed10-420a-8d6b-f53a85d38786 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:04.324088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-151a0cc2-ed10-420a-8d6b-f53a85d38786 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:04.337486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-151a0cc2-ed10-420a-8d6b-f53a85d38786 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:04.338056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-151a0cc2-ed10-420a-8d6b-f53a85d38786 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:05.090147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-151a0cc2-ed10-420a-8d6b-f53a85d38786 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:05.107325 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-151a0cc2-ed10-420a-8d6b-f53a85d38786 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.807084 Sep 10 10:47:05.117252 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1901/2407] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:04 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:05.133918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-180c2807-817e-45b4-88e9-78cae4efd16d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:05.136909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-180c2807-817e-45b4-88e9-78cae4efd16d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:05.158678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180c2807-817e-45b4-88e9-78cae4efd16d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:05.159120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180c2807-817e-45b4-88e9-78cae4efd16d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:05.159568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180c2807-817e-45b4-88e9-78cae4efd16d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:05.162943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180c2807-817e-45b4-88e9-78cae4efd16d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:05.163441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180c2807-817e-45b4-88e9-78cae4efd16d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:05.163889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-180c2807-817e-45b4-88e9-78cae4efd16d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:05.639102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-180c2807-817e-45b4-88e9-78cae4efd16d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:05.657138 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-180c2807-817e-45b4-88e9-78cae4efd16d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1499 microversion: 2.1 time: 0.530653 Sep 10 10:47:05.660252 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1902/2408] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:05 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1499 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:05.695951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a7d894e6-f955-4100-88a4-bf494416f016 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:05.697178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a7d894e6-f955-4100-88a4-bf494416f016 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:05.716168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7d894e6-f955-4100-88a4-bf494416f016 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:05.717267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7d894e6-f955-4100-88a4-bf494416f016 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:05.718803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7d894e6-f955-4100-88a4-bf494416f016 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:05.719697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7d894e6-f955-4100-88a4-bf494416f016 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:05.722255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7d894e6-f955-4100-88a4-bf494416f016 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:05.724533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7d894e6-f955-4100-88a4-bf494416f016 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:06.240641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a7d894e6-f955-4100-88a4-bf494416f016 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:06.250209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a7d894e6-f955-4100-88a4-bf494416f016 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1542 microversion: 2.1 time: 0.588736 Sep 10 10:47:06.253324 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1903/2409] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:05 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1542 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:06.263721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-324c7d09-c63e-4d68-94b2-183d59620ebc req-662010ef-fd79-422b-b7b2-9928af7e0679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdeda520-f083-4aa8-81c8-baba06d8771d", "name": "network-vif-deleted", "tag": "7cc5805f-04ae-481c-a914-42ebc2b10924"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:06.284629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-324c7d09-c63e-4d68-94b2-183d59620ebc req-662010ef-fd79-422b-b7b2-9928af7e0679 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:06.285090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-324c7d09-c63e-4d68-94b2-183d59620ebc req-662010ef-fd79-422b-b7b2-9928af7e0679 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:06.285567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-324c7d09-c63e-4d68-94b2-183d59620ebc req-662010ef-fd79-422b-b7b2-9928af7e0679 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:06.307118 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-324c7d09-c63e-4d68-94b2-183d59620ebc req-662010ef-fd79-422b-b7b2-9928af7e0679 service nova] Creating event network-vif-deleted:7cc5805f-04ae-481c-a914-42ebc2b10924 for instance bdeda520-f083-4aa8-81c8-baba06d8771d on n-h2-856894-1 Sep 10 10:47:06.327073 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-324c7d09-c63e-4d68-94b2-183d59620ebc req-662010ef-fd79-422b-b7b2-9928af7e0679 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063562 Sep 10 10:47:06.327879 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1904/2410] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:06.333892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:06.340866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] [instance: bdeda520-f083-4aa8-81c8-baba06d8771d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:06.350860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:06.351346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:06.351786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:06.352488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:06.352943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:06.353396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:06.373794 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] HTTP exception thrown: Instance bdeda520-f083-4aa8-81c8-baba06d8771d could not be found. Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Request method failure captured: Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d HTTP/1.1 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGsLYYWp2NnxzARWwhL7M5x-2RmiWa8uhUBP1vMdmvQSe2YGI-Wi4-E5vBQkmANz2kWSp4uDOHadfdvl6uUa8WhiDZBBSz9wDm8npDU8Mqy1lLfjzkarzpaMncYmiYUlV23Q44yQnY8hKF556hyPlRrfU9No4F1LAYH5fPtNKqj4IG4 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 4381e6e48cd540d89039afd241f4b570 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-318767653 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4381e6e48cd540d89039afd241f4b570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4381e6e48cd540d89039afd241f4b570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4381e6e48cd540d89039afd241f4b570"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4381e6e48cd540d89039afd241f4b570", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-318767653 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 4381e6e48cd540d89039afd241f4b570 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-318767653 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerDiagnosticsNegativeTest-318767653-project Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 6a9f563e69c34220a28739a06e7abbd5 Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-318767653-project Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance bdeda520-f083-4aa8-81c8-baba06d8771d could not be found. Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'bdeda520-f083-4aa8-81c8-baba06d8771d'} Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdeda520-f083-4aa8-81c8-baba06d8771d could not be found. Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdeda520-f083-4aa8-81c8-baba06d8771d could not be found. Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:06.375498 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:06.380215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:06.380215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:06.380215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:06.380215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:06.380215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:06.380215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:06.380215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdeda520-f083-4aa8-81c8-baba06d8771d could not be found. Sep 10 10:47:06.380215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:06.389256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] Returning 404 to user: Instance bdeda520-f083-4aa8-81c8-baba06d8771d could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:06.390647 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bfc73752-f4e8-4333-a1f6-8027979d06ed tempest-ServerDiagnosticsNegativeTest-318767653 tempest-ServerDiagnosticsNegativeTest-318767653-project] 10.222.0.20 "GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d" status: 404 len: 111 microversion: 2.1 time: 0.061319 Sep 10 10:47:06.395388 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1905/2411] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:06 2022] GET /compute/v2.1/servers/bdeda520-f083-4aa8-81c8-baba06d8771d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:06.401342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a45aea0e-2e19-46c6-bdc2-9ed67580012a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:06.402187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a45aea0e-2e19-46c6-bdc2-9ed67580012a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:06.409504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a45aea0e-2e19-46c6-bdc2-9ed67580012a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:06.410232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a45aea0e-2e19-46c6-bdc2-9ed67580012a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:06.410834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a45aea0e-2e19-46c6-bdc2-9ed67580012a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:06.411896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a45aea0e-2e19-46c6-bdc2-9ed67580012a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:06.412614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a45aea0e-2e19-46c6-bdc2-9ed67580012a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:06.413470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a45aea0e-2e19-46c6-bdc2-9ed67580012a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:07.179114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a45aea0e-2e19-46c6-bdc2-9ed67580012a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:07.199343 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a45aea0e-2e19-46c6-bdc2-9ed67580012a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.802559 Sep 10 10:47:07.205132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1906/2412] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:06 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:07.231928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:07.235277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:07.243390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:07.243884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:07.244324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:07.245879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:07.246333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:07.246946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:07.288952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:07.289703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:07.290428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:07.291901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lazy-loading 'fault' on Instance uuid 23234f05-7a83-4d00-be4d-deaca2a67637 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:47:07.379003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa978e59fa334084b722d116c761380f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1749f9d599ef467e84f306202e2a6b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:07.395978 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea2c8e1d-8a4a-4859-9369-31fddfe33818 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 200 len: 1305 microversion: 2.1 time: 0.186855 Sep 10 10:47:07.414036 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1907/2413] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:07 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 1305 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:07.761269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-461321712", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "928b2c88-18f3-45a3-9d17-bd8a3e62afe4"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:07.894387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] validate_networks() for [('928b2c88-18f3-45a3-9d17-bd8a3e62afe4', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:47:08.869978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:47:08.870641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:47:08.870854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:47:08.871449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:47:08.872048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:47:08.882203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:08.882912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:08.883832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:08.884747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:08.885413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:08.886022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:08.922521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Getting quotas for project 8f8c3fd9c84842eaba6f58e6f974c37e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:47:08.938935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Getting quotas for user 3801735334044dfe946e35d0c8af6aa4 and project 8f8c3fd9c84842eaba6f58e6f974c37e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:47:08.945630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:08.979388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:47:08.982344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:47:09.088253 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef947650-0612-46b4-bdff-45897f344eb3 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.671073 Sep 10 10:47:09.088952 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1908/2414] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:47:09.101191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e86e0bf6-b639-424c-9ac4-a9237b854d49 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:09.102247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e86e0bf6-b639-424c-9ac4-a9237b854d49 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:09.121453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e86e0bf6-b639-424c-9ac4-a9237b854d49 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:09.122360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e86e0bf6-b639-424c-9ac4-a9237b854d49 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:09.123167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e86e0bf6-b639-424c-9ac4-a9237b854d49 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:09.124399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e86e0bf6-b639-424c-9ac4-a9237b854d49 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:09.125226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e86e0bf6-b639-424c-9ac4-a9237b854d49 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:09.126107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e86e0bf6-b639-424c-9ac4-a9237b854d49 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:09.576348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e86e0bf6-b639-424c-9ac4-a9237b854d49 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:09.597369 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e86e0bf6-b639-424c-9ac4-a9237b854d49 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1542 microversion: 2.1 time: 0.499260 Sep 10 10:47:09.600113 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1909/2415] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:09 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1542 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:09.611740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c87f34e-6492-4a86-8e56-318bcd1f3bda tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:09.614881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6c87f34e-6492-4a86-8e56-318bcd1f3bda tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:09.633800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c87f34e-6492-4a86-8e56-318bcd1f3bda tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:09.635201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c87f34e-6492-4a86-8e56-318bcd1f3bda tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:09.636618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c87f34e-6492-4a86-8e56-318bcd1f3bda tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:09.638593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c87f34e-6492-4a86-8e56-318bcd1f3bda tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:09.641677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c87f34e-6492-4a86-8e56-318bcd1f3bda tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:09.644204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c87f34e-6492-4a86-8e56-318bcd1f3bda tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.134657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6c87f34e-6492-4a86-8e56-318bcd1f3bda tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:10.146046 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c87f34e-6492-4a86-8e56-318bcd1f3bda tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.542833 Sep 10 10:47:10.166319 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1910/2416] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:09 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:10.176385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-316e23d9-7221-4aa9-8932-d76f87a5ef22 req-6fb937ba-1cd3-4071-86d5-7f5f202f50dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23234f05-7a83-4d00-be4d-deaca2a67637", "name": "network-vif-deleted", "tag": "721e1b09-8f77-4410-b81d-7a7cad3ebe63"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:10.195848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-316e23d9-7221-4aa9-8932-d76f87a5ef22 req-6fb937ba-1cd3-4071-86d5-7f5f202f50dd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.196504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-316e23d9-7221-4aa9-8932-d76f87a5ef22 req-6fb937ba-1cd3-4071-86d5-7f5f202f50dd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.197156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-316e23d9-7221-4aa9-8932-d76f87a5ef22 req-6fb937ba-1cd3-4071-86d5-7f5f202f50dd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.234482 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-316e23d9-7221-4aa9-8932-d76f87a5ef22 req-6fb937ba-1cd3-4071-86d5-7f5f202f50dd service nova] Creating event network-vif-deleted:721e1b09-8f77-4410-b81d-7a7cad3ebe63 for instance 23234f05-7a83-4d00-be4d-deaca2a67637 on n-h2-856894-1 Sep 10 10:47:10.245922 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-316e23d9-7221-4aa9-8932-d76f87a5ef22 req-6fb937ba-1cd3-4071-86d5-7f5f202f50dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078348 Sep 10 10:47:10.250684 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1911/2417] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:10.264261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:10.267439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:10.279799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.286089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.286985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.288057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.288715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.289357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.317331 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 HTTP/1.1 Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '23234f05-7a83-4d00-be4d-deaca2a67637'} Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:10.324803 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.329636 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:10.329636 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:10.329636 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:10.329636 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:10.329636 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:10.329636 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.329636 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.335301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:10.336522 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5295222b-f5e3-463f-a81a-ceef252214b8 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 404 len: 111 microversion: 2.1 time: 0.083549 Sep 10 10:47:10.345823 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1912/2418] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:10 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:10.359176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0d1d6c5-7a68-48aa-8869-1337483524fa tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:10.360127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0d1d6c5-7a68-48aa-8869-1337483524fa tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:10.375146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1d6c5-7a68-48aa-8869-1337483524fa tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.377700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1d6c5-7a68-48aa-8869-1337483524fa tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.381437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1d6c5-7a68-48aa-8869-1337483524fa tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.382476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1d6c5-7a68-48aa-8869-1337483524fa tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.383154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1d6c5-7a68-48aa-8869-1337483524fa tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.383833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1d6c5-7a68-48aa-8869-1337483524fa tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.516606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0d1d6c5-7a68-48aa-8869-1337483524fa tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:10.529865 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0d1d6c5-7a68-48aa-8869-1337483524fa tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1212 microversion: 2.1 time: 0.180915 Sep 10 10:47:10.533278 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1913/2419] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:10 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1212 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:10.545022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:10.546131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:10.563754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.565614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.566478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.567452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.568148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.568849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.601356 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 HTTP/1.1 Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '23234f05-7a83-4d00-be4d-deaca2a67637'} Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:10.603352 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.607224 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.609325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:10.610497 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d690e408-2077-4fd4-bd2e-d61bc91b8c4d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 404 len: 111 microversion: 2.1 time: 0.075915 Sep 10 10:47:10.615160 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1914/2420] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:10 2022] DELETE /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:10.620508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:10.621724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 23234f05-7a83-4d00-be4d-deaca2a67637] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:10.629736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.630628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.631497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.632898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.633653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.634332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.658615 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 HTTP/1.1 Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '23234f05-7a83-4d00-be4d-deaca2a67637'} Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:10.660854 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.665037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:10.665037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:10.665037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:10.665037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:10.665037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:10.665037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. Sep 10 10:47:10.665037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:10.665037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 23234f05-7a83-4d00-be4d-deaca2a67637 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:10.665037 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2aa76efc-9eec-4641-b47f-b1cbc0f5b755 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637" status: 404 len: 111 microversion: 2.1 time: 0.047231 Sep 10 10:47:10.722045 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1915/2421] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:10 2022] GET /compute/v2.1/servers/23234f05-7a83-4d00-be4d-deaca2a67637 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:10.732544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74033064-a50b-4f6d-9dba-7acc86a3c3ba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:10.733256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74033064-a50b-4f6d-9dba-7acc86a3c3ba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:10.745316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74033064-a50b-4f6d-9dba-7acc86a3c3ba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.745814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74033064-a50b-4f6d-9dba-7acc86a3c3ba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.746263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74033064-a50b-4f6d-9dba-7acc86a3c3ba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:10.746965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74033064-a50b-4f6d-9dba-7acc86a3c3ba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:10.747425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74033064-a50b-4f6d-9dba-7acc86a3c3ba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:10.747852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74033064-a50b-4f6d-9dba-7acc86a3c3ba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:11.126578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74033064-a50b-4f6d-9dba-7acc86a3c3ba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:11.142493 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74033064-a50b-4f6d-9dba-7acc86a3c3ba tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1542 microversion: 2.1 time: 0.419092 Sep 10 10:47:11.155050 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1916/2422] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:10 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1542 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:11.161864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:11.162576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:11.170328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:11.171985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:11.176171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:11.178970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:11.179652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:11.180425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:11.209033 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe HTTP/1.1 Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '18610e7e-0f81-4038-abc9-9772929a13fe'} Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:11.221883 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:11.226507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-620a322f-20eb-48c2-b106-094558bcfb20 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 404 len: 111 microversion: 2.1 time: 0.066863 Sep 10 10:47:11.231428 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1917/2423] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:11 2022] DELETE /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:11.240180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd6784cd-02b9-4a2e-ae80-3fbb4c467422 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:11.241092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd6784cd-02b9-4a2e-ae80-3fbb4c467422 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:11.248299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd6784cd-02b9-4a2e-ae80-3fbb4c467422 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:11.248656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd6784cd-02b9-4a2e-ae80-3fbb4c467422 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:11.249336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd6784cd-02b9-4a2e-ae80-3fbb4c467422 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:11.250045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd6784cd-02b9-4a2e-ae80-3fbb4c467422 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:11.250506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd6784cd-02b9-4a2e-ae80-3fbb4c467422 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:11.250942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd6784cd-02b9-4a2e-ae80-3fbb4c467422 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:11.889136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd6784cd-02b9-4a2e-ae80-3fbb4c467422 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:11.904104 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd6784cd-02b9-4a2e-ae80-3fbb4c467422 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.667785 Sep 10 10:47:11.910784 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1918/2424] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:11 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:11.938394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:11.943869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 18610e7e-0f81-4038-abc9-9772929a13fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:11.972474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:11.974261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:11.974921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:11.976225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:11.979120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:11.980838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:12.011932 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe HTTP/1.1 Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '18610e7e-0f81-4038-abc9-9772929a13fe'} Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:12.014677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:12.019705 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:12.019705 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:12.019705 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:12.019705 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:12.019705 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:12.019705 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. Sep 10 10:47:12.019705 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:12.027032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 18610e7e-0f81-4038-abc9-9772929a13fe could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:12.028019 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d39771a-385c-46f4-aecf-035de943901e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe" status: 404 len: 111 microversion: 2.1 time: 0.116035 Sep 10 10:47:12.028603 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1919/2425] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:11 2022] GET /compute/v2.1/servers/18610e7e-0f81-4038-abc9-9772929a13fe => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:12.049150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-70e0f390-498f-47c1-976e-94e42c59e7f4 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:12.049766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-70e0f390-498f-47c1-976e-94e42c59e7f4 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:12.070387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70e0f390-498f-47c1-976e-94e42c59e7f4 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:12.070893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70e0f390-498f-47c1-976e-94e42c59e7f4 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:12.071593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70e0f390-498f-47c1-976e-94e42c59e7f4 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:12.080716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70e0f390-498f-47c1-976e-94e42c59e7f4 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:12.081501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70e0f390-498f-47c1-976e-94e42c59e7f4 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:12.082108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70e0f390-498f-47c1-976e-94e42c59e7f4 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:12.343649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-70e0f390-498f-47c1-976e-94e42c59e7f4 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:12.351039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:12.363838 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-70e0f390-498f-47c1-976e-94e42c59e7f4 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1268 microversion: 2.1 time: 0.327740 Sep 10 10:47:12.374688 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1920/2426] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:12 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1268 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:12.382636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:12.383149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:12.408231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:12.413478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:12.413997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:12.415124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:12.415607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:12.416049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:12.435114 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 HTTP/1.1 Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'aae35632-52bf-4dd6-88fb-b4419eab5073'} Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:12.436719 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88a416df-a82e-4ead-9be6-f5633c7239b1 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 404 len: 111 microversion: 2.1 time: 0.062696 Sep 10 10:47:12.442500 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1921/2427] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:12 2022] DELETE /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:12.763796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-48176611", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:12.919257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:47:13.747222 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:47:13.747222 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:47:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 10:47:13.790734 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:47:13.790894 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:47:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 10:47:14.420975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:47:14.422004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:47:14.423813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:47:14.424564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:47:14.425176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:47:14.450708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:14.451480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:14.451925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:14.452925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:14.453425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:14.453858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:14.500771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Getting quotas for project a8e0700581294ce78914145c18a1a70f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:47:14.509583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Getting quotas for user 036380e89f5e422ab0e5a66ee0a98777 and project a8e0700581294ce78914145c18a1a70f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:47:14.533271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:47:14.537034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:47:14.634511 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5e71313e-44f0-4cea-bcc7-0efb4b374914 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.193306 Sep 10 10:47:14.648613 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1922/2428] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:47:14.679905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6b4f857c-6bd8-49a1-be71-fbaf7d90f5a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:14.680965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6b4f857c-6bd8-49a1-be71-fbaf7d90f5a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:14.697012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b4f857c-6bd8-49a1-be71-fbaf7d90f5a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:14.702333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b4f857c-6bd8-49a1-be71-fbaf7d90f5a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:14.702799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b4f857c-6bd8-49a1-be71-fbaf7d90f5a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:14.703529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b4f857c-6bd8-49a1-be71-fbaf7d90f5a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:14.703994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b4f857c-6bd8-49a1-be71-fbaf7d90f5a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:14.704948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b4f857c-6bd8-49a1-be71-fbaf7d90f5a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:15.395719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6b4f857c-6bd8-49a1-be71-fbaf7d90f5a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:15.404919 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6b4f857c-6bd8-49a1-be71-fbaf7d90f5a1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1475 microversion: 2.1 time: 0.753215 Sep 10 10:47:15.409433 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1923/2429] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:14 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1475 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:15.426792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:15.427427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: aae35632-52bf-4dd6-88fb-b4419eab5073] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:15.443617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:15.444028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:15.444465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:15.445203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:15.445842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:15.447733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:15.485307 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 HTTP/1.1 Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'aae35632-52bf-4dd6-88fb-b4419eab5073'} Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:15.490872 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:15.495630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:15.495630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:15.495630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:15.495630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:15.495630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:15.495630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. Sep 10 10:47:15.495630 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:15.495630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance aae35632-52bf-4dd6-88fb-b4419eab5073 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:15.495630 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e259aa20-f2ce-424b-9a92-3f49a606313d tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073" status: 404 len: 111 microversion: 2.1 time: 0.081938 Sep 10 10:47:15.497196 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1924/2430] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:15 2022] GET /compute/v2.1/servers/aae35632-52bf-4dd6-88fb-b4419eab5073 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:15.509652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9c50d80-cb3e-4c7a-ae08-aede151a7ec2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:15.512063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9c50d80-cb3e-4c7a-ae08-aede151a7ec2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:15.528499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9c50d80-cb3e-4c7a-ae08-aede151a7ec2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:15.530776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9c50d80-cb3e-4c7a-ae08-aede151a7ec2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:15.531627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9c50d80-cb3e-4c7a-ae08-aede151a7ec2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:15.533941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9c50d80-cb3e-4c7a-ae08-aede151a7ec2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:15.534590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9c50d80-cb3e-4c7a-ae08-aede151a7ec2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:15.535682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9c50d80-cb3e-4c7a-ae08-aede151a7ec2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:15.945802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9c50d80-cb3e-4c7a-ae08-aede151a7ec2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:15.966151 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9c50d80-cb3e-4c7a-ae08-aede151a7ec2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.467720 Sep 10 10:47:15.968756 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1925/2431] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:15 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:15.980075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f69744c-bdfd-4fcd-b084-03cce4abe179 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:15.981269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f69744c-bdfd-4fcd-b084-03cce4abe179 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:15.991877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f69744c-bdfd-4fcd-b084-03cce4abe179 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:15.992820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f69744c-bdfd-4fcd-b084-03cce4abe179 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:15.993662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f69744c-bdfd-4fcd-b084-03cce4abe179 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:15.994534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f69744c-bdfd-4fcd-b084-03cce4abe179 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:15.995330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f69744c-bdfd-4fcd-b084-03cce4abe179 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:15.995910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f69744c-bdfd-4fcd-b084-03cce4abe179 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:16.709801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f69744c-bdfd-4fcd-b084-03cce4abe179 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:16.727080 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f69744c-bdfd-4fcd-b084-03cce4abe179 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1316 microversion: 2.1 time: 0.755726 Sep 10 10:47:16.729291 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1926/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:15 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1316 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:16.736712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-321989958", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:16.828857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:47:17.464419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:47:17.464950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:47:17.465955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:47:17.466576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:47:17.467214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:47:17.477439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:17.478286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:17.479053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:17.480003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:17.480666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:17.481331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:17.526294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Getting quotas for project a8e0700581294ce78914145c18a1a70f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:47:17.533353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Getting quotas for user 036380e89f5e422ab0e5a66ee0a98777 and project a8e0700581294ce78914145c18a1a70f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:47:17.553841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:47:17.557768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:47:17.649311 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fa580c40-3be1-40eb-b167-b0a2981f03cb tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913000 Sep 10 10:47:17.656627 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1927/2433] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:47:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:47:17.674928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:17.675881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:17.726487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:17.727198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:17.731073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:17.732546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:17.736918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:17.737528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:17.792519 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 HTTP/1.1 Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '8542d6bf-4373-44a8-9ffe-46f8e25a0ed7'} Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:17.797485 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:17.801464 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b349064e-3f35-4769-9a28-6252ae5125ad tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 404 len: 111 microversion: 2.1 time: 0.147471 Sep 10 10:47:17.808696 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1928/2434] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:17 2022] DELETE /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:17.822644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9566e016-fde1-47b2-8131-307aacb6c214 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:17.826905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9566e016-fde1-47b2-8131-307aacb6c214 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:17.847103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9566e016-fde1-47b2-8131-307aacb6c214 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:17.847729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9566e016-fde1-47b2-8131-307aacb6c214 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:17.848289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9566e016-fde1-47b2-8131-307aacb6c214 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:17.849186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9566e016-fde1-47b2-8131-307aacb6c214 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:17.851049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9566e016-fde1-47b2-8131-307aacb6c214 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:17.851585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9566e016-fde1-47b2-8131-307aacb6c214 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:18.406051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9566e016-fde1-47b2-8131-307aacb6c214 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:18.419364 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9566e016-fde1-47b2-8131-307aacb6c214 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1470 microversion: 2.1 time: 0.609376 Sep 10 10:47:18.429189 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1929/2435] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:17 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1470 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:18.434403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1cc2ac96-c136-48d2-81a3-f1b2245b84b9 req-9c492952-56bf-4f81-8027-7899c5896530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee459b93-4eb4-4aef-a49a-932de04dd93c", "name": "network-vif-unplugged", "status": "completed", "tag": "39589cf4-02b9-4961-8e0c-79680b9855a0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:18.452283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1cc2ac96-c136-48d2-81a3-f1b2245b84b9 req-9c492952-56bf-4f81-8027-7899c5896530 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:18.452789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1cc2ac96-c136-48d2-81a3-f1b2245b84b9 req-9c492952-56bf-4f81-8027-7899c5896530 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:18.453157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1cc2ac96-c136-48d2-81a3-f1b2245b84b9 req-9c492952-56bf-4f81-8027-7899c5896530 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:18.466786 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1cc2ac96-c136-48d2-81a3-f1b2245b84b9 req-9c492952-56bf-4f81-8027-7899c5896530 service nova] Creating event network-vif-unplugged:39589cf4-02b9-4961-8e0c-79680b9855a0 for instance ee459b93-4eb4-4aef-a49a-932de04dd93c on n-h2-856894-1 Sep 10 10:47:18.474969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-1cc2ac96-c136-48d2-81a3-f1b2245b84b9 req-9c492952-56bf-4f81-8027-7899c5896530 service nova] Instance ee459b93-4eb4-4aef-a49a-932de04dd93c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 10:47:18.483274 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1cc2ac96-c136-48d2-81a3-f1b2245b84b9 req-9c492952-56bf-4f81-8027-7899c5896530 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061713 Sep 10 10:47:18.484917 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1930/2436] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:18.491948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a6af6b46-d020-4624-ab33-06b89a7f7eb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:18.493497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a6af6b46-d020-4624-ab33-06b89a7f7eb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:18.503010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6af6b46-d020-4624-ab33-06b89a7f7eb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:18.503858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6af6b46-d020-4624-ab33-06b89a7f7eb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:18.504634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6af6b46-d020-4624-ab33-06b89a7f7eb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:18.506304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6af6b46-d020-4624-ab33-06b89a7f7eb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:18.507689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6af6b46-d020-4624-ab33-06b89a7f7eb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:18.509805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6af6b46-d020-4624-ab33-06b89a7f7eb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:18.933255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a6af6b46-d020-4624-ab33-06b89a7f7eb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:18.950260 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a6af6b46-d020-4624-ab33-06b89a7f7eb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.462483 Sep 10 10:47:18.970853 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1931/2437] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:18 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:18.980270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07a4c72c-6f04-49d3-95d4-d62f37f3c1da tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:18.981328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07a4c72c-6f04-49d3-95d4-d62f37f3c1da tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:18.989924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a4c72c-6f04-49d3-95d4-d62f37f3c1da tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:18.990698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a4c72c-6f04-49d3-95d4-d62f37f3c1da tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:18.991363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a4c72c-6f04-49d3-95d4-d62f37f3c1da tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:19.004426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a4c72c-6f04-49d3-95d4-d62f37f3c1da tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:19.007689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a4c72c-6f04-49d3-95d4-d62f37f3c1da tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:19.008462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a4c72c-6f04-49d3-95d4-d62f37f3c1da tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:19.243004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-07a4c72c-6f04-49d3-95d4-d62f37f3c1da tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:19.256338 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07a4c72c-6f04-49d3-95d4-d62f37f3c1da tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1265 microversion: 2.1 time: 0.282550 Sep 10 10:47:19.256940 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1932/2438] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:18 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:19.270636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f58e33a-c69b-43bf-bbab-d01bf7c3749b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:19.271711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f58e33a-c69b-43bf-bbab-d01bf7c3749b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:19.279615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f58e33a-c69b-43bf-bbab-d01bf7c3749b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:19.280057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f58e33a-c69b-43bf-bbab-d01bf7c3749b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:19.280755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f58e33a-c69b-43bf-bbab-d01bf7c3749b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:19.281484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f58e33a-c69b-43bf-bbab-d01bf7c3749b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:19.282146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f58e33a-c69b-43bf-bbab-d01bf7c3749b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:19.282757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f58e33a-c69b-43bf-bbab-d01bf7c3749b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:19.573454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1f58e33a-c69b-43bf-bbab-d01bf7c3749b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:19.587103 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f58e33a-c69b-43bf-bbab-d01bf7c3749b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1316 microversion: 2.1 time: 0.328819 Sep 10 10:47:19.604165 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1933/2439] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:19 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:19.613724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:19.615485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:19.622201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:19.623965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:19.624704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:19.625709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:19.626967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:19.627621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:19.646646 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 HTTP/1.1 Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '8542d6bf-4373-44a8-9ffe-46f8e25a0ed7'} Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:19.649418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:19.655362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:19.655362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:19.655362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:19.655362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:19.655362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:19.655362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. Sep 10 10:47:19.655362 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:19.659651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:19.660530 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8dbdb409-5595-47dd-8a98-b19956a6669e tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7" status: 404 len: 111 microversion: 2.1 time: 0.055015 Sep 10 10:47:19.665977 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1934/2440] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:19 2022] GET /compute/v2.1/servers/8542d6bf-4373-44a8-9ffe-46f8e25a0ed7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:19.674365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:19.681261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:19.691257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:19.696020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:19.696637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:19.698095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:19.698946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:19.699629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:19.774997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:19.775486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:19.775929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:19.776659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:19.777128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:19.781391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:19.826358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for project 7c408248417b4deaaa26ef380da4bb90. Resources: {'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:47:19.838618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for user f5b257d1488141689c826efe484e4040 and project 7c408248417b4deaaa26ef380da4bb90. Resources: {'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:47:19.861558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:20.024706 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b646ae83-176f-4e4e-ae1c-648a0ec6f3da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c/action" status: 202 len: 0 microversion: 2.1 time: 0.357077 Sep 10 10:47:20.028516 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1935/2441] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:47:19 2022] POST /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:47:20.038955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7886a096-77f2-4f00-8c04-afd7ae3dbe96 req-68543ba7-d0f6-4120-b4c5-ff5ec1079b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93abea13-0bab-41b4-8db8-9d52f75d4eb7", "tag": "db17c464-54e5-49a3-9e72-09d0a71acfea"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:20.060907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7886a096-77f2-4f00-8c04-afd7ae3dbe96 req-68543ba7-d0f6-4120-b4c5-ff5ec1079b2e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:20.062430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7886a096-77f2-4f00-8c04-afd7ae3dbe96 req-68543ba7-d0f6-4120-b4c5-ff5ec1079b2e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:20.064566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7886a096-77f2-4f00-8c04-afd7ae3dbe96 req-68543ba7-d0f6-4120-b4c5-ff5ec1079b2e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:20.113855 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7886a096-77f2-4f00-8c04-afd7ae3dbe96 req-68543ba7-d0f6-4120-b4c5-ff5ec1079b2e service nova] Creating event network-changed:db17c464-54e5-49a3-9e72-09d0a71acfea for instance 93abea13-0bab-41b4-8db8-9d52f75d4eb7 on n-h2-856894-1 Sep 10 10:47:20.124376 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7886a096-77f2-4f00-8c04-afd7ae3dbe96 req-68543ba7-d0f6-4120-b4c5-ff5ec1079b2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093012 Sep 10 10:47:20.127808 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1936/2442] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:20.228904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-787ddab8-a166-45b9-b453-513fb3a159dd tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Action: 'create', calling method: .version_select at 0x7efcae4051f0>, body: {"keypair": {"name": "tempest-keypair-1094995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJht/NVQpUBFpuAU2NG6U3hQXvywiv+jWj2ZYNQALurfjqpt8u969jHw+Dvu7GYVUkvmiSxO2ceNwdztypDudm/H4RShh9Yg9TwLRQeSoTinZF7eH2Xb92MZ+NBEIbfnww=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:20.256703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-787ddab8-a166-45b9-b453-513fb3a159dd tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Getting quotas for project 72599cbbdc464dfda19d7659518c02ff. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:47:20.265471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-787ddab8-a166-45b9-b453-513fb3a159dd tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Getting quotas for user 90e056c746024ae59524e4ddf7d529d7 and project 72599cbbdc464dfda19d7659518c02ff. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:47:20.317206 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-787ddab8-a166-45b9-b453-513fb3a159dd tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.185900 Sep 10 10:47:20.317847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1937/2443] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:47:20 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:20.332668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:20.333365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 0ac3602b-3a76-46ac-be5c-61337f66c441] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:20.342082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:20.343584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:20.344079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:20.345678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:20.346696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:20.347290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:20.373377 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 HTTP/1.1 Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '0ac3602b-3a76-46ac-be5c-61337f66c441'} Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:20.378597 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:47:20.383615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:20.386545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:20.389144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b04e8a20-4458-471b-a63c-ebc3f5d430cc tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441" status: 404 len: 111 microversion: 2.1 time: 0.061485 Sep 10 10:47:20.390331 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1938/2444] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:20 2022] DELETE /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:20.397534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e4a0ccaf-d31b-4ef5-9150-5ad61e5a9c01 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:20.398646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e4a0ccaf-d31b-4ef5-9150-5ad61e5a9c01 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:20.408575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4a0ccaf-d31b-4ef5-9150-5ad61e5a9c01 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:20.409143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4a0ccaf-d31b-4ef5-9150-5ad61e5a9c01 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:20.409582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4a0ccaf-d31b-4ef5-9150-5ad61e5a9c01 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:20.410480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4a0ccaf-d31b-4ef5-9150-5ad61e5a9c01 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:20.411082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4a0ccaf-d31b-4ef5-9150-5ad61e5a9c01 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:20.411361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4a0ccaf-d31b-4ef5-9150-5ad61e5a9c01 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:21.532881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e4a0ccaf-d31b-4ef5-9150-5ad61e5a9c01 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:21.546120 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e4a0ccaf-d31b-4ef5-9150-5ad61e5a9c01 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 1.154377 Sep 10 10:47:21.555717 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1939/2445] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:20 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:21.562538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d309411-d24a-4202-aa6b-beafede379f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:21.563160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d309411-d24a-4202-aa6b-beafede379f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:21.583502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d309411-d24a-4202-aa6b-beafede379f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:21.584116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d309411-d24a-4202-aa6b-beafede379f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:21.584372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d309411-d24a-4202-aa6b-beafede379f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:21.585328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d309411-d24a-4202-aa6b-beafede379f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:21.585814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d309411-d24a-4202-aa6b-beafede379f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:21.586207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d309411-d24a-4202-aa6b-beafede379f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:22.219468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6d309411-d24a-4202-aa6b-beafede379f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:22.228903 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6d309411-d24a-4202-aa6b-beafede379f3 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1469 microversion: 2.1 time: 0.671984 Sep 10 10:47:22.229774 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1940/2446] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:21 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1469 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:22.234789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82fc81a9-24e0-409f-a06c-8f6b2bcbf3ee tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:22.235655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82fc81a9-24e0-409f-a06c-8f6b2bcbf3ee tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:22.241771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82fc81a9-24e0-409f-a06c-8f6b2bcbf3ee tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:22.242557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82fc81a9-24e0-409f-a06c-8f6b2bcbf3ee tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:22.243154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82fc81a9-24e0-409f-a06c-8f6b2bcbf3ee tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:22.244030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82fc81a9-24e0-409f-a06c-8f6b2bcbf3ee tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:22.244642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82fc81a9-24e0-409f-a06c-8f6b2bcbf3ee tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:22.245463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82fc81a9-24e0-409f-a06c-8f6b2bcbf3ee tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:22.250932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:22.391885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-82fc81a9-24e0-409f-a06c-8f6b2bcbf3ee tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:22.414791 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82fc81a9-24e0-409f-a06c-8f6b2bcbf3ee tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1271 microversion: 2.1 time: 0.181775 Sep 10 10:47:22.419664 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1941/2447] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:22 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:22.424562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:22.425200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 0ac3602b-3a76-46ac-be5c-61337f66c441] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:22.440619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:22.441291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:22.441574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:22.442276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:22.442728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:22.443147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:22.480221 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 HTTP/1.1 Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '0ac3602b-3a76-46ac-be5c-61337f66c441'} Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:22.485253 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:22.490051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:22.490051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:22.490051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:22.490051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:22.490051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:22.490051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. Sep 10 10:47:22.490051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:22.490051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 0ac3602b-3a76-46ac-be5c-61337f66c441 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:22.490051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9869766-e1ed-4a89-89d1-422a72a20eeb tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441" status: 404 len: 111 microversion: 2.1 time: 0.066086 Sep 10 10:47:22.491940 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1942/2448] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:22 2022] GET /compute/v2.1/servers/0ac3602b-3a76-46ac-be5c-61337f66c441 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:22.497978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-386c8d1e-2061-40ae-8919-ac76ae4e725b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:22.498600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-386c8d1e-2061-40ae-8919-ac76ae4e725b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:22.505358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-386c8d1e-2061-40ae-8919-ac76ae4e725b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:22.505854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-386c8d1e-2061-40ae-8919-ac76ae4e725b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:22.506594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-386c8d1e-2061-40ae-8919-ac76ae4e725b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:22.507308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-386c8d1e-2061-40ae-8919-ac76ae4e725b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:22.507760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-386c8d1e-2061-40ae-8919-ac76ae4e725b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:22.508454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-386c8d1e-2061-40ae-8919-ac76ae4e725b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:23.031665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-386c8d1e-2061-40ae-8919-ac76ae4e725b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:23.048511 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-386c8d1e-2061-40ae-8919-ac76ae4e725b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1316 microversion: 2.1 time: 0.555362 Sep 10 10:47:23.052491 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1943/2449] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:22 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:23.070671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a9eb4da8-461e-4598-b1f9-973ea239abee tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:23.072023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a9eb4da8-461e-4598-b1f9-973ea239abee tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:23.082299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9eb4da8-461e-4598-b1f9-973ea239abee tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:23.083144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9eb4da8-461e-4598-b1f9-973ea239abee tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:23.083831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9eb4da8-461e-4598-b1f9-973ea239abee tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:23.084726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9eb4da8-461e-4598-b1f9-973ea239abee tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:23.088931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9eb4da8-461e-4598-b1f9-973ea239abee tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:23.089854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9eb4da8-461e-4598-b1f9-973ea239abee tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:23.710320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a9eb4da8-461e-4598-b1f9-973ea239abee tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:23.739684 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a9eb4da8-461e-4598-b1f9-973ea239abee tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.685606 Sep 10 10:47:23.752162 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1944/2450] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:23 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:23.781100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c9c2ca1b-6859-414e-9cec-59a8502a083a req-3991d627-0eb6-4535-a123-d0f199e4eb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee459b93-4eb4-4aef-a49a-932de04dd93c", "name": "network-vif-plugged", "status": "completed", "tag": "39589cf4-02b9-4961-8e0c-79680b9855a0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:23.810483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c9c2ca1b-6859-414e-9cec-59a8502a083a req-3991d627-0eb6-4535-a123-d0f199e4eb1d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:23.812054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c9c2ca1b-6859-414e-9cec-59a8502a083a req-3991d627-0eb6-4535-a123-d0f199e4eb1d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:23.813950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c9c2ca1b-6859-414e-9cec-59a8502a083a req-3991d627-0eb6-4535-a123-d0f199e4eb1d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:23.855250 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c9c2ca1b-6859-414e-9cec-59a8502a083a req-3991d627-0eb6-4535-a123-d0f199e4eb1d service nova] Creating event network-vif-plugged:39589cf4-02b9-4961-8e0c-79680b9855a0 for instance ee459b93-4eb4-4aef-a49a-932de04dd93c on n-h2-856894-1 Sep 10 10:47:23.879224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-c9c2ca1b-6859-414e-9cec-59a8502a083a req-3991d627-0eb6-4535-a123-d0f199e4eb1d service nova] Instance ee459b93-4eb4-4aef-a49a-932de04dd93c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 10:47:23.894852 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c9c2ca1b-6859-414e-9cec-59a8502a083a req-3991d627-0eb6-4535-a123-d0f199e4eb1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134961 Sep 10 10:47:23.901181 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1945/2451] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:23.917248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93744fcf-a734-4cd9-bde0-bfa358beaaac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:23.923321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93744fcf-a734-4cd9-bde0-bfa358beaaac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:23.939030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93744fcf-a734-4cd9-bde0-bfa358beaaac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:23.941777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93744fcf-a734-4cd9-bde0-bfa358beaaac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:23.942543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93744fcf-a734-4cd9-bde0-bfa358beaaac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:23.945044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93744fcf-a734-4cd9-bde0-bfa358beaaac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:23.945708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93744fcf-a734-4cd9-bde0-bfa358beaaac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:23.948526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93744fcf-a734-4cd9-bde0-bfa358beaaac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:24.361457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93744fcf-a734-4cd9-bde0-bfa358beaaac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:24.375014 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93744fcf-a734-4cd9-bde0-bfa358beaaac tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1469 microversion: 2.1 time: 0.471013 Sep 10 10:47:24.376499 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1946/2452] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:23 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1469 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:24.389242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-caaa7f9b-9ea2-4b1d-ba7b-6733115860d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:24.393799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-caaa7f9b-9ea2-4b1d-ba7b-6733115860d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:24.411398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caaa7f9b-9ea2-4b1d-ba7b-6733115860d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:24.411900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caaa7f9b-9ea2-4b1d-ba7b-6733115860d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:24.416788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caaa7f9b-9ea2-4b1d-ba7b-6733115860d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:24.417645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caaa7f9b-9ea2-4b1d-ba7b-6733115860d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:24.418128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caaa7f9b-9ea2-4b1d-ba7b-6733115860d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:24.420522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-caaa7f9b-9ea2-4b1d-ba7b-6733115860d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:25.730826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-caaa7f9b-9ea2-4b1d-ba7b-6733115860d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:25.750156 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-caaa7f9b-9ea2-4b1d-ba7b-6733115860d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1313 microversion: 2.1 time: 1.370675 Sep 10 10:47:25.756728 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1947/2453] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:24 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1313 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:25.778111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-58bd26e5-d223-420c-9686-5b8e4003d7ba req-5a85cd0b-97d5-4b48-b985-ad29d22bf72b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0e0a60-5b09-404d-8e58-92a80dad0840", "tag": "9150ee97-5767-40aa-ad6c-5a7df51e7439"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:25.814000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-58bd26e5-d223-420c-9686-5b8e4003d7ba req-5a85cd0b-97d5-4b48-b985-ad29d22bf72b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:25.814864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-58bd26e5-d223-420c-9686-5b8e4003d7ba req-5a85cd0b-97d5-4b48-b985-ad29d22bf72b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:25.815720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-58bd26e5-d223-420c-9686-5b8e4003d7ba req-5a85cd0b-97d5-4b48-b985-ad29d22bf72b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:25.833424 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-58bd26e5-d223-420c-9686-5b8e4003d7ba req-5a85cd0b-97d5-4b48-b985-ad29d22bf72b service nova] Creating event network-changed:9150ee97-5767-40aa-ad6c-5a7df51e7439 for instance cc0e0a60-5b09-404d-8e58-92a80dad0840 on n-h2-856894-1 Sep 10 10:47:25.838511 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-58bd26e5-d223-420c-9686-5b8e4003d7ba req-5a85cd0b-97d5-4b48-b985-ad29d22bf72b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080245 Sep 10 10:47:25.839819 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1948/2454] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:25.857375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56b7d710-7c44-4f23-a8b9-83fe071c53b8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:25.862016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56b7d710-7c44-4f23-a8b9-83fe071c53b8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:25.891397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56b7d710-7c44-4f23-a8b9-83fe071c53b8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:25.893566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56b7d710-7c44-4f23-a8b9-83fe071c53b8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:25.897103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56b7d710-7c44-4f23-a8b9-83fe071c53b8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:25.901234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56b7d710-7c44-4f23-a8b9-83fe071c53b8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:25.901943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56b7d710-7c44-4f23-a8b9-83fe071c53b8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:25.904243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56b7d710-7c44-4f23-a8b9-83fe071c53b8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:26.805552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56b7d710-7c44-4f23-a8b9-83fe071c53b8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:26.835209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56b7d710-7c44-4f23-a8b9-83fe071c53b8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1316 microversion: 2.1 time: 0.991618 Sep 10 10:47:26.845898 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1949/2455] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:25 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1316 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:26.851973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7f37a17c-b74a-457a-99a5-de42e25d649c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:26.853283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7f37a17c-b74a-457a-99a5-de42e25d649c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:26.861408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f37a17c-b74a-457a-99a5-de42e25d649c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:26.861902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f37a17c-b74a-457a-99a5-de42e25d649c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:26.862337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f37a17c-b74a-457a-99a5-de42e25d649c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:26.863052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f37a17c-b74a-457a-99a5-de42e25d649c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:26.863794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f37a17c-b74a-457a-99a5-de42e25d649c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:26.864369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f37a17c-b74a-457a-99a5-de42e25d649c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:27.408161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7f37a17c-b74a-457a-99a5-de42e25d649c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:27.424784 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7f37a17c-b74a-457a-99a5-de42e25d649c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.577493 Sep 10 10:47:27.429294 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1950/2456] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:26 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:27.442226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc03766f-b36d-414a-98ac-ac9809cc18b9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:27.445954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dc03766f-b36d-414a-98ac-ac9809cc18b9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:27.452329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc03766f-b36d-414a-98ac-ac9809cc18b9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:27.453549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc03766f-b36d-414a-98ac-ac9809cc18b9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:27.456011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc03766f-b36d-414a-98ac-ac9809cc18b9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:27.456876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc03766f-b36d-414a-98ac-ac9809cc18b9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:27.457502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc03766f-b36d-414a-98ac-ac9809cc18b9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:27.458308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc03766f-b36d-414a-98ac-ac9809cc18b9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:27.737958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dc03766f-b36d-414a-98ac-ac9809cc18b9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:27.764246 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dc03766f-b36d-414a-98ac-ac9809cc18b9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1535 microversion: 2.1 time: 0.327633 Sep 10 10:47:27.765463 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1951/2457] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:27 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1535 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:27.782948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-153012152", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d3a73823-a3dd-4dbb-bfe0-d1813e3f3ad1"}], "security_groups": [{"name": "tempest-securitygroup--513572778"}], "key_name": "tempest-keypair-1094995", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:28.081913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] validate_networks() for [('d3a73823-a3dd-4dbb-bfe0-d1813e3f3ad1', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:47:29.110879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Getting quotas for project 72599cbbdc464dfda19d7659518c02ff. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:47:29.123485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Getting quotas for user 90e056c746024ae59524e4ddf7d529d7 and project 72599cbbdc464dfda19d7659518c02ff. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:47:29.152946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:47:29.153674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:47:29.154548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:47:29.157645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:47:29.158769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:47:29.174936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:29.175946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:29.179656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:29.182091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:29.183131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:29.185597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:29.213323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:29.233724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Getting quotas for project 72599cbbdc464dfda19d7659518c02ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:47:29.255856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Getting quotas for user 90e056c746024ae59524e4ddf7d529d7 and project 72599cbbdc464dfda19d7659518c02ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:47:29.285110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:47:29.286950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:47:29.362536 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1defab1f-837c-42eb-8a46-73f00b055343 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.594245 Sep 10 10:47:29.370319 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1952/2458] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:47:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:47:29.378294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2cda76f7-62f1-475f-8f91-0055dd329637 req-a25a68ea-a8f6-42cf-a7ae-ae3f4fa0896e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93abea13-0bab-41b4-8db8-9d52f75d4eb7", "name": "network-vif-plugged", "status": "completed", "tag": "db17c464-54e5-49a3-9e72-09d0a71acfea"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:29.393435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2cda76f7-62f1-475f-8f91-0055dd329637 req-a25a68ea-a8f6-42cf-a7ae-ae3f4fa0896e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:29.394649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2cda76f7-62f1-475f-8f91-0055dd329637 req-a25a68ea-a8f6-42cf-a7ae-ae3f4fa0896e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:29.395368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2cda76f7-62f1-475f-8f91-0055dd329637 req-a25a68ea-a8f6-42cf-a7ae-ae3f4fa0896e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:29.411279 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2cda76f7-62f1-475f-8f91-0055dd329637 req-a25a68ea-a8f6-42cf-a7ae-ae3f4fa0896e service nova] Creating event network-vif-plugged:db17c464-54e5-49a3-9e72-09d0a71acfea for instance 93abea13-0bab-41b4-8db8-9d52f75d4eb7 on n-h2-856894-1 Sep 10 10:47:29.418352 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2cda76f7-62f1-475f-8f91-0055dd329637 req-a25a68ea-a8f6-42cf-a7ae-ae3f4fa0896e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048997 Sep 10 10:47:29.419518 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1953/2459] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:29.428102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7c3605dc-29ea-4203-9d1d-c605c74a5069 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:29.429016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7c3605dc-29ea-4203-9d1d-c605c74a5069 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:29.443148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c3605dc-29ea-4203-9d1d-c605c74a5069 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:29.445151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c3605dc-29ea-4203-9d1d-c605c74a5069 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:29.445785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c3605dc-29ea-4203-9d1d-c605c74a5069 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:29.450378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c3605dc-29ea-4203-9d1d-c605c74a5069 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:29.451098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c3605dc-29ea-4203-9d1d-c605c74a5069 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:29.451742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c3605dc-29ea-4203-9d1d-c605c74a5069 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:29.740379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c3605dc-29ea-4203-9d1d-c605c74a5069 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:29.776849 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7c3605dc-29ea-4203-9d1d-c605c74a5069 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1313 microversion: 2.1 time: 0.354909 Sep 10 10:47:29.778674 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1954/2460] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:29 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:29.784097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e06e10c-630c-4638-add0-0d17080bdd17 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:29.784903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9e06e10c-630c-4638-add0-0d17080bdd17 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:29.796049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e06e10c-630c-4638-add0-0d17080bdd17 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:29.796587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e06e10c-630c-4638-add0-0d17080bdd17 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:29.797042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e06e10c-630c-4638-add0-0d17080bdd17 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:29.798394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e06e10c-630c-4638-add0-0d17080bdd17 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:29.798853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e06e10c-630c-4638-add0-0d17080bdd17 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:29.799471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e06e10c-630c-4638-add0-0d17080bdd17 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.099352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9e06e10c-630c-4638-add0-0d17080bdd17 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:30.109412 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9e06e10c-630c-4638-add0-0d17080bdd17 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1316 microversion: 2.1 time: 0.329218 Sep 10 10:47:30.111061 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1955/2461] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:29 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:30.117090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:30.117896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:30.130818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.131448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.133784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.135510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.135995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.136411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.152916 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc HTTP/1.1 Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '20059d23-e6d5-4140-ac67-7ebf9534febc'} Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:30.155550 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:47:30.161628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:30.168749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:30.171926 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa06775f-2739-4529-aaff-8ac25f9be75c tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 404 len: 111 microversion: 2.1 time: 0.059195 Sep 10 10:47:30.177721 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1956/2462] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:30 2022] DELETE /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:30.185661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cfabf108-8482-4a95-9c7b-249e5bce14f0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:30.186750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cfabf108-8482-4a95-9c7b-249e5bce14f0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:30.197547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfabf108-8482-4a95-9c7b-249e5bce14f0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.198142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfabf108-8482-4a95-9c7b-249e5bce14f0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.198758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfabf108-8482-4a95-9c7b-249e5bce14f0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.199478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfabf108-8482-4a95-9c7b-249e5bce14f0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.199940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfabf108-8482-4a95-9c7b-249e5bce14f0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.200367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfabf108-8482-4a95-9c7b-249e5bce14f0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.258584 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:47:30.259180 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 10:47:30.472717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cfabf108-8482-4a95-9c7b-249e5bce14f0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:30.484874 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cfabf108-8482-4a95-9c7b-249e5bce14f0 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.307033 Sep 10 10:47:30.485918 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1957/2463] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:30 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:30.490628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c962cc99-c164-4e2b-86ba-abd879f26dc9 req-2992c742-b5bc-46e2-aefc-d7c46f15c7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3da4a780-1e9e-4a12-822a-37ad1fe25cf4", "tag": "2e1a1d7b-02bc-4ca5-85bc-31e5ad0606a0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:30.507156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c962cc99-c164-4e2b-86ba-abd879f26dc9 req-2992c742-b5bc-46e2-aefc-d7c46f15c7ee service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.507603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c962cc99-c164-4e2b-86ba-abd879f26dc9 req-2992c742-b5bc-46e2-aefc-d7c46f15c7ee service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.508031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c962cc99-c164-4e2b-86ba-abd879f26dc9 req-2992c742-b5bc-46e2-aefc-d7c46f15c7ee service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.522269 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c962cc99-c164-4e2b-86ba-abd879f26dc9 req-2992c742-b5bc-46e2-aefc-d7c46f15c7ee service nova] Creating event network-changed:2e1a1d7b-02bc-4ca5-85bc-31e5ad0606a0 for instance 3da4a780-1e9e-4a12-822a-37ad1fe25cf4 on n-h2-856894-1 Sep 10 10:47:30.529674 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c962cc99-c164-4e2b-86ba-abd879f26dc9 req-2992c742-b5bc-46e2-aefc-d7c46f15c7ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042361 Sep 10 10:47:30.532720 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1958/2464] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:30.540772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8185e9a2-8e14-445a-b844-55c9c75ac77d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:30.541734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8185e9a2-8e14-445a-b844-55c9c75ac77d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:30.549892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185e9a2-8e14-445a-b844-55c9c75ac77d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.551370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185e9a2-8e14-445a-b844-55c9c75ac77d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.551982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185e9a2-8e14-445a-b844-55c9c75ac77d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.553308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185e9a2-8e14-445a-b844-55c9c75ac77d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.554429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185e9a2-8e14-445a-b844-55c9c75ac77d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.555024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185e9a2-8e14-445a-b844-55c9c75ac77d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.751174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8185e9a2-8e14-445a-b844-55c9c75ac77d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:30.760945 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8185e9a2-8e14-445a-b844-55c9c75ac77d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1535 microversion: 2.1 time: 0.225087 Sep 10 10:47:30.761816 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1959/2465] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:30 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1535 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:30.767834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec37bb50-04c7-461b-9363-d0638a520e59 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:30.768567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec37bb50-04c7-461b-9363-d0638a520e59 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:30.775014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec37bb50-04c7-461b-9363-d0638a520e59 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.775765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec37bb50-04c7-461b-9363-d0638a520e59 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.776199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec37bb50-04c7-461b-9363-d0638a520e59 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.776892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec37bb50-04c7-461b-9363-d0638a520e59 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.777392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec37bb50-04c7-461b-9363-d0638a520e59 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.777816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec37bb50-04c7-461b-9363-d0638a520e59 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.846445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec37bb50-04c7-461b-9363-d0638a520e59 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:30.854674 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec37bb50-04c7-461b-9363-d0638a520e59 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1270 microversion: 2.1 time: 0.091230 Sep 10 10:47:30.869106 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1960/2466] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:30 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:30.869106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:30.869106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: 20059d23-e6d5-4140-ac67-7ebf9534febc] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:30.869106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.869106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.869106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.869812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.870414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.871218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.888950 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc HTTP/1.1 Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '20059d23-e6d5-4140-ac67-7ebf9534febc'} Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:30.890738 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:30.894784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:30.894784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:30.894784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:30.894784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:30.894784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:30.894784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. Sep 10 10:47:30.894784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:30.894784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance 20059d23-e6d5-4140-ac67-7ebf9534febc could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:30.894784 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6abc55a1-3084-4bd1-93e3-6f4a442eaa89 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc" status: 404 len: 111 microversion: 2.1 time: 0.035803 Sep 10 10:47:30.894784 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1961/2467] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:30 2022] GET /compute/v2.1/servers/20059d23-e6d5-4140-ac67-7ebf9534febc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:30.897594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-095ea44d-2079-4632-bd02-7b7dd3fe0a60 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:30.898203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-095ea44d-2079-4632-bd02-7b7dd3fe0a60 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:30.905264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-095ea44d-2079-4632-bd02-7b7dd3fe0a60 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.906013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-095ea44d-2079-4632-bd02-7b7dd3fe0a60 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.906447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-095ea44d-2079-4632-bd02-7b7dd3fe0a60 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:30.907682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-095ea44d-2079-4632-bd02-7b7dd3fe0a60 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:30.908150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-095ea44d-2079-4632-bd02-7b7dd3fe0a60 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:30.908553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-095ea44d-2079-4632-bd02-7b7dd3fe0a60 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:31.076369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-095ea44d-2079-4632-bd02-7b7dd3fe0a60 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:31.088722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:31.093193 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-095ea44d-2079-4632-bd02-7b7dd3fe0a60 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1313 microversion: 2.1 time: 0.198948 Sep 10 10:47:31.095058 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1962/2468] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:30 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:31.103261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:31.104562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:31.113015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:31.116757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:31.117933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:31.119569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:31.120114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:31.120617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:31.143829 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe HTTP/1.1 Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f322918c-30a0-409f-9873-1cc3ba8ef4fe'} Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:31.145767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:47:31.150082 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:31.151720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:31.158633 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0cf02aa3-c8a9-49c3-badd-30038f542938 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 404 len: 111 microversion: 2.1 time: 0.056308 Sep 10 10:47:31.159493 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1963/2469] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:31 2022] DELETE /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:31.164978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-acb7af42-07cb-4d24-b304-3d53be91548b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:31.169546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-acb7af42-07cb-4d24-b304-3d53be91548b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:31.192248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acb7af42-07cb-4d24-b304-3d53be91548b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:31.192914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acb7af42-07cb-4d24-b304-3d53be91548b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:31.193491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acb7af42-07cb-4d24-b304-3d53be91548b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:31.194681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acb7af42-07cb-4d24-b304-3d53be91548b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:31.195287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acb7af42-07cb-4d24-b304-3d53be91548b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:31.195805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acb7af42-07cb-4d24-b304-3d53be91548b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:31.515641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-acb7af42-07cb-4d24-b304-3d53be91548b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:31.525339 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-acb7af42-07cb-4d24-b304-3d53be91548b tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1316 microversion: 2.1 time: 0.364470 Sep 10 10:47:31.528290 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1964/2470] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:31 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:31.531994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:31.532606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] [instance: f322918c-30a0-409f-9873-1cc3ba8ef4fe] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:31.539068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:31.539610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:31.540053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:31.540759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:31.541245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:31.541905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:31.557924 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] HTTP exception thrown: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Request method failure captured: Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe HTTP/1.1 Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGnM_R53bive6sQtGM5juMehvDRU3rosdNSPtRZiIiEmlDsmWGUnwpgaybEn0u399Y1WNLRUc_gCH8PqSh1Gl3f8AxxLXxUMBEqYuP1hahTUthHoQZWvW39Ho_gxq9grF-e_JpLigOy0uCQp8COfhP_AdUL46URbMT0xzeI5ZVs5xF4 Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1749f9d599ef467e84f306202e2a6b6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1749f9d599ef467e84f306202e2a6b6e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 1749f9d599ef467e84f306202e2a6b6e Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1825043446 Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: fa978e59fa334084b722d116c761380f Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-1825043446-project Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f322918c-30a0-409f-9873-1cc3ba8ef4fe'} Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:31.559785 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:31.564379 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:31.564379 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:31.564379 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:31.564379 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:31.564379 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:31.564379 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. Sep 10 10:47:31.564379 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:31.564379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] Returning 404 to user: Instance f322918c-30a0-409f-9873-1cc3ba8ef4fe could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:31.564379 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b849a79-e3b0-4a39-b318-4d38ff753d80 tempest-DeleteServersTestJSON-1825043446 tempest-DeleteServersTestJSON-1825043446-project] 10.222.0.20 "GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe" status: 404 len: 111 microversion: 2.1 time: 0.033653 Sep 10 10:47:31.579967 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1965/2471] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:31 2022] GET /compute/v2.1/servers/f322918c-30a0-409f-9873-1cc3ba8ef4fe => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:31.584782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ebbd625a-066e-4b0e-a8cb-b4d565ba2495 req-4605d885-0166-4639-b805-fcfce91100b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee459b93-4eb4-4aef-a49a-932de04dd93c", "name": "network-vif-unplugged", "status": "completed", "tag": "39589cf4-02b9-4961-8e0c-79680b9855a0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:31.595776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ebbd625a-066e-4b0e-a8cb-b4d565ba2495 req-4605d885-0166-4639-b805-fcfce91100b4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:31.596258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ebbd625a-066e-4b0e-a8cb-b4d565ba2495 req-4605d885-0166-4639-b805-fcfce91100b4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:31.596840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ebbd625a-066e-4b0e-a8cb-b4d565ba2495 req-4605d885-0166-4639-b805-fcfce91100b4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:31.658230 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ebbd625a-066e-4b0e-a8cb-b4d565ba2495 req-4605d885-0166-4639-b805-fcfce91100b4 service nova] Creating event network-vif-unplugged:39589cf4-02b9-4961-8e0c-79680b9855a0 for instance ee459b93-4eb4-4aef-a49a-932de04dd93c on n-h2-856894-1 Sep 10 10:47:31.677331 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ebbd625a-066e-4b0e-a8cb-b4d565ba2495 req-4605d885-0166-4639-b805-fcfce91100b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091675 Sep 10 10:47:31.679847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1966/2472] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:31.698367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-706db573-2286-4227-b975-e339275f654c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:31.699332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-706db573-2286-4227-b975-e339275f654c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:31.703809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:31.713451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706db573-2286-4227-b975-e339275f654c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:31.714416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706db573-2286-4227-b975-e339275f654c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:31.716569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706db573-2286-4227-b975-e339275f654c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:31.718117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706db573-2286-4227-b975-e339275f654c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:31.718881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706db573-2286-4227-b975-e339275f654c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:31.720047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706db573-2286-4227-b975-e339275f654c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:32.112569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-706db573-2286-4227-b975-e339275f654c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:32.131173 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-706db573-2286-4227-b975-e339275f654c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1735 microversion: 2.1 time: 0.449620 Sep 10 10:47:32.133668 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1967/2473] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:31 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1735 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:32.163484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f60bb381-98fb-48d2-ab72-7712d32edf88 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:32.172162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f60bb381-98fb-48d2-ab72-7712d32edf88 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:32.194967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f60bb381-98fb-48d2-ab72-7712d32edf88 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:32.195489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f60bb381-98fb-48d2-ab72-7712d32edf88 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:32.196795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f60bb381-98fb-48d2-ab72-7712d32edf88 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:32.199551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f60bb381-98fb-48d2-ab72-7712d32edf88 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:32.200302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f60bb381-98fb-48d2-ab72-7712d32edf88 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:32.203236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f60bb381-98fb-48d2-ab72-7712d32edf88 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:32.694177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f60bb381-98fb-48d2-ab72-7712d32edf88 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:32.708721 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f60bb381-98fb-48d2-ab72-7712d32edf88 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1528 microversion: 2.1 time: 0.571104 Sep 10 10:47:32.711365 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1968/2474] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:32 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1528 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:32.716118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1aab0ba1-44eb-4c80-8ff9-bb7a5f21b7d1 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:32.716725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1aab0ba1-44eb-4c80-8ff9-bb7a5f21b7d1 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:32.735675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aab0ba1-44eb-4c80-8ff9-bb7a5f21b7d1 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:32.735675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aab0ba1-44eb-4c80-8ff9-bb7a5f21b7d1 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:32.735675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aab0ba1-44eb-4c80-8ff9-bb7a5f21b7d1 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:32.735909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aab0ba1-44eb-4c80-8ff9-bb7a5f21b7d1 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:32.736276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aab0ba1-44eb-4c80-8ff9-bb7a5f21b7d1 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:32.741707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aab0ba1-44eb-4c80-8ff9-bb7a5f21b7d1 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:32.888136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1aab0ba1-44eb-4c80-8ff9-bb7a5f21b7d1 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:32.897569 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1aab0ba1-44eb-4c80-8ff9-bb7a5f21b7d1 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1318 microversion: 2.1 time: 0.185040 Sep 10 10:47:32.901278 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1969/2475] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:32 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:32.913089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-81b5e721-adb7-4443-a0d6-7a26a6691572 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:32.913714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-81b5e721-adb7-4443-a0d6-7a26a6691572 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:32.928084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81b5e721-adb7-4443-a0d6-7a26a6691572 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:32.928596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81b5e721-adb7-4443-a0d6-7a26a6691572 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:32.929044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81b5e721-adb7-4443-a0d6-7a26a6691572 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:32.929789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81b5e721-adb7-4443-a0d6-7a26a6691572 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:32.930257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81b5e721-adb7-4443-a0d6-7a26a6691572 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:32.930684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81b5e721-adb7-4443-a0d6-7a26a6691572 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:33.334694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-81b5e721-adb7-4443-a0d6-7a26a6691572 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:33.349383 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-81b5e721-adb7-4443-a0d6-7a26a6691572 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1313 microversion: 2.1 time: 0.446759 Sep 10 10:47:33.353535 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1970/2476] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:32 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:33.372151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9627b38f-3624-4a4f-a0bd-1f9b2d6c3792 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:33.373716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9627b38f-3624-4a4f-a0bd-1f9b2d6c3792 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:33.386294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9627b38f-3624-4a4f-a0bd-1f9b2d6c3792 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:33.387313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9627b38f-3624-4a4f-a0bd-1f9b2d6c3792 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:33.388073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9627b38f-3624-4a4f-a0bd-1f9b2d6c3792 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:33.389832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9627b38f-3624-4a4f-a0bd-1f9b2d6c3792 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:33.390579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9627b38f-3624-4a4f-a0bd-1f9b2d6c3792 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:33.391411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9627b38f-3624-4a4f-a0bd-1f9b2d6c3792 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:33.773720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9627b38f-3624-4a4f-a0bd-1f9b2d6c3792 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:33.800748 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9627b38f-3624-4a4f-a0bd-1f9b2d6c3792 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1506 microversion: 2.1 time: 0.442646 Sep 10 10:47:33.817385 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1971/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:33 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:33.832250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e05bbbb8-2238-41a3-a8a6-b9d5f6af4b5c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:33.835828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e05bbbb8-2238-41a3-a8a6-b9d5f6af4b5c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:33.856570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e05bbbb8-2238-41a3-a8a6-b9d5f6af4b5c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:33.861728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e05bbbb8-2238-41a3-a8a6-b9d5f6af4b5c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:33.863372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e05bbbb8-2238-41a3-a8a6-b9d5f6af4b5c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:33.864250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e05bbbb8-2238-41a3-a8a6-b9d5f6af4b5c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:33.864868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e05bbbb8-2238-41a3-a8a6-b9d5f6af4b5c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:33.867115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e05bbbb8-2238-41a3-a8a6-b9d5f6af4b5c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:34.137418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e05bbbb8-2238-41a3-a8a6-b9d5f6af4b5c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:34.150306 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e05bbbb8-2238-41a3-a8a6-b9d5f6af4b5c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1528 microversion: 2.1 time: 0.342572 Sep 10 10:47:34.170497 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1972/2478] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:33 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1528 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:34.179920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b5245c5-145e-4b2f-b16c-fd1b6a622e64 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:34.180542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b5245c5-145e-4b2f-b16c-fd1b6a622e64 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:34.204908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5245c5-145e-4b2f-b16c-fd1b6a622e64 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:34.208923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5245c5-145e-4b2f-b16c-fd1b6a622e64 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:34.212085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5245c5-145e-4b2f-b16c-fd1b6a622e64 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:34.213145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5245c5-145e-4b2f-b16c-fd1b6a622e64 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:34.214913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5245c5-145e-4b2f-b16c-fd1b6a622e64 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:34.215540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5245c5-145e-4b2f-b16c-fd1b6a622e64 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:34.557583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b5245c5-145e-4b2f-b16c-fd1b6a622e64 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:34.569684 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b5245c5-145e-4b2f-b16c-fd1b6a622e64 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1715 microversion: 2.1 time: 0.395359 Sep 10 10:47:34.570284 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1973/2479] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:34 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1715 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:34.580998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f61ff64-9faa-41ba-bb6b-a2dd1e3a8d26 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:34.582703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f61ff64-9faa-41ba-bb6b-a2dd1e3a8d26 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:34.598128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f61ff64-9faa-41ba-bb6b-a2dd1e3a8d26 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:34.598963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f61ff64-9faa-41ba-bb6b-a2dd1e3a8d26 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:34.600029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f61ff64-9faa-41ba-bb6b-a2dd1e3a8d26 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:34.600874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f61ff64-9faa-41ba-bb6b-a2dd1e3a8d26 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:34.601507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f61ff64-9faa-41ba-bb6b-a2dd1e3a8d26 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:34.601803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f61ff64-9faa-41ba-bb6b-a2dd1e3a8d26 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:34.655073 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f61ff64-9faa-41ba-bb6b-a2dd1e3a8d26 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7/ips" status: 200 len: 110 microversion: 2.1 time: 0.083547 Sep 10 10:47:34.655772 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1974/2480] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:47:34 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7/ips => generated 110 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:34.674689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8bab38f5-7431-4dfc-99aa-dd1c76e1fc9f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:34.675310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8bab38f5-7431-4dfc-99aa-dd1c76e1fc9f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:34.687182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bab38f5-7431-4dfc-99aa-dd1c76e1fc9f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:34.687714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bab38f5-7431-4dfc-99aa-dd1c76e1fc9f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:34.697926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bab38f5-7431-4dfc-99aa-dd1c76e1fc9f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:34.698925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bab38f5-7431-4dfc-99aa-dd1c76e1fc9f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:34.699568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bab38f5-7431-4dfc-99aa-dd1c76e1fc9f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:34.700162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bab38f5-7431-4dfc-99aa-dd1c76e1fc9f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:35.171238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8bab38f5-7431-4dfc-99aa-dd1c76e1fc9f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:35.185065 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8bab38f5-7431-4dfc-99aa-dd1c76e1fc9f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1326 microversion: 2.1 time: 0.518763 Sep 10 10:47:35.186189 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1975/2481] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:34 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1326 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:35.195534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63d219ba-90ad-47a4-a850-a5525c3dbf06 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:35.210889 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-63d219ba-90ad-47a4-a850-a5525c3dbf06 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] HTTP exception thrown: Flavor d3000ce6-d5ed-4e3f-9eae-b1e603273624 could not be found. Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63d219ba-90ad-47a4-a850-a5525c3dbf06 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Request method failure captured: Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/flavors/d3000ce6-d5ed-4e3f-9eae-b1e603273624 HTTP/1.1 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpS73kD-hfT6GkyTY59qtY-HEzqWjICX2pRz71cfYHv153PQsbwrXW0x3xITf_PfO1VfvKhxMaeMf0ebV_Nao2hSbWtBWMhuH4O-vNV2cWe87lEO3bvcNeJID-P4RmcFS9Plmd4uUN6Zv8chj4a-SyEhwDM2Zd0L0ObCRTtRcZ2fd0 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: caebc84429e44c758c11555ad1f06d97 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-MigrationsAdminTest-2084331763 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/caebc84429e44c758c11555ad1f06d97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/caebc84429e44c758c11555ad1f06d97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/caebc84429e44c758c11555ad1f06d97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_caebc84429e44c758c11555ad1f06d97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-MigrationsAdminTest-2084331763 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: caebc84429e44c758c11555ad1f06d97 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-MigrationsAdminTest-2084331763 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-MigrationsAdminTest-2084331763-project-admin Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c342890c5911447d97325fa697d9ee19 Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-MigrationsAdminTest-2084331763-project-admin Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: exception: Flavor d3000ce6-d5ed-4e3f-9eae-b1e603273624 could not be found. Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd3000ce6-d5ed-4e3f-9eae-b1e603273624'} Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d3000ce6-d5ed-4e3f-9eae-b1e603273624 could not be found. Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor d3000ce6-d5ed-4e3f-9eae-b1e603273624 could not be found. Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:35.219264 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d3000ce6-d5ed-4e3f-9eae-b1e603273624 could not be found. Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63d219ba-90ad-47a4-a850-a5525c3dbf06 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Returning 404 to user: Flavor d3000ce6-d5ed-4e3f-9eae-b1e603273624 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63d219ba-90ad-47a4-a850-a5525c3dbf06 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/d3000ce6-d5ed-4e3f-9eae-b1e603273624" status: 404 len: 109 microversion: 2.1 time: 0.033561 Sep 10 10:47:35.223349 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1976/2482] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:35 2022] DELETE /compute/v2.1/flavors/d3000ce6-d5ed-4e3f-9eae-b1e603273624 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:35.256298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb5c9f0a-c681-4d33-9d81-a5f813b2162a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:35.259594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fb5c9f0a-c681-4d33-9d81-a5f813b2162a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:35.280495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c9f0a-c681-4d33-9d81-a5f813b2162a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:35.283564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c9f0a-c681-4d33-9d81-a5f813b2162a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:35.284209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c9f0a-c681-4d33-9d81-a5f813b2162a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:35.286712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c9f0a-c681-4d33-9d81-a5f813b2162a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:35.289048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c9f0a-c681-4d33-9d81-a5f813b2162a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:35.289686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c9f0a-c681-4d33-9d81-a5f813b2162a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:35.909763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb5c9f0a-c681-4d33-9d81-a5f813b2162a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:35.925631 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb5c9f0a-c681-4d33-9d81-a5f813b2162a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1313 microversion: 2.1 time: 0.702672 Sep 10 10:47:35.926954 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1977/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:35 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:35.933212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41533496-916d-4abd-83a5-1599f7c006e8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:35.933991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-41533496-916d-4abd-83a5-1599f7c006e8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:35.943069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41533496-916d-4abd-83a5-1599f7c006e8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:35.943825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41533496-916d-4abd-83a5-1599f7c006e8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:35.945346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41533496-916d-4abd-83a5-1599f7c006e8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:35.946573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41533496-916d-4abd-83a5-1599f7c006e8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:35.947339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41533496-916d-4abd-83a5-1599f7c006e8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:35.948044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41533496-916d-4abd-83a5-1599f7c006e8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:35.992062 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41533496-916d-4abd-83a5-1599f7c006e8 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7/ips" status: 200 len: 110 microversion: 2.1 time: 0.063755 Sep 10 10:47:36.002960 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1978/2484] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 10:47:35 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7/ips => generated 110 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:36.010137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:36.014765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:36.028451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:36.029687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:36.031478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:36.038186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:36.038914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:36.039709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:36.219578 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] HTTP exception thrown: Cannot 'detach_volume' instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece while it is in vm_state rescued Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Request method failure captured: Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments/5066c150-ffdd-492d-9f94-a558840e6cdd HTTP/1.1 Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpHkAYnXeEeIkrvP5MU91LX1pHhCw1-X517wST7uI3nXMyFmEZF2-GrH_hD3-99qTj4dhIEoqm0d7-iBahX9spBGlFJJtEH3HGF62s1M_cLMl7ndO7Kwzn8XkzqLr7wv9Eh_FDYB9NepyfCMVt7SSvdhwxotJF7SX8u4upXel5-s6g Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52c98558e19447dfa54397d92f45dbb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0682225a07764437b25009c061ac844d Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'detach_volume' instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece while it is in vm_state rescued Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': 'a47a8a03-72e3-4db7-8e43-a1992a5f6ece', 'id': '5066c150-ffdd-492d-9f94-a558840e6cdd'} Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece while it is in vm_state rescued Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:36.221203 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:36.225038 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:36.225038 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:36.225038 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:36.225038 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:36.225038 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece while it is in vm_state rescued Sep 10 10:47:36.225038 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:36.225820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Returning 409 to user: Cannot 'detach_volume' instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece while it is in vm_state rescued {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:36.226977 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-37c9ed21-02ee-4ffc-b413-051e9d1e526d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments/5066c150-ffdd-492d-9f94-a558840e6cdd" status: 409 len: 152 microversion: 2.1 time: 0.222922 Sep 10 10:47:36.227553 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1979/2485] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 10:47:36 2022] DELETE /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments/5066c150-ffdd-492d-9f94-a558840e6cdd => generated 152 bytes in 224 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:47:36.241979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1283118787", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:36.326834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:47:37.124896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:47:37.126152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:47:37.126599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:47:37.127007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:47:37.127421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:47:37.147526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:37.148680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:37.152110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:37.153028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:37.153672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:37.154276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:37.217015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for project 7c408248417b4deaaa26ef380da4bb90. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:47:37.235251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Getting quotas for user f5b257d1488141689c826efe484e4040 and project 7c408248417b4deaaa26ef380da4bb90. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:47:37.266398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:47:37.273313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:47:37.356511 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b2ef431b-1783-417a-bb72-aab66ff3c597 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.126868 Sep 10 10:47:37.359263 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1980/2486] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:47:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:47:37.384733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9d115e15-89ef-476f-b873-68e26a594b0b req-cafe48eb-b547-455f-94b1-851bdadabf01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0e0a60-5b09-404d-8e58-92a80dad0840", "name": "network-vif-plugged", "status": "completed", "tag": "9150ee97-5767-40aa-ad6c-5a7df51e7439"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:37.416447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d115e15-89ef-476f-b873-68e26a594b0b req-cafe48eb-b547-455f-94b1-851bdadabf01 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:37.417200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d115e15-89ef-476f-b873-68e26a594b0b req-cafe48eb-b547-455f-94b1-851bdadabf01 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:37.417853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d115e15-89ef-476f-b873-68e26a594b0b req-cafe48eb-b547-455f-94b1-851bdadabf01 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:37.446392 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9d115e15-89ef-476f-b873-68e26a594b0b req-cafe48eb-b547-455f-94b1-851bdadabf01 service nova] Creating event network-vif-plugged:9150ee97-5767-40aa-ad6c-5a7df51e7439 for instance cc0e0a60-5b09-404d-8e58-92a80dad0840 on n-h2-856894-1 Sep 10 10:47:37.470187 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9d115e15-89ef-476f-b873-68e26a594b0b req-cafe48eb-b547-455f-94b1-851bdadabf01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097006 Sep 10 10:47:37.471459 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1981/2487] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:37.495136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a9ee0de-2295-487c-b45f-cbbd57d8c2ce tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:37.496537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a9ee0de-2295-487c-b45f-cbbd57d8c2ce tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:37.513525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9ee0de-2295-487c-b45f-cbbd57d8c2ce tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:37.514120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9ee0de-2295-487c-b45f-cbbd57d8c2ce tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:37.514555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9ee0de-2295-487c-b45f-cbbd57d8c2ce tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:37.515136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9ee0de-2295-487c-b45f-cbbd57d8c2ce tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:37.515589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9ee0de-2295-487c-b45f-cbbd57d8c2ce tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:37.516542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9ee0de-2295-487c-b45f-cbbd57d8c2ce tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:37.585034 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a9ee0de-2295-487c-b45f-cbbd57d8c2ce tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7/ips/tempest-ServerAddressesTestJSON-2005397893-network" status: 200 len: 95 microversion: 2.1 time: 0.108440 Sep 10 10:47:37.585958 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1982/2488] 10.222.0.20 () {58 vars in 1401 bytes} [Sat Sep 10 10:47:37 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7/ips/tempest-ServerAddressesTestJSON-2005397893-network => generated 95 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:47:37.591037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cc03028-3fab-4531-81f0-68b44f3e9017 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:37.591838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6cc03028-3fab-4531-81f0-68b44f3e9017 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:37.599976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cc03028-3fab-4531-81f0-68b44f3e9017 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:37.600703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cc03028-3fab-4531-81f0-68b44f3e9017 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:37.602094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cc03028-3fab-4531-81f0-68b44f3e9017 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:37.604422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cc03028-3fab-4531-81f0-68b44f3e9017 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:37.605662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cc03028-3fab-4531-81f0-68b44f3e9017 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:37.607109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cc03028-3fab-4531-81f0-68b44f3e9017 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:38.114101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6cc03028-3fab-4531-81f0-68b44f3e9017 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:38.126828 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cc03028-3fab-4531-81f0-68b44f3e9017 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1391 microversion: 2.1 time: 0.537443 Sep 10 10:47:38.128925 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1983/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:37 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1391 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:38.135853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-efe10a11-9a57-40e7-aa56-fb2730687e2c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:38.136655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-efe10a11-9a57-40e7-aa56-fb2730687e2c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:38.162208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efe10a11-9a57-40e7-aa56-fb2730687e2c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:38.162725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efe10a11-9a57-40e7-aa56-fb2730687e2c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:38.163362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efe10a11-9a57-40e7-aa56-fb2730687e2c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:38.164280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efe10a11-9a57-40e7-aa56-fb2730687e2c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:38.164959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efe10a11-9a57-40e7-aa56-fb2730687e2c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:38.165577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efe10a11-9a57-40e7-aa56-fb2730687e2c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:38.246047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:38.408816 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-efe10a11-9a57-40e7-aa56-fb2730687e2c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/action" status: 202 len: 0 microversion: 2.1 time: 0.274715 Sep 10 10:47:38.415032 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1984/2490] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:47:38 2022] POST /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:47:38.435268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90c01aa4-b548-49b9-9dd0-2d361c86c341 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:38.449255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-90c01aa4-b548-49b9-9dd0-2d361c86c341 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:38.472038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90c01aa4-b548-49b9-9dd0-2d361c86c341 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:38.472566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90c01aa4-b548-49b9-9dd0-2d361c86c341 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:38.473021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90c01aa4-b548-49b9-9dd0-2d361c86c341 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:38.486497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90c01aa4-b548-49b9-9dd0-2d361c86c341 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:38.491783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90c01aa4-b548-49b9-9dd0-2d361c86c341 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:38.494311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90c01aa4-b548-49b9-9dd0-2d361c86c341 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:38.840387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-90c01aa4-b548-49b9-9dd0-2d361c86c341 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:38.851782 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90c01aa4-b548-49b9-9dd0-2d361c86c341 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1313 microversion: 2.1 time: 0.434874 Sep 10 10:47:38.861107 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1985/2491] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:38 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:38.864978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-516c3437-18d8-424f-bc8f-c19e0355a9f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:38.865903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-516c3437-18d8-424f-bc8f-c19e0355a9f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:38.881159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516c3437-18d8-424f-bc8f-c19e0355a9f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:38.882163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516c3437-18d8-424f-bc8f-c19e0355a9f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:38.884713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516c3437-18d8-424f-bc8f-c19e0355a9f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:38.886144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516c3437-18d8-424f-bc8f-c19e0355a9f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:38.889707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516c3437-18d8-424f-bc8f-c19e0355a9f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:38.890154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516c3437-18d8-424f-bc8f-c19e0355a9f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:39.071987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-516c3437-18d8-424f-bc8f-c19e0355a9f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:39.082274 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-516c3437-18d8-424f-bc8f-c19e0355a9f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1209 microversion: 2.1 time: 0.227741 Sep 10 10:47:39.085757 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1986/2492] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:38 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1209 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:39.092891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e153cb55-e34f-404b-ac0e-27f51d127f44 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:39.101716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e153cb55-e34f-404b-ac0e-27f51d127f44 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:39.114312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e153cb55-e34f-404b-ac0e-27f51d127f44 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:39.114807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e153cb55-e34f-404b-ac0e-27f51d127f44 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:39.115243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e153cb55-e34f-404b-ac0e-27f51d127f44 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:39.115966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e153cb55-e34f-404b-ac0e-27f51d127f44 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:39.116420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e153cb55-e34f-404b-ac0e-27f51d127f44 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:39.117031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e153cb55-e34f-404b-ac0e-27f51d127f44 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:39.156952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e153cb55-e34f-404b-ac0e-27f51d127f44 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:47:39.273548 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e153cb55-e34f-404b-ac0e-27f51d127f44 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "DELETE /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 204 len: 0 microversion: 2.1 time: 0.186040 Sep 10 10:47:39.276068 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1987/2493] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:47:39 2022] DELETE /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:47:39.290524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7abab60b-3da2-48b2-9d6c-0a2f6f317e6a req-cd2ae23c-4bbb-46eb-80a0-fddabf98010d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "715a034b-25ef-4c28-bff9-7843175d473f", "tag": "1a59a894-6b66-4f8a-82af-b9f60f5f1e38"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:39.303409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7abab60b-3da2-48b2-9d6c-0a2f6f317e6a req-cd2ae23c-4bbb-46eb-80a0-fddabf98010d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:39.304181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7abab60b-3da2-48b2-9d6c-0a2f6f317e6a req-cd2ae23c-4bbb-46eb-80a0-fddabf98010d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:39.304724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7abab60b-3da2-48b2-9d6c-0a2f6f317e6a req-cd2ae23c-4bbb-46eb-80a0-fddabf98010d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:39.321043 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7abab60b-3da2-48b2-9d6c-0a2f6f317e6a req-cd2ae23c-4bbb-46eb-80a0-fddabf98010d service nova] Creating event network-changed:1a59a894-6b66-4f8a-82af-b9f60f5f1e38 for instance 715a034b-25ef-4c28-bff9-7843175d473f on n-h2-856894-1 Sep 10 10:47:39.326793 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7abab60b-3da2-48b2-9d6c-0a2f6f317e6a req-cd2ae23c-4bbb-46eb-80a0-fddabf98010d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048752 Sep 10 10:47:39.327409 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1988/2494] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:39.346644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-158a84dc-4a02-43a9-b192-3e663377bdb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:39.348028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-158a84dc-4a02-43a9-b192-3e663377bdb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:39.357664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-158a84dc-4a02-43a9-b192-3e663377bdb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:39.358445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-158a84dc-4a02-43a9-b192-3e663377bdb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:39.359152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-158a84dc-4a02-43a9-b192-3e663377bdb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:39.360149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-158a84dc-4a02-43a9-b192-3e663377bdb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:39.360830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-158a84dc-4a02-43a9-b192-3e663377bdb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:39.361512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-158a84dc-4a02-43a9-b192-3e663377bdb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:40.067801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-158a84dc-4a02-43a9-b192-3e663377bdb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:40.080202 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-158a84dc-4a02-43a9-b192-3e663377bdb4 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1723 microversion: 2.1 time: 0.750737 Sep 10 10:47:40.080809 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1989/2495] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:39 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1723 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:40.095373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2fd9491f-3ddd-40e9-8782-1250e3c72fbc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:40.096632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2fd9491f-3ddd-40e9-8782-1250e3c72fbc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:40.123407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fd9491f-3ddd-40e9-8782-1250e3c72fbc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:40.124579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fd9491f-3ddd-40e9-8782-1250e3c72fbc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:40.128316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fd9491f-3ddd-40e9-8782-1250e3c72fbc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:40.129273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fd9491f-3ddd-40e9-8782-1250e3c72fbc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:40.129905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fd9491f-3ddd-40e9-8782-1250e3c72fbc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:40.130551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2fd9491f-3ddd-40e9-8782-1250e3c72fbc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:40.403965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2fd9491f-3ddd-40e9-8782-1250e3c72fbc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:40.425910 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2fd9491f-3ddd-40e9-8782-1250e3c72fbc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1391 microversion: 2.1 time: 0.339252 Sep 10 10:47:40.427399 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1990/2496] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:40 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1391 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:40.439228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60718288-d4fe-4285-831b-992c3065f42a tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:40.440254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60718288-d4fe-4285-831b-992c3065f42a tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:40.462154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60718288-d4fe-4285-831b-992c3065f42a tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:40.463721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60718288-d4fe-4285-831b-992c3065f42a tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:40.464678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60718288-d4fe-4285-831b-992c3065f42a tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:40.466295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60718288-d4fe-4285-831b-992c3065f42a tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:40.470764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60718288-d4fe-4285-831b-992c3065f42a tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:40.471979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60718288-d4fe-4285-831b-992c3065f42a tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:41.150203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60718288-d4fe-4285-831b-992c3065f42a tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:41.165545 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60718288-d4fe-4285-831b-992c3065f42a tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1512 microversion: 2.1 time: 0.736321 Sep 10 10:47:41.167817 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1991/2497] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:40 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1512 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:41.175094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1b8b1110-6e98-4738-ba26-be319da05d1a req-c64eb6e8-261c-4eac-997e-00e8f3308b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee459b93-4eb4-4aef-a49a-932de04dd93c", "name": "network-vif-plugged", "status": "completed", "tag": "39589cf4-02b9-4961-8e0c-79680b9855a0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:41.191967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b8b1110-6e98-4738-ba26-be319da05d1a req-c64eb6e8-261c-4eac-997e-00e8f3308b8b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:41.195554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b8b1110-6e98-4738-ba26-be319da05d1a req-c64eb6e8-261c-4eac-997e-00e8f3308b8b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:41.196435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b8b1110-6e98-4738-ba26-be319da05d1a req-c64eb6e8-261c-4eac-997e-00e8f3308b8b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:41.213629 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1b8b1110-6e98-4738-ba26-be319da05d1a req-c64eb6e8-261c-4eac-997e-00e8f3308b8b service nova] Creating event network-vif-plugged:39589cf4-02b9-4961-8e0c-79680b9855a0 for instance ee459b93-4eb4-4aef-a49a-932de04dd93c on n-h2-856894-1 Sep 10 10:47:41.225407 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1b8b1110-6e98-4738-ba26-be319da05d1a req-c64eb6e8-261c-4eac-997e-00e8f3308b8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055670 Sep 10 10:47:41.227540 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1992/2498] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:41.244445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2981d30a-6b93-42a4-95a6-348929c6f62b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:41.269629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2981d30a-6b93-42a4-95a6-348929c6f62b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:41.311517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2981d30a-6b93-42a4-95a6-348929c6f62b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:41.313958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2981d30a-6b93-42a4-95a6-348929c6f62b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:41.314443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2981d30a-6b93-42a4-95a6-348929c6f62b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:41.322953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2981d30a-6b93-42a4-95a6-348929c6f62b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:41.324146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2981d30a-6b93-42a4-95a6-348929c6f62b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:41.325951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2981d30a-6b93-42a4-95a6-348929c6f62b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:41.830142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2981d30a-6b93-42a4-95a6-348929c6f62b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:41.839383 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2981d30a-6b93-42a4-95a6-348929c6f62b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1313 microversion: 2.1 time: 0.610329 Sep 10 10:47:41.840208 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1993/2499] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:41 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:41.872438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7e015ab2-e70b-45ed-84db-4df420efd992 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:41.873594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e015ab2-e70b-45ed-84db-4df420efd992 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:41.886758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e015ab2-e70b-45ed-84db-4df420efd992 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:41.887264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e015ab2-e70b-45ed-84db-4df420efd992 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:41.887742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e015ab2-e70b-45ed-84db-4df420efd992 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:41.888443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e015ab2-e70b-45ed-84db-4df420efd992 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:41.888836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e015ab2-e70b-45ed-84db-4df420efd992 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:41.889294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e015ab2-e70b-45ed-84db-4df420efd992 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:42.052453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e015ab2-e70b-45ed-84db-4df420efd992 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:42.065581 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7e015ab2-e70b-45ed-84db-4df420efd992 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1273 microversion: 2.1 time: 0.200777 Sep 10 10:47:42.066691 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1994/2500] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:41 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:42.072890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f4c436c-a5c7-4760-b1e4-f599a0169e8f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:42.073773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f4c436c-a5c7-4760-b1e4-f599a0169e8f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:42.082568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f4c436c-a5c7-4760-b1e4-f599a0169e8f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:42.083396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f4c436c-a5c7-4760-b1e4-f599a0169e8f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:42.083844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f4c436c-a5c7-4760-b1e4-f599a0169e8f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:42.084588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f4c436c-a5c7-4760-b1e4-f599a0169e8f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:42.085092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f4c436c-a5c7-4760-b1e4-f599a0169e8f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:42.086246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f4c436c-a5c7-4760-b1e4-f599a0169e8f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:42.457550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f4c436c-a5c7-4760-b1e4-f599a0169e8f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:42.471075 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f4c436c-a5c7-4760-b1e4-f599a0169e8f tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1723 microversion: 2.1 time: 0.399789 Sep 10 10:47:42.472119 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1995/2501] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:42 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:42.477346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e319390-a656-4bf2-a30e-02b363c4a929 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:42.478283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e319390-a656-4bf2-a30e-02b363c4a929 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:42.489540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e319390-a656-4bf2-a30e-02b363c4a929 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:42.492465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e319390-a656-4bf2-a30e-02b363c4a929 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:42.493154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e319390-a656-4bf2-a30e-02b363c4a929 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:42.494482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e319390-a656-4bf2-a30e-02b363c4a929 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:42.495482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e319390-a656-4bf2-a30e-02b363c4a929 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:42.496212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e319390-a656-4bf2-a30e-02b363c4a929 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:42.737004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e319390-a656-4bf2-a30e-02b363c4a929 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:42.746143 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e319390-a656-4bf2-a30e-02b363c4a929 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1391 microversion: 2.1 time: 0.272737 Sep 10 10:47:42.747406 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1996/2502] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:42 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1391 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:42.754405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7d0a6ac6-2966-4a85-ba34-efcc26474cdc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:42.755254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7d0a6ac6-2966-4a85-ba34-efcc26474cdc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:42.762258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d0a6ac6-2966-4a85-ba34-efcc26474cdc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:42.763028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d0a6ac6-2966-4a85-ba34-efcc26474cdc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:42.763464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d0a6ac6-2966-4a85-ba34-efcc26474cdc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:42.764183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d0a6ac6-2966-4a85-ba34-efcc26474cdc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:42.764633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d0a6ac6-2966-4a85-ba34-efcc26474cdc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:42.765054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d0a6ac6-2966-4a85-ba34-efcc26474cdc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:42.850626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7d0a6ac6-2966-4a85-ba34-efcc26474cdc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:42.859248 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7d0a6ac6-2966-4a85-ba34-efcc26474cdc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1470 microversion: 2.1 time: 0.109638 Sep 10 10:47:42.860400 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1997/2503] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:42 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1470 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:42.866262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7c4e6c6b-9311-46c1-92e7-2e2299be9b10 req-905e17a7-bea2-46e1-95ca-0fc3eb2b36cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93abea13-0bab-41b4-8db8-9d52f75d4eb7", "name": "network-vif-deleted", "tag": "db17c464-54e5-49a3-9e72-09d0a71acfea"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:42.876288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7c4e6c6b-9311-46c1-92e7-2e2299be9b10 req-905e17a7-bea2-46e1-95ca-0fc3eb2b36cf service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:42.876851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7c4e6c6b-9311-46c1-92e7-2e2299be9b10 req-905e17a7-bea2-46e1-95ca-0fc3eb2b36cf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:42.877534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7c4e6c6b-9311-46c1-92e7-2e2299be9b10 req-905e17a7-bea2-46e1-95ca-0fc3eb2b36cf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:42.889301 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7c4e6c6b-9311-46c1-92e7-2e2299be9b10 req-905e17a7-bea2-46e1-95ca-0fc3eb2b36cf service nova] Creating event network-vif-deleted:db17c464-54e5-49a3-9e72-09d0a71acfea for instance 93abea13-0bab-41b4-8db8-9d52f75d4eb7 on n-h2-856894-1 Sep 10 10:47:42.895517 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7c4e6c6b-9311-46c1-92e7-2e2299be9b10 req-905e17a7-bea2-46e1-95ca-0fc3eb2b36cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033214 Sep 10 10:47:42.896190 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1998/2504] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:42.902641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec7b8989-4853-40fc-b5ab-f13c35e440e4 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:42.903599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec7b8989-4853-40fc-b5ab-f13c35e440e4 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:42.910829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec7b8989-4853-40fc-b5ab-f13c35e440e4 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:42.911614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec7b8989-4853-40fc-b5ab-f13c35e440e4 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:42.912251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec7b8989-4853-40fc-b5ab-f13c35e440e4 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:42.913412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec7b8989-4853-40fc-b5ab-f13c35e440e4 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:42.913947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec7b8989-4853-40fc-b5ab-f13c35e440e4 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:42.915327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec7b8989-4853-40fc-b5ab-f13c35e440e4 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:43.121095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec7b8989-4853-40fc-b5ab-f13c35e440e4 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:43.129573 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec7b8989-4853-40fc-b5ab-f13c35e440e4 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1313 microversion: 2.1 time: 0.231929 Sep 10 10:47:43.132834 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 1999/2505] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:42 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:43.137991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0552a39a-73b4-491f-b5f5-7b2dea72552e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:43.138616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0552a39a-73b4-491f-b5f5-7b2dea72552e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:43.162576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0552a39a-73b4-491f-b5f5-7b2dea72552e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:43.163093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0552a39a-73b4-491f-b5f5-7b2dea72552e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:43.163538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0552a39a-73b4-491f-b5f5-7b2dea72552e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:43.165462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0552a39a-73b4-491f-b5f5-7b2dea72552e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:43.166102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0552a39a-73b4-491f-b5f5-7b2dea72552e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:43.166548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0552a39a-73b4-491f-b5f5-7b2dea72552e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:43.288479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0552a39a-73b4-491f-b5f5-7b2dea72552e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:43.300046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:43.305153 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0552a39a-73b4-491f-b5f5-7b2dea72552e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1273 microversion: 2.1 time: 0.171096 Sep 10 10:47:43.321517 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2000/2506] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:43 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:43.331072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-67e76454-173f-48e9-95ce-f3868ecaeb7f req-7277a8f0-9797-4c74-89ba-0044a1f7d79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3da4a780-1e9e-4a12-822a-37ad1fe25cf4", "name": "network-vif-plugged", "status": "completed", "tag": "2e1a1d7b-02bc-4ca5-85bc-31e5ad0606a0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:43.345314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-67e76454-173f-48e9-95ce-f3868ecaeb7f req-7277a8f0-9797-4c74-89ba-0044a1f7d79f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:43.346102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-67e76454-173f-48e9-95ce-f3868ecaeb7f req-7277a8f0-9797-4c74-89ba-0044a1f7d79f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:43.347051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-67e76454-173f-48e9-95ce-f3868ecaeb7f req-7277a8f0-9797-4c74-89ba-0044a1f7d79f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:43.369938 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-67e76454-173f-48e9-95ce-f3868ecaeb7f req-7277a8f0-9797-4c74-89ba-0044a1f7d79f service nova] Creating event network-vif-plugged:2e1a1d7b-02bc-4ca5-85bc-31e5ad0606a0 for instance 3da4a780-1e9e-4a12-822a-37ad1fe25cf4 on n-h2-856894-1 Sep 10 10:47:43.383695 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-67e76454-173f-48e9-95ce-f3868ecaeb7f req-7277a8f0-9797-4c74-89ba-0044a1f7d79f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060524 Sep 10 10:47:43.384723 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2001/2507] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:43.496519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-45b8a13f-c1c3-4013-aac4-43e534c7137d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:43.497247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-45b8a13f-c1c3-4013-aac4-43e534c7137d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:43.504373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45b8a13f-c1c3-4013-aac4-43e534c7137d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:43.505243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45b8a13f-c1c3-4013-aac4-43e534c7137d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:43.505931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45b8a13f-c1c3-4013-aac4-43e534c7137d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:43.506826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45b8a13f-c1c3-4013-aac4-43e534c7137d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:43.507470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45b8a13f-c1c3-4013-aac4-43e534c7137d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:43.508089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45b8a13f-c1c3-4013-aac4-43e534c7137d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:43.726568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-45b8a13f-c1c3-4013-aac4-43e534c7137d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:43.744317 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-45b8a13f-c1c3-4013-aac4-43e534c7137d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1723 microversion: 2.1 time: 0.251212 Sep 10 10:47:43.745628 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2002/2508] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:43 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:43.771217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-081e6f06-cec9-46f3-af59-4cc0c1a48da6 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:43.771844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-081e6f06-cec9-46f3-af59-4cc0c1a48da6 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:43.779926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-081e6f06-cec9-46f3-af59-4cc0c1a48da6 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:43.780140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-081e6f06-cec9-46f3-af59-4cc0c1a48da6 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:43.781634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-081e6f06-cec9-46f3-af59-4cc0c1a48da6 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:43.782690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-081e6f06-cec9-46f3-af59-4cc0c1a48da6 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:43.784137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-081e6f06-cec9-46f3-af59-4cc0c1a48da6 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:43.784910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-081e6f06-cec9-46f3-af59-4cc0c1a48da6 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:44.529826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-081e6f06-cec9-46f3-af59-4cc0c1a48da6 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:44.543231 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-081e6f06-cec9-46f3-af59-4cc0c1a48da6 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1391 microversion: 2.1 time: 0.776206 Sep 10 10:47:44.544777 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2003/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:43 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1391 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:47:44.572721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:44.573691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:44.587851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:44.588375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:44.588830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:44.589584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:44.592303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:44.593345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:44.674890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:44.674890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:44.674890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:44.674890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lazy-loading 'fault' on Instance uuid 93abea13-0bab-41b4-8db8-9d52f75d4eb7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:47:44.824119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3801735334044dfe946e35d0c8af6aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f8c3fd9c84842eaba6f58e6f974c37e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:44.855776 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ccd2040d-2405-4d50-a9c1-a648fe6c50f7 tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 200 len: 1306 microversion: 2.1 time: 0.307027 Sep 10 10:47:44.857188 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2004/2510] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:44 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 1306 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:44.881036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2887ebde-8c09-4152-bf73-6b3dddb11851 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:44.881547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2887ebde-8c09-4152-bf73-6b3dddb11851 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:44.888579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2887ebde-8c09-4152-bf73-6b3dddb11851 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:44.889499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2887ebde-8c09-4152-bf73-6b3dddb11851 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:44.890151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2887ebde-8c09-4152-bf73-6b3dddb11851 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:44.891097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2887ebde-8c09-4152-bf73-6b3dddb11851 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:44.891903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2887ebde-8c09-4152-bf73-6b3dddb11851 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:44.892542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2887ebde-8c09-4152-bf73-6b3dddb11851 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:45.197488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2887ebde-8c09-4152-bf73-6b3dddb11851 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:45.214103 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2887ebde-8c09-4152-bf73-6b3dddb11851 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1313 microversion: 2.1 time: 0.353616 Sep 10 10:47:45.214710 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2005/2511] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:44 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:45.223690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7e20e6a2-7ec7-4032-8dc8-7dbed2e77b61 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:45.224495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e20e6a2-7ec7-4032-8dc8-7dbed2e77b61 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:45.229566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:45.231800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e20e6a2-7ec7-4032-8dc8-7dbed2e77b61 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:45.232531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e20e6a2-7ec7-4032-8dc8-7dbed2e77b61 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:45.232965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e20e6a2-7ec7-4032-8dc8-7dbed2e77b61 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:45.233841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e20e6a2-7ec7-4032-8dc8-7dbed2e77b61 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:45.235202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e20e6a2-7ec7-4032-8dc8-7dbed2e77b61 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:45.235793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e20e6a2-7ec7-4032-8dc8-7dbed2e77b61 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:45.330991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e20e6a2-7ec7-4032-8dc8-7dbed2e77b61 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:45.356575 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7e20e6a2-7ec7-4032-8dc8-7dbed2e77b61 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1271 microversion: 2.1 time: 0.140508 Sep 10 10:47:45.374207 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2006/2512] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:45 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:45.392641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-08a7fccd-c358-477b-a4d3-b982548e4d4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:45.395409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-08a7fccd-c358-477b-a4d3-b982548e4d4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:45.410007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a7fccd-c358-477b-a4d3-b982548e4d4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:45.410511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a7fccd-c358-477b-a4d3-b982548e4d4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:45.411215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a7fccd-c358-477b-a4d3-b982548e4d4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:45.412154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a7fccd-c358-477b-a4d3-b982548e4d4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:45.412834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a7fccd-c358-477b-a4d3-b982548e4d4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:45.413534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a7fccd-c358-477b-a4d3-b982548e4d4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:45.720644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-08a7fccd-c358-477b-a4d3-b982548e4d4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:45.738174 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-08a7fccd-c358-477b-a4d3-b982548e4d4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1729 microversion: 2.1 time: 0.361411 Sep 10 10:47:45.739279 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2007/2513] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:45 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1729 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:45.747607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b21ffc2-eee1-44ae-97e3-7fe94f3137af tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:45.748873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b21ffc2-eee1-44ae-97e3-7fe94f3137af tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:45.762252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b21ffc2-eee1-44ae-97e3-7fe94f3137af tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:45.763054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b21ffc2-eee1-44ae-97e3-7fe94f3137af tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:45.763605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b21ffc2-eee1-44ae-97e3-7fe94f3137af tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:45.766711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b21ffc2-eee1-44ae-97e3-7fe94f3137af tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:45.769461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b21ffc2-eee1-44ae-97e3-7fe94f3137af tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:45.770159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b21ffc2-eee1-44ae-97e3-7fe94f3137af tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:46.332183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b21ffc2-eee1-44ae-97e3-7fe94f3137af tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:46.374585 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b21ffc2-eee1-44ae-97e3-7fe94f3137af tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1391 microversion: 2.1 time: 0.634069 Sep 10 10:47:46.377619 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2008/2514] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:45 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1391 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:46.405035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57993db9-65ee-4535-aded-f56063485433 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:46.406723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57993db9-65ee-4535-aded-f56063485433 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:46.419858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57993db9-65ee-4535-aded-f56063485433 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:46.423506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57993db9-65ee-4535-aded-f56063485433 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:46.424589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57993db9-65ee-4535-aded-f56063485433 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:46.427314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57993db9-65ee-4535-aded-f56063485433 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:46.428896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57993db9-65ee-4535-aded-f56063485433 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:46.429967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57993db9-65ee-4535-aded-f56063485433 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:46.628576 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57993db9-65ee-4535-aded-f56063485433 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.249155 Sep 10 10:47:46.636705 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2009/2515] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:47:46 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-interface => generated 285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:46.636705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:46.636705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] [instance: 93abea13-0bab-41b4-8db8-9d52f75d4eb7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:46.646786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:46.647298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:46.648013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:46.648461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:46.648925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:46.649412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:46.674501 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] HTTP exception thrown: Instance 93abea13-0bab-41b4-8db8-9d52f75d4eb7 could not be found. Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Request method failure captured: Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 HTTP/1.1 Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGsqa95zgWJED3N5CGGdribVitqIg_R2p9fjjwlDdW9-zmXa-soUme-uGnNUnYahDxYNtiOlAPKyZhmamSE1p38JR8qjQeoT8iTieufjOMqpW4pU0CVciAiAhcXxbrwJ7L8npthvNWacipecTB2B_xOPbtxvB2SUbfLSOWE6dODJQkg Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8f8c3fd9c84842eaba6f58e6f974c37e Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerAddressesTestJSON-30063686 Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f8c3fd9c84842eaba6f58e6f974c37e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f8c3fd9c84842eaba6f58e6f974c37e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f8c3fd9c84842eaba6f58e6f974c37e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f8c3fd9c84842eaba6f58e6f974c37e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerAddressesTestJSON-30063686 Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8f8c3fd9c84842eaba6f58e6f974c37e Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerAddressesTestJSON-30063686 Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerAddressesTestJSON-30063686-project Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3801735334044dfe946e35d0c8af6aa4 Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerAddressesTestJSON-30063686-project Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 93abea13-0bab-41b4-8db8-9d52f75d4eb7 could not be found. Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '93abea13-0bab-41b4-8db8-9d52f75d4eb7'} Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93abea13-0bab-41b4-8db8-9d52f75d4eb7 could not be found. Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93abea13-0bab-41b4-8db8-9d52f75d4eb7 could not be found. Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:47:46.676270 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:46.680856 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:47:46.680856 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:47:46.680856 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:47:46.680856 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:47:46.680856 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:47:46.680856 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93abea13-0bab-41b4-8db8-9d52f75d4eb7 could not be found. Sep 10 10:47:46.680856 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:47:46.680856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] Returning 404 to user: Instance 93abea13-0bab-41b4-8db8-9d52f75d4eb7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:47:46.680856 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f2b6444-0888-4908-9600-b8ed10d254bc tempest-ServerAddressesTestJSON-30063686 tempest-ServerAddressesTestJSON-30063686-project] 10.222.0.20 "GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7" status: 404 len: 111 microversion: 2.1 time: 0.047181 Sep 10 10:47:46.680856 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2010/2516] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:46 2022] GET /compute/v2.1/servers/93abea13-0bab-41b4-8db8-9d52f75d4eb7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:47:46.683891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-794f39fc-7f42-4b3e-842a-4e45c45b4fa2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:46.683891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-794f39fc-7f42-4b3e-842a-4e45c45b4fa2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:46.696148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-794f39fc-7f42-4b3e-842a-4e45c45b4fa2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:46.696652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-794f39fc-7f42-4b3e-842a-4e45c45b4fa2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:46.697121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-794f39fc-7f42-4b3e-842a-4e45c45b4fa2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:46.697841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-794f39fc-7f42-4b3e-842a-4e45c45b4fa2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:46.698306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-794f39fc-7f42-4b3e-842a-4e45c45b4fa2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:46.698742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-794f39fc-7f42-4b3e-842a-4e45c45b4fa2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:47.191461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:47.253420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=38 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:47.640826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-794f39fc-7f42-4b3e-842a-4e45c45b4fa2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:47.658087 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-794f39fc-7f42-4b3e-842a-4e45c45b4fa2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1462 microversion: 2.1 time: 0.978295 Sep 10 10:47:47.659489 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2011/2517] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:46 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1462 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:47.676225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88c75744-ebbc-4ebf-85b9-3811d5fcd847 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:47.677262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88c75744-ebbc-4ebf-85b9-3811d5fcd847 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:47.694155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c75744-ebbc-4ebf-85b9-3811d5fcd847 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:47.696011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c75744-ebbc-4ebf-85b9-3811d5fcd847 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:47.696706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c75744-ebbc-4ebf-85b9-3811d5fcd847 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:47.697723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c75744-ebbc-4ebf-85b9-3811d5fcd847 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:47.698418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c75744-ebbc-4ebf-85b9-3811d5fcd847 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:47.699081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c75744-ebbc-4ebf-85b9-3811d5fcd847 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:48.261469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88c75744-ebbc-4ebf-85b9-3811d5fcd847 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:48.273134 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88c75744-ebbc-4ebf-85b9-3811d5fcd847 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1313 microversion: 2.1 time: 0.611065 Sep 10 10:47:48.275534 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2012/2518] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:47 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:48.285107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-85fe980d-eaec-4e14-8bac-7dbb4fe8376c req-53daf0bc-6e68-4a61-b6b8-4274acefad71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "715a034b-25ef-4c28-bff9-7843175d473f", "name": "network-vif-plugged", "status": "completed", "tag": "1a59a894-6b66-4f8a-82af-b9f60f5f1e38"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:48.305266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-85fe980d-eaec-4e14-8bac-7dbb4fe8376c req-53daf0bc-6e68-4a61-b6b8-4274acefad71 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:48.307052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-85fe980d-eaec-4e14-8bac-7dbb4fe8376c req-53daf0bc-6e68-4a61-b6b8-4274acefad71 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:48.307754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-85fe980d-eaec-4e14-8bac-7dbb4fe8376c req-53daf0bc-6e68-4a61-b6b8-4274acefad71 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:48.327093 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-85fe980d-eaec-4e14-8bac-7dbb4fe8376c req-53daf0bc-6e68-4a61-b6b8-4274acefad71 service nova] Creating event network-vif-plugged:1a59a894-6b66-4f8a-82af-b9f60f5f1e38 for instance 715a034b-25ef-4c28-bff9-7843175d473f on n-h2-856894-1 Sep 10 10:47:48.335695 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-85fe980d-eaec-4e14-8bac-7dbb4fe8376c req-53daf0bc-6e68-4a61-b6b8-4274acefad71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058162 Sep 10 10:47:48.340999 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2013/2519] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:48.351358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1684a4b3-1a27-48a1-a44a-3e7eabfd6002 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:48.358341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1684a4b3-1a27-48a1-a44a-3e7eabfd6002 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:48.383112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1684a4b3-1a27-48a1-a44a-3e7eabfd6002 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:48.384885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1684a4b3-1a27-48a1-a44a-3e7eabfd6002 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:48.385496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1684a4b3-1a27-48a1-a44a-3e7eabfd6002 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:48.386592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1684a4b3-1a27-48a1-a44a-3e7eabfd6002 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:48.388642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1684a4b3-1a27-48a1-a44a-3e7eabfd6002 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:48.389217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1684a4b3-1a27-48a1-a44a-3e7eabfd6002 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:48.991590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1684a4b3-1a27-48a1-a44a-3e7eabfd6002 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:49.001521 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1684a4b3-1a27-48a1-a44a-3e7eabfd6002 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1391 microversion: 2.1 time: 0.658028 Sep 10 10:47:49.003007 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2014/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:48 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1391 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:49.026684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7fd37a71-5160-4b78-b5e8-cca2932c7ad3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:49.027565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7fd37a71-5160-4b78-b5e8-cca2932c7ad3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:49.042778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fd37a71-5160-4b78-b5e8-cca2932c7ad3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:49.043495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fd37a71-5160-4b78-b5e8-cca2932c7ad3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:49.044429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fd37a71-5160-4b78-b5e8-cca2932c7ad3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:49.045961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fd37a71-5160-4b78-b5e8-cca2932c7ad3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:49.046760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fd37a71-5160-4b78-b5e8-cca2932c7ad3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:49.047352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fd37a71-5160-4b78-b5e8-cca2932c7ad3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:49.588999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7fd37a71-5160-4b78-b5e8-cca2932c7ad3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:49.604106 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7fd37a71-5160-4b78-b5e8-cca2932c7ad3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1462 microversion: 2.1 time: 0.599705 Sep 10 10:47:49.605419 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2015/2521] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:49 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1462 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:49.619350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bad3e335-1ebf-491f-a9db-0d7efca2024b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:49.620275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bad3e335-1ebf-491f-a9db-0d7efca2024b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:49.663259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad3e335-1ebf-491f-a9db-0d7efca2024b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:49.665348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad3e335-1ebf-491f-a9db-0d7efca2024b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:49.665878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad3e335-1ebf-491f-a9db-0d7efca2024b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:49.669891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad3e335-1ebf-491f-a9db-0d7efca2024b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:49.681330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad3e335-1ebf-491f-a9db-0d7efca2024b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:49.682615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad3e335-1ebf-491f-a9db-0d7efca2024b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:50.940269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bad3e335-1ebf-491f-a9db-0d7efca2024b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:50.968503 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bad3e335-1ebf-491f-a9db-0d7efca2024b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1313 microversion: 2.1 time: 1.361728 Sep 10 10:47:50.969485 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2016/2522] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:49 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1313 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:50.979712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-951463448", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "cc0e0a60-5b09-404d-8e58-92a80dad0840"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:51.115385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:47:51.901472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:47:51.901935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:47:51.902432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:47:51.902852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:47:51.903277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:47:51.925935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:51.926818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:51.927575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:51.928648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:51.929166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:51.929959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:51.987703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Getting quotas for project a8e0700581294ce78914145c18a1a70f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:47:51.997117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Getting quotas for user 036380e89f5e422ab0e5a66ee0a98777 and project a8e0700581294ce78914145c18a1a70f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:47:52.038398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:47:52.040940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:47:52.166649 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a11a58dc-32da-4582-a9a4-0848bd1c8ac5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.192376 Sep 10 10:47:52.175459 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2017/2523] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:47:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:47:52.189469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-cc23b015-0764-47d6-84a3-3bb2183415bf req-fe9878db-f66b-4534-9a2d-69b5e7918ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee58542a-6b67-4a9c-877d-08388a963470", "tag": "108704ca-0340-4f7a-85fa-f375c14063d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:52.215059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cc23b015-0764-47d6-84a3-3bb2183415bf req-fe9878db-f66b-4534-9a2d-69b5e7918ee1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:52.223823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cc23b015-0764-47d6-84a3-3bb2183415bf req-fe9878db-f66b-4534-9a2d-69b5e7918ee1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:52.224537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cc23b015-0764-47d6-84a3-3bb2183415bf req-fe9878db-f66b-4534-9a2d-69b5e7918ee1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:52.258853 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-cc23b015-0764-47d6-84a3-3bb2183415bf req-fe9878db-f66b-4534-9a2d-69b5e7918ee1 service nova] Creating event network-changed:108704ca-0340-4f7a-85fa-f375c14063d4 for instance ee58542a-6b67-4a9c-877d-08388a963470 on n-h2-856894-1 Sep 10 10:47:52.269779 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-cc23b015-0764-47d6-84a3-3bb2183415bf req-fe9878db-f66b-4534-9a2d-69b5e7918ee1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096636 Sep 10 10:47:52.270736 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2018/2524] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:52.276278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9cbdc8f7-e4ee-4e8f-bd34-03734ae0ecec tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:52.282616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9cbdc8f7-e4ee-4e8f-bd34-03734ae0ecec tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:52.298722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbdc8f7-e4ee-4e8f-bd34-03734ae0ecec tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:52.300633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbdc8f7-e4ee-4e8f-bd34-03734ae0ecec tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:52.308750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbdc8f7-e4ee-4e8f-bd34-03734ae0ecec tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:52.309415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbdc8f7-e4ee-4e8f-bd34-03734ae0ecec tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:52.309910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbdc8f7-e4ee-4e8f-bd34-03734ae0ecec tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:52.310354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cbdc8f7-e4ee-4e8f-bd34-03734ae0ecec tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:53.261326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9cbdc8f7-e4ee-4e8f-bd34-03734ae0ecec tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:53.319405 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9cbdc8f7-e4ee-4e8f-bd34-03734ae0ecec tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1572 microversion: 2.1 time: 1.041833 Sep 10 10:47:53.341495 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2019/2525] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:52 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1572 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:53.355979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9235926-eb04-414d-a1c0-1a4dc69803df tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:53.359824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9235926-eb04-414d-a1c0-1a4dc69803df tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:53.391189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9235926-eb04-414d-a1c0-1a4dc69803df tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:53.391692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9235926-eb04-414d-a1c0-1a4dc69803df tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:53.397797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9235926-eb04-414d-a1c0-1a4dc69803df tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:53.398547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9235926-eb04-414d-a1c0-1a4dc69803df tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:53.399024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9235926-eb04-414d-a1c0-1a4dc69803df tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:53.399447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9235926-eb04-414d-a1c0-1a4dc69803df tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:54.213981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9235926-eb04-414d-a1c0-1a4dc69803df tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:54.218538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:47:54.224274 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9235926-eb04-414d-a1c0-1a4dc69803df tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1313 microversion: 2.1 time: 0.893699 Sep 10 10:47:54.236646 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2020/2526] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:53 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:54.259241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae533bf9-33f0-46fb-bf91-6d9db7adaf47 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:54.260280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ae533bf9-33f0-46fb-bf91-6d9db7adaf47 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:54.268403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae533bf9-33f0-46fb-bf91-6d9db7adaf47 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:54.269034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae533bf9-33f0-46fb-bf91-6d9db7adaf47 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:54.269374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae533bf9-33f0-46fb-bf91-6d9db7adaf47 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:54.270091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae533bf9-33f0-46fb-bf91-6d9db7adaf47 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:54.270691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae533bf9-33f0-46fb-bf91-6d9db7adaf47 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:54.271135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae533bf9-33f0-46fb-bf91-6d9db7adaf47 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:54.401349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae533bf9-33f0-46fb-bf91-6d9db7adaf47 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:54.430935 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae533bf9-33f0-46fb-bf91-6d9db7adaf47 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1265 microversion: 2.1 time: 0.179938 Sep 10 10:47:54.432754 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2021/2527] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:54 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:54.438277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fad1d7c2-54ed-49a2-aa70-fbdbca7219e3 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:54.438788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fad1d7c2-54ed-49a2-aa70-fbdbca7219e3 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:54.446764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad1d7c2-54ed-49a2-aa70-fbdbca7219e3 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:54.447394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad1d7c2-54ed-49a2-aa70-fbdbca7219e3 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:54.447840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad1d7c2-54ed-49a2-aa70-fbdbca7219e3 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:54.448704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad1d7c2-54ed-49a2-aa70-fbdbca7219e3 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:54.449487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad1d7c2-54ed-49a2-aa70-fbdbca7219e3 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:54.450183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fad1d7c2-54ed-49a2-aa70-fbdbca7219e3 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:55.049570 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fad1d7c2-54ed-49a2-aa70-fbdbca7219e3 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.615116 Sep 10 10:47:55.050149 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2022/2528] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:47:54 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f/os-interface => generated 284 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:55.055144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-eec4bf5b-1b90-417b-973d-fc5b491ec6f1 req-5183f4a9-c348-4e81-aa08-417d6920f9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47a8a03-72e3-4db7-8e43-a1992a5f6ece", "tag": "d82ae4f2-aa8d-42e7-9522-1732c70f4f3a"}, {"name": "network-changed", "server_uuid": "a47a8a03-72e3-4db7-8e43-a1992a5f6ece", "tag": "d82ae4f2-aa8d-42e7-9522-1732c70f4f3a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:55.079690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-eec4bf5b-1b90-417b-973d-fc5b491ec6f1 req-5183f4a9-c348-4e81-aa08-417d6920f9a4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:55.089853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-eec4bf5b-1b90-417b-973d-fc5b491ec6f1 req-5183f4a9-c348-4e81-aa08-417d6920f9a4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:55.090307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-eec4bf5b-1b90-417b-973d-fc5b491ec6f1 req-5183f4a9-c348-4e81-aa08-417d6920f9a4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:55.102706 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-eec4bf5b-1b90-417b-973d-fc5b491ec6f1 req-5183f4a9-c348-4e81-aa08-417d6920f9a4 service nova] Creating event network-changed:d82ae4f2-aa8d-42e7-9522-1732c70f4f3a for instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece on n-h2-856894-1 Sep 10 10:47:55.103565 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-eec4bf5b-1b90-417b-973d-fc5b491ec6f1 req-5183f4a9-c348-4e81-aa08-417d6920f9a4 service nova] Creating event network-changed:d82ae4f2-aa8d-42e7-9522-1732c70f4f3a for instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece on n-h2-856894-1 Sep 10 10:47:55.110134 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-eec4bf5b-1b90-417b-973d-fc5b491ec6f1 req-5183f4a9-c348-4e81-aa08-417d6920f9a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058720 Sep 10 10:47:55.111434 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2023/2529] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:55.275348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95660eb5-10a8-49e1-992a-fe499e485cd8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:55.278379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95660eb5-10a8-49e1-992a-fe499e485cd8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:55.295433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95660eb5-10a8-49e1-992a-fe499e485cd8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:55.296822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95660eb5-10a8-49e1-992a-fe499e485cd8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:55.298128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95660eb5-10a8-49e1-992a-fe499e485cd8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:55.299247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95660eb5-10a8-49e1-992a-fe499e485cd8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:55.299931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95660eb5-10a8-49e1-992a-fe499e485cd8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:55.300596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95660eb5-10a8-49e1-992a-fe499e485cd8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:56.114085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95660eb5-10a8-49e1-992a-fe499e485cd8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:56.126038 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95660eb5-10a8-49e1-992a-fe499e485cd8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1313 microversion: 2.1 time: 0.863230 Sep 10 10:47:56.127070 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2024/2530] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:55 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1313 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:56.149037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-61de1bae-981b-4cd2-a596-cf458b910001 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:56.150874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-61de1bae-981b-4cd2-a596-cf458b910001 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:56.170192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61de1bae-981b-4cd2-a596-cf458b910001 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:56.171200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61de1bae-981b-4cd2-a596-cf458b910001 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:56.173268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61de1bae-981b-4cd2-a596-cf458b910001 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:56.174005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61de1bae-981b-4cd2-a596-cf458b910001 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:56.178363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61de1bae-981b-4cd2-a596-cf458b910001 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:56.179036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61de1bae-981b-4cd2-a596-cf458b910001 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:56.330224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-61de1bae-981b-4cd2-a596-cf458b910001 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:56.341999 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-61de1bae-981b-4cd2-a596-cf458b910001 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1271 microversion: 2.1 time: 0.213821 Sep 10 10:47:56.343885 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2025/2531] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:56 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1271 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:56.745878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-603fe6fa-6b8b-45f5-8542-656ce86facf0 req-8e7b6bb6-0380-4e92-9755-8edfc1f5defc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee58542a-6b67-4a9c-877d-08388a963470", "name": "network-vif-plugged", "status": "completed", "tag": "108704ca-0340-4f7a-85fa-f375c14063d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:56.761349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-603fe6fa-6b8b-45f5-8542-656ce86facf0 req-8e7b6bb6-0380-4e92-9755-8edfc1f5defc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:56.762093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-603fe6fa-6b8b-45f5-8542-656ce86facf0 req-8e7b6bb6-0380-4e92-9755-8edfc1f5defc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:56.762715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-603fe6fa-6b8b-45f5-8542-656ce86facf0 req-8e7b6bb6-0380-4e92-9755-8edfc1f5defc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:56.783635 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-603fe6fa-6b8b-45f5-8542-656ce86facf0 req-8e7b6bb6-0380-4e92-9755-8edfc1f5defc service nova] Creating event network-vif-plugged:108704ca-0340-4f7a-85fa-f375c14063d4 for instance ee58542a-6b67-4a9c-877d-08388a963470 on n-h2-856894-1 Sep 10 10:47:56.795682 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-603fe6fa-6b8b-45f5-8542-656ce86facf0 req-8e7b6bb6-0380-4e92-9755-8edfc1f5defc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056421 Sep 10 10:47:56.797694 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2026/2532] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:57.153274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5477bb98-58c8-4e4a-808e-37158aebaae6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:57.154253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5477bb98-58c8-4e4a-808e-37158aebaae6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:57.163564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5477bb98-58c8-4e4a-808e-37158aebaae6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:57.164217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5477bb98-58c8-4e4a-808e-37158aebaae6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:57.164768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5477bb98-58c8-4e4a-808e-37158aebaae6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:57.165768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5477bb98-58c8-4e4a-808e-37158aebaae6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:57.166355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5477bb98-58c8-4e4a-808e-37158aebaae6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:57.167012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5477bb98-58c8-4e4a-808e-37158aebaae6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:57.942217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5477bb98-58c8-4e4a-808e-37158aebaae6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:57.955985 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5477bb98-58c8-4e4a-808e-37158aebaae6 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1313 microversion: 2.1 time: 0.809905 Sep 10 10:47:57.960730 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2027/2533] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:57 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1313 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:47:57.972684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f25f70dd-09e2-4e2b-a046-12155635db24 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:57.974073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f25f70dd-09e2-4e2b-a046-12155635db24 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:57.988472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f25f70dd-09e2-4e2b-a046-12155635db24 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:57.990277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f25f70dd-09e2-4e2b-a046-12155635db24 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:57.990899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f25f70dd-09e2-4e2b-a046-12155635db24 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:57.992910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f25f70dd-09e2-4e2b-a046-12155635db24 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:57.993616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f25f70dd-09e2-4e2b-a046-12155635db24 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:57.994384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f25f70dd-09e2-4e2b-a046-12155635db24 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:58.507232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f25f70dd-09e2-4e2b-a046-12155635db24 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:58.520377 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f25f70dd-09e2-4e2b-a046-12155635db24 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1271 microversion: 2.1 time: 0.556269 Sep 10 10:47:58.525624 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2028/2534] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:57 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1271 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:58.851635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85f82d8f-da33-4b89-9a8f-cc1761b5a58e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'create', calling method: .version_select at 0x7efcb2bd5670>, body: {"keypair": {"name": "tempest-keypair-2068908624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIf8GPE8RkqbEcqDP75l94gCJs7jjJiWUTak3nyhZ8ehmJmGwWF+VrL74RYoSfl9zZJdmxCqsBbijxU9Rm/Qnm2S8CHAiXMP2d6BU+tfuDLyGVqFu01nMhYw8iQrf0UrPQ=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:47:58.900633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-85f82d8f-da33-4b89-9a8f-cc1761b5a58e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for project 524c87c1679a4651a4e303650950283c. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:47:58.923325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-85f82d8f-da33-4b89-9a8f-cc1761b5a58e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for user 2cccb6588d07459eb1cfa9c00f53f7e2 and project 524c87c1679a4651a4e303650950283c. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:47:58.986391 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85f82d8f-da33-4b89-9a8f-cc1761b5a58e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.459488 Sep 10 10:47:58.996244 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2029/2535] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:47:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:47:58.996589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b7f46ae-5d37-4042-a26c-fe7f92ff82da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:58.998642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b7f46ae-5d37-4042-a26c-fe7f92ff82da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:59.018403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7f46ae-5d37-4042-a26c-fe7f92ff82da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:59.020389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7f46ae-5d37-4042-a26c-fe7f92ff82da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:59.021485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7f46ae-5d37-4042-a26c-fe7f92ff82da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:59.022844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7f46ae-5d37-4042-a26c-fe7f92ff82da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:59.031466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7f46ae-5d37-4042-a26c-fe7f92ff82da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:59.033682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7f46ae-5d37-4042-a26c-fe7f92ff82da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:59.647180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b7f46ae-5d37-4042-a26c-fe7f92ff82da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:47:59.656723 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b7f46ae-5d37-4042-a26c-fe7f92ff82da tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1463 microversion: 2.1 time: 0.668163 Sep 10 10:47:59.666396 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2030/2536] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:58 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1463 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:47:59.671653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3c046ea-2533-414b-8c83-936ebf511759 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:47:59.672522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e3c046ea-2533-414b-8c83-936ebf511759 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:47:59.694318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3c046ea-2533-414b-8c83-936ebf511759 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:59.695224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3c046ea-2533-414b-8c83-936ebf511759 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:59.696124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3c046ea-2533-414b-8c83-936ebf511759 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:47:59.697735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3c046ea-2533-414b-8c83-936ebf511759 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:47:59.709907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3c046ea-2533-414b-8c83-936ebf511759 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:47:59.710763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3c046ea-2533-414b-8c83-936ebf511759 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:00.361762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e3c046ea-2533-414b-8c83-936ebf511759 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:00.380440 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3c046ea-2533-414b-8c83-936ebf511759 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1313 microversion: 2.1 time: 0.712264 Sep 10 10:48:00.383313 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2031/2537] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:47:59 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1313 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:00.392194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-faac87c9-fd33-4e18-b0ac-1d6eb2926206 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:00.395641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-faac87c9-fd33-4e18-b0ac-1d6eb2926206 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:00.410950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faac87c9-fd33-4e18-b0ac-1d6eb2926206 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:00.411493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faac87c9-fd33-4e18-b0ac-1d6eb2926206 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:00.411906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faac87c9-fd33-4e18-b0ac-1d6eb2926206 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:00.417605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faac87c9-fd33-4e18-b0ac-1d6eb2926206 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:00.418273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faac87c9-fd33-4e18-b0ac-1d6eb2926206 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:00.419056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-faac87c9-fd33-4e18-b0ac-1d6eb2926206 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:01.512577 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-faac87c9-fd33-4e18-b0ac-1d6eb2926206 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1614 microversion: 2.1 time: 1.127578 Sep 10 10:48:01.526019 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2032/2538] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:00 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1614 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:01.544038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-093a1a6c-0cab-491e-90dd-4884caecd71f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:01.550331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-093a1a6c-0cab-491e-90dd-4884caecd71f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:01.574616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093a1a6c-0cab-491e-90dd-4884caecd71f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:01.575410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093a1a6c-0cab-491e-90dd-4884caecd71f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:01.576244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093a1a6c-0cab-491e-90dd-4884caecd71f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:01.577279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093a1a6c-0cab-491e-90dd-4884caecd71f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:01.577962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093a1a6c-0cab-491e-90dd-4884caecd71f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:01.578613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093a1a6c-0cab-491e-90dd-4884caecd71f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:01.950333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:02.025527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-093a1a6c-0cab-491e-90dd-4884caecd71f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:02.040665 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-093a1a6c-0cab-491e-90dd-4884caecd71f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1572 microversion: 2.1 time: 0.512964 Sep 10 10:48:02.043049 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2033/2539] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:01 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1572 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:02.055506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e9f34a9f-7cb0-4333-880c-8452d90a6d50 req-cadaa4a7-0ca3-4e9b-9b75-fb88fb87dd0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "715a034b-25ef-4c28-bff9-7843175d473f", "tag": "1a59a894-6b66-4f8a-82af-b9f60f5f1e38"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:02.087468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e9f34a9f-7cb0-4333-880c-8452d90a6d50 req-cadaa4a7-0ca3-4e9b-9b75-fb88fb87dd0f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:02.090787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e9f34a9f-7cb0-4333-880c-8452d90a6d50 req-cadaa4a7-0ca3-4e9b-9b75-fb88fb87dd0f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:02.091648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e9f34a9f-7cb0-4333-880c-8452d90a6d50 req-cadaa4a7-0ca3-4e9b-9b75-fb88fb87dd0f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:02.119352 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e9f34a9f-7cb0-4333-880c-8452d90a6d50 req-cadaa4a7-0ca3-4e9b-9b75-fb88fb87dd0f service nova] Creating event network-changed:1a59a894-6b66-4f8a-82af-b9f60f5f1e38 for instance 715a034b-25ef-4c28-bff9-7843175d473f on n-h2-856894-1 Sep 10 10:48:02.125099 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e9f34a9f-7cb0-4333-880c-8452d90a6d50 req-cadaa4a7-0ca3-4e9b-9b75-fb88fb87dd0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080059 Sep 10 10:48:02.127209 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2034/2540] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:02.133405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a312c070-9cb4-4412-b3b1-c702a144c047 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:02.134497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a312c070-9cb4-4412-b3b1-c702a144c047 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:02.143894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a312c070-9cb4-4412-b3b1-c702a144c047 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:02.144841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a312c070-9cb4-4412-b3b1-c702a144c047 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:02.145545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a312c070-9cb4-4412-b3b1-c702a144c047 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:02.146566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a312c070-9cb4-4412-b3b1-c702a144c047 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:02.147292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a312c070-9cb4-4412-b3b1-c702a144c047 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:02.147966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a312c070-9cb4-4412-b3b1-c702a144c047 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:02.613827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a312c070-9cb4-4412-b3b1-c702a144c047 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:02.628138 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a312c070-9cb4-4412-b3b1-c702a144c047 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1313 microversion: 2.1 time: 0.498726 Sep 10 10:48:02.628743 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2035/2541] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:02 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:02.652248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:02.652248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:02.659581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:02.660348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:02.661013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:02.661957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:02.662607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:02.663226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:02.727588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c342890c5911447d97325fa697d9ee19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caebc84429e44c758c11555ad1f06d97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:02.728322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] [instance: ee58542a-6b67-4a9c-877d-08388a963470] flavor_id is None. Assuming migration. {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 10:48:02.728739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 10:48:02.978480 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a84d2c00-3ff7-44d9-a5d4-c34bd311a24b tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470/action" status: 202 len: 0 microversion: 2.1 time: 0.334897 Sep 10 10:48:02.979954 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2036/2542] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:48:02 2022] POST /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:48:03.000504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9685354-3334-4c32-932b-2d2706f6e545 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:03.001561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f9685354-3334-4c32-932b-2d2706f6e545 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:03.010033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9685354-3334-4c32-932b-2d2706f6e545 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:03.010738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9685354-3334-4c32-932b-2d2706f6e545 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:03.011547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9685354-3334-4c32-932b-2d2706f6e545 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:03.014108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9685354-3334-4c32-932b-2d2706f6e545 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:03.014999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9685354-3334-4c32-932b-2d2706f6e545 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:03.015997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9685354-3334-4c32-932b-2d2706f6e545 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:04.036786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f9685354-3334-4c32-932b-2d2706f6e545 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:04.049870 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f9685354-3334-4c32-932b-2d2706f6e545 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1472 microversion: 2.1 time: 1.064908 Sep 10 10:48:04.051051 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2037/2543] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:02 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1472 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:04.057224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a69937bd-2678-4df2-a5a7-7dd2fe6ea3e9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:04.057839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a69937bd-2678-4df2-a5a7-7dd2fe6ea3e9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:04.076820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69937bd-2678-4df2-a5a7-7dd2fe6ea3e9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:04.078619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69937bd-2678-4df2-a5a7-7dd2fe6ea3e9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:04.079540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69937bd-2678-4df2-a5a7-7dd2fe6ea3e9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:04.080647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69937bd-2678-4df2-a5a7-7dd2fe6ea3e9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:04.081255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69937bd-2678-4df2-a5a7-7dd2fe6ea3e9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:04.081829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a69937bd-2678-4df2-a5a7-7dd2fe6ea3e9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:04.780903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a69937bd-2678-4df2-a5a7-7dd2fe6ea3e9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:04.803276 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a69937bd-2678-4df2-a5a7-7dd2fe6ea3e9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1313 microversion: 2.1 time: 0.749677 Sep 10 10:48:04.819707 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2038/2544] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:04 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:04.844238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-bc24511b-32ab-4d82-b35d-2ee1ea8fc31e req-349e5cf5-8d8b-4512-bd08-29d7e6b7768d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fecc3604-4982-44d0-8db3-3851a489bbe0", "tag": "58fc25cf-6f2b-4427-9708-006b8323b627"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:04.862845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bc24511b-32ab-4d82-b35d-2ee1ea8fc31e req-349e5cf5-8d8b-4512-bd08-29d7e6b7768d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:04.863330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bc24511b-32ab-4d82-b35d-2ee1ea8fc31e req-349e5cf5-8d8b-4512-bd08-29d7e6b7768d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:04.863855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bc24511b-32ab-4d82-b35d-2ee1ea8fc31e req-349e5cf5-8d8b-4512-bd08-29d7e6b7768d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:04.887794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:04.917005 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-bc24511b-32ab-4d82-b35d-2ee1ea8fc31e req-349e5cf5-8d8b-4512-bd08-29d7e6b7768d service nova] Creating event network-changed:58fc25cf-6f2b-4427-9708-006b8323b627 for instance fecc3604-4982-44d0-8db3-3851a489bbe0 on n-h2-856894-1 Sep 10 10:48:04.923590 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-bc24511b-32ab-4d82-b35d-2ee1ea8fc31e req-349e5cf5-8d8b-4512-bd08-29d7e6b7768d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100609 Sep 10 10:48:04.924963 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2039/2545] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:05.077532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30fcc273-5f55-4671-ad93-f5b1de681d6f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:05.079076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30fcc273-5f55-4671-ad93-f5b1de681d6f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:05.102187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30fcc273-5f55-4671-ad93-f5b1de681d6f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:05.102962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30fcc273-5f55-4671-ad93-f5b1de681d6f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:05.103433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30fcc273-5f55-4671-ad93-f5b1de681d6f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:05.104681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30fcc273-5f55-4671-ad93-f5b1de681d6f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:05.106159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30fcc273-5f55-4671-ad93-f5b1de681d6f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:05.106596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30fcc273-5f55-4671-ad93-f5b1de681d6f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:05.523693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30fcc273-5f55-4671-ad93-f5b1de681d6f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:05.538609 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30fcc273-5f55-4671-ad93-f5b1de681d6f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1472 microversion: 2.1 time: 0.467002 Sep 10 10:48:05.539725 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2040/2546] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:05 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1472 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:05.826473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f35855b-fd10-42d0-a39a-0ee007debc8b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:05.827414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f35855b-fd10-42d0-a39a-0ee007debc8b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:05.846868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f35855b-fd10-42d0-a39a-0ee007debc8b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:05.848342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f35855b-fd10-42d0-a39a-0ee007debc8b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:05.848982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f35855b-fd10-42d0-a39a-0ee007debc8b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:05.854143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f35855b-fd10-42d0-a39a-0ee007debc8b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:05.856067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f35855b-fd10-42d0-a39a-0ee007debc8b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:05.856622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f35855b-fd10-42d0-a39a-0ee007debc8b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:06.309695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f35855b-fd10-42d0-a39a-0ee007debc8b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:06.323201 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f35855b-fd10-42d0-a39a-0ee007debc8b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1313 microversion: 2.1 time: 0.500776 Sep 10 10:48:06.325746 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2041/2547] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:05 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:06.444488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1891016693", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17605326-3d0c-4135-8b61-c2da6b77cdca"}], "security_groups": [{"name": "tempest-securitygroup--273475051"}], "key_name": "tempest-keypair-2068908624", "user_data": "}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:06.719261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] validate_networks() for [('17605326-3d0c-4135-8b61-c2da6b77cdca', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:48:07.961563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:08.660513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:48:08.661518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:48:08.662003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:48:08.662416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:48:08.662832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:48:08.680788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:08.681306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:08.681741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:08.682467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:08.682919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:08.686804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:08.742694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for project 524c87c1679a4651a4e303650950283c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:08.759300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for user 2cccb6588d07459eb1cfa9c00f53f7e2 and project 524c87c1679a4651a4e303650950283c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:08.792606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:48:08.801407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:48:08.936026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1aa7a5ff-ad12-4b22-8318-ef4572270d23 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.496416 Sep 10 10:48:08.937301 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2042/2548] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:48:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 2498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 10:48:08.947095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53b14302-688e-4e84-963c-ff804213da8e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:08.951032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53b14302-688e-4e84-963c-ff804213da8e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:08.964293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b14302-688e-4e84-963c-ff804213da8e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:08.970127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b14302-688e-4e84-963c-ff804213da8e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:08.970848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b14302-688e-4e84-963c-ff804213da8e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:08.971770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b14302-688e-4e84-963c-ff804213da8e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:08.972399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b14302-688e-4e84-963c-ff804213da8e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:08.974051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53b14302-688e-4e84-963c-ff804213da8e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:09.605765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53b14302-688e-4e84-963c-ff804213da8e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:09.623335 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53b14302-688e-4e84-963c-ff804213da8e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.681094 Sep 10 10:48:09.628187 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2043/2549] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:08 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:09.643315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd499edb-c90a-43de-8b5a-c4c5649dd383 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:09.644196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd499edb-c90a-43de-8b5a-c4c5649dd383 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:09.660612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd499edb-c90a-43de-8b5a-c4c5649dd383 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:09.661434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd499edb-c90a-43de-8b5a-c4c5649dd383 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:09.662055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd499edb-c90a-43de-8b5a-c4c5649dd383 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:09.665196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd499edb-c90a-43de-8b5a-c4c5649dd383 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:09.665837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd499edb-c90a-43de-8b5a-c4c5649dd383 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:09.668455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd499edb-c90a-43de-8b5a-c4c5649dd383 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:09.997578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd499edb-c90a-43de-8b5a-c4c5649dd383 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:10.010926 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd499edb-c90a-43de-8b5a-c4c5649dd383 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1313 microversion: 2.1 time: 0.378625 Sep 10 10:48:10.013183 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2044/2550] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:09 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:10.032332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c5b4c460-825d-4150-92bc-a525e23cbb5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:10.034873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c5b4c460-825d-4150-92bc-a525e23cbb5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:10.050143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5b4c460-825d-4150-92bc-a525e23cbb5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:10.053097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5b4c460-825d-4150-92bc-a525e23cbb5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:10.053555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5b4c460-825d-4150-92bc-a525e23cbb5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:10.058148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5b4c460-825d-4150-92bc-a525e23cbb5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:10.058700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5b4c460-825d-4150-92bc-a525e23cbb5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:10.059412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5b4c460-825d-4150-92bc-a525e23cbb5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:10.212114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5b4c460-825d-4150-92bc-a525e23cbb5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:10.223868 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c5b4c460-825d-4150-92bc-a525e23cbb5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1243 microversion: 2.1 time: 0.209513 Sep 10 10:48:10.230334 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2045/2551] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:10 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1243 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:10.681314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db3dbf7a-e2d5-4aa1-9d7f-f05c18fd1e4f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:10.682580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db3dbf7a-e2d5-4aa1-9d7f-f05c18fd1e4f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:10.702681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db3dbf7a-e2d5-4aa1-9d7f-f05c18fd1e4f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:10.704429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db3dbf7a-e2d5-4aa1-9d7f-f05c18fd1e4f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:10.705111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db3dbf7a-e2d5-4aa1-9d7f-f05c18fd1e4f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:10.736177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db3dbf7a-e2d5-4aa1-9d7f-f05c18fd1e4f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:10.740098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db3dbf7a-e2d5-4aa1-9d7f-f05c18fd1e4f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:10.741609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db3dbf7a-e2d5-4aa1-9d7f-f05c18fd1e4f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:11.306491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-db3dbf7a-e2d5-4aa1-9d7f-f05c18fd1e4f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:11.345716 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db3dbf7a-e2d5-4aa1-9d7f-f05c18fd1e4f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.695666 Sep 10 10:48:11.346923 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2046/2552] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:10 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:11.352376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-39615ddf-a9ae-402a-94d2-cc720f4caf36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:11.353202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-39615ddf-a9ae-402a-94d2-cc720f4caf36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:11.396210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39615ddf-a9ae-402a-94d2-cc720f4caf36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:11.396719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39615ddf-a9ae-402a-94d2-cc720f4caf36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:11.397344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39615ddf-a9ae-402a-94d2-cc720f4caf36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:11.398062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39615ddf-a9ae-402a-94d2-cc720f4caf36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:11.398522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39615ddf-a9ae-402a-94d2-cc720f4caf36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:11.398954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39615ddf-a9ae-402a-94d2-cc720f4caf36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:11.878780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39615ddf-a9ae-402a-94d2-cc720f4caf36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:11.900753 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-39615ddf-a9ae-402a-94d2-cc720f4caf36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1313 microversion: 2.1 time: 0.542195 Sep 10 10:48:11.901471 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2047/2553] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:11 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:11.918728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-da90197a-f1df-449f-8fca-9ad3adfc8928 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:11.921977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-da90197a-f1df-449f-8fca-9ad3adfc8928 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:11.943574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da90197a-f1df-449f-8fca-9ad3adfc8928 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:11.944097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da90197a-f1df-449f-8fca-9ad3adfc8928 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:11.944541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da90197a-f1df-449f-8fca-9ad3adfc8928 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:11.945290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da90197a-f1df-449f-8fca-9ad3adfc8928 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:11.950567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da90197a-f1df-449f-8fca-9ad3adfc8928 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:11.951030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da90197a-f1df-449f-8fca-9ad3adfc8928 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:12.094476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-da90197a-f1df-449f-8fca-9ad3adfc8928 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:12.104287 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-da90197a-f1df-449f-8fca-9ad3adfc8928 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1297 microversion: 2.1 time: 0.201549 Sep 10 10:48:12.105284 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2048/2554] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:11 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1297 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:12.352662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52a50a58-33df-461f-a9e5-666d3e9528b8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Action: 'create', calling method: .version_select at 0x7efcb2c041f0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-753606673", "policies": ["affinity"]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:12.417394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-52a50a58-33df-461f-a9e5-666d3e9528b8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:12.426635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-52a50a58-33df-461f-a9e5-666d3e9528b8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:12.474472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-52a50a58-33df-461f-a9e5-666d3e9528b8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:12.481234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-52a50a58-33df-461f-a9e5-666d3e9528b8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:12.503602 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-52a50a58-33df-461f-a9e5-666d3e9528b8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.396239 Sep 10 10:48:12.505219 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2049/2555] 10.222.0.20 () {60 vars in 1174 bytes} [Sat Sep 10 10:48:12 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:12.513255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d724cad-e62b-4f82-9909-daabf63d0eec tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:12.513959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9d724cad-e62b-4f82-9909-daabf63d0eec tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:12.520900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d724cad-e62b-4f82-9909-daabf63d0eec tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:12.521468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d724cad-e62b-4f82-9909-daabf63d0eec tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:12.522093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d724cad-e62b-4f82-9909-daabf63d0eec tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:12.522800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d724cad-e62b-4f82-9909-daabf63d0eec tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:12.523317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d724cad-e62b-4f82-9909-daabf63d0eec tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:12.523866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d724cad-e62b-4f82-9909-daabf63d0eec tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:12.844742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d724cad-e62b-4f82-9909-daabf63d0eec tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:12.862692 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d724cad-e62b-4f82-9909-daabf63d0eec tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.356245 Sep 10 10:48:12.873303 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2050/2556] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:12 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:12.873303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e67a45a-6676-4ba6-a9f7-d45c76995a19 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Action: 'create', calling method: .version_select at 0x7efcb2c3d820>, body: {"server_group": {"name": "tempest-server-group-1387115934", "policies": ["affinity"]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:12.910916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0e67a45a-6676-4ba6-a9f7-d45c76995a19 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:12.923391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0e67a45a-6676-4ba6-a9f7-d45c76995a19 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:12.995559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0e67a45a-6676-4ba6-a9f7-d45c76995a19 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:13.004755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0e67a45a-6676-4ba6-a9f7-d45c76995a19 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:13.027138 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e67a45a-6676-4ba6-a9f7-d45c76995a19 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.162363 Sep 10 10:48:13.028115 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2051/2557] 10.222.0.20 () {60 vars in 1173 bytes} [Sat Sep 10 10:48:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:13.034020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94d6d712-e8a4-4c77-9816-3577c8c44b8d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:13.034673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-94d6d712-e8a4-4c77-9816-3577c8c44b8d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:13.045333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94d6d712-e8a4-4c77-9816-3577c8c44b8d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:13.046326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94d6d712-e8a4-4c77-9816-3577c8c44b8d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:13.047153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94d6d712-e8a4-4c77-9816-3577c8c44b8d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:13.047877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94d6d712-e8a4-4c77-9816-3577c8c44b8d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:13.048336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94d6d712-e8a4-4c77-9816-3577c8c44b8d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:13.048764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94d6d712-e8a4-4c77-9816-3577c8c44b8d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:13.709585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-94d6d712-e8a4-4c77-9816-3577c8c44b8d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:13.725470 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94d6d712-e8a4-4c77-9816-3577c8c44b8d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1313 microversion: 2.1 time: 0.696164 Sep 10 10:48:13.751830 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2052/2558] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:13 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:13.760505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eec59ce2-c6d2-4042-baec-02ee518f8988 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Action: 'create', calling method: .version_select at 0x7efcadd22670>, body: {"server_group": {"name": "tempest-server-group-1387115934", "policies": ["affinity"]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:13.799787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-eec59ce2-c6d2-4042-baec-02ee518f8988 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:13.810225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-eec59ce2-c6d2-4042-baec-02ee518f8988 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:13.850910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:13.887157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-eec59ce2-c6d2-4042-baec-02ee518f8988 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:13.902072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-eec59ce2-c6d2-4042-baec-02ee518f8988 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:13.923616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eec59ce2-c6d2-4042-baec-02ee518f8988 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.169391 Sep 10 10:48:13.924284 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2053/2559] 10.222.0.20 () {60 vars in 1173 bytes} [Sat Sep 10 10:48:13 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:13.929836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ae08f7a5-fc5a-4351-a9bd-50d75a5df729 req-2d065785-9ef2-4fbf-9532-647d2b914086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fecc3604-4982-44d0-8db3-3851a489bbe0", "name": "network-vif-plugged", "status": "completed", "tag": "58fc25cf-6f2b-4427-9708-006b8323b627"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:13.940816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae08f7a5-fc5a-4351-a9bd-50d75a5df729 req-2d065785-9ef2-4fbf-9532-647d2b914086 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:13.944702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae08f7a5-fc5a-4351-a9bd-50d75a5df729 req-2d065785-9ef2-4fbf-9532-647d2b914086 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:13.944702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae08f7a5-fc5a-4351-a9bd-50d75a5df729 req-2d065785-9ef2-4fbf-9532-647d2b914086 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:13.954974 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ae08f7a5-fc5a-4351-a9bd-50d75a5df729 req-2d065785-9ef2-4fbf-9532-647d2b914086 service nova] Creating event network-vif-plugged:58fc25cf-6f2b-4427-9708-006b8323b627 for instance fecc3604-4982-44d0-8db3-3851a489bbe0 on n-h2-856894-1 Sep 10 10:48:13.968725 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ae08f7a5-fc5a-4351-a9bd-50d75a5df729 req-2d065785-9ef2-4fbf-9532-647d2b914086 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043050 Sep 10 10:48:13.970268 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2054/2560] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:13.976516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-509ba4a3-077f-45ce-b7c8-6417c0f506e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:13.978801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-509ba4a3-077f-45ce-b7c8-6417c0f506e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:13.988133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509ba4a3-077f-45ce-b7c8-6417c0f506e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:13.988133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509ba4a3-077f-45ce-b7c8-6417c0f506e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:13.988133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509ba4a3-077f-45ce-b7c8-6417c0f506e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:13.988133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509ba4a3-077f-45ce-b7c8-6417c0f506e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:13.988133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509ba4a3-077f-45ce-b7c8-6417c0f506e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:13.988558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509ba4a3-077f-45ce-b7c8-6417c0f506e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:14.341111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-509ba4a3-077f-45ce-b7c8-6417c0f506e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:14.352589 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-509ba4a3-077f-45ce-b7c8-6417c0f506e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1364 microversion: 2.1 time: 0.380953 Sep 10 10:48:14.354588 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2055/2561] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:13 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1364 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:14.360863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-77235fae-46e1-4bf4-80df-de0f75311651 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:14.361923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-77235fae-46e1-4bf4-80df-de0f75311651 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:14.368792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77235fae-46e1-4bf4-80df-de0f75311651 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:14.370229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77235fae-46e1-4bf4-80df-de0f75311651 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:14.370902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77235fae-46e1-4bf4-80df-de0f75311651 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:14.371866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77235fae-46e1-4bf4-80df-de0f75311651 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:14.372555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77235fae-46e1-4bf4-80df-de0f75311651 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:14.373239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77235fae-46e1-4bf4-80df-de0f75311651 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:14.722484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-77235fae-46e1-4bf4-80df-de0f75311651 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:14.740324 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-77235fae-46e1-4bf4-80df-de0f75311651 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.384286 Sep 10 10:48:14.754900 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2056/2562] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:14 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:14.771746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0e570c8-1969-438c-b84a-b4cb2e7ec8ee tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:14.816580 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0e570c8-1969-438c-b84a-b4cb2e7ec8ee tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da" status: 204 len: 0 microversion: 2.1 time: 0.059477 Sep 10 10:48:14.817751 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2057/2563] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:48:14 2022] DELETE /compute/v2.1/os-server-groups/e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:48:14.823668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76cccac0-0128-4d08-bbd8-8556fcbf401a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:14.824288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-76cccac0-0128-4d08-bbd8-8556fcbf401a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:14.833066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cccac0-0128-4d08-bbd8-8556fcbf401a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:14.833587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cccac0-0128-4d08-bbd8-8556fcbf401a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:14.834084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cccac0-0128-4d08-bbd8-8556fcbf401a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:14.834792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cccac0-0128-4d08-bbd8-8556fcbf401a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:14.835242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cccac0-0128-4d08-bbd8-8556fcbf401a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:14.835811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cccac0-0128-4d08-bbd8-8556fcbf401a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:15.168685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76cccac0-0128-4d08-bbd8-8556fcbf401a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:15.178845 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76cccac0-0128-4d08-bbd8-8556fcbf401a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1313 microversion: 2.1 time: 0.359609 Sep 10 10:48:15.195817 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2058/2564] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:14 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:15.202123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-480c3439-4219-4587-8256-bb25057df2cb tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:15.223848 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-480c3439-4219-4587-8256-bb25057df2cb tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.026628 Sep 10 10:48:15.224511 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2059/2565] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:48:15 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:15.237090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-652d7dec-f068-44e1-afed-1854ae75100e tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:15.288834 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-652d7dec-f068-44e1-afed-1854ae75100e tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f" status: 204 len: 0 microversion: 2.1 time: 0.053792 Sep 10 10:48:15.293567 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2060/2566] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:48:15 2022] DELETE /compute/v2.1/os-server-groups/f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:48:15.304254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27424581-eb05-4f82-867c-03d59afd6bb4 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:15.321332 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27424581-eb05-4f82-867c-03d59afd6bb4 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.025607 Sep 10 10:48:15.324153 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2061/2567] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:48:15 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:15.341065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8461a7cc-6096-4f4a-999c-767bed6177a1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Action: 'create', calling method: .version_select at 0x7efcae4051f0>, body: {"server_group": {"name": "tempest-server-group-1069591584", "policies": ["affinity"]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:15.369002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8461a7cc-6096-4f4a-999c-767bed6177a1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:15.382378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8461a7cc-6096-4f4a-999c-767bed6177a1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:15.456952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8461a7cc-6096-4f4a-999c-767bed6177a1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:15.465477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8461a7cc-6096-4f4a-999c-767bed6177a1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:15.488241 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8461a7cc-6096-4f4a-999c-767bed6177a1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.151003 Sep 10 10:48:15.488878 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2062/2568] 10.222.0.20 () {60 vars in 1173 bytes} [Sat Sep 10 10:48:15 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:15.495726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b8ea6069-bc39-404b-9047-58488ad65fd7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:15.496282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b8ea6069-bc39-404b-9047-58488ad65fd7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:15.504115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8ea6069-bc39-404b-9047-58488ad65fd7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:15.504617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8ea6069-bc39-404b-9047-58488ad65fd7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:15.505055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8ea6069-bc39-404b-9047-58488ad65fd7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:15.505791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8ea6069-bc39-404b-9047-58488ad65fd7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:15.506247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8ea6069-bc39-404b-9047-58488ad65fd7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:15.506778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8ea6069-bc39-404b-9047-58488ad65fd7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:15.764487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b8ea6069-bc39-404b-9047-58488ad65fd7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:15.772933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b8ea6069-bc39-404b-9047-58488ad65fd7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1364 microversion: 2.1 time: 0.282504 Sep 10 10:48:15.773704 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2063/2569] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:15 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:15.778622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ac21aa20-46f7-4e79-83b8-c04ca691d126 req-c08a16c3-1678-4f64-bca5-a8e591b4ede0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5", "tag": "a9a5c077-18b4-45a9-ab46-131e14788b74"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:15.789474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ac21aa20-46f7-4e79-83b8-c04ca691d126 req-c08a16c3-1678-4f64-bca5-a8e591b4ede0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:15.790343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ac21aa20-46f7-4e79-83b8-c04ca691d126 req-c08a16c3-1678-4f64-bca5-a8e591b4ede0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:15.791043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ac21aa20-46f7-4e79-83b8-c04ca691d126 req-c08a16c3-1678-4f64-bca5-a8e591b4ede0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:15.809240 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ac21aa20-46f7-4e79-83b8-c04ca691d126 req-c08a16c3-1678-4f64-bca5-a8e591b4ede0 service nova] Creating event network-changed:a9a5c077-18b4-45a9-ab46-131e14788b74 for instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 on n-h2-856894-1 Sep 10 10:48:15.818977 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ac21aa20-46f7-4e79-83b8-c04ca691d126 req-c08a16c3-1678-4f64-bca5-a8e591b4ede0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043801 Sep 10 10:48:15.822297 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2064/2570] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:15.833545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1958af61-2377-4307-9968-d528fb748601 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:15.879520 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1958af61-2377-4307-9968-d528fb748601 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/84bc24a2-01cf-4765-90fc-d0bf71bef860" status: 204 len: 0 microversion: 2.1 time: 0.055177 Sep 10 10:48:15.882013 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2065/2571] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:48:15 2022] DELETE /compute/v2.1/os-server-groups/84bc24a2-01cf-4765-90fc-d0bf71bef860 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:48:15.893194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02655ef5-d1c4-4a2a-a89e-e09cb4c02837 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:15.894225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02655ef5-d1c4-4a2a-a89e-e09cb4c02837 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:15.939478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02655ef5-d1c4-4a2a-a89e-e09cb4c02837 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:15.939898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02655ef5-d1c4-4a2a-a89e-e09cb4c02837 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:15.940324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02655ef5-d1c4-4a2a-a89e-e09cb4c02837 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:15.941028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02655ef5-d1c4-4a2a-a89e-e09cb4c02837 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:15.941509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02655ef5-d1c4-4a2a-a89e-e09cb4c02837 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:15.941934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02655ef5-d1c4-4a2a-a89e-e09cb4c02837 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:16.362080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02655ef5-d1c4-4a2a-a89e-e09cb4c02837 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:16.377374 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02655ef5-d1c4-4a2a-a89e-e09cb4c02837 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.493907 Sep 10 10:48:16.378385 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2066/2572] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:15 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:16.389620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6aa85406-b17c-4b2d-bebf-1b2d41eb6de3 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:16.418406 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6aa85406-b17c-4b2d-bebf-1b2d41eb6de3 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.038509 Sep 10 10:48:16.420017 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2067/2573] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:48:16 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:16.425644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8116f9f-678e-48d2-8419-3c6d70e183c3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:16.426560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e8116f9f-678e-48d2-8419-3c6d70e183c3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:16.436678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8116f9f-678e-48d2-8419-3c6d70e183c3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:16.437725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8116f9f-678e-48d2-8419-3c6d70e183c3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:16.438458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8116f9f-678e-48d2-8419-3c6d70e183c3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:16.439389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8116f9f-678e-48d2-8419-3c6d70e183c3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:16.440208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8116f9f-678e-48d2-8419-3c6d70e183c3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:16.440858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8116f9f-678e-48d2-8419-3c6d70e183c3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:16.470124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:16.933679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e8116f9f-678e-48d2-8419-3c6d70e183c3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:16.943309 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8116f9f-678e-48d2-8419-3c6d70e183c3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1313 microversion: 2.1 time: 0.521399 Sep 10 10:48:16.946430 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2068/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:16 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:16.954375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e837a2f-4626-4468-bb76-6b7d2b44dc3a tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Action: 'create', calling method: .version_select at 0x7efcb2bcc0d0>, body: {"server_group": {"name": "tempest-server-group-1625118724", "policies": ["anti-affinity"]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:16.981887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4e837a2f-4626-4468-bb76-6b7d2b44dc3a tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:16.990233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4e837a2f-4626-4468-bb76-6b7d2b44dc3a tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:17.026051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:17.082710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4e837a2f-4626-4468-bb76-6b7d2b44dc3a tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:17.090576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4e837a2f-4626-4468-bb76-6b7d2b44dc3a tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:17.112771 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e837a2f-4626-4468-bb76-6b7d2b44dc3a tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.165041 Sep 10 10:48:17.120193 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2069/2575] 10.222.0.20 () {60 vars in 1173 bytes} [Sat Sep 10 10:48:16 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:17.126268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e44af575-34d1-403d-923d-a15edcbf9d26 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:17.126995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e44af575-34d1-403d-923d-a15edcbf9d26 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:17.133792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44af575-34d1-403d-923d-a15edcbf9d26 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:17.134376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44af575-34d1-403d-923d-a15edcbf9d26 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:17.134863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44af575-34d1-403d-923d-a15edcbf9d26 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:17.135721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44af575-34d1-403d-923d-a15edcbf9d26 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:17.136187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44af575-34d1-403d-923d-a15edcbf9d26 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:17.136671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44af575-34d1-403d-923d-a15edcbf9d26 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:17.526861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e44af575-34d1-403d-923d-a15edcbf9d26 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:17.539191 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e44af575-34d1-403d-923d-a15edcbf9d26 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1364 microversion: 2.1 time: 0.417671 Sep 10 10:48:17.547382 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2070/2576] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:17 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1364 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:17.559694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93851189-9059-4f48-b758-a11623ce707c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:17.598000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93851189-9059-4f48-b758-a11623ce707c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/db80e217-7e49-47a5-a5d2-af206d25b074" status: 204 len: 0 microversion: 2.1 time: 0.048021 Sep 10 10:48:17.605234 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2071/2577] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:48:17 2022] DELETE /compute/v2.1/os-server-groups/db80e217-7e49-47a5-a5d2-af206d25b074 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:48:17.612662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7201b7af-ea11-4895-86e8-e45db21a40f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:17.613542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7201b7af-ea11-4895-86e8-e45db21a40f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:17.620727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201b7af-ea11-4895-86e8-e45db21a40f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:17.621430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201b7af-ea11-4895-86e8-e45db21a40f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:17.621992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201b7af-ea11-4895-86e8-e45db21a40f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:17.622790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201b7af-ea11-4895-86e8-e45db21a40f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:17.623871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201b7af-ea11-4895-86e8-e45db21a40f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:17.624415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7201b7af-ea11-4895-86e8-e45db21a40f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:17.956378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7201b7af-ea11-4895-86e8-e45db21a40f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:17.972524 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7201b7af-ea11-4895-86e8-e45db21a40f4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.365381 Sep 10 10:48:17.973441 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2072/2578] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:17 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:17.978726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b45a3e5c-b1fd-4222-ae92-aa9c043e4cbb tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:17.995530 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b45a3e5c-b1fd-4222-ae92-aa9c043e4cbb tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.020461 Sep 10 10:48:18.005046 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2073/2579] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:48:17 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:18.014013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc9fcff0-ea81-4080-8d7e-07a711b421e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:18.017879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dc9fcff0-ea81-4080-8d7e-07a711b421e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:18.026487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc9fcff0-ea81-4080-8d7e-07a711b421e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:18.026986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc9fcff0-ea81-4080-8d7e-07a711b421e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:18.027426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc9fcff0-ea81-4080-8d7e-07a711b421e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:18.028128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc9fcff0-ea81-4080-8d7e-07a711b421e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:18.028636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc9fcff0-ea81-4080-8d7e-07a711b421e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:18.029093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc9fcff0-ea81-4080-8d7e-07a711b421e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:18.584536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dc9fcff0-ea81-4080-8d7e-07a711b421e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:18.602791 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dc9fcff0-ea81-4080-8d7e-07a711b421e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1463 microversion: 2.1 time: 0.595354 Sep 10 10:48:18.604317 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2074/2580] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:18 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1463 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:18.611225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-898316886", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "2689ba3b-9fa1-4682-a350-701c0d79bc05"}]}, "os:scheduler_hints": {"group": "9860ac7e-835f-4d61-93ea-20631aca2e51"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:18.680968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] validate_networks() for [('2689ba3b-9fa1-4682-a350-701c0d79bc05', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:48:18.712168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:19.226685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:48:19.227316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:48:19.227657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:48:19.228078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:48:19.228419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:48:19.242740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=57 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:19.245241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:19.245725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:19.246492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:19.247229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:19.247685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:19.248842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:19.267065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:19.272901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:19.286870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:48:19.289428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:48:19.345325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:19.350827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:19.394889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for project b160aa19988d44c1bf69613f179d72be. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:48:19.400785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Getting quotas for user e4b73c9c96c9499fb419484a688021da and project b160aa19988d44c1bf69613f179d72be. Resources: {'server_group_members'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:48:19.433189 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72cb9be0-9324-42d3-ad44-3dbd0335ce0c tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827564 Sep 10 10:48:19.440280 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2075/2581] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:48:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:48:19.442019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50ff40da-fd2a-4534-bd11-a12739159b86 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:19.442649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50ff40da-fd2a-4534-bd11-a12739159b86 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:19.449340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ff40da-fd2a-4534-bd11-a12739159b86 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:19.449834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ff40da-fd2a-4534-bd11-a12739159b86 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:19.450272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ff40da-fd2a-4534-bd11-a12739159b86 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:19.450976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ff40da-fd2a-4534-bd11-a12739159b86 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:19.451477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ff40da-fd2a-4534-bd11-a12739159b86 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:19.451902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ff40da-fd2a-4534-bd11-a12739159b86 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:19.693011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50ff40da-fd2a-4534-bd11-a12739159b86 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:19.703652 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50ff40da-fd2a-4534-bd11-a12739159b86 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1364 microversion: 2.1 time: 0.268405 Sep 10 10:48:19.704342 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2076/2582] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:19 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1364 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:20.122749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-359bb0a9-5799-4f79-bd0f-e696a33d2f7b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:20.130260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-359bb0a9-5799-4f79-bd0f-e696a33d2f7b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Searching by: {'deleted': False, 'project_id': '005b3f77ec0d42099d1c3ae23aaa3c7c'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:48:20.146448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359bb0a9-5799-4f79-bd0f-e696a33d2f7b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:20.147634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359bb0a9-5799-4f79-bd0f-e696a33d2f7b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:20.148334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359bb0a9-5799-4f79-bd0f-e696a33d2f7b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:20.149493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359bb0a9-5799-4f79-bd0f-e696a33d2f7b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:20.150949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359bb0a9-5799-4f79-bd0f-e696a33d2f7b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:20.151639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-359bb0a9-5799-4f79-bd0f-e696a33d2f7b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:20.196294 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-359bb0a9-5799-4f79-bd0f-e696a33d2f7b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.490588 Sep 10 10:48:20.205483 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2077/2583] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:48:19 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:48:20.211272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05210e31-b627-454b-8db1-4e98afe92d3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:20.212204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05210e31-b627-454b-8db1-4e98afe92d3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:20.220936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05210e31-b627-454b-8db1-4e98afe92d3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:20.221709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05210e31-b627-454b-8db1-4e98afe92d3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:20.222148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05210e31-b627-454b-8db1-4e98afe92d3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:20.223244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05210e31-b627-454b-8db1-4e98afe92d3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:20.223768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05210e31-b627-454b-8db1-4e98afe92d3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:20.224269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05210e31-b627-454b-8db1-4e98afe92d3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:20.477153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05210e31-b627-454b-8db1-4e98afe92d3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:20.488028 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05210e31-b627-454b-8db1-4e98afe92d3b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.281142 Sep 10 10:48:20.489167 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2078/2584] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:20 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:20.494588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-34cd93f8-a2bf-4ae9-86bc-93e147e728cd tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:20.495364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-34cd93f8-a2bf-4ae9-86bc-93e147e728cd tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:20.510430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34cd93f8-a2bf-4ae9-86bc-93e147e728cd tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:20.510977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34cd93f8-a2bf-4ae9-86bc-93e147e728cd tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:20.511419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34cd93f8-a2bf-4ae9-86bc-93e147e728cd tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:20.512171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34cd93f8-a2bf-4ae9-86bc-93e147e728cd tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:20.512630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34cd93f8-a2bf-4ae9-86bc-93e147e728cd tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:20.513080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34cd93f8-a2bf-4ae9-86bc-93e147e728cd tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:20.588637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-34cd93f8-a2bf-4ae9-86bc-93e147e728cd tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:20.597762 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-34cd93f8-a2bf-4ae9-86bc-93e147e728cd tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1208 microversion: 2.1 time: 0.107324 Sep 10 10:48:20.598978 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2079/2585] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:20 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1208 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:20.613242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:20.619256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Searching by: {'deleted': False} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:48:20.625388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:20.626244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:20.626845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:20.627794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:20.628738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:20.629357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:21.103054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:48:21.194454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:21.194951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:21.195408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.000868 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6b360a61-b71a-4876-aa5d-e580ddace3c5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21228 microversion: 2.1 time: 1.400185 Sep 10 10:48:22.013551 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2080/2586] 10.222.0.20 () {58 vars in 1171 bytes} [Sat Sep 10 10:48:20 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21228 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:48:22.053291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc9496fc-1115-486a-a311-9313edbc3c5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:22.054200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc9496fc-1115-486a-a311-9313edbc3c5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:22.061382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc9496fc-1115-486a-a311-9313edbc3c5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:22.062097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc9496fc-1115-486a-a311-9313edbc3c5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:22.062713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc9496fc-1115-486a-a311-9313edbc3c5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.063567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc9496fc-1115-486a-a311-9313edbc3c5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:22.064185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc9496fc-1115-486a-a311-9313edbc3c5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:22.064763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc9496fc-1115-486a-a311-9313edbc3c5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.300601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc9496fc-1115-486a-a311-9313edbc3c5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:22.312355 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc9496fc-1115-486a-a311-9313edbc3c5f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1364 microversion: 2.1 time: 0.296807 Sep 10 10:48:22.313892 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2081/2587] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:22 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1364 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:22.320565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2a0daad-a8c3-49a1-9a4f-93a201204e2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:22.321521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2a0daad-a8c3-49a1-9a4f-93a201204e2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:22.329060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2a0daad-a8c3-49a1-9a4f-93a201204e2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:22.329716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2a0daad-a8c3-49a1-9a4f-93a201204e2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:22.330228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2a0daad-a8c3-49a1-9a4f-93a201204e2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.331123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2a0daad-a8c3-49a1-9a4f-93a201204e2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:22.331580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2a0daad-a8c3-49a1-9a4f-93a201204e2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:22.332013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2a0daad-a8c3-49a1-9a4f-93a201204e2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.571050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2a0daad-a8c3-49a1-9a4f-93a201204e2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:22.587178 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2a0daad-a8c3-49a1-9a4f-93a201204e2f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.271932 Sep 10 10:48:22.593607 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2082/2588] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:22 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:22.615521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e91a60b-d8aa-46c9-9b10-aad7486fd6e8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:22.616548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e91a60b-d8aa-46c9-9b10-aad7486fd6e8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:22.627144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e91a60b-d8aa-46c9-9b10-aad7486fd6e8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:22.628299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e91a60b-d8aa-46c9-9b10-aad7486fd6e8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:22.629033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e91a60b-d8aa-46c9-9b10-aad7486fd6e8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.630206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e91a60b-d8aa-46c9-9b10-aad7486fd6e8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:22.631108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e91a60b-d8aa-46c9-9b10-aad7486fd6e8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:22.631973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e91a60b-d8aa-46c9-9b10-aad7486fd6e8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.829901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e91a60b-d8aa-46c9-9b10-aad7486fd6e8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:22.838533 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e91a60b-d8aa-46c9-9b10-aad7486fd6e8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1270 microversion: 2.1 time: 0.242808 Sep 10 10:48:22.839177 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2083/2589] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:22 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1270 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:22.844403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76cb5e6a-15f1-4deb-b349-2474125f7905 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:22.849762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-76cb5e6a-15f1-4deb-b349-2474125f7905 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Searching by: {'deleted': False, 'project_id': '005b3f77ec0d42099d1c3ae23aaa3c7c'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:48:22.855549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cb5e6a-15f1-4deb-b349-2474125f7905 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:22.856273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cb5e6a-15f1-4deb-b349-2474125f7905 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:22.856881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cb5e6a-15f1-4deb-b349-2474125f7905 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.858482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cb5e6a-15f1-4deb-b349-2474125f7905 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:22.859087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cb5e6a-15f1-4deb-b349-2474125f7905 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:22.859694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76cb5e6a-15f1-4deb-b349-2474125f7905 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.889721 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76cb5e6a-15f1-4deb-b349-2474125f7905 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?tenant_id=a8e0700581294ce78914145c18a1a70f" status: 200 len: 15 microversion: 2.1 time: 0.049188 Sep 10 10:48:22.890298 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2084/2590] 10.222.0.20 () {58 vars in 1231 bytes} [Sat Sep 10 10:48:22 2022] GET /compute/v2.1/servers/detail?tenant_id=a8e0700581294ce78914145c18a1a70f => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:48:22.914407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:22.921680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Searching by: {'tenant_id': 'a8e0700581294ce78914145c18a1a70f', 'deleted': False} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:48:22.926945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:22.927595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:22.928136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.929216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:22.929807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:22.930339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:22.963144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:48:23.011421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:23.012080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:23.012479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:23.340733 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4bb39d75-7248-4086-8f77-6a92389937b3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a8e0700581294ce78914145c18a1a70f" status: 200 len: 4823 microversion: 2.1 time: 0.429875 Sep 10 10:48:23.357811 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2085/2591] 10.222.0.20 () {58 vars in 1257 bytes} [Sat Sep 10 10:48:22 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a8e0700581294ce78914145c18a1a70f => generated 4823 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:23.368587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f8e892a-ef43-4fd3-a028-926945f3a8ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:23.370035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f8e892a-ef43-4fd3-a028-926945f3a8ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:23.381475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:23.391795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f8e892a-ef43-4fd3-a028-926945f3a8ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:23.392310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f8e892a-ef43-4fd3-a028-926945f3a8ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:23.392745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f8e892a-ef43-4fd3-a028-926945f3a8ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:23.393509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f8e892a-ef43-4fd3-a028-926945f3a8ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:23.393966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f8e892a-ef43-4fd3-a028-926945f3a8ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:23.394404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f8e892a-ef43-4fd3-a028-926945f3a8ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:23.719227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3f8e892a-ef43-4fd3-a028-926945f3a8ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:23.731744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f8e892a-ef43-4fd3-a028-926945f3a8ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1364 microversion: 2.1 time: 0.380463 Sep 10 10:48:23.733404 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2086/2592] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:23 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1364 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:23.767353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e155bc52-6ee5-4e20-820b-c0154dff3cbb tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:23.780886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e155bc52-6ee5-4e20-820b-c0154dff3cbb tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Searching by: {'tenant_id': '005b3f77ec0d42099d1c3ae23aaa3c7c', 'deleted': False} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:48:23.786909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155bc52-6ee5-4e20-820b-c0154dff3cbb tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:23.787627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155bc52-6ee5-4e20-820b-c0154dff3cbb tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:23.788239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155bc52-6ee5-4e20-820b-c0154dff3cbb tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:23.789143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155bc52-6ee5-4e20-820b-c0154dff3cbb tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:23.789785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155bc52-6ee5-4e20-820b-c0154dff3cbb tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:23.790365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155bc52-6ee5-4e20-820b-c0154dff3cbb tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:23.819432 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e155bc52-6ee5-4e20-820b-c0154dff3cbb tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=005b3f77ec0d42099d1c3ae23aaa3c7c" status: 200 len: 15 microversion: 2.1 time: 0.084615 Sep 10 10:48:23.820324 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2087/2593] 10.222.0.20 () {58 vars in 1257 bytes} [Sat Sep 10 10:48:23 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=005b3f77ec0d42099d1c3ae23aaa3c7c => generated 15 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:48:23.825238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ba6317d9-8a02-4466-90f8-7b0d9c665b40 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:23.826788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ba6317d9-8a02-4466-90f8-7b0d9c665b40 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:23.844166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba6317d9-8a02-4466-90f8-7b0d9c665b40 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:23.845704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba6317d9-8a02-4466-90f8-7b0d9c665b40 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:23.847094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba6317d9-8a02-4466-90f8-7b0d9c665b40 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:23.848032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba6317d9-8a02-4466-90f8-7b0d9c665b40 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:23.848732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba6317d9-8a02-4466-90f8-7b0d9c665b40 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:23.849258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba6317d9-8a02-4466-90f8-7b0d9c665b40 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:24.225120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ba6317d9-8a02-4466-90f8-7b0d9c665b40 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:24.238870 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ba6317d9-8a02-4466-90f8-7b0d9c665b40 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.417333 Sep 10 10:48:24.245156 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2088/2594] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:23 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:24.255412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-61517169-d6be-4e85-aae8-e825fa98c3d2 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:24.262989 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-61517169-d6be-4e85-aae8-e825fa98c3d2 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014607 Sep 10 10:48:24.264390 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2089/2595] 10.222.0.20 () {58 vars in 1189 bytes} [Sat Sep 10 10:48:24 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:48:24.272488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bbf170e5-513b-4ff9-a05a-6eafa2689dc5 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:24.273380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bbf170e5-513b-4ff9-a05a-6eafa2689dc5 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:24.292508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbf170e5-513b-4ff9-a05a-6eafa2689dc5 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:24.293016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbf170e5-513b-4ff9-a05a-6eafa2689dc5 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:24.293494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbf170e5-513b-4ff9-a05a-6eafa2689dc5 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:24.294360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbf170e5-513b-4ff9-a05a-6eafa2689dc5 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:24.294883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbf170e5-513b-4ff9-a05a-6eafa2689dc5 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:24.295951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbf170e5-513b-4ff9-a05a-6eafa2689dc5 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:24.329029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:24.740521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bbf170e5-513b-4ff9-a05a-6eafa2689dc5 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:24.755933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bbf170e5-513b-4ff9-a05a-6eafa2689dc5 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1312 microversion: 2.1 time: 0.489357 Sep 10 10:48:24.767872 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2090/2596] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:24 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1312 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:24.775074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c6487a62-5fae-409a-a6e2-393c10b2445e req-c0c1d3dd-efd6-431c-8113-abf4c446d93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5", "name": "network-vif-plugged", "status": "completed", "tag": "a9a5c077-18b4-45a9-ab46-131e14788b74"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:24.788618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c6487a62-5fae-409a-a6e2-393c10b2445e req-c0c1d3dd-efd6-431c-8113-abf4c446d93c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:24.789374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c6487a62-5fae-409a-a6e2-393c10b2445e req-c0c1d3dd-efd6-431c-8113-abf4c446d93c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:24.789963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c6487a62-5fae-409a-a6e2-393c10b2445e req-c0c1d3dd-efd6-431c-8113-abf4c446d93c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:24.804763 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c6487a62-5fae-409a-a6e2-393c10b2445e req-c0c1d3dd-efd6-431c-8113-abf4c446d93c service nova] Creating event network-vif-plugged:a9a5c077-18b4-45a9-ab46-131e14788b74 for instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 on n-h2-856894-1 Sep 10 10:48:24.818194 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c6487a62-5fae-409a-a6e2-393c10b2445e req-c0c1d3dd-efd6-431c-8113-abf4c446d93c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048875 Sep 10 10:48:24.822934 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2091/2597] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:24.844748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac1191cf-3823-45f9-9d94-fe1e1cd31d22 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:24.862879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac1191cf-3823-45f9-9d94-fe1e1cd31d22 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:24.916442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac1191cf-3823-45f9-9d94-fe1e1cd31d22 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:24.928250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac1191cf-3823-45f9-9d94-fe1e1cd31d22 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:24.928826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac1191cf-3823-45f9-9d94-fe1e1cd31d22 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:24.929632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac1191cf-3823-45f9-9d94-fe1e1cd31d22 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:24.933395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac1191cf-3823-45f9-9d94-fe1e1cd31d22 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:24.933852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac1191cf-3823-45f9-9d94-fe1e1cd31d22 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:25.092156 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac1191cf-3823-45f9-9d94-fe1e1cd31d22 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action" status: 202 len: 0 microversion: 2.1 time: 0.266609 Sep 10 10:48:25.092810 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2092/2598] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:48:24 2022] POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:48:25.097877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a074727-7d63-4e19-961d-0209770402f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:25.101349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a074727-7d63-4e19-961d-0209770402f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:25.108337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a074727-7d63-4e19-961d-0209770402f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:25.109164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a074727-7d63-4e19-961d-0209770402f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:25.109803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a074727-7d63-4e19-961d-0209770402f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:25.110707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a074727-7d63-4e19-961d-0209770402f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:25.111338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a074727-7d63-4e19-961d-0209770402f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:25.111922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a074727-7d63-4e19-961d-0209770402f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:25.856235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a074727-7d63-4e19-961d-0209770402f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:25.874176 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a074727-7d63-4e19-961d-0209770402f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1364 microversion: 2.1 time: 0.778990 Sep 10 10:48:25.874782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2093/2599] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:25 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1364 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:25.889225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:25.894732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:25.899467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'a8e0700581294ce78914145c18a1a70f'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:48:25.913811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:25.914760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:25.915654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:25.917476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:25.922196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:25.922910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:26.098259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:48:26.198799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1bf80e07-c181-4630-a550-4929fa541a70 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers?status=error" status: 200 len: 337 microversion: 2.1 time: 0.322660 Sep 10 10:48:26.199730 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2094/2600] 10.222.0.20 () {58 vars in 1150 bytes} [Sat Sep 10 10:48:25 2022] GET /compute/v2.1/servers?status=error => generated 337 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:26.211978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-64f7f068-6789-474d-b993-1139c0e192e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:26.215066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-64f7f068-6789-474d-b993-1139c0e192e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:26.230712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64f7f068-6789-474d-b993-1139c0e192e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:26.231228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64f7f068-6789-474d-b993-1139c0e192e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:26.231680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64f7f068-6789-474d-b993-1139c0e192e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:26.232436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64f7f068-6789-474d-b993-1139c0e192e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:26.232904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64f7f068-6789-474d-b993-1139c0e192e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:26.233369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64f7f068-6789-474d-b993-1139c0e192e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:26.555010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-64f7f068-6789-474d-b993-1139c0e192e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:26.567452 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-64f7f068-6789-474d-b993-1139c0e192e1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.366476 Sep 10 10:48:26.568338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2095/2601] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:26 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:26.573973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a3e7cc84-ee8a-48ac-a4cc-f8209f9831a0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:26.574805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a3e7cc84-ee8a-48ac-a4cc-f8209f9831a0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:26.584031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e7cc84-ee8a-48ac-a4cc-f8209f9831a0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:26.584812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e7cc84-ee8a-48ac-a4cc-f8209f9831a0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:26.586761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e7cc84-ee8a-48ac-a4cc-f8209f9831a0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:26.590285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e7cc84-ee8a-48ac-a4cc-f8209f9831a0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:26.591300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e7cc84-ee8a-48ac-a4cc-f8209f9831a0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:26.591990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e7cc84-ee8a-48ac-a4cc-f8209f9831a0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:26.973557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3e7cc84-ee8a-48ac-a4cc-f8209f9831a0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:26.982888 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a3e7cc84-ee8a-48ac-a4cc-f8209f9831a0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1312 microversion: 2.1 time: 0.412806 Sep 10 10:48:26.989593 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2096/2602] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:26 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:26.994766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-176d70aa-172d-40d5-bb25-9a4ebfc2c0cd req-5d058534-6a98-477a-acf6-af6d4fc4e39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9900e5f4-b4c1-4dff-a34e-7dc78556b5d0", "tag": "1b3ae783-e4c7-4909-9a58-4c14f39508db"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:27.025702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-176d70aa-172d-40d5-bb25-9a4ebfc2c0cd req-5d058534-6a98-477a-acf6-af6d4fc4e39b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:27.027022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-176d70aa-172d-40d5-bb25-9a4ebfc2c0cd req-5d058534-6a98-477a-acf6-af6d4fc4e39b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:27.030926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-176d70aa-172d-40d5-bb25-9a4ebfc2c0cd req-5d058534-6a98-477a-acf6-af6d4fc4e39b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:27.047209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-176d70aa-172d-40d5-bb25-9a4ebfc2c0cd req-5d058534-6a98-477a-acf6-af6d4fc4e39b service nova] Creating event network-changed:1b3ae783-e4c7-4909-9a58-4c14f39508db for instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 on n-h2-856894-1 Sep 10 10:48:27.053628 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-176d70aa-172d-40d5-bb25-9a4ebfc2c0cd req-5d058534-6a98-477a-acf6-af6d4fc4e39b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061985 Sep 10 10:48:27.057710 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2097/2603] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:27.067774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-09277b0a-95c1-4e7a-b51e-87c1f261e503 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:27.076613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-09277b0a-95c1-4e7a-b51e-87c1f261e503 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:27.089115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09277b0a-95c1-4e7a-b51e-87c1f261e503 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:27.089876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09277b0a-95c1-4e7a-b51e-87c1f261e503 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:27.090548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09277b0a-95c1-4e7a-b51e-87c1f261e503 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:27.091523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09277b0a-95c1-4e7a-b51e-87c1f261e503 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:27.092404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09277b0a-95c1-4e7a-b51e-87c1f261e503 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:27.093104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09277b0a-95c1-4e7a-b51e-87c1f261e503 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:27.252717 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-09277b0a-95c1-4e7a-b51e-87c1f261e503 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action" status: 202 len: 0 microversion: 2.1 time: 0.193214 Sep 10 10:48:27.253480 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2098/2604] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:48:27 2022] POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:48:27.261987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28c6dcb9-c7f2-487a-96be-6bee2ee7e46d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:27.280997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-28c6dcb9-c7f2-487a-96be-6bee2ee7e46d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:27.291886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28c6dcb9-c7f2-487a-96be-6bee2ee7e46d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:27.292397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28c6dcb9-c7f2-487a-96be-6bee2ee7e46d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:27.292841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28c6dcb9-c7f2-487a-96be-6bee2ee7e46d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:27.293835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28c6dcb9-c7f2-487a-96be-6bee2ee7e46d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:27.294460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28c6dcb9-c7f2-487a-96be-6bee2ee7e46d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:27.295636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28c6dcb9-c7f2-487a-96be-6bee2ee7e46d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:27.612041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-28c6dcb9-c7f2-487a-96be-6bee2ee7e46d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:27.625117 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-28c6dcb9-c7f2-487a-96be-6bee2ee7e46d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1551 microversion: 2.1 time: 0.366850 Sep 10 10:48:27.627196 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2099/2605] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:27 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1551 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:27.636571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee4bb201-da49-479d-832a-beafc873b2a3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:27.637402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ee4bb201-da49-479d-832a-beafc873b2a3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:27.644399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee4bb201-da49-479d-832a-beafc873b2a3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:27.645116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee4bb201-da49-479d-832a-beafc873b2a3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:27.645616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee4bb201-da49-479d-832a-beafc873b2a3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:27.646374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee4bb201-da49-479d-832a-beafc873b2a3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:27.646891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee4bb201-da49-479d-832a-beafc873b2a3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:27.647547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee4bb201-da49-479d-832a-beafc873b2a3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:27.831175 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ee4bb201-da49-479d-832a-beafc873b2a3 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1613 microversion: 2.1 time: 0.201598 Sep 10 10:48:27.831778 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2100/2606] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:27 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1613 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:27.836547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-568e0f3a-acf9-4717-82f6-d9dced6e68f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:27.837370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-568e0f3a-acf9-4717-82f6-d9dced6e68f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:27.851529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-568e0f3a-acf9-4717-82f6-d9dced6e68f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:27.852059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-568e0f3a-acf9-4717-82f6-d9dced6e68f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:27.852506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-568e0f3a-acf9-4717-82f6-d9dced6e68f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:27.853347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-568e0f3a-acf9-4717-82f6-d9dced6e68f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:27.853701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-568e0f3a-acf9-4717-82f6-d9dced6e68f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:27.854125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-568e0f3a-acf9-4717-82f6-d9dced6e68f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:28.105614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-568e0f3a-acf9-4717-82f6-d9dced6e68f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:28.115241 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-568e0f3a-acf9-4717-82f6-d9dced6e68f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.282220 Sep 10 10:48:28.115968 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2101/2607] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:27 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:28.121438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8cef7a81-9a71-4b23-9bc7-6939ca0e6c12 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:28.122053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8cef7a81-9a71-4b23-9bc7-6939ca0e6c12 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:28.128766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cef7a81-9a71-4b23-9bc7-6939ca0e6c12 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:28.129446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cef7a81-9a71-4b23-9bc7-6939ca0e6c12 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:28.129994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cef7a81-9a71-4b23-9bc7-6939ca0e6c12 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:28.130827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cef7a81-9a71-4b23-9bc7-6939ca0e6c12 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:28.131436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cef7a81-9a71-4b23-9bc7-6939ca0e6c12 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:28.132110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cef7a81-9a71-4b23-9bc7-6939ca0e6c12 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:28.260819 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8cef7a81-9a71-4b23-9bc7-6939ca0e6c12 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143440 Sep 10 10:48:28.268736 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2102/2608] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 10:48:28 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:28.268736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-91705242-9a8d-41ad-8984-7c8f78b63b1d tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:28.268736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-91705242-9a8d-41ad-8984-7c8f78b63b1d tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:28.274633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91705242-9a8d-41ad-8984-7c8f78b63b1d tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:28.274927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91705242-9a8d-41ad-8984-7c8f78b63b1d tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:28.275363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91705242-9a8d-41ad-8984-7c8f78b63b1d tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:28.276054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91705242-9a8d-41ad-8984-7c8f78b63b1d tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:28.276505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91705242-9a8d-41ad-8984-7c8f78b63b1d tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:28.276929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91705242-9a8d-41ad-8984-7c8f78b63b1d tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:28.535150 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-91705242-9a8d-41ad-8984-7c8f78b63b1d tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1613 microversion: 2.1 time: 0.271849 Sep 10 10:48:28.536413 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2103/2609] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:28 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1613 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:28.545017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62f1025c-730f-494f-a1dc-e734dcd9fd85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:28.545940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62f1025c-730f-494f-a1dc-e734dcd9fd85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:28.558543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62f1025c-730f-494f-a1dc-e734dcd9fd85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:28.559854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62f1025c-730f-494f-a1dc-e734dcd9fd85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:28.561484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62f1025c-730f-494f-a1dc-e734dcd9fd85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:28.562963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62f1025c-730f-494f-a1dc-e734dcd9fd85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:28.563719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62f1025c-730f-494f-a1dc-e734dcd9fd85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:28.564406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62f1025c-730f-494f-a1dc-e734dcd9fd85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:28.958556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62f1025c-730f-494f-a1dc-e734dcd9fd85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:28.968698 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62f1025c-730f-494f-a1dc-e734dcd9fd85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1312 microversion: 2.1 time: 0.431016 Sep 10 10:48:28.969328 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2104/2610] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:28 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1312 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:28.992789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8cedeffd-0d3e-4e14-9d82-bebc5c9d3811 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:29.000289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8cedeffd-0d3e-4e14-9d82-bebc5c9d3811 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Searching by: {'host': 'n-h2-856894-1', 'deleted': False} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:48:29.008818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cedeffd-0d3e-4e14-9d82-bebc5c9d3811 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.009696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cedeffd-0d3e-4e14-9d82-bebc5c9d3811 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:29.010359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cedeffd-0d3e-4e14-9d82-bebc5c9d3811 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:29.011765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cedeffd-0d3e-4e14-9d82-bebc5c9d3811 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.012321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cedeffd-0d3e-4e14-9d82-bebc5c9d3811 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:29.012709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cedeffd-0d3e-4e14-9d82-bebc5c9d3811 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:29.121215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-8cedeffd-0d3e-4e14-9d82-bebc5c9d3811 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:48:29.126964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:29.210563 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8cedeffd-0d3e-4e14-9d82-bebc5c9d3811 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=n-h2-856894-1&all_tenants=1" status: 200 len: 3933 microversion: 2.1 time: 0.228661 Sep 10 10:48:29.225105 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2105/2611] 10.222.0.20 () {58 vars in 1190 bytes} [Sat Sep 10 10:48:28 2022] GET /compute/v2.1/servers?host=n-h2-856894-1&all_tenants=1 => generated 3933 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:29.225105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d65e3a6d-5d98-44cf-bed2-9316177c3b08 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:29.225105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d65e3a6d-5d98-44cf-bed2-9316177c3b08 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:29.225105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d65e3a6d-5d98-44cf-bed2-9316177c3b08 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.225105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d65e3a6d-5d98-44cf-bed2-9316177c3b08 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:29.225105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d65e3a6d-5d98-44cf-bed2-9316177c3b08 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:29.226491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d65e3a6d-5d98-44cf-bed2-9316177c3b08 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.226491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d65e3a6d-5d98-44cf-bed2-9316177c3b08 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:29.226491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d65e3a6d-5d98-44cf-bed2-9316177c3b08 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:29.540293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d65e3a6d-5d98-44cf-bed2-9316177c3b08 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:29.554249 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d65e3a6d-5d98-44cf-bed2-9316177c3b08 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.341516 Sep 10 10:48:29.555598 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2106/2612] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:29 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:29.561577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d8287bac-0171-433c-9684-cb54a36bda56 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:29.569213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d8287bac-0171-433c-9684-cb54a36bda56 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:48:29.578518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8287bac-0171-433c-9684-cb54a36bda56 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.580443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8287bac-0171-433c-9684-cb54a36bda56 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:29.581150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8287bac-0171-433c-9684-cb54a36bda56 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:29.584265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8287bac-0171-433c-9684-cb54a36bda56 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.586009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8287bac-0171-433c-9684-cb54a36bda56 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:29.586674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8287bac-0171-433c-9684-cb54a36bda56 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:29.624222 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d8287bac-0171-433c-9684-cb54a36bda56 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.067303 Sep 10 10:48:29.625552 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2107/2613] 10.222.0.20 () {58 vars in 1196 bytes} [Sat Sep 10 10:48:29 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:48:29.639808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14f4e44c-887d-47b5-b41d-0514cb88e26a tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:29.644572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14f4e44c-887d-47b5-b41d-0514cb88e26a tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:29.654686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14f4e44c-887d-47b5-b41d-0514cb88e26a tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.655697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14f4e44c-887d-47b5-b41d-0514cb88e26a tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:29.656302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14f4e44c-887d-47b5-b41d-0514cb88e26a tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:29.657283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14f4e44c-887d-47b5-b41d-0514cb88e26a tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.657840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14f4e44c-887d-47b5-b41d-0514cb88e26a tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:29.658417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14f4e44c-887d-47b5-b41d-0514cb88e26a tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:29.766009 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14f4e44c-887d-47b5-b41d-0514cb88e26a tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action" status: 202 len: 0 microversion: 2.1 time: 0.130963 Sep 10 10:48:29.770228 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2108/2614] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:48:29 2022] POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:48:29.779612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:29.783390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:29.790957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.791459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:29.792226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:29.793254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.794166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:29.794690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:29.904668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:48:29.905750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:48:29.906516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:48:29.907085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:48:29.907680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:48:29.990446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:29.999017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:29.999811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:30.000410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:30.001649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:30.002369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:30.003429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:30.044305 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fd0e08b3-5051-4aaa-8dcc-76593e132665 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action" status: 202 len: 1066 microversion: 2.1 time: 0.271990 Sep 10 10:48:30.046351 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2109/2615] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:48:29 2022] POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action => generated 1066 bytes in 275 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 10:48:30.052439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-849e1f01-525e-41e0-8f4f-9a05383cb0ca tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:30.053570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-849e1f01-525e-41e0-8f4f-9a05383cb0ca tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:30.061739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-849e1f01-525e-41e0-8f4f-9a05383cb0ca tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:30.062869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-849e1f01-525e-41e0-8f4f-9a05383cb0ca tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:30.063601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-849e1f01-525e-41e0-8f4f-9a05383cb0ca tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:30.064530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-849e1f01-525e-41e0-8f4f-9a05383cb0ca tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:30.065977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-849e1f01-525e-41e0-8f4f-9a05383cb0ca tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:30.066960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-849e1f01-525e-41e0-8f4f-9a05383cb0ca tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:30.360702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-849e1f01-525e-41e0-8f4f-9a05383cb0ca tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:30.373795 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-849e1f01-525e-41e0-8f4f-9a05383cb0ca tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1312 microversion: 2.1 time: 0.325122 Sep 10 10:48:30.377985 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2110/2616] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:30 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:30.382972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-525099e7-68fb-4ece-a9ee-2671a26f0c3a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:30.383629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-525099e7-68fb-4ece-a9ee-2671a26f0c3a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:30.405832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-525099e7-68fb-4ece-a9ee-2671a26f0c3a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:30.407179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-525099e7-68fb-4ece-a9ee-2671a26f0c3a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:30.407723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-525099e7-68fb-4ece-a9ee-2671a26f0c3a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:30.408581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-525099e7-68fb-4ece-a9ee-2671a26f0c3a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:30.409159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-525099e7-68fb-4ece-a9ee-2671a26f0c3a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:30.409779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-525099e7-68fb-4ece-a9ee-2671a26f0c3a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:30.651939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-525099e7-68fb-4ece-a9ee-2671a26f0c3a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:30.670731 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-525099e7-68fb-4ece-a9ee-2671a26f0c3a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1470 microversion: 2.1 time: 0.290878 Sep 10 10:48:30.672318 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2111/2617] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:30 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1470 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:30.682315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-fb533bd9-8315-4dd8-9324-ddf873db7f76 req-1ebb0c6f-0e60-4d3e-bd66-db20976df323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5", "tag": "a9a5c077-18b4-45a9-ab46-131e14788b74"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:30.696333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fb533bd9-8315-4dd8-9324-ddf873db7f76 req-1ebb0c6f-0e60-4d3e-bd66-db20976df323 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:30.697820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fb533bd9-8315-4dd8-9324-ddf873db7f76 req-1ebb0c6f-0e60-4d3e-bd66-db20976df323 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:30.698339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fb533bd9-8315-4dd8-9324-ddf873db7f76 req-1ebb0c6f-0e60-4d3e-bd66-db20976df323 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:30.714751 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-fb533bd9-8315-4dd8-9324-ddf873db7f76 req-1ebb0c6f-0e60-4d3e-bd66-db20976df323 service nova] Creating event network-changed:a9a5c077-18b4-45a9-ab46-131e14788b74 for instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 on n-h2-856894-1 Sep 10 10:48:30.720554 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-fb533bd9-8315-4dd8-9324-ddf873db7f76 req-1ebb0c6f-0e60-4d3e-bd66-db20976df323 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043172 Sep 10 10:48:30.721613 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2112/2618] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:30.727875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a1c048d-a423-4aa9-b3b9-decea18dbfa9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:30.728800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a1c048d-a423-4aa9-b3b9-decea18dbfa9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:30.751284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a1c048d-a423-4aa9-b3b9-decea18dbfa9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:30.752015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a1c048d-a423-4aa9-b3b9-decea18dbfa9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:30.752528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a1c048d-a423-4aa9-b3b9-decea18dbfa9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:30.753296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a1c048d-a423-4aa9-b3b9-decea18dbfa9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:30.753808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a1c048d-a423-4aa9-b3b9-decea18dbfa9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:30.754588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a1c048d-a423-4aa9-b3b9-decea18dbfa9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:31.112361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a1c048d-a423-4aa9-b3b9-decea18dbfa9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:31.121524 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a1c048d-a423-4aa9-b3b9-decea18dbfa9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.398511 Sep 10 10:48:31.126952 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2113/2619] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:30 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:31.401415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48552bf0-ebfb-4d6a-80eb-a6ef5c994bb1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:31.401992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-48552bf0-ebfb-4d6a-80eb-a6ef5c994bb1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:31.409517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48552bf0-ebfb-4d6a-80eb-a6ef5c994bb1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:31.410256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48552bf0-ebfb-4d6a-80eb-a6ef5c994bb1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:31.410855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48552bf0-ebfb-4d6a-80eb-a6ef5c994bb1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:31.411846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48552bf0-ebfb-4d6a-80eb-a6ef5c994bb1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:31.412894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48552bf0-ebfb-4d6a-80eb-a6ef5c994bb1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:31.413669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48552bf0-ebfb-4d6a-80eb-a6ef5c994bb1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:31.857839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-48552bf0-ebfb-4d6a-80eb-a6ef5c994bb1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:31.869515 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-48552bf0-ebfb-4d6a-80eb-a6ef5c994bb1 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1312 microversion: 2.1 time: 0.471893 Sep 10 10:48:31.885308 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2114/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:31 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1312 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:31.893540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cee4f4a9-a76b-4301-aa90-ca2fd46b7458 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:31.894419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cee4f4a9-a76b-4301-aa90-ca2fd46b7458 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:31.901390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee4f4a9-a76b-4301-aa90-ca2fd46b7458 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:31.902471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee4f4a9-a76b-4301-aa90-ca2fd46b7458 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:31.903086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee4f4a9-a76b-4301-aa90-ca2fd46b7458 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:31.904064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee4f4a9-a76b-4301-aa90-ca2fd46b7458 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:31.905599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee4f4a9-a76b-4301-aa90-ca2fd46b7458 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:31.906271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee4f4a9-a76b-4301-aa90-ca2fd46b7458 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:32.245530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cee4f4a9-a76b-4301-aa90-ca2fd46b7458 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:32.263129 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cee4f4a9-a76b-4301-aa90-ca2fd46b7458 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1470 microversion: 2.1 time: 0.376338 Sep 10 10:48:32.264631 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2115/2621] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:31 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:32.271700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65e1b3c0-f691-4bdb-8c50-747c85ecc334 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:32.272588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65e1b3c0-f691-4bdb-8c50-747c85ecc334 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:32.279672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e1b3c0-f691-4bdb-8c50-747c85ecc334 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:32.280548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e1b3c0-f691-4bdb-8c50-747c85ecc334 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:32.281356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e1b3c0-f691-4bdb-8c50-747c85ecc334 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:32.282181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e1b3c0-f691-4bdb-8c50-747c85ecc334 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:32.283080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e1b3c0-f691-4bdb-8c50-747c85ecc334 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:32.284046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e1b3c0-f691-4bdb-8c50-747c85ecc334 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:32.557955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-65e1b3c0-f691-4bdb-8c50-747c85ecc334 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:32.571469 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65e1b3c0-f691-4bdb-8c50-747c85ecc334 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.304838 Sep 10 10:48:32.572760 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2116/2622] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:32 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:32.897627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63d4638c-84bf-44dd-bd8f-22e672ca5c3f tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:32.898571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63d4638c-84bf-44dd-bd8f-22e672ca5c3f tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:32.909099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d4638c-84bf-44dd-bd8f-22e672ca5c3f tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:32.909968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d4638c-84bf-44dd-bd8f-22e672ca5c3f tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:32.910759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d4638c-84bf-44dd-bd8f-22e672ca5c3f tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:32.912130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d4638c-84bf-44dd-bd8f-22e672ca5c3f tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:32.913185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d4638c-84bf-44dd-bd8f-22e672ca5c3f tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:32.913864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d4638c-84bf-44dd-bd8f-22e672ca5c3f tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:33.006589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=17 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:33.307624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63d4638c-84bf-44dd-bd8f-22e672ca5c3f tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:33.336259 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63d4638c-84bf-44dd-bd8f-22e672ca5c3f tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1312 microversion: 2.1 time: 0.433435 Sep 10 10:48:33.337245 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2117/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:32 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1312 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:33.354756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65262d02-50e9-461f-9862-83c06885271e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:33.355362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65262d02-50e9-461f-9862-83c06885271e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:33.371334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65262d02-50e9-461f-9862-83c06885271e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:33.374956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65262d02-50e9-461f-9862-83c06885271e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:33.375682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65262d02-50e9-461f-9862-83c06885271e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:33.376808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65262d02-50e9-461f-9862-83c06885271e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:33.377746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65262d02-50e9-461f-9862-83c06885271e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:33.379085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65262d02-50e9-461f-9862-83c06885271e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:33.510248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-65262d02-50e9-461f-9862-83c06885271e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lazy-loading 'services' on Instance uuid a47a8a03-72e3-4db7-8e43-a1992a5f6ece {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:48:33.616996 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65262d02-50e9-461f-9862-83c06885271e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments/5066c150-ffdd-492d-9f94-a558840e6cdd" status: 202 len: 0 microversion: 2.1 time: 0.276595 Sep 10 10:48:33.618551 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2118/2624] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 10:48:33 2022] DELETE /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments/5066c150-ffdd-492d-9f94-a558840e6cdd => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:48:33.628979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-59a4d75a-160e-4154-93d2-2650981f2d43 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:33.630116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-59a4d75a-160e-4154-93d2-2650981f2d43 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:33.638896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59a4d75a-160e-4154-93d2-2650981f2d43 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:33.639745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59a4d75a-160e-4154-93d2-2650981f2d43 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:33.640420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59a4d75a-160e-4154-93d2-2650981f2d43 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:33.641450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59a4d75a-160e-4154-93d2-2650981f2d43 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:33.642178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59a4d75a-160e-4154-93d2-2650981f2d43 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:33.642897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59a4d75a-160e-4154-93d2-2650981f2d43 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:33.648926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:34.052632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-59a4d75a-160e-4154-93d2-2650981f2d43 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:34.064019 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-59a4d75a-160e-4154-93d2-2650981f2d43 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1470 microversion: 2.1 time: 0.444001 Sep 10 10:48:34.067028 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2119/2625] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:33 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1470 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:34.326632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c2cab9d-0bcf-4403-9d32-0352c25b3b4c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:34.327255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4c2cab9d-0bcf-4403-9d32-0352c25b3b4c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:34.333646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2cab9d-0bcf-4403-9d32-0352c25b3b4c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:34.334378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2cab9d-0bcf-4403-9d32-0352c25b3b4c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:34.335973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2cab9d-0bcf-4403-9d32-0352c25b3b4c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:34.336852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2cab9d-0bcf-4403-9d32-0352c25b3b4c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:34.341643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2cab9d-0bcf-4403-9d32-0352c25b3b4c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:34.342101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2cab9d-0bcf-4403-9d32-0352c25b3b4c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:34.659046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4c2cab9d-0bcf-4403-9d32-0352c25b3b4c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:34.672847 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c2cab9d-0bcf-4403-9d32-0352c25b3b4c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.602418 Sep 10 10:48:34.674228 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2120/2626] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:34 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:34.680627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e13b53af-26eb-4e85-83c2-35cb03908121 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:34.683221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e13b53af-26eb-4e85-83c2-35cb03908121 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:34.699982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e13b53af-26eb-4e85-83c2-35cb03908121 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:34.700676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e13b53af-26eb-4e85-83c2-35cb03908121 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:34.701499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e13b53af-26eb-4e85-83c2-35cb03908121 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:34.702470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e13b53af-26eb-4e85-83c2-35cb03908121 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:34.703164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e13b53af-26eb-4e85-83c2-35cb03908121 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:34.703820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e13b53af-26eb-4e85-83c2-35cb03908121 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:34.750220 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e13b53af-26eb-4e85-83c2-35cb03908121 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074414 Sep 10 10:48:34.751355 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2121/2627] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:48:34 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:34.757740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e73a5c7f-8e04-4035-9164-6b929e932114 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:34.758938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e73a5c7f-8e04-4035-9164-6b929e932114 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:34.766666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e73a5c7f-8e04-4035-9164-6b929e932114 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:34.767388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e73a5c7f-8e04-4035-9164-6b929e932114 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:34.767996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e73a5c7f-8e04-4035-9164-6b929e932114 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:34.768868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e73a5c7f-8e04-4035-9164-6b929e932114 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:34.769553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e73a5c7f-8e04-4035-9164-6b929e932114 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:34.770377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e73a5c7f-8e04-4035-9164-6b929e932114 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:35.039645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e73a5c7f-8e04-4035-9164-6b929e932114 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:35.071799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e73a5c7f-8e04-4035-9164-6b929e932114 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1312 microversion: 2.1 time: 0.318989 Sep 10 10:48:35.073978 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2122/2628] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:34 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1312 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:35.080467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-38218bd5-0ebe-412b-8f08-7aa7ecc9f452 req-93a1797e-872a-467d-a7dd-fb6ab1019e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9900e5f4-b4c1-4dff-a34e-7dc78556b5d0", "name": "network-vif-plugged", "status": "completed", "tag": "1b3ae783-e4c7-4909-9a58-4c14f39508db"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:35.123640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-38218bd5-0ebe-412b-8f08-7aa7ecc9f452 req-93a1797e-872a-467d-a7dd-fb6ab1019e29 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:35.124258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-38218bd5-0ebe-412b-8f08-7aa7ecc9f452 req-93a1797e-872a-467d-a7dd-fb6ab1019e29 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:35.127671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-38218bd5-0ebe-412b-8f08-7aa7ecc9f452 req-93a1797e-872a-467d-a7dd-fb6ab1019e29 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:35.162484 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-38218bd5-0ebe-412b-8f08-7aa7ecc9f452 req-93a1797e-872a-467d-a7dd-fb6ab1019e29 service nova] Creating event network-vif-plugged:1b3ae783-e4c7-4909-9a58-4c14f39508db for instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 on n-h2-856894-1 Sep 10 10:48:35.172570 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-38218bd5-0ebe-412b-8f08-7aa7ecc9f452 req-93a1797e-872a-467d-a7dd-fb6ab1019e29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096670 Sep 10 10:48:35.174326 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2123/2629] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:35.182892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27349fd2-d8ca-4740-a0d7-b4f891244c11 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:35.183991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-27349fd2-d8ca-4740-a0d7-b4f891244c11 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:35.204443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27349fd2-d8ca-4740-a0d7-b4f891244c11 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:35.205655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27349fd2-d8ca-4740-a0d7-b4f891244c11 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:35.206274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27349fd2-d8ca-4740-a0d7-b4f891244c11 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:35.207308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27349fd2-d8ca-4740-a0d7-b4f891244c11 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:35.211346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27349fd2-d8ca-4740-a0d7-b4f891244c11 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:35.214069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27349fd2-d8ca-4740-a0d7-b4f891244c11 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:35.525724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-27349fd2-d8ca-4740-a0d7-b4f891244c11 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:35.535522 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27349fd2-d8ca-4740-a0d7-b4f891244c11 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1470 microversion: 2.1 time: 0.359761 Sep 10 10:48:35.552830 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2124/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:35 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1470 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:35.696803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42a3d579-9cb2-4243-accf-bf69fb08bc91 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:35.697671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42a3d579-9cb2-4243-accf-bf69fb08bc91 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:35.709523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42a3d579-9cb2-4243-accf-bf69fb08bc91 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:35.710309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42a3d579-9cb2-4243-accf-bf69fb08bc91 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:35.710916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42a3d579-9cb2-4243-accf-bf69fb08bc91 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:35.711807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42a3d579-9cb2-4243-accf-bf69fb08bc91 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:35.712771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42a3d579-9cb2-4243-accf-bf69fb08bc91 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:35.713449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42a3d579-9cb2-4243-accf-bf69fb08bc91 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:35.920873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-42a3d579-9cb2-4243-accf-bf69fb08bc91 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:35.930021 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42a3d579-9cb2-4243-accf-bf69fb08bc91 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.238093 Sep 10 10:48:35.930933 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2125/2631] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:35 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:35.939216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a19cfb86-c7b5-4e6f-b4f7-4d18ec362f67 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:35.942050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a19cfb86-c7b5-4e6f-b4f7-4d18ec362f67 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:35.952786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a19cfb86-c7b5-4e6f-b4f7-4d18ec362f67 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:35.954106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a19cfb86-c7b5-4e6f-b4f7-4d18ec362f67 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:35.954707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a19cfb86-c7b5-4e6f-b4f7-4d18ec362f67 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:35.955571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a19cfb86-c7b5-4e6f-b4f7-4d18ec362f67 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:35.956182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a19cfb86-c7b5-4e6f-b4f7-4d18ec362f67 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:35.956769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a19cfb86-c7b5-4e6f-b4f7-4d18ec362f67 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:35.998910 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a19cfb86-c7b5-4e6f-b4f7-4d18ec362f67 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066868 Sep 10 10:48:35.999813 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2126/2632] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:48:35 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:36.102892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a8d1dc3-f2b4-4d83-b75a-fbff7d8107a8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:36.103632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8a8d1dc3-f2b4-4d83-b75a-fbff7d8107a8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:36.124216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8d1dc3-f2b4-4d83-b75a-fbff7d8107a8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:36.125650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8d1dc3-f2b4-4d83-b75a-fbff7d8107a8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:36.126515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8d1dc3-f2b4-4d83-b75a-fbff7d8107a8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:36.127414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8d1dc3-f2b4-4d83-b75a-fbff7d8107a8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:36.128473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8d1dc3-f2b4-4d83-b75a-fbff7d8107a8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:36.129149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a8d1dc3-f2b4-4d83-b75a-fbff7d8107a8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:36.359087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a8d1dc3-f2b4-4d83-b75a-fbff7d8107a8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:36.369933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8a8d1dc3-f2b4-4d83-b75a-fbff7d8107a8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1312 microversion: 2.1 time: 0.271415 Sep 10 10:48:36.371355 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2127/2633] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:36 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1312 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:36.559659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ff238b3-5733-418c-ad7f-5714991a913d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:36.560522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3ff238b3-5733-418c-ad7f-5714991a913d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:36.568821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ff238b3-5733-418c-ad7f-5714991a913d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:36.569544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ff238b3-5733-418c-ad7f-5714991a913d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:36.569989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ff238b3-5733-418c-ad7f-5714991a913d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:36.570699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ff238b3-5733-418c-ad7f-5714991a913d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:36.571327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ff238b3-5733-418c-ad7f-5714991a913d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:36.571928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ff238b3-5733-418c-ad7f-5714991a913d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:36.850850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3ff238b3-5733-418c-ad7f-5714991a913d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:36.865487 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3ff238b3-5733-418c-ad7f-5714991a913d tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1470 microversion: 2.1 time: 0.309431 Sep 10 10:48:36.878407 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2128/2634] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:36 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1470 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:36.956900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af1a5062-3517-434e-a5fb-0131d0bb7446 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:36.957967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-af1a5062-3517-434e-a5fb-0131d0bb7446 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:36.971115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af1a5062-3517-434e-a5fb-0131d0bb7446 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:36.971864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af1a5062-3517-434e-a5fb-0131d0bb7446 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:36.972667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af1a5062-3517-434e-a5fb-0131d0bb7446 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:36.973638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af1a5062-3517-434e-a5fb-0131d0bb7446 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:36.974634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af1a5062-3517-434e-a5fb-0131d0bb7446 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:36.975264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af1a5062-3517-434e-a5fb-0131d0bb7446 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:37.175669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-af1a5062-3517-434e-a5fb-0131d0bb7446 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:37.186272 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af1a5062-3517-434e-a5fb-0131d0bb7446 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.234913 Sep 10 10:48:37.187509 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2129/2635] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:36 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:37.192558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-925c14be-0a0d-491d-bf63-f4933751ebaf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:37.195174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-925c14be-0a0d-491d-bf63-f4933751ebaf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:37.202024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925c14be-0a0d-491d-bf63-f4933751ebaf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:37.202735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925c14be-0a0d-491d-bf63-f4933751ebaf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:37.203536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925c14be-0a0d-491d-bf63-f4933751ebaf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:37.204682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925c14be-0a0d-491d-bf63-f4933751ebaf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:37.205329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925c14be-0a0d-491d-bf63-f4933751ebaf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:37.205933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925c14be-0a0d-491d-bf63-f4933751ebaf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:37.243255 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-925c14be-0a0d-491d-bf63-f4933751ebaf tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054470 Sep 10 10:48:37.244432 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2130/2636] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:48:37 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:37.394744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec4603c4-f725-4495-8663-2fe502d4016b tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:37.395408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec4603c4-f725-4495-8663-2fe502d4016b tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:37.401682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec4603c4-f725-4495-8663-2fe502d4016b tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:37.402175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec4603c4-f725-4495-8663-2fe502d4016b tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:37.402665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec4603c4-f725-4495-8663-2fe502d4016b tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:37.403377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec4603c4-f725-4495-8663-2fe502d4016b tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:37.403901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec4603c4-f725-4495-8663-2fe502d4016b tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:37.404332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec4603c4-f725-4495-8663-2fe502d4016b tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:37.619365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec4603c4-f725-4495-8663-2fe502d4016b tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:37.635458 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec4603c4-f725-4495-8663-2fe502d4016b tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1498 microversion: 2.1 time: 0.245005 Sep 10 10:48:37.636412 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2131/2637] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:37 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1498 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:37.671781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7175685d-7796-4a61-8e4f-94dba1d783d8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:37.696541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.server_groups [None req-7175685d-7796-4a61-8e4f-94dba1d783d8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Querying cell de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) for 1 instances {{(pid=128788) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 10:48:37.697841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7175685d-7796-4a61-8e4f-94dba1d783d8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:37.698609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7175685d-7796-4a61-8e4f-94dba1d783d8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:37.699264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7175685d-7796-4a61-8e4f-94dba1d783d8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:37.744759 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7175685d-7796-4a61-8e4f-94dba1d783d8 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/9860ac7e-835f-4d61-93ea-20631aca2e51" status: 200 len: 221 microversion: 2.1 time: 0.080712 Sep 10 10:48:37.747101 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2132/2638] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:48:37 2022] GET /compute/v2.1/os-server-groups/9860ac7e-835f-4d61-93ea-20631aca2e51 => generated 221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:48:37.761294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-210aef44-60ae-4405-ac06-552dfa152cc6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:37.761808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-210aef44-60ae-4405-ac06-552dfa152cc6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:37.779731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:37.783536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-210aef44-60ae-4405-ac06-552dfa152cc6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:37.784846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-210aef44-60ae-4405-ac06-552dfa152cc6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:37.786660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-210aef44-60ae-4405-ac06-552dfa152cc6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:37.788064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-210aef44-60ae-4405-ac06-552dfa152cc6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:37.789969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-210aef44-60ae-4405-ac06-552dfa152cc6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:37.790858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-210aef44-60ae-4405-ac06-552dfa152cc6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:37.846806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-210aef44-60ae-4405-ac06-552dfa152cc6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:48:37.954339 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-210aef44-60ae-4405-ac06-552dfa152cc6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 204 len: 0 microversion: 2.1 time: 0.199887 Sep 10 10:48:37.955670 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2133/2639] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:48:37 2022] DELETE /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:48:37.962185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-01e59077-239c-4d54-989a-ee36bfc92c99 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:37.962923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-01e59077-239c-4d54-989a-ee36bfc92c99 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:37.969506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01e59077-239c-4d54-989a-ee36bfc92c99 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:37.970007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01e59077-239c-4d54-989a-ee36bfc92c99 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:37.971015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01e59077-239c-4d54-989a-ee36bfc92c99 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:37.971982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01e59077-239c-4d54-989a-ee36bfc92c99 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:37.971982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01e59077-239c-4d54-989a-ee36bfc92c99 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:37.972196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01e59077-239c-4d54-989a-ee36bfc92c99 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:38.184878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-01e59077-239c-4d54-989a-ee36bfc92c99 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:38.194567 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-01e59077-239c-4d54-989a-ee36bfc92c99 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1470 microversion: 2.1 time: 0.237483 Sep 10 10:48:38.195350 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2134/2640] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:37 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:38.199837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43d32d96-a199-4297-85ee-38d0a5815cb9 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:38.200558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-43d32d96-a199-4297-85ee-38d0a5815cb9 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:38.207623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d32d96-a199-4297-85ee-38d0a5815cb9 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:38.208026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d32d96-a199-4297-85ee-38d0a5815cb9 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:38.209935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d32d96-a199-4297-85ee-38d0a5815cb9 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:38.209935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d32d96-a199-4297-85ee-38d0a5815cb9 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:38.209935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d32d96-a199-4297-85ee-38d0a5815cb9 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:38.210224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d32d96-a199-4297-85ee-38d0a5815cb9 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:38.217196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:38.445311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-43d32d96-a199-4297-85ee-38d0a5815cb9 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:38.458960 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43d32d96-a199-4297-85ee-38d0a5815cb9 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1504 microversion: 2.1 time: 0.262640 Sep 10 10:48:38.474707 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2135/2641] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:38 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:38.485817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0586057f-bfa2-4cc9-a987-d73d4fda94f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:38.487474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0586057f-bfa2-4cc9-a987-d73d4fda94f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:38.497908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0586057f-bfa2-4cc9-a987-d73d4fda94f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:38.498671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0586057f-bfa2-4cc9-a987-d73d4fda94f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:38.499456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0586057f-bfa2-4cc9-a987-d73d4fda94f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:38.500410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0586057f-bfa2-4cc9-a987-d73d4fda94f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:38.501116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0586057f-bfa2-4cc9-a987-d73d4fda94f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:38.501756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0586057f-bfa2-4cc9-a987-d73d4fda94f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:38.707370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0586057f-bfa2-4cc9-a987-d73d4fda94f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:38.769725 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0586057f-bfa2-4cc9-a987-d73d4fda94f2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.293199 Sep 10 10:48:38.771497 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2136/2642] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:38 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:38.781090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7523f54-62a9-4044-83cb-d8d5976aa79c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:38.786872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7523f54-62a9-4044-83cb-d8d5976aa79c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:38.826878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523f54-62a9-4044-83cb-d8d5976aa79c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:38.826878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523f54-62a9-4044-83cb-d8d5976aa79c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:38.838994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523f54-62a9-4044-83cb-d8d5976aa79c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:38.839569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523f54-62a9-4044-83cb-d8d5976aa79c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:38.843731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523f54-62a9-4044-83cb-d8d5976aa79c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:38.845477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523f54-62a9-4044-83cb-d8d5976aa79c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:38.913780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7523f54-62a9-4044-83cb-d8d5976aa79c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140420 Sep 10 10:48:38.915453 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2137/2643] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:48:38 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:39.218921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5bf3ca5a-84c2-42a5-aa09-3473cf4409e6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:39.219584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5bf3ca5a-84c2-42a5-aa09-3473cf4409e6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:39.225526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bf3ca5a-84c2-42a5-aa09-3473cf4409e6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:39.226223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bf3ca5a-84c2-42a5-aa09-3473cf4409e6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:39.226768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bf3ca5a-84c2-42a5-aa09-3473cf4409e6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:39.227722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bf3ca5a-84c2-42a5-aa09-3473cf4409e6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:39.228510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bf3ca5a-84c2-42a5-aa09-3473cf4409e6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:39.229017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bf3ca5a-84c2-42a5-aa09-3473cf4409e6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:39.603876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=18 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:39.950517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5bf3ca5a-84c2-42a5-aa09-3473cf4409e6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:39.961133 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5bf3ca5a-84c2-42a5-aa09-3473cf4409e6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1470 microversion: 2.1 time: 0.746845 Sep 10 10:48:39.962266 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2138/2644] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:39 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1470 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:39.977228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c27207a2-a682-489e-951d-13b12e7f2b02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:39.977850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c27207a2-a682-489e-951d-13b12e7f2b02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:39.986929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27207a2-a682-489e-951d-13b12e7f2b02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:39.987655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27207a2-a682-489e-951d-13b12e7f2b02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:39.988273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27207a2-a682-489e-951d-13b12e7f2b02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:39.989395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27207a2-a682-489e-951d-13b12e7f2b02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:39.990195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27207a2-a682-489e-951d-13b12e7f2b02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:39.990798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27207a2-a682-489e-951d-13b12e7f2b02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:40.236414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c27207a2-a682-489e-951d-13b12e7f2b02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:40.252534 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c27207a2-a682-489e-951d-13b12e7f2b02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1504 microversion: 2.1 time: 0.289085 Sep 10 10:48:40.253364 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2139/2645] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:39 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:40.258167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-400c13ba-9b91-47e6-a208-6648dec81ea1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:40.258933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-400c13ba-9b91-47e6-a208-6648dec81ea1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:40.265454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-400c13ba-9b91-47e6-a208-6648dec81ea1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:40.265945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-400c13ba-9b91-47e6-a208-6648dec81ea1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:40.266384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-400c13ba-9b91-47e6-a208-6648dec81ea1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:40.267085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-400c13ba-9b91-47e6-a208-6648dec81ea1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:40.267541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-400c13ba-9b91-47e6-a208-6648dec81ea1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:40.267966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-400c13ba-9b91-47e6-a208-6648dec81ea1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:40.444219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-400c13ba-9b91-47e6-a208-6648dec81ea1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:40.453866 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-400c13ba-9b91-47e6-a208-6648dec81ea1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.198459 Sep 10 10:48:40.454371 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2140/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:40 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:40.470297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-03856ed1-ecc0-4570-9341-c88539cac998 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:40.479868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-03856ed1-ecc0-4570-9341-c88539cac998 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:40.488547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03856ed1-ecc0-4570-9341-c88539cac998 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:40.490226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03856ed1-ecc0-4570-9341-c88539cac998 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:40.491087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03856ed1-ecc0-4570-9341-c88539cac998 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:40.492043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03856ed1-ecc0-4570-9341-c88539cac998 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:40.492741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03856ed1-ecc0-4570-9341-c88539cac998 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:40.493702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03856ed1-ecc0-4570-9341-c88539cac998 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:40.541582 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-03856ed1-ecc0-4570-9341-c88539cac998 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085840 Sep 10 10:48:40.543083 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2141/2647] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:48:40 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:40.985456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-11019731-adf5-4ed2-a094-af713d3f52d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:40.986075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-11019731-adf5-4ed2-a094-af713d3f52d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:40.993456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11019731-adf5-4ed2-a094-af713d3f52d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:40.993941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11019731-adf5-4ed2-a094-af713d3f52d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:40.994568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11019731-adf5-4ed2-a094-af713d3f52d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:40.995266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11019731-adf5-4ed2-a094-af713d3f52d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:40.995715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11019731-adf5-4ed2-a094-af713d3f52d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:40.996330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11019731-adf5-4ed2-a094-af713d3f52d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:41.175078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-11019731-adf5-4ed2-a094-af713d3f52d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:41.182895 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-11019731-adf5-4ed2-a094-af713d3f52d7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1470 microversion: 2.1 time: 0.201379 Sep 10 10:48:41.197097 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2142/2648] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:40 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:41.278072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2b041c8-4a88-43cc-a933-6c762f618a02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:41.279553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2b041c8-4a88-43cc-a933-6c762f618a02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:41.286652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b041c8-4a88-43cc-a933-6c762f618a02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:41.287219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b041c8-4a88-43cc-a933-6c762f618a02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:41.287729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b041c8-4a88-43cc-a933-6c762f618a02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:41.288497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b041c8-4a88-43cc-a933-6c762f618a02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:41.289095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b041c8-4a88-43cc-a933-6c762f618a02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:41.289617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b041c8-4a88-43cc-a933-6c762f618a02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:41.423610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d2b041c8-4a88-43cc-a933-6c762f618a02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:41.432216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2b041c8-4a88-43cc-a933-6c762f618a02 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1504 microversion: 2.1 time: 0.158192 Sep 10 10:48:41.433451 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2143/2649] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:41 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:41.475953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e1f925c-bf55-45c4-a4e9-d3816e74b350 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:41.476571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e1f925c-bf55-45c4-a4e9-d3816e74b350 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:41.483250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e1f925c-bf55-45c4-a4e9-d3816e74b350 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:41.483754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e1f925c-bf55-45c4-a4e9-d3816e74b350 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:41.484195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e1f925c-bf55-45c4-a4e9-d3816e74b350 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:41.484909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e1f925c-bf55-45c4-a4e9-d3816e74b350 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:41.485392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e1f925c-bf55-45c4-a4e9-d3816e74b350 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:41.485818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e1f925c-bf55-45c4-a4e9-d3816e74b350 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:41.632266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e1f925c-bf55-45c4-a4e9-d3816e74b350 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:41.660645 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e1f925c-bf55-45c4-a4e9-d3816e74b350 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.188537 Sep 10 10:48:41.661295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2144/2650] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:41 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:41.689846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb4eb6f9-7459-4267-8073-f942dc350140 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:41.699626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb4eb6f9-7459-4267-8073-f942dc350140 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:41.712597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb4eb6f9-7459-4267-8073-f942dc350140 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:41.714238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb4eb6f9-7459-4267-8073-f942dc350140 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:41.714817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb4eb6f9-7459-4267-8073-f942dc350140 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:41.715834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb4eb6f9-7459-4267-8073-f942dc350140 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:41.717019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb4eb6f9-7459-4267-8073-f942dc350140 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:41.721656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb4eb6f9-7459-4267-8073-f942dc350140 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:41.773798 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb4eb6f9-7459-4267-8073-f942dc350140 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093601 Sep 10 10:48:41.774865 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2145/2651] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 10:48:41 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:48:41.882600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:41.884968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:41.891619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:41.892473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:41.892637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:41.893428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:41.894156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:41.894728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:41.932321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] HTTP exception thrown: Cannot 'reboot' instance bf615daa-1aa8-4756-8b54-041304199609 while it is in vm_state rescued Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Request method failure captured: Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609/action HTTP/1.1 Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 28 Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpHkAYnXeEeIkrvP5MU91LX1pHhCw1-X517wST7uI3nXMyFmEZF2-GrH_hD3-99qTj4dhIEoqm0d7-iBahX9spBGlFJJtEH3HGF62s1M_cLMl7ndO7Kwzn8XkzqLr7wv9Eh_FDYB9NepyfCMVt7SSvdhwxotJF7SX8u4upXel5-s6g Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52c98558e19447dfa54397d92f45dbb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0682225a07764437b25009c061ac844d Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: {"reboot": {"type": "HARD"}} Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'reboot' instance bf615daa-1aa8-4756-8b54-041304199609 while it is in vm_state rescued Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'bf615daa-1aa8-4756-8b54-041304199609', 'body': {'reboot': {'type': 'HARD'}}} Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf615daa-1aa8-4756-8b54-041304199609 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:48:41.935181 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance bf615daa-1aa8-4756-8b54-041304199609 while it is in vm_state rescued Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance bf615daa-1aa8-4756-8b54-041304199609 while it is in vm_state rescued Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Returning 409 to user: Cannot 'reboot' instance bf615daa-1aa8-4756-8b54-041304199609 while it is in vm_state rescued {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a0ff3ead-b73a-4662-a358-f0f3e23a46c3 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609/action" status: 409 len: 145 microversion: 2.1 time: 0.058122 Sep 10 10:48:41.946612 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2146/2652] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:48:41 2022] POST /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609/action => generated 145 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 10:48:41.949017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:41.952157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:41.967168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:41.968187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:41.969401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:41.971581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:41.972626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:41.973291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.025010 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] HTTP exception thrown: Cannot 'rebuild' instance bf615daa-1aa8-4756-8b54-041304199609 while it is in vm_state rescued Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Request method failure captured: Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609/action HTTP/1.1 Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 65 Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpHkAYnXeEeIkrvP5MU91LX1pHhCw1-X517wST7uI3nXMyFmEZF2-GrH_hD3-99qTj4dhIEoqm0d7-iBahX9spBGlFJJtEH3HGF62s1M_cLMl7ndO7Kwzn8XkzqLr7wv9Eh_FDYB9NepyfCMVt7SSvdhwxotJF7SX8u4upXel5-s6g Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52c98558e19447dfa54397d92f45dbb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0682225a07764437b25009c061ac844d Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'rebuild' instance bf615daa-1aa8-4756-8b54-041304199609 while it is in vm_state rescued Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'bf615daa-1aa8-4756-8b54-041304199609', 'body': {'rebuild': {'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5'}}} Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf615daa-1aa8-4756-8b54-041304199609 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:48:42.029275 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance bf615daa-1aa8-4756-8b54-041304199609 while it is in vm_state rescued Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance bf615daa-1aa8-4756-8b54-041304199609 while it is in vm_state rescued Sep 10 10:48:42.033866 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:42.037586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Returning 409 to user: Cannot 'rebuild' instance bf615daa-1aa8-4756-8b54-041304199609 while it is in vm_state rescued {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:42.038761 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-184afbab-39a7-4900-8f10-bcfc18aed980 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "POST /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609/action" status: 409 len: 146 microversion: 2.1 time: 0.095010 Sep 10 10:48:42.043763 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2147/2653] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:48:41 2022] POST /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609/action => generated 146 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:48:42.051116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac465345-d7bd-4982-832a-7efa94e632c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:42.051876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac465345-d7bd-4982-832a-7efa94e632c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:42.058788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac465345-d7bd-4982-832a-7efa94e632c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.059634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac465345-d7bd-4982-832a-7efa94e632c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.060903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac465345-d7bd-4982-832a-7efa94e632c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.061946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac465345-d7bd-4982-832a-7efa94e632c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.062647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac465345-d7bd-4982-832a-7efa94e632c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.063365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac465345-d7bd-4982-832a-7efa94e632c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.111652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac465345-d7bd-4982-832a-7efa94e632c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:48:42.226370 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac465345-d7bd-4982-832a-7efa94e632c5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 204 len: 0 microversion: 2.1 time: 0.174011 Sep 10 10:48:42.228861 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2148/2654] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:48:42 2022] DELETE /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:48:42.243705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1da45740-d753-4983-b258-839ba2136cbf tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:42.244746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1da45740-d753-4983-b258-839ba2136cbf tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:42.251098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da45740-d753-4983-b258-839ba2136cbf tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.251604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da45740-d753-4983-b258-839ba2136cbf tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.252055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da45740-d753-4983-b258-839ba2136cbf tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.252769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da45740-d753-4983-b258-839ba2136cbf tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.253428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da45740-d753-4983-b258-839ba2136cbf tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.253881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1da45740-d753-4983-b258-839ba2136cbf tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.526820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1da45740-d753-4983-b258-839ba2136cbf tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:42.540397 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1da45740-d753-4983-b258-839ba2136cbf tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1470 microversion: 2.1 time: 0.309064 Sep 10 10:48:42.543025 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2149/2655] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:42 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:42.572764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0758934-8057-43d3-951d-be1fdce88ded tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:42.574305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0758934-8057-43d3-951d-be1fdce88ded tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:42.583722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0758934-8057-43d3-951d-be1fdce88ded tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.584335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0758934-8057-43d3-951d-be1fdce88ded tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.584886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0758934-8057-43d3-951d-be1fdce88ded tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.585760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0758934-8057-43d3-951d-be1fdce88ded tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.586333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0758934-8057-43d3-951d-be1fdce88ded tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.586928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0758934-8057-43d3-951d-be1fdce88ded tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.787116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a0758934-8057-43d3-951d-be1fdce88ded tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:42.789494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:42.798296 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a0758934-8057-43d3-951d-be1fdce88ded tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1689 microversion: 2.1 time: 0.238247 Sep 10 10:48:42.799435 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2150/2656] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:42 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1689 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:42.804217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f1a2a918-c277-49ca-adbf-8b6cb745a0c2 req-6baeb3bd-5be3-4af9-8952-d984c11510a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9900e5f4-b4c1-4dff-a34e-7dc78556b5d0", "name": "network-vif-deleted", "tag": "1b3ae783-e4c7-4909-9a58-4c14f39508db"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:42.816716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f1a2a918-c277-49ca-adbf-8b6cb745a0c2 req-6baeb3bd-5be3-4af9-8952-d984c11510a2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.817407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f1a2a918-c277-49ca-adbf-8b6cb745a0c2 req-6baeb3bd-5be3-4af9-8952-d984c11510a2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.818015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f1a2a918-c277-49ca-adbf-8b6cb745a0c2 req-6baeb3bd-5be3-4af9-8952-d984c11510a2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.833045 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f1a2a918-c277-49ca-adbf-8b6cb745a0c2 req-6baeb3bd-5be3-4af9-8952-d984c11510a2 service nova] Creating event network-vif-deleted:1b3ae783-e4c7-4909-9a58-4c14f39508db for instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 on n-h2-856894-1 Sep 10 10:48:42.838751 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f1a2a918-c277-49ca-adbf-8b6cb745a0c2 req-6baeb3bd-5be3-4af9-8952-d984c11510a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037911 Sep 10 10:48:42.839682 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2151/2657] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:42.849511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8a5e887-172f-4159-9f28-d11828012fc0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:42.850454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8a5e887-172f-4159-9f28-d11828012fc0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:42.857781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a5e887-172f-4159-9f28-d11828012fc0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.858520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a5e887-172f-4159-9f28-d11828012fc0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.859123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a5e887-172f-4159-9f28-d11828012fc0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.860003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a5e887-172f-4159-9f28-d11828012fc0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.860621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a5e887-172f-4159-9f28-d11828012fc0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.861256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8a5e887-172f-4159-9f28-d11828012fc0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.932622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c8a5e887-172f-4159-9f28-d11828012fc0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:42.944022 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8a5e887-172f-4159-9f28-d11828012fc0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1462 microversion: 2.1 time: 0.098619 Sep 10 10:48:42.945064 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2152/2658] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:42 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1462 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:42.950836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbca6347-b418-45ad-b019-f15371bdba72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:42.951624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fbca6347-b418-45ad-b019-f15371bdba72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:42.958002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbca6347-b418-45ad-b019-f15371bdba72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.958730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbca6347-b418-45ad-b019-f15371bdba72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.959276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbca6347-b418-45ad-b019-f15371bdba72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:42.960160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbca6347-b418-45ad-b019-f15371bdba72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:42.960775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbca6347-b418-45ad-b019-f15371bdba72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:42.961331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbca6347-b418-45ad-b019-f15371bdba72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:43.206977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbca6347-b418-45ad-b019-f15371bdba72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:43.221818 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbca6347-b418-45ad-b019-f15371bdba72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.275451 Sep 10 10:48:43.222426 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2153/2659] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:42 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:43.572042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23d2fae6-6eb6-44de-8bd3-362fb881fde3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:43.572633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23d2fae6-6eb6-44de-8bd3-362fb881fde3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:43.579597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d2fae6-6eb6-44de-8bd3-362fb881fde3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:43.580378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d2fae6-6eb6-44de-8bd3-362fb881fde3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:43.581045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d2fae6-6eb6-44de-8bd3-362fb881fde3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:43.581993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d2fae6-6eb6-44de-8bd3-362fb881fde3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:43.582672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d2fae6-6eb6-44de-8bd3-362fb881fde3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:43.583307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d2fae6-6eb6-44de-8bd3-362fb881fde3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:43.734127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23d2fae6-6eb6-44de-8bd3-362fb881fde3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:43.744039 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23d2fae6-6eb6-44de-8bd3-362fb881fde3 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1488 microversion: 2.1 time: 0.177329 Sep 10 10:48:43.744848 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2154/2660] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:43 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1488 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:43.829584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97785806-4a43-45e1-886b-5372161bd865 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:43.830205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-97785806-4a43-45e1-886b-5372161bd865 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:43.839697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97785806-4a43-45e1-886b-5372161bd865 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:43.840254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97785806-4a43-45e1-886b-5372161bd865 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:43.840742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97785806-4a43-45e1-886b-5372161bd865 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:43.842269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97785806-4a43-45e1-886b-5372161bd865 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:43.842947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97785806-4a43-45e1-886b-5372161bd865 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:43.843440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97785806-4a43-45e1-886b-5372161bd865 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:44.053775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-97785806-4a43-45e1-886b-5372161bd865 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:44.066154 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-97785806-4a43-45e1-886b-5372161bd865 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1689 microversion: 2.1 time: 0.243460 Sep 10 10:48:44.067132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2155/2661] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:43 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:44.087526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f1182aa-4f78-4393-9297-3d1bcd02ee85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:44.088742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f1182aa-4f78-4393-9297-3d1bcd02ee85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:44.106771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f1182aa-4f78-4393-9297-3d1bcd02ee85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:44.107539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f1182aa-4f78-4393-9297-3d1bcd02ee85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:44.108164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f1182aa-4f78-4393-9297-3d1bcd02ee85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:44.109240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f1182aa-4f78-4393-9297-3d1bcd02ee85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:44.113759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f1182aa-4f78-4393-9297-3d1bcd02ee85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:44.114422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f1182aa-4f78-4393-9297-3d1bcd02ee85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:44.213421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f1182aa-4f78-4393-9297-3d1bcd02ee85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:44.222773 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f1182aa-4f78-4393-9297-3d1bcd02ee85 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1297 microversion: 2.1 time: 0.154152 Sep 10 10:48:44.223420 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2156/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:44 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1297 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:44.252390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f54e7d2-100a-444d-922c-306de0aec247 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:44.253965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f54e7d2-100a-444d-922c-306de0aec247 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:44.263278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f54e7d2-100a-444d-922c-306de0aec247 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:44.264822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f54e7d2-100a-444d-922c-306de0aec247 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:44.265769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f54e7d2-100a-444d-922c-306de0aec247 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:44.266684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f54e7d2-100a-444d-922c-306de0aec247 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:44.268093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f54e7d2-100a-444d-922c-306de0aec247 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:44.268707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f54e7d2-100a-444d-922c-306de0aec247 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:44.501777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f54e7d2-100a-444d-922c-306de0aec247 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:44.516645 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f54e7d2-100a-444d-922c-306de0aec247 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.275187 Sep 10 10:48:44.533098 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2157/2663] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:44 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:44.767936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b9d76fb-f591-43ff-8b43-093acc3f77e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:44.769555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b9d76fb-f591-43ff-8b43-093acc3f77e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:44.777761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b9d76fb-f591-43ff-8b43-093acc3f77e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:44.778509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b9d76fb-f591-43ff-8b43-093acc3f77e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:44.779120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b9d76fb-f591-43ff-8b43-093acc3f77e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:44.781028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b9d76fb-f591-43ff-8b43-093acc3f77e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:44.781678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b9d76fb-f591-43ff-8b43-093acc3f77e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:44.782211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b9d76fb-f591-43ff-8b43-093acc3f77e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:45.020916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b9d76fb-f591-43ff-8b43-093acc3f77e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:45.032262 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b9d76fb-f591-43ff-8b43-093acc3f77e7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1488 microversion: 2.1 time: 0.268145 Sep 10 10:48:45.033132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2158/2664] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:44 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1488 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:45.094283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8cff76f3-6e3c-4756-b892-93a5c3c58463 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:45.094918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8cff76f3-6e3c-4756-b892-93a5c3c58463 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:45.102753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cff76f3-6e3c-4756-b892-93a5c3c58463 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:45.103536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cff76f3-6e3c-4756-b892-93a5c3c58463 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:45.103969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cff76f3-6e3c-4756-b892-93a5c3c58463 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:45.104685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cff76f3-6e3c-4756-b892-93a5c3c58463 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:45.105195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cff76f3-6e3c-4756-b892-93a5c3c58463 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:45.105800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cff76f3-6e3c-4756-b892-93a5c3c58463 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:45.329356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8cff76f3-6e3c-4756-b892-93a5c3c58463 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:45.347082 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8cff76f3-6e3c-4756-b892-93a5c3c58463 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1689 microversion: 2.1 time: 0.257206 Sep 10 10:48:45.348372 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2159/2665] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:45 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1689 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:48:45.365185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7800bdff-8316-4032-8835-b21c0e23d273 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:45.365768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7800bdff-8316-4032-8835-b21c0e23d273 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:45.377835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7800bdff-8316-4032-8835-b21c0e23d273 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:45.378358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7800bdff-8316-4032-8835-b21c0e23d273 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:45.378805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7800bdff-8316-4032-8835-b21c0e23d273 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:45.379515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7800bdff-8316-4032-8835-b21c0e23d273 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:45.379972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7800bdff-8316-4032-8835-b21c0e23d273 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:45.380395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7800bdff-8316-4032-8835-b21c0e23d273 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:45.454991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7800bdff-8316-4032-8835-b21c0e23d273 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:45.467100 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7800bdff-8316-4032-8835-b21c0e23d273 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1297 microversion: 2.1 time: 0.117313 Sep 10 10:48:45.468871 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2160/2666] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:45 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:45.545507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-434bf319-01c6-43eb-8a8e-2648a39bf211 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:45.546571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-434bf319-01c6-43eb-8a8e-2648a39bf211 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:45.555270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-434bf319-01c6-43eb-8a8e-2648a39bf211 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:45.555939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-434bf319-01c6-43eb-8a8e-2648a39bf211 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:45.556480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-434bf319-01c6-43eb-8a8e-2648a39bf211 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:45.561855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-434bf319-01c6-43eb-8a8e-2648a39bf211 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:45.562444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-434bf319-01c6-43eb-8a8e-2648a39bf211 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:45.563120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-434bf319-01c6-43eb-8a8e-2648a39bf211 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:45.784883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-434bf319-01c6-43eb-8a8e-2648a39bf211 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:45.800076 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-434bf319-01c6-43eb-8a8e-2648a39bf211 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1477 microversion: 2.1 time: 0.260809 Sep 10 10:48:45.802065 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2161/2667] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:45 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1477 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:45.817648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3d819d60-4f63-49df-9589-c6a66a3867bf req-68e75026-ecff-42f5-8bb9-4d9ec5074d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee58542a-6b67-4a9c-877d-08388a963470", "name": "network-vif-unplugged", "status": "completed", "tag": "108704ca-0340-4f7a-85fa-f375c14063d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:45.834230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d819d60-4f63-49df-9589-c6a66a3867bf req-68e75026-ecff-42f5-8bb9-4d9ec5074d1d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:45.834998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d819d60-4f63-49df-9589-c6a66a3867bf req-68e75026-ecff-42f5-8bb9-4d9ec5074d1d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:45.835608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d819d60-4f63-49df-9589-c6a66a3867bf req-68e75026-ecff-42f5-8bb9-4d9ec5074d1d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:45.851176 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3d819d60-4f63-49df-9589-c6a66a3867bf req-68e75026-ecff-42f5-8bb9-4d9ec5074d1d service nova] Creating event network-vif-unplugged:108704ca-0340-4f7a-85fa-f375c14063d4 for instance ee58542a-6b67-4a9c-877d-08388a963470 on n-h2-856894-1 Sep 10 10:48:45.861728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-3d819d60-4f63-49df-9589-c6a66a3867bf req-68e75026-ecff-42f5-8bb9-4d9ec5074d1d service nova] Instance ee58542a-6b67-4a9c-877d-08388a963470 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 10:48:45.873430 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3d819d60-4f63-49df-9589-c6a66a3867bf req-68e75026-ecff-42f5-8bb9-4d9ec5074d1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070087 Sep 10 10:48:45.874807 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2162/2668] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:46.062583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93d5f11c-4b10-4f8d-9131-9c8c9a4bbc77 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:46.063543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93d5f11c-4b10-4f8d-9131-9c8c9a4bbc77 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:46.073851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d5f11c-4b10-4f8d-9131-9c8c9a4bbc77 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:46.076477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d5f11c-4b10-4f8d-9131-9c8c9a4bbc77 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:46.077618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d5f11c-4b10-4f8d-9131-9c8c9a4bbc77 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:46.080225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d5f11c-4b10-4f8d-9131-9c8c9a4bbc77 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:46.080701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d5f11c-4b10-4f8d-9131-9c8c9a4bbc77 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:46.081160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d5f11c-4b10-4f8d-9131-9c8c9a4bbc77 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:46.304737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93d5f11c-4b10-4f8d-9131-9c8c9a4bbc77 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:46.313943 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93d5f11c-4b10-4f8d-9131-9c8c9a4bbc77 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1488 microversion: 2.1 time: 0.256549 Sep 10 10:48:46.314540 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2163/2669] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:46 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1488 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:46.377302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6ae1729-964d-475b-919d-b280d9904c4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:46.378092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d6ae1729-964d-475b-919d-b280d9904c4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:46.385652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6ae1729-964d-475b-919d-b280d9904c4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:46.386323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6ae1729-964d-475b-919d-b280d9904c4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:46.386865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6ae1729-964d-475b-919d-b280d9904c4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:46.387726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6ae1729-964d-475b-919d-b280d9904c4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:46.388446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6ae1729-964d-475b-919d-b280d9904c4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:46.389175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6ae1729-964d-475b-919d-b280d9904c4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:46.646766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d6ae1729-964d-475b-919d-b280d9904c4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:46.660398 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6ae1729-964d-475b-919d-b280d9904c4a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1689 microversion: 2.1 time: 0.290087 Sep 10 10:48:46.663151 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2164/2670] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:46 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1689 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:46.679763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:46.692050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:46.707138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Searching by: {'deleted': False, 'project_id': '72599cbbdc464dfda19d7659518c02ff'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:48:46.720891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:46.721417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:46.721905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:46.727087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:46.728258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:46.728773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:46.778948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:48:46.834969 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ee2fe05a-38a7-4c6f-bc4d-d01b361f06fe tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.170442 Sep 10 10:48:46.835664 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2165/2671] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 10:48:46 2022] GET /compute/v2.1/servers => generated 333 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:46.862351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:46.872959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:46.885540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:46.890228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:46.898947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:46.900479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:46.901322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:46.902377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:46.958498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:46.959256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:46.960032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:46.960917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lazy-loading 'fault' on Instance uuid 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:48:47.041599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:47.051273 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-880916b3-43ec-4044-a065-1cc7e932f316 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1302 microversion: 2.1 time: 0.213501 Sep 10 10:48:47.061435 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2166/2672] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:46 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1302 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:47.066562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a0cabc9-6e17-4f1f-8aca-152677d3480c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:47.069586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a0cabc9-6e17-4f1f-8aca-152677d3480c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:47.086261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0cabc9-6e17-4f1f-8aca-152677d3480c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:47.087182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0cabc9-6e17-4f1f-8aca-152677d3480c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:47.087901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0cabc9-6e17-4f1f-8aca-152677d3480c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:47.089954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0cabc9-6e17-4f1f-8aca-152677d3480c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:47.092670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0cabc9-6e17-4f1f-8aca-152677d3480c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:47.093190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0cabc9-6e17-4f1f-8aca-152677d3480c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:47.593898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a0cabc9-6e17-4f1f-8aca-152677d3480c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:47.600358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:47.602746 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a0cabc9-6e17-4f1f-8aca-152677d3480c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1476 microversion: 2.1 time: 0.539883 Sep 10 10:48:47.603343 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2167/2673] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:47 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1476 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:47.615393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:47.629088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:47.633800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Searching by: {'deleted': False, 'project_id': '72599cbbdc464dfda19d7659518c02ff'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:48:47.647871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:47.651869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:47.652573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:47.653621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:47.656085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:47.656748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:47.730141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:48:47.851233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:47.880189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:47.880684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:47.881154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:48.182669 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8b3cbbc3-cf1b-40c1-8fd5-3010dbbaf46f tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1694 microversion: 2.1 time: 0.570939 Sep 10 10:48:48.210954 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2168/2674] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:48:47 2022] GET /compute/v2.1/servers/detail => generated 1694 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:48.217864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f6511c2-ee53-4995-aba5-686e975ff508 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:48.218926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f6511c2-ee53-4995-aba5-686e975ff508 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:48.228379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f6511c2-ee53-4995-aba5-686e975ff508 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:48.230589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f6511c2-ee53-4995-aba5-686e975ff508 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:48.232110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f6511c2-ee53-4995-aba5-686e975ff508 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:48.233150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f6511c2-ee53-4995-aba5-686e975ff508 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:48.233909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f6511c2-ee53-4995-aba5-686e975ff508 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:48.234564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f6511c2-ee53-4995-aba5-686e975ff508 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:48.548483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f6511c2-ee53-4995-aba5-686e975ff508 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:48.563671 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f6511c2-ee53-4995-aba5-686e975ff508 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1476 microversion: 2.1 time: 0.351311 Sep 10 10:48:48.564272 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2169/2675] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:48 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:48.572819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7fa6e38e-469a-4ca8-bbae-ab4fb5f925a5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:48.577991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7fa6e38e-469a-4ca8-bbae-ab4fb5f925a5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:48.585524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa6e38e-469a-4ca8-bbae-ab4fb5f925a5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:48.586380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa6e38e-469a-4ca8-bbae-ab4fb5f925a5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:48.587119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa6e38e-469a-4ca8-bbae-ab4fb5f925a5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:48.603582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa6e38e-469a-4ca8-bbae-ab4fb5f925a5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:48.608886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa6e38e-469a-4ca8-bbae-ab4fb5f925a5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:48.609688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa6e38e-469a-4ca8-bbae-ab4fb5f925a5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:48.986050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7fa6e38e-469a-4ca8-bbae-ab4fb5f925a5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:48.998118 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7fa6e38e-469a-4ca8-bbae-ab4fb5f925a5 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1689 microversion: 2.1 time: 0.432004 Sep 10 10:48:49.019266 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2170/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:48 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1689 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:49.024673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c590d8e3-c7e9-47ea-a9f4-0541bb8bde80 req-eac73aa6-a91a-4764-96aa-b9f4b8948879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0e0a60-5b09-404d-8e58-92a80dad0840", "name": "network-vif-unplugged", "status": "completed", "tag": "9150ee97-5767-40aa-ad6c-5a7df51e7439"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:49.036685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c590d8e3-c7e9-47ea-a9f4-0541bb8bde80 req-eac73aa6-a91a-4764-96aa-b9f4b8948879 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:49.037566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c590d8e3-c7e9-47ea-a9f4-0541bb8bde80 req-eac73aa6-a91a-4764-96aa-b9f4b8948879 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:49.038890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c590d8e3-c7e9-47ea-a9f4-0541bb8bde80 req-eac73aa6-a91a-4764-96aa-b9f4b8948879 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:49.052507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c590d8e3-c7e9-47ea-a9f4-0541bb8bde80 req-eac73aa6-a91a-4764-96aa-b9f4b8948879 service nova] Creating event network-vif-unplugged:9150ee97-5767-40aa-ad6c-5a7df51e7439 for instance cc0e0a60-5b09-404d-8e58-92a80dad0840 on n-h2-856894-1 Sep 10 10:48:49.061981 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c590d8e3-c7e9-47ea-a9f4-0541bb8bde80 req-eac73aa6-a91a-4764-96aa-b9f4b8948879 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041002 Sep 10 10:48:49.069286 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2171/2677] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:49.075826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:49.076633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:49.102442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:49.102995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:49.103449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:49.113838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:49.114463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:49.114914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:49.203001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:49.207832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:49.208543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:49.209216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lazy-loading 'fault' on Instance uuid 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:48:49.308876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b73c9c96c9499fb419484a688021da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b160aa19988d44c1bf69613f179d72be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:49.323398 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2eaa023e-9eef-4f01-ae69-f83b5db6a144 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 200 len: 1302 microversion: 2.1 time: 0.251904 Sep 10 10:48:49.324539 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2172/2678] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:49 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 1302 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:49.330767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-abcd7cb9-88c9-4b33-bc3f-32cafb301888 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:49.341920 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-abcd7cb9-88c9-4b33-bc3f-32cafb301888 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015726 Sep 10 10:48:49.343349 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2173/2679] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:48:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:49.348557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-70fc844d-d570-4fa8-9b0a-a7d0b1f77aab tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:49.349492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-70fc844d-d570-4fa8-9b0a-a7d0b1f77aab tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:49.362245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:49.373346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc844d-d570-4fa8-9b0a-a7d0b1f77aab tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:49.374314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc844d-d570-4fa8-9b0a-a7d0b1f77aab tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:49.374314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc844d-d570-4fa8-9b0a-a7d0b1f77aab tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:49.376210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc844d-d570-4fa8-9b0a-a7d0b1f77aab tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:49.376210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc844d-d570-4fa8-9b0a-a7d0b1f77aab tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:49.376210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70fc844d-d570-4fa8-9b0a-a7d0b1f77aab tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:50.207453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-70fc844d-d570-4fa8-9b0a-a7d0b1f77aab tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:50.217974 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-70fc844d-d570-4fa8-9b0a-a7d0b1f77aab tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1476 microversion: 2.1 time: 0.873379 Sep 10 10:48:50.218620 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2174/2680] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:49 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1476 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:50.226116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-44024cdb-8869-4bbe-919a-f22e5e054aa5 req-6bd8f7d6-9435-4c48-bf96-a44d970df653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee58542a-6b67-4a9c-877d-08388a963470", "tag": "108704ca-0340-4f7a-85fa-f375c14063d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:50.252554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-44024cdb-8869-4bbe-919a-f22e5e054aa5 req-6bd8f7d6-9435-4c48-bf96-a44d970df653 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:50.253200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-44024cdb-8869-4bbe-919a-f22e5e054aa5 req-6bd8f7d6-9435-4c48-bf96-a44d970df653 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:50.253634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-44024cdb-8869-4bbe-919a-f22e5e054aa5 req-6bd8f7d6-9435-4c48-bf96-a44d970df653 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:50.278253 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-44024cdb-8869-4bbe-919a-f22e5e054aa5 req-6bd8f7d6-9435-4c48-bf96-a44d970df653 service nova] Creating event network-changed:108704ca-0340-4f7a-85fa-f375c14063d4 for instance ee58542a-6b67-4a9c-877d-08388a963470 on n-h1-856894-1 Sep 10 10:48:50.285751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-44024cdb-8869-4bbe-919a-f22e5e054aa5 req-6bd8f7d6-9435-4c48-bf96-a44d970df653 service nova] Instance ee58542a-6b67-4a9c-877d-08388a963470 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 10:48:50.302774 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-44024cdb-8869-4bbe-919a-f22e5e054aa5 req-6bd8f7d6-9435-4c48-bf96-a44d970df653 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078354 Sep 10 10:48:50.303412 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2175/2681] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:50.310483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8014847f-37d4-4ae7-8ab2-d54460d956b5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:50.311431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8014847f-37d4-4ae7-8ab2-d54460d956b5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:50.318929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8014847f-37d4-4ae7-8ab2-d54460d956b5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:50.319524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8014847f-37d4-4ae7-8ab2-d54460d956b5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:50.319974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8014847f-37d4-4ae7-8ab2-d54460d956b5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:50.320961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8014847f-37d4-4ae7-8ab2-d54460d956b5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:50.321337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8014847f-37d4-4ae7-8ab2-d54460d956b5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:50.321770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8014847f-37d4-4ae7-8ab2-d54460d956b5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:50.657595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8014847f-37d4-4ae7-8ab2-d54460d956b5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:50.680141 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8014847f-37d4-4ae7-8ab2-d54460d956b5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1476 microversion: 2.1 time: 0.373270 Sep 10 10:48:50.681033 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2176/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:50 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:50.720090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ae8382f-680d-43ce-ac9c-9539c5f356ef tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:50.721678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6ae8382f-680d-43ce-ac9c-9539c5f356ef tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:50.737688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae8382f-680d-43ce-ac9c-9539c5f356ef tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:50.738196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae8382f-680d-43ce-ac9c-9539c5f356ef tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:50.743188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae8382f-680d-43ce-ac9c-9539c5f356ef tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:50.743890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae8382f-680d-43ce-ac9c-9539c5f356ef tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:50.747590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae8382f-680d-43ce-ac9c-9539c5f356ef tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:50.748046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae8382f-680d-43ce-ac9c-9539c5f356ef tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:50.852633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6ae8382f-680d-43ce-ac9c-9539c5f356ef tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:48:51.111622 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ae8382f-680d-43ce-ac9c-9539c5f356ef tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "DELETE /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 204 len: 0 microversion: 2.1 time: 0.400271 Sep 10 10:48:51.112885 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2177/2683] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:48:50 2022] DELETE /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:48:51.122913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:51.123961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:51.131462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:51.132257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:51.132887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:51.134199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:51.134401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:51.134696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:51.216074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:51.218289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:51.224077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:51.229365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lazy-loading 'fault' on Instance uuid a47a8a03-72e3-4db7-8e43-a1992a5f6ece {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:48:51.324281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:51.336093 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eaba3d3d-cd06-42f9-bfb3-8882ea6ca00d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1334 microversion: 2.1 time: 0.221734 Sep 10 10:48:51.339436 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2178/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:51 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1334 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:51.345515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:51.346244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:51.353284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:51.353878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:51.354552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:51.355588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:51.357044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:51.357556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:51.376506 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] HTTP exception thrown: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Request method failure captured: Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 HTTP/1.1 Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGtrps1bN00OwlGGWx3u07ELdKFxVEFUV3CzI-cSYOlf0xxaPnWfaTi446rp7ToKsgvz5ylhSOhaz6NBMQ5uCA5wWLWupqmWhXH0TSB-JWNUkQgJTuO5XAdyvXevPkPSZ8UfnDVuzsNNEoZrdl-vqmqM1x_TbNM7m1JiK7eaxkCcUaI Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b160aa19988d44c1bf69613f179d72be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e4b73c9c96c9499fb419484a688021da Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '9900e5f4-b4c1-4dff-a34e-7dc78556b5d0'} Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:51.378429 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:51.382782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:51.382782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:51.382782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:51.382782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:51.382782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:51.382782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:51.382782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:51.387698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Returning 404 to user: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:51.388898 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a436de2-bde6-4670-a67e-7de59de64a11 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 404 len: 111 microversion: 2.1 time: 0.047258 Sep 10 10:48:51.390345 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2179/2685] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:51 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:48:51.395956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6760daf-6004-4a87-9b66-0e633f0f32dc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:51.396792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e6760daf-6004-4a87-9b66-0e633f0f32dc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:51.422221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6760daf-6004-4a87-9b66-0e633f0f32dc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:51.426598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6760daf-6004-4a87-9b66-0e633f0f32dc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:51.428648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6760daf-6004-4a87-9b66-0e633f0f32dc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:51.429656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6760daf-6004-4a87-9b66-0e633f0f32dc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:51.430275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6760daf-6004-4a87-9b66-0e633f0f32dc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:51.430860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6760daf-6004-4a87-9b66-0e633f0f32dc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:51.680360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6760daf-6004-4a87-9b66-0e633f0f32dc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:51.692230 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6760daf-6004-4a87-9b66-0e633f0f32dc tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1697 microversion: 2.1 time: 0.300404 Sep 10 10:48:51.705403 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2180/2686] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:51 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1697 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:51.720548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-267fc461-d9af-4b81-92e2-6923058ddb9b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:51.723997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-267fc461-d9af-4b81-92e2-6923058ddb9b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:51.751289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267fc461-d9af-4b81-92e2-6923058ddb9b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:51.756135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267fc461-d9af-4b81-92e2-6923058ddb9b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:51.756960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267fc461-d9af-4b81-92e2-6923058ddb9b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:51.761773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267fc461-d9af-4b81-92e2-6923058ddb9b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:51.762901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267fc461-d9af-4b81-92e2-6923058ddb9b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:51.767003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267fc461-d9af-4b81-92e2-6923058ddb9b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:51.999135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-267fc461-d9af-4b81-92e2-6923058ddb9b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:52.011530 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-267fc461-d9af-4b81-92e2-6923058ddb9b tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1474 microversion: 2.1 time: 0.302286 Sep 10 10:48:52.013180 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2181/2687] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:51 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1474 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:52.024504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93399f0f-3b5d-4cc3-9f51-7a7e47dacff6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:52.083479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.server_groups [None req-93399f0f-3b5d-4cc3-9f51-7a7e47dacff6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Querying cell de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) for 1 instances {{(pid=128788) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 10:48:52.084226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93399f0f-3b5d-4cc3-9f51-7a7e47dacff6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:52.085019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93399f0f-3b5d-4cc3-9f51-7a7e47dacff6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:52.085683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93399f0f-3b5d-4cc3-9f51-7a7e47dacff6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:52.141538 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93399f0f-3b5d-4cc3-9f51-7a7e47dacff6 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.125590 Sep 10 10:48:52.142308 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2182/2688] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:48:52 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:52.146732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f6c8f3a-020c-4670-b6ac-6125bcd16083 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:52.147331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f6c8f3a-020c-4670-b6ac-6125bcd16083 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:52.161422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f6c8f3a-020c-4670-b6ac-6125bcd16083 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:52.162079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f6c8f3a-020c-4670-b6ac-6125bcd16083 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:52.162607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f6c8f3a-020c-4670-b6ac-6125bcd16083 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:52.163323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f6c8f3a-020c-4670-b6ac-6125bcd16083 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:52.163785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f6c8f3a-020c-4670-b6ac-6125bcd16083 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:52.164211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f6c8f3a-020c-4670-b6ac-6125bcd16083 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:52.806767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f6c8f3a-020c-4670-b6ac-6125bcd16083 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:52.820341 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f6c8f3a-020c-4670-b6ac-6125bcd16083 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1476 microversion: 2.1 time: 0.675332 Sep 10 10:48:52.822132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2183/2689] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:52 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1476 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:52.833480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7eaa9446-e581-4451-a170-0d0365c960cf tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:52.920372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.server_groups [None req-7eaa9446-e581-4451-a170-0d0365c960cf tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Querying cell de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) for 1 instances {{(pid=128788) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 10:48:52.921144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7eaa9446-e581-4451-a170-0d0365c960cf tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:52.921638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7eaa9446-e581-4451-a170-0d0365c960cf tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:52.928195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7eaa9446-e581-4451-a170-0d0365c960cf tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:52.977209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7eaa9446-e581-4451-a170-0d0365c960cf tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/9860ac7e-835f-4d61-93ea-20631aca2e51" status: 200 len: 183 microversion: 2.1 time: 0.149431 Sep 10 10:48:52.977818 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2184/2690] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:48:52 2022] GET /compute/v2.1/os-server-groups/9860ac7e-835f-4d61-93ea-20631aca2e51 => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:52.989877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a80fcf08-940e-4c65-aee2-b23d17b0b0e4 req-a0e41b2a-0e26-446f-a0be-f6f75431671a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0e0a60-5b09-404d-8e58-92a80dad0840", "name": "network-vif-plugged", "status": "completed", "tag": "9150ee97-5767-40aa-ad6c-5a7df51e7439"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:53.011421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a80fcf08-940e-4c65-aee2-b23d17b0b0e4 req-a0e41b2a-0e26-446f-a0be-f6f75431671a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:53.015151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a80fcf08-940e-4c65-aee2-b23d17b0b0e4 req-a0e41b2a-0e26-446f-a0be-f6f75431671a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:53.017647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a80fcf08-940e-4c65-aee2-b23d17b0b0e4 req-a0e41b2a-0e26-446f-a0be-f6f75431671a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:53.058875 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a80fcf08-940e-4c65-aee2-b23d17b0b0e4 req-a0e41b2a-0e26-446f-a0be-f6f75431671a service nova] Creating event network-vif-plugged:9150ee97-5767-40aa-ad6c-5a7df51e7439 for instance cc0e0a60-5b09-404d-8e58-92a80dad0840 on n-h2-856894-1 Sep 10 10:48:53.069770 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a80fcf08-940e-4c65-aee2-b23d17b0b0e4 req-a0e41b2a-0e26-446f-a0be-f6f75431671a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090219 Sep 10 10:48:53.070721 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2185/2691] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:53.076809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:53.077541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:53.101912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:53.102517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:53.103157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:53.104078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:53.104699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:53.105322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:53.110818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:53.188126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:53.188621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:53.189058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:53.189536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lazy-loading 'fault' on Instance uuid a47a8a03-72e3-4db7-8e43-a1992a5f6ece {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:48:53.365414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:53.378373 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2adb8145-879a-4bda-8b3e-607791607a3e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 200 len: 1334 microversion: 2.1 time: 0.306291 Sep 10 10:48:53.379165 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2186/2692] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:53 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 1334 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:53.391939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b7da3e89-8de2-40cf-9d45-2bb31307d916 req-c1e9114b-f836-4517-85b7-b699786d86ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47a8a03-72e3-4db7-8e43-a1992a5f6ece", "name": "network-vif-deleted", "tag": "d82ae4f2-aa8d-42e7-9522-1732c70f4f3a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:53.415784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b7da3e89-8de2-40cf-9d45-2bb31307d916 req-c1e9114b-f836-4517-85b7-b699786d86ec service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:53.417720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b7da3e89-8de2-40cf-9d45-2bb31307d916 req-c1e9114b-f836-4517-85b7-b699786d86ec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:53.420463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b7da3e89-8de2-40cf-9d45-2bb31307d916 req-c1e9114b-f836-4517-85b7-b699786d86ec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:53.451637 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b7da3e89-8de2-40cf-9d45-2bb31307d916 req-c1e9114b-f836-4517-85b7-b699786d86ec service nova] Creating event network-vif-deleted:d82ae4f2-aa8d-42e7-9522-1732c70f4f3a for instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece on n-h2-856894-1 Sep 10 10:48:53.462370 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b7da3e89-8de2-40cf-9d45-2bb31307d916 req-c1e9114b-f836-4517-85b7-b699786d86ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076276 Sep 10 10:48:53.467307 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2187/2693] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:53.478288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a00fff9f-d269-4a04-9e72-c518105081e8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:53.483083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a00fff9f-d269-4a04-9e72-c518105081e8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:53.497427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a00fff9f-d269-4a04-9e72-c518105081e8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:53.498288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a00fff9f-d269-4a04-9e72-c518105081e8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:53.498916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a00fff9f-d269-4a04-9e72-c518105081e8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:53.499889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a00fff9f-d269-4a04-9e72-c518105081e8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:53.500546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a00fff9f-d269-4a04-9e72-c518105081e8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:53.501176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a00fff9f-d269-4a04-9e72-c518105081e8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:54.165958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a00fff9f-d269-4a04-9e72-c518105081e8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:54.191836 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a00fff9f-d269-4a04-9e72-c518105081e8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1697 microversion: 2.1 time: 0.722891 Sep 10 10:48:54.218543 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2188/2694] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:53 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1697 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:54.226474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:54.233153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:54.246646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:54.252599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:54.253283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:54.255882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:54.256538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:54.257506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:54.280782 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] HTTP exception thrown: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Request method failure captured: Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 HTTP/1.1 Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGtrps1bN00OwlGGWx3u07ELdKFxVEFUV3CzI-cSYOlf0xxaPnWfaTi446rp7ToKsgvz5ylhSOhaz6NBMQ5uCA5wWLWupqmWhXH0TSB-JWNUkQgJTuO5XAdyvXevPkPSZ8UfnDVuzsNNEoZrdl-vqmqM1x_TbNM7m1JiK7eaxkCcUaI Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b160aa19988d44c1bf69613f179d72be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e4b73c9c96c9499fb419484a688021da Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '9900e5f4-b4c1-4dff-a34e-7dc78556b5d0'} Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:48:54.283239 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:54.287724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:54.293320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Returning 404 to user: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:54.295434 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf88067d-8f84-4e96-bc69-1b6a8697ff25 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 404 len: 111 microversion: 2.1 time: 0.074412 Sep 10 10:48:54.296216 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2189/2695] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:48:54 2022] DELETE /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:48:54.302099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76d3be75-aac1-447e-a70a-2f0480645520 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:54.305021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-76d3be75-aac1-447e-a70a-2f0480645520 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:54.312444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76d3be75-aac1-447e-a70a-2f0480645520 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:54.313342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76d3be75-aac1-447e-a70a-2f0480645520 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:54.314432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76d3be75-aac1-447e-a70a-2f0480645520 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:54.315552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76d3be75-aac1-447e-a70a-2f0480645520 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:54.316246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76d3be75-aac1-447e-a70a-2f0480645520 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:54.316877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76d3be75-aac1-447e-a70a-2f0480645520 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:54.632614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76d3be75-aac1-447e-a70a-2f0480645520 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:54.641241 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76d3be75-aac1-447e-a70a-2f0480645520 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1471 microversion: 2.1 time: 0.343675 Sep 10 10:48:54.641818 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2190/2696] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:54 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:54.652932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a66613cf-8b36-4361-b18b-9aa0b1c45d16 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:54.655945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a66613cf-8b36-4361-b18b-9aa0b1c45d16 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:54.664147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66613cf-8b36-4361-b18b-9aa0b1c45d16 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:54.665087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66613cf-8b36-4361-b18b-9aa0b1c45d16 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:54.665687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66613cf-8b36-4361-b18b-9aa0b1c45d16 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:54.666643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66613cf-8b36-4361-b18b-9aa0b1c45d16 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:54.667274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66613cf-8b36-4361-b18b-9aa0b1c45d16 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:54.668024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66613cf-8b36-4361-b18b-9aa0b1c45d16 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:55.388981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a66613cf-8b36-4361-b18b-9aa0b1c45d16 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:55.407599 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a66613cf-8b36-4361-b18b-9aa0b1c45d16 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1476 microversion: 2.1 time: 0.760049 Sep 10 10:48:55.408254 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2191/2697] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:54 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1476 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:55.442433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:55.443079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] [instance: 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:55.480117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:55.480663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:55.481695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:55.482851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:55.482979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:55.495637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:55.542231 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] HTTP exception thrown: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Request method failure captured: Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 HTTP/1.1 Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGtrps1bN00OwlGGWx3u07ELdKFxVEFUV3CzI-cSYOlf0xxaPnWfaTi446rp7ToKsgvz5ylhSOhaz6NBMQ5uCA5wWLWupqmWhXH0TSB-JWNUkQgJTuO5XAdyvXevPkPSZ8UfnDVuzsNNEoZrdl-vqmqM1x_TbNM7m1JiK7eaxkCcUaI Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b160aa19988d44c1bf69613f179d72be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e4b73c9c96c9499fb419484a688021da Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '9900e5f4-b4c1-4dff-a34e-7dc78556b5d0'} Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:55.544365 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:55.548497 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:55.548497 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:55.548497 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:55.548497 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:55.548497 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:55.548497 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. Sep 10 10:48:55.548497 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:55.548497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Returning 404 to user: Instance 9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:55.566937 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41d1da59-a410-4c72-bb6f-b4b43e7c79ab tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0" status: 404 len: 111 microversion: 2.1 time: 0.138233 Sep 10 10:48:55.568955 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2192/2698] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:55 2022] GET /compute/v2.1/servers/9900e5f4-b4c1-4dff-a34e-7dc78556b5d0 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:48:55.591288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:55.594116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: a47a8a03-72e3-4db7-8e43-a1992a5f6ece] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:55.612021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:55.614091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:55.615508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:55.618273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:55.619600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:55.621854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:55.669834 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] HTTP exception thrown: Instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece could not be found. Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Request method failure captured: Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece HTTP/1.1 Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpHkAYnXeEeIkrvP5MU91LX1pHhCw1-X517wST7uI3nXMyFmEZF2-GrH_hD3-99qTj4dhIEoqm0d7-iBahX9spBGlFJJtEH3HGF62s1M_cLMl7ndO7Kwzn8XkzqLr7wv9Eh_FDYB9NepyfCMVt7SSvdhwxotJF7SX8u4upXel5-s6g Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52c98558e19447dfa54397d92f45dbb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0682225a07764437b25009c061ac844d Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece could not be found. Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'a47a8a03-72e3-4db7-8e43-a1992a5f6ece'} Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece could not be found. Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece could not be found. Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:55.673873 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:55.677889 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:55.677889 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:55.677889 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:55.677889 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:55.677889 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:55.677889 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:55.677889 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece could not be found. Sep 10 10:48:55.677889 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:55.682741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Returning 404 to user: Instance a47a8a03-72e3-4db7-8e43-a1992a5f6ece could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:55.684216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9506ef1f-bd42-400e-b082-470bf6c96a9c tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece" status: 404 len: 111 microversion: 2.1 time: 0.113942 Sep 10 10:48:55.686988 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2193/2699] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:55 2022] GET /compute/v2.1/servers/a47a8a03-72e3-4db7-8e43-a1992a5f6ece => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:48:55.700683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db9e1e98-96a8-46fc-95e2-47cb62cce01c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:55.704295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db9e1e98-96a8-46fc-95e2-47cb62cce01c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:55.718584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9e1e98-96a8-46fc-95e2-47cb62cce01c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:55.719457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9e1e98-96a8-46fc-95e2-47cb62cce01c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:55.720815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9e1e98-96a8-46fc-95e2-47cb62cce01c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:55.723454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9e1e98-96a8-46fc-95e2-47cb62cce01c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:55.724327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9e1e98-96a8-46fc-95e2-47cb62cce01c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:55.725802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9e1e98-96a8-46fc-95e2-47cb62cce01c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:55.933522 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db9e1e98-96a8-46fc-95e2-47cb62cce01c tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "POST /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470/action" status: 202 len: 0 microversion: 2.1 time: 0.243799 Sep 10 10:48:55.937418 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2194/2700] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:48:55 2022] POST /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:48:55.953564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0ea8638a-c672-4d79-8815-8ab2391d8a4f req-50b0254e-041f-4b7c-83ea-d2d2db64ff23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee58542a-6b67-4a9c-877d-08388a963470", "name": "network-vif-plugged", "status": "completed", "tag": "108704ca-0340-4f7a-85fa-f375c14063d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:55.978758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0ea8638a-c672-4d79-8815-8ab2391d8a4f req-50b0254e-041f-4b7c-83ea-d2d2db64ff23 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:55.979983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0ea8638a-c672-4d79-8815-8ab2391d8a4f req-50b0254e-041f-4b7c-83ea-d2d2db64ff23 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:55.980858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0ea8638a-c672-4d79-8815-8ab2391d8a4f req-50b0254e-041f-4b7c-83ea-d2d2db64ff23 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:55.995768 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0ea8638a-c672-4d79-8815-8ab2391d8a4f req-50b0254e-041f-4b7c-83ea-d2d2db64ff23 service nova] Creating event network-vif-plugged:108704ca-0340-4f7a-85fa-f375c14063d4 for instance ee58542a-6b67-4a9c-877d-08388a963470 on n-h1-856894-1 Sep 10 10:48:56.003078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-0ea8638a-c672-4d79-8815-8ab2391d8a4f req-50b0254e-041f-4b7c-83ea-d2d2db64ff23 service nova] Instance ee58542a-6b67-4a9c-877d-08388a963470 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 10:48:56.016722 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0ea8638a-c672-4d79-8815-8ab2391d8a4f req-50b0254e-041f-4b7c-83ea-d2d2db64ff23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075995 Sep 10 10:48:56.018432 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2195/2701] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:56.024839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:56.025942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:56.035822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:56.036554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:56.037379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:56.039216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:56.039984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:56.040871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:56.084776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:56.085421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:56.085953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:56.086527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lazy-loading 'fault' on Instance uuid 715a034b-25ef-4c28-bff9-7843175d473f {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:48:56.162325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e056c746024ae59524e4ddf7d529d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72599cbbdc464dfda19d7659518c02ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:56.177164 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2df78df3-ced8-4b51-a082-ab2531b0d09c tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 200 len: 1356 microversion: 2.1 time: 0.152699 Sep 10 10:48:56.193020 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2196/2702] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:56 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:56.193020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2869be19-5c94-4a57-96cc-a67c0b0d2cb0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:56.204428 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2869be19-5c94-4a57-96cc-a67c0b0d2cb0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] HTTP exception thrown: Instance group db80e217-7e49-47a5-a5d2-af206d25b074 could not be found. Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2869be19-5c94-4a57-96cc-a67c0b0d2cb0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Request method failure captured: Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-server-groups/db80e217-7e49-47a5-a5d2-af206d25b074 HTTP/1.1 Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGtrps1bN00OwlGGWx3u07ELdKFxVEFUV3CzI-cSYOlf0xxaPnWfaTi446rp7ToKsgvz5ylhSOhaz6NBMQ5uCA5wWLWupqmWhXH0TSB-JWNUkQgJTuO5XAdyvXevPkPSZ8UfnDVuzsNNEoZrdl-vqmqM1x_TbNM7m1JiK7eaxkCcUaI Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b160aa19988d44c1bf69613f179d72be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e4b73c9c96c9499fb419484a688021da Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance group db80e217-7e49-47a5-a5d2-af206d25b074 could not be found. Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'db80e217-7e49-47a5-a5d2-af206d25b074'} Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group db80e217-7e49-47a5-a5d2-af206d25b074 could not be found. Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group db80e217-7e49-47a5-a5d2-af206d25b074 could not be found. Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:56.216045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:56.221885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:56.221885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:56.221885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:56.221885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:56.221885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group db80e217-7e49-47a5-a5d2-af206d25b074 could not be found. Sep 10 10:48:56.221885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:56.221885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2869be19-5c94-4a57-96cc-a67c0b0d2cb0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Returning 404 to user: Instance group db80e217-7e49-47a5-a5d2-af206d25b074 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:56.221885 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2869be19-5c94-4a57-96cc-a67c0b0d2cb0 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/db80e217-7e49-47a5-a5d2-af206d25b074" status: 404 len: 117 microversion: 2.1 time: 0.040201 Sep 10 10:48:56.221885 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2197/2703] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:48:56 2022] DELETE /compute/v2.1/os-server-groups/db80e217-7e49-47a5-a5d2-af206d25b074 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:48:56.229649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22766ce7-6385-430a-b80a-cd5f9bba33dd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '.version_select at 0x7efcae96faf0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:56.275081 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-22766ce7-6385-430a-b80a-cd5f9bba33dd tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-824773763" status: 202 len: 0 microversion: 2.1 time: 0.054243 Sep 10 10:48:56.275895 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2198/2704] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Sep 10 10:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-824773763 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:48:56.299387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-31455c60-39a9-4565-b0ea-221e2c3529d2 req-9db40162-9524-4833-bb2d-6449739bad8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "715a034b-25ef-4c28-bff9-7843175d473f", "name": "network-vif-deleted", "tag": "1a59a894-6b66-4f8a-82af-b9f60f5f1e38"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:56.324629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-31455c60-39a9-4565-b0ea-221e2c3529d2 req-9db40162-9524-4833-bb2d-6449739bad8c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:56.328383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-31455c60-39a9-4565-b0ea-221e2c3529d2 req-9db40162-9524-4833-bb2d-6449739bad8c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:56.330593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-31455c60-39a9-4565-b0ea-221e2c3529d2 req-9db40162-9524-4833-bb2d-6449739bad8c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:56.352769 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-31455c60-39a9-4565-b0ea-221e2c3529d2 req-9db40162-9524-4833-bb2d-6449739bad8c service nova] Creating event network-vif-deleted:1a59a894-6b66-4f8a-82af-b9f60f5f1e38 for instance 715a034b-25ef-4c28-bff9-7843175d473f on n-h2-856894-1 Sep 10 10:48:56.372395 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-31455c60-39a9-4565-b0ea-221e2c3529d2 req-9db40162-9524-4833-bb2d-6449739bad8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094802 Sep 10 10:48:56.376459 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2199/2705] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:48:56.388220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac42ce87-50ca-4767-aa41-4c231514ac3f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:56.389764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac42ce87-50ca-4767-aa41-4c231514ac3f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:56.400247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac42ce87-50ca-4767-aa41-4c231514ac3f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:56.401031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac42ce87-50ca-4767-aa41-4c231514ac3f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:56.401772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac42ce87-50ca-4767-aa41-4c231514ac3f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:56.402698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac42ce87-50ca-4767-aa41-4c231514ac3f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:56.403885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac42ce87-50ca-4767-aa41-4c231514ac3f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:56.416079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac42ce87-50ca-4767-aa41-4c231514ac3f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:56.834625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ac42ce87-50ca-4767-aa41-4c231514ac3f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:56.852449 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac42ce87-50ca-4767-aa41-4c231514ac3f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1470 microversion: 2.1 time: 0.473977 Sep 10 10:48:56.853170 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2200/2706] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:56 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:56.900667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7183be4b-650b-4dd0-b906-c8168c125846 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:56.908632 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-7183be4b-650b-4dd0-b906-c8168c125846 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] HTTP exception thrown: Instance group 84bc24a2-01cf-4765-90fc-d0bf71bef860 could not be found. Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7183be4b-650b-4dd0-b906-c8168c125846 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Request method failure captured: Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-server-groups/84bc24a2-01cf-4765-90fc-d0bf71bef860 HTTP/1.1 Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGtrps1bN00OwlGGWx3u07ELdKFxVEFUV3CzI-cSYOlf0xxaPnWfaTi446rp7ToKsgvz5ylhSOhaz6NBMQ5uCA5wWLWupqmWhXH0TSB-JWNUkQgJTuO5XAdyvXevPkPSZ8UfnDVuzsNNEoZrdl-vqmqM1x_TbNM7m1JiK7eaxkCcUaI Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b160aa19988d44c1bf69613f179d72be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e4b73c9c96c9499fb419484a688021da Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance group 84bc24a2-01cf-4765-90fc-d0bf71bef860 could not be found. Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '84bc24a2-01cf-4765-90fc-d0bf71bef860'} Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 84bc24a2-01cf-4765-90fc-d0bf71bef860 could not be found. Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 84bc24a2-01cf-4765-90fc-d0bf71bef860 could not be found. Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:56.910601 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:56.914933 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:56.914933 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:56.914933 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:56.914933 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:56.914933 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 84bc24a2-01cf-4765-90fc-d0bf71bef860 could not be found. Sep 10 10:48:56.914933 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:56.919076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7183be4b-650b-4dd0-b906-c8168c125846 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Returning 404 to user: Instance group 84bc24a2-01cf-4765-90fc-d0bf71bef860 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:56.920551 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7183be4b-650b-4dd0-b906-c8168c125846 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/84bc24a2-01cf-4765-90fc-d0bf71bef860" status: 404 len: 117 microversion: 2.1 time: 0.057314 Sep 10 10:48:56.925661 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2201/2707] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:48:56 2022] DELETE /compute/v2.1/os-server-groups/84bc24a2-01cf-4765-90fc-d0bf71bef860 => generated 117 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:48:56.928687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28e2fff8-9194-4651-8f67-b166e3c22897 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:56.929523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-28e2fff8-9194-4651-8f67-b166e3c22897 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:56.942276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28e2fff8-9194-4651-8f67-b166e3c22897 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:56.943593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28e2fff8-9194-4651-8f67-b166e3c22897 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:56.944302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28e2fff8-9194-4651-8f67-b166e3c22897 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:56.945551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28e2fff8-9194-4651-8f67-b166e3c22897 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:56.946390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28e2fff8-9194-4651-8f67-b166e3c22897 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:56.948711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28e2fff8-9194-4651-8f67-b166e3c22897 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:57.310562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-28e2fff8-9194-4651-8f67-b166e3c22897 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:57.329678 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-28e2fff8-9194-4651-8f67-b166e3c22897 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1462 microversion: 2.1 time: 0.406379 Sep 10 10:48:57.330811 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2202/2708] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:56 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1462 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:57.335690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9b147a1-2764-4dd0-bf3b-acf77129ad68 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:57.346376 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f9b147a1-2764-4dd0-bf3b-acf77129ad68 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] HTTP exception thrown: Instance group f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f could not be found. Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9b147a1-2764-4dd0-bf3b-acf77129ad68 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Request method failure captured: Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-server-groups/f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f HTTP/1.1 Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGtrps1bN00OwlGGWx3u07ELdKFxVEFUV3CzI-cSYOlf0xxaPnWfaTi446rp7ToKsgvz5ylhSOhaz6NBMQ5uCA5wWLWupqmWhXH0TSB-JWNUkQgJTuO5XAdyvXevPkPSZ8UfnDVuzsNNEoZrdl-vqmqM1x_TbNM7m1JiK7eaxkCcUaI Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b160aa19988d44c1bf69613f179d72be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e4b73c9c96c9499fb419484a688021da Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance group f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f could not be found. Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f'} Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f could not be found. Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f could not be found. Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.350123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:57.354211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:57.354211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:57.354211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:57.354211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:57.354211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f could not be found. Sep 10 10:48:57.354211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.356467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9b147a1-2764-4dd0-bf3b-acf77129ad68 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Returning 404 to user: Instance group f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:57.357534 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f9b147a1-2764-4dd0-bf3b-acf77129ad68 tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f" status: 404 len: 117 microversion: 2.1 time: 0.025786 Sep 10 10:48:57.358123 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2203/2709] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:48:57 2022] DELETE /compute/v2.1/os-server-groups/f9a290da-f7f1-4dd9-9d4b-058a3fc19c5f => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:48:57.362756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:57.363571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] [instance: 715a034b-25ef-4c28-bff9-7843175d473f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:57.374918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:57.375706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:57.376064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:57.376947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:57.377622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:57.378456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:57.393614 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] HTTP exception thrown: Instance 715a034b-25ef-4c28-bff9-7843175d473f could not be found. Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Request method failure captured: Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f HTTP/1.1 Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGs3RvPQsVhRa5sKLMDLLrBz-8i_O_nTbBoTT89mx7e0rsLhrfRdp8xd_wMJnBDSI893hEx9Re9QaLYs6XAL6t_En5I-DeWEEYlxLKPcCF68OITmLAo_xrMNB3kNauoIqgKxYaE_pYL6zcvPqbyOxMr3hnNoKqGOZKiNsiF5Oq33DGk Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 72599cbbdc464dfda19d7659518c02ff Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-575987561 Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72599cbbdc464dfda19d7659518c02ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72599cbbdc464dfda19d7659518c02ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72599cbbdc464dfda19d7659518c02ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72599cbbdc464dfda19d7659518c02ff", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-575987561 Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 72599cbbdc464dfda19d7659518c02ff Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-575987561 Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-575987561-project Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 90e056c746024ae59524e4ddf7d529d7 Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-575987561-project Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 715a034b-25ef-4c28-bff9-7843175d473f could not be found. Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '715a034b-25ef-4c28-bff9-7843175d473f'} Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 715a034b-25ef-4c28-bff9-7843175d473f could not be found. Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 715a034b-25ef-4c28-bff9-7843175d473f could not be found. Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.396118 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:57.400465 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:57.400465 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:57.400465 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:57.400465 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:57.400465 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 715a034b-25ef-4c28-bff9-7843175d473f could not be found. Sep 10 10:48:57.400465 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.402976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Returning 404 to user: Instance 715a034b-25ef-4c28-bff9-7843175d473f could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:57.404076 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-49530cb0-e280-4d16-ad9c-23cd865eb0a9 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f" status: 404 len: 111 microversion: 2.1 time: 0.045041 Sep 10 10:48:57.405445 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2204/2710] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:57 2022] GET /compute/v2.1/servers/715a034b-25ef-4c28-bff9-7843175d473f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:48:57.410306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e2c951f-3c5a-4deb-bb6b-cd431b1fbffc tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:57.411174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e2c951f-3c5a-4deb-bb6b-cd431b1fbffc tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:57.417572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e2c951f-3c5a-4deb-bb6b-cd431b1fbffc tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:57.418315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e2c951f-3c5a-4deb-bb6b-cd431b1fbffc tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:57.418789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e2c951f-3c5a-4deb-bb6b-cd431b1fbffc tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:57.419478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e2c951f-3c5a-4deb-bb6b-cd431b1fbffc tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:57.420154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e2c951f-3c5a-4deb-bb6b-cd431b1fbffc tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:57.420797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e2c951f-3c5a-4deb-bb6b-cd431b1fbffc tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:57.644060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e2c951f-3c5a-4deb-bb6b-cd431b1fbffc tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:57.653037 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e2c951f-3c5a-4deb-bb6b-cd431b1fbffc tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1462 microversion: 2.1 time: 0.246114 Sep 10 10:48:57.653646 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2205/2711] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:57 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1462 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:57.664445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af2e8fce-3bed-4402-a7b9-95d0a429b49d tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:57.700012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:57.701557 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-af2e8fce-3bed-4402-a7b9-95d0a429b49d tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] HTTP exception thrown: Instance group e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da could not be found. Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af2e8fce-3bed-4402-a7b9-95d0a429b49d tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Request method failure captured: Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-server-groups/e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da HTTP/1.1 Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGtrps1bN00OwlGGWx3u07ELdKFxVEFUV3CzI-cSYOlf0xxaPnWfaTi446rp7ToKsgvz5ylhSOhaz6NBMQ5uCA5wWLWupqmWhXH0TSB-JWNUkQgJTuO5XAdyvXevPkPSZ8UfnDVuzsNNEoZrdl-vqmqM1x_TbNM7m1JiK7eaxkCcUaI Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b160aa19988d44c1bf69613f179d72be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b160aa19988d44c1bf69613f179d72be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b160aa19988d44c1bf69613f179d72be Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerGroupTestJSON-2025858587 Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e4b73c9c96c9499fb419484a688021da Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerGroupTestJSON-2025858587-project Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance group e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da could not be found. Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da'} Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da could not be found. Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da could not be found. Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.703999 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:48:57.708751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:48:57.708751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:48:57.708751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:48:57.708751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:48:57.708751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da could not be found. Sep 10 10:48:57.708751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:48:57.710894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af2e8fce-3bed-4402-a7b9-95d0a429b49d tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Returning 404 to user: Instance group e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:48:57.711948 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af2e8fce-3bed-4402-a7b9-95d0a429b49d tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da" status: 404 len: 117 microversion: 2.1 time: 0.057373 Sep 10 10:48:57.712680 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2206/2712] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:48:57 2022] DELETE /compute/v2.1/os-server-groups/e95f93ac-ab9f-4ffa-ad1f-da26e7a0e0da => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:48:57.721225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9653a136-9987-4db4-92f7-14e8cba94bf8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] Calling method '.version_select at 0x7efcae83df70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:57.762517 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9653a136-9987-4db4-92f7-14e8cba94bf8 tempest-ServersTestJSON-575987561 tempest-ServersTestJSON-575987561-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094995" status: 202 len: 0 microversion: 2.1 time: 0.047321 Sep 10 10:48:57.767382 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2207/2713] 10.222.0.20 () {58 vars in 1212 bytes} [Sat Sep 10 10:48:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094995 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:48:57.773455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:48:57.778194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:57.787663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:57.788430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:57.789066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:57.790063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:57.790952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:57.791747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:57.847197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:57.914459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:48:57.915095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:48:57.915801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:48:57.916669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:48:57.917278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:48:58.045982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:58.055010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:58.055761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:58.057391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:58.062110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:58.063226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:58.064136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:58.167037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:58.186981 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7d67edb0-4c77-4497-b7fa-66074421e5aa tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action" status: 202 len: 1066 microversion: 2.1 time: 0.418119 Sep 10 10:48:58.188280 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2208/2714] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:48:57 2022] POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action => generated 1066 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 10:48:58.195899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6922b10-9464-4f8e-be47-94c25fc77d9a tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:58.237798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:48:58.282830 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6922b10-9464-4f8e-be47-94c25fc77d9a tempest-ServerGroupTestJSON-2025858587 tempest-ServerGroupTestJSON-2025858587-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/9860ac7e-835f-4d61-93ea-20631aca2e51" status: 204 len: 0 microversion: 2.1 time: 0.091875 Sep 10 10:48:58.283449 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2209/2715] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 10:48:58 2022] DELETE /compute/v2.1/os-server-groups/9860ac7e-835f-4d61-93ea-20631aca2e51 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:48:58.313767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b632bc8-ae9f-491c-805d-7da4ccf360f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:58.317231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b632bc8-ae9f-491c-805d-7da4ccf360f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:58.331096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b632bc8-ae9f-491c-805d-7da4ccf360f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:58.331560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b632bc8-ae9f-491c-805d-7da4ccf360f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:58.348576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b632bc8-ae9f-491c-805d-7da4ccf360f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:58.367863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b632bc8-ae9f-491c-805d-7da4ccf360f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:58.375997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b632bc8-ae9f-491c-805d-7da4ccf360f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:58.376931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b632bc8-ae9f-491c-805d-7da4ccf360f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:59.651141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2b632bc8-ae9f-491c-805d-7da4ccf360f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:48:59.659448 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b632bc8-ae9f-491c-805d-7da4ccf360f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1470 microversion: 2.1 time: 1.372585 Sep 10 10:48:59.673700 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2210/2716] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:58 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1470 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:48:59.695122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d424c3b-b4fb-4e20-8963-bc20cbbdee36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:48:59.695747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d424c3b-b4fb-4e20-8963-bc20cbbdee36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:48:59.709700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d424c3b-b4fb-4e20-8963-bc20cbbdee36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:59.710271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d424c3b-b4fb-4e20-8963-bc20cbbdee36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:59.710707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d424c3b-b4fb-4e20-8963-bc20cbbdee36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:48:59.711463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d424c3b-b4fb-4e20-8963-bc20cbbdee36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:48:59.711920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d424c3b-b4fb-4e20-8963-bc20cbbdee36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:48:59.712354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d424c3b-b4fb-4e20-8963-bc20cbbdee36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:00.387698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d424c3b-b4fb-4e20-8963-bc20cbbdee36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:00.405787 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d424c3b-b4fb-4e20-8963-bc20cbbdee36 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.726331 Sep 10 10:49:00.407070 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2211/2717] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:48:59 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:00.694664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9058e52b-57ba-4b27-9119-48bf1e2dbc72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:00.695190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9058e52b-57ba-4b27-9119-48bf1e2dbc72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:00.712319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9058e52b-57ba-4b27-9119-48bf1e2dbc72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:00.714227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9058e52b-57ba-4b27-9119-48bf1e2dbc72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:00.717462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9058e52b-57ba-4b27-9119-48bf1e2dbc72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:00.720095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9058e52b-57ba-4b27-9119-48bf1e2dbc72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:00.720807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9058e52b-57ba-4b27-9119-48bf1e2dbc72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:00.723060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9058e52b-57ba-4b27-9119-48bf1e2dbc72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:01.064550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9058e52b-57ba-4b27-9119-48bf1e2dbc72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:01.079513 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9058e52b-57ba-4b27-9119-48bf1e2dbc72 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1470 microversion: 2.1 time: 0.393901 Sep 10 10:49:01.083174 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2212/2718] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:00 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1470 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:01.437948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-68b17194-0b45-4b98-8f7e-823d021a961c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:01.439035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-68b17194-0b45-4b98-8f7e-823d021a961c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:01.469544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68b17194-0b45-4b98-8f7e-823d021a961c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:01.470401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68b17194-0b45-4b98-8f7e-823d021a961c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:01.472080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68b17194-0b45-4b98-8f7e-823d021a961c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:01.476865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68b17194-0b45-4b98-8f7e-823d021a961c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:01.478499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68b17194-0b45-4b98-8f7e-823d021a961c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:01.479240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68b17194-0b45-4b98-8f7e-823d021a961c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:02.347717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-68b17194-0b45-4b98-8f7e-823d021a961c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:02.359852 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-68b17194-0b45-4b98-8f7e-823d021a961c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.922877 Sep 10 10:49:02.361114 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2213/2719] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:01 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:49:02.376529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e51cdf83-2886-4eae-aa5e-8ee8ced74f59 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:02.377747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e51cdf83-2886-4eae-aa5e-8ee8ced74f59 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:02.395533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51cdf83-2886-4eae-aa5e-8ee8ced74f59 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:02.396401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51cdf83-2886-4eae-aa5e-8ee8ced74f59 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:02.397750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51cdf83-2886-4eae-aa5e-8ee8ced74f59 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:02.400852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51cdf83-2886-4eae-aa5e-8ee8ced74f59 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:02.413641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51cdf83-2886-4eae-aa5e-8ee8ced74f59 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:02.418285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51cdf83-2886-4eae-aa5e-8ee8ced74f59 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:03.103993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e51cdf83-2886-4eae-aa5e-8ee8ced74f59 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:03.116156 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e51cdf83-2886-4eae-aa5e-8ee8ced74f59 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1470 microversion: 2.1 time: 0.751691 Sep 10 10:49:03.119333 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2214/2720] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:02 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1470 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:03.398664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf422482-d6cf-4363-b222-1486db068585 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:03.400666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf422482-d6cf-4363-b222-1486db068585 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:03.409585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf422482-d6cf-4363-b222-1486db068585 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:03.410654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf422482-d6cf-4363-b222-1486db068585 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:03.411765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf422482-d6cf-4363-b222-1486db068585 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:03.413008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf422482-d6cf-4363-b222-1486db068585 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:03.413966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf422482-d6cf-4363-b222-1486db068585 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:03.414625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf422482-d6cf-4363-b222-1486db068585 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:05.191255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cf422482-d6cf-4363-b222-1486db068585 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:05.203917 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf422482-d6cf-4363-b222-1486db068585 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 1.817768 Sep 10 10:49:05.206016 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2215/2721] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:03 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:05.230248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d9b9ded0-cff8-4e5b-a643-cd9bcab28ad5 req-f5476b05-0154-4a0b-92ea-8337ea15d914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee58542a-6b67-4a9c-877d-08388a963470", "name": "network-vif-unplugged", "status": "completed", "tag": "108704ca-0340-4f7a-85fa-f375c14063d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:05.271286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d9b9ded0-cff8-4e5b-a643-cd9bcab28ad5 req-f5476b05-0154-4a0b-92ea-8337ea15d914 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:05.273985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d9b9ded0-cff8-4e5b-a643-cd9bcab28ad5 req-f5476b05-0154-4a0b-92ea-8337ea15d914 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:05.274606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d9b9ded0-cff8-4e5b-a643-cd9bcab28ad5 req-f5476b05-0154-4a0b-92ea-8337ea15d914 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:05.308542 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d9b9ded0-cff8-4e5b-a643-cd9bcab28ad5 req-f5476b05-0154-4a0b-92ea-8337ea15d914 service nova] Creating event network-vif-unplugged:108704ca-0340-4f7a-85fa-f375c14063d4 for instance ee58542a-6b67-4a9c-877d-08388a963470 on n-h2-856894-1 Sep 10 10:49:05.316113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-d9b9ded0-cff8-4e5b-a643-cd9bcab28ad5 req-f5476b05-0154-4a0b-92ea-8337ea15d914 service nova] Instance ee58542a-6b67-4a9c-877d-08388a963470 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 10:49:05.329108 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d9b9ded0-cff8-4e5b-a643-cd9bcab28ad5 req-f5476b05-0154-4a0b-92ea-8337ea15d914 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121460 Sep 10 10:49:05.330367 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2216/2722] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:05.336277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78080f84-f776-46dc-84c9-2bce60d3c2fe tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:05.337367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78080f84-f776-46dc-84c9-2bce60d3c2fe tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:05.351556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78080f84-f776-46dc-84c9-2bce60d3c2fe tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:05.352365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78080f84-f776-46dc-84c9-2bce60d3c2fe tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:05.352975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78080f84-f776-46dc-84c9-2bce60d3c2fe tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:05.357595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78080f84-f776-46dc-84c9-2bce60d3c2fe tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:05.358273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78080f84-f776-46dc-84c9-2bce60d3c2fe tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:05.360016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78080f84-f776-46dc-84c9-2bce60d3c2fe tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:05.722963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-78080f84-f776-46dc-84c9-2bce60d3c2fe tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:05.737430 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78080f84-f776-46dc-84c9-2bce60d3c2fe tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1470 microversion: 2.1 time: 0.401225 Sep 10 10:49:05.739012 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2217/2723] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:05 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:06.229188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-294e4ade-7d08-420b-831f-f8c9ff017f83 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:06.230670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-294e4ade-7d08-420b-831f-f8c9ff017f83 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:06.246958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294e4ade-7d08-420b-831f-f8c9ff017f83 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:06.247717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294e4ade-7d08-420b-831f-f8c9ff017f83 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:06.250939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294e4ade-7d08-420b-831f-f8c9ff017f83 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:06.251983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294e4ade-7d08-420b-831f-f8c9ff017f83 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:06.254327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294e4ade-7d08-420b-831f-f8c9ff017f83 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:06.255200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294e4ade-7d08-420b-831f-f8c9ff017f83 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:06.854286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-294e4ade-7d08-420b-831f-f8c9ff017f83 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:06.867438 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-294e4ade-7d08-420b-831f-f8c9ff017f83 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.642484 Sep 10 10:49:06.869128 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2218/2724] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:06 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:49:06.880578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8540788c-7df2-4cd5-9788-a177e45b4cd9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:06.881544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8540788c-7df2-4cd5-9788-a177e45b4cd9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:06.890499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8540788c-7df2-4cd5-9788-a177e45b4cd9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:06.891960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8540788c-7df2-4cd5-9788-a177e45b4cd9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:06.892632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8540788c-7df2-4cd5-9788-a177e45b4cd9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:06.893731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8540788c-7df2-4cd5-9788-a177e45b4cd9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:06.895551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8540788c-7df2-4cd5-9788-a177e45b4cd9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:06.896259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8540788c-7df2-4cd5-9788-a177e45b4cd9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:07.276074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8540788c-7df2-4cd5-9788-a177e45b4cd9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:07.296486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8540788c-7df2-4cd5-9788-a177e45b4cd9 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1470 microversion: 2.1 time: 0.424851 Sep 10 10:49:07.298633 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2219/2725] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:06 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1470 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:07.447471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9b05eced-7ddc-4789-bf65-64ab79853fc4 req-9786dabc-8ba9-4362-8b61-461709377e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee58542a-6b67-4a9c-877d-08388a963470", "tag": "108704ca-0340-4f7a-85fa-f375c14063d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:07.493869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b05eced-7ddc-4789-bf65-64ab79853fc4 req-9786dabc-8ba9-4362-8b61-461709377e1d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:07.496177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b05eced-7ddc-4789-bf65-64ab79853fc4 req-9786dabc-8ba9-4362-8b61-461709377e1d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:07.497406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b05eced-7ddc-4789-bf65-64ab79853fc4 req-9786dabc-8ba9-4362-8b61-461709377e1d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:07.533452 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9b05eced-7ddc-4789-bf65-64ab79853fc4 req-9786dabc-8ba9-4362-8b61-461709377e1d service nova] Creating event network-changed:108704ca-0340-4f7a-85fa-f375c14063d4 for instance ee58542a-6b67-4a9c-877d-08388a963470 on n-h2-856894-1 Sep 10 10:49:07.544012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-9b05eced-7ddc-4789-bf65-64ab79853fc4 req-9786dabc-8ba9-4362-8b61-461709377e1d service nova] Instance ee58542a-6b67-4a9c-877d-08388a963470 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 10:49:07.603029 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9b05eced-7ddc-4789-bf65-64ab79853fc4 req-9786dabc-8ba9-4362-8b61-461709377e1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163795 Sep 10 10:49:07.609121 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2220/2726] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:07.897726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62d1eeed-f6d4-48b9-8919-377ad7a2fc04 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:07.898732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62d1eeed-f6d4-48b9-8919-377ad7a2fc04 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:07.911762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d1eeed-f6d4-48b9-8919-377ad7a2fc04 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:07.916374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d1eeed-f6d4-48b9-8919-377ad7a2fc04 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:07.919991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d1eeed-f6d4-48b9-8919-377ad7a2fc04 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:07.921210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d1eeed-f6d4-48b9-8919-377ad7a2fc04 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:07.924169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d1eeed-f6d4-48b9-8919-377ad7a2fc04 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:07.925195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d1eeed-f6d4-48b9-8919-377ad7a2fc04 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:08.336385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62d1eeed-f6d4-48b9-8919-377ad7a2fc04 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:08.349430 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62d1eeed-f6d4-48b9-8919-377ad7a2fc04 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.454056 Sep 10 10:49:08.353122 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2221/2727] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:07 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:49:08.365180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8eb4af97-f4b6-4a5d-9efd-f701514a4f8d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:08.366483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8eb4af97-f4b6-4a5d-9efd-f701514a4f8d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:08.389096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb4af97-f4b6-4a5d-9efd-f701514a4f8d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:08.392299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb4af97-f4b6-4a5d-9efd-f701514a4f8d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:08.393279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb4af97-f4b6-4a5d-9efd-f701514a4f8d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:08.394248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb4af97-f4b6-4a5d-9efd-f701514a4f8d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:08.399007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb4af97-f4b6-4a5d-9efd-f701514a4f8d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:08.399574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb4af97-f4b6-4a5d-9efd-f701514a4f8d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:08.464265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8eb4af97-f4b6-4a5d-9efd-f701514a4f8d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:49:08.680204 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8eb4af97-f4b6-4a5d-9efd-f701514a4f8d tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 204 len: 0 microversion: 2.1 time: 0.325070 Sep 10 10:49:08.684387 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2222/2728] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:49:08 2022] DELETE /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:49:08.708380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-13ddff75-ee46-4d84-aada-775bd77cef5d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:08.713411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-13ddff75-ee46-4d84-aada-775bd77cef5d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:08.735736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13ddff75-ee46-4d84-aada-775bd77cef5d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:08.737434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13ddff75-ee46-4d84-aada-775bd77cef5d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:08.738181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13ddff75-ee46-4d84-aada-775bd77cef5d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:08.741176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13ddff75-ee46-4d84-aada-775bd77cef5d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:08.741657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13ddff75-ee46-4d84-aada-775bd77cef5d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:08.742099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13ddff75-ee46-4d84-aada-775bd77cef5d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:09.113712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-13ddff75-ee46-4d84-aada-775bd77cef5d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:09.123972 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-13ddff75-ee46-4d84-aada-775bd77cef5d tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1470 microversion: 2.1 time: 0.427524 Sep 10 10:49:09.141711 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2223/2729] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:08 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1470 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:09.147454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea8dec6f-0269-4e45-9d57-f7e553f7e642 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:09.148316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea8dec6f-0269-4e45-9d57-f7e553f7e642 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:09.158163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea8dec6f-0269-4e45-9d57-f7e553f7e642 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:09.159092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea8dec6f-0269-4e45-9d57-f7e553f7e642 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:09.159780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea8dec6f-0269-4e45-9d57-f7e553f7e642 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:09.160744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea8dec6f-0269-4e45-9d57-f7e553f7e642 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:09.163398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea8dec6f-0269-4e45-9d57-f7e553f7e642 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:09.164309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea8dec6f-0269-4e45-9d57-f7e553f7e642 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:09.651474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ea8dec6f-0269-4e45-9d57-f7e553f7e642 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:09.666941 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea8dec6f-0269-4e45-9d57-f7e553f7e642 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1508 microversion: 2.1 time: 0.523161 Sep 10 10:49:09.674298 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2224/2730] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:09 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1508 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:09.694245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65e4982f-d9cc-410f-a09e-3e4286bae41b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:09.697977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65e4982f-d9cc-410f-a09e-3e4286bae41b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:09.719842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e4982f-d9cc-410f-a09e-3e4286bae41b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:09.723289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e4982f-d9cc-410f-a09e-3e4286bae41b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:09.727109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e4982f-d9cc-410f-a09e-3e4286bae41b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:09.728648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e4982f-d9cc-410f-a09e-3e4286bae41b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:09.732635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e4982f-d9cc-410f-a09e-3e4286bae41b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:09.733986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e4982f-d9cc-410f-a09e-3e4286bae41b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:09.754256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:10.268317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-65e4982f-d9cc-410f-a09e-3e4286bae41b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:10.277308 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65e4982f-d9cc-410f-a09e-3e4286bae41b tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.601576 Sep 10 10:49:10.289380 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2225/2731] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:09 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:10.297828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc49c335-34d8-4876-8fcb-1b4e39713a69 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:10.297828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cc49c335-34d8-4876-8fcb-1b4e39713a69 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:10.306168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc49c335-34d8-4876-8fcb-1b4e39713a69 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:10.306664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc49c335-34d8-4876-8fcb-1b4e39713a69 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:10.307100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc49c335-34d8-4876-8fcb-1b4e39713a69 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:10.307805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc49c335-34d8-4876-8fcb-1b4e39713a69 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:10.308256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc49c335-34d8-4876-8fcb-1b4e39713a69 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:10.309303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc49c335-34d8-4876-8fcb-1b4e39713a69 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:10.744176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cc49c335-34d8-4876-8fcb-1b4e39713a69 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:10.752788 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cc49c335-34d8-4876-8fcb-1b4e39713a69 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1463 microversion: 2.1 time: 0.469080 Sep 10 10:49:10.765755 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2226/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:10 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1463 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:10.778159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-912af2e8-65f2-49c8-9ede-3d8bd2f50465 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:10.779034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-912af2e8-65f2-49c8-9ede-3d8bd2f50465 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:10.786462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-912af2e8-65f2-49c8-9ede-3d8bd2f50465 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:10.787264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-912af2e8-65f2-49c8-9ede-3d8bd2f50465 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:10.787946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-912af2e8-65f2-49c8-9ede-3d8bd2f50465 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:10.788899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-912af2e8-65f2-49c8-9ede-3d8bd2f50465 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:10.789621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-912af2e8-65f2-49c8-9ede-3d8bd2f50465 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:10.790209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-912af2e8-65f2-49c8-9ede-3d8bd2f50465 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:11.278572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-912af2e8-65f2-49c8-9ede-3d8bd2f50465 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:11.294210 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-912af2e8-65f2-49c8-9ede-3d8bd2f50465 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 200 len: 1508 microversion: 2.1 time: 0.525095 Sep 10 10:49:11.294835 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2227/2733] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:10 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:11.869933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8185b807-6a40-4efe-95ea-83359bc5e915 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:11.870576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8185b807-6a40-4efe-95ea-83359bc5e915 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:11.893494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185b807-6a40-4efe-95ea-83359bc5e915 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:11.895937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185b807-6a40-4efe-95ea-83359bc5e915 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:11.898492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185b807-6a40-4efe-95ea-83359bc5e915 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:11.900232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185b807-6a40-4efe-95ea-83359bc5e915 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:11.909983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185b807-6a40-4efe-95ea-83359bc5e915 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:11.910434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8185b807-6a40-4efe-95ea-83359bc5e915 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:12.586570 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8185b807-6a40-4efe-95ea-83359bc5e915 tempest-MigrationsAdminTest-2084331763 tempest-MigrationsAdminTest-2084331763-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1614 microversion: 2.1 time: 1.290582 Sep 10 10:49:12.587516 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2228/2734] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:11 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1614 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:12.613427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e137656-d425-4263-b859-99690332afa9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:12.614058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e137656-d425-4263-b859-99690332afa9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:12.637974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e137656-d425-4263-b859-99690332afa9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:12.638500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e137656-d425-4263-b859-99690332afa9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:12.638953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e137656-d425-4263-b859-99690332afa9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:12.639675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e137656-d425-4263-b859-99690332afa9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:12.640136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e137656-d425-4263-b859-99690332afa9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:12.640570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e137656-d425-4263-b859-99690332afa9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:13.468925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e137656-d425-4263-b859-99690332afa9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:13.489100 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e137656-d425-4263-b859-99690332afa9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.882728 Sep 10 10:49:13.489946 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2229/2735] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:12 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:13.503266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9bc08e72-1480-4572-ab2e-221b7e78c03d req-45e52c6d-9695-4903-b744-a7f57298e4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf615daa-1aa8-4756-8b54-041304199609", "name": "network-vif-deleted", "tag": "847262ac-e422-4b62-87d1-33447a795418"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:13.524754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9bc08e72-1480-4572-ab2e-221b7e78c03d req-45e52c6d-9695-4903-b744-a7f57298e4f8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:13.526347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9bc08e72-1480-4572-ab2e-221b7e78c03d req-45e52c6d-9695-4903-b744-a7f57298e4f8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:13.526865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9bc08e72-1480-4572-ab2e-221b7e78c03d req-45e52c6d-9695-4903-b744-a7f57298e4f8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:13.539229 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9bc08e72-1480-4572-ab2e-221b7e78c03d req-45e52c6d-9695-4903-b744-a7f57298e4f8 service nova] Creating event network-vif-deleted:847262ac-e422-4b62-87d1-33447a795418 for instance bf615daa-1aa8-4756-8b54-041304199609 on n-h2-856894-1 Sep 10 10:49:13.546136 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9bc08e72-1480-4572-ab2e-221b7e78c03d req-45e52c6d-9695-4903-b744-a7f57298e4f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046737 Sep 10 10:49:13.547435 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2230/2736] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:13.554138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:13.555018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: bf615daa-1aa8-4756-8b54-041304199609] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:13.563796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:13.564798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:13.565646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:13.566564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:13.567187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:13.567774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:13.585817 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] HTTP exception thrown: Instance bf615daa-1aa8-4756-8b54-041304199609 could not be found. Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Request method failure captured: Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 HTTP/1.1 Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpHkAYnXeEeIkrvP5MU91LX1pHhCw1-X517wST7uI3nXMyFmEZF2-GrH_hD3-99qTj4dhIEoqm0d7-iBahX9spBGlFJJtEH3HGF62s1M_cLMl7ndO7Kwzn8XkzqLr7wv9Eh_FDYB9NepyfCMVt7SSvdhwxotJF7SX8u4upXel5-s6g Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52c98558e19447dfa54397d92f45dbb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0682225a07764437b25009c061ac844d Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance bf615daa-1aa8-4756-8b54-041304199609 could not be found. Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'bf615daa-1aa8-4756-8b54-041304199609'} Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf615daa-1aa8-4756-8b54-041304199609 could not be found. Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf615daa-1aa8-4756-8b54-041304199609 could not be found. Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:13.588257 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:13.594678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:13.594678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:13.594678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:13.594678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:13.594678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:49:13.594678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:49:13.594678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf615daa-1aa8-4756-8b54-041304199609 could not be found. Sep 10 10:49:13.594678 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:13.598759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Returning 404 to user: Instance bf615daa-1aa8-4756-8b54-041304199609 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:49:13.600090 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-37afa19f-b9a6-4258-b5fe-01c2f2a241fe tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609" status: 404 len: 111 microversion: 2.1 time: 0.051102 Sep 10 10:49:13.600682 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2231/2737] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:13 2022] GET /compute/v2.1/servers/bf615daa-1aa8-4756-8b54-041304199609 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:49:13.606730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1a507e7-af41-449f-8b2f-518e36a41b02 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:13.607253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1a507e7-af41-449f-8b2f-518e36a41b02 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:13.619817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a507e7-af41-449f-8b2f-518e36a41b02 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:13.621685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a507e7-af41-449f-8b2f-518e36a41b02 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:13.622428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a507e7-af41-449f-8b2f-518e36a41b02 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:13.624198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a507e7-af41-449f-8b2f-518e36a41b02 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:13.625408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a507e7-af41-449f-8b2f-518e36a41b02 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:13.626095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a507e7-af41-449f-8b2f-518e36a41b02 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:13.679209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1a507e7-af41-449f-8b2f-518e36a41b02 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:49:13.841625 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1a507e7-af41-449f-8b2f-518e36a41b02 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 204 len: 0 microversion: 2.1 time: 0.232268 Sep 10 10:49:13.842724 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2232/2738] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:49:13 2022] DELETE /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:49:13.851096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-71831838-1a55-4c09-9862-9792dd22cea4 req-f3236764-a568-4aeb-b93f-bc1392a222f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee58542a-6b67-4a9c-877d-08388a963470", "name": "network-vif-plugged", "status": "completed", "tag": "108704ca-0340-4f7a-85fa-f375c14063d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:13.877954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-71831838-1a55-4c09-9862-9792dd22cea4 req-f3236764-a568-4aeb-b93f-bc1392a222f5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:13.879258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-71831838-1a55-4c09-9862-9792dd22cea4 req-f3236764-a568-4aeb-b93f-bc1392a222f5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:13.879798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-71831838-1a55-4c09-9862-9792dd22cea4 req-f3236764-a568-4aeb-b93f-bc1392a222f5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:13.901190 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-71831838-1a55-4c09-9862-9792dd22cea4 req-f3236764-a568-4aeb-b93f-bc1392a222f5 service nova] Creating event network-vif-plugged:108704ca-0340-4f7a-85fa-f375c14063d4 for instance ee58542a-6b67-4a9c-877d-08388a963470 on n-h2-856894-1 Sep 10 10:49:13.909402 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-71831838-1a55-4c09-9862-9792dd22cea4 req-f3236764-a568-4aeb-b93f-bc1392a222f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064185 Sep 10 10:49:13.910933 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2233/2739] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:13.917371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-47c15549-38df-484f-9648-abd469b97914 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:13.919643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47c15549-38df-484f-9648-abd469b97914 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:13.934250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c15549-38df-484f-9648-abd469b97914 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:13.934990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c15549-38df-484f-9648-abd469b97914 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:13.935694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c15549-38df-484f-9648-abd469b97914 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:13.938458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c15549-38df-484f-9648-abd469b97914 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:13.940454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c15549-38df-484f-9648-abd469b97914 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:13.941555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47c15549-38df-484f-9648-abd469b97914 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:14.063243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47c15549-38df-484f-9648-abd469b97914 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:49:14.220767 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-47c15549-38df-484f-9648-abd469b97914 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 204 len: 0 microversion: 2.1 time: 0.308149 Sep 10 10:49:14.224760 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2234/2740] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:49:13 2022] DELETE /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:49:14.230472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-147e16c4-274c-4355-9576-3d7c70ee5941 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:14.231188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-147e16c4-274c-4355-9576-3d7c70ee5941 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:14.246721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147e16c4-274c-4355-9576-3d7c70ee5941 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:14.247411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147e16c4-274c-4355-9576-3d7c70ee5941 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:14.248037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147e16c4-274c-4355-9576-3d7c70ee5941 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:14.249203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147e16c4-274c-4355-9576-3d7c70ee5941 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:14.249823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147e16c4-274c-4355-9576-3d7c70ee5941 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:14.250463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147e16c4-274c-4355-9576-3d7c70ee5941 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:14.533771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-147e16c4-274c-4355-9576-3d7c70ee5941 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:14.545062 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-147e16c4-274c-4355-9576-3d7c70ee5941 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1469 microversion: 2.1 time: 0.318998 Sep 10 10:49:14.548163 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2235/2741] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:14 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1469 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:14.553335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80ca5780-49bd-4867-876f-4980d063a094 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:14.560035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80ca5780-49bd-4867-876f-4980d063a094 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:14.569052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80ca5780-49bd-4867-876f-4980d063a094 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:14.574962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80ca5780-49bd-4867-876f-4980d063a094 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:14.575443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80ca5780-49bd-4867-876f-4980d063a094 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:14.576187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80ca5780-49bd-4867-876f-4980d063a094 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:14.576656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80ca5780-49bd-4867-876f-4980d063a094 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:14.577090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80ca5780-49bd-4867-876f-4980d063a094 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:14.968132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80ca5780-49bd-4867-876f-4980d063a094 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:14.976434 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80ca5780-49bd-4867-876f-4980d063a094 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.426683 Sep 10 10:49:14.992096 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2236/2742] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:14 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:15.001752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3dec889e-782b-41c4-9b03-8d4a7e832b53 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:15.002608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3dec889e-782b-41c4-9b03-8d4a7e832b53 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:15.010686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dec889e-782b-41c4-9b03-8d4a7e832b53 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:15.011950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dec889e-782b-41c4-9b03-8d4a7e832b53 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:15.012649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dec889e-782b-41c4-9b03-8d4a7e832b53 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:15.013647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dec889e-782b-41c4-9b03-8d4a7e832b53 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:15.015268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dec889e-782b-41c4-9b03-8d4a7e832b53 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:15.015865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dec889e-782b-41c4-9b03-8d4a7e832b53 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:15.272423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3dec889e-782b-41c4-9b03-8d4a7e832b53 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:15.287229 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3dec889e-782b-41c4-9b03-8d4a7e832b53 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.293016 Sep 10 10:49:15.291261 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2237/2743] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:14 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:15.574233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-17b62d46-d72a-45cf-a0d0-38e7d1eca546 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:15.575589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-17b62d46-d72a-45cf-a0d0-38e7d1eca546 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:15.586291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b62d46-d72a-45cf-a0d0-38e7d1eca546 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:15.588893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b62d46-d72a-45cf-a0d0-38e7d1eca546 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:15.591214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b62d46-d72a-45cf-a0d0-38e7d1eca546 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:15.592712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b62d46-d72a-45cf-a0d0-38e7d1eca546 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:15.594191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b62d46-d72a-45cf-a0d0-38e7d1eca546 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:15.594900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b62d46-d72a-45cf-a0d0-38e7d1eca546 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:15.850307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-17b62d46-d72a-45cf-a0d0-38e7d1eca546 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:15.866629 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-17b62d46-d72a-45cf-a0d0-38e7d1eca546 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1469 microversion: 2.1 time: 0.297236 Sep 10 10:49:15.867765 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2238/2744] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:15 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:49:15.875565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab96d639-5e5f-4c46-ad53-90f962e1dfce tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:15.876400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab96d639-5e5f-4c46-ad53-90f962e1dfce tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:15.890720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab96d639-5e5f-4c46-ad53-90f962e1dfce tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:15.897499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab96d639-5e5f-4c46-ad53-90f962e1dfce tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:15.898603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab96d639-5e5f-4c46-ad53-90f962e1dfce tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:15.899957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab96d639-5e5f-4c46-ad53-90f962e1dfce tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:15.903338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab96d639-5e5f-4c46-ad53-90f962e1dfce tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:15.905222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab96d639-5e5f-4c46-ad53-90f962e1dfce tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:16.200954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab96d639-5e5f-4c46-ad53-90f962e1dfce tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:16.228016 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab96d639-5e5f-4c46-ad53-90f962e1dfce tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.359018 Sep 10 10:49:16.228620 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2239/2745] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:15 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:16.236622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c4f88a5-3f7a-4b2a-b58f-3c88a9df2e6e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:16.241436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4c4f88a5-3f7a-4b2a-b58f-3c88a9df2e6e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:16.250707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4f88a5-3f7a-4b2a-b58f-3c88a9df2e6e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:16.251461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4f88a5-3f7a-4b2a-b58f-3c88a9df2e6e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:16.252072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4f88a5-3f7a-4b2a-b58f-3c88a9df2e6e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:16.253134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4f88a5-3f7a-4b2a-b58f-3c88a9df2e6e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:16.253941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4f88a5-3f7a-4b2a-b58f-3c88a9df2e6e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:16.254373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4f88a5-3f7a-4b2a-b58f-3c88a9df2e6e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:16.305465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:16.552199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4c4f88a5-3f7a-4b2a-b58f-3c88a9df2e6e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:16.563412 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c4f88a5-3f7a-4b2a-b58f-3c88a9df2e6e tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.330471 Sep 10 10:49:16.565016 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2240/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:16 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:16.570641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-038d592d-ac9d-4c87-a90a-70fd3d5ee0b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:16.571517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-038d592d-ac9d-4c87-a90a-70fd3d5ee0b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:16.578952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-038d592d-ac9d-4c87-a90a-70fd3d5ee0b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:16.580534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-038d592d-ac9d-4c87-a90a-70fd3d5ee0b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:16.581199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-038d592d-ac9d-4c87-a90a-70fd3d5ee0b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:16.582339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-038d592d-ac9d-4c87-a90a-70fd3d5ee0b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:16.582947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-038d592d-ac9d-4c87-a90a-70fd3d5ee0b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:16.583567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-038d592d-ac9d-4c87-a90a-70fd3d5ee0b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:16.798757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-038d592d-ac9d-4c87-a90a-70fd3d5ee0b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:16.807640 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-038d592d-ac9d-4c87-a90a-70fd3d5ee0b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.241410 Sep 10 10:49:16.809746 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2241/2747] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:16 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:16.814836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a92dad0-511b-4704-b2fd-1389e444cb4a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:16.815456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a92dad0-511b-4704-b2fd-1389e444cb4a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:16.823377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92dad0-511b-4704-b2fd-1389e444cb4a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:16.824449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92dad0-511b-4704-b2fd-1389e444cb4a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:16.825104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92dad0-511b-4704-b2fd-1389e444cb4a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:16.825896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92dad0-511b-4704-b2fd-1389e444cb4a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:16.826525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92dad0-511b-4704-b2fd-1389e444cb4a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:16.826954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92dad0-511b-4704-b2fd-1389e444cb4a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:17.052864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a92dad0-511b-4704-b2fd-1389e444cb4a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:17.065270 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a92dad0-511b-4704-b2fd-1389e444cb4a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.254241 Sep 10 10:49:17.079382 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2242/2748] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:16 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:17.095332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e74cd6f-36df-4fbb-80b7-331df7dafba7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:17.096403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e74cd6f-36df-4fbb-80b7-331df7dafba7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:17.104270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e74cd6f-36df-4fbb-80b7-331df7dafba7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:17.106076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e74cd6f-36df-4fbb-80b7-331df7dafba7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:17.106691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e74cd6f-36df-4fbb-80b7-331df7dafba7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:17.107570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e74cd6f-36df-4fbb-80b7-331df7dafba7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:17.108040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e74cd6f-36df-4fbb-80b7-331df7dafba7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:17.108497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e74cd6f-36df-4fbb-80b7-331df7dafba7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:17.311637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e74cd6f-36df-4fbb-80b7-331df7dafba7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:17.333546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e74cd6f-36df-4fbb-80b7-331df7dafba7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.242506 Sep 10 10:49:17.333546 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2243/2749] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:17 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:17.333546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-34f74040-3359-4c11-bde5-b50515095950 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:17.333546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-34f74040-3359-4c11-bde5-b50515095950 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:17.338368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34f74040-3359-4c11-bde5-b50515095950 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:17.340150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34f74040-3359-4c11-bde5-b50515095950 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:17.340826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34f74040-3359-4c11-bde5-b50515095950 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:17.341853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34f74040-3359-4c11-bde5-b50515095950 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:17.342482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34f74040-3359-4c11-bde5-b50515095950 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:17.343077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-34f74040-3359-4c11-bde5-b50515095950 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:17.856120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-34f74040-3359-4c11-bde5-b50515095950 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:17.871876 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-34f74040-3359-4c11-bde5-b50515095950 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1469 microversion: 2.1 time: 0.544976 Sep 10 10:49:17.872510 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2244/2750] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:17 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1469 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:17.890086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-574414d5-02f0-4dc4-848e-35ca976f753d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-431564517"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:17.899370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-574414d5-02f0-4dc4-848e-35ca976f753d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:17.917483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574414d5-02f0-4dc4-848e-35ca976f753d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:17.934286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574414d5-02f0-4dc4-848e-35ca976f753d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:17.939238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574414d5-02f0-4dc4-848e-35ca976f753d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:17.950802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574414d5-02f0-4dc4-848e-35ca976f753d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:17.954828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574414d5-02f0-4dc4-848e-35ca976f753d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:17.956970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-574414d5-02f0-4dc4-848e-35ca976f753d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:18.437238 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-574414d5-02f0-4dc4-848e-35ca976f753d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.556893 Sep 10 10:49:18.437938 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2245/2751] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:49:17 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 10 10:49:18.454042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-96009f41-23a5-4742-821a-f4cd64643c1a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:18.455088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-96009f41-23a5-4742-821a-f4cd64643c1a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:18.462043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96009f41-23a5-4742-821a-f4cd64643c1a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:18.462968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96009f41-23a5-4742-821a-f4cd64643c1a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:18.463651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96009f41-23a5-4742-821a-f4cd64643c1a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:18.464708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96009f41-23a5-4742-821a-f4cd64643c1a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:18.465402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96009f41-23a5-4742-821a-f4cd64643c1a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:18.466034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-96009f41-23a5-4742-821a-f4cd64643c1a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:18.827928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-96009f41-23a5-4742-821a-f4cd64643c1a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:18.843903 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-96009f41-23a5-4742-821a-f4cd64643c1a tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1522 microversion: 2.1 time: 0.397597 Sep 10 10:49:18.845866 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2246/2752] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:18 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:18.857649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db627573-2798-41d7-9bb0-0bc4ff5b4a3c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:18.859085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db627573-2798-41d7-9bb0-0bc4ff5b4a3c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:18.874239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db627573-2798-41d7-9bb0-0bc4ff5b4a3c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:18.875854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db627573-2798-41d7-9bb0-0bc4ff5b4a3c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:18.882025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db627573-2798-41d7-9bb0-0bc4ff5b4a3c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:18.883097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db627573-2798-41d7-9bb0-0bc4ff5b4a3c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:18.883798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db627573-2798-41d7-9bb0-0bc4ff5b4a3c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:18.884485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db627573-2798-41d7-9bb0-0bc4ff5b4a3c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:19.315991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-db627573-2798-41d7-9bb0-0bc4ff5b4a3c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:19.331063 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db627573-2798-41d7-9bb0-0bc4ff5b4a3c tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.483227 Sep 10 10:49:19.332243 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2247/2753] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:18 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:19.345128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:19.346272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:19.356225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:19.362885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:19.363650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:19.364262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:19.365370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:19.366024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:19.366627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:19.447465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:19.449290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:19.452932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:19.453796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lazy-loading 'fault' on Instance uuid ee58542a-6b67-4a9c-877d-08388a963470 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:49:19.575936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:19.588947 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9395b9e1-aac2-421e-aa46-2d2df7cf81e0 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 200 len: 1303 microversion: 2.1 time: 0.255357 Sep 10 10:49:19.599603 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2248/2754] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:19 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 1303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:19.946531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1cb47966-256e-473a-a51c-34d203b8855e req-c392c574-b0a8-4118-a2cb-e12f971569f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee58542a-6b67-4a9c-877d-08388a963470", "name": "network-vif-deleted", "tag": "108704ca-0340-4f7a-85fa-f375c14063d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:19.967226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1cb47966-256e-473a-a51c-34d203b8855e req-c392c574-b0a8-4118-a2cb-e12f971569f3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:19.967869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1cb47966-256e-473a-a51c-34d203b8855e req-c392c574-b0a8-4118-a2cb-e12f971569f3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:19.970292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1cb47966-256e-473a-a51c-34d203b8855e req-c392c574-b0a8-4118-a2cb-e12f971569f3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:20.016710 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1cb47966-256e-473a-a51c-34d203b8855e req-c392c574-b0a8-4118-a2cb-e12f971569f3 service nova] Creating event network-vif-deleted:108704ca-0340-4f7a-85fa-f375c14063d4 for instance ee58542a-6b67-4a9c-877d-08388a963470 on n-h2-856894-1 Sep 10 10:49:20.032335 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1cb47966-256e-473a-a51c-34d203b8855e req-c392c574-b0a8-4118-a2cb-e12f971569f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.431067 Sep 10 10:49:20.037905 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2249/2755] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:20.044198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:20.053786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:20.068986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:20.081989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:20.082560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:20.083402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:20.083949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:20.084454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:20.150315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:20.151083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:20.151811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:20.153125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lazy-loading 'fault' on Instance uuid 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:49:20.245222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:20.256058 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9e121381-d03a-42d2-9e7b-fd319e7e90b2 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1312 microversion: 2.1 time: 0.216491 Sep 10 10:49:20.262633 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2250/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:20 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:20.362264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-61074697-87cc-4b5a-90e9-78df1b55ee58 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:20.363438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-61074697-87cc-4b5a-90e9-78df1b55ee58 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:20.380271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61074697-87cc-4b5a-90e9-78df1b55ee58 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:20.391704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61074697-87cc-4b5a-90e9-78df1b55ee58 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:20.394250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61074697-87cc-4b5a-90e9-78df1b55ee58 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:20.398700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61074697-87cc-4b5a-90e9-78df1b55ee58 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:20.400114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61074697-87cc-4b5a-90e9-78df1b55ee58 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:20.402887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61074697-87cc-4b5a-90e9-78df1b55ee58 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:20.704022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-61074697-87cc-4b5a-90e9-78df1b55ee58 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:20.716795 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-61074697-87cc-4b5a-90e9-78df1b55ee58 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.357798 Sep 10 10:49:20.718167 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2251/2757] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:20 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:49:20.724200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:20.725026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee58542a-6b67-4a9c-877d-08388a963470] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:20.733216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:20.734922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:20.736046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:20.737036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:20.737844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:20.738511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:20.763345 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] HTTP exception thrown: Instance ee58542a-6b67-4a9c-877d-08388a963470 could not be found. Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Request method failure captured: Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 HTTP/1.1 Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpQfbf1zsucCvXg9cXzpLWHGLyVY7mkoPKOcuR2jyC7XL8wdzV1o3ttaR_wFfoegiiVWl1adhRkew3IDICJSFVOU9w1bXnDwRICTyiLT-HPad7ao9E5h-tKrsP2kIJ9jOVTM3zJZfI43_ZFnPHtycrlClPpq91nFATjVuTAtDGokmo Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 7c408248417b4deaaa26ef380da4bb90 Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c408248417b4deaaa26ef380da4bb90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 7c408248417b4deaaa26ef380da4bb90 Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-MigrationsAdminTest-82215703-project Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: f5b257d1488141689c826efe484e4040 Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-MigrationsAdminTest-82215703-project Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance ee58542a-6b67-4a9c-877d-08388a963470 could not be found. Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'ee58542a-6b67-4a9c-877d-08388a963470'} Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee58542a-6b67-4a9c-877d-08388a963470 could not be found. Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee58542a-6b67-4a9c-877d-08388a963470 could not be found. Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:20.765751 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:20.770340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:20.770340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:20.770340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:20.770340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:49:20.770340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:49:20.770340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee58542a-6b67-4a9c-877d-08388a963470 could not be found. Sep 10 10:49:20.770340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:20.773164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Returning 404 to user: Instance ee58542a-6b67-4a9c-877d-08388a963470 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:49:20.774515 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a75c56ac-268e-483a-8b4a-f8d23853b8f7 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470" status: 404 len: 111 microversion: 2.1 time: 0.055056 Sep 10 10:49:20.775453 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2252/2758] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:20 2022] GET /compute/v2.1/servers/ee58542a-6b67-4a9c-877d-08388a963470 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:49:20.785284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a0210af-8bd6-4a33-86e1-ff87ae4ba5b2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:20.786215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a0210af-8bd6-4a33-86e1-ff87ae4ba5b2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:20.793282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0210af-8bd6-4a33-86e1-ff87ae4ba5b2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:20.794201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0210af-8bd6-4a33-86e1-ff87ae4ba5b2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:20.794911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0210af-8bd6-4a33-86e1-ff87ae4ba5b2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:20.796084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0210af-8bd6-4a33-86e1-ff87ae4ba5b2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:20.796779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0210af-8bd6-4a33-86e1-ff87ae4ba5b2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:20.797478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0210af-8bd6-4a33-86e1-ff87ae4ba5b2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:20.831325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a0210af-8bd6-4a33-86e1-ff87ae4ba5b2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:49:20.977707 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a0210af-8bd6-4a33-86e1-ff87ae4ba5b2 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 204 len: 0 microversion: 2.1 time: 0.196502 Sep 10 10:49:20.986351 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2253/2759] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:49:20 2022] DELETE /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:49:20.995078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee3e7530-edb0-468d-a5b4-0e07cdb71cae tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:20.995797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ee3e7530-edb0-468d-a5b4-0e07cdb71cae tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:21.014979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee3e7530-edb0-468d-a5b4-0e07cdb71cae tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:21.016233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee3e7530-edb0-468d-a5b4-0e07cdb71cae tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:21.016862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee3e7530-edb0-468d-a5b4-0e07cdb71cae tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:21.018283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee3e7530-edb0-468d-a5b4-0e07cdb71cae tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:21.018979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee3e7530-edb0-468d-a5b4-0e07cdb71cae tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:21.020136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee3e7530-edb0-468d-a5b4-0e07cdb71cae tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:21.357201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ee3e7530-edb0-468d-a5b4-0e07cdb71cae tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:21.362270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:21.372935 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ee3e7530-edb0-468d-a5b4-0e07cdb71cae tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1534 microversion: 2.1 time: 0.382318 Sep 10 10:49:21.374295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2254/2760] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:20 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1534 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:49:21.381204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:21.382168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:21.439628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:21.440544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.048s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:21.442789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:21.444263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:21.444916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:21.446608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:21.566732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:21.567235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:21.567680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:21.568148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lazy-loading 'fault' on Instance uuid 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:49:21.669493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0682225a07764437b25009c061ac844d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c98558e19447dfa54397d92f45dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:21.685002 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02615314-2f23-4af3-895f-e134de5f1832 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 200 len: 1312 microversion: 2.1 time: 0.305298 Sep 10 10:49:21.686535 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2255/2761] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:21 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 1312 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:21.744965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b88ae4a9-94ab-4ff6-a6b9-3a3727e86661 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:21.746169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b88ae4a9-94ab-4ff6-a6b9-3a3727e86661 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:21.758979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88ae4a9-94ab-4ff6-a6b9-3a3727e86661 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:21.759759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88ae4a9-94ab-4ff6-a6b9-3a3727e86661 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:21.760447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88ae4a9-94ab-4ff6-a6b9-3a3727e86661 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:21.761469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88ae4a9-94ab-4ff6-a6b9-3a3727e86661 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:21.762094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88ae4a9-94ab-4ff6-a6b9-3a3727e86661 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:21.762716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88ae4a9-94ab-4ff6-a6b9-3a3727e86661 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:22.071146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b88ae4a9-94ab-4ff6-a6b9-3a3727e86661 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:22.085217 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b88ae4a9-94ab-4ff6-a6b9-3a3727e86661 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.347682 Sep 10 10:49:22.087322 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2256/2762] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:21 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:22.125323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-581ea10e-4d53-4eac-b44a-f748d52fde64 req-a54652be-1d23-4d70-8a62-e69ed84f5a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0", "name": "network-vif-deleted", "tag": "6b66707a-c5e9-468a-986c-6dcabdec9863"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:22.148677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-581ea10e-4d53-4eac-b44a-f748d52fde64 req-a54652be-1d23-4d70-8a62-e69ed84f5a2d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:22.149474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-581ea10e-4d53-4eac-b44a-f748d52fde64 req-a54652be-1d23-4d70-8a62-e69ed84f5a2d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:22.150076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-581ea10e-4d53-4eac-b44a-f748d52fde64 req-a54652be-1d23-4d70-8a62-e69ed84f5a2d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:22.178474 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-581ea10e-4d53-4eac-b44a-f748d52fde64 req-a54652be-1d23-4d70-8a62-e69ed84f5a2d service nova] Creating event network-vif-deleted:6b66707a-c5e9-468a-986c-6dcabdec9863 for instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 on n-h2-856894-1 Sep 10 10:49:22.185774 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-581ea10e-4d53-4eac-b44a-f748d52fde64 req-a54652be-1d23-4d70-8a62-e69ed84f5a2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065989 Sep 10 10:49:22.189791 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2257/2763] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:22.402565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82ebdb9e-e56f-4934-8c71-b5e633dea8c8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:22.403633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82ebdb9e-e56f-4934-8c71-b5e633dea8c8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:22.427883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ebdb9e-e56f-4934-8c71-b5e633dea8c8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:22.432398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ebdb9e-e56f-4934-8c71-b5e633dea8c8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:22.434183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ebdb9e-e56f-4934-8c71-b5e633dea8c8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:22.435942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ebdb9e-e56f-4934-8c71-b5e633dea8c8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:22.436727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ebdb9e-e56f-4934-8c71-b5e633dea8c8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:22.437479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82ebdb9e-e56f-4934-8c71-b5e633dea8c8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:22.900242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-82ebdb9e-e56f-4934-8c71-b5e633dea8c8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:22.910449 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82ebdb9e-e56f-4934-8c71-b5e633dea8c8 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1534 microversion: 2.1 time: 0.513081 Sep 10 10:49:22.917402 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2258/2764] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:22 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1534 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:49:22.958130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:22.959569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] [instance: 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:22.966796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:22.967583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:22.968270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:22.969185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:22.969813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:22.970458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:22.992382 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] HTTP exception thrown: Instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 could not be found. Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Request method failure captured: Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 HTTP/1.1 Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpHkAYnXeEeIkrvP5MU91LX1pHhCw1-X517wST7uI3nXMyFmEZF2-GrH_hD3-99qTj4dhIEoqm0d7-iBahX9spBGlFJJtEH3HGF62s1M_cLMl7ndO7Kwzn8XkzqLr7wv9Eh_FDYB9NepyfCMVt7SSvdhwxotJF7SX8u4upXel5-s6g Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/52c98558e19447dfa54397d92f45dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_52c98558e19447dfa54397d92f45dbb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 52c98558e19447dfa54397d92f45dbb9 Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1127100768 Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 0682225a07764437b25009c061ac844d Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1127100768-project Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 could not be found. Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0'} Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 could not be found. Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 could not be found. Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:22.994313 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:23.001041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:23.001041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:23.001041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:23.001041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:23.001041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:49:23.001041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:49:23.001041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 could not be found. Sep 10 10:49:23.001041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:23.001041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] Returning 404 to user: Instance 01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:49:23.006363 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3af239ca-4dbb-4bee-83bd-d424e1dac647 tempest-ServerRescueNegativeTestJSON-1127100768 tempest-ServerRescueNegativeTestJSON-1127100768-project] 10.222.0.20 "GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0" status: 404 len: 111 microversion: 2.1 time: 0.056577 Sep 10 10:49:23.006363 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2259/2765] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:22 2022] GET /compute/v2.1/servers/01e8d5fc-abc9-420f-b4f5-bff6b0bbefd0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:49:23.112660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f0fa8753-87bd-4864-8411-2cb096f14d5a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:23.113440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f0fa8753-87bd-4864-8411-2cb096f14d5a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:23.153508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0fa8753-87bd-4864-8411-2cb096f14d5a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:23.154015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0fa8753-87bd-4864-8411-2cb096f14d5a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:23.154462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0fa8753-87bd-4864-8411-2cb096f14d5a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:23.155434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0fa8753-87bd-4864-8411-2cb096f14d5a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:23.155890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0fa8753-87bd-4864-8411-2cb096f14d5a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:23.156321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0fa8753-87bd-4864-8411-2cb096f14d5a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:23.900291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f0fa8753-87bd-4864-8411-2cb096f14d5a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:23.918271 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f0fa8753-87bd-4864-8411-2cb096f14d5a tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.810470 Sep 10 10:49:23.920059 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2260/2766] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:23 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:49:23.958956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6a009a76-d6f7-4f6a-b678-c5549b4af454 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:23.959603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6a009a76-d6f7-4f6a-b678-c5549b4af454 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:23.990391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a009a76-d6f7-4f6a-b678-c5549b4af454 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:24.004980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a009a76-d6f7-4f6a-b678-c5549b4af454 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:24.005483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a009a76-d6f7-4f6a-b678-c5549b4af454 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:24.006240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a009a76-d6f7-4f6a-b678-c5549b4af454 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:24.006709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a009a76-d6f7-4f6a-b678-c5549b4af454 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:24.007146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a009a76-d6f7-4f6a-b678-c5549b4af454 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:24.711157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6a009a76-d6f7-4f6a-b678-c5549b4af454 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:24.721453 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6a009a76-d6f7-4f6a-b678-c5549b4af454 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1534 microversion: 2.1 time: 0.776711 Sep 10 10:49:24.746493 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2261/2767] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:23 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1534 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:24.766447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-11afe99a-0077-4a85-aafe-e87272f2e745 req-49617ce8-d66d-4808-ae09-b9b7864e2497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5", "name": "network-vif-plugged", "status": "completed", "tag": "a9a5c077-18b4-45a9-ab46-131e14788b74"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:24.788681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-11afe99a-0077-4a85-aafe-e87272f2e745 req-49617ce8-d66d-4808-ae09-b9b7864e2497 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:24.789197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-11afe99a-0077-4a85-aafe-e87272f2e745 req-49617ce8-d66d-4808-ae09-b9b7864e2497 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:24.797691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-11afe99a-0077-4a85-aafe-e87272f2e745 req-49617ce8-d66d-4808-ae09-b9b7864e2497 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:24.813721 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-11afe99a-0077-4a85-aafe-e87272f2e745 req-49617ce8-d66d-4808-ae09-b9b7864e2497 service nova] Creating event network-vif-plugged:a9a5c077-18b4-45a9-ab46-131e14788b74 for instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 on n-h2-856894-1 Sep 10 10:49:24.833090 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-11afe99a-0077-4a85-aafe-e87272f2e745 req-49617ce8-d66d-4808-ae09-b9b7864e2497 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070606 Sep 10 10:49:24.834317 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2262/2768] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:24.948120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bcfe5f60-78fd-43d8-ade9-1e1546198486 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:24.949003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bcfe5f60-78fd-43d8-ade9-1e1546198486 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:24.967104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcfe5f60-78fd-43d8-ade9-1e1546198486 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:24.968009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcfe5f60-78fd-43d8-ade9-1e1546198486 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:24.968885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcfe5f60-78fd-43d8-ade9-1e1546198486 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:24.970365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcfe5f60-78fd-43d8-ade9-1e1546198486 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:24.971059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcfe5f60-78fd-43d8-ade9-1e1546198486 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:24.971940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcfe5f60-78fd-43d8-ade9-1e1546198486 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:26.650988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bcfe5f60-78fd-43d8-ade9-1e1546198486 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:26.659921 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bcfe5f60-78fd-43d8-ade9-1e1546198486 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 1.720628 Sep 10 10:49:26.684179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2263/2769] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:24 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:26.718781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:26.719391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:26.735301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:26.735800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:26.736235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:26.739092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:26.739593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:26.740028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:26.860077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:26.861216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:26.864311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:26.864984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lazy-loading 'fault' on Instance uuid ee459b93-4eb4-4aef-a49a-932de04dd93c {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:49:26.986024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:26.996425 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-492832a2-c096-469f-9514-87c40d624fcf tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 200 len: 1368 microversion: 2.1 time: 0.311042 Sep 10 10:49:26.997369 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2264/2770] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:26 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:27.004877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-bb779446-7b05-4530-9c33-189a3f24bd3a req-7cc51a0f-c0b4-4cfe-af83-9d269b9a33a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee459b93-4eb4-4aef-a49a-932de04dd93c", "name": "network-vif-deleted", "tag": "39589cf4-02b9-4961-8e0c-79680b9855a0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:27.056030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bb779446-7b05-4530-9c33-189a3f24bd3a req-7cc51a0f-c0b4-4cfe-af83-9d269b9a33a5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:27.057841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bb779446-7b05-4530-9c33-189a3f24bd3a req-7cc51a0f-c0b4-4cfe-af83-9d269b9a33a5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:27.061765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bb779446-7b05-4530-9c33-189a3f24bd3a req-7cc51a0f-c0b4-4cfe-af83-9d269b9a33a5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:27.092073 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-bb779446-7b05-4530-9c33-189a3f24bd3a req-7cc51a0f-c0b4-4cfe-af83-9d269b9a33a5 service nova] Creating event network-vif-deleted:39589cf4-02b9-4961-8e0c-79680b9855a0 for instance ee459b93-4eb4-4aef-a49a-932de04dd93c on n-h2-856894-1 Sep 10 10:49:27.107890 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-bb779446-7b05-4530-9c33-189a3f24bd3a req-7cc51a0f-c0b4-4cfe-af83-9d269b9a33a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106596 Sep 10 10:49:27.109325 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2265/2771] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:27.689052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-91a3f04c-38dc-46f8-b78b-76313b6aff19 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:27.690950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-91a3f04c-38dc-46f8-b78b-76313b6aff19 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:27.721659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91a3f04c-38dc-46f8-b78b-76313b6aff19 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:27.722907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91a3f04c-38dc-46f8-b78b-76313b6aff19 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:27.727206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91a3f04c-38dc-46f8-b78b-76313b6aff19 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:27.728315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91a3f04c-38dc-46f8-b78b-76313b6aff19 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:27.730212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91a3f04c-38dc-46f8-b78b-76313b6aff19 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:27.731897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91a3f04c-38dc-46f8-b78b-76313b6aff19 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:28.660789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-91a3f04c-38dc-46f8-b78b-76313b6aff19 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:28.678700 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-91a3f04c-38dc-46f8-b78b-76313b6aff19 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.996305 Sep 10 10:49:28.680503 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2266/2772] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:27 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:29.049694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1514489213", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "64cb3b23-4abb-49b9-b60e-201809cae02d"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:29.174559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] validate_networks() for [('64cb3b23-4abb-49b9-b60e-201809cae02d', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:49:30.641124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:49:30.641815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:49:30.641995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:49:30.642604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:49:30.643189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:49:30.664696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:30.665629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:30.668846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:30.671406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:30.672986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:30.682138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:30.765175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Getting quotas for project 827645d7a2374eb4bc75b115b8ccd6dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:49:30.774166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Getting quotas for user e3e819f2b7d9489497e408871a233377 and project 827645d7a2374eb4bc75b115b8ccd6dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:49:30.842594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:49:30.846968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:49:30.982584 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-47d32c13-7978-415f-bc0c-1bb6d644e335 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.293771 Sep 10 10:49:30.983612 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2267/2773] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:49:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:49:31.000741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:31.005234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: ee459b93-4eb4-4aef-a49a-932de04dd93c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:31.025937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:31.043563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:31.049263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:31.050341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:31.051063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:31.053678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:31.111567 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] HTTP exception thrown: Instance ee459b93-4eb4-4aef-a49a-932de04dd93c could not be found. Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Request method failure captured: Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c HTTP/1.1 Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpQfbf1zsucCvXg9cXzpLWHGLyVY7mkoPKOcuR2jyC7XL8wdzV1o3ttaR_wFfoegiiVWl1adhRkew3IDICJSFVOU9w1bXnDwRICTyiLT-HPad7ao9E5h-tKrsP2kIJ9jOVTM3zJZfI43_ZFnPHtycrlClPpq91nFATjVuTAtDGokmo Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 7c408248417b4deaaa26ef380da4bb90 Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c408248417b4deaaa26ef380da4bb90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 7c408248417b4deaaa26ef380da4bb90 Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-MigrationsAdminTest-82215703-project Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: f5b257d1488141689c826efe484e4040 Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-MigrationsAdminTest-82215703-project Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance ee459b93-4eb4-4aef-a49a-932de04dd93c could not be found. Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'ee459b93-4eb4-4aef-a49a-932de04dd93c'} Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee459b93-4eb4-4aef-a49a-932de04dd93c could not be found. Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee459b93-4eb4-4aef-a49a-932de04dd93c could not be found. Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:31.127687 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:31.133464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:31.133464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:31.133464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:31.133464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:49:31.133464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:49:31.133464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee459b93-4eb4-4aef-a49a-932de04dd93c could not be found. Sep 10 10:49:31.133464 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:31.135623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Returning 404 to user: Instance ee459b93-4eb4-4aef-a49a-932de04dd93c could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:49:31.135623 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63756f40-7b26-41a0-835a-0d029bd753f1 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c" status: 404 len: 111 microversion: 2.1 time: 0.150595 Sep 10 10:49:31.138790 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2268/2774] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:30 2022] GET /compute/v2.1/servers/ee459b93-4eb4-4aef-a49a-932de04dd93c => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:49:31.160093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a70194eb-97be-40f9-b435-414052f16dc6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:31.164852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a70194eb-97be-40f9-b435-414052f16dc6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:31.186345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70194eb-97be-40f9-b435-414052f16dc6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:31.190622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70194eb-97be-40f9-b435-414052f16dc6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:31.195033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70194eb-97be-40f9-b435-414052f16dc6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:31.200530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70194eb-97be-40f9-b435-414052f16dc6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:31.202655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70194eb-97be-40f9-b435-414052f16dc6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:31.203386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70194eb-97be-40f9-b435-414052f16dc6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:31.973493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a70194eb-97be-40f9-b435-414052f16dc6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:31.982525 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a70194eb-97be-40f9-b435-414052f16dc6 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1471 microversion: 2.1 time: 0.840081 Sep 10 10:49:31.983124 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2269/2775] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:31 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1471 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:31.991761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c07828ad-050c-4c07-b75f-f663422b0a38 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:32.004186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c07828ad-050c-4c07-b75f-f663422b0a38 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:32.180002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c07828ad-050c-4c07-b75f-f663422b0a38 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:32.199384 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c07828ad-050c-4c07-b75f-f663422b0a38 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1218 microversion: 2.1 time: 0.213035 Sep 10 10:49:32.210902 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2270/2776] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:31 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:32.236860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-31ff828f-b8c9-4f94-a1be-018a0397ff9f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '.version_select at 0x7efcae65e3a0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:32.297519 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-31ff828f-b8c9-4f94-a1be-018a0397ff9f tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329288233" status: 202 len: 0 microversion: 2.1 time: 0.085160 Sep 10 10:49:32.298132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2271/2777] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 10:49:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329288233 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:49:33.010500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f03352b-144c-4999-9004-aab4ea475ab1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:33.011528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f03352b-144c-4999-9004-aab4ea475ab1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:33.047386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f03352b-144c-4999-9004-aab4ea475ab1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:33.049776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f03352b-144c-4999-9004-aab4ea475ab1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:33.052089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f03352b-144c-4999-9004-aab4ea475ab1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:33.054370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f03352b-144c-4999-9004-aab4ea475ab1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:33.056244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f03352b-144c-4999-9004-aab4ea475ab1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:33.058548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f03352b-144c-4999-9004-aab4ea475ab1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:33.633985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f03352b-144c-4999-9004-aab4ea475ab1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:33.651724 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f03352b-144c-4999-9004-aab4ea475ab1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1477 microversion: 2.1 time: 0.646780 Sep 10 10:49:33.658621 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2272/2778] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:33 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1477 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:33.669884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:33.680858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:33.716135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:33.722977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:33.725232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:33.727996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:33.728935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:33.736196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:33.981258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:33.992851 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1270 microversion: 2.1 time: 0.332108 Sep 10 10:49:33.993569 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2273/2779] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:33 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1270 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:34.024226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:34.026000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7af9af10-8062-4e6e-b8bd-5c226db23496 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002168 Sep 10 10:49:34.027621 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2274/2780] 10.222.0.20 () {56 vars in 886 bytes} [Sat Sep 10 10:49:34 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 10:49:34.689327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7d9170ca-1302-40fb-b97e-0bb863ec4c3f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:34.690395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7d9170ca-1302-40fb-b97e-0bb863ec4c3f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:34.713428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d9170ca-1302-40fb-b97e-0bb863ec4c3f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:34.716125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d9170ca-1302-40fb-b97e-0bb863ec4c3f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:34.717981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d9170ca-1302-40fb-b97e-0bb863ec4c3f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:34.720880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d9170ca-1302-40fb-b97e-0bb863ec4c3f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:34.724225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d9170ca-1302-40fb-b97e-0bb863ec4c3f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:34.725206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d9170ca-1302-40fb-b97e-0bb863ec4c3f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:36.259602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7d9170ca-1302-40fb-b97e-0bb863ec4c3f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:36.276327 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7d9170ca-1302-40fb-b97e-0bb863ec4c3f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1477 microversion: 2.1 time: 1.592057 Sep 10 10:49:36.288404 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2275/2781] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:34 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1477 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:36.308117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e15080f6-3a16-438f-8faa-553da597a963 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:36.315041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e15080f6-3a16-438f-8faa-553da597a963 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:36.335908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e15080f6-3a16-438f-8faa-553da597a963 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:36.337163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e15080f6-3a16-438f-8faa-553da597a963 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:36.338751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e15080f6-3a16-438f-8faa-553da597a963 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:36.356311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e15080f6-3a16-438f-8faa-553da597a963 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:36.359918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e15080f6-3a16-438f-8faa-553da597a963 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:36.360699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e15080f6-3a16-438f-8faa-553da597a963 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:36.897849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e15080f6-3a16-438f-8faa-553da597a963 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:36.917228 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e15080f6-3a16-438f-8faa-553da597a963 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1276 microversion: 2.1 time: 0.626361 Sep 10 10:49:36.918031 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2276/2782] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:36 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1276 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:36.934197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9555b672-8cb3-481c-92af-2a519bf86d14 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:36.934830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9555b672-8cb3-481c-92af-2a519bf86d14 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:36.955697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9555b672-8cb3-481c-92af-2a519bf86d14 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:36.956441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9555b672-8cb3-481c-92af-2a519bf86d14 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:36.958050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9555b672-8cb3-481c-92af-2a519bf86d14 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:36.960614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9555b672-8cb3-481c-92af-2a519bf86d14 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:36.962597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9555b672-8cb3-481c-92af-2a519bf86d14 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:36.965024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9555b672-8cb3-481c-92af-2a519bf86d14 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:37.074874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9555b672-8cb3-481c-92af-2a519bf86d14 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:49:37.086480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:37.252726 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9555b672-8cb3-481c-92af-2a519bf86d14 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 204 len: 0 microversion: 2.1 time: 0.326030 Sep 10 10:49:37.254919 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2277/2783] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:49:36 2022] DELETE /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:49:37.266363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-cb7586b6-a52f-459b-bb47-4b4b91be7c82 req-812b3c3c-4dd4-4223-94b7-02a44ed37f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0e0a60-5b09-404d-8e58-92a80dad0840", "name": "network-vif-unplugged", "status": "completed", "tag": "9150ee97-5767-40aa-ad6c-5a7df51e7439"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:37.287888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cb7586b6-a52f-459b-bb47-4b4b91be7c82 req-812b3c3c-4dd4-4223-94b7-02a44ed37f41 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:37.289979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cb7586b6-a52f-459b-bb47-4b4b91be7c82 req-812b3c3c-4dd4-4223-94b7-02a44ed37f41 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:37.290447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cb7586b6-a52f-459b-bb47-4b4b91be7c82 req-812b3c3c-4dd4-4223-94b7-02a44ed37f41 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:37.318976 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-cb7586b6-a52f-459b-bb47-4b4b91be7c82 req-812b3c3c-4dd4-4223-94b7-02a44ed37f41 service nova] Creating event network-vif-unplugged:9150ee97-5767-40aa-ad6c-5a7df51e7439 for instance cc0e0a60-5b09-404d-8e58-92a80dad0840 on n-h2-856894-1 Sep 10 10:49:37.339334 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-cb7586b6-a52f-459b-bb47-4b4b91be7c82 req-812b3c3c-4dd4-4223-94b7-02a44ed37f41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081278 Sep 10 10:49:37.346046 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2278/2784] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:37.367549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d5b51fe8-afb1-4f03-9184-10dfb4405ee4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:37.368551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d5b51fe8-afb1-4f03-9184-10dfb4405ee4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:37.397690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b51fe8-afb1-4f03-9184-10dfb4405ee4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:37.398334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b51fe8-afb1-4f03-9184-10dfb4405ee4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:37.398766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b51fe8-afb1-4f03-9184-10dfb4405ee4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:37.406490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b51fe8-afb1-4f03-9184-10dfb4405ee4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:37.407354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b51fe8-afb1-4f03-9184-10dfb4405ee4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:37.408918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5b51fe8-afb1-4f03-9184-10dfb4405ee4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:38.269054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d5b51fe8-afb1-4f03-9184-10dfb4405ee4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:38.287828 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d5b51fe8-afb1-4f03-9184-10dfb4405ee4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1469 microversion: 2.1 time: 0.940439 Sep 10 10:49:38.293283 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2279/2785] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:37 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1469 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:38.305547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2df3b92a-bcec-459f-a552-07d0a4927428 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:38.312201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2df3b92a-bcec-459f-a552-07d0a4927428 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:38.329248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:38.334605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df3b92a-bcec-459f-a552-07d0a4927428 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:38.344937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df3b92a-bcec-459f-a552-07d0a4927428 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:38.344937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df3b92a-bcec-459f-a552-07d0a4927428 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:38.344937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df3b92a-bcec-459f-a552-07d0a4927428 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:38.344937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df3b92a-bcec-459f-a552-07d0a4927428 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:38.344937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2df3b92a-bcec-459f-a552-07d0a4927428 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:39.983043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2df3b92a-bcec-459f-a552-07d0a4927428 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:39.995250 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2df3b92a-bcec-459f-a552-07d0a4927428 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1477 microversion: 2.1 time: 1.698991 Sep 10 10:49:39.995970 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2280/2786] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:38 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1477 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:40.017391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8bbf0388-36bd-4c1e-8786-3a88bd69da3c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:40.024584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8bbf0388-36bd-4c1e-8786-3a88bd69da3c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:40.047388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bbf0388-36bd-4c1e-8786-3a88bd69da3c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:40.048693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bbf0388-36bd-4c1e-8786-3a88bd69da3c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:40.050646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bbf0388-36bd-4c1e-8786-3a88bd69da3c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:40.054767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bbf0388-36bd-4c1e-8786-3a88bd69da3c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:40.055864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bbf0388-36bd-4c1e-8786-3a88bd69da3c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:40.061787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8bbf0388-36bd-4c1e-8786-3a88bd69da3c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:40.727759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:40.908764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8bbf0388-36bd-4c1e-8786-3a88bd69da3c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:40.919115 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8bbf0388-36bd-4c1e-8786-3a88bd69da3c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1318 microversion: 2.1 time: 0.922172 Sep 10 10:49:40.922295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2281/2787] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:39 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1318 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:40.952845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4662924b-16c6-49bb-ad05-d53ddf1984b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:40.957173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4662924b-16c6-49bb-ad05-d53ddf1984b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:40.974191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4662924b-16c6-49bb-ad05-d53ddf1984b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:40.977632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4662924b-16c6-49bb-ad05-d53ddf1984b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:40.979652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4662924b-16c6-49bb-ad05-d53ddf1984b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:40.984892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4662924b-16c6-49bb-ad05-d53ddf1984b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:40.986213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4662924b-16c6-49bb-ad05-d53ddf1984b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:40.986862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4662924b-16c6-49bb-ad05-d53ddf1984b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:41.595341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4662924b-16c6-49bb-ad05-d53ddf1984b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:41.609803 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4662924b-16c6-49bb-ad05-d53ddf1984b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 200 len: 1469 microversion: 2.1 time: 0.684051 Sep 10 10:49:41.610419 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2282/2788] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:40 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 1469 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:41.620694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f6fcd0a9-a565-42ce-a1d3-ff7a456a1566 req-8820e180-0b4d-4bba-a167-7507b161e004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0e0a60-5b09-404d-8e58-92a80dad0840", "name": "network-vif-plugged", "status": "completed", "tag": "9150ee97-5767-40aa-ad6c-5a7df51e7439"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:41.652810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f6fcd0a9-a565-42ce-a1d3-ff7a456a1566 req-8820e180-0b4d-4bba-a167-7507b161e004 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:41.653385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f6fcd0a9-a565-42ce-a1d3-ff7a456a1566 req-8820e180-0b4d-4bba-a167-7507b161e004 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:41.653818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f6fcd0a9-a565-42ce-a1d3-ff7a456a1566 req-8820e180-0b4d-4bba-a167-7507b161e004 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:41.712645 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f6fcd0a9-a565-42ce-a1d3-ff7a456a1566 req-8820e180-0b4d-4bba-a167-7507b161e004 service nova] Creating event network-vif-plugged:9150ee97-5767-40aa-ad6c-5a7df51e7439 for instance cc0e0a60-5b09-404d-8e58-92a80dad0840 on n-h2-856894-1 Sep 10 10:49:41.718195 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f6fcd0a9-a565-42ce-a1d3-ff7a456a1566 req-8820e180-0b4d-4bba-a167-7507b161e004 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104594 Sep 10 10:49:41.719590 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2283/2789] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:41.761808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-294c2978-c6fc-4832-be67-610924292048 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:41.762589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-294c2978-c6fc-4832-be67-610924292048 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:41.782714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294c2978-c6fc-4832-be67-610924292048 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:41.783495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294c2978-c6fc-4832-be67-610924292048 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:41.785318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294c2978-c6fc-4832-be67-610924292048 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:41.787341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294c2978-c6fc-4832-be67-610924292048 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:41.787975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294c2978-c6fc-4832-be67-610924292048 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:41.788670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-294c2978-c6fc-4832-be67-610924292048 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:42.186537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:42.555125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-294c2978-c6fc-4832-be67-610924292048 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:42.567328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-294c2978-c6fc-4832-be67-610924292048 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1477 microversion: 2.1 time: 0.845809 Sep 10 10:49:42.568084 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2284/2790] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:41 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1477 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:42.580163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-55be182f-f089-4a0e-928b-880009a78984 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:42.583343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-55be182f-f089-4a0e-928b-880009a78984 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:42.633101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55be182f-f089-4a0e-928b-880009a78984 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:42.636248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55be182f-f089-4a0e-928b-880009a78984 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:42.637360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55be182f-f089-4a0e-928b-880009a78984 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:42.641602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55be182f-f089-4a0e-928b-880009a78984 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:42.641602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55be182f-f089-4a0e-928b-880009a78984 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:42.641897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55be182f-f089-4a0e-928b-880009a78984 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:43.247684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-55be182f-f089-4a0e-928b-880009a78984 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:43.274828 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-55be182f-f089-4a0e-928b-880009a78984 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1318 microversion: 2.1 time: 0.699699 Sep 10 10:49:43.279714 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2285/2791] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:42 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1318 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:43.574271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1966432174", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": "none"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:43.725238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:49:43.725809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:49:43.726498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:49:43.727074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:49:43.727499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:49:43.749492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:43.749983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:43.753724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:43.754753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:43.756447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:43.757320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:43.808628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Getting quotas for project a43851400d0a427ab18328c92b349fbf. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:49:43.826224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Getting quotas for user 52c0efce1fa344059de5505b96930282 and project a43851400d0a427ab18328c92b349fbf. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:49:43.890084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:49:43.906678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:49:43.992773 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79edff22-fa49-449f-a69b-5d5cb68d8d58 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.703861 Sep 10 10:49:43.996279 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2286/2792] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:49:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 10:49:44.009285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0e4e4a11-2ff7-4769-b310-b3fd3c1e837f req-51597091-fab2-489f-8c06-af2e4d25ae21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda18caa-5a27-40b6-ae42-48a93b63825c", "name": "network-vif-deleted", "tag": "a8d7b3d4-fa78-4890-8baa-75a8aff3caff"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:44.054600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0e4e4a11-2ff7-4769-b310-b3fd3c1e837f req-51597091-fab2-489f-8c06-af2e4d25ae21 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:44.063193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0e4e4a11-2ff7-4769-b310-b3fd3c1e837f req-51597091-fab2-489f-8c06-af2e4d25ae21 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:44.063798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0e4e4a11-2ff7-4769-b310-b3fd3c1e837f req-51597091-fab2-489f-8c06-af2e4d25ae21 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:44.114081 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0e4e4a11-2ff7-4769-b310-b3fd3c1e837f req-51597091-fab2-489f-8c06-af2e4d25ae21 service nova] Creating event network-vif-deleted:a8d7b3d4-fa78-4890-8baa-75a8aff3caff for instance fda18caa-5a27-40b6-ae42-48a93b63825c on n-h2-856894-1 Sep 10 10:49:44.137121 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0e4e4a11-2ff7-4769-b310-b3fd3c1e837f req-51597091-fab2-489f-8c06-af2e4d25ae21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133134 Sep 10 10:49:44.138612 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2287/2793] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:44.148094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:44.151910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: fda18caa-5a27-40b6-ae42-48a93b63825c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:44.167760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:44.171451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:44.173048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:44.176858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:44.177568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:44.178080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:44.207108 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] HTTP exception thrown: Instance fda18caa-5a27-40b6-ae42-48a93b63825c could not be found. Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Request method failure captured: Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c HTTP/1.1 Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpQfbf1zsucCvXg9cXzpLWHGLyVY7mkoPKOcuR2jyC7XL8wdzV1o3ttaR_wFfoegiiVWl1adhRkew3IDICJSFVOU9w1bXnDwRICTyiLT-HPad7ao9E5h-tKrsP2kIJ9jOVTM3zJZfI43_ZFnPHtycrlClPpq91nFATjVuTAtDGokmo Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 7c408248417b4deaaa26ef380da4bb90 Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c408248417b4deaaa26ef380da4bb90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 7c408248417b4deaaa26ef380da4bb90 Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-MigrationsAdminTest-82215703-project Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: f5b257d1488141689c826efe484e4040 Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-MigrationsAdminTest-82215703-project Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance fda18caa-5a27-40b6-ae42-48a93b63825c could not be found. Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'fda18caa-5a27-40b6-ae42-48a93b63825c'} Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda18caa-5a27-40b6-ae42-48a93b63825c could not be found. Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda18caa-5a27-40b6-ae42-48a93b63825c could not be found. Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:44.210328 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:44.215913 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:44.215913 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:44.215913 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:44.215913 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:49:44.215913 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:49:44.215913 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda18caa-5a27-40b6-ae42-48a93b63825c could not be found. Sep 10 10:49:44.215913 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:44.222177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Returning 404 to user: Instance fda18caa-5a27-40b6-ae42-48a93b63825c could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:49:44.223242 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1174d668-7f2c-410e-96e7-fae96ce67a46 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c" status: 404 len: 111 microversion: 2.1 time: 0.083294 Sep 10 10:49:44.224255 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2288/2794] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:44 2022] GET /compute/v2.1/servers/fda18caa-5a27-40b6-ae42-48a93b63825c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:49:44.233948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f4aa7596-bfd7-4dc5-a977-f1a4011e6061 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:44.235064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f4aa7596-bfd7-4dc5-a977-f1a4011e6061 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:44.255415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4aa7596-bfd7-4dc5-a977-f1a4011e6061 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:44.256103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4aa7596-bfd7-4dc5-a977-f1a4011e6061 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:44.256384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4aa7596-bfd7-4dc5-a977-f1a4011e6061 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:44.257059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4aa7596-bfd7-4dc5-a977-f1a4011e6061 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:44.257978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4aa7596-bfd7-4dc5-a977-f1a4011e6061 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:44.257978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4aa7596-bfd7-4dc5-a977-f1a4011e6061 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:45.028896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f4aa7596-bfd7-4dc5-a977-f1a4011e6061 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:45.042657 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f4aa7596-bfd7-4dc5-a977-f1a4011e6061 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1462 microversion: 2.1 time: 0.817160 Sep 10 10:49:45.043333 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2289/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:44 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1462 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:45.063299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-551f8f05-3e71-42c6-924a-9eb5fdb93c4b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:45.064302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-551f8f05-3e71-42c6-924a-9eb5fdb93c4b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:45.230593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-551f8f05-3e71-42c6-924a-9eb5fdb93c4b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:45.246731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-551f8f05-3e71-42c6-924a-9eb5fdb93c4b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:45.256900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-551f8f05-3e71-42c6-924a-9eb5fdb93c4b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:45.258888 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-551f8f05-3e71-42c6-924a-9eb5fdb93c4b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/7bca7472-e63e-4b9a-a54f-9ab02f82cc1c" status: 200 len: 1278 microversion: 2.47 time: 0.210361 Sep 10 10:49:45.259955 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2290/2796] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:49:45 2022] GET /compute/v2.1/servers/7bca7472-e63e-4b9a-a54f-9ab02f82cc1c => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:49:45.269131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a2613e60-17fc-478a-b4ed-17c69fc06d16 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:45.271517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a2613e60-17fc-478a-b4ed-17c69fc06d16 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:45.284742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2613e60-17fc-478a-b4ed-17c69fc06d16 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:45.287536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2613e60-17fc-478a-b4ed-17c69fc06d16 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:45.292565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2613e60-17fc-478a-b4ed-17c69fc06d16 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:45.293604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2613e60-17fc-478a-b4ed-17c69fc06d16 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:45.294252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2613e60-17fc-478a-b4ed-17c69fc06d16 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:45.294886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a2613e60-17fc-478a-b4ed-17c69fc06d16 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:45.368455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a2613e60-17fc-478a-b4ed-17c69fc06d16 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:49:45.582876 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a2613e60-17fc-478a-b4ed-17c69fc06d16 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 204 len: 0 microversion: 2.1 time: 0.319269 Sep 10 10:49:45.589651 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2291/2797] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:49:45 2022] DELETE /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:49:45.605795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6c9759a-1fb9-4593-958f-bb8c8f552f3e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:45.606515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c6c9759a-1fb9-4593-958f-bb8c8f552f3e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:45.640736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6c9759a-1fb9-4593-958f-bb8c8f552f3e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:45.641311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6c9759a-1fb9-4593-958f-bb8c8f552f3e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:45.641751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6c9759a-1fb9-4593-958f-bb8c8f552f3e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:45.642470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6c9759a-1fb9-4593-958f-bb8c8f552f3e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:45.642897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6c9759a-1fb9-4593-958f-bb8c8f552f3e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:45.661640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6c9759a-1fb9-4593-958f-bb8c8f552f3e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:46.181785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c6c9759a-1fb9-4593-958f-bb8c8f552f3e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:46.194871 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c6c9759a-1fb9-4593-958f-bb8c8f552f3e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1318 microversion: 2.1 time: 0.604838 Sep 10 10:49:46.195503 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2292/2798] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:45 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1318 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:46.203787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-072e47fb-467d-4413-a49f-c88bf6630c1b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:46.206188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-072e47fb-467d-4413-a49f-c88bf6630c1b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:46.225401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072e47fb-467d-4413-a49f-c88bf6630c1b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:46.225914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072e47fb-467d-4413-a49f-c88bf6630c1b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:46.226383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072e47fb-467d-4413-a49f-c88bf6630c1b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:46.229023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072e47fb-467d-4413-a49f-c88bf6630c1b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:46.229537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072e47fb-467d-4413-a49f-c88bf6630c1b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:46.230147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072e47fb-467d-4413-a49f-c88bf6630c1b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:46.415811 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-072e47fb-467d-4413-a49f-c88bf6630c1b tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action" status: 202 len: 0 microversion: 2.1 time: 0.218359 Sep 10 10:49:46.417038 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2293/2799] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:49:46 2022] POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:49:46.426864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-771875807", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": "none"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:46.583321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:49:46.588740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:49:46.591004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:49:46.593319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:49:46.596247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:49:46.629268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:46.633658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:46.634278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:46.635074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:46.635541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:46.635968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:46.657958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:46.687666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Getting quotas for project a43851400d0a427ab18328c92b349fbf. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:49:46.701933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Getting quotas for user 52c0efce1fa344059de5505b96930282 and project a43851400d0a427ab18328c92b349fbf. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:49:46.735128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:49:46.739060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:49:46.836443 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab0bf780-e609-4fbc-a1e6-d39faa6cfcf8 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.418052 Sep 10 10:49:46.841418 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2294/2800] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:49:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 10:49:46.848079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a776c1f-ca13-4b03-be97-0d877ad141b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:46.853167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a776c1f-ca13-4b03-be97-0d877ad141b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:46.872131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a776c1f-ca13-4b03-be97-0d877ad141b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:46.873722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a776c1f-ca13-4b03-be97-0d877ad141b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:46.877836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a776c1f-ca13-4b03-be97-0d877ad141b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:46.905708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a776c1f-ca13-4b03-be97-0d877ad141b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:46.906242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a776c1f-ca13-4b03-be97-0d877ad141b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:46.906938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a776c1f-ca13-4b03-be97-0d877ad141b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:47.266581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a776c1f-ca13-4b03-be97-0d877ad141b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b257d1488141689c826efe484e4040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c408248417b4deaaa26ef380da4bb90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:47.278296 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a776c1f-ca13-4b03-be97-0d877ad141b4 tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 200 len: 1425 microversion: 2.1 time: 0.435745 Sep 10 10:49:47.279753 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2295/2801] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:46 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 1425 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:47.284646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:47.286403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:47.299762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:47.300590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:47.301474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:47.302555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:47.303390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:47.304066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:47.349414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:47.350706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:47.351639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:47.352871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lazy-loading 'fault' on Instance uuid cc0e0a60-5b09-404d-8e58-92a80dad0840 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:49:47.711777 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8df59b2f-d00e-4fc3-a31b-2bbca13e02a7 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1596 microversion: 2.1 time: 0.429676 Sep 10 10:49:47.713095 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2296/2802] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:47 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1596 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:47.725826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1b58fb0c-340f-4aef-8c0d-ef7a1a274037 req-25a0652c-0aa1-4c58-9dd2-3a84804147cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbd1fad-d00f-4532-9b16-5dc493820bf7", "tag": "9fbd9607-a1ea-4dde-bde4-ad4c12562465"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:47.742988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b58fb0c-340f-4aef-8c0d-ef7a1a274037 req-25a0652c-0aa1-4c58-9dd2-3a84804147cf service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:47.743843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b58fb0c-340f-4aef-8c0d-ef7a1a274037 req-25a0652c-0aa1-4c58-9dd2-3a84804147cf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:47.745251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1b58fb0c-340f-4aef-8c0d-ef7a1a274037 req-25a0652c-0aa1-4c58-9dd2-3a84804147cf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:47.773629 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1b58fb0c-340f-4aef-8c0d-ef7a1a274037 req-25a0652c-0aa1-4c58-9dd2-3a84804147cf service nova] Creating event network-changed:9fbd9607-a1ea-4dde-bde4-ad4c12562465 for instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 on n-h2-856894-1 Sep 10 10:49:47.787454 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1b58fb0c-340f-4aef-8c0d-ef7a1a274037 req-25a0652c-0aa1-4c58-9dd2-3a84804147cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068420 Sep 10 10:49:47.793005 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2297/2803] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:47.812820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-639d8cd8-cf1f-43c7-b2ee-807fafc45103 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:47.822884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-639d8cd8-cf1f-43c7-b2ee-807fafc45103 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:48.023391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-639d8cd8-cf1f-43c7-b2ee-807fafc45103 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:48.026882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-639d8cd8-cf1f-43c7-b2ee-807fafc45103 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:48.029951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-639d8cd8-cf1f-43c7-b2ee-807fafc45103 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:48.500884 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-639d8cd8-cf1f-43c7-b2ee-807fafc45103 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "PUT /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 991 microversion: 2.47 time: 0.701458 Sep 10 10:49:48.515809 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2298/2804] 10.222.0.20 () {62 vars in 1297 bytes} [Sat Sep 10 10:49:47 2022] PUT /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 991 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:49:48.533418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-515a7aa7-02e3-4fde-addd-34c734cd02c6 req-6d3b1ede-530a-4eb5-ae59-79d451e1163b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e93b86a-4f96-4e67-8d62-bc190286a2f9", "name": "network-vif-deleted", "tag": "cc11e812-1e24-4e7c-8919-bcc89ad1958c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:48.551749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-515a7aa7-02e3-4fde-addd-34c734cd02c6 req-6d3b1ede-530a-4eb5-ae59-79d451e1163b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:48.552490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-515a7aa7-02e3-4fde-addd-34c734cd02c6 req-6d3b1ede-530a-4eb5-ae59-79d451e1163b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:48.553971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-515a7aa7-02e3-4fde-addd-34c734cd02c6 req-6d3b1ede-530a-4eb5-ae59-79d451e1163b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:48.596067 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-515a7aa7-02e3-4fde-addd-34c734cd02c6 req-6d3b1ede-530a-4eb5-ae59-79d451e1163b service nova] Creating event network-vif-deleted:cc11e812-1e24-4e7c-8919-bcc89ad1958c for instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 on n-h1-856894-1 Sep 10 10:49:48.606692 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-515a7aa7-02e3-4fde-addd-34c734cd02c6 req-6d3b1ede-530a-4eb5-ae59-79d451e1163b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088958 Sep 10 10:49:48.608876 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2299/2805] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:48.631020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e04f5d03-f816-4ff7-8898-f3ea2497cf1b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:48.631771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e04f5d03-f816-4ff7-8898-f3ea2497cf1b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:48.646104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04f5d03-f816-4ff7-8898-f3ea2497cf1b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:48.646875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04f5d03-f816-4ff7-8898-f3ea2497cf1b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:48.648986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04f5d03-f816-4ff7-8898-f3ea2497cf1b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:48.651164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04f5d03-f816-4ff7-8898-f3ea2497cf1b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:48.651823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04f5d03-f816-4ff7-8898-f3ea2497cf1b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:48.655350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04f5d03-f816-4ff7-8898-f3ea2497cf1b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:49.106816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e04f5d03-f816-4ff7-8898-f3ea2497cf1b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:49.146106 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e04f5d03-f816-4ff7-8898-f3ea2497cf1b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1318 microversion: 2.1 time: 0.523057 Sep 10 10:49:49.146777 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2300/2806] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:48 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:49.152021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-852bb4b4-f25a-49c4-9567-7214f667f0f5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:49.178097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-852bb4b4-f25a-49c4-9567-7214f667f0f5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:49.198202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-852bb4b4-f25a-49c4-9567-7214f667f0f5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:49.198713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-852bb4b4-f25a-49c4-9567-7214f667f0f5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:49.199155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-852bb4b4-f25a-49c4-9567-7214f667f0f5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:49.199861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-852bb4b4-f25a-49c4-9567-7214f667f0f5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:49.200314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-852bb4b4-f25a-49c4-9567-7214f667f0f5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:49.200734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-852bb4b4-f25a-49c4-9567-7214f667f0f5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:49.381928 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-852bb4b4-f25a-49c4-9567-7214f667f0f5 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action" status: 202 len: 0 microversion: 2.1 time: 0.233925 Sep 10 10:49:49.383137 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2301/2807] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:49:49 2022] POST /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:49:49.389229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:49.390118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] [instance: 8e93b86a-4f96-4e67-8d62-bc190286a2f9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:49.410119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:49.411973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:49.414273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:49.418480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:49.419195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:49.434002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:49.480049 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] HTTP exception thrown: Instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 could not be found. Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Request method failure captured: Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 HTTP/1.1 Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGpQfbf1zsucCvXg9cXzpLWHGLyVY7mkoPKOcuR2jyC7XL8wdzV1o3ttaR_wFfoegiiVWl1adhRkew3IDICJSFVOU9w1bXnDwRICTyiLT-HPad7ao9E5h-tKrsP2kIJ9jOVTM3zJZfI43_ZFnPHtycrlClPpq91nFATjVuTAtDGokmo Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 7c408248417b4deaaa26ef380da4bb90 Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c408248417b4deaaa26ef380da4bb90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c408248417b4deaaa26ef380da4bb90", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 7c408248417b4deaaa26ef380da4bb90 Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-MigrationsAdminTest-82215703 Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-MigrationsAdminTest-82215703-project Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: f5b257d1488141689c826efe484e4040 Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-MigrationsAdminTest-82215703-project Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 could not be found. Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '8e93b86a-4f96-4e67-8d62-bc190286a2f9'} Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 could not be found. Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 could not be found. Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:49.486595 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:49.491132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:49.491132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:49.491132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:49.491132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:49:49.491132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:49:49.491132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 could not be found. Sep 10 10:49:49.491132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:49.492747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] Returning 404 to user: Instance 8e93b86a-4f96-4e67-8d62-bc190286a2f9 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:49:49.497305 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a736b432-d658-48ca-a338-099366ac612e tempest-MigrationsAdminTest-82215703 tempest-MigrationsAdminTest-82215703-project] 10.222.0.20 "GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9" status: 404 len: 111 microversion: 2.1 time: 0.111914 Sep 10 10:49:49.498065 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2302/2808] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:49 2022] GET /compute/v2.1/servers/8e93b86a-4f96-4e67-8d62-bc190286a2f9 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:49:49.537697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:49.540660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:49.570424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:49.574322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:49.576564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:49.583507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:49.584255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:49.585905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:49.905203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:49.922357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:49.924761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:49.926241 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a46fd94b-8953-4026-9cab-657d838345b6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1273 microversion: 2.47 time: 0.425664 Sep 10 10:49:49.942213 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2303/2809] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:49:49 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1273 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:49:49.953138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-695ba1ca-4509-4b5c-aeea-d8054d2e5e24 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:49.954095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-695ba1ca-4509-4b5c-aeea-d8054d2e5e24 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:49.976047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695ba1ca-4509-4b5c-aeea-d8054d2e5e24 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:49.981587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695ba1ca-4509-4b5c-aeea-d8054d2e5e24 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:49.982305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695ba1ca-4509-4b5c-aeea-d8054d2e5e24 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:49.984489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695ba1ca-4509-4b5c-aeea-d8054d2e5e24 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:49.986118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695ba1ca-4509-4b5c-aeea-d8054d2e5e24 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:49.987333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695ba1ca-4509-4b5c-aeea-d8054d2e5e24 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:50.424148 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-695ba1ca-4509-4b5c-aeea-d8054d2e5e24 tempest-ServersAdminTestJSON-975689647 tempest-ServersAdminTestJSON-975689647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1613 microversion: 2.1 time: 0.480405 Sep 10 10:49:50.428905 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2304/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:49 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1613 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:50.437166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73066492-18fa-4dc1-a710-5d9f41fd2ccb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:50.439819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73066492-18fa-4dc1-a710-5d9f41fd2ccb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:50.468064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73066492-18fa-4dc1-a710-5d9f41fd2ccb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:50.468921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73066492-18fa-4dc1-a710-5d9f41fd2ccb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:50.469770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73066492-18fa-4dc1-a710-5d9f41fd2ccb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:50.470722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73066492-18fa-4dc1-a710-5d9f41fd2ccb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:50.471406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73066492-18fa-4dc1-a710-5d9f41fd2ccb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:50.472191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73066492-18fa-4dc1-a710-5d9f41fd2ccb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:50.952169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73066492-18fa-4dc1-a710-5d9f41fd2ccb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:50.961794 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73066492-18fa-4dc1-a710-5d9f41fd2ccb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1318 microversion: 2.1 time: 0.531656 Sep 10 10:49:50.964047 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2305/2811] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:50 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:50.982449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-18bcd32e-d7ca-4d4f-bb25-2b6066a0c2a5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:50.983215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-18bcd32e-d7ca-4d4f-bb25-2b6066a0c2a5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:50.994262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18bcd32e-d7ca-4d4f-bb25-2b6066a0c2a5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:50.995546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18bcd32e-d7ca-4d4f-bb25-2b6066a0c2a5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:51.003926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18bcd32e-d7ca-4d4f-bb25-2b6066a0c2a5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:51.004869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18bcd32e-d7ca-4d4f-bb25-2b6066a0c2a5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:51.005533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18bcd32e-d7ca-4d4f-bb25-2b6066a0c2a5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:51.006272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18bcd32e-d7ca-4d4f-bb25-2b6066a0c2a5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:51.082249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-18bcd32e-d7ca-4d4f-bb25-2b6066a0c2a5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:49:51.305715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:51.358528 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-18bcd32e-d7ca-4d4f-bb25-2b6066a0c2a5 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 204 len: 0 microversion: 2.1 time: 0.386577 Sep 10 10:49:51.360058 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2306/2812] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:49:50 2022] DELETE /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:49:51.376610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:51.378308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:51.407100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:51.408567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:51.409452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:51.410692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:51.411364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:51.411961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:51.569613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:51.589151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:51.594550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:51.597301 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0cfc0e82-eb05-4bde-bb35-3dcf52b5af48 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1335 microversion: 2.47 time: 0.235053 Sep 10 10:49:51.600747 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2307/2813] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:49:51 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1335 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:49:51.629170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-283084bb-aa75-46e7-af9a-a810c0b611d1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:51.632306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-283084bb-aa75-46e7-af9a-a810c0b611d1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:51.674939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-283084bb-aa75-46e7-af9a-a810c0b611d1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:51.675603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-283084bb-aa75-46e7-af9a-a810c0b611d1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:51.676126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-283084bb-aa75-46e7-af9a-a810c0b611d1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:51.676970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-283084bb-aa75-46e7-af9a-a810c0b611d1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:51.677730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-283084bb-aa75-46e7-af9a-a810c0b611d1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:51.678365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-283084bb-aa75-46e7-af9a-a810c0b611d1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:52.056609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-283084bb-aa75-46e7-af9a-a810c0b611d1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:52.066360 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-283084bb-aa75-46e7-af9a-a810c0b611d1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1469 microversion: 2.1 time: 0.463265 Sep 10 10:49:52.068387 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2308/2814] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:51 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1469 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:52.075430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f73c69cb-1036-4794-a9de-f1f6665842ae tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:52.089977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f73c69cb-1036-4794-a9de-f1f6665842ae tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:52.106373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f73c69cb-1036-4794-a9de-f1f6665842ae tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:52.114578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f73c69cb-1036-4794-a9de-f1f6665842ae tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:52.115267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f73c69cb-1036-4794-a9de-f1f6665842ae tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:52.117824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f73c69cb-1036-4794-a9de-f1f6665842ae tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:52.118467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f73c69cb-1036-4794-a9de-f1f6665842ae tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:52.121051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f73c69cb-1036-4794-a9de-f1f6665842ae tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:52.524350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f73c69cb-1036-4794-a9de-f1f6665842ae tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:52.540755 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f73c69cb-1036-4794-a9de-f1f6665842ae tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1318 microversion: 2.1 time: 0.470282 Sep 10 10:49:52.543184 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2309/2815] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:52 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:52.638247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:52.648241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:52.660552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:52.661859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:52.670402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:52.673758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:52.680029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:52.681439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:52.696870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:52.909370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:52.927547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:52.932819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:52.935968 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-44e9ef51-1958-42fd-8e2f-7bcde8907415 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1335 microversion: 2.47 time: 0.311298 Sep 10 10:49:52.937711 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2310/2816] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:49:52 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1335 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:49:53.101623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6eb9d79e-83c9-46b2-92e5-50dde71f9e38 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:53.102532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6eb9d79e-83c9-46b2-92e5-50dde71f9e38 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:53.141642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb9d79e-83c9-46b2-92e5-50dde71f9e38 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:53.146026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb9d79e-83c9-46b2-92e5-50dde71f9e38 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:53.148380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb9d79e-83c9-46b2-92e5-50dde71f9e38 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:53.155396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb9d79e-83c9-46b2-92e5-50dde71f9e38 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:53.162795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb9d79e-83c9-46b2-92e5-50dde71f9e38 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:53.165997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb9d79e-83c9-46b2-92e5-50dde71f9e38 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:53.493102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6eb9d79e-83c9-46b2-92e5-50dde71f9e38 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:53.514345 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6eb9d79e-83c9-46b2-92e5-50dde71f9e38 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1469 microversion: 2.1 time: 0.416939 Sep 10 10:49:53.528778 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2311/2817] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:53 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:53.566978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88c503b2-26dc-45c5-969c-971d42645703 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:53.567600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88c503b2-26dc-45c5-969c-971d42645703 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:53.579421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c503b2-26dc-45c5-969c-971d42645703 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:53.579937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c503b2-26dc-45c5-969c-971d42645703 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:53.580786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c503b2-26dc-45c5-969c-971d42645703 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:53.581545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c503b2-26dc-45c5-969c-971d42645703 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:53.582007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c503b2-26dc-45c5-969c-971d42645703 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:53.583709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88c503b2-26dc-45c5-969c-971d42645703 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:54.145746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88c503b2-26dc-45c5-969c-971d42645703 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:54.176077 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88c503b2-26dc-45c5-969c-971d42645703 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1318 microversion: 2.1 time: 0.613213 Sep 10 10:49:54.187284 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2312/2818] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:53 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:49:54.199212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:54.203890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:54.223070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:54.224602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:54.234613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:54.241058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:54.245002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:54.246466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:54.471438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:54.487236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:54.497697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:54.501142 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-590f3e3f-2f00-46d8-ac33-bd6f864ac353 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1335 microversion: 2.47 time: 0.309604 Sep 10 10:49:54.503953 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2313/2819] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:49:54 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1335 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:49:54.542360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1d7cf13-5fe2-4eca-902a-6c31aae6f118 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:54.542977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1d7cf13-5fe2-4eca-902a-6c31aae6f118 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:54.551311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1d7cf13-5fe2-4eca-902a-6c31aae6f118 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:54.552845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1d7cf13-5fe2-4eca-902a-6c31aae6f118 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:54.553509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1d7cf13-5fe2-4eca-902a-6c31aae6f118 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:54.554399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1d7cf13-5fe2-4eca-902a-6c31aae6f118 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:54.555025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1d7cf13-5fe2-4eca-902a-6c31aae6f118 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:54.555804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1d7cf13-5fe2-4eca-902a-6c31aae6f118 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:55.321263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1d7cf13-5fe2-4eca-902a-6c31aae6f118 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:55.334037 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1d7cf13-5fe2-4eca-902a-6c31aae6f118 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 200 len: 1469 microversion: 2.1 time: 0.796019 Sep 10 10:49:55.337438 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2314/2820] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:54 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 1469 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:55.349516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-74620bd8-18c4-4020-a148-4e9fd7bfa157 req-3bd72e0d-0de7-44ee-91f2-280b9f534c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbd1fad-d00f-4532-9b16-5dc493820bf7", "name": "network-vif-plugged", "status": "completed", "tag": "9fbd9607-a1ea-4dde-bde4-ad4c12562465"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:55.383189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-74620bd8-18c4-4020-a148-4e9fd7bfa157 req-3bd72e0d-0de7-44ee-91f2-280b9f534c46 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:55.383689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-74620bd8-18c4-4020-a148-4e9fd7bfa157 req-3bd72e0d-0de7-44ee-91f2-280b9f534c46 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:55.384240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-74620bd8-18c4-4020-a148-4e9fd7bfa157 req-3bd72e0d-0de7-44ee-91f2-280b9f534c46 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:55.403244 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-74620bd8-18c4-4020-a148-4e9fd7bfa157 req-3bd72e0d-0de7-44ee-91f2-280b9f534c46 service nova] Creating event network-vif-plugged:9fbd9607-a1ea-4dde-bde4-ad4c12562465 for instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 on n-h2-856894-1 Sep 10 10:49:55.420674 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-74620bd8-18c4-4020-a148-4e9fd7bfa157 req-3bd72e0d-0de7-44ee-91f2-280b9f534c46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080220 Sep 10 10:49:55.422479 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2315/2821] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:55.434156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b018fa9e-74c2-4024-a55f-4ef0224ca83b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:55.435195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b018fa9e-74c2-4024-a55f-4ef0224ca83b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:55.456386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b018fa9e-74c2-4024-a55f-4ef0224ca83b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:55.456799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b018fa9e-74c2-4024-a55f-4ef0224ca83b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:55.457392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b018fa9e-74c2-4024-a55f-4ef0224ca83b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:55.461188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b018fa9e-74c2-4024-a55f-4ef0224ca83b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:55.461943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b018fa9e-74c2-4024-a55f-4ef0224ca83b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:55.463762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b018fa9e-74c2-4024-a55f-4ef0224ca83b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:55.774945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b018fa9e-74c2-4024-a55f-4ef0224ca83b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:55.792627 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b018fa9e-74c2-4024-a55f-4ef0224ca83b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1318 microversion: 2.1 time: 0.365681 Sep 10 10:49:55.794469 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2316/2822] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:55 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:55.818711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-75713294-0f26-4484-91c4-249480c8563f req-b83fb7fc-239e-4ae9-b6c9-008bb1804af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fecc3604-4982-44d0-8db3-3851a489bbe0", "name": "network-vif-deleted", "tag": "58fc25cf-6f2b-4427-9708-006b8323b627"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:55.845115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-75713294-0f26-4484-91c4-249480c8563f req-b83fb7fc-239e-4ae9-b6c9-008bb1804af0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:55.845962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-75713294-0f26-4484-91c4-249480c8563f req-b83fb7fc-239e-4ae9-b6c9-008bb1804af0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:55.848366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-75713294-0f26-4484-91c4-249480c8563f req-b83fb7fc-239e-4ae9-b6c9-008bb1804af0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:55.887339 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-75713294-0f26-4484-91c4-249480c8563f req-b83fb7fc-239e-4ae9-b6c9-008bb1804af0 service nova] Creating event network-vif-deleted:58fc25cf-6f2b-4427-9708-006b8323b627 for instance fecc3604-4982-44d0-8db3-3851a489bbe0 on n-h2-856894-1 Sep 10 10:49:55.925739 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-75713294-0f26-4484-91c4-249480c8563f req-b83fb7fc-239e-4ae9-b6c9-008bb1804af0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129166 Sep 10 10:49:55.926632 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2317/2823] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:49:55.935532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f390b586-144b-42b6-868d-237158ab89b4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:55.939885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f390b586-144b-42b6-868d-237158ab89b4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:55.965837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f390b586-144b-42b6-868d-237158ab89b4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:55.980058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f390b586-144b-42b6-868d-237158ab89b4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:55.981039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f390b586-144b-42b6-868d-237158ab89b4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:55.982599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f390b586-144b-42b6-868d-237158ab89b4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:55.985440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f390b586-144b-42b6-868d-237158ab89b4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:55.986102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f390b586-144b-42b6-868d-237158ab89b4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.167368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f390b586-144b-42b6-868d-237158ab89b4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:56.182538 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f390b586-144b-42b6-868d-237158ab89b4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.253690 Sep 10 10:49:56.198148 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2318/2824] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:55 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:56.210348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:56.211680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:56.220020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.220512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.220950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.223648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.224132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.224556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.307229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:56.319466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:56.322237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:56.324391 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d7424160-1f37-4d38-a1f0-8507940bafd6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1356 microversion: 2.47 time: 0.124764 Sep 10 10:49:56.325569 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2319/2825] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:49:56 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1356 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:49:56.331222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-06eca0ec-ef19-4b00-9a38-57b1035107b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1228531566"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:56.335547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-06eca0ec-ef19-4b00-9a38-57b1035107b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:56.347469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06eca0ec-ef19-4b00-9a38-57b1035107b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.347970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06eca0ec-ef19-4b00-9a38-57b1035107b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.348599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06eca0ec-ef19-4b00-9a38-57b1035107b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.349663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06eca0ec-ef19-4b00-9a38-57b1035107b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.350426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06eca0ec-ef19-4b00-9a38-57b1035107b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.350899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06eca0ec-ef19-4b00-9a38-57b1035107b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.636158 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-06eca0ec-ef19-4b00-9a38-57b1035107b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.306023 Sep 10 10:49:56.642191 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2320/2826] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:49:56 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 10 10:49:56.655560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:56.662871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:56.675366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:56.677625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.678022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.678460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.679161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.679647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.680021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.727108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=14 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:56.778011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:49:56.778434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:49:56.779248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:49:56.779916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:49:56.780334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:49:56.845871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:56.852304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.853031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.854300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.855184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.855851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.856287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.894161 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-37eb7fd1-1a8b-45f9-b345-182947724029 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "POST /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62/action" status: 202 len: 1078 microversion: 2.47 time: 0.246898 Sep 10 10:49:56.895134 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2321/2827] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:49:56 2022] POST /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62/action => generated 1078 bytes in 252 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 10:49:56.899662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:56.900303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: fecc3604-4982-44d0-8db3-3851a489bbe0] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:56.908438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.909587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.910226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.910947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.911433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.911877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.928818 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] HTTP exception thrown: Instance fecc3604-4982-44d0-8db3-3851a489bbe0 could not be found. Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Request method failure captured: Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 HTTP/1.1 Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGsuWOztucEDGbQIVo0gt5ELd3FWQ1j_EP5EOEN7RRy4uP83f2laGGAR7LsjGSUI6b2xctZFIa_7ZjK2FWUlKvtfiVqzVWyZIcQQ1BB5qIwSTH20xbTrjbnDVMPLKaiTAB0Kp8BE1WyXTafR2WG6MHHD7PAbujFXSj2m0aZa99hoBVk Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: a8e0700581294ce78914145c18a1a70f Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersAdminTestJSON-1241323966 Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8e0700581294ce78914145c18a1a70f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a8e0700581294ce78914145c18a1a70f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8e0700581294ce78914145c18a1a70f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a8e0700581294ce78914145c18a1a70f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersAdminTestJSON-1241323966 Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: a8e0700581294ce78914145c18a1a70f Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersAdminTestJSON-1241323966 Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersAdminTestJSON-1241323966-project Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 036380e89f5e422ab0e5a66ee0a98777 Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersAdminTestJSON-1241323966-project Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance fecc3604-4982-44d0-8db3-3851a489bbe0 could not be found. Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'fecc3604-4982-44d0-8db3-3851a489bbe0'} Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fecc3604-4982-44d0-8db3-3851a489bbe0 could not be found. Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fecc3604-4982-44d0-8db3-3851a489bbe0 could not be found. Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:49:56.930735 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:56.938249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:49:56.938249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:49:56.938249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:49:56.938249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:49:56.938249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:49:56.938249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fecc3604-4982-44d0-8db3-3851a489bbe0 could not be found. Sep 10 10:49:56.938249 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:49:56.938249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Returning 404 to user: Instance fecc3604-4982-44d0-8db3-3851a489bbe0 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:49:56.938249 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1698cf2-2d37-4325-9b70-d3ed270c75e2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0" status: 404 len: 111 microversion: 2.1 time: 0.036610 Sep 10 10:49:56.938249 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2322/2828] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:56 2022] GET /compute/v2.1/servers/fecc3604-4982-44d0-8db3-3851a489bbe0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:49:56.941804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23944174-b6b7-42b8-870b-8e3329e1a928 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:56.942136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23944174-b6b7-42b8-870b-8e3329e1a928 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:56.948442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23944174-b6b7-42b8-870b-8e3329e1a928 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.949694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23944174-b6b7-42b8-870b-8e3329e1a928 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.950024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23944174-b6b7-42b8-870b-8e3329e1a928 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:56.951217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23944174-b6b7-42b8-870b-8e3329e1a928 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:56.952019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23944174-b6b7-42b8-870b-8e3329e1a928 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:56.952713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23944174-b6b7-42b8-870b-8e3329e1a928 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:57.131944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23944174-b6b7-42b8-870b-8e3329e1a928 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:57.153020 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23944174-b6b7-42b8-870b-8e3329e1a928 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1318 microversion: 2.1 time: 0.218627 Sep 10 10:49:57.171775 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2323/2829] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:56 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:57.179122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:57.180224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:57.195108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:57.195709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:57.196159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:57.196855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:57.197569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:57.198167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:57.276499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:57.286198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:57.287777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:57.289328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f8edd40-5ea9-4d49-a3e4-419dfdde6c90 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.116272 Sep 10 10:49:57.301109 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2324/2830] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:49:57 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:49:57.301109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-beb2cfd9-3fe7-4365-bd07-b98c021b9a59 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:57.301109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-beb2cfd9-3fe7-4365-bd07-b98c021b9a59 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:57.308321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beb2cfd9-3fe7-4365-bd07-b98c021b9a59 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:57.308321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beb2cfd9-3fe7-4365-bd07-b98c021b9a59 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:57.308321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beb2cfd9-3fe7-4365-bd07-b98c021b9a59 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:57.308321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beb2cfd9-3fe7-4365-bd07-b98c021b9a59 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:57.308321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beb2cfd9-3fe7-4365-bd07-b98c021b9a59 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:57.308321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beb2cfd9-3fe7-4365-bd07-b98c021b9a59 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:57.325763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:49:57.334926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-beb2cfd9-3fe7-4365-bd07-b98c021b9a59 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:49:57.439519 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-beb2cfd9-3fe7-4365-bd07-b98c021b9a59 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 204 len: 0 microversion: 2.1 time: 0.147302 Sep 10 10:49:57.443402 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2325/2831] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:49:57 2022] DELETE /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:49:57.450009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73360c1f-999d-47df-abb6-ed5035f60075 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:57.450630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73360c1f-999d-47df-abb6-ed5035f60075 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:57.458541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73360c1f-999d-47df-abb6-ed5035f60075 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:57.458964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73360c1f-999d-47df-abb6-ed5035f60075 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:57.459412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73360c1f-999d-47df-abb6-ed5035f60075 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:57.460454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73360c1f-999d-47df-abb6-ed5035f60075 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:57.460883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73360c1f-999d-47df-abb6-ed5035f60075 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:57.461352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73360c1f-999d-47df-abb6-ed5035f60075 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:57.641806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73360c1f-999d-47df-abb6-ed5035f60075 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:57.651509 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73360c1f-999d-47df-abb6-ed5035f60075 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1468 microversion: 2.1 time: 0.206653 Sep 10 10:49:57.652299 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2326/2832] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:57 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1468 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:58.183611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e605851-794e-4842-a60a-a2ece2c353de tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:58.185856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e605851-794e-4842-a60a-a2ece2c353de tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:58.193643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e605851-794e-4842-a60a-a2ece2c353de tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:58.194255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e605851-794e-4842-a60a-a2ece2c353de tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:58.194695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e605851-794e-4842-a60a-a2ece2c353de tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:58.195425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e605851-794e-4842-a60a-a2ece2c353de tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:58.195880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e605851-794e-4842-a60a-a2ece2c353de tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:58.196297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e605851-794e-4842-a60a-a2ece2c353de tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:58.359913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e605851-794e-4842-a60a-a2ece2c353de tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:58.372714 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e605851-794e-4842-a60a-a2ece2c353de tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1509 microversion: 2.1 time: 0.194539 Sep 10 10:49:58.374796 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2327/2833] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:58 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:49:58.381850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:58.382713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:58.390720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:58.393164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:58.395339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:58.397898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:58.400296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:58.403575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:58.496478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:58.506250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:58.508012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:58.509243 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed6c6852-e281-4e79-9727-41216a618631 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.132885 Sep 10 10:49:58.521683 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2328/2834] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:49:58 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:49:58.535613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-25d67b2c-4055-4e25-b986-e20d8b92eaad tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:58.536492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-25d67b2c-4055-4e25-b986-e20d8b92eaad tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:58.543072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25d67b2c-4055-4e25-b986-e20d8b92eaad tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:58.543795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25d67b2c-4055-4e25-b986-e20d8b92eaad tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:58.544416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25d67b2c-4055-4e25-b986-e20d8b92eaad tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:58.548966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25d67b2c-4055-4e25-b986-e20d8b92eaad tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:58.549841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25d67b2c-4055-4e25-b986-e20d8b92eaad tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:58.550458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25d67b2c-4055-4e25-b986-e20d8b92eaad tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:58.761703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25d67b2c-4055-4e25-b986-e20d8b92eaad tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:58.784867 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-25d67b2c-4055-4e25-b986-e20d8b92eaad tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1509 microversion: 2.1 time: 0.260775 Sep 10 10:49:58.786774 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2329/2835] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:58 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:58.805297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23e802c9-f688-48bf-bb8a-a602ae55268f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:49:58.807101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23e802c9-f688-48bf-bb8a-a602ae55268f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:58.815005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e802c9-f688-48bf-bb8a-a602ae55268f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:58.815764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e802c9-f688-48bf-bb8a-a602ae55268f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:58.817959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e802c9-f688-48bf-bb8a-a602ae55268f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:58.818931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e802c9-f688-48bf-bb8a-a602ae55268f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:58.819623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e802c9-f688-48bf-bb8a-a602ae55268f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:58.820434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e802c9-f688-48bf-bb8a-a602ae55268f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:59.008280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23e802c9-f688-48bf-bb8a-a602ae55268f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:49:59.028062 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23e802c9-f688-48bf-bb8a-a602ae55268f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1468 microversion: 2.1 time: 0.238423 Sep 10 10:49:59.032216 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2330/2836] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:49:58 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:49:59.465174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1669342393", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": "none"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:59.563605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:49:59.564044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:49:59.564502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:49:59.564925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:49:59.565367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:49:59.588298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:59.588788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:59.589261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:59.590962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:59.591644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:59.592274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:59.615124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Getting quotas for project 31435b92586b4306a63134bf958f157e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:49:59.622958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Getting quotas for user 06d856288f8c407dac317f7d97ba7fe9 and project 31435b92586b4306a63134bf958f157e. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:49:59.637681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:49:59.640471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:49:59.705398 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-253e2d45-e5a7-4043-bf00-df1d20c66ce0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.669449 Sep 10 10:49:59.708094 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2331/2837] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:49:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 10:49:59.715178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:49:59.719403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:59.730023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:59.730947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:59.731399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:59.732606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:59.733686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:59.734142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:59.867975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:49:59.868741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:49:59.870210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:49:59.870789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:49:59.871441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:49:59.976564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:49:59.991595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:59.993478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:59.995073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:49:59.996237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:49:59.997578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:49:59.998560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:00.052361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d056b16b-1fe4-4ea1-8413-f2388df53e0d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "POST /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7/action" status: 202 len: 1111 microversion: 2.1 time: 0.342554 Sep 10 10:50:00.053644 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2332/2838] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:49:59 2022] POST /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7/action => generated 1111 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 10:50:00.059247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:00.059857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:00.066214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:00.067727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:00.068175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:00.068967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:00.069413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:00.070022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:00.256023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:00.268068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:00.269604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:00.271218 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb4b8afa-85cd-4c9b-954b-a4403ec9f85f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.216273 Sep 10 10:50:00.272499 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2333/2839] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:00 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:00.280604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9751403d-1085-4980-9e2f-74bf888aa4ad tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:00.283197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9751403d-1085-4980-9e2f-74bf888aa4ad tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:00.370779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9751403d-1085-4980-9e2f-74bf888aa4ad tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:00.380998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9751403d-1085-4980-9e2f-74bf888aa4ad tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:00.382687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9751403d-1085-4980-9e2f-74bf888aa4ad tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:00.390886 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9751403d-1085-4980-9e2f-74bf888aa4ad tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "PUT /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1359 microversion: 2.75 time: 0.116907 Sep 10 10:50:00.406598 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2334/2840] 10.222.0.20 () {62 vars in 1297 bytes} [Sat Sep 10 10:50:00 2022] PUT /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1359 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:00.419329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1d6e1f6-4937-468a-a94e-b29c2b948557 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:00.420037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1d6e1f6-4937-468a-a94e-b29c2b948557 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:00.429135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d6e1f6-4937-468a-a94e-b29c2b948557 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:00.430371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d6e1f6-4937-468a-a94e-b29c2b948557 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:00.432058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d6e1f6-4937-468a-a94e-b29c2b948557 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:00.433534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d6e1f6-4937-468a-a94e-b29c2b948557 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:00.434304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d6e1f6-4937-468a-a94e-b29c2b948557 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:00.435395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d6e1f6-4937-468a-a94e-b29c2b948557 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:00.544765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b1d6e1f6-4937-468a-a94e-b29c2b948557 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:00.557846 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1d6e1f6-4937-468a-a94e-b29c2b948557 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1298 microversion: 2.1 time: 0.147964 Sep 10 10:50:00.559047 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2335/2841] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:00 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1298 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:00.567250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-662e242c-cd71-468d-aaf2-83de30c30539 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:00.568558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-662e242c-cd71-468d-aaf2-83de30c30539 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:00.598227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:00.613105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-662e242c-cd71-468d-aaf2-83de30c30539 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:00.615757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-662e242c-cd71-468d-aaf2-83de30c30539 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:00.617342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-662e242c-cd71-468d-aaf2-83de30c30539 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:00.618140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-662e242c-cd71-468d-aaf2-83de30c30539 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:00.618573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-662e242c-cd71-468d-aaf2-83de30c30539 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:00.619078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-662e242c-cd71-468d-aaf2-83de30c30539 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:00.871405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-662e242c-cd71-468d-aaf2-83de30c30539 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:00.889325 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-662e242c-cd71-468d-aaf2-83de30c30539 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.327387 Sep 10 10:50:00.891452 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2336/2842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:00 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:00.904983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-be6f0a8d-7407-440e-85bc-56a580793fe9 req-a781e8aa-2b10-4225-953e-313ab90faf1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3da4a780-1e9e-4a12-822a-37ad1fe25cf4", "name": "network-vif-deleted", "tag": "2e1a1d7b-02bc-4ca5-85bc-31e5ad0606a0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:00.922367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-be6f0a8d-7407-440e-85bc-56a580793fe9 req-a781e8aa-2b10-4225-953e-313ab90faf1e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:00.923224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-be6f0a8d-7407-440e-85bc-56a580793fe9 req-a781e8aa-2b10-4225-953e-313ab90faf1e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:00.924475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-be6f0a8d-7407-440e-85bc-56a580793fe9 req-a781e8aa-2b10-4225-953e-313ab90faf1e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:00.953357 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-be6f0a8d-7407-440e-85bc-56a580793fe9 req-a781e8aa-2b10-4225-953e-313ab90faf1e service nova] Creating event network-vif-deleted:2e1a1d7b-02bc-4ca5-85bc-31e5ad0606a0 for instance 3da4a780-1e9e-4a12-822a-37ad1fe25cf4 on n-h2-856894-1 Sep 10 10:50:00.961783 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-be6f0a8d-7407-440e-85bc-56a580793fe9 req-a781e8aa-2b10-4225-953e-313ab90faf1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068994 Sep 10 10:50:00.963216 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2337/2843] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:00.970800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0626e1b5-58d4-478f-8531-2cef890ee9dd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:00.971905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0626e1b5-58d4-478f-8531-2cef890ee9dd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:01.052394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0626e1b5-58d4-478f-8531-2cef890ee9dd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:01.070551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0626e1b5-58d4-478f-8531-2cef890ee9dd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:01.072347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0626e1b5-58d4-478f-8531-2cef890ee9dd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:01.082144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0626e1b5-58d4-478f-8531-2cef890ee9dd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1359 microversion: 2.75 time: 0.116910 Sep 10 10:50:01.111116 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2338/2844] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:00 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:01.298365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:01.298981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:01.307396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:01.308168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:01.308610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:01.309339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:01.310016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:01.310505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:01.418271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:01.432067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:01.433705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:01.436865 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5452d6ee-d34c-4a4e-8228-3830a2fbe32e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.141529 Sep 10 10:50:01.437999 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2339/2845] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:01 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:01.593028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:01.593958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:01.610351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:01.610853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:01.611291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:01.611996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:01.614296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:01.617140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:01.748086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:01.758143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:01.758758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:01.759271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lazy-loading 'fault' on Instance uuid 3da4a780-1e9e-4a12-822a-37ad1fe25cf4 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:50:01.847108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:01.877584 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb5b580a-6b39-498b-b81e-cce9673040b1 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 200 len: 1303 microversion: 2.1 time: 0.288233 Sep 10 10:50:01.879573 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2340/2846] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:01 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 1303 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:01.916884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ccd14eb5-ff66-4e41-ac9f-14517dfc2420 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:01.918000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ccd14eb5-ff66-4e41-ac9f-14517dfc2420 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:01.927887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd14eb5-ff66-4e41-ac9f-14517dfc2420 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:01.930011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd14eb5-ff66-4e41-ac9f-14517dfc2420 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:01.933941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd14eb5-ff66-4e41-ac9f-14517dfc2420 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:01.936395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd14eb5-ff66-4e41-ac9f-14517dfc2420 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:01.938940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd14eb5-ff66-4e41-ac9f-14517dfc2420 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:01.939572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd14eb5-ff66-4e41-ac9f-14517dfc2420 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:01.998943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:02.170993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ccd14eb5-ff66-4e41-ac9f-14517dfc2420 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:02.181034 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ccd14eb5-ff66-4e41-ac9f-14517dfc2420 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.268728 Sep 10 10:50:02.182423 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2341/2847] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:01 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:02.197778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:02.198486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:02.205520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:02.206246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:02.206872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:02.208198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:02.208823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:02.209951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:02.347978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:02.357644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:02.359901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:02.367142 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fd488a50-bb2b-4988-9516-9da7209e696a tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1411 microversion: 2.75 time: 0.183542 Sep 10 10:50:02.368126 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2342/2848] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:02 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1411 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:02.465399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:02.466171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:02.476342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:02.476944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:02.478456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:02.480379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:02.482501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:02.484039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:02.584937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:02.598130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:02.601047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:02.603335 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e383af3-8f30-4586-832e-1921c4b72c73 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.143307 Sep 10 10:50:02.609217 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2343/2849] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:02 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:03.199610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-dab73e10-be3e-4e2e-9387-6bcee1604a19 req-91c9cedd-48b5-436d-b5ec-f37f4bbfbac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5", "name": "network-vif-plugged", "status": "completed", "tag": "a9a5c077-18b4-45a9-ab46-131e14788b74"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:03.214395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dab73e10-be3e-4e2e-9387-6bcee1604a19 req-91c9cedd-48b5-436d-b5ec-f37f4bbfbac9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:03.214922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dab73e10-be3e-4e2e-9387-6bcee1604a19 req-91c9cedd-48b5-436d-b5ec-f37f4bbfbac9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:03.216982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dab73e10-be3e-4e2e-9387-6bcee1604a19 req-91c9cedd-48b5-436d-b5ec-f37f4bbfbac9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:03.238742 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-dab73e10-be3e-4e2e-9387-6bcee1604a19 req-91c9cedd-48b5-436d-b5ec-f37f4bbfbac9 service nova] Creating event network-vif-plugged:a9a5c077-18b4-45a9-ab46-131e14788b74 for instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 on n-h2-856894-1 Sep 10 10:50:03.250012 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-dab73e10-be3e-4e2e-9387-6bcee1604a19 req-91c9cedd-48b5-436d-b5ec-f37f4bbfbac9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.429978 Sep 10 10:50:03.250748 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2344/2850] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:03.259963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:03.261015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: 3da4a780-1e9e-4a12-822a-37ad1fe25cf4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:03.272661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:03.273763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:03.274981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:03.276397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:03.277459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:03.278006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:03.298241 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] HTTP exception thrown: Instance 3da4a780-1e9e-4a12-822a-37ad1fe25cf4 could not be found. Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Request method failure captured: Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 HTTP/1.1 Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGsuWOztucEDGbQIVo0gt5ELd3FWQ1j_EP5EOEN7RRy4uP83f2laGGAR7LsjGSUI6b2xctZFIa_7ZjK2FWUlKvtfiVqzVWyZIcQQ1BB5qIwSTH20xbTrjbnDVMPLKaiTAB0Kp8BE1WyXTafR2WG6MHHD7PAbujFXSj2m0aZa99hoBVk Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: a8e0700581294ce78914145c18a1a70f Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersAdminTestJSON-1241323966 Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8e0700581294ce78914145c18a1a70f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a8e0700581294ce78914145c18a1a70f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8e0700581294ce78914145c18a1a70f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a8e0700581294ce78914145c18a1a70f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersAdminTestJSON-1241323966 Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: a8e0700581294ce78914145c18a1a70f Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersAdminTestJSON-1241323966 Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersAdminTestJSON-1241323966-project Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 036380e89f5e422ab0e5a66ee0a98777 Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersAdminTestJSON-1241323966-project Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 3da4a780-1e9e-4a12-822a-37ad1fe25cf4 could not be found. Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '3da4a780-1e9e-4a12-822a-37ad1fe25cf4'} Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da4a780-1e9e-4a12-822a-37ad1fe25cf4 could not be found. Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da4a780-1e9e-4a12-822a-37ad1fe25cf4 could not be found. Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:03.300174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:03.310130 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:03.310130 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:03.310130 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:03.310130 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:50:03.310130 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:50:03.310130 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da4a780-1e9e-4a12-822a-37ad1fe25cf4 could not be found. Sep 10 10:50:03.310130 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:03.310130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Returning 404 to user: Instance 3da4a780-1e9e-4a12-822a-37ad1fe25cf4 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:50:03.310130 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cbabc906-3d16-415c-a178-ebab3e1ff0f2 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4" status: 404 len: 111 microversion: 2.1 time: 0.051732 Sep 10 10:50:03.310130 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2345/2851] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:03 2022] GET /compute/v2.1/servers/3da4a780-1e9e-4a12-822a-37ad1fe25cf4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:50:03.313221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1542b8af-95c5-4b94-b9f0-db612a08744e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:03.314031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1542b8af-95c5-4b94-b9f0-db612a08744e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:03.321466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1542b8af-95c5-4b94-b9f0-db612a08744e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:03.322204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1542b8af-95c5-4b94-b9f0-db612a08744e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:03.322827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1542b8af-95c5-4b94-b9f0-db612a08744e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:03.323746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1542b8af-95c5-4b94-b9f0-db612a08744e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:03.324361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1542b8af-95c5-4b94-b9f0-db612a08744e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:03.325033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1542b8af-95c5-4b94-b9f0-db612a08744e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:03.546327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1542b8af-95c5-4b94-b9f0-db612a08744e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:03.559903 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1542b8af-95c5-4b94-b9f0-db612a08744e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.252477 Sep 10 10:50:03.562425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2346/2852] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:03 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:03.583950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f3494c8-96a1-485e-9613-95f35a877bf9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:03.584470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f3494c8-96a1-485e-9613-95f35a877bf9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:03.595839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f3494c8-96a1-485e-9613-95f35a877bf9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:03.597162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f3494c8-96a1-485e-9613-95f35a877bf9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:03.597793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f3494c8-96a1-485e-9613-95f35a877bf9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:03.599016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f3494c8-96a1-485e-9613-95f35a877bf9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:03.600617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f3494c8-96a1-485e-9613-95f35a877bf9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:03.601481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f3494c8-96a1-485e-9613-95f35a877bf9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:03.678842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f3494c8-96a1-485e-9613-95f35a877bf9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:50:03.848251 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f3494c8-96a1-485e-9613-95f35a877bf9 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 204 len: 0 microversion: 2.1 time: 0.282559 Sep 10 10:50:03.849210 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2347/2853] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:50:03 2022] DELETE /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:50:03.863155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:03.863890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:03.871858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:03.872361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:03.872806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:03.873604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:03.874070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:03.874500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:03.969146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:03.988488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:03.990687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:03.998750 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f95e86f6-1033-43a4-9f1b-7e614bca4445 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1417 microversion: 2.75 time: 0.144061 Sep 10 10:50:04.000099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2348/2854] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:03 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1417 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:04.007015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:04.007994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:04.015420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:04.016775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:04.020509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:04.021614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:04.022216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:04.022855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:04.138755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:04.149226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:04.151564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:04.152812 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7bdb6557-60b0-44b0-97d2-7cc50c01ef42 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.151350 Sep 10 10:50:04.176179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2349/2855] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:04 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:04.181707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0910e1ca-0f15-49ca-bbb1-650d67ee0d9f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:04.182551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0910e1ca-0f15-49ca-bbb1-650d67ee0d9f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:04.189199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0910e1ca-0f15-49ca-bbb1-650d67ee0d9f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:04.189904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0910e1ca-0f15-49ca-bbb1-650d67ee0d9f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:04.190640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0910e1ca-0f15-49ca-bbb1-650d67ee0d9f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:04.191738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0910e1ca-0f15-49ca-bbb1-650d67ee0d9f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:04.192607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0910e1ca-0f15-49ca-bbb1-650d67ee0d9f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:04.193235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0910e1ca-0f15-49ca-bbb1-650d67ee0d9f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:04.417404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0910e1ca-0f15-49ca-bbb1-650d67ee0d9f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:04.427538 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0910e1ca-0f15-49ca-bbb1-650d67ee0d9f tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1468 microversion: 2.1 time: 0.249982 Sep 10 10:50:04.428384 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2350/2856] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:04 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1468 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:04.584654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bed1f827-e4ae-47ee-a9f7-c33b6fa6c3da tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:04.585317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bed1f827-e4ae-47ee-a9f7-c33b6fa6c3da tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:04.591725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bed1f827-e4ae-47ee-a9f7-c33b6fa6c3da tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:04.592231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bed1f827-e4ae-47ee-a9f7-c33b6fa6c3da tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:04.592675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bed1f827-e4ae-47ee-a9f7-c33b6fa6c3da tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:04.602266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bed1f827-e4ae-47ee-a9f7-c33b6fa6c3da tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:04.602895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bed1f827-e4ae-47ee-a9f7-c33b6fa6c3da tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:04.603270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bed1f827-e4ae-47ee-a9f7-c33b6fa6c3da tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:04.923662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bed1f827-e4ae-47ee-a9f7-c33b6fa6c3da tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:04.934771 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bed1f827-e4ae-47ee-a9f7-c33b6fa6c3da tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.353835 Sep 10 10:50:04.939773 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2351/2857] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:04 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:05.037260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:05.037889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:05.061522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:05.063660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:05.064368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:05.066370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:05.067700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:05.070904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:05.186710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:05.212564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:05.216587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:05.222990 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76b0e63c-3680-462d-9066-2af38d14c793 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1417 microversion: 2.75 time: 0.192195 Sep 10 10:50:05.224108 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2352/2858] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:05 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1417 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:05.242540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:05.243239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:05.263364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:05.263872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:05.267474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:05.269397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:05.271097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:05.271954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:05.371083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:05.381444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:05.383571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:05.385682 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f48f569a-2ac0-4d65-8764-c5f0840977c0 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.160529 Sep 10 10:50:05.386909 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2353/2859] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:05 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:05.456687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8427888-5f49-47b0-bd78-355a25119391 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:05.457716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8427888-5f49-47b0-bd78-355a25119391 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:05.468986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8427888-5f49-47b0-bd78-355a25119391 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:05.475509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8427888-5f49-47b0-bd78-355a25119391 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:05.476175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8427888-5f49-47b0-bd78-355a25119391 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:05.485300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8427888-5f49-47b0-bd78-355a25119391 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:05.485859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8427888-5f49-47b0-bd78-355a25119391 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:05.490824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8427888-5f49-47b0-bd78-355a25119391 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:05.716624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8427888-5f49-47b0-bd78-355a25119391 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:05.729022 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8427888-5f49-47b0-bd78-355a25119391 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1468 microversion: 2.1 time: 0.278408 Sep 10 10:50:05.729661 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2354/2860] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:05 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1468 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:05.966346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c03c805c-2868-49d6-b652-b89d47bfde78 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:05.967049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c03c805c-2868-49d6-b652-b89d47bfde78 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:05.980660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c805c-2868-49d6-b652-b89d47bfde78 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:05.981974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c805c-2868-49d6-b652-b89d47bfde78 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:05.982682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c805c-2868-49d6-b652-b89d47bfde78 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:05.983627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c805c-2868-49d6-b652-b89d47bfde78 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:05.984350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c805c-2868-49d6-b652-b89d47bfde78 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:05.984996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c805c-2868-49d6-b652-b89d47bfde78 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:06.163995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c03c805c-2868-49d6-b652-b89d47bfde78 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:06.173732 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c03c805c-2868-49d6-b652-b89d47bfde78 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.211372 Sep 10 10:50:06.193335 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2355/2861] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:05 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:06.256746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:06.258616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:06.273899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:06.274975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:06.277929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:06.279244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:06.282012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:06.283664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:06.409981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:06.421761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:06.423822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:06.431987 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8a317306-4dbf-4ac4-9bb6-7f3cc4072e5c tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1417 microversion: 2.75 time: 0.178861 Sep 10 10:50:06.434026 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2356/2862] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:06 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1417 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:06.445523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:06.446552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:06.455289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:06.456252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:06.457060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:06.457982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:06.458765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:06.459358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:06.607655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:06.612606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:06.620348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:06.622534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:06.624159 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-872d931e-5444-42c0-8c4f-8b5bdf6b8d80 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.189005 Sep 10 10:50:06.625386 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2357/2863] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:06 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:06.753778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-67c94247-efe9-40d1-a3cb-27a7f3379424 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:06.755241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-67c94247-efe9-40d1-a3cb-27a7f3379424 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:06.775794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67c94247-efe9-40d1-a3cb-27a7f3379424 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:06.777126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67c94247-efe9-40d1-a3cb-27a7f3379424 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:06.779721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67c94247-efe9-40d1-a3cb-27a7f3379424 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:06.781766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67c94247-efe9-40d1-a3cb-27a7f3379424 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:06.782638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67c94247-efe9-40d1-a3cb-27a7f3379424 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:06.783819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67c94247-efe9-40d1-a3cb-27a7f3379424 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:07.184134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-67c94247-efe9-40d1-a3cb-27a7f3379424 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:07.197269 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-67c94247-efe9-40d1-a3cb-27a7f3379424 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1468 microversion: 2.1 time: 0.448032 Sep 10 10:50:07.200728 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2358/2864] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:06 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1468 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:07.213838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78e104f4-b2e3-491a-93e1-0fb2cf2598f1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:07.214892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78e104f4-b2e3-491a-93e1-0fb2cf2598f1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:07.258870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e104f4-b2e3-491a-93e1-0fb2cf2598f1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:07.260041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e104f4-b2e3-491a-93e1-0fb2cf2598f1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:07.260809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e104f4-b2e3-491a-93e1-0fb2cf2598f1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:07.262125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e104f4-b2e3-491a-93e1-0fb2cf2598f1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:07.264118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e104f4-b2e3-491a-93e1-0fb2cf2598f1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:07.266337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e104f4-b2e3-491a-93e1-0fb2cf2598f1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:07.962657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-78e104f4-b2e3-491a-93e1-0fb2cf2598f1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:07.971651 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78e104f4-b2e3-491a-93e1-0fb2cf2598f1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.769456 Sep 10 10:50:07.972304 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2359/2865] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:07 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:07.996944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:08.001490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:08.018058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:08.020961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:08.021924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:08.022821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:08.025557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:08.026175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:08.213221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:08.225713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:08.228451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:08.238989 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b09f7e2f-52f6-4747-aee9-e33ea9d8b1b8 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1438 microversion: 2.75 time: 0.256527 Sep 10 10:50:08.242202 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2360/2866] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:07 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1438 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:08.249857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:08.250676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:08.261960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:08.262656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:08.263394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:08.264859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:08.265939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:08.266695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:08.441699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:08.457930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:08.459779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:08.467385 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f74b7b84-647e-4494-9742-68e2ae8f94c5 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.219856 Sep 10 10:50:08.467991 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2361/2867] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:08 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:08.481154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b360207-2e3e-46f4-9d16-5a18fb6e9ae7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:08.488063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9b360207-2e3e-46f4-9d16-5a18fb6e9ae7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:08.513131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b360207-2e3e-46f4-9d16-5a18fb6e9ae7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:08.516070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b360207-2e3e-46f4-9d16-5a18fb6e9ae7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:08.517578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b360207-2e3e-46f4-9d16-5a18fb6e9ae7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:08.519539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b360207-2e3e-46f4-9d16-5a18fb6e9ae7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:08.519539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b360207-2e3e-46f4-9d16-5a18fb6e9ae7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:08.519777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b360207-2e3e-46f4-9d16-5a18fb6e9ae7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:08.786444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9b360207-2e3e-46f4-9d16-5a18fb6e9ae7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036380e89f5e422ab0e5a66ee0a98777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e0700581294ce78914145c18a1a70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:08.812682 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9b360207-2e3e-46f4-9d16-5a18fb6e9ae7 tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 200 len: 1426 microversion: 2.1 time: 0.325974 Sep 10 10:50:08.814266 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2362/2868] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:08 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 1426 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:08.824662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:08.827174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:08.834416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:08.835176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:08.835784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:08.836647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:08.837390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:08.838517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:09.058088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:50:09.060320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:50:09.061000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:50:09.062647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:50:09.064199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:50:09.241453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:09.256894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:09.258528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:09.260804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:09.261637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:09.264037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:09.264712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:09.470927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:09.499879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:09.503988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:09.523424 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a8199a9-7ac9-4103-8cd7-12c1a1021353 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "POST /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554/action" status: 202 len: 1495 microversion: 2.75 time: 0.707360 Sep 10 10:50:09.524385 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2363/2869] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:50:08 2022] POST /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554/action => generated 1495 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 10:50:09.529684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3f4b63fb-3b62-4e97-b87e-3af2383e95fb req-6451a735-4460-4626-b763-f2eb95c62764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0e0a60-5b09-404d-8e58-92a80dad0840", "name": "network-vif-deleted", "tag": "9150ee97-5767-40aa-ad6c-5a7df51e7439"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:09.540004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3f4b63fb-3b62-4e97-b87e-3af2383e95fb req-6451a735-4460-4626-b763-f2eb95c62764 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:09.541386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3f4b63fb-3b62-4e97-b87e-3af2383e95fb req-6451a735-4460-4626-b763-f2eb95c62764 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:09.542044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3f4b63fb-3b62-4e97-b87e-3af2383e95fb req-6451a735-4460-4626-b763-f2eb95c62764 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:09.556410 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3f4b63fb-3b62-4e97-b87e-3af2383e95fb req-6451a735-4460-4626-b763-f2eb95c62764 service nova] Creating event network-vif-deleted:9150ee97-5767-40aa-ad6c-5a7df51e7439 for instance cc0e0a60-5b09-404d-8e58-92a80dad0840 on n-h2-856894-1 Sep 10 10:50:09.563012 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3f4b63fb-3b62-4e97-b87e-3af2383e95fb req-6451a735-4460-4626-b763-f2eb95c62764 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037162 Sep 10 10:50:09.568011 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2364/2870] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:09.574275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4eb897ef-7d95-4585-9d18-fa806b2e987b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:09.575302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4eb897ef-7d95-4585-9d18-fa806b2e987b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:09.583015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eb897ef-7d95-4585-9d18-fa806b2e987b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:09.584207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eb897ef-7d95-4585-9d18-fa806b2e987b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:09.584927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eb897ef-7d95-4585-9d18-fa806b2e987b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:09.585968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eb897ef-7d95-4585-9d18-fa806b2e987b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:09.586656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eb897ef-7d95-4585-9d18-fa806b2e987b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:09.587543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eb897ef-7d95-4585-9d18-fa806b2e987b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:09.615337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:09.857940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4eb897ef-7d95-4585-9d18-fa806b2e987b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:09.867298 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4eb897ef-7d95-4585-9d18-fa806b2e987b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.297759 Sep 10 10:50:09.868371 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2365/2871] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:09 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:09.887053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:09.900474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:09.907812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:09.908487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:09.908953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:09.909685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:09.910268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:09.910621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:10.049774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:10.076136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:10.086643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:10.090926 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74232056-ce7c-41dd-9c33-ef27f519d85c tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.220832 Sep 10 10:50:10.098944 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2366/2872] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:09 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:10.117015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:10.118015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:10.141794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:10.146053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:10.146578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:10.147515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:10.148163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:10.148779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:10.266568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:10.290900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:10.296478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:10.307916 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-028e4b30-bc3b-4087-9cd7-629646dc94b3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.205473 Sep 10 10:50:10.310749 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2367/2873] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:10 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:10.329438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:10.330234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] [instance: cc0e0a60-5b09-404d-8e58-92a80dad0840] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:10.349451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:10.351281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:10.354411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:10.355447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:10.358698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:10.359452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:10.388298 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] HTTP exception thrown: Instance cc0e0a60-5b09-404d-8e58-92a80dad0840 could not be found. Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Request method failure captured: Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 HTTP/1.1 Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGsuWOztucEDGbQIVo0gt5ELd3FWQ1j_EP5EOEN7RRy4uP83f2laGGAR7LsjGSUI6b2xctZFIa_7ZjK2FWUlKvtfiVqzVWyZIcQQ1BB5qIwSTH20xbTrjbnDVMPLKaiTAB0Kp8BE1WyXTafR2WG6MHHD7PAbujFXSj2m0aZa99hoBVk Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: a8e0700581294ce78914145c18a1a70f Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersAdminTestJSON-1241323966 Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8e0700581294ce78914145c18a1a70f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a8e0700581294ce78914145c18a1a70f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8e0700581294ce78914145c18a1a70f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a8e0700581294ce78914145c18a1a70f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersAdminTestJSON-1241323966 Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: a8e0700581294ce78914145c18a1a70f Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersAdminTestJSON-1241323966 Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersAdminTestJSON-1241323966-project Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 036380e89f5e422ab0e5a66ee0a98777 Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersAdminTestJSON-1241323966-project Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance cc0e0a60-5b09-404d-8e58-92a80dad0840 could not be found. Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'cc0e0a60-5b09-404d-8e58-92a80dad0840'} Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0e0a60-5b09-404d-8e58-92a80dad0840 could not be found. Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0e0a60-5b09-404d-8e58-92a80dad0840 could not be found. Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:10.396759 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:10.402102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:10.402102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:10.402102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:10.402102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:50:10.402102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:50:10.402102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0e0a60-5b09-404d-8e58-92a80dad0840 could not be found. Sep 10 10:50:10.402102 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:10.402102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] Returning 404 to user: Instance cc0e0a60-5b09-404d-8e58-92a80dad0840 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:50:10.402102 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f281f103-08c3-401c-8a46-1b0325141fec tempest-ServersAdminTestJSON-1241323966 tempest-ServersAdminTestJSON-1241323966-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840" status: 404 len: 111 microversion: 2.1 time: 0.087561 Sep 10 10:50:10.403667 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2368/2874] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:10 2022] GET /compute/v2.1/servers/cc0e0a60-5b09-404d-8e58-92a80dad0840 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:50:10.893388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a36ac649-8785-4d9d-b5cb-6b63e42f710a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:10.895475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a36ac649-8785-4d9d-b5cb-6b63e42f710a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:10.917110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36ac649-8785-4d9d-b5cb-6b63e42f710a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:10.921731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36ac649-8785-4d9d-b5cb-6b63e42f710a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:10.922412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36ac649-8785-4d9d-b5cb-6b63e42f710a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:10.923407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36ac649-8785-4d9d-b5cb-6b63e42f710a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:10.924059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36ac649-8785-4d9d-b5cb-6b63e42f710a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:10.940157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a36ac649-8785-4d9d-b5cb-6b63e42f710a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:11.058735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=10 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:11.182293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a36ac649-8785-4d9d-b5cb-6b63e42f710a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:11.198057 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a36ac649-8785-4d9d-b5cb-6b63e42f710a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.308719 Sep 10 10:50:11.213099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2369/2875] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:10 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:11.213099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:11.213099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:11.213099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:11.213099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:11.213099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:11.213785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:11.213885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:11.214281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:11.355802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:11.371106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:11.373103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:11.376466 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-25cf1fc6-2b66-4f45-a2e6-55e8dba89e1b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.175954 Sep 10 10:50:11.377365 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2370/2876] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:11 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:11.404640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:11.406457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:11.420155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:11.432579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:11.433846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:11.434534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:11.435805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:11.436694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:11.437508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:11.572864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:11.586485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:11.589274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:11.595487 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-40613dd2-98a5-4be8-a8a3-b637b6d41c01 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.214887 Sep 10 10:50:11.614361 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2371/2877] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:11 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:12.222293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8fc423c-234c-4ac8-a60e-3e31baef6881 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:12.222996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e8fc423c-234c-4ac8-a60e-3e31baef6881 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:12.239052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8fc423c-234c-4ac8-a60e-3e31baef6881 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:12.244388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8fc423c-234c-4ac8-a60e-3e31baef6881 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:12.244843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8fc423c-234c-4ac8-a60e-3e31baef6881 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:12.250176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8fc423c-234c-4ac8-a60e-3e31baef6881 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:12.253679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8fc423c-234c-4ac8-a60e-3e31baef6881 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:12.254492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8fc423c-234c-4ac8-a60e-3e31baef6881 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:12.485335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e8fc423c-234c-4ac8-a60e-3e31baef6881 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:12.494203 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8fc423c-234c-4ac8-a60e-3e31baef6881 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.276056 Sep 10 10:50:12.510936 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2372/2878] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:12 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:12.517373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:12.518329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:12.525723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:12.526457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:12.527183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:12.527880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:12.528328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:12.528750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:12.551441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:12.622276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:12.635981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:12.637528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:12.638648 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0db92d59-13ce-4e78-8928-947d489bedfc tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.126386 Sep 10 10:50:12.653097 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2373/2879] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:12 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:12.653097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:12.653097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:12.654304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:12.655239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:12.655907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:12.656803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:12.657492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:12.658110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:12.768093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:12.785202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:12.791684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:12.804020 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-271f0a28-fe20-4ef1-87bd-2cbd7f0b18c6 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.163749 Sep 10 10:50:12.809194 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2374/2880] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:12 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:13.525829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8d27d7a3-9473-4500-9dc2-350d852811cc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:13.527362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8d27d7a3-9473-4500-9dc2-350d852811cc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:13.546644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d27d7a3-9473-4500-9dc2-350d852811cc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:13.550697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d27d7a3-9473-4500-9dc2-350d852811cc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:13.558318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d27d7a3-9473-4500-9dc2-350d852811cc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:13.559464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d27d7a3-9473-4500-9dc2-350d852811cc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:13.561280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d27d7a3-9473-4500-9dc2-350d852811cc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:13.562432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d27d7a3-9473-4500-9dc2-350d852811cc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:13.841717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d27d7a3-9473-4500-9dc2-350d852811cc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:13.854579 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8d27d7a3-9473-4500-9dc2-350d852811cc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.333289 Sep 10 10:50:13.857593 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2375/2881] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:13 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:13.864415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:13.865595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:13.873768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:13.874756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:13.875460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:13.876757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:13.877729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:13.878307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:13.964565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:13.978623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:13.980792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:13.982471 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f26c2ca6-3ae1-4cfe-ab61-50372687920f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.122911 Sep 10 10:50:13.983133 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2376/2882] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:13 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:13.999474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:14.001811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:14.028885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:14.030696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:14.034663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:14.035433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:14.035914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:14.036358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:14.182035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:14.191539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:14.193551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:14.200996 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b9ca7d2c-972d-4783-810c-6e9fd9438ae0 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.216537 Sep 10 10:50:14.201826 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2377/2883] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:13 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:14.887186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-89b9849a-1799-4325-926f-3fba2c79e25a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:14.888619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-89b9849a-1799-4325-926f-3fba2c79e25a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:14.900549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89b9849a-1799-4325-926f-3fba2c79e25a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:14.905394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89b9849a-1799-4325-926f-3fba2c79e25a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:14.906025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89b9849a-1799-4325-926f-3fba2c79e25a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:14.906818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89b9849a-1799-4325-926f-3fba2c79e25a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:14.907429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89b9849a-1799-4325-926f-3fba2c79e25a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:14.907866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89b9849a-1799-4325-926f-3fba2c79e25a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:15.216109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-89b9849a-1799-4325-926f-3fba2c79e25a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:15.255099 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-89b9849a-1799-4325-926f-3fba2c79e25a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.369074 Sep 10 10:50:15.256134 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2378/2884] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:14 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:15.307456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:15.308091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:15.371576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:15.379570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:15.382505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:15.386135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:15.401478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:15.402060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:15.649035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:15.663238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:15.665756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:15.667413 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cf8e0fb-4ceb-48ad-bf9e-7cdf29a70618 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.409139 Sep 10 10:50:15.693996 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2379/2885] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:15 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:15.712891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:15.720535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:15.741883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:15.746061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:15.746566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:15.748064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:15.748552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:15.750461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:15.907441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:15.934627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:15.948197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:15.972195 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-546d555b-5cd9-4dc0-81cb-2b9cc6d3e790 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.272172 Sep 10 10:50:15.972875 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2380/2886] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:15 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:16.464752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ecc4c93b-fcb1-4995-b1c4-6a19d348f964 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:16.468939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc4c93b-fcb1-4995-b1c4-6a19d348f964 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:16.469462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc4c93b-fcb1-4995-b1c4-6a19d348f964 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:16.469903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc4c93b-fcb1-4995-b1c4-6a19d348f964 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:16.470629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc4c93b-fcb1-4995-b1c4-6a19d348f964 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:16.474447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc4c93b-fcb1-4995-b1c4-6a19d348f964 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:16.476679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc4c93b-fcb1-4995-b1c4-6a19d348f964 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:16.566741 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ecc4c93b-fcb1-4995-b1c4-6a19d348f964 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.300680 Sep 10 10:50:16.568166 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2381/2887] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:50:16 2022] GET /compute/v2.1/os-services => generated 944 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:50:16.574186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d296df8-612a-4821-a231-c9ab91144285 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:16.575015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d296df8-612a-4821-a231-c9ab91144285 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:16.583061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d296df8-612a-4821-a231-c9ab91144285 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:16.584949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d296df8-612a-4821-a231-c9ab91144285 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:16.585549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d296df8-612a-4821-a231-c9ab91144285 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:16.586888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d296df8-612a-4821-a231-c9ab91144285 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:16.588260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d296df8-612a-4821-a231-c9ab91144285 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:16.589583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d296df8-612a-4821-a231-c9ab91144285 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:16.807359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d296df8-612a-4821-a231-c9ab91144285 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:16.822996 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d296df8-612a-4821-a231-c9ab91144285 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.253143 Sep 10 10:50:16.830195 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2382/2888] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:16 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:16.844849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-45a7843c-d75f-4d5b-993a-a6d0feb2883a tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:16.849241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45a7843c-d75f-4d5b-993a-a6d0feb2883a tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:16.849817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45a7843c-d75f-4d5b-993a-a6d0feb2883a tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:16.850340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45a7843c-d75f-4d5b-993a-a6d0feb2883a tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:16.852235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45a7843c-d75f-4d5b-993a-a6d0feb2883a tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:16.857530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45a7843c-d75f-4d5b-993a-a6d0feb2883a tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:16.858200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45a7843c-d75f-4d5b-993a-a6d0feb2883a tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:16.897220 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-45a7843c-d75f-4d5b-993a-a6d0feb2883a tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.065682 Sep 10 10:50:16.897846 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2383/2889] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Sep 10 10:50:16 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:16.915576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:16.916903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:16.924285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:16.924997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:16.925647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:16.926567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:16.927229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:16.928166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.080856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:17.092982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:17.096205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:17.097952 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80813aa2-e981-40ba-9187-c0429a8a0150 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.189716 Sep 10 10:50:17.113813 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2384/2890] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:16 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:17.134664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e545099d-68fa-42b5-a29b-ba769b3d21c5 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:17.143958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e545099d-68fa-42b5-a29b-ba769b3d21c5 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.144715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e545099d-68fa-42b5-a29b-ba769b3d21c5 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.147539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e545099d-68fa-42b5-a29b-ba769b3d21c5 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.156251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e545099d-68fa-42b5-a29b-ba769b3d21c5 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.157058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e545099d-68fa-42b5-a29b-ba769b3d21c5 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.157776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e545099d-68fa-42b5-a29b-ba769b3d21c5 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.191759 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e545099d-68fa-42b5-a29b-ba769b3d21c5 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.075620 Sep 10 10:50:17.203681 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2385/2891] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:50:17 2022] GET /compute/v2.1/os-services => generated 944 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:17.208736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:17.209674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:17.216584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.217410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.218371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.219283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.219948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.220582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.308039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:17.318083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:17.319921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:17.326849 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7d4f6e17-c533-4d3a-bd80-0304e5d9b5d1 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.121500 Sep 10 10:50:17.328793 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2386/2892] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:17 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:17.334332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fdcb1846-c8b4-4aa2-8bdf-0023b9bf7ce0 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:17.338465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdcb1846-c8b4-4aa2-8bdf-0023b9bf7ce0 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.339297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdcb1846-c8b4-4aa2-8bdf-0023b9bf7ce0 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.340015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdcb1846-c8b4-4aa2-8bdf-0023b9bf7ce0 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.341000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdcb1846-c8b4-4aa2-8bdf-0023b9bf7ce0 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.341712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdcb1846-c8b4-4aa2-8bdf-0023b9bf7ce0 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.342415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdcb1846-c8b4-4aa2-8bdf-0023b9bf7ce0 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.370659 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fdcb1846-c8b4-4aa2-8bdf-0023b9bf7ce0 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-856894-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.039790 Sep 10 10:50:17.379161 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2387/2893] 10.222.0.20 () {58 vars in 1194 bytes} [Sat Sep 10 10:50:17 2022] GET /compute/v2.1/os-services?host=n-d-856894-1&binary=xxx => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:50:17.385650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe3e53b3-c2f5-48dd-b9d8-92db90f07b04 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:17.392182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe3e53b3-c2f5-48dd-b9d8-92db90f07b04 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.393535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe3e53b3-c2f5-48dd-b9d8-92db90f07b04 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.394224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe3e53b3-c2f5-48dd-b9d8-92db90f07b04 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.395759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe3e53b3-c2f5-48dd-b9d8-92db90f07b04 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.396782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe3e53b3-c2f5-48dd-b9d8-92db90f07b04 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.397993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe3e53b3-c2f5-48dd-b9d8-92db90f07b04 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.429293 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe3e53b3-c2f5-48dd-b9d8-92db90f07b04 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047849 Sep 10 10:50:17.430150 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2388/2894] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:50:17 2022] GET /compute/v2.1/os-services => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:17.442504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b165da4-feae-4904-ae61-bed4e2daa850 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:17.447144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b165da4-feae-4904-ae61-bed4e2daa850 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.447974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b165da4-feae-4904-ae61-bed4e2daa850 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.448670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b165da4-feae-4904-ae61-bed4e2daa850 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.449691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b165da4-feae-4904-ae61-bed4e2daa850 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.450406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b165da4-feae-4904-ae61-bed4e2daa850 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.451153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b165da4-feae-4904-ae61-bed4e2daa850 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.478326 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9b165da4-feae-4904-ae61-bed4e2daa850 tempest-ServicesAdminNegativeTestJSON-1210040577 tempest-ServicesAdminNegativeTestJSON-1210040577-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.038381 Sep 10 10:50:17.486532 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2389/2895] 10.222.0.20 () {58 vars in 1198 bytes} [Sat Sep 10 10:50:17 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 10:50:17.850006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-789e39a4-eb35-41f7-847f-b2aa04c5669f tempest-ServicesAdminNegativeTestJSON-1081640570 tempest-ServicesAdminNegativeTestJSON-1081640570-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:17.854019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-789e39a4-eb35-41f7-847f-b2aa04c5669f tempest-ServicesAdminNegativeTestJSON-1081640570 tempest-ServicesAdminNegativeTestJSON-1081640570-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '33ca0adb3316418586840d2a4e675926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4483e4ce3e46cabeeb0dae21cd1eab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-789e39a4-eb35-41f7-847f-b2aa04c5669f tempest-ServicesAdminNegativeTestJSON-1081640570 tempest-ServicesAdminNegativeTestJSON-1081640570-project] Request method failure captured: Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGvmMHcJy36dZzfT4KOp4eU5uMJsNT6Y1AbNdRh-NqHai-tApCFuO1lqyeK9Dk6PuYAwdb5XxaLKTVhetYmR5aDzbpfgXXi3sTzBTvDL1L6l7H4jXHkBfaUtAEnXcfOCS3ywun6ZEI4LL5u6zVFEBl9fxvvmFWF3inj2jpXe70jX2lQ Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 0c4483e4ce3e46cabeeb0dae21cd1eab Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1081640570 Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c4483e4ce3e46cabeeb0dae21cd1eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0c4483e4ce3e46cabeeb0dae21cd1eab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c4483e4ce3e46cabeeb0dae21cd1eab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0c4483e4ce3e46cabeeb0dae21cd1eab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1081640570 Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 0c4483e4ce3e46cabeeb0dae21cd1eab Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1081640570 Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServicesAdminNegativeTestJSON-1081640570-project Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 33ca0adb3316418586840d2a4e675926 Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1081640570-project Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: action_args: {} Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 10:50:17.864360 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-789e39a4-eb35-41f7-847f-b2aa04c5669f tempest-ServicesAdminNegativeTestJSON-1081640570 tempest-ServicesAdminNegativeTestJSON-1081640570-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:50:17.869417 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-789e39a4-eb35-41f7-847f-b2aa04c5669f tempest-ServicesAdminNegativeTestJSON-1081640570 tempest-ServicesAdminNegativeTestJSON-1081640570-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.377999 Sep 10 10:50:17.872093 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2390/2896] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:50:17 2022] GET /compute/v2.1/os-services => generated 112 bytes in 384 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:50:17.879515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-348209c1-b3e0-4a92-a7ca-d30d909a26fb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:17.887811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-348209c1-b3e0-4a92-a7ca-d30d909a26fb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:17.912134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348209c1-b3e0-4a92-a7ca-d30d909a26fb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.912899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348209c1-b3e0-4a92-a7ca-d30d909a26fb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.913533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348209c1-b3e0-4a92-a7ca-d30d909a26fb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:17.914439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348209c1-b3e0-4a92-a7ca-d30d909a26fb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:17.917787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348209c1-b3e0-4a92-a7ca-d30d909a26fb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:17.918918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-348209c1-b3e0-4a92-a7ca-d30d909a26fb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:18.261025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-348209c1-b3e0-4a92-a7ca-d30d909a26fb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:18.270252 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-348209c1-b3e0-4a92-a7ca-d30d909a26fb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.396694 Sep 10 10:50:18.277833 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2391/2897] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:17 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:18.290093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:18.290723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:18.316288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:18.316786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:18.317264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:18.317978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:18.318440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:18.318872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:18.527515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:18.548072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:18.556973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:18.570028 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a422e88-e2c7-475b-b0d4-dc922e0d9b86 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.281760 Sep 10 10:50:18.571369 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2392/2898] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:18 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:18.580492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:18.581415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:18.595914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:18.598658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:18.599317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:18.603806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:18.604604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:18.605726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:18.814873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:18.824924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:18.832058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:18.840721 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-671ea488-90ae-477d-80b4-bd001d4b5ba5 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.267536 Sep 10 10:50:18.841543 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2393/2899] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:18 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:19.304643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-863527e2-068e-4d2d-82c7-153f015fa1bf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:19.308505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-863527e2-068e-4d2d-82c7-153f015fa1bf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:19.327359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863527e2-068e-4d2d-82c7-153f015fa1bf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:19.329818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863527e2-068e-4d2d-82c7-153f015fa1bf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:19.330602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863527e2-068e-4d2d-82c7-153f015fa1bf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:19.331568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863527e2-068e-4d2d-82c7-153f015fa1bf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:19.334223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863527e2-068e-4d2d-82c7-153f015fa1bf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:19.334764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863527e2-068e-4d2d-82c7-153f015fa1bf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:19.676578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-863527e2-068e-4d2d-82c7-153f015fa1bf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:19.691395 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-863527e2-068e-4d2d-82c7-153f015fa1bf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.394956 Sep 10 10:50:19.691395 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2394/2900] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:19 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:19.702967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:19.703612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:19.733584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:19.737513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:19.738932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:19.740533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:19.743773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:19.744239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:19.773587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:19.871619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:19.884863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:19.888097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:19.889918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-54eb6756-4a5a-49a6-9d80-2374a49e9c0a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.198529 Sep 10 10:50:19.906399 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2395/2901] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:19 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:19.911257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:19.913756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:19.929578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:19.930439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:19.932759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:19.937167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:19.937906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:19.939705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:20.023225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:20.036327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:20.040924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:20.060341 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c4bc0d0-be39-4450-87a0-091969123316 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.160702 Sep 10 10:50:20.061512 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2396/2902] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:19 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:20.718619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d543489e-7d35-4a98-90b1-c12a11515a43 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:20.720047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d543489e-7d35-4a98-90b1-c12a11515a43 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:20.736153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d543489e-7d35-4a98-90b1-c12a11515a43 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:20.738942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d543489e-7d35-4a98-90b1-c12a11515a43 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:20.739778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d543489e-7d35-4a98-90b1-c12a11515a43 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:20.742420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d543489e-7d35-4a98-90b1-c12a11515a43 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:20.745016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d543489e-7d35-4a98-90b1-c12a11515a43 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:20.747018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d543489e-7d35-4a98-90b1-c12a11515a43 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:21.076848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d543489e-7d35-4a98-90b1-c12a11515a43 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:21.091160 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d543489e-7d35-4a98-90b1-c12a11515a43 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.382031 Sep 10 10:50:21.092505 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2397/2903] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:20 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:21.097895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:21.099657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:21.107489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:21.108350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:21.109457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:21.110485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:21.111224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:21.111948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:21.221621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:21.230902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:21.233298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:21.234691 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d293c356-4212-4628-a5f8-1c8cc990fa4a tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.140867 Sep 10 10:50:21.235425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2398/2904] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:21 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:21.240353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:21.241213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:21.247960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:21.248650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:21.249316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:21.250168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:21.250784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:21.251369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:21.378566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:21.393985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:21.396189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:21.406664 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86350ada-e93a-447c-8ead-8eb415c042f4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.169981 Sep 10 10:50:21.413856 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2399/2905] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:21 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:22.122705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76b0576b-4eef-4e69-b3de-131a62efe016 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:22.123551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-76b0576b-4eef-4e69-b3de-131a62efe016 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:22.132979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0576b-4eef-4e69-b3de-131a62efe016 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:22.134385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0576b-4eef-4e69-b3de-131a62efe016 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:22.135877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0576b-4eef-4e69-b3de-131a62efe016 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:22.136854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0576b-4eef-4e69-b3de-131a62efe016 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:22.137875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0576b-4eef-4e69-b3de-131a62efe016 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:22.138587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b0576b-4eef-4e69-b3de-131a62efe016 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:22.420072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76b0576b-4eef-4e69-b3de-131a62efe016 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:22.436998 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76b0576b-4eef-4e69-b3de-131a62efe016 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.320290 Sep 10 10:50:22.438144 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2400/2906] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:22 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:22.443565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:22.444561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:22.452349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:22.453284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:22.453932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:22.454862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:22.456317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:22.456958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:22.557709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:22.570192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:22.573803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:22.575028 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed1c5323-a646-4314-87fa-42699e987a7b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.135677 Sep 10 10:50:22.575608 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2401/2907] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:22 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:22.596942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:22.610642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:22.625314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:22.631157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:22.632972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:22.634357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:22.636147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:22.638207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:22.804908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:22.820625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:22.832683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:22.840776 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c32002f3-80a4-4a8c-b9d1-4728121a7479 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.248969 Sep 10 10:50:22.842633 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2402/2908] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:22 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:23.461639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9f42a54-b3d5-494a-a917-f7df914328fa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:23.462811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f9f42a54-b3d5-494a-a917-f7df914328fa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:23.475291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9f42a54-b3d5-494a-a917-f7df914328fa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:23.475789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9f42a54-b3d5-494a-a917-f7df914328fa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:23.476233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9f42a54-b3d5-494a-a917-f7df914328fa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:23.476946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9f42a54-b3d5-494a-a917-f7df914328fa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:23.485852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9f42a54-b3d5-494a-a917-f7df914328fa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:23.486254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9f42a54-b3d5-494a-a917-f7df914328fa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:23.708212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f9f42a54-b3d5-494a-a917-f7df914328fa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:23.720280 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f9f42a54-b3d5-494a-a917-f7df914328fa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.262027 Sep 10 10:50:23.721188 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2403/2909] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:23 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:23.726908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:23.728338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:23.734455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:23.735156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:23.736065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:23.736939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:23.737598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:23.738186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:23.816651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:23.828471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:23.830393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:23.832307 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c5c0e883-a21b-4229-869a-438bb34de765 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.109457 Sep 10 10:50:23.833713 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2404/2910] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:23 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:23.873053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:23.875631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:23.894463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:23.896287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:23.898579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:23.900724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:23.901431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:23.902072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:24.012285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:24.031065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:24.034411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:24.054570 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b824d144-8348-42fb-8b81-f760d3edb628 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.185796 Sep 10 10:50:24.055186 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2405/2911] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:23 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:50:24.746535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f37babe-6953-4bf7-baaf-44ee823f9875 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:24.747974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0f37babe-6953-4bf7-baaf-44ee823f9875 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:24.762609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:24.765914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f37babe-6953-4bf7-baaf-44ee823f9875 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:24.767076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f37babe-6953-4bf7-baaf-44ee823f9875 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:24.768172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f37babe-6953-4bf7-baaf-44ee823f9875 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:24.787171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f37babe-6953-4bf7-baaf-44ee823f9875 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:24.791693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f37babe-6953-4bf7-baaf-44ee823f9875 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:24.793652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f37babe-6953-4bf7-baaf-44ee823f9875 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.103530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0f37babe-6953-4bf7-baaf-44ee823f9875 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:25.114336 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f37babe-6953-4bf7-baaf-44ee823f9875 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.372550 Sep 10 10:50:25.116471 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2406/2912] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:24 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:25.125390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:25.128316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:25.135763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.140531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.146798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.149333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.149830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.150273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.244186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:25.260420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:25.261906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:25.263490 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e9b42f65-1c80-4ff7-b43c-a0d9234e8d67 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.144279 Sep 10 10:50:25.264585 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2407/2913] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:25 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:25.537506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Action: 'update', calling method: .version_select at 0x7efcb2bcc5e0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:25.544107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.544720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.545703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.558163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.559630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.560085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.569699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] HTTP exception thrown: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Request method failure captured: Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/os-services/9a7d180e-88cb-4de3-9bdf-4ad287cf0984 HTTP/1.1 Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 56 Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGvwwR9BflqZ6NuE_ABTTj4bL4DeXaAKO1QgxD9CgzuOjkniPnXohuvYJh6YyhV1EQ7Hr1I5e0q8lbY2RubGDCHkfeRFMyMfCraqHmECfa5wNFQaxN4pnTbKMD5-0OziypGX3bm8lZk38S07-mSdGWyr5dhJST7PR8lSpAO5nlEdZLs Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 18473ce1e07f4157b2d74d202cf862ba Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1218747348 Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18473ce1e07f4157b2d74d202cf862ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18473ce1e07f4157b2d74d202cf862ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18473ce1e07f4157b2d74d202cf862ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18473ce1e07f4157b2d74d202cf862ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1218747348 Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 18473ce1e07f4157b2d74d202cf862ba Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1218747348 Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 218c69bd16e345edae4b3a9f47bfcd12 Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: exception: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '9a7d180e-88cb-4de3-9bdf-4ad287cf0984', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:50:25.570372 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Returning 404 to user: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0aa64f9d-ee83-4b30-b1c4-39dbab860d42 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/9a7d180e-88cb-4de3-9bdf-4ad287cf0984" status: 404 len: 110 microversion: 2.53 time: 0.304863 Sep 10 10:50:25.578839 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2408/2914] 10.222.0.20 () {62 vars in 1309 bytes} [Sat Sep 10 10:50:25 2022] PUT /compute/v2.1/os-services/9a7d180e-88cb-4de3-9bdf-4ad287cf0984 => generated 110 bytes in 307 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:50:25.581243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:25.581243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:25.586807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.587522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.587904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.588597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.589196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.589754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.668640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:25.683791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:25.692861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:25.709605 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a6e28013-6961-418d-91d8-1b180201bd0d tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.133149 Sep 10 10:50:25.710559 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2409/2915] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:25 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:25.720882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Action: 'update', calling method: .version_select at 0x7efcb2bd0820>, body: {"status": "disabled"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:25.729125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.732264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.732717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.742292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.743517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.744294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.750011 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] HTTP exception thrown: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Request method failure captured: Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/os-services/9a7d180e-88cb-4de3-9bdf-4ad287cf0984 HTTP/1.1 Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 22 Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGvwwR9BflqZ6NuE_ABTTj4bL4DeXaAKO1QgxD9CgzuOjkniPnXohuvYJh6YyhV1EQ7Hr1I5e0q8lbY2RubGDCHkfeRFMyMfCraqHmECfa5wNFQaxN4pnTbKMD5-0OziypGX3bm8lZk38S07-mSdGWyr5dhJST7PR8lSpAO5nlEdZLs Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 18473ce1e07f4157b2d74d202cf862ba Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1218747348 Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18473ce1e07f4157b2d74d202cf862ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18473ce1e07f4157b2d74d202cf862ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18473ce1e07f4157b2d74d202cf862ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18473ce1e07f4157b2d74d202cf862ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1218747348 Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 18473ce1e07f4157b2d74d202cf862ba Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1218747348 Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 218c69bd16e345edae4b3a9f47bfcd12 Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: {"status": "disabled"} Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: exception: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '9a7d180e-88cb-4de3-9bdf-4ad287cf0984', 'body': {'status': 'disabled'}} Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:50:25.752444 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.757949 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.760416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Returning 404 to user: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:50:25.761805 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c07683dc-cda3-4229-b852-68fecd1b1a9f tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/9a7d180e-88cb-4de3-9bdf-4ad287cf0984" status: 404 len: 110 microversion: 2.53 time: 0.050156 Sep 10 10:50:25.763041 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2410/2916] 10.222.0.20 () {62 vars in 1309 bytes} [Sat Sep 10 10:50:25 2022] PUT /compute/v2.1/os-services/9a7d180e-88cb-4de3-9bdf-4ad287cf0984 => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:50:25.772184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Action: 'update', calling method: .version_select at 0x7efcadcd73a0>, body: {"status": "enabled"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:25.778745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.779236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.780189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.792308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.792800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.793305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.806485 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] HTTP exception thrown: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Request method failure captured: Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/os-services/9a7d180e-88cb-4de3-9bdf-4ad287cf0984 HTTP/1.1 Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 21 Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGvwwR9BflqZ6NuE_ABTTj4bL4DeXaAKO1QgxD9CgzuOjkniPnXohuvYJh6YyhV1EQ7Hr1I5e0q8lbY2RubGDCHkfeRFMyMfCraqHmECfa5wNFQaxN4pnTbKMD5-0OziypGX3bm8lZk38S07-mSdGWyr5dhJST7PR8lSpAO5nlEdZLs Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 18473ce1e07f4157b2d74d202cf862ba Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1218747348 Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18473ce1e07f4157b2d74d202cf862ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18473ce1e07f4157b2d74d202cf862ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18473ce1e07f4157b2d74d202cf862ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18473ce1e07f4157b2d74d202cf862ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1218747348 Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 18473ce1e07f4157b2d74d202cf862ba Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1218747348 Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 218c69bd16e345edae4b3a9f47bfcd12 Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: {"status": "enabled"} Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: exception: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '9a7d180e-88cb-4de3-9bdf-4ad287cf0984', 'body': {'status': 'enabled'}} Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:50:25.809124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Returning 404 to user: Service 9a7d180e-88cb-4de3-9bdf-4ad287cf0984 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:50:25.814578 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87675284-6921-4478-a93c-510a598b73b0 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/9a7d180e-88cb-4de3-9bdf-4ad287cf0984" status: 404 len: 110 microversion: 2.53 time: 0.042224 Sep 10 10:50:25.816806 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2411/2917] 10.222.0.20 () {62 vars in 1309 bytes} [Sat Sep 10 10:50:25 2022] PUT /compute/v2.1/os-services/9a7d180e-88cb-4de3-9bdf-4ad287cf0984 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:50:25.823543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3fe66d6-30a4-4c38-bad0-461b9b9903a9 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:25.825545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fe66d6-30a4-4c38-bad0-461b9b9903a9 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.825878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fe66d6-30a4-4c38-bad0-461b9b9903a9 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.826487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fe66d6-30a4-4c38-bad0-461b9b9903a9 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.827232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fe66d6-30a4-4c38-bad0-461b9b9903a9 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.827676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fe66d6-30a4-4c38-bad0-461b9b9903a9 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.828101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3fe66d6-30a4-4c38-bad0-461b9b9903a9 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.858672 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3fe66d6-30a4-4c38-bad0-461b9b9903a9 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.040434 Sep 10 10:50:25.859568 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2412/2918] 10.222.0.20 () {60 vars in 1178 bytes} [Sat Sep 10 10:50:25 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:25.875642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f740bd22-eafe-43bf-973d-6c7b0e231763 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:25.882528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f740bd22-eafe-43bf-973d-6c7b0e231763 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.883202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f740bd22-eafe-43bf-973d-6c7b0e231763 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.884227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f740bd22-eafe-43bf-973d-6c7b0e231763 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.885271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f740bd22-eafe-43bf-973d-6c7b0e231763 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.885944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f740bd22-eafe-43bf-973d-6c7b0e231763 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.888889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f740bd22-eafe-43bf-973d-6c7b0e231763 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.943038 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f740bd22-eafe-43bf-973d-6c7b0e231763 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.071618 Sep 10 10:50:25.947349 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2413/2919] 10.222.0.20 () {60 vars in 1211 bytes} [Sat Sep 10 10:50:25 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:25.958405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0baa542e-76d1-41e0-b8f8-93c0f0566785 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:25.971756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0baa542e-76d1-41e0-b8f8-93c0f0566785 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.972290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0baa542e-76d1-41e0-b8f8-93c0f0566785 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.972974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0baa542e-76d1-41e0-b8f8-93c0f0566785 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:25.973969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0baa542e-76d1-41e0-b8f8-93c0f0566785 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:25.974631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0baa542e-76d1-41e0-b8f8-93c0f0566785 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:25.975475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0baa542e-76d1-41e0-b8f8-93c0f0566785 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.031519 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0baa542e-76d1-41e0-b8f8-93c0f0566785 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.077037 Sep 10 10:50:26.037976 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2414/2920] 10.222.0.20 () {60 vars in 1178 bytes} [Sat Sep 10 10:50:25 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:26.052143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e85c1f9a-42ef-466b-9322-2a5b4c7360ae tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:26.059629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e85c1f9a-42ef-466b-9322-2a5b4c7360ae tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.061951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e85c1f9a-42ef-466b-9322-2a5b4c7360ae tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.062649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e85c1f9a-42ef-466b-9322-2a5b4c7360ae tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.065169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e85c1f9a-42ef-466b-9322-2a5b4c7360ae tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.066073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e85c1f9a-42ef-466b-9322-2a5b4c7360ae tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.067904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e85c1f9a-42ef-466b-9322-2a5b4c7360ae tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.114349 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e85c1f9a-42ef-466b-9322-2a5b4c7360ae tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-856894-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.065984 Sep 10 10:50:26.115494 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2415/2921] 10.222.0.20 () {60 vars in 1235 bytes} [Sat Sep 10 10:50:26 2022] GET /compute/v2.1/os-services?host=n-d-856894-1&binary=xxx => generated 16 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:26.134618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ebce2ad-4d98-4538-8b90-9d9be66fcca2 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:26.140680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ebce2ad-4d98-4538-8b90-9d9be66fcca2 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.141440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ebce2ad-4d98-4538-8b90-9d9be66fcca2 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.142698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ebce2ad-4d98-4538-8b90-9d9be66fcca2 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.143703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ebce2ad-4d98-4538-8b90-9d9be66fcca2 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.144387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ebce2ad-4d98-4538-8b90-9d9be66fcca2 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.145037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ebce2ad-4d98-4538-8b90-9d9be66fcca2 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.187918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ebce2ad-4d98-4538-8b90-9d9be66fcca2 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063265 Sep 10 10:50:26.189222 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2416/2922] 10.222.0.20 () {60 vars in 1178 bytes} [Sat Sep 10 10:50:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:26.207260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d0ca2a76-6d6d-4b36-8c51-0dbdd51ead6b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:26.214757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d0ca2a76-6d6d-4b36-8c51-0dbdd51ead6b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:26.234938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0ca2a76-6d6d-4b36-8c51-0dbdd51ead6b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.235902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0ca2a76-6d6d-4b36-8c51-0dbdd51ead6b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.236382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0ca2a76-6d6d-4b36-8c51-0dbdd51ead6b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.237153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0ca2a76-6d6d-4b36-8c51-0dbdd51ead6b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.237644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0ca2a76-6d6d-4b36-8c51-0dbdd51ead6b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.238136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0ca2a76-6d6d-4b36-8c51-0dbdd51ead6b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.243456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:26.485413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d0ca2a76-6d6d-4b36-8c51-0dbdd51ead6b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:26.496476 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d0ca2a76-6d6d-4b36-8c51-0dbdd51ead6b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.305752 Sep 10 10:50:26.498931 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2417/2923] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:26 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:26.503928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-284c447e-d546-4b77-8b5b-5b4461bd5c7e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:26.504719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-284c447e-d546-4b77-8b5b-5b4461bd5c7e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:26.512567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-284c447e-d546-4b77-8b5b-5b4461bd5c7e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.513290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-284c447e-d546-4b77-8b5b-5b4461bd5c7e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.513887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-284c447e-d546-4b77-8b5b-5b4461bd5c7e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.514927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-284c447e-d546-4b77-8b5b-5b4461bd5c7e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.515653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-284c447e-d546-4b77-8b5b-5b4461bd5c7e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.516238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-284c447e-d546-4b77-8b5b-5b4461bd5c7e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.763871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-284c447e-d546-4b77-8b5b-5b4461bd5c7e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:26.772940 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-284c447e-d546-4b77-8b5b-5b4461bd5c7e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.272723 Sep 10 10:50:26.786746 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2418/2924] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:26 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:26.799038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e8e16e5-8ccb-4297-a446-b2f0001989e4 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:26.807878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e8e16e5-8ccb-4297-a446-b2f0001989e4 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.808515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e8e16e5-8ccb-4297-a446-b2f0001989e4 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.811108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e8e16e5-8ccb-4297-a446-b2f0001989e4 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.811985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e8e16e5-8ccb-4297-a446-b2f0001989e4 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.814893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e8e16e5-8ccb-4297-a446-b2f0001989e4 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.815442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e8e16e5-8ccb-4297-a446-b2f0001989e4 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.851483 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e8e16e5-8ccb-4297-a446-b2f0001989e4 tempest-ServicesAdminNegativeV253TestJSON-1218747348 tempest-ServicesAdminNegativeV253TestJSON-1218747348-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.063317 Sep 10 10:50:26.852283 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2419/2925] 10.222.0.20 () {60 vars in 1239 bytes} [Sat Sep 10 10:50:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:26.859230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:26.859230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:26.872621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.873146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.873593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.874299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:26.874752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:26.875176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:26.972898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:26.983639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:26.986107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:26.987811 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5fca85be-7961-4558-9de7-c7becc62ad43 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.134216 Sep 10 10:50:27.000616 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2420/2926] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:26 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:27.007068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:27.014518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:27.035154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:27.035844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:27.036309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:27.037752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:27.038224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:27.038660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:27.165432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:27.177294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:27.181322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:27.187526 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a561cbb1-3c88-4da0-b8a8-01123b3628d3 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.189004 Sep 10 10:50:27.188927 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2421/2927] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:26 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:27.194521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7adf57d-2129-436f-96f9-8281ac858e09 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-398205669"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:27.198229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7adf57d-2129-436f-96f9-8281ac858e09 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:27.205704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7adf57d-2129-436f-96f9-8281ac858e09 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:27.206394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7adf57d-2129-436f-96f9-8281ac858e09 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:27.207394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7adf57d-2129-436f-96f9-8281ac858e09 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:27.208341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7adf57d-2129-436f-96f9-8281ac858e09 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:27.209389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7adf57d-2129-436f-96f9-8281ac858e09 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:27.210097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7adf57d-2129-436f-96f9-8281ac858e09 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:27.544265 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7adf57d-2129-436f-96f9-8281ac858e09 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.353142 Sep 10 10:50:27.545639 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2422/2928] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:50:27 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 10 10:50:27.870981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33cc711f-6b4d-4148-843f-e78627bf06d9 tempest-ServicesAdminNegativeV253TestJSON-1005519588 tempest-ServicesAdminNegativeV253TestJSON-1005519588-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:27.875629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-33cc711f-6b4d-4148-843f-e78627bf06d9 tempest-ServicesAdminNegativeV253TestJSON-1005519588 tempest-ServicesAdminNegativeV253TestJSON-1005519588-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd35e5355ef854a4f925f8bea24c3bba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63f5af356f4919bd110d80538258cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33cc711f-6b4d-4148-843f-e78627bf06d9 tempest-ServicesAdminNegativeV253TestJSON-1005519588 tempest-ServicesAdminNegativeV253TestJSON-1005519588-project] Request method failure captured: Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGvuXqgbY0nhrb2FHStQLxTmQ_qVcRNLQ4OuGsgn8eXVVOidy811Gbg0mgCnWxO_BLLfY1trawZaXjVDVuHs8getoekEB9PClASbOrL6dRef8Fc0etTZSU4h-gryKjTVyJRP52AToKThgHc9NWH--GJ4r9AFsupUm27jRTEGlX3a17M Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9b63f5af356f4919bd110d80538258cc Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1005519588 Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b63f5af356f4919bd110d80538258cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b63f5af356f4919bd110d80538258cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b63f5af356f4919bd110d80538258cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b63f5af356f4919bd110d80538258cc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1005519588 Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9b63f5af356f4919bd110d80538258cc Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1005519588 Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1005519588-project Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d35e5355ef854a4f925f8bea24c3bba1 Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1005519588-project Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: action_args: {} Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 10:50:27.877806 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33cc711f-6b4d-4148-843f-e78627bf06d9 tempest-ServicesAdminNegativeV253TestJSON-1005519588 tempest-ServicesAdminNegativeV253TestJSON-1005519588-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:50:27.885061 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-33cc711f-6b4d-4148-843f-e78627bf06d9 tempest-ServicesAdminNegativeV253TestJSON-1005519588 tempest-ServicesAdminNegativeV253TestJSON-1005519588-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.332274 Sep 10 10:50:27.886982 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2423/2929] 10.222.0.20 () {60 vars in 1178 bytes} [Sat Sep 10 10:50:27 2022] GET /compute/v2.1/os-services => generated 112 bytes in 339 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:50:27.890926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-abd3cd39-e9cb-46b9-b6e5-31be59d7eae9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:27.892642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-abd3cd39-e9cb-46b9-b6e5-31be59d7eae9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:27.899235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abd3cd39-e9cb-46b9-b6e5-31be59d7eae9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:27.899727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abd3cd39-e9cb-46b9-b6e5-31be59d7eae9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:27.900171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abd3cd39-e9cb-46b9-b6e5-31be59d7eae9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:27.900867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abd3cd39-e9cb-46b9-b6e5-31be59d7eae9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:27.901349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abd3cd39-e9cb-46b9-b6e5-31be59d7eae9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:27.901778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abd3cd39-e9cb-46b9-b6e5-31be59d7eae9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:28.050078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-abd3cd39-e9cb-46b9-b6e5-31be59d7eae9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:28.057908 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-abd3cd39-e9cb-46b9-b6e5-31be59d7eae9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.171285 Sep 10 10:50:28.058725 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2424/2930] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:27 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:28.064688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2158361-4bfb-447f-b5a0-3ee366db9308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:28.065343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2158361-4bfb-447f-b5a0-3ee366db9308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:28.071730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2158361-4bfb-447f-b5a0-3ee366db9308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:28.072490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2158361-4bfb-447f-b5a0-3ee366db9308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:28.073212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2158361-4bfb-447f-b5a0-3ee366db9308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:28.074215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2158361-4bfb-447f-b5a0-3ee366db9308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:28.074745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2158361-4bfb-447f-b5a0-3ee366db9308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:28.075263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2158361-4bfb-447f-b5a0-3ee366db9308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:28.239304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2158361-4bfb-447f-b5a0-3ee366db9308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:28.252837 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2158361-4bfb-447f-b5a0-3ee366db9308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.192769 Sep 10 10:50:28.254248 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2425/2931] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:28 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:28.259285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1814065922", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:28.604069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:50:28.844851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:50:28.845414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:50:28.845971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:50:28.846451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:50:28.846950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:50:28.859281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:28.859971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:28.860611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:28.861592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:28.862380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:28.863291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:28.902507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Getting quotas for project 44d6a37e411c4416813b48bbd959f8fb. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:50:28.908597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Getting quotas for user 5d2fcd9534fd4d728edd4e5865ab6cf1 and project 44d6a37e411c4416813b48bbd959f8fb. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:50:28.922472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:50:28.924989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:50:28.974796 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf3525d6-b48a-4bce-b975-39bdbebaad62 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718997 Sep 10 10:50:28.975449 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2426/2932] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:50:28.986005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:28.986620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:29.005824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:29.006387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:29.006842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:29.007575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:29.008037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:29.009161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:29.084574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:29.097961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:29.099797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:29.101276 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f4074fa-84a9-4e95-b0ab-d14f7dd818af tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.124871 Sep 10 10:50:29.103130 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2427/2933] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:28 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:29.115667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:29.116625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:29.124881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:29.125427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:29.126005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:29.127073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:29.127725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:29.129394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:29.219012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:29.230440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:29.232289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:29.238627 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-482b2e21-d612-4752-9893-b2618c14240e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.133136 Sep 10 10:50:29.239429 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2428/2934] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:29 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:29.246083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-54cf3534-0f17-4323-a8cd-43b694fa6ad2 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:29.247444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54cf3534-0f17-4323-a8cd-43b694fa6ad2 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:29.330089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54cf3534-0f17-4323-a8cd-43b694fa6ad2 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:29.339229 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-54cf3534-0f17-4323-a8cd-43b694fa6ad2 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1214 microversion: 2.1 time: 0.098498 Sep 10 10:50:29.340946 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2429/2935] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:29 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:29.347292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c3682c1-f1a7-4ec0-9cc0-25c6d7719362 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:29.348079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c3682c1-f1a7-4ec0-9cc0-25c6d7719362 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:29.358023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c3682c1-f1a7-4ec0-9cc0-25c6d7719362 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:29.358782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c3682c1-f1a7-4ec0-9cc0-25c6d7719362 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:29.359480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c3682c1-f1a7-4ec0-9cc0-25c6d7719362 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:29.360727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c3682c1-f1a7-4ec0-9cc0-25c6d7719362 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:29.361530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c3682c1-f1a7-4ec0-9cc0-25c6d7719362 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:29.363044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c3682c1-f1a7-4ec0-9cc0-25c6d7719362 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:29.560842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9c3682c1-f1a7-4ec0-9cc0-25c6d7719362 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:29.569535 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c3682c1-f1a7-4ec0-9cc0-25c6d7719362 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.226867 Sep 10 10:50:29.585452 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2430/2936] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:29 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:29.585452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72416a23-19bc-4a4f-90f7-5b6a1cb559dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:29.585452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-72416a23-19bc-4a4f-90f7-5b6a1cb559dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:29.585452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72416a23-19bc-4a4f-90f7-5b6a1cb559dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:29.585452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72416a23-19bc-4a4f-90f7-5b6a1cb559dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:29.585452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72416a23-19bc-4a4f-90f7-5b6a1cb559dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:29.585452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72416a23-19bc-4a4f-90f7-5b6a1cb559dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:29.586174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72416a23-19bc-4a4f-90f7-5b6a1cb559dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:29.586260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72416a23-19bc-4a4f-90f7-5b6a1cb559dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:29.732834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-72416a23-19bc-4a4f-90f7-5b6a1cb559dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:29.741215 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72416a23-19bc-4a4f-90f7-5b6a1cb559dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1688 microversion: 2.1 time: 0.169982 Sep 10 10:50:29.741703 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2431/2937] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:29 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:30.138655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:30.140156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:30.154811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:30.156924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:30.157765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:30.158698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:30.159328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:30.160629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:30.264890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:30.274830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:30.278498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:30.280811 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fea5dd36-634c-4d80-bccd-c907b760abbe tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1365 microversion: 2.47 time: 0.153936 Sep 10 10:50:30.282152 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2432/2938] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:30 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:50:30.288816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:30.290089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:30.297180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:30.297813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:30.298260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:30.299270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:30.299779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:30.300532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:30.432103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:30.444172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:30.450275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:30.464481 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa3a90fd-9807-4210-8050-bcd77daeed96 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.181055 Sep 10 10:50:30.465093 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2433/2939] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:30 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:30.471952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-58f61cfa-237a-4a0f-81b3-19f322fe34ea tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:30.472570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-58f61cfa-237a-4a0f-81b3-19f322fe34ea tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:30.483712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58f61cfa-237a-4a0f-81b3-19f322fe34ea tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:30.484168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58f61cfa-237a-4a0f-81b3-19f322fe34ea tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:30.485043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58f61cfa-237a-4a0f-81b3-19f322fe34ea tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:30.486021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58f61cfa-237a-4a0f-81b3-19f322fe34ea tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:30.486800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58f61cfa-237a-4a0f-81b3-19f322fe34ea tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:30.487559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58f61cfa-237a-4a0f-81b3-19f322fe34ea tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:30.565486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-58f61cfa-237a-4a0f-81b3-19f322fe34ea tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:30.574291 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-58f61cfa-237a-4a0f-81b3-19f322fe34ea tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1218 microversion: 2.1 time: 0.108115 Sep 10 10:50:30.581158 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2434/2940] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:30 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:30.597260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48631e3f-f268-4064-9fa3-a6699f0681b3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:30.597916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-48631e3f-f268-4064-9fa3-a6699f0681b3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:30.605118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48631e3f-f268-4064-9fa3-a6699f0681b3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:30.605366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48631e3f-f268-4064-9fa3-a6699f0681b3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:30.605760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48631e3f-f268-4064-9fa3-a6699f0681b3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:30.606494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48631e3f-f268-4064-9fa3-a6699f0681b3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:30.606959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48631e3f-f268-4064-9fa3-a6699f0681b3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:30.607394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48631e3f-f268-4064-9fa3-a6699f0681b3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:30.777719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-48631e3f-f268-4064-9fa3-a6699f0681b3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:30.783627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:30.789306 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-48631e3f-f268-4064-9fa3-a6699f0681b3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1516 microversion: 2.1 time: 0.197009 Sep 10 10:50:30.790491 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2435/2941] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:30 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:31.182467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-082a04dd-0f40-4f49-80cc-57432de89697 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Calling method '.version_select at 0x7efcae7d6ca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:31.194252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082a04dd-0f40-4f49-80cc-57432de89697 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:31.194733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082a04dd-0f40-4f49-80cc-57432de89697 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:31.195394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082a04dd-0f40-4f49-80cc-57432de89697 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:31.196721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082a04dd-0f40-4f49-80cc-57432de89697 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:31.197210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082a04dd-0f40-4f49-80cc-57432de89697 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:31.197736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082a04dd-0f40-4f49-80cc-57432de89697 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:31.217877 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-082a04dd-0f40-4f49-80cc-57432de89697 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.426350 Sep 10 10:50:31.218733 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2436/2942] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Sep 10 10:50:30 2022] GET /compute/v2.1/limits => generated 511 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:31.224059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1ffdff5f-7288-4856-b42c-365df5288c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:31.224702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1ffdff5f-7288-4856-b42c-365df5288c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:31.231661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ffdff5f-7288-4856-b42c-365df5288c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:31.232341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ffdff5f-7288-4856-b42c-365df5288c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:31.232955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ffdff5f-7288-4856-b42c-365df5288c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:31.233677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ffdff5f-7288-4856-b42c-365df5288c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:31.234446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ffdff5f-7288-4856-b42c-365df5288c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:31.234869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ffdff5f-7288-4856-b42c-365df5288c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:31.413478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1ffdff5f-7288-4856-b42c-365df5288c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:31.423971 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1ffdff5f-7288-4856-b42c-365df5288c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1688 microversion: 2.1 time: 0.203791 Sep 10 10:50:31.424823 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2437/2943] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:31 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1688 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:31.429797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-76b5c1b8-a41e-42aa-b685-fdc392249b83 req-e840adee-d22e-471b-b981-67d3d8b9ef07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5", "name": "network-vif-unplugged", "status": "completed", "tag": "a9a5c077-18b4-45a9-ab46-131e14788b74"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:31.440043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-76b5c1b8-a41e-42aa-b685-fdc392249b83 req-e840adee-d22e-471b-b981-67d3d8b9ef07 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:31.440906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-76b5c1b8-a41e-42aa-b685-fdc392249b83 req-e840adee-d22e-471b-b981-67d3d8b9ef07 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:31.441333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-76b5c1b8-a41e-42aa-b685-fdc392249b83 req-e840adee-d22e-471b-b981-67d3d8b9ef07 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:31.453188 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-76b5c1b8-a41e-42aa-b685-fdc392249b83 req-e840adee-d22e-471b-b981-67d3d8b9ef07 service nova] Creating event network-vif-unplugged:a9a5c077-18b4-45a9-ab46-131e14788b74 for instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 on n-h2-856894-1 Sep 10 10:50:31.458337 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-76b5c1b8-a41e-42aa-b685-fdc392249b83 req-e840adee-d22e-471b-b981-67d3d8b9ef07 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032019 Sep 10 10:50:31.458925 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2438/2944] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:31.467481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:31.468339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:31.475660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:31.476256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:31.476804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:31.478124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:31.478678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:31.479185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:31.552273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:31.561803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:31.563259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:31.564444 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2fdb628-95f4-4c95-9f3a-be3311bc684e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1383 microversion: 2.47 time: 0.104182 Sep 10 10:50:31.565196 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2439/2945] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:31 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1383 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:31.570045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44fbbef1-78b0-4136-9cc1-d3d79e322d18 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1615804545", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:31.583351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:31.639286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-44fbbef1-78b0-4136-9cc1-d3d79e322d18 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:50:31.920452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-44fbbef1-78b0-4136-9cc1-d3d79e322d18 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Getting quotas for project 55de86c67c1c42f5ac40e569af9a7469. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:50:31.927704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-44fbbef1-78b0-4136-9cc1-d3d79e322d18 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Getting quotas for user d8b269fdc6e74f10b1ef81c5c8e8ce37 and project 55de86c67c1c42f5ac40e569af9a7469. Resources: dict_keys(['metadata_items']) {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:50:31.942213 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-44fbbef1-78b0-4136-9cc1-d3d79e322d18 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44fbbef1-78b0-4136-9cc1-d3d79e322d18 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Request method failure captured: Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 1752 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGv2Ygz-J8RogCV2kJhqI5ntJebx8y-hAUw8h1-TxXjLrgEF6_nwdm5Wj0mgyKP2v35pC6SRlIC9Rz5nFYvVQcyRnb0JuWBCMPzSlWXg1HLFp_dso6JkM93fD6Ht83f-Ty9ChZWLBHRcBRJWkUlRCmOFoWN1S5j5uOAPDGujiFQCvE0 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 55de86c67c1c42f5ac40e569af9a7469 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-799153206 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/55de86c67c1c42f5ac40e569af9a7469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/55de86c67c1c42f5ac40e569af9a7469"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/55de86c67c1c42f5ac40e569af9a7469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_55de86c67c1c42f5ac40e569af9a7469", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-799153206 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 55de86c67c1c42f5ac40e569af9a7469 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-799153206 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-799153206-project Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d8b269fdc6e74f10b1ef81c5c8e8ce37 Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-799153206-project Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1615804545", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:50:31.944663 n-d-856894-1 devstack@n-api.service[128788]: exception: Maximum number of metadata items exceeds 128 Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1615804545', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:50:31.948145 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 10 10:50:31.951754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:31.954879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44fbbef1-78b0-4136-9cc1-d3d79e322d18 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:50:31.957014 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-44fbbef1-78b0-4136-9cc1-d3d79e322d18 tempest-AbsoluteLimitsNegativeTestJSON-799153206 tempest-AbsoluteLimitsNegativeTestJSON-799153206-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.390600 Sep 10 10:50:31.960867 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2440/2946] 10.222.0.20 () {60 vars in 1148 bytes} [Sat Sep 10 10:50:31 2022] POST /compute/v2.1/servers => generated 87 bytes in 395 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:50:31.971125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:31.973746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:31.989423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:31.990046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:31.991793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:31.992627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:31.997033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:31.997628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:32.159563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:32.173902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:32.175838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:32.186971 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3abbc083-57b9-4f63-a2bb-497f9ee895f2 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.223380 Sep 10 10:50:32.188857 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2441/2947] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:31 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:32.197227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c021418a-f6dc-422e-b34c-8a71258240af tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:32.198204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c021418a-f6dc-422e-b34c-8a71258240af tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:32.207152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c021418a-f6dc-422e-b34c-8a71258240af tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:32.208083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c021418a-f6dc-422e-b34c-8a71258240af tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:32.209064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c021418a-f6dc-422e-b34c-8a71258240af tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:32.210375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c021418a-f6dc-422e-b34c-8a71258240af tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:32.210866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c021418a-f6dc-422e-b34c-8a71258240af tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:32.211410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c021418a-f6dc-422e-b34c-8a71258240af tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:32.325848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c021418a-f6dc-422e-b34c-8a71258240af tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:32.339382 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c021418a-f6dc-422e-b34c-8a71258240af tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1218 microversion: 2.1 time: 0.148966 Sep 10 10:50:32.339979 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2442/2948] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:32 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1218 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:32.348876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c27f53bb-f5f3-412f-8b3d-97628f25d453 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:32.349171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c27f53bb-f5f3-412f-8b3d-97628f25d453 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:32.368945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27f53bb-f5f3-412f-8b3d-97628f25d453 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:32.369556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27f53bb-f5f3-412f-8b3d-97628f25d453 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:32.370007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27f53bb-f5f3-412f-8b3d-97628f25d453 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:32.370769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27f53bb-f5f3-412f-8b3d-97628f25d453 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:32.371224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27f53bb-f5f3-412f-8b3d-97628f25d453 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:32.371648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c27f53bb-f5f3-412f-8b3d-97628f25d453 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:32.606749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c27f53bb-f5f3-412f-8b3d-97628f25d453 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:32.632657 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c27f53bb-f5f3-412f-8b3d-97628f25d453 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1534 microversion: 2.1 time: 0.289920 Sep 10 10:50:32.634410 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2443/2949] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:32 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1534 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:32.642025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-781b3b54-c09c-4b7a-bb6e-2b9a3536a8fa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:32.642822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-781b3b54-c09c-4b7a-bb6e-2b9a3536a8fa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:32.658240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-781b3b54-c09c-4b7a-bb6e-2b9a3536a8fa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:32.659363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-781b3b54-c09c-4b7a-bb6e-2b9a3536a8fa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:32.659363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-781b3b54-c09c-4b7a-bb6e-2b9a3536a8fa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:32.660428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-781b3b54-c09c-4b7a-bb6e-2b9a3536a8fa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:32.660983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-781b3b54-c09c-4b7a-bb6e-2b9a3536a8fa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:32.661587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-781b3b54-c09c-4b7a-bb6e-2b9a3536a8fa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:32.942966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-781b3b54-c09c-4b7a-bb6e-2b9a3536a8fa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:32.962006 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-781b3b54-c09c-4b7a-bb6e-2b9a3536a8fa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1688 microversion: 2.1 time: 0.324414 Sep 10 10:50:32.968042 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2444/2950] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:32 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1688 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:32.978278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:32.979996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:32.988305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:32.989428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:32.991197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:32.993017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:32.994104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:32.994805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:33.117396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:33.128312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:33.129918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:33.131311 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d441a600-ad84-479a-a2f9-a98be3ee1b45 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1371 microversion: 2.47 time: 0.159557 Sep 10 10:50:33.149433 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2445/2951] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:32 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:33.222046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:33.222911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:33.231810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:33.234954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:33.235577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:33.237382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:33.238131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:33.238823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:33.335927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:33.348181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:33.350747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:33.359894 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62d43d75-c406-4658-826f-61d358baf9d4 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.142785 Sep 10 10:50:33.377858 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2446/2952] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:33 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:33.388338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c114677-c8ad-432f-a905-955bfcc16769 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:33.388967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c114677-c8ad-432f-a905-955bfcc16769 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:33.400156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c114677-c8ad-432f-a905-955bfcc16769 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:33.400942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c114677-c8ad-432f-a905-955bfcc16769 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:33.401726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c114677-c8ad-432f-a905-955bfcc16769 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:33.402502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c114677-c8ad-432f-a905-955bfcc16769 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:33.403570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c114677-c8ad-432f-a905-955bfcc16769 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:33.404649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c114677-c8ad-432f-a905-955bfcc16769 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:33.495078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c114677-c8ad-432f-a905-955bfcc16769 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:33.503739 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c114677-c8ad-432f-a905-955bfcc16769 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1266 microversion: 2.1 time: 0.126786 Sep 10 10:50:33.509189 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2447/2953] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:33 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:33.513892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f626fa3f-d463-40c9-83ab-8ac2a5bceb3c req-219f56ba-7a44-4bcc-9e6a-da5505fed047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5", "name": "network-vif-plugged", "status": "completed", "tag": "a9a5c077-18b4-45a9-ab46-131e14788b74"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:33.534874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f626fa3f-d463-40c9-83ab-8ac2a5bceb3c req-219f56ba-7a44-4bcc-9e6a-da5505fed047 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:33.536129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f626fa3f-d463-40c9-83ab-8ac2a5bceb3c req-219f56ba-7a44-4bcc-9e6a-da5505fed047 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:33.536690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f626fa3f-d463-40c9-83ab-8ac2a5bceb3c req-219f56ba-7a44-4bcc-9e6a-da5505fed047 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:33.557180 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f626fa3f-d463-40c9-83ab-8ac2a5bceb3c req-219f56ba-7a44-4bcc-9e6a-da5505fed047 service nova] Creating event network-vif-plugged:a9a5c077-18b4-45a9-ab46-131e14788b74 for instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 on n-h2-856894-1 Sep 10 10:50:33.563443 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f626fa3f-d463-40c9-83ab-8ac2a5bceb3c req-219f56ba-7a44-4bcc-9e6a-da5505fed047 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053071 Sep 10 10:50:33.564394 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2448/2954] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:33.675278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d166211-8333-457d-8bf2-7f78252ce73b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:33.676202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d166211-8333-457d-8bf2-7f78252ce73b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:33.693345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d166211-8333-457d-8bf2-7f78252ce73b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:33.694083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d166211-8333-457d-8bf2-7f78252ce73b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:33.694531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d166211-8333-457d-8bf2-7f78252ce73b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:33.695952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d166211-8333-457d-8bf2-7f78252ce73b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:33.696509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d166211-8333-457d-8bf2-7f78252ce73b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:33.697056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d166211-8333-457d-8bf2-7f78252ce73b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:33.757803 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:50:33.759255 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:50:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 10:50:33.804982 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:50:33.806382 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:50:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 10:50:33.915764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d166211-8333-457d-8bf2-7f78252ce73b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:33.928840 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d166211-8333-457d-8bf2-7f78252ce73b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1522 microversion: 2.1 time: 0.268240 Sep 10 10:50:33.941578 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2449/2955] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:33 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:33.990489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b3882fe-7aad-4e43-af95-e20d3d7b76c4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:33.991517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b3882fe-7aad-4e43-af95-e20d3d7b76c4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:34.002477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b3882fe-7aad-4e43-af95-e20d3d7b76c4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:34.003234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b3882fe-7aad-4e43-af95-e20d3d7b76c4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:34.004038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b3882fe-7aad-4e43-af95-e20d3d7b76c4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:34.005997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b3882fe-7aad-4e43-af95-e20d3d7b76c4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:34.006948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b3882fe-7aad-4e43-af95-e20d3d7b76c4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:34.007908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b3882fe-7aad-4e43-af95-e20d3d7b76c4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:34.179865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b3882fe-7aad-4e43-af95-e20d3d7b76c4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:34.190689 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b3882fe-7aad-4e43-af95-e20d3d7b76c4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.204430 Sep 10 10:50:34.191788 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2450/2956] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:33 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:34.209412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:34.210232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:34.218111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:34.218827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:34.219516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:34.220433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:34.221109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:34.221928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:34.315580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:34.328401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:34.331938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:34.334321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fdbf0db8-3181-4b8b-b20a-4a8af2b09bde tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1371 microversion: 2.47 time: 0.141116 Sep 10 10:50:34.335989 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2451/2957] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:34 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:34.390854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:34.392041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:34.399635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:34.400487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:34.401512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:34.402382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:34.402847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:34.403431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:34.510121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:34.521838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:34.523546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:34.536599 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1018771b-2e34-4e1f-8867-33b1dcdae422 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.149848 Sep 10 10:50:34.538223 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2452/2958] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:34 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:34.553521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f970f8f-11ec-4942-8438-d07b6da08388 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:34.558359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f970f8f-11ec-4942-8438-d07b6da08388 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:34.566710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f970f8f-11ec-4942-8438-d07b6da08388 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:34.567672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f970f8f-11ec-4942-8438-d07b6da08388 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:34.568279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f970f8f-11ec-4942-8438-d07b6da08388 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:34.569380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f970f8f-11ec-4942-8438-d07b6da08388 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:34.570540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f970f8f-11ec-4942-8438-d07b6da08388 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:34.571324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f970f8f-11ec-4942-8438-d07b6da08388 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:34.677003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f970f8f-11ec-4942-8438-d07b6da08388 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:34.700997 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f970f8f-11ec-4942-8438-d07b6da08388 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1266 microversion: 2.1 time: 0.159738 Sep 10 10:50:34.702779 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2453/2959] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:34 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:34.954627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-59b4404a-5f0f-424a-a024-ac9935f041e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:34.955488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-59b4404a-5f0f-424a-a024-ac9935f041e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:34.990883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b4404a-5f0f-424a-a024-ac9935f041e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:34.992351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b4404a-5f0f-424a-a024-ac9935f041e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:35.001512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b4404a-5f0f-424a-a024-ac9935f041e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:35.004677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b4404a-5f0f-424a-a024-ac9935f041e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:35.007547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b4404a-5f0f-424a-a024-ac9935f041e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:35.010901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b4404a-5f0f-424a-a024-ac9935f041e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:35.333997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-59b4404a-5f0f-424a-a024-ac9935f041e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:35.348883 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-59b4404a-5f0f-424a-a024-ac9935f041e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1522 microversion: 2.1 time: 0.399036 Sep 10 10:50:35.354397 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2454/2960] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:34 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:35.364512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-442177ac-ba6a-46c0-b1fe-2a14f9a7bcbf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:35.365418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-442177ac-ba6a-46c0-b1fe-2a14f9a7bcbf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:35.371956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-442177ac-ba6a-46c0-b1fe-2a14f9a7bcbf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:35.372945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-442177ac-ba6a-46c0-b1fe-2a14f9a7bcbf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:35.373517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-442177ac-ba6a-46c0-b1fe-2a14f9a7bcbf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:35.374544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-442177ac-ba6a-46c0-b1fe-2a14f9a7bcbf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:35.375097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-442177ac-ba6a-46c0-b1fe-2a14f9a7bcbf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:35.375723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-442177ac-ba6a-46c0-b1fe-2a14f9a7bcbf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:35.423820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:35.574189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-442177ac-ba6a-46c0-b1fe-2a14f9a7bcbf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:35.588474 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-442177ac-ba6a-46c0-b1fe-2a14f9a7bcbf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.232531 Sep 10 10:50:35.589160 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2455/2961] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:35 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:35.594215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:35.595043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:35.601916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:35.602669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:35.603326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:35.604258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:35.604896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:35.605785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:35.790048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:35.813000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:35.814503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:35.822197 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-06180d68-aaa9-4440-af27-6cda4b6ded31 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1371 microversion: 2.47 time: 0.231691 Sep 10 10:50:35.824935 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2456/2962] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:35 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:35.839519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:35.841632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:35.849428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:35.850154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:35.850854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:35.852440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:35.853058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:35.853862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:35.955478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:35.968420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:35.974627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:35.990518 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-515124b6-53b5-4b95-aa0a-163e7863370b tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.164304 Sep 10 10:50:35.995273 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2457/2963] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:35 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:36.008842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7f1e0f74-cf6c-4df7-bab3-e827c93a51d6 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:36.012476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7f1e0f74-cf6c-4df7-bab3-e827c93a51d6 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:36.027327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f1e0f74-cf6c-4df7-bab3-e827c93a51d6 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:36.028247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f1e0f74-cf6c-4df7-bab3-e827c93a51d6 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:36.030239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f1e0f74-cf6c-4df7-bab3-e827c93a51d6 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:36.031135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f1e0f74-cf6c-4df7-bab3-e827c93a51d6 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:36.031762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f1e0f74-cf6c-4df7-bab3-e827c93a51d6 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:36.032356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f1e0f74-cf6c-4df7-bab3-e827c93a51d6 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:36.154888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7f1e0f74-cf6c-4df7-bab3-e827c93a51d6 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:36.163895 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7f1e0f74-cf6c-4df7-bab3-e827c93a51d6 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1266 microversion: 2.1 time: 0.162953 Sep 10 10:50:36.178035 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2458/2964] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:35 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:36.382137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-68cc0813-6c65-48e4-b9f0-3865118600e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:36.383780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-68cc0813-6c65-48e4-b9f0-3865118600e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:36.410651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68cc0813-6c65-48e4-b9f0-3865118600e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:36.411623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68cc0813-6c65-48e4-b9f0-3865118600e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:36.415764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68cc0813-6c65-48e4-b9f0-3865118600e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:36.418834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68cc0813-6c65-48e4-b9f0-3865118600e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:36.425739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68cc0813-6c65-48e4-b9f0-3865118600e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:36.426622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68cc0813-6c65-48e4-b9f0-3865118600e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:37.260794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-68cc0813-6c65-48e4-b9f0-3865118600e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:37.293918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-68cc0813-6c65-48e4-b9f0-3865118600e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1522 microversion: 2.1 time: 0.914223 Sep 10 10:50:37.323343 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2459/2965] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:36 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1522 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:50:37.338574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36ebac01-da72-4282-a59d-8455ddbfedb1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:37.340407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36ebac01-da72-4282-a59d-8455ddbfedb1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:37.366239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ebac01-da72-4282-a59d-8455ddbfedb1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:37.374271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ebac01-da72-4282-a59d-8455ddbfedb1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:37.375622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ebac01-da72-4282-a59d-8455ddbfedb1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:37.378531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ebac01-da72-4282-a59d-8455ddbfedb1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:37.380173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ebac01-da72-4282-a59d-8455ddbfedb1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:37.382049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36ebac01-da72-4282-a59d-8455ddbfedb1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:37.783405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36ebac01-da72-4282-a59d-8455ddbfedb1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:37.791820 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36ebac01-da72-4282-a59d-8455ddbfedb1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.466742 Sep 10 10:50:37.796570 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2460/2966] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:37 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:37.815407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:37.817109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:37.837468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:37.847643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:37.852885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:37.864145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:37.865713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:37.869496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:38.181925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:38.217834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:38.236356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:38.241264 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2099de9-c40f-48ea-bf00-58f089d61d92 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1356 microversion: 2.47 time: 0.442166 Sep 10 10:50:38.271958 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2461/2967] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:37 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1356 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:38.298268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:38.299144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:38.309239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:38.311052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:38.311781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:38.312666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:38.314045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:38.314644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:38.615552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:38.626098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:38.627496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:38.655736 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60943eff-1867-47dc-99f0-34fa41efbacd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.368084 Sep 10 10:50:38.694821 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2462/2968] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:38 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:38.724511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4309049d-03ac-4bc8-bc01-c6e8f8733e08 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:38.728694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4309049d-03ac-4bc8-bc01-c6e8f8733e08 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:38.770424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4309049d-03ac-4bc8-bc01-c6e8f8733e08 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:38.775440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4309049d-03ac-4bc8-bc01-c6e8f8733e08 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:38.776087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4309049d-03ac-4bc8-bc01-c6e8f8733e08 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:38.777100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4309049d-03ac-4bc8-bc01-c6e8f8733e08 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:38.778063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4309049d-03ac-4bc8-bc01-c6e8f8733e08 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:38.778655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4309049d-03ac-4bc8-bc01-c6e8f8733e08 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:39.329451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4309049d-03ac-4bc8-bc01-c6e8f8733e08 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:39.352678 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4309049d-03ac-4bc8-bc01-c6e8f8733e08 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1272 microversion: 2.1 time: 0.652917 Sep 10 10:50:39.355204 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2463/2969] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:38 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1272 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:39.370731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-658865b4-ec32-41d8-99f9-f252acfb4977 req-f8133a3c-e67e-4bbc-a619-5fcae86bfe7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbd1fad-d00f-4532-9b16-5dc493820bf7", "name": "network-vif-unplugged", "status": "completed", "tag": "9fbd9607-a1ea-4dde-bde4-ad4c12562465"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:39.393860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-658865b4-ec32-41d8-99f9-f252acfb4977 req-f8133a3c-e67e-4bbc-a619-5fcae86bfe7a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:39.394597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-658865b4-ec32-41d8-99f9-f252acfb4977 req-f8133a3c-e67e-4bbc-a619-5fcae86bfe7a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:39.397912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-658865b4-ec32-41d8-99f9-f252acfb4977 req-f8133a3c-e67e-4bbc-a619-5fcae86bfe7a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:39.458072 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-658865b4-ec32-41d8-99f9-f252acfb4977 req-f8133a3c-e67e-4bbc-a619-5fcae86bfe7a service nova] Creating event network-vif-unplugged:9fbd9607-a1ea-4dde-bde4-ad4c12562465 for instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 on n-h2-856894-1 Sep 10 10:50:39.494821 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-658865b4-ec32-41d8-99f9-f252acfb4977 req-f8133a3c-e67e-4bbc-a619-5fcae86bfe7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135821 Sep 10 10:50:39.496456 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2464/2970] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:39.513642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:39.539888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:39.558557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Searching by: {'deleted': False, 'project_id': 'a43851400d0a427ab18328c92b349fbf'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:50:39.592083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:39.595430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:39.596971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:39.600670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:39.601179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:39.605917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:39.801863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=35 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:40.013161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:50:40.208972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:40.217470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:40.218032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:40.218481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:40.251370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:40.252528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:40.478002 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af37d387-4be5-4333-918c-7ec6401c69c1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.978353 Sep 10 10:50:40.478650 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2465/2971] 10.222.0.20 () {60 vars in 1187 bytes} [Sat Sep 10 10:50:39 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:40.506092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-657adf2e-b910-46b0-ad8a-2e028218d67d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:40.507163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-657adf2e-b910-46b0-ad8a-2e028218d67d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:40.528439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657adf2e-b910-46b0-ad8a-2e028218d67d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:40.528949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657adf2e-b910-46b0-ad8a-2e028218d67d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:40.529684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657adf2e-b910-46b0-ad8a-2e028218d67d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:40.530527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657adf2e-b910-46b0-ad8a-2e028218d67d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:40.530994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657adf2e-b910-46b0-ad8a-2e028218d67d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:40.531426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657adf2e-b910-46b0-ad8a-2e028218d67d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:41.055948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-657adf2e-b910-46b0-ad8a-2e028218d67d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:41.066715 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-657adf2e-b910-46b0-ad8a-2e028218d67d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1522 microversion: 2.1 time: 0.577364 Sep 10 10:50:41.069993 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2466/2972] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:40 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:41.082075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7e3c528d-e062-44ec-9085-125bf6f84fc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:41.082989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e3c528d-e062-44ec-9085-125bf6f84fc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:41.094842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3c528d-e062-44ec-9085-125bf6f84fc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:41.095609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3c528d-e062-44ec-9085-125bf6f84fc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:41.097614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3c528d-e062-44ec-9085-125bf6f84fc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:41.098743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3c528d-e062-44ec-9085-125bf6f84fc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:41.105932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3c528d-e062-44ec-9085-125bf6f84fc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:41.106633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3c528d-e062-44ec-9085-125bf6f84fc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:41.928534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e3c528d-e062-44ec-9085-125bf6f84fc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:41.945925 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7e3c528d-e062-44ec-9085-125bf6f84fc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.867416 Sep 10 10:50:41.946592 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2467/2973] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:41 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:41.978785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:41.982589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:42.016883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:42.018280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:42.018742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:42.019483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:42.019945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:42.020371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:42.240058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:42.261530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:42.271015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:42.290626 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-84b20ee0-7f19-4c8a-ae78-b0183ef3ee03 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1447 microversion: 2.75 time: 0.338133 Sep 10 10:50:42.293252 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2468/2974] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:41 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1447 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:42.314707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dbafdd96-f30e-477a-a5f1-595488b0cd59 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:42.321148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dbafdd96-f30e-477a-a5f1-595488b0cd59 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:42.331711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbafdd96-f30e-477a-a5f1-595488b0cd59 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:42.332546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbafdd96-f30e-477a-a5f1-595488b0cd59 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:42.336454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbafdd96-f30e-477a-a5f1-595488b0cd59 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:42.341722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbafdd96-f30e-477a-a5f1-595488b0cd59 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:42.342694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbafdd96-f30e-477a-a5f1-595488b0cd59 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:42.343394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dbafdd96-f30e-477a-a5f1-595488b0cd59 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:42.948631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dbafdd96-f30e-477a-a5f1-595488b0cd59 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:42.969744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dbafdd96-f30e-477a-a5f1-595488b0cd59 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1314 microversion: 2.1 time: 0.668788 Sep 10 10:50:42.973194 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2469/2975] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:42 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:42.985018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-628ab666-435c-43d1-b55e-8517c4d7601e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:42.985575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-628ab666-435c-43d1-b55e-8517c4d7601e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:43.012859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-628ab666-435c-43d1-b55e-8517c4d7601e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:43.013403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-628ab666-435c-43d1-b55e-8517c4d7601e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:43.016664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-628ab666-435c-43d1-b55e-8517c4d7601e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:43.023007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-628ab666-435c-43d1-b55e-8517c4d7601e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:43.024098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-628ab666-435c-43d1-b55e-8517c4d7601e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:43.026855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-628ab666-435c-43d1-b55e-8517c4d7601e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:43.095420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-628ab666-435c-43d1-b55e-8517c4d7601e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:50:43.243804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:43.329228 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-628ab666-435c-43d1-b55e-8517c4d7601e tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 204 len: 0 microversion: 2.47 time: 0.353476 Sep 10 10:50:43.330882 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2470/2976] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:50:42 2022] DELETE /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:50:43.344408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6394a7c7-1616-4127-9d40-2477db5d7d13 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:43.347954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6394a7c7-1616-4127-9d40-2477db5d7d13 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:43.363705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6394a7c7-1616-4127-9d40-2477db5d7d13 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:43.364586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6394a7c7-1616-4127-9d40-2477db5d7d13 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:43.365993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6394a7c7-1616-4127-9d40-2477db5d7d13 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:43.368523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6394a7c7-1616-4127-9d40-2477db5d7d13 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:43.369276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6394a7c7-1616-4127-9d40-2477db5d7d13 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:43.369918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6394a7c7-1616-4127-9d40-2477db5d7d13 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:44.608260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6394a7c7-1616-4127-9d40-2477db5d7d13 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:44.620391 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6394a7c7-1616-4127-9d40-2477db5d7d13 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1522 microversion: 2.1 time: 1.287822 Sep 10 10:50:44.622303 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2471/2977] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:43 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1522 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:44.655265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b807a80f-e77c-48fb-a9ca-bc0e8a008048 req-aa3e00a1-f78c-4ce4-b23c-6fb134923e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbd1fad-d00f-4532-9b16-5dc493820bf7", "name": "network-vif-plugged", "status": "completed", "tag": "9fbd9607-a1ea-4dde-bde4-ad4c12562465"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:44.666959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b807a80f-e77c-48fb-a9ca-bc0e8a008048 req-aa3e00a1-f78c-4ce4-b23c-6fb134923e9b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:44.667824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b807a80f-e77c-48fb-a9ca-bc0e8a008048 req-aa3e00a1-f78c-4ce4-b23c-6fb134923e9b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:44.668490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b807a80f-e77c-48fb-a9ca-bc0e8a008048 req-aa3e00a1-f78c-4ce4-b23c-6fb134923e9b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:44.699117 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b807a80f-e77c-48fb-a9ca-bc0e8a008048 req-aa3e00a1-f78c-4ce4-b23c-6fb134923e9b service nova] Creating event network-vif-plugged:9fbd9607-a1ea-4dde-bde4-ad4c12562465 for instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 on n-h2-856894-1 Sep 10 10:50:44.712438 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b807a80f-e77c-48fb-a9ca-bc0e8a008048 req-aa3e00a1-f78c-4ce4-b23c-6fb134923e9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087548 Sep 10 10:50:44.748684 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2472/2978] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:44.906505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5be0e81c-c00c-463e-89d1-d55cd116f07a req-6275e8ec-4b17-4945-9772-6c7cbb93b547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e051393-fa2f-41d0-a506-8e59eaee8e20", "tag": "990ea5b5-eb74-4af6-aab1-32b4d04f1739"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:44.973369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5be0e81c-c00c-463e-89d1-d55cd116f07a req-6275e8ec-4b17-4945-9772-6c7cbb93b547 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:44.977236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5be0e81c-c00c-463e-89d1-d55cd116f07a req-6275e8ec-4b17-4945-9772-6c7cbb93b547 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:44.977777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5be0e81c-c00c-463e-89d1-d55cd116f07a req-6275e8ec-4b17-4945-9772-6c7cbb93b547 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:45.028321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5be0e81c-c00c-463e-89d1-d55cd116f07a req-6275e8ec-4b17-4945-9772-6c7cbb93b547 service nova] Creating event network-changed:990ea5b5-eb74-4af6-aab1-32b4d04f1739 for instance 0e051393-fa2f-41d0-a506-8e59eaee8e20 on n-h2-856894-1 Sep 10 10:50:45.050207 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5be0e81c-c00c-463e-89d1-d55cd116f07a req-6275e8ec-4b17-4945-9772-6c7cbb93b547 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299430 Sep 10 10:50:45.051079 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2473/2979] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:45.067229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07d6bb25-2117-48d9-8826-a4e9805a40f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:45.069875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07d6bb25-2117-48d9-8826-a4e9805a40f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:45.082435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d6bb25-2117-48d9-8826-a4e9805a40f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:45.084878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d6bb25-2117-48d9-8826-a4e9805a40f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:45.087552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d6bb25-2117-48d9-8826-a4e9805a40f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:45.088475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d6bb25-2117-48d9-8826-a4e9805a40f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:45.089133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d6bb25-2117-48d9-8826-a4e9805a40f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:45.089924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d6bb25-2117-48d9-8826-a4e9805a40f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:45.438116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-07d6bb25-2117-48d9-8826-a4e9805a40f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:45.450031 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07d6bb25-2117-48d9-8826-a4e9805a40f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.397493 Sep 10 10:50:45.451521 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2474/2980] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:45 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:45.461821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:45.462464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:45.485112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:45.487016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:45.497452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:45.498559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:45.499251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:45.499916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:45.646657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:45.660525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:45.666634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:45.677909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:45.683069 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fea5a9d0-97c4-4486-8295-3d137f633eaf tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1453 microversion: 2.75 time: 0.230318 Sep 10 10:50:45.702382 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2475/2981] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:45 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1453 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:45.720112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:45.724493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:45.753806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:45.754438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:45.754977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:45.756112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:45.756716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:45.757192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:45.911762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:45.920998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:45.932267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:45.936144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9fbd850c-38e8-43b3-9288-6b7b6713c5f1 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1362 microversion: 2.47 time: 0.229770 Sep 10 10:50:45.937024 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2476/2982] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:45 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:45.975770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e365526b-2248-4939-a38f-a8241f8bd839 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:45.979001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e365526b-2248-4939-a38f-a8241f8bd839 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:46.000284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e365526b-2248-4939-a38f-a8241f8bd839 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:46.002359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e365526b-2248-4939-a38f-a8241f8bd839 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:46.003030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e365526b-2248-4939-a38f-a8241f8bd839 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:46.007608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e365526b-2248-4939-a38f-a8241f8bd839 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:46.016716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e365526b-2248-4939-a38f-a8241f8bd839 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:46.020635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e365526b-2248-4939-a38f-a8241f8bd839 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:46.328256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e365526b-2248-4939-a38f-a8241f8bd839 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:46.341121 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e365526b-2248-4939-a38f-a8241f8bd839 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1314 microversion: 2.1 time: 0.390302 Sep 10 10:50:46.342587 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2477/2983] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:45 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:46.347730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44e88038-e650-4855-bc45-9fee0f3ee29f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:46.348690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-44e88038-e650-4855-bc45-9fee0f3ee29f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:46.363602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e88038-e650-4855-bc45-9fee0f3ee29f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:46.364396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e88038-e650-4855-bc45-9fee0f3ee29f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:46.365135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e88038-e650-4855-bc45-9fee0f3ee29f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:46.366123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e88038-e650-4855-bc45-9fee0f3ee29f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:46.366761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e88038-e650-4855-bc45-9fee0f3ee29f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:46.368161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44e88038-e650-4855-bc45-9fee0f3ee29f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:46.616785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44e88038-e650-4855-bc45-9fee0f3ee29f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:46.629431 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-44e88038-e650-4855-bc45-9fee0f3ee29f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1522 microversion: 2.1 time: 0.285302 Sep 10 10:50:46.630500 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2478/2984] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:46 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:46.844199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-877b82ff-b0f5-4e47-a98d-23de244ffb5a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: .version_select at 0x7efcad9d6e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-628362644", "description": "tempest-description-493366108"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:47.151062 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-877b82ff-b0f5-4e47-a98d-23de244ffb5a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.519152 Sep 10 10:50:47.163437 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2479/2985] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:50:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:47.174601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b048d17f-c1dd-4ccc-a486-f6533905364f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:47.176153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b048d17f-c1dd-4ccc-a486-f6533905364f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:47.212886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b048d17f-c1dd-4ccc-a486-f6533905364f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:47.215426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b048d17f-c1dd-4ccc-a486-f6533905364f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:47.216130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b048d17f-c1dd-4ccc-a486-f6533905364f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:47.217237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b048d17f-c1dd-4ccc-a486-f6533905364f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:47.217977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b048d17f-c1dd-4ccc-a486-f6533905364f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:47.218652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b048d17f-c1dd-4ccc-a486-f6533905364f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:47.505569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b048d17f-c1dd-4ccc-a486-f6533905364f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:47.516196 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b048d17f-c1dd-4ccc-a486-f6533905364f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.348517 Sep 10 10:50:47.517502 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2480/2986] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:47 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:47.535352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:47.536742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:47.544841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:47.545764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:47.546772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:47.547662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:47.548421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:47.549043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:47.840872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:47.866174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:47.872039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:47.883483 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-702c8200-5efc-462f-b7bf-b83d01e073fd tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1438 microversion: 2.75 time: 0.364638 Sep 10 10:50:47.889128 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2481/2987] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:47 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1438 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:47.898836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:47.899817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:47.916767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:47.917638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:47.918283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:47.919238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:47.919881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:47.920563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:47.974636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:47.975148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:47.975799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:47.978116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lazy-loading 'fault' on Instance uuid 1223dfcd-4986-4254-adb1-3f7818bd0f62 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:50:48.071517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:48.086257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:48.089757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:48.091859 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cc4a6b98-a767-48bf-a919-e141b95209f6 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 200 len: 1367 microversion: 2.47 time: 0.201488 Sep 10 10:50:48.112613 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2482/2988] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:47 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:48.118155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd9676be-074b-4e80-be42-97195b357d27 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: .version_select at 0x7efcae7e0310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1506094518", "description": "tempest-description-1189053301"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:48.437831 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fd9676be-074b-4e80-be42-97195b357d27 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.323727 Sep 10 10:50:48.438972 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2483/2989] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:50:48 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:48.443778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-548be00c-7518-4d44-aa9c-8b6ad531b540 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:48.444600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-548be00c-7518-4d44-aa9c-8b6ad531b540 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:48.471538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-548be00c-7518-4d44-aa9c-8b6ad531b540 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:48.472037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-548be00c-7518-4d44-aa9c-8b6ad531b540 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:48.472485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-548be00c-7518-4d44-aa9c-8b6ad531b540 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:48.473236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-548be00c-7518-4d44-aa9c-8b6ad531b540 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:48.473697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-548be00c-7518-4d44-aa9c-8b6ad531b540 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:48.474135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-548be00c-7518-4d44-aa9c-8b6ad531b540 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:48.792910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-548be00c-7518-4d44-aa9c-8b6ad531b540 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:48.804862 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-548be00c-7518-4d44-aa9c-8b6ad531b540 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1314 microversion: 2.1 time: 0.364132 Sep 10 10:50:48.817232 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2484/2990] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:48 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:48.834091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c35b9b5d-4205-4d5f-9405-d537a566c4e6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:48.834969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c35b9b5d-4205-4d5f-9405-d537a566c4e6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:48.843379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c35b9b5d-4205-4d5f-9405-d537a566c4e6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:48.844158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c35b9b5d-4205-4d5f-9405-d537a566c4e6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:48.844833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c35b9b5d-4205-4d5f-9405-d537a566c4e6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:48.845829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c35b9b5d-4205-4d5f-9405-d537a566c4e6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:48.846912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c35b9b5d-4205-4d5f-9405-d537a566c4e6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:48.847047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c35b9b5d-4205-4d5f-9405-d537a566c4e6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:49.018912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c35b9b5d-4205-4d5f-9405-d537a566c4e6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:49.029695 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c35b9b5d-4205-4d5f-9405-d537a566c4e6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1522 microversion: 2.1 time: 0.218451 Sep 10 10:50:49.043454 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2485/2991] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:48 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:49.398881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:49.402712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:49.427755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:49.438525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:49.439120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:49.447709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:49.448511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:49.450597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:49.684935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:50:49.690516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:50:49.691506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:50:49.696397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:50:49.705700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:50:49.853824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:49.862961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:49.863683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:49.864151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:49.864970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:49.865721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:49.866277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:49.983263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:50.127896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:50:50.157697 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f0a9571b-1456-4ca2-b6c7-b85b79907b32 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554/action" status: 202 len: 1942 microversion: 2.75 time: 1.124964 Sep 10 10:50:50.159363 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2486/2992] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:50:49 2022] POST /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554/action => generated 1942 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 10:50:50.164483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a76be6f9-35e0-4c31-bb59-e21bb523ce89 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:50.165448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a76be6f9-35e0-4c31-bb59-e21bb523ce89 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:50.173222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a76be6f9-35e0-4c31-bb59-e21bb523ce89 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:50.174076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a76be6f9-35e0-4c31-bb59-e21bb523ce89 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:50.174778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a76be6f9-35e0-4c31-bb59-e21bb523ce89 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:50.175651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a76be6f9-35e0-4c31-bb59-e21bb523ce89 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:50.176268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a76be6f9-35e0-4c31-bb59-e21bb523ce89 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:50.177103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a76be6f9-35e0-4c31-bb59-e21bb523ce89 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:50.201805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:50.206083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=16 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:50.269795 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:50:50.271096 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:50:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 10:50:50.427411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a76be6f9-35e0-4c31-bb59-e21bb523ce89 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:50.439703 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a76be6f9-35e0-4c31-bb59-e21bb523ce89 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.276666 Sep 10 10:50:50.443000 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2487/2993] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:50 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:50.451654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-99944077", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "76161e86-8494-4ec8-960c-d16cf1f1f18b"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:50.740257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] validate_networks() for [('76161e86-8494-4ec8-960c-d16cf1f1f18b', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:50:51.767988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:50:51.768551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:50:51.768897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:50:51.769374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:50:51.769800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:50:51.790115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:51.790614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:51.791115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:51.791923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:51.792387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:51.792826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:51.822746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Getting quotas for project 684b82ad978e47479334031e215abdc1. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:50:51.832479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Getting quotas for user e9cd1c03592e40a38dea70af40a8bd7b and project 684b82ad978e47479334031e215abdc1. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:50:51.856593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:50:51.859977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:50:51.956895 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea4dba6a-f5bd-425e-bebb-27d71b46a7a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.512377 Sep 10 10:50:51.964576 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2488/2994] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:50:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:50:51.979269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:51.982289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 1223dfcd-4986-4254-adb1-3f7818bd0f62] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:52.009778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:52.010282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:52.010716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:52.015939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:52.017363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:52.018029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:52.078138 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] HTTP exception thrown: Instance 1223dfcd-4986-4254-adb1-3f7818bd0f62 could not be found. Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Request method failure captured: Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 HTTP/1.1 Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGvF_LW_PbRv62wD87Mld73xAfOpGuNfQH06QfzHOf12-1gMTVULBc6TaLm7B83K-Nx6qUe1HiKtjqnRZevJsHYl71L6DEEd_QMpDm9kj-nL02TKPrKh9JLDZABwjXHjNSYOje8TGPhkTVGrd1djF83-k_UZn3j86r0WclnrPnSFpdc Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.47 Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: a43851400d0a427ab18328c92b349fbf Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerShowV247Test-271353662 Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43851400d0a427ab18328c92b349fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a43851400d0a427ab18328c92b349fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43851400d0a427ab18328c92b349fbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a43851400d0a427ab18328c92b349fbf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerShowV247Test-271353662 Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: a43851400d0a427ab18328c92b349fbf Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerShowV247Test-271353662 Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerShowV247Test-271353662-project Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 52c0efce1fa344059de5505b96930282 Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerShowV247Test-271353662-project Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 1223dfcd-4986-4254-adb1-3f7818bd0f62 could not be found. Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '1223dfcd-4986-4254-adb1-3f7818bd0f62'} Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1223dfcd-4986-4254-adb1-3f7818bd0f62 could not be found. Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1223dfcd-4986-4254-adb1-3f7818bd0f62 could not be found. Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:52.081216 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:52.086252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:52.086252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:52.086252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:52.086252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:50:52.086252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:50:52.086252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1223dfcd-4986-4254-adb1-3f7818bd0f62 could not be found. Sep 10 10:50:52.086252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:52.089592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Returning 404 to user: Instance 1223dfcd-4986-4254-adb1-3f7818bd0f62 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:50:52.090736 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-97a3e557-937c-4ac3-9a9a-f4a647951b9b tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62" status: 404 len: 111 microversion: 2.47 time: 0.124983 Sep 10 10:50:52.091672 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2489/2995] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:51 2022] GET /compute/v2.1/servers/1223dfcd-4986-4254-adb1-3f7818bd0f62 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:50:52.097275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97b9a002-f8f6-46c1-a277-5c3bf73a1bed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:52.098315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-97b9a002-f8f6-46c1-a277-5c3bf73a1bed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:52.106032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97b9a002-f8f6-46c1-a277-5c3bf73a1bed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:52.106944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97b9a002-f8f6-46c1-a277-5c3bf73a1bed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:52.107616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97b9a002-f8f6-46c1-a277-5c3bf73a1bed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:52.108682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97b9a002-f8f6-46c1-a277-5c3bf73a1bed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:52.109918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97b9a002-f8f6-46c1-a277-5c3bf73a1bed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:52.110583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97b9a002-f8f6-46c1-a277-5c3bf73a1bed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:52.542650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-97b9a002-f8f6-46c1-a277-5c3bf73a1bed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:52.554786 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-97b9a002-f8f6-46c1-a277-5c3bf73a1bed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1314 microversion: 2.1 time: 0.461757 Sep 10 10:50:52.557156 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2490/2996] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:52 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:52.589045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb7f3b20-39c6-4d1a-9892-82688b567f9a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:52.593909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fb7f3b20-39c6-4d1a-9892-82688b567f9a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:52.607031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb7f3b20-39c6-4d1a-9892-82688b567f9a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:52.608072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb7f3b20-39c6-4d1a-9892-82688b567f9a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:52.612648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb7f3b20-39c6-4d1a-9892-82688b567f9a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:52.614528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb7f3b20-39c6-4d1a-9892-82688b567f9a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:52.616932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb7f3b20-39c6-4d1a-9892-82688b567f9a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:52.620582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb7f3b20-39c6-4d1a-9892-82688b567f9a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:53.078110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb7f3b20-39c6-4d1a-9892-82688b567f9a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:53.110224 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb7f3b20-39c6-4d1a-9892-82688b567f9a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1507 microversion: 2.1 time: 0.530343 Sep 10 10:50:53.123220 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2491/2997] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:52 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1507 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:53.136584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3737ee1e-afa2-4af7-a15c-352d46da962e tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:53.137240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3737ee1e-afa2-4af7-a15c-352d46da962e tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:53.167237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3737ee1e-afa2-4af7-a15c-352d46da962e tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:53.168477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3737ee1e-afa2-4af7-a15c-352d46da962e tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:53.172254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3737ee1e-afa2-4af7-a15c-352d46da962e tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:53.173398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3737ee1e-afa2-4af7-a15c-352d46da962e tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:53.174091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3737ee1e-afa2-4af7-a15c-352d46da962e tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:53.175010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3737ee1e-afa2-4af7-a15c-352d46da962e tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:53.349326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-3737ee1e-afa2-4af7-a15c-352d46da962e tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:50:53.405059 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3737ee1e-afa2-4af7-a15c-352d46da962e tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.279787 Sep 10 10:50:53.418961 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2492/2998] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:53 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:53.435714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-89d47dd3-76ff-4f9f-88dd-d6ba2f957279 req-c8684fca-9bb6-4984-995f-17da8bdf2fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e051393-fa2f-41d0-a506-8e59eaee8e20", "name": "network-vif-plugged", "status": "completed", "tag": "990ea5b5-eb74-4af6-aab1-32b4d04f1739"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:53.462230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-89d47dd3-76ff-4f9f-88dd-d6ba2f957279 req-c8684fca-9bb6-4984-995f-17da8bdf2fba service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:53.462715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-89d47dd3-76ff-4f9f-88dd-d6ba2f957279 req-c8684fca-9bb6-4984-995f-17da8bdf2fba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:53.467466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-89d47dd3-76ff-4f9f-88dd-d6ba2f957279 req-c8684fca-9bb6-4984-995f-17da8bdf2fba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:53.494419 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-89d47dd3-76ff-4f9f-88dd-d6ba2f957279 req-c8684fca-9bb6-4984-995f-17da8bdf2fba service nova] Creating event network-vif-plugged:990ea5b5-eb74-4af6-aab1-32b4d04f1739 for instance 0e051393-fa2f-41d0-a506-8e59eaee8e20 on n-h2-856894-1 Sep 10 10:50:53.506707 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-89d47dd3-76ff-4f9f-88dd-d6ba2f957279 req-c8684fca-9bb6-4984-995f-17da8bdf2fba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076601 Sep 10 10:50:53.507626 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2493/2999] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:50:53.520640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4629c48-3ea2-4116-816b-8d8e65f7f3d6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:53.521803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d4629c48-3ea2-4116-816b-8d8e65f7f3d6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:53.532050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4629c48-3ea2-4116-816b-8d8e65f7f3d6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:53.532793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4629c48-3ea2-4116-816b-8d8e65f7f3d6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:53.533504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4629c48-3ea2-4116-816b-8d8e65f7f3d6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:53.534459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4629c48-3ea2-4116-816b-8d8e65f7f3d6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:53.535140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4629c48-3ea2-4116-816b-8d8e65f7f3d6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:53.535790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4629c48-3ea2-4116-816b-8d8e65f7f3d6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:54.025562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4629c48-3ea2-4116-816b-8d8e65f7f3d6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:54.036217 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4629c48-3ea2-4116-816b-8d8e65f7f3d6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.525433 Sep 10 10:50:54.045386 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2494/3000] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:53 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:54.058124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f7f93c6b-a26d-44b0-abcb-1749d3c0d1a7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:54.059074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f7f93c6b-a26d-44b0-abcb-1749d3c0d1a7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:54.072136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f93c6b-a26d-44b0-abcb-1749d3c0d1a7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:54.076299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f93c6b-a26d-44b0-abcb-1749d3c0d1a7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:54.076964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f93c6b-a26d-44b0-abcb-1749d3c0d1a7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:54.078095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f93c6b-a26d-44b0-abcb-1749d3c0d1a7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:54.081338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f93c6b-a26d-44b0-abcb-1749d3c0d1a7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:54.082393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f93c6b-a26d-44b0-abcb-1749d3c0d1a7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:54.262402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f7f93c6b-a26d-44b0-abcb-1749d3c0d1a7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:54.275973 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f7f93c6b-a26d-44b0-abcb-1749d3c0d1a7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1266 microversion: 2.1 time: 0.229186 Sep 10 10:50:54.276574 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2495/3001] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:54 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:54.307099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6802525d-1af0-486e-a43f-c3deb6260f63 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:54.307794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6802525d-1af0-486e-a43f-c3deb6260f63 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:54.317082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6802525d-1af0-486e-a43f-c3deb6260f63 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:54.317804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6802525d-1af0-486e-a43f-c3deb6260f63 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:54.318472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6802525d-1af0-486e-a43f-c3deb6260f63 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:54.321687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6802525d-1af0-486e-a43f-c3deb6260f63 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:54.322222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6802525d-1af0-486e-a43f-c3deb6260f63 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:54.322802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6802525d-1af0-486e-a43f-c3deb6260f63 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:54.380457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6802525d-1af0-486e-a43f-c3deb6260f63 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:50:54.575816 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6802525d-1af0-486e-a43f-c3deb6260f63 tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7bca7472-e63e-4b9a-a54f-9ab02f82cc1c" status: 204 len: 0 microversion: 2.47 time: 0.297220 Sep 10 10:50:54.580564 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2496/3002] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:50:54 2022] DELETE /compute/v2.1/servers/7bca7472-e63e-4b9a-a54f-9ab02f82cc1c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:50:54.587646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ae83a9c-fb68-40f2-880f-bb0937b3a56d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:54.588428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3ae83a9c-fb68-40f2-880f-bb0937b3a56d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:54.599358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ae83a9c-fb68-40f2-880f-bb0937b3a56d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:54.600043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ae83a9c-fb68-40f2-880f-bb0937b3a56d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:54.600500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ae83a9c-fb68-40f2-880f-bb0937b3a56d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:54.601672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ae83a9c-fb68-40f2-880f-bb0937b3a56d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:54.602300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ae83a9c-fb68-40f2-880f-bb0937b3a56d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:54.604797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ae83a9c-fb68-40f2-880f-bb0937b3a56d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:54.902930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3ae83a9c-fb68-40f2-880f-bb0937b3a56d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:54.937060 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3ae83a9c-fb68-40f2-880f-bb0937b3a56d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 200 len: 1507 microversion: 2.1 time: 0.353950 Sep 10 10:50:54.938338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2497/3003] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:54 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:54.967571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-981e7dfe-031a-40a7-8375-0b660db43e13 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:54.968208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-981e7dfe-031a-40a7-8375-0b660db43e13 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:54.976014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-981e7dfe-031a-40a7-8375-0b660db43e13 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:54.977465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-981e7dfe-031a-40a7-8375-0b660db43e13 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:54.977921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-981e7dfe-031a-40a7-8375-0b660db43e13 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:54.978862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-981e7dfe-031a-40a7-8375-0b660db43e13 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:54.979157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-981e7dfe-031a-40a7-8375-0b660db43e13 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:54.979663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-981e7dfe-031a-40a7-8375-0b660db43e13 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:55.374041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-981e7dfe-031a-40a7-8375-0b660db43e13 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:55.390417 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-981e7dfe-031a-40a7-8375-0b660db43e13 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1314 microversion: 2.1 time: 0.434455 Sep 10 10:50:55.391032 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2498/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:54 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:55.400186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4787eea2-1b32-4537-b2f3-e194776ca8c8 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:55.417283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4787eea2-1b32-4537-b2f3-e194776ca8c8 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:55.430101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4787eea2-1b32-4537-b2f3-e194776ca8c8 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:55.430851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4787eea2-1b32-4537-b2f3-e194776ca8c8 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:55.431659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4787eea2-1b32-4537-b2f3-e194776ca8c8 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:55.432550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4787eea2-1b32-4537-b2f3-e194776ca8c8 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:55.433223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4787eea2-1b32-4537-b2f3-e194776ca8c8 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:55.433845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4787eea2-1b32-4537-b2f3-e194776ca8c8 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:55.626712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4787eea2-1b32-4537-b2f3-e194776ca8c8 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:50:55.703096 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4787eea2-1b32-4537-b2f3-e194776ca8c8 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.310109 Sep 10 10:50:55.704781 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2499/3005] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:55 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:55.725274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:55.726268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:55.739363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:55.740245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:55.740980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:55.742607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:55.743252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:55.743858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:55.888675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:55.902552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:55.906360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52c0efce1fa344059de5505b96930282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a43851400d0a427ab18328c92b349fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:55.907593 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7aef8668-f36f-4e22-8a99-95dac5ee7a1f tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/7bca7472-e63e-4b9a-a54f-9ab02f82cc1c" status: 200 len: 1363 microversion: 2.47 time: 0.199169 Sep 10 10:50:55.908166 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2500/3006] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:55 2022] GET /compute/v2.1/servers/7bca7472-e63e-4b9a-a54f-9ab02f82cc1c => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:55.932975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3cd5dd8-3143-4e70-8738-29a1409ad520 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:55.933525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f3cd5dd8-3143-4e70-8738-29a1409ad520 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:55.941946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3cd5dd8-3143-4e70-8738-29a1409ad520 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:55.942453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3cd5dd8-3143-4e70-8738-29a1409ad520 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:55.942905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3cd5dd8-3143-4e70-8738-29a1409ad520 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:55.943654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3cd5dd8-3143-4e70-8738-29a1409ad520 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:55.944081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3cd5dd8-3143-4e70-8738-29a1409ad520 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:55.944514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3cd5dd8-3143-4e70-8738-29a1409ad520 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:55.976010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f3cd5dd8-3143-4e70-8738-29a1409ad520 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:50:56.123661 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f3cd5dd8-3143-4e70-8738-29a1409ad520 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 204 len: 0 microversion: 2.1 time: 0.194890 Sep 10 10:50:56.130757 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2501/3007] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:50:55 2022] DELETE /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:50:56.151447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43068606-3e6a-40f2-85eb-7faca5e4e4d4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:56.152287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-43068606-3e6a-40f2-85eb-7faca5e4e4d4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:56.159489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43068606-3e6a-40f2-85eb-7faca5e4e4d4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:56.160265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43068606-3e6a-40f2-85eb-7faca5e4e4d4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:56.160863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43068606-3e6a-40f2-85eb-7faca5e4e4d4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:56.161747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43068606-3e6a-40f2-85eb-7faca5e4e4d4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:56.162337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43068606-3e6a-40f2-85eb-7faca5e4e4d4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:56.162872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43068606-3e6a-40f2-85eb-7faca5e4e4d4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:56.195712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:56.495289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-43068606-3e6a-40f2-85eb-7faca5e4e4d4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:56.504981 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43068606-3e6a-40f2-85eb-7faca5e4e4d4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.364865 Sep 10 10:50:56.505597 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2502/3008] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:56 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:56.526353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-431837c0-ed48-427f-bc0d-a86b14be1860 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:56.527222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-431837c0-ed48-427f-bc0d-a86b14be1860 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:56.534990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-431837c0-ed48-427f-bc0d-a86b14be1860 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:56.535748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-431837c0-ed48-427f-bc0d-a86b14be1860 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:56.536378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-431837c0-ed48-427f-bc0d-a86b14be1860 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:56.537298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-431837c0-ed48-427f-bc0d-a86b14be1860 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:56.537925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-431837c0-ed48-427f-bc0d-a86b14be1860 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:56.539088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-431837c0-ed48-427f-bc0d-a86b14be1860 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:56.644332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-431837c0-ed48-427f-bc0d-a86b14be1860 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:56.656407 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-431837c0-ed48-427f-bc0d-a86b14be1860 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1272 microversion: 2.1 time: 0.136588 Sep 10 10:50:56.660198 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2503/3009] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:56 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1272 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:56.684589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-298931975", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "64cb3b23-4abb-49b9-b60e-201809cae02d"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:50:56.788208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] validate_networks() for [('64cb3b23-4abb-49b9-b60e-201809cae02d', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:50:57.818594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:50:57.820807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:50:57.821544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:50:57.822252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:50:57.822897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:50:57.836843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:57.837899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:57.838625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:57.839938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:57.840617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:57.842075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:57.864691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Getting quotas for project 827645d7a2374eb4bc75b115b8ccd6dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:50:57.867433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:50:57.893292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Getting quotas for user e3e819f2b7d9489497e408871a233377 and project 827645d7a2374eb4bc75b115b8ccd6dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:50:57.929234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:50:57.946809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:50:58.062483 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-61605e23-8a7a-4f62-92aa-4c80561abbd1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400525 Sep 10 10:50:58.064310 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2504/3010] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:50:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:50:58.076026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ffcab794-f5af-4c2d-9524-7429ed3ef411 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:58.077361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ffcab794-f5af-4c2d-9524-7429ed3ef411 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:58.101458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffcab794-f5af-4c2d-9524-7429ed3ef411 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:58.103743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffcab794-f5af-4c2d-9524-7429ed3ef411 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:58.104875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffcab794-f5af-4c2d-9524-7429ed3ef411 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:58.107705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffcab794-f5af-4c2d-9524-7429ed3ef411 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:58.109438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffcab794-f5af-4c2d-9524-7429ed3ef411 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:58.110333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffcab794-f5af-4c2d-9524-7429ed3ef411 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:59.466593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffcab794-f5af-4c2d-9524-7429ed3ef411 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:50:59.494767 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ffcab794-f5af-4c2d-9524-7429ed3ef411 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1464 microversion: 2.1 time: 1.427424 Sep 10 10:50:59.503556 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2505/3011] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:50:58 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1464 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:50:59.529548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8465ffa-9066-4ddf-8868-6e0c76dec58d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:59.531528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8465ffa-9066-4ddf-8868-6e0c76dec58d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:59.540623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8465ffa-9066-4ddf-8868-6e0c76dec58d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:59.548199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8465ffa-9066-4ddf-8868-6e0c76dec58d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:59.549594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8465ffa-9066-4ddf-8868-6e0c76dec58d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:59.553656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8465ffa-9066-4ddf-8868-6e0c76dec58d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:59.554970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8465ffa-9066-4ddf-8868-6e0c76dec58d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:59.555675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8465ffa-9066-4ddf-8868-6e0c76dec58d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:59.855267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-c8465ffa-9066-4ddf-8868-6e0c76dec58d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:50:59.896763 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8465ffa-9066-4ddf-8868-6e0c76dec58d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.387742 Sep 10 10:50:59.913971 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2506/3012] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:59 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:50:59.930864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:50:59.931487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] [instance: 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:50:59.948838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:59.949373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:59.949812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:59.950527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:50:59.951032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:50:59.951388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:50:59.983624 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] HTTP exception thrown: Instance 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c could not be found. Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Request method failure captured: Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/7bca7472-e63e-4b9a-a54f-9ab02f82cc1c HTTP/1.1 Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGvF_LW_PbRv62wD87Mld73xAfOpGuNfQH06QfzHOf12-1gMTVULBc6TaLm7B83K-Nx6qUe1HiKtjqnRZevJsHYl71L6DEEd_QMpDm9kj-nL02TKPrKh9JLDZABwjXHjNSYOje8TGPhkTVGrd1djF83-k_UZn3j86r0WclnrPnSFpdc Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.47 Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: a43851400d0a427ab18328c92b349fbf Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerShowV247Test-271353662 Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43851400d0a427ab18328c92b349fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a43851400d0a427ab18328c92b349fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a43851400d0a427ab18328c92b349fbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a43851400d0a427ab18328c92b349fbf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerShowV247Test-271353662 Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: a43851400d0a427ab18328c92b349fbf Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerShowV247Test-271353662 Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerShowV247Test-271353662-project Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 52c0efce1fa344059de5505b96930282 Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerShowV247Test-271353662-project Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c could not be found. Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7bca7472-e63e-4b9a-a54f-9ab02f82cc1c'} Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c could not be found. Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c could not be found. Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:50:59.986011 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:59.992320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:50:59.992320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:50:59.992320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:50:59.992320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:50:59.992320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:50:59.992320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c could not be found. Sep 10 10:50:59.992320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:50:59.994306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] Returning 404 to user: Instance 7bca7472-e63e-4b9a-a54f-9ab02f82cc1c could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:50:59.996762 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7ce98716-e9b5-46b1-8252-7c7bf48399db tempest-ServerShowV247Test-271353662 tempest-ServerShowV247Test-271353662-project] 10.222.0.20 "GET /compute/v2.1/servers/7bca7472-e63e-4b9a-a54f-9ab02f82cc1c" status: 404 len: 111 microversion: 2.47 time: 0.081733 Sep 10 10:51:00.000455 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2507/3013] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:50:59 2022] GET /compute/v2.1/servers/7bca7472-e63e-4b9a-a54f-9ab02f82cc1c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:51:00.015740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-54e77b3d-598a-4757-b227-bc592b39e780 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:00.016785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54e77b3d-598a-4757-b227-bc592b39e780 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:00.027838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e77b3d-598a-4757-b227-bc592b39e780 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:00.029879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e77b3d-598a-4757-b227-bc592b39e780 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:00.033002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e77b3d-598a-4757-b227-bc592b39e780 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:00.034049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e77b3d-598a-4757-b227-bc592b39e780 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:00.035152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e77b3d-598a-4757-b227-bc592b39e780 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:00.037569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e77b3d-598a-4757-b227-bc592b39e780 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:00.767333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54e77b3d-598a-4757-b227-bc592b39e780 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:00.780453 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-54e77b3d-598a-4757-b227-bc592b39e780 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.778668 Sep 10 10:51:00.784089 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2508/3014] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:00 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:00.807740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f196f2f-38f9-42db-a813-a2508920cdd3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:00.811513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f196f2f-38f9-42db-a813-a2508920cdd3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:00.827668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f196f2f-38f9-42db-a813-a2508920cdd3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:00.832247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f196f2f-38f9-42db-a813-a2508920cdd3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:00.836276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f196f2f-38f9-42db-a813-a2508920cdd3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:00.837517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f196f2f-38f9-42db-a813-a2508920cdd3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:00.840187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f196f2f-38f9-42db-a813-a2508920cdd3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:00.841434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f196f2f-38f9-42db-a813-a2508920cdd3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:01.528390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f196f2f-38f9-42db-a813-a2508920cdd3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:01.539254 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f196f2f-38f9-42db-a813-a2508920cdd3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1314 microversion: 2.1 time: 0.752888 Sep 10 10:51:01.541686 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2509/3015] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:00 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:01.560043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c4bf284a-0ea6-404d-ba5d-1637d81c5617 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:01.560043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4bf284a-0ea6-404d-ba5d-1637d81c5617 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:01.574836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bf284a-0ea6-404d-ba5d-1637d81c5617 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:01.576380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bf284a-0ea6-404d-ba5d-1637d81c5617 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:01.576914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bf284a-0ea6-404d-ba5d-1637d81c5617 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:01.583262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bf284a-0ea6-404d-ba5d-1637d81c5617 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:01.583850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bf284a-0ea6-404d-ba5d-1637d81c5617 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:01.584373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4bf284a-0ea6-404d-ba5d-1637d81c5617 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:01.827149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c4bf284a-0ea6-404d-ba5d-1637d81c5617 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:01.835423 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c4bf284a-0ea6-404d-ba5d-1637d81c5617 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1275 microversion: 2.1 time: 0.288618 Sep 10 10:51:01.849563 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2510/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:01 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:01.855824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e155e8d1-a516-4527-a925-7990a21ba1fd tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "984f583c-8875-40de-873f-fe85cb6eb3ef", "device": "/dev/sdb"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:01.861576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e155e8d1-a516-4527-a925-7990a21ba1fd tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:01.883047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155e8d1-a516-4527-a925-7990a21ba1fd tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:01.883556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155e8d1-a516-4527-a925-7990a21ba1fd tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:01.884012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155e8d1-a516-4527-a925-7990a21ba1fd tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:01.884722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155e8d1-a516-4527-a925-7990a21ba1fd tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:01.885240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155e8d1-a516-4527-a925-7990a21ba1fd tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:01.885680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e155e8d1-a516-4527-a925-7990a21ba1fd tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:02.548156 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e155e8d1-a516-4527-a925-7990a21ba1fd tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "POST /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700535 Sep 10 10:51:02.560269 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2511/3017] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 10:51:01 2022] POST /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20/os-volume_attachments => generated 194 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:02.591580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4bb14901-ecb0-4add-b1bf-32bca14d42a0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:02.600951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4bb14901-ecb0-4add-b1bf-32bca14d42a0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:02.618643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb14901-ecb0-4add-b1bf-32bca14d42a0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:02.619153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb14901-ecb0-4add-b1bf-32bca14d42a0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:02.625441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb14901-ecb0-4add-b1bf-32bca14d42a0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:02.627536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb14901-ecb0-4add-b1bf-32bca14d42a0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:02.628036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb14901-ecb0-4add-b1bf-32bca14d42a0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:02.630675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bb14901-ecb0-4add-b1bf-32bca14d42a0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:03.219300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4bb14901-ecb0-4add-b1bf-32bca14d42a0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:03.266484 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4bb14901-ecb0-4add-b1bf-32bca14d42a0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.704242 Sep 10 10:51:03.268979 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2512/3018] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:02 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:03.289764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ef7b21e2-44f0-489a-b0df-95e97f167d25 req-6e6a5e65-2c4e-4e62-909e-23f2753b4eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cffeb4-50b7-434d-be36-a6b74c2e750f", "tag": "193980e0-7ce9-46fe-ab55-1a5fdaabb1fe"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:03.328230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ef7b21e2-44f0-489a-b0df-95e97f167d25 req-6e6a5e65-2c4e-4e62-909e-23f2753b4eaf service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:03.329177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ef7b21e2-44f0-489a-b0df-95e97f167d25 req-6e6a5e65-2c4e-4e62-909e-23f2753b4eaf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:03.330124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ef7b21e2-44f0-489a-b0df-95e97f167d25 req-6e6a5e65-2c4e-4e62-909e-23f2753b4eaf service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:03.375030 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ef7b21e2-44f0-489a-b0df-95e97f167d25 req-6e6a5e65-2c4e-4e62-909e-23f2753b4eaf service nova] Creating event network-changed:193980e0-7ce9-46fe-ab55-1a5fdaabb1fe for instance 07cffeb4-50b7-434d-be36-a6b74c2e750f on n-h2-856894-1 Sep 10 10:51:03.383541 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ef7b21e2-44f0-489a-b0df-95e97f167d25 req-6e6a5e65-2c4e-4e62-909e-23f2753b4eaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108732 Sep 10 10:51:03.386719 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2513/3019] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:03.392011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c41f597b-eb06-4e21-9697-98454b8a72b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:03.402433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c41f597b-eb06-4e21-9697-98454b8a72b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:03.415218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c41f597b-eb06-4e21-9697-98454b8a72b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:03.418036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c41f597b-eb06-4e21-9697-98454b8a72b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:03.418711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c41f597b-eb06-4e21-9697-98454b8a72b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:03.421374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c41f597b-eb06-4e21-9697-98454b8a72b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:03.421884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c41f597b-eb06-4e21-9697-98454b8a72b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:03.422650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c41f597b-eb06-4e21-9697-98454b8a72b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:03.760353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c41f597b-eb06-4e21-9697-98454b8a72b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:03.770419 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c41f597b-eb06-4e21-9697-98454b8a72b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1683 microversion: 2.1 time: 0.382380 Sep 10 10:51:03.785767 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2514/3020] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:03 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1683 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:03.793573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f7876a7-c06c-49b0-802a-3264216799ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:03.794386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f7876a7-c06c-49b0-802a-3264216799ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:03.801205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f7876a7-c06c-49b0-802a-3264216799ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:03.801877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f7876a7-c06c-49b0-802a-3264216799ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:03.802477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f7876a7-c06c-49b0-802a-3264216799ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:03.803540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f7876a7-c06c-49b0-802a-3264216799ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:03.804911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f7876a7-c06c-49b0-802a-3264216799ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:03.805752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f7876a7-c06c-49b0-802a-3264216799ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:03.988176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1f7876a7-c06c-49b0-802a-3264216799ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:04.010079 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f7876a7-c06c-49b0-802a-3264216799ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1314 microversion: 2.1 time: 0.222836 Sep 10 10:51:04.015279 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2515/3021] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:03 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:04.032533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3882583-29db-4c21-9e9f-44605f42427b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:04.033309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e3882583-29db-4c21-9e9f-44605f42427b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:04.040385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3882583-29db-4c21-9e9f-44605f42427b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:04.041143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3882583-29db-4c21-9e9f-44605f42427b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:04.042065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3882583-29db-4c21-9e9f-44605f42427b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:04.043619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3882583-29db-4c21-9e9f-44605f42427b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:04.044634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3882583-29db-4c21-9e9f-44605f42427b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:04.046566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3882583-29db-4c21-9e9f-44605f42427b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:04.310722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e3882583-29db-4c21-9e9f-44605f42427b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:04.321000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3882583-29db-4c21-9e9f-44605f42427b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1317 microversion: 2.1 time: 0.306276 Sep 10 10:51:04.321968 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2516/3022] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:04 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:04.350818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82a5d33d-2bd0-4d08-8fd4-7cba4011343b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:04.352817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82a5d33d-2bd0-4d08-8fd4-7cba4011343b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:04.369297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82a5d33d-2bd0-4d08-8fd4-7cba4011343b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:04.369798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82a5d33d-2bd0-4d08-8fd4-7cba4011343b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:04.370237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82a5d33d-2bd0-4d08-8fd4-7cba4011343b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:04.370938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82a5d33d-2bd0-4d08-8fd4-7cba4011343b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:04.371390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82a5d33d-2bd0-4d08-8fd4-7cba4011343b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:04.371811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82a5d33d-2bd0-4d08-8fd4-7cba4011343b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:04.513733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-82a5d33d-2bd0-4d08-8fd4-7cba4011343b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:04.538335 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82a5d33d-2bd0-4d08-8fd4-7cba4011343b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.214808 Sep 10 10:51:04.539479 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2517/3023] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:04 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:04.937115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-80d7f083-67c3-4d6a-8e43-2a3897d04e5f req-30be2459-54a6-49c6-b290-f91774352785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30352b5-a583-40b8-8e8b-9065682fc622", "tag": "71c8ab6d-8672-4c8a-ab73-29ff25b4bb84"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:04.960077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-80d7f083-67c3-4d6a-8e43-2a3897d04e5f req-30be2459-54a6-49c6-b290-f91774352785 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:04.964044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-80d7f083-67c3-4d6a-8e43-2a3897d04e5f req-30be2459-54a6-49c6-b290-f91774352785 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:04.964592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-80d7f083-67c3-4d6a-8e43-2a3897d04e5f req-30be2459-54a6-49c6-b290-f91774352785 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:04.998974 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-80d7f083-67c3-4d6a-8e43-2a3897d04e5f req-30be2459-54a6-49c6-b290-f91774352785 service nova] Creating event network-changed:71c8ab6d-8672-4c8a-ab73-29ff25b4bb84 for instance e30352b5-a583-40b8-8e8b-9065682fc622 on n-h2-856894-1 Sep 10 10:51:05.014248 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-80d7f083-67c3-4d6a-8e43-2a3897d04e5f req-30be2459-54a6-49c6-b290-f91774352785 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.472578 Sep 10 10:51:05.016327 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2518/3024] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:05.031642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cef00c78-4817-44c7-a9ed-64d82bc0b783 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:05.033548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cef00c78-4817-44c7-a9ed-64d82bc0b783 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:05.051363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef00c78-4817-44c7-a9ed-64d82bc0b783 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:05.056492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef00c78-4817-44c7-a9ed-64d82bc0b783 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:05.058790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef00c78-4817-44c7-a9ed-64d82bc0b783 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:05.059566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef00c78-4817-44c7-a9ed-64d82bc0b783 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:05.060053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef00c78-4817-44c7-a9ed-64d82bc0b783 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:05.060491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef00c78-4817-44c7-a9ed-64d82bc0b783 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:05.071980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:05.554658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cef00c78-4817-44c7-a9ed-64d82bc0b783 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:05.567187 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cef00c78-4817-44c7-a9ed-64d82bc0b783 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.549013 Sep 10 10:51:05.567782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2519/3025] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:05 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:05.611010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-da3ff5ad-e019-4f56-b272-5b6baada81df tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:05.615522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-da3ff5ad-e019-4f56-b272-5b6baada81df tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:05.630590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da3ff5ad-e019-4f56-b272-5b6baada81df tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:05.631080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da3ff5ad-e019-4f56-b272-5b6baada81df tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:05.631697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da3ff5ad-e019-4f56-b272-5b6baada81df tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:05.633407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da3ff5ad-e019-4f56-b272-5b6baada81df tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:05.634205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da3ff5ad-e019-4f56-b272-5b6baada81df tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:05.634816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da3ff5ad-e019-4f56-b272-5b6baada81df tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:06.031898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-da3ff5ad-e019-4f56-b272-5b6baada81df tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:06.042263 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-da3ff5ad-e019-4f56-b272-5b6baada81df tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1314 microversion: 2.1 time: 0.458244 Sep 10 10:51:06.044487 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2520/3026] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:05 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:06.057806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b0c66348-a9cc-4649-ad42-0c8434b01e12 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:06.061264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b0c66348-a9cc-4649-ad42-0c8434b01e12 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:06.082237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0c66348-a9cc-4649-ad42-0c8434b01e12 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:06.082992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0c66348-a9cc-4649-ad42-0c8434b01e12 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:06.083658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0c66348-a9cc-4649-ad42-0c8434b01e12 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:06.084762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0c66348-a9cc-4649-ad42-0c8434b01e12 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:06.086173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0c66348-a9cc-4649-ad42-0c8434b01e12 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:06.086834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0c66348-a9cc-4649-ad42-0c8434b01e12 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:06.464746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b0c66348-a9cc-4649-ad42-0c8434b01e12 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:06.479943 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b0c66348-a9cc-4649-ad42-0c8434b01e12 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1317 microversion: 2.1 time: 0.434330 Sep 10 10:51:06.493168 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2521/3027] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:06 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:06.498374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2b5b1edf-3607-436c-8e6d-200d2355921e req-bf0bd6d6-40b0-4b46-867f-5254edd8f62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbd1fad-d00f-4532-9b16-5dc493820bf7", "name": "network-vif-deleted", "tag": "9fbd9607-a1ea-4dde-bde4-ad4c12562465"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:06.515413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2b5b1edf-3607-436c-8e6d-200d2355921e req-bf0bd6d6-40b0-4b46-867f-5254edd8f62e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:06.515896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2b5b1edf-3607-436c-8e6d-200d2355921e req-bf0bd6d6-40b0-4b46-867f-5254edd8f62e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:06.516333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2b5b1edf-3607-436c-8e6d-200d2355921e req-bf0bd6d6-40b0-4b46-867f-5254edd8f62e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:06.529108 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2b5b1edf-3607-436c-8e6d-200d2355921e req-bf0bd6d6-40b0-4b46-867f-5254edd8f62e service nova] Creating event network-vif-deleted:9fbd9607-a1ea-4dde-bde4-ad4c12562465 for instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 on n-h2-856894-1 Sep 10 10:51:06.534838 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2b5b1edf-3607-436c-8e6d-200d2355921e req-bf0bd6d6-40b0-4b46-867f-5254edd8f62e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050118 Sep 10 10:51:06.536793 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2522/3028] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:06.545928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ffed724-8546-4fd8-960a-b8161cc9128d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:06.547086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ffed724-8546-4fd8-960a-b8161cc9128d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:06.555061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ffed724-8546-4fd8-960a-b8161cc9128d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:06.556411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ffed724-8546-4fd8-960a-b8161cc9128d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:06.557049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ffed724-8546-4fd8-960a-b8161cc9128d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:06.558087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ffed724-8546-4fd8-960a-b8161cc9128d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:06.558755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ffed724-8546-4fd8-960a-b8161cc9128d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:06.559436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ffed724-8546-4fd8-960a-b8161cc9128d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:06.660051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5ffed724-8546-4fd8-960a-b8161cc9128d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:06.686744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ffed724-8546-4fd8-960a-b8161cc9128d tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.146523 Sep 10 10:51:06.688014 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2523/3029] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:06 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:06.945285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2022144610", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": "none"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:07.009240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:51:07.009675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:51:07.010160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:51:07.010573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:51:07.010996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:51:07.020041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:07.020533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:07.020973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:07.021756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:07.022394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:07.023071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:07.042803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Getting quotas for project a10beb89155a4d2ba4ee3f52fb84abd5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:51:07.048300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Getting quotas for user 54b522b7dbd543eba814f05abeb5e864 and project a10beb89155a4d2ba4ee3f52fb84abd5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:51:07.063384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:51:07.065930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:51:07.124308 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a9ad39e-ef54-41f0-ae77-548caad8be28 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.434786 Sep 10 10:51:07.131380 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2524/3030] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 10:51:07.136235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd2383c7-be21-4382-a2c8-b5f9bdbc94e4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:07.137053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd2383c7-be21-4382-a2c8-b5f9bdbc94e4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:07.144471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2383c7-be21-4382-a2c8-b5f9bdbc94e4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:07.146479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2383c7-be21-4382-a2c8-b5f9bdbc94e4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:07.146479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2383c7-be21-4382-a2c8-b5f9bdbc94e4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:07.147327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2383c7-be21-4382-a2c8-b5f9bdbc94e4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:07.148046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2383c7-be21-4382-a2c8-b5f9bdbc94e4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:07.148684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2383c7-be21-4382-a2c8-b5f9bdbc94e4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:07.333483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd2383c7-be21-4382-a2c8-b5f9bdbc94e4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:07.346186 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd2383c7-be21-4382-a2c8-b5f9bdbc94e4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.219470 Sep 10 10:51:07.347153 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2525/3031] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:07 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:07.352349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3e805aba-3895-4ab4-809a-65a08b23ab8f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:07.352960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3e805aba-3895-4ab4-809a-65a08b23ab8f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:07.359951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e805aba-3895-4ab4-809a-65a08b23ab8f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:07.360445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e805aba-3895-4ab4-809a-65a08b23ab8f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:07.360880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e805aba-3895-4ab4-809a-65a08b23ab8f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:07.361656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e805aba-3895-4ab4-809a-65a08b23ab8f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:07.362119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e805aba-3895-4ab4-809a-65a08b23ab8f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:07.362570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e805aba-3895-4ab4-809a-65a08b23ab8f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:07.660148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e805aba-3895-4ab4-809a-65a08b23ab8f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:07.671354 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3e805aba-3895-4ab4-809a-65a08b23ab8f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1314 microversion: 2.1 time: 0.322963 Sep 10 10:51:07.671986 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2526/3032] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:07 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:07.686023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef774696-11e6-49dc-85a1-d25c3e9b320f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:07.690318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef774696-11e6-49dc-85a1-d25c3e9b320f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:07.839592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef774696-11e6-49dc-85a1-d25c3e9b320f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:07.852352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef774696-11e6-49dc-85a1-d25c3e9b320f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:07.854139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef774696-11e6-49dc-85a1-d25c3e9b320f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:07.855500 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef774696-11e6-49dc-85a1-d25c3e9b320f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1278 microversion: 2.54 time: 0.182610 Sep 10 10:51:07.858778 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2527/3033] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:07 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:07.868965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf0b3ed0-d96b-4011-939e-3f27339299e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:07.872286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bf0b3ed0-d96b-4011-939e-3f27339299e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:07.889129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf0b3ed0-d96b-4011-939e-3f27339299e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:07.889952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf0b3ed0-d96b-4011-939e-3f27339299e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:07.892192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf0b3ed0-d96b-4011-939e-3f27339299e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:07.893263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf0b3ed0-d96b-4011-939e-3f27339299e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:07.894857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf0b3ed0-d96b-4011-939e-3f27339299e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:07.895460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf0b3ed0-d96b-4011-939e-3f27339299e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:08.226855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bf0b3ed0-d96b-4011-939e-3f27339299e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:08.241902 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf0b3ed0-d96b-4011-939e-3f27339299e1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1317 microversion: 2.1 time: 0.381652 Sep 10 10:51:08.242862 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2528/3034] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:07 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:08.265408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1d16bde-6500-4d25-8da9-5fa705f2017b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:08.267361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1d16bde-6500-4d25-8da9-5fa705f2017b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:08.277234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d16bde-6500-4d25-8da9-5fa705f2017b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:08.278339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d16bde-6500-4d25-8da9-5fa705f2017b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:08.289674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d16bde-6500-4d25-8da9-5fa705f2017b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:08.292248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d16bde-6500-4d25-8da9-5fa705f2017b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:08.294157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d16bde-6500-4d25-8da9-5fa705f2017b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:08.295150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1d16bde-6500-4d25-8da9-5fa705f2017b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:08.628141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-b1d16bde-6500-4d25-8da9-5fa705f2017b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:08.704147 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1d16bde-6500-4d25-8da9-5fa705f2017b tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.460114 Sep 10 10:51:08.722424 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2529/3035] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:08 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:08.733683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-809dd946-dbe0-499f-b9aa-f652e909b774 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:08.734517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-809dd946-dbe0-499f-b9aa-f652e909b774 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:08.744515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809dd946-dbe0-499f-b9aa-f652e909b774 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:08.745602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809dd946-dbe0-499f-b9aa-f652e909b774 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:08.746229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809dd946-dbe0-499f-b9aa-f652e909b774 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:08.747304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809dd946-dbe0-499f-b9aa-f652e909b774 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:08.748069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809dd946-dbe0-499f-b9aa-f652e909b774 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:08.748496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809dd946-dbe0-499f-b9aa-f652e909b774 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:09.021818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-809dd946-dbe0-499f-b9aa-f652e909b774 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:09.032588 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-809dd946-dbe0-499f-b9aa-f652e909b774 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1314 microversion: 2.1 time: 0.308996 Sep 10 10:51:09.034208 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2530/3036] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:08 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:09.040256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:09.041211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:09.048643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:09.049414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:09.050222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:09.051136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:09.051801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:09.052418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:09.152313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:09.162881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:09.165046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:09.181564 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-771c3089-8e8b-4267-a672-22d083f29677 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1330 microversion: 2.54 time: 0.145918 Sep 10 10:51:09.184014 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2531/3037] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:09 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1330 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:09.265828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b6a4b2a-53fe-4760-b334-b9862f35ee76 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:09.266943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b6a4b2a-53fe-4760-b334-b9862f35ee76 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:09.280928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b6a4b2a-53fe-4760-b334-b9862f35ee76 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:09.283667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b6a4b2a-53fe-4760-b334-b9862f35ee76 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:09.286664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b6a4b2a-53fe-4760-b334-b9862f35ee76 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:09.289094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b6a4b2a-53fe-4760-b334-b9862f35ee76 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:09.290110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b6a4b2a-53fe-4760-b334-b9862f35ee76 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:09.293751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b6a4b2a-53fe-4760-b334-b9862f35ee76 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:09.658734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b6a4b2a-53fe-4760-b334-b9862f35ee76 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:09.669336 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b6a4b2a-53fe-4760-b334-b9862f35ee76 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1317 microversion: 2.1 time: 0.408355 Sep 10 10:51:09.670215 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2532/3038] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:09 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:09.740104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb2dd1f5-346b-4a0c-bf70-77b852841289 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:09.740790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cb2dd1f5-346b-4a0c-bf70-77b852841289 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:09.751893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2dd1f5-346b-4a0c-bf70-77b852841289 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:09.757599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2dd1f5-346b-4a0c-bf70-77b852841289 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:09.758826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2dd1f5-346b-4a0c-bf70-77b852841289 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:09.760087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2dd1f5-346b-4a0c-bf70-77b852841289 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:09.763193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2dd1f5-346b-4a0c-bf70-77b852841289 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:09.765514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb2dd1f5-346b-4a0c-bf70-77b852841289 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:09.920903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-cb2dd1f5-346b-4a0c-bf70-77b852841289 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:09.977882 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb2dd1f5-346b-4a0c-bf70-77b852841289 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.242294 Sep 10 10:51:09.978494 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2533/3039] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:09 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:51:09.989311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1d291e88-8619-49c0-98bf-7c57757c13b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:09.989311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1d291e88-8619-49c0-98bf-7c57757c13b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:09.990332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d291e88-8619-49c0-98bf-7c57757c13b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:09.991041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d291e88-8619-49c0-98bf-7c57757c13b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:09.991840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d291e88-8619-49c0-98bf-7c57757c13b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:09.992959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d291e88-8619-49c0-98bf-7c57757c13b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:09.993697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d291e88-8619-49c0-98bf-7c57757c13b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:09.994293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d291e88-8619-49c0-98bf-7c57757c13b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:10.187094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1d291e88-8619-49c0-98bf-7c57757c13b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:10.199690 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1d291e88-8619-49c0-98bf-7c57757c13b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.220038 Sep 10 10:51:10.215068 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2534/3040] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:09 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:10.237984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3ccff8a3-3a7c-490c-89bf-2e59fd0d67e7 req-d9a30b05-06ec-467f-ab28-7ecf69060e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cffeb4-50b7-434d-be36-a6b74c2e750f", "name": "network-vif-plugged", "status": "completed", "tag": "193980e0-7ce9-46fe-ab55-1a5fdaabb1fe"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:10.252085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3ccff8a3-3a7c-490c-89bf-2e59fd0d67e7 req-d9a30b05-06ec-467f-ab28-7ecf69060e7d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:10.252505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3ccff8a3-3a7c-490c-89bf-2e59fd0d67e7 req-d9a30b05-06ec-467f-ab28-7ecf69060e7d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:10.252923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3ccff8a3-3a7c-490c-89bf-2e59fd0d67e7 req-d9a30b05-06ec-467f-ab28-7ecf69060e7d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:10.265775 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3ccff8a3-3a7c-490c-89bf-2e59fd0d67e7 req-d9a30b05-06ec-467f-ab28-7ecf69060e7d service nova] Creating event network-vif-plugged:193980e0-7ce9-46fe-ab55-1a5fdaabb1fe for instance 07cffeb4-50b7-434d-be36-a6b74c2e750f on n-h2-856894-1 Sep 10 10:51:10.271645 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3ccff8a3-3a7c-490c-89bf-2e59fd0d67e7 req-d9a30b05-06ec-467f-ab28-7ecf69060e7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055352 Sep 10 10:51:10.273124 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2535/3041] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:10.280006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-98d9543c-6bef-4e7d-afdf-4a4c2f8563b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:10.281192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-98d9543c-6bef-4e7d-afdf-4a4c2f8563b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:10.284691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:10.290001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d9543c-6bef-4e7d-afdf-4a4c2f8563b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:10.290580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d9543c-6bef-4e7d-afdf-4a4c2f8563b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:10.291092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d9543c-6bef-4e7d-afdf-4a4c2f8563b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:10.291870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d9543c-6bef-4e7d-afdf-4a4c2f8563b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:10.292398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d9543c-6bef-4e7d-afdf-4a4c2f8563b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:10.292899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d9543c-6bef-4e7d-afdf-4a4c2f8563b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:10.444502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-98d9543c-6bef-4e7d-afdf-4a4c2f8563b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:10.464493 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-98d9543c-6bef-4e7d-afdf-4a4c2f8563b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1314 microversion: 2.1 time: 0.189659 Sep 10 10:51:10.481105 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2536/3042] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:10 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:10.492416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:10.493518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:10.503429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:10.503937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:10.504371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:10.505096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:10.507148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:10.507613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:10.632194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:10.640398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:10.657467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:10.659638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:10.660923 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d255c2ff-0aca-44ab-9209-063aea374390 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1336 microversion: 2.54 time: 0.194094 Sep 10 10:51:10.661744 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2537/3043] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:10 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1336 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:10.674062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d41fcc4-49a8-4296-96d6-ad082ddf92e8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:10.674679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d41fcc4-49a8-4296-96d6-ad082ddf92e8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:10.695034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d41fcc4-49a8-4296-96d6-ad082ddf92e8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:10.695796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d41fcc4-49a8-4296-96d6-ad082ddf92e8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:10.695951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d41fcc4-49a8-4296-96d6-ad082ddf92e8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:10.696655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d41fcc4-49a8-4296-96d6-ad082ddf92e8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:10.697125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d41fcc4-49a8-4296-96d6-ad082ddf92e8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:10.697558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d41fcc4-49a8-4296-96d6-ad082ddf92e8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:10.948611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d41fcc4-49a8-4296-96d6-ad082ddf92e8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:10.957457 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d41fcc4-49a8-4296-96d6-ad082ddf92e8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.294623 Sep 10 10:51:10.958027 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2538/3044] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:10 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:10.970638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4620843-2b1e-4bbc-8b90-8342265029b4 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:10.971497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4620843-2b1e-4bbc-8b90-8342265029b4 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:10.979132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4620843-2b1e-4bbc-8b90-8342265029b4 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:10.979738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4620843-2b1e-4bbc-8b90-8342265029b4 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:10.980398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4620843-2b1e-4bbc-8b90-8342265029b4 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:10.981136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4620843-2b1e-4bbc-8b90-8342265029b4 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:10.981597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4620843-2b1e-4bbc-8b90-8342265029b4 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:10.982017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4620843-2b1e-4bbc-8b90-8342265029b4 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:11.132535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4620843-2b1e-4bbc-8b90-8342265029b4 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:11.141675 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a4620843-2b1e-4bbc-8b90-8342265029b4 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1317 microversion: 2.1 time: 0.181044 Sep 10 10:51:11.142284 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2539/3045] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:10 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:11.148757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc6e34bb-d15a-42d9-941f-1a43a5fd86f0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:11.159082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fc6e34bb-d15a-42d9-941f-1a43a5fd86f0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:11.165395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc6e34bb-d15a-42d9-941f-1a43a5fd86f0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:11.165896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc6e34bb-d15a-42d9-941f-1a43a5fd86f0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:11.166331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc6e34bb-d15a-42d9-941f-1a43a5fd86f0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:11.167114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc6e34bb-d15a-42d9-941f-1a43a5fd86f0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:11.167763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc6e34bb-d15a-42d9-941f-1a43a5fd86f0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:11.168237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc6e34bb-d15a-42d9-941f-1a43a5fd86f0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:11.329736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fc6e34bb-d15a-42d9-941f-1a43a5fd86f0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:11.340151 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc6e34bb-d15a-42d9-941f-1a43a5fd86f0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.196839 Sep 10 10:51:11.341087 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2540/3046] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:11 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:11.357255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be7642b1-de7e-4b04-bbe7-b2298e9d6923 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:11.357709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be7642b1-de7e-4b04-bbe7-b2298e9d6923 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:11.368745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be7642b1-de7e-4b04-bbe7-b2298e9d6923 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:11.369277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be7642b1-de7e-4b04-bbe7-b2298e9d6923 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:11.369781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be7642b1-de7e-4b04-bbe7-b2298e9d6923 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:11.370411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be7642b1-de7e-4b04-bbe7-b2298e9d6923 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:11.370970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be7642b1-de7e-4b04-bbe7-b2298e9d6923 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:11.371273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be7642b1-de7e-4b04-bbe7-b2298e9d6923 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:11.469612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-be7642b1-de7e-4b04-bbe7-b2298e9d6923 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:11.516576 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be7642b1-de7e-4b04-bbe7-b2298e9d6923 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.174207 Sep 10 10:51:11.529115 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2541/3047] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:11 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:11.529115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2f022bd-645d-4964-ac14-18285da98a37 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:11.529115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2f022bd-645d-4964-ac14-18285da98a37 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:11.536894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f022bd-645d-4964-ac14-18285da98a37 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:11.537848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f022bd-645d-4964-ac14-18285da98a37 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:11.538831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f022bd-645d-4964-ac14-18285da98a37 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:11.539532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f022bd-645d-4964-ac14-18285da98a37 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:11.540059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f022bd-645d-4964-ac14-18285da98a37 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:11.540483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f022bd-645d-4964-ac14-18285da98a37 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:11.644240 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2f022bd-645d-4964-ac14-18285da98a37 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.125558 Sep 10 10:51:11.645444 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2542/3048] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:51:11 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:11.651684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c2e0c53-ad1b-4d30-ae39-594681486109 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:11.652715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4c2e0c53-ad1b-4d30-ae39-594681486109 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:11.662955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2e0c53-ad1b-4d30-ae39-594681486109 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:11.664973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2e0c53-ad1b-4d30-ae39-594681486109 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:11.665465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2e0c53-ad1b-4d30-ae39-594681486109 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:11.666173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2e0c53-ad1b-4d30-ae39-594681486109 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:11.666628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2e0c53-ad1b-4d30-ae39-594681486109 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:11.667049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c2e0c53-ad1b-4d30-ae39-594681486109 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:11.851583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4c2e0c53-ad1b-4d30-ae39-594681486109 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:11.859982 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c2e0c53-ad1b-4d30-ae39-594681486109 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1314 microversion: 2.1 time: 0.213032 Sep 10 10:51:11.860560 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2543/3049] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:11 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:11.870924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-643837ca-c29a-442d-9b4f-2b564b87d096 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:11.871661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-643837ca-c29a-442d-9b4f-2b564b87d096 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:11.878646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643837ca-c29a-442d-9b4f-2b564b87d096 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:11.880045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643837ca-c29a-442d-9b4f-2b564b87d096 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:11.880575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643837ca-c29a-442d-9b4f-2b564b87d096 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:11.881439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643837ca-c29a-442d-9b4f-2b564b87d096 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:11.882710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643837ca-c29a-442d-9b4f-2b564b87d096 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:11.883151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643837ca-c29a-442d-9b4f-2b564b87d096 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:12.030313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-643837ca-c29a-442d-9b4f-2b564b87d096 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:12.038722 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-643837ca-c29a-442d-9b4f-2b564b87d096 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1672 microversion: 2.1 time: 0.176883 Sep 10 10:51:12.054212 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2544/3050] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:11 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1672 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:12.061091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:12.061902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:12.068665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:12.070270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:12.071189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:12.072582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:12.073519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:12.074306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:12.150650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:12.161435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:12.165290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:12.165290 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf2e35a1-1236-4b7d-9009-4c5cd85572d6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1336 microversion: 2.54 time: 0.108803 Sep 10 10:51:12.165290 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2545/3051] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:12 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1336 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:12.172673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a514858c-6ea4-48e8-985a-1f1a7df2a937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:12.173266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a514858c-6ea4-48e8-985a-1f1a7df2a937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:12.180974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a514858c-6ea4-48e8-985a-1f1a7df2a937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:12.181494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a514858c-6ea4-48e8-985a-1f1a7df2a937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:12.181957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a514858c-6ea4-48e8-985a-1f1a7df2a937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:12.183266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a514858c-6ea4-48e8-985a-1f1a7df2a937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:12.184725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a514858c-6ea4-48e8-985a-1f1a7df2a937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:12.185202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a514858c-6ea4-48e8-985a-1f1a7df2a937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:12.349622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a514858c-6ea4-48e8-985a-1f1a7df2a937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:12.365328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a514858c-6ea4-48e8-985a-1f1a7df2a937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1317 microversion: 2.1 time: 0.196347 Sep 10 10:51:12.365328 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2546/3052] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:12 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:12.370384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1ba32e61-5bde-4bd9-913d-c6600a243e5b req-6977414d-284a-4e28-9bf9-a611b3a6991b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5", "name": "network-vif-unplugged", "status": "completed", "tag": "a9a5c077-18b4-45a9-ab46-131e14788b74"}, {"server_uuid": "e30352b5-a583-40b8-8e8b-9065682fc622", "name": "network-vif-plugged", "status": "completed", "tag": "71c8ab6d-8672-4c8a-ab73-29ff25b4bb84"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:12.381470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1ba32e61-5bde-4bd9-913d-c6600a243e5b req-6977414d-284a-4e28-9bf9-a611b3a6991b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:12.382547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1ba32e61-5bde-4bd9-913d-c6600a243e5b req-6977414d-284a-4e28-9bf9-a611b3a6991b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:12.383000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1ba32e61-5bde-4bd9-913d-c6600a243e5b req-6977414d-284a-4e28-9bf9-a611b3a6991b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:12.401188 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1ba32e61-5bde-4bd9-913d-c6600a243e5b req-6977414d-284a-4e28-9bf9-a611b3a6991b service nova] Creating event network-vif-unplugged:a9a5c077-18b4-45a9-ab46-131e14788b74 for instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 on n-h2-856894-1 Sep 10 10:51:12.401704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1ba32e61-5bde-4bd9-913d-c6600a243e5b req-6977414d-284a-4e28-9bf9-a611b3a6991b service nova] Creating event network-vif-plugged:71c8ab6d-8672-4c8a-ab73-29ff25b4bb84 for instance e30352b5-a583-40b8-8e8b-9065682fc622 on n-h2-856894-1 Sep 10 10:51:12.411144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1ba32e61-5bde-4bd9-913d-c6600a243e5b req-6977414d-284a-4e28-9bf9-a611b3a6991b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045818 Sep 10 10:51:12.418464 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2547/3053] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:12.558038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c5d848a-f7d9-47ce-99b4-6ea1eabb1758 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:12.562059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4c5d848a-f7d9-47ce-99b4-6ea1eabb1758 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:12.576410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c5d848a-f7d9-47ce-99b4-6ea1eabb1758 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:12.577240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c5d848a-f7d9-47ce-99b4-6ea1eabb1758 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:12.577692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c5d848a-f7d9-47ce-99b4-6ea1eabb1758 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:12.578409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c5d848a-f7d9-47ce-99b4-6ea1eabb1758 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:12.578869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c5d848a-f7d9-47ce-99b4-6ea1eabb1758 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:12.579305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c5d848a-f7d9-47ce-99b4-6ea1eabb1758 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:12.718208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4c5d848a-f7d9-47ce-99b4-6ea1eabb1758 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:12.736953 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c5d848a-f7d9-47ce-99b4-6ea1eabb1758 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.190583 Sep 10 10:51:12.741550 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2548/3054] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:12 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:12.884377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38764545-f76a-4855-baa4-6178bca82d4c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:12.885399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38764545-f76a-4855-baa4-6178bca82d4c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:12.895875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38764545-f76a-4855-baa4-6178bca82d4c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:12.896770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38764545-f76a-4855-baa4-6178bca82d4c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:12.897267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38764545-f76a-4855-baa4-6178bca82d4c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:12.901864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38764545-f76a-4855-baa4-6178bca82d4c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:12.902368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38764545-f76a-4855-baa4-6178bca82d4c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:12.905847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38764545-f76a-4855-baa4-6178bca82d4c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:13.093709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38764545-f76a-4855-baa4-6178bca82d4c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:13.102802 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38764545-f76a-4855-baa4-6178bca82d4c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1503 microversion: 2.1 time: 0.222558 Sep 10 10:51:13.103058 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2549/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:12 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:13.116672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed64ae0a-037b-48e8-b069-c28a610ffba3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:13.116672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed64ae0a-037b-48e8-b069-c28a610ffba3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:13.116672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed64ae0a-037b-48e8-b069-c28a610ffba3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:13.116672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed64ae0a-037b-48e8-b069-c28a610ffba3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:13.116672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed64ae0a-037b-48e8-b069-c28a610ffba3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:13.116672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed64ae0a-037b-48e8-b069-c28a610ffba3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:13.116672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed64ae0a-037b-48e8-b069-c28a610ffba3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:13.117425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed64ae0a-037b-48e8-b069-c28a610ffba3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:13.291606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed64ae0a-037b-48e8-b069-c28a610ffba3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:13.301605 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed64ae0a-037b-48e8-b069-c28a610ffba3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1672 microversion: 2.1 time: 0.197511 Sep 10 10:51:13.309119 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2550/3056] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:13 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1672 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:13.322637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-425b643e-a9f4-4e8a-bd9d-08c09072a256 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-628362644"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:13.323194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-425b643e-a9f4-4e8a-bd9d-08c09072a256 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:13.330514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-425b643e-a9f4-4e8a-bd9d-08c09072a256 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:13.330939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-425b643e-a9f4-4e8a-bd9d-08c09072a256 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:13.331375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-425b643e-a9f4-4e8a-bd9d-08c09072a256 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:13.332069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-425b643e-a9f4-4e8a-bd9d-08c09072a256 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:13.332520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-425b643e-a9f4-4e8a-bd9d-08c09072a256 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:13.332941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-425b643e-a9f4-4e8a-bd9d-08c09072a256 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:13.490395 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.network.security_group_api [None req-425b643e-a9f4-4e8a-bd9d-08c09072a256 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Adding security group ddc63294-8228-484a-bc08-3791c99a6026 to port 193980e0-7ce9-46fe-ab55-1a5fdaabb1fe Sep 10 10:51:13.948883 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-425b643e-a9f4-4e8a-bd9d-08c09072a256 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f/action" status: 202 len: 0 microversion: 2.1 time: 0.642226 Sep 10 10:51:13.950049 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2551/3057] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:51:13 2022] POST /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:13.960997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:13.961658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:13.977090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:13.978472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:13.978938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:13.995896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:13.998416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:14.002533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:14.150217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:14.163174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:14.164649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:14.165945 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b06a9591-d46e-43ee-abf0-1b9a4ebb13fd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1357 microversion: 2.54 time: 0.214685 Sep 10 10:51:14.166516 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2552/3058] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:13 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:14.173389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc2cc835-475d-403a-bdcc-f3a1d9556dc3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:14.174242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc2cc835-475d-403a-bdcc-f3a1d9556dc3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:14.183698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cc835-475d-403a-bdcc-f3a1d9556dc3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:14.185303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cc835-475d-403a-bdcc-f3a1d9556dc3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:14.198334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cc835-475d-403a-bdcc-f3a1d9556dc3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:14.199170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cc835-475d-403a-bdcc-f3a1d9556dc3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:14.199656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cc835-475d-403a-bdcc-f3a1d9556dc3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:14.200102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc2cc835-475d-403a-bdcc-f3a1d9556dc3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:14.437704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc2cc835-475d-403a-bdcc-f3a1d9556dc3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:14.441725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:14.451490 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc2cc835-475d-403a-bdcc-f3a1d9556dc3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1317 microversion: 2.1 time: 0.283690 Sep 10 10:51:14.453454 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2553/3059] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:14 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:14.464693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8d1a9317-4d31-4472-9d6d-01b0a7668144 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:14.467163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8d1a9317-4d31-4472-9d6d-01b0a7668144 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:14.481511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d1a9317-4d31-4472-9d6d-01b0a7668144 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:14.482009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d1a9317-4d31-4472-9d6d-01b0a7668144 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:14.482465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d1a9317-4d31-4472-9d6d-01b0a7668144 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:14.483196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d1a9317-4d31-4472-9d6d-01b0a7668144 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:14.483659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d1a9317-4d31-4472-9d6d-01b0a7668144 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:14.484088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d1a9317-4d31-4472-9d6d-01b0a7668144 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:14.577483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-8d1a9317-4d31-4472-9d6d-01b0a7668144 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:14.595925 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8d1a9317-4d31-4472-9d6d-01b0a7668144 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.141214 Sep 10 10:51:14.616642 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2554/3060] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:14 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:14.616642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57d9c390-63a8-4642-9d6d-fae2ba6c15be tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1506094518"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:14.616642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57d9c390-63a8-4642-9d6d-fae2ba6c15be tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:14.616642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57d9c390-63a8-4642-9d6d-fae2ba6c15be tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:14.616642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57d9c390-63a8-4642-9d6d-fae2ba6c15be tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:14.616642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57d9c390-63a8-4642-9d6d-fae2ba6c15be tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:14.616642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57d9c390-63a8-4642-9d6d-fae2ba6c15be tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:14.616642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57d9c390-63a8-4642-9d6d-fae2ba6c15be tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:14.616642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57d9c390-63a8-4642-9d6d-fae2ba6c15be tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:14.829629 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.network.security_group_api [None req-57d9c390-63a8-4642-9d6d-fae2ba6c15be tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Adding security group 1cb4bc51-8675-441a-a2c4-3cfa0114250e to port 193980e0-7ce9-46fe-ab55-1a5fdaabb1fe Sep 10 10:51:15.230759 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57d9c390-63a8-4642-9d6d-fae2ba6c15be tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f/action" status: 202 len: 0 microversion: 2.1 time: 0.632648 Sep 10 10:51:15.231768 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2555/3061] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:51:14 2022] POST /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:15.238259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4a3e13cf-68a9-41fd-b8b9-7f619d59bd24 req-13c96942-d49b-4c06-b286-a5634a49524f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cffeb4-50b7-434d-be36-a6b74c2e750f", "tag": "193980e0-7ce9-46fe-ab55-1a5fdaabb1fe"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:15.265042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4a3e13cf-68a9-41fd-b8b9-7f619d59bd24 req-13c96942-d49b-4c06-b286-a5634a49524f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:15.269897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4a3e13cf-68a9-41fd-b8b9-7f619d59bd24 req-13c96942-d49b-4c06-b286-a5634a49524f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:15.271080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4a3e13cf-68a9-41fd-b8b9-7f619d59bd24 req-13c96942-d49b-4c06-b286-a5634a49524f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:15.314148 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4a3e13cf-68a9-41fd-b8b9-7f619d59bd24 req-13c96942-d49b-4c06-b286-a5634a49524f service nova] Creating event network-changed:193980e0-7ce9-46fe-ab55-1a5fdaabb1fe for instance 07cffeb4-50b7-434d-be36-a6b74c2e750f on n-h2-856894-1 Sep 10 10:51:15.328393 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4a3e13cf-68a9-41fd-b8b9-7f619d59bd24 req-13c96942-d49b-4c06-b286-a5634a49524f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094826 Sep 10 10:51:15.329713 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2556/3062] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:15.353368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38e78c1b-bb8d-4c60-b6d1-e5624d68ccfe tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Action: 'create', calling method: .version_select at 0x7efcae6dba60>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-360434032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo85fq+3T25YC20AymaSC+khOYayCnWirnX4sL7SOK6toUmobkcCql/UHf3lQ4BPDRgtINE92yUs4SLEI7pDMzGDJhVzr/MjYg4w4MnVUizy2VhlrBYHo6OdaykXhskRg=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:15.376885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-38e78c1b-bb8d-4c60-b6d1-e5624d68ccfe tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Getting quotas for project a10beb89155a4d2ba4ee3f52fb84abd5. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:51:15.386603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-38e78c1b-bb8d-4c60-b6d1-e5624d68ccfe tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Getting quotas for user 54b522b7dbd543eba814f05abeb5e864 and project a10beb89155a4d2ba4ee3f52fb84abd5. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:51:15.422311 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38e78c1b-bb8d-4c60-b6d1-e5624d68ccfe tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.076060 Sep 10 10:51:15.423196 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2557/3063] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Sep 10 10:51:15 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 10:51:15.436588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-29fef574-37a7-4e0e-902d-558a501fa5a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:15.437690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-29fef574-37a7-4e0e-902d-558a501fa5a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:15.453037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29fef574-37a7-4e0e-902d-558a501fa5a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:15.455745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29fef574-37a7-4e0e-902d-558a501fa5a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:15.457891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29fef574-37a7-4e0e-902d-558a501fa5a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:15.458765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29fef574-37a7-4e0e-902d-558a501fa5a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:15.459355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29fef574-37a7-4e0e-902d-558a501fa5a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:15.461554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29fef574-37a7-4e0e-902d-558a501fa5a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:15.724677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-29fef574-37a7-4e0e-902d-558a501fa5a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:15.745565 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-29fef574-37a7-4e0e-902d-558a501fa5a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.320257 Sep 10 10:51:15.762447 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2558/3064] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:15 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:15.790525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-647852e0-af59-4c3a-b28a-97921aa4408c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:15.791251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-647852e0-af59-4c3a-b28a-97921aa4408c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:15.807976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-647852e0-af59-4c3a-b28a-97921aa4408c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:15.808487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-647852e0-af59-4c3a-b28a-97921aa4408c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:15.808935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-647852e0-af59-4c3a-b28a-97921aa4408c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:15.809679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-647852e0-af59-4c3a-b28a-97921aa4408c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:15.810140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-647852e0-af59-4c3a-b28a-97921aa4408c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:15.810567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-647852e0-af59-4c3a-b28a-97921aa4408c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.057912 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-647852e0-af59-4c3a-b28a-97921aa4408c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.293515 Sep 10 10:51:16.060027 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2559/3065] 10.222.0.20 () {58 vars in 1293 bytes} [Sat Sep 10 10:51:15 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f/os-security-groups => generated 1157 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:16.081630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-360434032", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:16.086552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:16.109558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:16.111056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:16.111784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.112767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:16.113552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:16.114144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.248404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:51:16.249530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:51:16.250206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:51:16.250797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:51:16.251450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:51:16.337462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:16.345427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:16.346188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:16.346849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.347773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:16.348397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:16.348999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.390607 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c12cf168-43c8-4e78-aa60-a3641cb402f6 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "POST /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01/action" status: 202 len: 1139 microversion: 2.54 time: 0.329330 Sep 10 10:51:16.397318 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2560/3066] 10.222.0.20 () {62 vars in 1320 bytes} [Sat Sep 10 10:51:16 2022] POST /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01/action => generated 1139 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 10:51:16.401655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fab6606d-2280-42d6-a87b-d32b2a64e8a9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:16.402634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fab6606d-2280-42d6-a87b-d32b2a64e8a9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:16.410057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fab6606d-2280-42d6-a87b-d32b2a64e8a9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:16.410783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fab6606d-2280-42d6-a87b-d32b2a64e8a9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:16.411409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fab6606d-2280-42d6-a87b-d32b2a64e8a9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.412113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fab6606d-2280-42d6-a87b-d32b2a64e8a9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:16.412566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fab6606d-2280-42d6-a87b-d32b2a64e8a9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:16.413640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fab6606d-2280-42d6-a87b-d32b2a64e8a9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.565951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fab6606d-2280-42d6-a87b-d32b2a64e8a9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:16.575161 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fab6606d-2280-42d6-a87b-d32b2a64e8a9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1507 microversion: 2.1 time: 0.182825 Sep 10 10:51:16.575775 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2561/3067] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:16 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:16.580985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95edf7da-c9f7-4b69-9541-a6d0803cda48 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:16.581767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95edf7da-c9f7-4b69-9541-a6d0803cda48 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:16.588581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95edf7da-c9f7-4b69-9541-a6d0803cda48 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:16.589105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95edf7da-c9f7-4b69-9541-a6d0803cda48 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:16.589550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95edf7da-c9f7-4b69-9541-a6d0803cda48 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.590258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95edf7da-c9f7-4b69-9541-a6d0803cda48 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:16.590716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95edf7da-c9f7-4b69-9541-a6d0803cda48 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:16.591207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95edf7da-c9f7-4b69-9541-a6d0803cda48 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.687979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-95edf7da-c9f7-4b69-9541-a6d0803cda48 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:16.709338 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95edf7da-c9f7-4b69-9541-a6d0803cda48 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.131624 Sep 10 10:51:16.711570 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2562/3068] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:16 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:16.716872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8c19cc0-c4ee-4200-bc56-8ea339aadc87 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:16.719365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8c19cc0-c4ee-4200-bc56-8ea339aadc87 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:16.726639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8c19cc0-c4ee-4200-bc56-8ea339aadc87 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:16.727206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8c19cc0-c4ee-4200-bc56-8ea339aadc87 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:16.727721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8c19cc0-c4ee-4200-bc56-8ea339aadc87 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.728513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8c19cc0-c4ee-4200-bc56-8ea339aadc87 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:16.729530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8c19cc0-c4ee-4200-bc56-8ea339aadc87 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:16.730048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8c19cc0-c4ee-4200-bc56-8ea339aadc87 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:16.837873 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8c19cc0-c4ee-4200-bc56-8ea339aadc87 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 200 len: 321 microversion: 2.1 time: 0.125123 Sep 10 10:51:16.838586 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2563/3069] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:51:16 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 321 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:16.844801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f68576b-ce5f-4135-b506-139a8e382294 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: .version_select at 0x7efcae9f7550>, body: {"security_group": {"name": " tempest-securitygroup -603419944 ", "description": "tempest-description-462541336"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:17.033573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:17.125266 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f68576b-ce5f-4135-b506-139a8e382294 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.284942 Sep 10 10:51:17.125976 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2564/3070] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:51:16 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:17.134564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:17.137628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:17.148273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:17.148989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:17.149663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:17.161295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:17.161844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:17.162350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:17.280416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:17.292172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:17.294122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:17.295478 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ecfa98d0-b9b8-406e-aac0-ab2dab3bafb8 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.168729 Sep 10 10:51:17.296613 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2565/3071] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:17 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:17.302849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14823534-7dbf-440b-9707-5fd3ecff615b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:17.304222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14823534-7dbf-440b-9707-5fd3ecff615b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:17.320884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14823534-7dbf-440b-9707-5fd3ecff615b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:17.321415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14823534-7dbf-440b-9707-5fd3ecff615b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:17.321848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14823534-7dbf-440b-9707-5fd3ecff615b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:17.322561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14823534-7dbf-440b-9707-5fd3ecff615b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:17.323015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14823534-7dbf-440b-9707-5fd3ecff615b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:17.323445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14823534-7dbf-440b-9707-5fd3ecff615b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:17.621928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14823534-7dbf-440b-9707-5fd3ecff615b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:17.633742 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14823534-7dbf-440b-9707-5fd3ecff615b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1507 microversion: 2.1 time: 0.335088 Sep 10 10:51:17.635128 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2566/3072] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:17 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:17.640433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5a2b809-f38d-41bf-9184-5d3b90d86c6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:17.641465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f5a2b809-f38d-41bf-9184-5d3b90d86c6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:17.659035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5a2b809-f38d-41bf-9184-5d3b90d86c6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:17.659035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5a2b809-f38d-41bf-9184-5d3b90d86c6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:17.659035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5a2b809-f38d-41bf-9184-5d3b90d86c6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:17.659719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5a2b809-f38d-41bf-9184-5d3b90d86c6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:17.660268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5a2b809-f38d-41bf-9184-5d3b90d86c6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:17.660768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5a2b809-f38d-41bf-9184-5d3b90d86c6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:17.846145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f5a2b809-f38d-41bf-9184-5d3b90d86c6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:17.856480 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f5a2b809-f38d-41bf-9184-5d3b90d86c6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.219944 Sep 10 10:51:17.857554 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2567/3073] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:17 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:17.887156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c4ffd8e-edba-47ce-849b-b0be41858ab1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcb2deee50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:17.950485 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c4ffd8e-edba-47ce-849b-b0be41858ab1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/f1cf2297-8083-4aa9-8ff0-877a65209b97" status: 200 len: 222 microversion: 2.1 time: 0.081612 Sep 10 10:51:17.951258 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2568/3074] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:51:17 2022] GET /compute/v2.1/os-security-groups/f1cf2297-8083-4aa9-8ff0-877a65209b97 => generated 222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:17.955983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-49821d1d-41d7-4f68-b686-670e1e971921 req-e1758d57-7001-424b-9846-8b641275d56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cffeb4-50b7-434d-be36-a6b74c2e750f", "tag": "193980e0-7ce9-46fe-ab55-1a5fdaabb1fe"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:17.978095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-49821d1d-41d7-4f68-b686-670e1e971921 req-e1758d57-7001-424b-9846-8b641275d56c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:17.978586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-49821d1d-41d7-4f68-b686-670e1e971921 req-e1758d57-7001-424b-9846-8b641275d56c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:17.979028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-49821d1d-41d7-4f68-b686-670e1e971921 req-e1758d57-7001-424b-9846-8b641275d56c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:17.992590 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-49821d1d-41d7-4f68-b686-670e1e971921 req-e1758d57-7001-424b-9846-8b641275d56c service nova] Creating event network-changed:193980e0-7ce9-46fe-ab55-1a5fdaabb1fe for instance 07cffeb4-50b7-434d-be36-a6b74c2e750f on n-h2-856894-1 Sep 10 10:51:17.997780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-49821d1d-41d7-4f68-b686-670e1e971921 req-e1758d57-7001-424b-9846-8b641275d56c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045191 Sep 10 10:51:17.999073 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2569/3075] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:18.005279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-67d1de5e-525c-44d1-a638-88bd76a738c6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:18.008631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-67d1de5e-525c-44d1-a638-88bd76a738c6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:18.015833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67d1de5e-525c-44d1-a638-88bd76a738c6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:18.016543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67d1de5e-525c-44d1-a638-88bd76a738c6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:18.017197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67d1de5e-525c-44d1-a638-88bd76a738c6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:18.018100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67d1de5e-525c-44d1-a638-88bd76a738c6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:18.018735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67d1de5e-525c-44d1-a638-88bd76a738c6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:18.019337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67d1de5e-525c-44d1-a638-88bd76a738c6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:18.125118 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-67d1de5e-525c-44d1-a638-88bd76a738c6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "PUT /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1079 microversion: 2.1 time: 0.124590 Sep 10 10:51:18.126084 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2570/3076] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Sep 10 10:51:17 2022] PUT /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1079 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:18.143737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38997fea-c641-484e-bb9c-47b438166c64 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:18.146531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38997fea-c641-484e-bb9c-47b438166c64 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:18.166739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38997fea-c641-484e-bb9c-47b438166c64 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:18.168745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38997fea-c641-484e-bb9c-47b438166c64 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:18.169413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38997fea-c641-484e-bb9c-47b438166c64 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:18.173037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38997fea-c641-484e-bb9c-47b438166c64 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:18.173730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38997fea-c641-484e-bb9c-47b438166c64 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:18.174360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38997fea-c641-484e-bb9c-47b438166c64 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:18.287138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-38997fea-c641-484e-bb9c-47b438166c64 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:18.292691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:18.318239 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38997fea-c641-484e-bb9c-47b438166c64 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.190843 Sep 10 10:51:18.320499 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2571/3077] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:18 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:18.328119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-75f56d34-a99d-4566-8f54-c9930eb6f1ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:18.328745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-75f56d34-a99d-4566-8f54-c9930eb6f1ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:18.343825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75f56d34-a99d-4566-8f54-c9930eb6f1ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:18.344331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75f56d34-a99d-4566-8f54-c9930eb6f1ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:18.344774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75f56d34-a99d-4566-8f54-c9930eb6f1ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:18.347019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75f56d34-a99d-4566-8f54-c9930eb6f1ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:18.348144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75f56d34-a99d-4566-8f54-c9930eb6f1ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:18.348649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-75f56d34-a99d-4566-8f54-c9930eb6f1ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:18.616691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-75f56d34-a99d-4566-8f54-c9930eb6f1ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:18.631227 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-75f56d34-a99d-4566-8f54-c9930eb6f1ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.308959 Sep 10 10:51:18.632285 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2572/3078] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:18 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:18.644018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1bb7087a-e3f3-4e71-a923-c87b5b74e013 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcae8fcca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:18.892787 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1bb7087a-e3f3-4e71-a923-c87b5b74e013 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f1cf2297-8083-4aa9-8ff0-877a65209b97" status: 202 len: 0 microversion: 2.1 time: 0.259145 Sep 10 10:51:18.894450 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2573/3079] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:51:18 2022] DELETE /compute/v2.1/os-security-groups/f1cf2297-8083-4aa9-8ff0-877a65209b97 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:18.900763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7911abc7-50a9-4656-ac66-f3c04babb37a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:18.903093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7911abc7-50a9-4656-ac66-f3c04babb37a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:18.922049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7911abc7-50a9-4656-ac66-f3c04babb37a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:18.922857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7911abc7-50a9-4656-ac66-f3c04babb37a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:18.923542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7911abc7-50a9-4656-ac66-f3c04babb37a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:18.924485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7911abc7-50a9-4656-ac66-f3c04babb37a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:18.925689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7911abc7-50a9-4656-ac66-f3c04babb37a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:18.926732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7911abc7-50a9-4656-ac66-f3c04babb37a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:19.099239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7911abc7-50a9-4656-ac66-f3c04babb37a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:19.108504 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7911abc7-50a9-4656-ac66-f3c04babb37a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1505 microversion: 2.1 time: 0.212780 Sep 10 10:51:19.109127 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2574/3080] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:18 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:19.114090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:19.114807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:19.121784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:19.122557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:19.123214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:19.124247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:19.124928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:19.126295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:19.204061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:19.214626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:19.216148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:19.217779 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-358b893e-cfd8-474a-bbba-d78663e6608a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.107015 Sep 10 10:51:19.218351 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2575/3081] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:19 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:19.224079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63460fef-c491-4354-8a26-5a644e83e5cd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:19.224772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63460fef-c491-4354-8a26-5a644e83e5cd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:19.231302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:19.232896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63460fef-c491-4354-8a26-5a644e83e5cd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:19.233418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63460fef-c491-4354-8a26-5a644e83e5cd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:19.234014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63460fef-c491-4354-8a26-5a644e83e5cd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:19.234737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63460fef-c491-4354-8a26-5a644e83e5cd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:19.235278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63460fef-c491-4354-8a26-5a644e83e5cd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:19.235710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63460fef-c491-4354-8a26-5a644e83e5cd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:19.393723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63460fef-c491-4354-8a26-5a644e83e5cd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:19.404020 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63460fef-c491-4354-8a26-5a644e83e5cd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.183534 Sep 10 10:51:19.406454 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2576/3082] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:19 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:19.410717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-958ec0f7-27b8-4c51-802c-90d3be39d4a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcae9349d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:19.441791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-958ec0f7-27b8-4c51-802c-90d3be39d4a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:51:19.442481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-958ec0f7-27b8-4c51-802c-90d3be39d4a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Neutron security group f1cf2297-8083-4aa9-8ff0-877a65209b97 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:51:19.443046 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-958ec0f7-27b8-4c51-802c-90d3be39d4a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:51:19.443046 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-94d915da-0f33-465f-befc-a72fa875afe3'] Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-958ec0f7-27b8-4c51-802c-90d3be39d4a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-security-groups/f1cf2297-8083-4aa9-8ff0-877a65209b97 HTTP/1.1 Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-94d915da-0f33-465f-befc-a72fa875afe3'] Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f1cf2297-8083-4aa9-8ff0-877a65209b97'} Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:51:19.445223 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94d915da-0f33-465f-befc-a72fa875afe3'] Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94d915da-0f33-465f-befc-a72fa875afe3'] Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94d915da-0f33-465f-befc-a72fa875afe3'] Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94d915da-0f33-465f-befc-a72fa875afe3'] Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-958ec0f7-27b8-4c51-802c-90d3be39d4a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-94d915da-0f33-465f-befc-a72fa875afe3'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-958ec0f7-27b8-4c51-802c-90d3be39d4a6 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/f1cf2297-8083-4aa9-8ff0-877a65209b97" status: 404 len: 194 microversion: 2.1 time: 0.040342 Sep 10 10:51:19.453496 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2577/3083] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:51:19 2022] GET /compute/v2.1/os-security-groups/f1cf2297-8083-4aa9-8ff0-877a65209b97 => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:51:19.457244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a96aeb09-bbd8-41a4-893e-cc7f9fe34599 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:19.457244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a96aeb09-bbd8-41a4-893e-cc7f9fe34599 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:19.480552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a96aeb09-bbd8-41a4-893e-cc7f9fe34599 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:19.480552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a96aeb09-bbd8-41a4-893e-cc7f9fe34599 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:19.480552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a96aeb09-bbd8-41a4-893e-cc7f9fe34599 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:19.480552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a96aeb09-bbd8-41a4-893e-cc7f9fe34599 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:19.480552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a96aeb09-bbd8-41a4-893e-cc7f9fe34599 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:19.480552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a96aeb09-bbd8-41a4-893e-cc7f9fe34599 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:19.715558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a96aeb09-bbd8-41a4-893e-cc7f9fe34599 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:19.736151 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a96aeb09-bbd8-41a4-893e-cc7f9fe34599 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1505 microversion: 2.1 time: 0.286737 Sep 10 10:51:19.736756 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2578/3084] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:19 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:19.744634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5269d7b6-948d-497a-9979-e1051529b4d0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:19.745432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5269d7b6-948d-497a-9979-e1051529b4d0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:19.753532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5269d7b6-948d-497a-9979-e1051529b4d0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:19.754088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5269d7b6-948d-497a-9979-e1051529b4d0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:19.754527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5269d7b6-948d-497a-9979-e1051529b4d0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:19.755488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5269d7b6-948d-497a-9979-e1051529b4d0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:19.756036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5269d7b6-948d-497a-9979-e1051529b4d0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:19.757154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5269d7b6-948d-497a-9979-e1051529b4d0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:19.847584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5269d7b6-948d-497a-9979-e1051529b4d0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:19.866258 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5269d7b6-948d-497a-9979-e1051529b4d0 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.128106 Sep 10 10:51:19.877095 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2579/3085] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:19 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:19.877095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d97cd62-a4c5-46ef-8bbd-208882a9f7f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:19.877095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d97cd62-a4c5-46ef-8bbd-208882a9f7f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:19.878783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d97cd62-a4c5-46ef-8bbd-208882a9f7f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:19.879167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d97cd62-a4c5-46ef-8bbd-208882a9f7f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:19.879618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d97cd62-a4c5-46ef-8bbd-208882a9f7f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:19.880360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d97cd62-a4c5-46ef-8bbd-208882a9f7f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:19.880793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d97cd62-a4c5-46ef-8bbd-208882a9f7f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:19.881275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d97cd62-a4c5-46ef-8bbd-208882a9f7f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:20.057828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d97cd62-a4c5-46ef-8bbd-208882a9f7f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:20.067474 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d97cd62-a4c5-46ef-8bbd-208882a9f7f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.199163 Sep 10 10:51:20.068713 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2580/3086] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:19 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:20.074548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41eb6526-032c-499a-9b94-2d006d44c3fd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: .version_select at 0x7efcae96ff70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2086655253", "description": "tempest-description-1583819899"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:20.251568 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41eb6526-032c-499a-9b94-2d006d44c3fd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.181164 Sep 10 10:51:20.252398 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2581/3087] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:51:20 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:20.268520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:20.271448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:20.279591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:20.279744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:20.280147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:20.280851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:20.281330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:20.281754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:20.373458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:51:20.373768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:51:20.374229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:51:20.374719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:51:20.375137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:51:20.452715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:20.461235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:20.461853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:20.462633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:20.463432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:20.463876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:20.464305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:20.513226 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fd583d0d-451a-467b-bd1a-b425a561a7ea tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "POST /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622/action" status: 202 len: 1111 microversion: 2.1 time: 0.238585 Sep 10 10:51:20.513226 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2582/3088] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:51:20 2022] POST /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622/action => generated 1111 bytes in 240 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 10:51:20.519824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-986345553", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "17605326-3d0c-4135-8b61-c2da6b77cdca"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:20.611107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] validate_networks() for [('17605326-3d0c-4135-8b61-c2da6b77cdca', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:51:21.301968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:51:21.302571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:51:21.303253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:51:21.304356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:51:21.304956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:51:21.313255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=25 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:21.317736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:21.318418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:21.319079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:21.320012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:21.320897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:21.321514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:21.348661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for project 524c87c1679a4651a4e303650950283c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:51:21.356532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for user 2cccb6588d07459eb1cfa9c00f53f7e2 and project 524c87c1679a4651a4e303650950283c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:51:21.376545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:51:21.380750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:51:21.458499 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-447c2c11-6c7a-4f06-9839-9828e2dbd232 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953109 Sep 10 10:51:21.459559 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2583/3089] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:51:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:51:21.464328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:21.464955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:21.473283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:21.486295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:21.486798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:21.490074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:21.490650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:21.493042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:21.608085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:21.621549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:21.625567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:21.630888 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f5fcaba1-cb0e-4a44-9bd2-98428aac866c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.168705 Sep 10 10:51:21.631734 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2584/3090] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:21 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:21.663249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85a9b0df-801c-4a1a-86ac-78fc938e641e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: .version_select at 0x7efcae8fcd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-529067959", "description": "tempest-description-1608983714"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:22.012809 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85a9b0df-801c-4a1a-86ac-78fc938e641e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.361853 Sep 10 10:51:22.013676 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2585/3091] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:51:21 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:22.025671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfea4e51-5e8e-4a86-9d25-07e71214ce07 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:22.026228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfea4e51-5e8e-4a86-9d25-07e71214ce07 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:22.033719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfea4e51-5e8e-4a86-9d25-07e71214ce07 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:22.034413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfea4e51-5e8e-4a86-9d25-07e71214ce07 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:22.035018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfea4e51-5e8e-4a86-9d25-07e71214ce07 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:22.035906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfea4e51-5e8e-4a86-9d25-07e71214ce07 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:22.036523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfea4e51-5e8e-4a86-9d25-07e71214ce07 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:22.037151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfea4e51-5e8e-4a86-9d25-07e71214ce07 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:22.207340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfea4e51-5e8e-4a86-9d25-07e71214ce07 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:22.221047 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfea4e51-5e8e-4a86-9d25-07e71214ce07 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.205836 Sep 10 10:51:22.222126 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2586/3092] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:22 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:22.228668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0b34b0e-5f95-45da-a271-6c10bbf69443 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:22.229311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0b34b0e-5f95-45da-a271-6c10bbf69443 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:22.242459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0b34b0e-5f95-45da-a271-6c10bbf69443 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:22.243172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0b34b0e-5f95-45da-a271-6c10bbf69443 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:22.243846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0b34b0e-5f95-45da-a271-6c10bbf69443 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:22.245428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0b34b0e-5f95-45da-a271-6c10bbf69443 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:22.246050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0b34b0e-5f95-45da-a271-6c10bbf69443 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:22.246635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0b34b0e-5f95-45da-a271-6c10bbf69443 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:22.356279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-a0b34b0e-5f95-45da-a271-6c10bbf69443 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:22.378908 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a0b34b0e-5f95-45da-a271-6c10bbf69443 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1929 microversion: 2.75 time: 0.155174 Sep 10 10:51:22.400879 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2587/3093] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:22 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:22.409014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9cc5d7af-3542-41a1-a3e9-139b8e03c169 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:22.410083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9cc5d7af-3542-41a1-a3e9-139b8e03c169 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:22.418402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7af-3542-41a1-a3e9-139b8e03c169 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:22.418900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7af-3542-41a1-a3e9-139b8e03c169 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:22.419344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7af-3542-41a1-a3e9-139b8e03c169 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:22.420485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7af-3542-41a1-a3e9-139b8e03c169 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:22.421002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7af-3542-41a1-a3e9-139b8e03c169 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:22.421465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7af-3542-41a1-a3e9-139b8e03c169 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:22.504567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9cc5d7af-3542-41a1-a3e9-139b8e03c169 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:22.518194 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9cc5d7af-3542-41a1-a3e9-139b8e03c169 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1218 microversion: 2.1 time: 0.115911 Sep 10 10:51:22.519116 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2588/3094] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:22 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:22.530497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-83775dc5-97c6-45db-b797-0c4a5430b6fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: .version_select at 0x7efcae8e4280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1025472676", "description": "tempest-description-1607093219"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:22.852845 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-83775dc5-97c6-45db-b797-0c4a5430b6fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.332426 Sep 10 10:51:22.853478 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2589/3095] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:51:22 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:22.869195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:22.869841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:22.887420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:22.887420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:22.887420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:22.887420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:22.887420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:22.887420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:22.971473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:22.980992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:22.983515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:22.985165 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7c1e7753-70d1-4bd2-8f90-67c6c060ca6e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.130677 Sep 10 10:51:23.001403 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2590/3096] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:22 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:23.017170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c66bb8c2-d56a-4d8a-94d0-442017c3331a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcae7e8ca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:23.276218 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c66bb8c2-d56a-4d8a-94d0-442017c3331a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.273573 Sep 10 10:51:23.276819 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2591/3097] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:51:23 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:23.281915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cdfa37b4-ebfe-47d3-accb-45e6640f8d4a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:23.282531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cdfa37b4-ebfe-47d3-accb-45e6640f8d4a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:23.290137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdfa37b4-ebfe-47d3-accb-45e6640f8d4a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:23.290630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdfa37b4-ebfe-47d3-accb-45e6640f8d4a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:23.291067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdfa37b4-ebfe-47d3-accb-45e6640f8d4a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:23.291783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdfa37b4-ebfe-47d3-accb-45e6640f8d4a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:23.292234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdfa37b4-ebfe-47d3-accb-45e6640f8d4a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:23.292661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdfa37b4-ebfe-47d3-accb-45e6640f8d4a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:23.315143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:23.455457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cdfa37b4-ebfe-47d3-accb-45e6640f8d4a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:23.466029 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cdfa37b4-ebfe-47d3-accb-45e6640f8d4a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.187818 Sep 10 10:51:23.475638 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2592/3098] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:23 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:23.480715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-46b7bd81-42a7-414e-9895-cfe72672fdf5 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcae8f8310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:23.669905 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-46b7bd81-42a7-414e-9895-cfe72672fdf5 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/8db26e38-2c28-4271-a6fc-7806046dbd59" status: 202 len: 0 microversion: 2.1 time: 0.200688 Sep 10 10:51:23.678036 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2593/3099] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:51:23 2022] DELETE /compute/v2.1/os-security-groups/8db26e38-2c28-4271-a6fc-7806046dbd59 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:23.700284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b0a3219-973a-4082-9850-041875b8c544 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:23.701820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b0a3219-973a-4082-9850-041875b8c544 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:23.712629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0a3219-973a-4082-9850-041875b8c544 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:23.713481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0a3219-973a-4082-9850-041875b8c544 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:23.713959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0a3219-973a-4082-9850-041875b8c544 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:23.714676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0a3219-973a-4082-9850-041875b8c544 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:23.715138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0a3219-973a-4082-9850-041875b8c544 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:23.715721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b0a3219-973a-4082-9850-041875b8c544 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:23.827816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5b0a3219-973a-4082-9850-041875b8c544 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:23.869666 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b0a3219-973a-4082-9850-041875b8c544 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1935 microversion: 2.75 time: 0.188800 Sep 10 10:51:23.870635 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2594/3100] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:23 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1935 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:23.875691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86eaa967-1926-4e62-9334-63571137571f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:23.876361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86eaa967-1926-4e62-9334-63571137571f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:23.883358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86eaa967-1926-4e62-9334-63571137571f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:23.883910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86eaa967-1926-4e62-9334-63571137571f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:23.884373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86eaa967-1926-4e62-9334-63571137571f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:23.885130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86eaa967-1926-4e62-9334-63571137571f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:23.885617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86eaa967-1926-4e62-9334-63571137571f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:23.886076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86eaa967-1926-4e62-9334-63571137571f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:24.017881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-86eaa967-1926-4e62-9334-63571137571f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:24.036547 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86eaa967-1926-4e62-9334-63571137571f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1266 microversion: 2.1 time: 0.164636 Sep 10 10:51:24.049099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2595/3101] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:23 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:24.049099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb4a82a7-8c32-4009-8906-d40a9fefdfd1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcaeb4e430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:24.074794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-fb4a82a7-8c32-4009-8906-d40a9fefdfd1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:51:24.077004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-fb4a82a7-8c32-4009-8906-d40a9fefdfd1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Neutron security group 8db26e38-2c28-4271-a6fc-7806046dbd59 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:51:24.079555 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-fb4a82a7-8c32-4009-8906-d40a9fefdfd1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:51:24.079555 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-afcd6e20-498e-4027-b9ce-3ac2174c9a4d'] Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb4a82a7-8c32-4009-8906-d40a9fefdfd1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-security-groups/8db26e38-2c28-4271-a6fc-7806046dbd59 HTTP/1.1 Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-afcd6e20-498e-4027-b9ce-3ac2174c9a4d'] Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '8db26e38-2c28-4271-a6fc-7806046dbd59'} Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:51:24.082467 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-afcd6e20-498e-4027-b9ce-3ac2174c9a4d'] Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-afcd6e20-498e-4027-b9ce-3ac2174c9a4d'] Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-afcd6e20-498e-4027-b9ce-3ac2174c9a4d'] Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-afcd6e20-498e-4027-b9ce-3ac2174c9a4d'] Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb4a82a7-8c32-4009-8906-d40a9fefdfd1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-afcd6e20-498e-4027-b9ce-3ac2174c9a4d'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb4a82a7-8c32-4009-8906-d40a9fefdfd1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/8db26e38-2c28-4271-a6fc-7806046dbd59" status: 404 len: 194 microversion: 2.1 time: 0.047037 Sep 10 10:51:24.093709 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2596/3102] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:51:24 2022] GET /compute/v2.1/os-security-groups/8db26e38-2c28-4271-a6fc-7806046dbd59 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:51:24.108459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:24.108459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:24.119722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:24.132732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:24.136176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:24.138093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:24.145388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:24.148975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:24.290310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:24.299184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:24.302975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:24.304409 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3c4f52c-7197-46f7-8f07-c869a133bdba tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.215488 Sep 10 10:51:24.317513 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2597/3103] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:24 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:24.328652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-efdefd0c-67c4-4a2a-9ca5-80c12f409f17 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcaeb4eca0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:24.813662 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-efdefd0c-67c4-4a2a-9ca5-80c12f409f17 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2ece3566-ddbc-411a-9fb5-9c9259668cd5" status: 202 len: 0 microversion: 2.1 time: 0.494521 Sep 10 10:51:24.819587 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2598/3104] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:51:24 2022] DELETE /compute/v2.1/os-security-groups/2ece3566-ddbc-411a-9fb5-9c9259668cd5 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:24.825322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e2ca9ac-2608-4a3f-b894-93c8058f151f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:24.826102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e2ca9ac-2608-4a3f-b894-93c8058f151f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:24.841625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2ca9ac-2608-4a3f-b894-93c8058f151f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:24.842419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2ca9ac-2608-4a3f-b894-93c8058f151f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:24.844487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2ca9ac-2608-4a3f-b894-93c8058f151f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:24.845450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2ca9ac-2608-4a3f-b894-93c8058f151f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:24.855931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2ca9ac-2608-4a3f-b894-93c8058f151f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:24.857709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2ca9ac-2608-4a3f-b894-93c8058f151f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:25.172412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e2ca9ac-2608-4a3f-b894-93c8058f151f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:25.181581 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e2ca9ac-2608-4a3f-b894-93c8058f151f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.360904 Sep 10 10:51:25.182179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2599/3105] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:24 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:25.187979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d688f57-42f9-416d-963e-ce85908dd84a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcae7d6700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:25.236907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-9d688f57-42f9-416d-963e-ce85908dd84a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:51:25.237781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-9d688f57-42f9-416d-963e-ce85908dd84a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Neutron security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:51:25.238535 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9d688f57-42f9-416d-963e-ce85908dd84a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:51:25.238535 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-2063fe0a-e1ad-46b8-b197-176fa57fffe5'] Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d688f57-42f9-416d-963e-ce85908dd84a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-security-groups/2ece3566-ddbc-411a-9fb5-9c9259668cd5 HTTP/1.1 Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-2063fe0a-e1ad-46b8-b197-176fa57fffe5'] Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '2ece3566-ddbc-411a-9fb5-9c9259668cd5'} Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:51:25.241750 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2063fe0a-e1ad-46b8-b197-176fa57fffe5'] Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2063fe0a-e1ad-46b8-b197-176fa57fffe5'] Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2063fe0a-e1ad-46b8-b197-176fa57fffe5'] Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2063fe0a-e1ad-46b8-b197-176fa57fffe5'] Sep 10 10:51:25.246053 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:25.251571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d688f57-42f9-416d-963e-ce85908dd84a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:51:25.251571 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-2063fe0a-e1ad-46b8-b197-176fa57fffe5'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:51:25.253741 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d688f57-42f9-416d-963e-ce85908dd84a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/2ece3566-ddbc-411a-9fb5-9c9259668cd5" status: 404 len: 194 microversion: 2.1 time: 0.070180 Sep 10 10:51:25.255104 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2600/3106] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:51:25 2022] GET /compute/v2.1/os-security-groups/2ece3566-ddbc-411a-9fb5-9c9259668cd5 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:51:25.280848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a9ef84f2-6f51-42e2-b563-72691298d925 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:25.282163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a9ef84f2-6f51-42e2-b563-72691298d925 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:25.292487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9ef84f2-6f51-42e2-b563-72691298d925 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:25.293415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9ef84f2-6f51-42e2-b563-72691298d925 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:25.296993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9ef84f2-6f51-42e2-b563-72691298d925 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:25.298047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9ef84f2-6f51-42e2-b563-72691298d925 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:25.298744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9ef84f2-6f51-42e2-b563-72691298d925 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:25.299406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9ef84f2-6f51-42e2-b563-72691298d925 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:25.491350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-a9ef84f2-6f51-42e2-b563-72691298d925 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:25.536137 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a9ef84f2-6f51-42e2-b563-72691298d925 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1935 microversion: 2.75 time: 0.279460 Sep 10 10:51:25.558617 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2601/3107] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:25 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1935 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:25.570940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd33c4ab-d333-4167-a9a9-d91c0298afaf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:25.572019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd33c4ab-d333-4167-a9a9-d91c0298afaf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:25.578930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd33c4ab-d333-4167-a9a9-d91c0298afaf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:25.579734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd33c4ab-d333-4167-a9a9-d91c0298afaf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:25.580191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd33c4ab-d333-4167-a9a9-d91c0298afaf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:25.580926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd33c4ab-d333-4167-a9a9-d91c0298afaf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:25.581431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd33c4ab-d333-4167-a9a9-d91c0298afaf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:25.581850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd33c4ab-d333-4167-a9a9-d91c0298afaf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:25.851997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd33c4ab-d333-4167-a9a9-d91c0298afaf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:25.874857 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd33c4ab-d333-4167-a9a9-d91c0298afaf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1284 microversion: 2.1 time: 0.309910 Sep 10 10:51:25.875567 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2602/3108] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:25 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1284 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:25.906023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-346ce562-ae8b-48e5-817e-8e1dcd2ffb1d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcaebc01f0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:26.355561 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-346ce562-ae8b-48e5-817e-8e1dcd2ffb1d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/668a489e-6fb3-4adf-8356-61e832e11eab" status: 202 len: 0 microversion: 2.1 time: 0.478850 Sep 10 10:51:26.356574 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2603/3109] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:51:25 2022] DELETE /compute/v2.1/os-security-groups/668a489e-6fb3-4adf-8356-61e832e11eab => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:26.367734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:26.368650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:26.388728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:26.389614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:26.391488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:26.392784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:26.398010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:26.398831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:26.513058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:26.530918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:26.532891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:26.534986 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a11a77b-481d-47b5-9614-8f7ac256412f tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.176535 Sep 10 10:51:26.550238 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2604/3110] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:26 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:26.560584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-073d9cd7-4b51-4a90-a938-7aba647e3949 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:26.561701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-073d9cd7-4b51-4a90-a938-7aba647e3949 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:26.568364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-073d9cd7-4b51-4a90-a938-7aba647e3949 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:26.569531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-073d9cd7-4b51-4a90-a938-7aba647e3949 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:26.570190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-073d9cd7-4b51-4a90-a938-7aba647e3949 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:26.571016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-073d9cd7-4b51-4a90-a938-7aba647e3949 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:26.571553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-073d9cd7-4b51-4a90-a938-7aba647e3949 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:26.572119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-073d9cd7-4b51-4a90-a938-7aba647e3949 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:26.862472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-073d9cd7-4b51-4a90-a938-7aba647e3949 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:26.883561 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-073d9cd7-4b51-4a90-a938-7aba647e3949 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.329494 Sep 10 10:51:26.897465 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2605/3111] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:26 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:26.910893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7cd9ed14-0c20-446b-b594-f993ad3052ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcae96f430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:26.945996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-7cd9ed14-0c20-446b-b594-f993ad3052ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:51:26.946641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-7cd9ed14-0c20-446b-b594-f993ad3052ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Neutron security group 668a489e-6fb3-4adf-8356-61e832e11eab not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:51:26.947399 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-7cd9ed14-0c20-446b-b594-f993ad3052ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:51:26.947399 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-d75b7ae3-f9ca-445f-808e-8f052fad1709'] Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7cd9ed14-0c20-446b-b594-f993ad3052ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-security-groups/668a489e-6fb3-4adf-8356-61e832e11eab HTTP/1.1 Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-d75b7ae3-f9ca-445f-808e-8f052fad1709'] Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '668a489e-6fb3-4adf-8356-61e832e11eab'} Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:51:26.949772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d75b7ae3-f9ca-445f-808e-8f052fad1709'] Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d75b7ae3-f9ca-445f-808e-8f052fad1709'] Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d75b7ae3-f9ca-445f-808e-8f052fad1709'] Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d75b7ae3-f9ca-445f-808e-8f052fad1709'] Sep 10 10:51:26.954654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:26.959179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7cd9ed14-0c20-446b-b594-f993ad3052ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:51:26.959179 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-d75b7ae3-f9ca-445f-808e-8f052fad1709'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:51:26.960831 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7cd9ed14-0c20-446b-b594-f993ad3052ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/668a489e-6fb3-4adf-8356-61e832e11eab" status: 404 len: 194 microversion: 2.1 time: 0.061948 Sep 10 10:51:26.962528 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2606/3112] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:51:26 2022] GET /compute/v2.1/os-security-groups/668a489e-6fb3-4adf-8356-61e832e11eab => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:51:26.968643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2463bb6e-75e0-4156-96c7-7cc7356aac37 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:26.969693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2463bb6e-75e0-4156-96c7-7cc7356aac37 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:26.979776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2463bb6e-75e0-4156-96c7-7cc7356aac37 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:26.980557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2463bb6e-75e0-4156-96c7-7cc7356aac37 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:26.981235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2463bb6e-75e0-4156-96c7-7cc7356aac37 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:26.982493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2463bb6e-75e0-4156-96c7-7cc7356aac37 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:26.983364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2463bb6e-75e0-4156-96c7-7cc7356aac37 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:26.984147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2463bb6e-75e0-4156-96c7-7cc7356aac37 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:27.078965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-2463bb6e-75e0-4156-96c7-7cc7356aac37 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] Lazy-loading 'services' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:27.118903 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2463bb6e-75e0-4156-96c7-7cc7356aac37 tempest-ServersAdmin275Test-1960044852 tempest-ServersAdmin275Test-1960044852-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1920 microversion: 2.75 time: 0.154766 Sep 10 10:51:27.120361 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2607/3113] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:26 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1920 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:27.130031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f51586af-b363-4eee-885e-a7f9f83008aa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:27.132896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f51586af-b363-4eee-885e-a7f9f83008aa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:27.149983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f51586af-b363-4eee-885e-a7f9f83008aa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:27.150771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f51586af-b363-4eee-885e-a7f9f83008aa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:27.151510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f51586af-b363-4eee-885e-a7f9f83008aa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:27.153209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f51586af-b363-4eee-885e-a7f9f83008aa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:27.153851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f51586af-b363-4eee-885e-a7f9f83008aa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:27.155135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f51586af-b363-4eee-885e-a7f9f83008aa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:27.436196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f51586af-b363-4eee-885e-a7f9f83008aa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:27.447556 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f51586af-b363-4eee-885e-a7f9f83008aa tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1314 microversion: 2.1 time: 0.324762 Sep 10 10:51:27.448562 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2608/3114] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:27 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:27.468086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2885e500-2b33-4489-b964-50183553159b tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcae8fcd30>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:27.723216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2885e500-2b33-4489-b964-50183553159b tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.271866 Sep 10 10:51:27.723808 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2609/3115] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:51:27 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:27.733999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35d9560b-0ec8-45d4-bc8a-b44f22b4dde9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:27.733999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-35d9560b-0ec8-45d4-bc8a-b44f22b4dde9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:27.749500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35d9560b-0ec8-45d4-bc8a-b44f22b4dde9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:27.753452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35d9560b-0ec8-45d4-bc8a-b44f22b4dde9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:27.754126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35d9560b-0ec8-45d4-bc8a-b44f22b4dde9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:27.755644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35d9560b-0ec8-45d4-bc8a-b44f22b4dde9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:27.756890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35d9560b-0ec8-45d4-bc8a-b44f22b4dde9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:27.757787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35d9560b-0ec8-45d4-bc8a-b44f22b4dde9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:27.815988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-35d9560b-0ec8-45d4-bc8a-b44f22b4dde9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:51:28.047977 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-35d9560b-0ec8-45d4-bc8a-b44f22b4dde9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 204 len: 0 microversion: 2.75 time: 0.322792 Sep 10 10:51:28.049386 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2610/3116] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:51:27 2022] DELETE /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:51:28.055162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:28.055876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:28.071852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:28.072427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:28.072878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:28.073625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:28.074082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:28.074535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:28.651330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:28.683200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:28.702479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:28.703952 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-20e501d5-6dbc-4579-bb89-6b5ff97b813e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.653048 Sep 10 10:51:28.704642 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2611/3117] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:28 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:28.728968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c268cb93-1085-4604-9861-88a53d3757ec tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: .version_select at 0x7efcae8fc160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-561829746", "description": "tempest-description-395495843"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:28.927450 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c268cb93-1085-4604-9861-88a53d3757ec tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.208810 Sep 10 10:51:28.928345 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2612/3118] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:51:28 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:28.933763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-fd64aeaa-e84b-4a55-ad88-93b61810fefd req-b4069bf0-8a79-463e-a360-90ce7e8e26f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0e028d-c34c-4d5d-b7fa-1e494522b645", "tag": "f965aab7-c91f-4c1b-a122-49ea634fb346"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:28.970029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd64aeaa-e84b-4a55-ad88-93b61810fefd req-b4069bf0-8a79-463e-a360-90ce7e8e26f4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:28.972454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd64aeaa-e84b-4a55-ad88-93b61810fefd req-b4069bf0-8a79-463e-a360-90ce7e8e26f4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:28.974920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd64aeaa-e84b-4a55-ad88-93b61810fefd req-b4069bf0-8a79-463e-a360-90ce7e8e26f4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:29.008546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-fd64aeaa-e84b-4a55-ad88-93b61810fefd req-b4069bf0-8a79-463e-a360-90ce7e8e26f4 service nova] Creating event network-changed:f965aab7-c91f-4c1b-a122-49ea634fb346 for instance bc0e028d-c34c-4d5d-b7fa-1e494522b645 on n-h2-856894-1 Sep 10 10:51:29.026964 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-fd64aeaa-e84b-4a55-ad88-93b61810fefd req-b4069bf0-8a79-463e-a360-90ce7e8e26f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096368 Sep 10 10:51:29.030443 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2613/3119] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:29.044476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d43bed5b-b193-49db-8037-b5bbefc28015 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:29.046170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d43bed5b-b193-49db-8037-b5bbefc28015 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:29.061744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d43bed5b-b193-49db-8037-b5bbefc28015 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:29.062411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d43bed5b-b193-49db-8037-b5bbefc28015 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:29.062887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d43bed5b-b193-49db-8037-b5bbefc28015 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:29.063796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d43bed5b-b193-49db-8037-b5bbefc28015 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:29.065226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d43bed5b-b193-49db-8037-b5bbefc28015 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:29.065870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d43bed5b-b193-49db-8037-b5bbefc28015 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:29.309010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d43bed5b-b193-49db-8037-b5bbefc28015 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:29.330982 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d43bed5b-b193-49db-8037-b5bbefc28015 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.299191 Sep 10 10:51:29.345470 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2614/3120] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:29 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:29.351050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:29.351681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:29.359484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:29.360076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:29.360836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:29.361569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:29.362024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:29.362448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:29.390005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:29.439313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:29.448360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:29.449907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:29.455307 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d1b3931-67fa-41ca-a418-427ebd150d09 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1444 microversion: 2.75 time: 0.108753 Sep 10 10:51:29.456508 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2615/3121] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:29 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:29.461966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-316526b3-7cb9-4e52-b595-c9f061080bdd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:29.462971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-316526b3-7cb9-4e52-b595-c9f061080bdd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:29.468815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-316526b3-7cb9-4e52-b595-c9f061080bdd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:29.469598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-316526b3-7cb9-4e52-b595-c9f061080bdd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:29.470299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-316526b3-7cb9-4e52-b595-c9f061080bdd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:29.471051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-316526b3-7cb9-4e52-b595-c9f061080bdd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:29.471563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-316526b3-7cb9-4e52-b595-c9f061080bdd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:29.472158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-316526b3-7cb9-4e52-b595-c9f061080bdd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:29.634822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-316526b3-7cb9-4e52-b595-c9f061080bdd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:29.642690 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-316526b3-7cb9-4e52-b595-c9f061080bdd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1314 microversion: 2.1 time: 0.184727 Sep 10 10:51:29.643154 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2616/3122] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:29 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:29.647696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-338022cc-cf04-4e0e-9b67-3d7d6ec7f223 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: .version_select at 0x7efcaf06b790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1366370466", "description": "tempest-description-449922060"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:29.867571 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-338022cc-cf04-4e0e-9b67-3d7d6ec7f223 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.220951 Sep 10 10:51:29.867571 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2617/3123] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:51:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:29.872171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:29.872800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:29.921298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:29.927715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:29.930554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:29.932950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:29.933928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:29.934392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:30.079291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:30.107212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:30.109583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:30.110829 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bad8ff33-f469-4411-ba39-10dfcfa23155 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.242999 Sep 10 10:51:30.115056 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2618/3124] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:29 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:30.136180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1662864322", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "76161e86-8494-4ec8-960c-d16cf1f1f18b"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:30.229981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] validate_networks() for [('76161e86-8494-4ec8-960c-d16cf1f1f18b', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:51:30.679002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:51:30.679430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:51:30.679913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:51:30.680326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:51:30.680744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:51:30.689931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:30.690426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:30.690863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:30.691801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:30.692258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:30.692686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:30.711894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Getting quotas for project 684b82ad978e47479334031e215abdc1. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:51:30.714341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:30.718529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Getting quotas for user e9cd1c03592e40a38dea70af40a8bd7b and project 684b82ad978e47479334031e215abdc1. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:51:30.740235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:51:30.742651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:51:30.791181 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de02e223-d380-4b45-9c2d-3a28e93c16ca tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674407 Sep 10 10:51:30.791835 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2619/3125] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:51:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:51:30.796446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41ac4df2-6c51-450d-9b2b-da551c521585 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:30.797274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-41ac4df2-6c51-450d-9b2b-da551c521585 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:30.804953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ac4df2-6c51-450d-9b2b-da551c521585 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:30.805478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ac4df2-6c51-450d-9b2b-da551c521585 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:30.805918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ac4df2-6c51-450d-9b2b-da551c521585 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:30.806618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ac4df2-6c51-450d-9b2b-da551c521585 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:30.807073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ac4df2-6c51-450d-9b2b-da551c521585 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:30.807500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ac4df2-6c51-450d-9b2b-da551c521585 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:30.962494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-41ac4df2-6c51-450d-9b2b-da551c521585 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:30.971489 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41ac4df2-6c51-450d-9b2b-da551c521585 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.178370 Sep 10 10:51:30.972245 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2620/3126] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:30 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:30.978187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:30.979642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:30.986425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:30.987146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:30.987947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:30.988712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:30.989273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:30.989698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:31.061737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:31.071375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:31.072975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:31.078603 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-763d7441-e68a-489f-b861-d876618b1254 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1444 microversion: 2.75 time: 0.105183 Sep 10 10:51:31.079187 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2621/3127] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:30 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:31.084403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-813f6fd9-ed87-4a45-880c-83c8dede8b67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:31.085739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-813f6fd9-ed87-4a45-880c-83c8dede8b67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:31.091906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813f6fd9-ed87-4a45-880c-83c8dede8b67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:31.092390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813f6fd9-ed87-4a45-880c-83c8dede8b67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:31.093050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813f6fd9-ed87-4a45-880c-83c8dede8b67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:31.094094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813f6fd9-ed87-4a45-880c-83c8dede8b67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:31.094747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813f6fd9-ed87-4a45-880c-83c8dede8b67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:31.095364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-813f6fd9-ed87-4a45-880c-83c8dede8b67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:31.258964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-813f6fd9-ed87-4a45-880c-83c8dede8b67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:31.267804 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-813f6fd9-ed87-4a45-880c-83c8dede8b67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1314 microversion: 2.1 time: 0.186924 Sep 10 10:51:31.268515 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2622/3128] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:31 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:31.274220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bee07421-ee3e-4b68-b55e-5563745db51f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:31.275069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bee07421-ee3e-4b68-b55e-5563745db51f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:31.282627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bee07421-ee3e-4b68-b55e-5563745db51f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:31.283112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bee07421-ee3e-4b68-b55e-5563745db51f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:31.283551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bee07421-ee3e-4b68-b55e-5563745db51f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:31.284278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bee07421-ee3e-4b68-b55e-5563745db51f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:31.284704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bee07421-ee3e-4b68-b55e-5563745db51f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:31.285172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bee07421-ee3e-4b68-b55e-5563745db51f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:31.360696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bee07421-ee3e-4b68-b55e-5563745db51f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:31.371398 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bee07421-ee3e-4b68-b55e-5563745db51f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1220 microversion: 2.1 time: 0.101503 Sep 10 10:51:31.373253 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2623/3129] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:31 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:31.378343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:31.378952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:31.385759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:31.386455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:31.391381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:31.392175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:31.392669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:31.393232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:31.488472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:31.498651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:31.500265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:31.501563 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-28cbbe56-f7e3-416b-ae26-070112f6141e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.127100 Sep 10 10:51:31.502323 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2624/3130] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:31 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:31.996821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-997086d1-ae03-4398-b37d-fcc0a36196c1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:31.998294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-997086d1-ae03-4398-b37d-fcc0a36196c1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:32.023235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-997086d1-ae03-4398-b37d-fcc0a36196c1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.025773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-997086d1-ae03-4398-b37d-fcc0a36196c1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.027216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-997086d1-ae03-4398-b37d-fcc0a36196c1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.028653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-997086d1-ae03-4398-b37d-fcc0a36196c1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.030258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-997086d1-ae03-4398-b37d-fcc0a36196c1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.034235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-997086d1-ae03-4398-b37d-fcc0a36196c1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.200776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-997086d1-ae03-4398-b37d-fcc0a36196c1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:32.209548 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-997086d1-ae03-4398-b37d-fcc0a36196c1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.217795 Sep 10 10:51:32.211070 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2625/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:31 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:32.227084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:32.227848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:32.235902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.236521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.237164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.238150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.238633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.239059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.276764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.277282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.277719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.278165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lazy-loading 'fault' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:32.321840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:32.330749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:32.332257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:32.338067 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0a641085-7513-486d-b826-ee7c9327009e tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1449 microversion: 2.75 time: 0.125527 Sep 10 10:51:32.338657 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2626/3132] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:32 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1449 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:32.343649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19c3361b-dab9-47b8-be69-661f1fabedfe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:32.345518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-19c3361b-dab9-47b8-be69-661f1fabedfe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:32.353399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19c3361b-dab9-47b8-be69-661f1fabedfe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.354064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19c3361b-dab9-47b8-be69-661f1fabedfe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.354877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19c3361b-dab9-47b8-be69-661f1fabedfe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.355873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19c3361b-dab9-47b8-be69-661f1fabedfe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.356597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19c3361b-dab9-47b8-be69-661f1fabedfe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.357048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19c3361b-dab9-47b8-be69-661f1fabedfe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.503061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19c3361b-dab9-47b8-be69-661f1fabedfe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:32.514993 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-19c3361b-dab9-47b8-be69-661f1fabedfe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1314 microversion: 2.1 time: 0.175244 Sep 10 10:51:32.516204 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2627/3133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:32 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:32.525128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac055621-d2f0-47f1-843b-11608db7a6d1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:32.526048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac055621-d2f0-47f1-843b-11608db7a6d1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:32.534613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac055621-d2f0-47f1-843b-11608db7a6d1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.535634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac055621-d2f0-47f1-843b-11608db7a6d1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.536697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac055621-d2f0-47f1-843b-11608db7a6d1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.538192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac055621-d2f0-47f1-843b-11608db7a6d1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.539822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac055621-d2f0-47f1-843b-11608db7a6d1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.540708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac055621-d2f0-47f1-843b-11608db7a6d1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.662940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ac055621-d2f0-47f1-843b-11608db7a6d1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:32.684454 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac055621-d2f0-47f1-843b-11608db7a6d1 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1268 microversion: 2.1 time: 0.166660 Sep 10 10:51:32.689942 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2628/3134] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:32 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:32.700804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:32.700804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:32.711949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.714326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.716032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.719240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:32.720066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:32.720911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:32.834825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:32.849100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:32.850630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:32.852676 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-925f63b0-91a9-44e7-88fb-d080947e6a1a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.161658 Sep 10 10:51:32.857120 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2629/3135] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:32 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:33.234129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-18652835-64e7-4ecd-8b96-f5b950f51bca tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:33.235730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-18652835-64e7-4ecd-8b96-f5b950f51bca tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:33.244479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18652835-64e7-4ecd-8b96-f5b950f51bca tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:33.283741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18652835-64e7-4ecd-8b96-f5b950f51bca tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:33.283741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18652835-64e7-4ecd-8b96-f5b950f51bca tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:33.283741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18652835-64e7-4ecd-8b96-f5b950f51bca tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:33.283741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18652835-64e7-4ecd-8b96-f5b950f51bca tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:33.283741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-18652835-64e7-4ecd-8b96-f5b950f51bca tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:33.482395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-18652835-64e7-4ecd-8b96-f5b950f51bca tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:33.493878 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-18652835-64e7-4ecd-8b96-f5b950f51bca tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.263491 Sep 10 10:51:33.495074 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2630/3136] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:33 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:33.502257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:33.502879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:33.510757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:33.511766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:33.512216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:33.512990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:33.513482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:33.513910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:33.556361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:33.556862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:33.557335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:33.557799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lazy-loading 'fault' on Instance uuid d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:33.621105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:33.629781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:33.631415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d856288f8c407dac317f7d97ba7fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31435b92586b4306a63134bf958f157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:33.637021 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c14ac16a-a8f2-426a-9d1a-862490575f24 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 200 len: 1449 microversion: 2.75 time: 0.140314 Sep 10 10:51:33.637964 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2631/3137] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:33 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 1449 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:33.642941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b34439a6-2342-4701-922e-cec0fa799a4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:33.643461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b34439a6-2342-4701-922e-cec0fa799a4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:33.650261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b34439a6-2342-4701-922e-cec0fa799a4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:33.650754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b34439a6-2342-4701-922e-cec0fa799a4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:33.651191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b34439a6-2342-4701-922e-cec0fa799a4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:33.651898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b34439a6-2342-4701-922e-cec0fa799a4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:33.652543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b34439a6-2342-4701-922e-cec0fa799a4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:33.653152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b34439a6-2342-4701-922e-cec0fa799a4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:33.844459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b34439a6-2342-4701-922e-cec0fa799a4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:33.851701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:33.856101 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b34439a6-2342-4701-922e-cec0fa799a4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1314 microversion: 2.1 time: 0.217025 Sep 10 10:51:33.856721 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2632/3138] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:33 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:33.862218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1970d6f4-2b28-47cc-83b3-f74c2f4c4494 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:33.862860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1970d6f4-2b28-47cc-83b3-f74c2f4c4494 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:33.870318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1970d6f4-2b28-47cc-83b3-f74c2f4c4494 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:33.870813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1970d6f4-2b28-47cc-83b3-f74c2f4c4494 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:33.871252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1970d6f4-2b28-47cc-83b3-f74c2f4c4494 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:33.871955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1970d6f4-2b28-47cc-83b3-f74c2f4c4494 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:33.872760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1970d6f4-2b28-47cc-83b3-f74c2f4c4494 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:33.873239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1970d6f4-2b28-47cc-83b3-f74c2f4c4494 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:34.045981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1970d6f4-2b28-47cc-83b3-f74c2f4c4494 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:34.062069 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1970d6f4-2b28-47cc-83b3-f74c2f4c4494 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1316 microversion: 2.1 time: 0.204095 Sep 10 10:51:34.064203 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2633/3139] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:33 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:34.070094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:34.070733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:34.082739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:34.083825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:34.085199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:34.085199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:34.085576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:34.086012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:34.166408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:34.174885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:34.176303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:34.177525 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-770a644e-31ca-4551-ad27-195ade86d65c tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.112334 Sep 10 10:51:34.178210 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2634/3140] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:34 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:34.519519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22537e43-662b-41c8-a9c4-dbdf8e552e74 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:34.520180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-22537e43-662b-41c8-a9c4-dbdf8e552e74 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:34.529963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22537e43-662b-41c8-a9c4-dbdf8e552e74 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:34.530728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22537e43-662b-41c8-a9c4-dbdf8e552e74 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:34.531359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22537e43-662b-41c8-a9c4-dbdf8e552e74 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:34.532259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22537e43-662b-41c8-a9c4-dbdf8e552e74 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:34.532883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22537e43-662b-41c8-a9c4-dbdf8e552e74 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:34.533576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22537e43-662b-41c8-a9c4-dbdf8e552e74 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:34.763029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-22537e43-662b-41c8-a9c4-dbdf8e552e74 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:34.772834 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-22537e43-662b-41c8-a9c4-dbdf8e552e74 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.258313 Sep 10 10:51:34.785481 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2635/3141] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:34 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:34.791449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e9800eb1-c766-4a55-b176-0fa431848f42 req-dcda54eb-1b5f-4269-ab04-3300eb3c3aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2bfc6ba-e6cf-4263-b70c-e21afd2fe828", "tag": "e7c3aa12-f8f1-4dc6-80d9-9122ec45c547"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:34.803755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e9800eb1-c766-4a55-b176-0fa431848f42 req-dcda54eb-1b5f-4269-ab04-3300eb3c3aab service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:34.804359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e9800eb1-c766-4a55-b176-0fa431848f42 req-dcda54eb-1b5f-4269-ab04-3300eb3c3aab service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:34.804893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e9800eb1-c766-4a55-b176-0fa431848f42 req-dcda54eb-1b5f-4269-ab04-3300eb3c3aab service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:34.817898 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e9800eb1-c766-4a55-b176-0fa431848f42 req-dcda54eb-1b5f-4269-ab04-3300eb3c3aab service nova] Creating event network-changed:e7c3aa12-f8f1-4dc6-80d9-9122ec45c547 for instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 on n-h2-856894-1 Sep 10 10:51:34.823817 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e9800eb1-c766-4a55-b176-0fa431848f42 req-dcda54eb-1b5f-4269-ab04-3300eb3c3aab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036645 Sep 10 10:51:34.824853 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2636/3142] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:34.831685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:34.834622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] [instance: d1dfa4da-8dd8-4c4a-9c69-471c2eb25554] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:34.842953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:34.843715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:34.844537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:34.845512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:34.846165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:34.846863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:34.865320 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] HTTP exception thrown: Instance d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 could not be found. Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Request method failure captured: Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 HTTP/1.1 Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGvUyoBL37ji5jXNf5BfRd-GWfAVDDO_ZE8QO_YoaOpdTISZWVDo0DH8KPrKKRaft3csgUt8rRrgobtypxPa7bHP2Jb82B_9RPSvlO5fkFzELZ5hlwqWy9wa1dtP8D4j8Sn69R6pOgWeHYCuGd43QwpTGwwMKzwVjtbW8XIZ9gtvaO4 Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.75 Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 31435b92586b4306a63134bf958f157e Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersAdmin275Test-749002275 Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31435b92586b4306a63134bf958f157e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/31435b92586b4306a63134bf958f157e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/31435b92586b4306a63134bf958f157e"}]}, {"type": "tempest-type-513607880", "name": "tempest-service-1036790611", "endpoints": [{"region": "tempest-region-2043862374", "internalURL": "https://url-1270162014.com"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_31435b92586b4306a63134bf958f157e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "tempest-type-25174732", "name": "tempest-service-79844178", "endpoints": [{"region": "tempest-region-2069047919", "publicURL": "https://url-781048423.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersAdmin275Test-749002275 Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 31435b92586b4306a63134bf958f157e Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersAdmin275Test-749002275 Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersAdmin275Test-749002275-project Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 06d856288f8c407dac317f7d97ba7fe9 Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersAdmin275Test-749002275-project Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 could not be found. Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd1dfa4da-8dd8-4c4a-9c69-471c2eb25554'} Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 could not be found. Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:51:34.867425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 could not be found. Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 could not be found. Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] Returning 404 to user: Instance d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c0df632-92d1-4294-9598-6bc31f0f3ae9 tempest-ServersAdmin275Test-749002275 tempest-ServersAdmin275Test-749002275-project] 10.222.0.20 "GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554" status: 404 len: 111 microversion: 2.75 time: 0.042948 Sep 10 10:51:34.871416 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2637/3143] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:34 2022] GET /compute/v2.1/servers/d1dfa4da-8dd8-4c4a-9c69-471c2eb25554 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:51:34.894628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5bd25ebb-4232-47bf-b0a7-02d3db2387e5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:34.897840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5bd25ebb-4232-47bf-b0a7-02d3db2387e5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:34.910455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bd25ebb-4232-47bf-b0a7-02d3db2387e5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:34.911278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bd25ebb-4232-47bf-b0a7-02d3db2387e5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:34.911965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bd25ebb-4232-47bf-b0a7-02d3db2387e5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:34.913736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bd25ebb-4232-47bf-b0a7-02d3db2387e5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:34.917230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bd25ebb-4232-47bf-b0a7-02d3db2387e5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:34.917935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5bd25ebb-4232-47bf-b0a7-02d3db2387e5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:35.150205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5bd25ebb-4232-47bf-b0a7-02d3db2387e5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:35.160094 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5bd25ebb-4232-47bf-b0a7-02d3db2387e5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1314 microversion: 2.1 time: 0.276087 Sep 10 10:51:35.190034 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2638/3144] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:34 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:35.195289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-438ac1cd-f721-4328-acc6-3e6b6c0d6aee tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:35.199898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-438ac1cd-f721-4328-acc6-3e6b6c0d6aee tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:35.206607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438ac1cd-f721-4328-acc6-3e6b6c0d6aee tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:35.207704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438ac1cd-f721-4328-acc6-3e6b6c0d6aee tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:35.208328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438ac1cd-f721-4328-acc6-3e6b6c0d6aee tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:35.210703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438ac1cd-f721-4328-acc6-3e6b6c0d6aee tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:35.211408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438ac1cd-f721-4328-acc6-3e6b6c0d6aee tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:35.212008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-438ac1cd-f721-4328-acc6-3e6b6c0d6aee tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:35.387594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-438ac1cd-f721-4328-acc6-3e6b6c0d6aee tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:35.396851 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-438ac1cd-f721-4328-acc6-3e6b6c0d6aee tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1316 microversion: 2.1 time: 0.205161 Sep 10 10:51:35.398025 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2639/3145] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:35 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:35.402812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:35.403412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:35.409854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:35.410343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:35.410775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:35.411456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:35.411970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:35.412941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:35.539579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:35.550200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:35.552013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:35.554668 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b269d95-2947-4d43-9c4f-7ac54164446e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.155453 Sep 10 10:51:35.557260 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2640/3146] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:35 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:35.579643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d0834af5-3952-4277-bc86-71e233ca0516 req-104375d4-89ac-4e6f-95b3-ebdf21609d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0e028d-c34c-4d5d-b7fa-1e494522b645", "name": "network-vif-plugged", "status": "completed", "tag": "f965aab7-c91f-4c1b-a122-49ea634fb346"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:35.597669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d0834af5-3952-4277-bc86-71e233ca0516 req-104375d4-89ac-4e6f-95b3-ebdf21609d77 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:35.598344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d0834af5-3952-4277-bc86-71e233ca0516 req-104375d4-89ac-4e6f-95b3-ebdf21609d77 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:35.598898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d0834af5-3952-4277-bc86-71e233ca0516 req-104375d4-89ac-4e6f-95b3-ebdf21609d77 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:35.613994 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d0834af5-3952-4277-bc86-71e233ca0516 req-104375d4-89ac-4e6f-95b3-ebdf21609d77 service nova] Creating event network-vif-plugged:f965aab7-c91f-4c1b-a122-49ea634fb346 for instance bc0e028d-c34c-4d5d-b7fa-1e494522b645 on n-h2-856894-1 Sep 10 10:51:35.619425 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d0834af5-3952-4277-bc86-71e233ca0516 req-104375d4-89ac-4e6f-95b3-ebdf21609d77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044329 Sep 10 10:51:35.620553 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2641/3147] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:51:35.806748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa130a6b-cd6f-4c9f-be64-2a56396cf8f3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:35.810482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa130a6b-cd6f-4c9f-be64-2a56396cf8f3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:35.826594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa130a6b-cd6f-4c9f-be64-2a56396cf8f3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:35.828098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa130a6b-cd6f-4c9f-be64-2a56396cf8f3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:35.828915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa130a6b-cd6f-4c9f-be64-2a56396cf8f3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:35.831182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa130a6b-cd6f-4c9f-be64-2a56396cf8f3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:35.831834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa130a6b-cd6f-4c9f-be64-2a56396cf8f3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:35.832412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa130a6b-cd6f-4c9f-be64-2a56396cf8f3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:36.040048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa130a6b-cd6f-4c9f-be64-2a56396cf8f3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:36.049174 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa130a6b-cd6f-4c9f-be64-2a56396cf8f3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.252522 Sep 10 10:51:36.051187 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2642/3148] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:35 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:36.189744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-746e1cdd-6953-423e-8881-8290217493ae tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:36.190437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-746e1cdd-6953-423e-8881-8290217493ae tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:36.197220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-746e1cdd-6953-423e-8881-8290217493ae tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:36.197718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-746e1cdd-6953-423e-8881-8290217493ae tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:36.198170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-746e1cdd-6953-423e-8881-8290217493ae tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:36.199226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-746e1cdd-6953-423e-8881-8290217493ae tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:36.199791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-746e1cdd-6953-423e-8881-8290217493ae tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:36.200279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-746e1cdd-6953-423e-8881-8290217493ae tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:36.356207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-746e1cdd-6953-423e-8881-8290217493ae tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:36.364261 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-746e1cdd-6953-423e-8881-8290217493ae tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1314 microversion: 2.1 time: 0.178521 Sep 10 10:51:36.364966 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2643/3149] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:36 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:36.424406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86d9840c-6936-4bab-905e-316eebac374f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:36.425558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86d9840c-6936-4bab-905e-316eebac374f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:36.433628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86d9840c-6936-4bab-905e-316eebac374f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:36.434742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86d9840c-6936-4bab-905e-316eebac374f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:36.435253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86d9840c-6936-4bab-905e-316eebac374f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:36.436032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86d9840c-6936-4bab-905e-316eebac374f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:36.436844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86d9840c-6936-4bab-905e-316eebac374f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:36.437371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86d9840c-6936-4bab-905e-316eebac374f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:36.731809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-86d9840c-6936-4bab-905e-316eebac374f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:36.745644 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86d9840c-6936-4bab-905e-316eebac374f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1316 microversion: 2.1 time: 0.325997 Sep 10 10:51:36.746832 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2644/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:36 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:36.752719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:36.753617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:36.761945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:36.763118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:36.763914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:36.765735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:36.769669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:36.770441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:36.863524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:36.875515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:36.877380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:36.879373 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36b15870-103d-4ae1-844e-c97f73760860 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.130371 Sep 10 10:51:36.894015 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2645/3151] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:36 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:37.075308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85425db9-ffd0-439c-bbab-aabef7a28d97 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:37.075922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-85425db9-ffd0-439c-bbab-aabef7a28d97 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:37.091204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85425db9-ffd0-439c-bbab-aabef7a28d97 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:37.091704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85425db9-ffd0-439c-bbab-aabef7a28d97 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:37.092142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85425db9-ffd0-439c-bbab-aabef7a28d97 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:37.099617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85425db9-ffd0-439c-bbab-aabef7a28d97 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:37.101283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85425db9-ffd0-439c-bbab-aabef7a28d97 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:37.108242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85425db9-ffd0-439c-bbab-aabef7a28d97 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:37.321359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-85425db9-ffd0-439c-bbab-aabef7a28d97 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:37.331623 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85425db9-ffd0-439c-bbab-aabef7a28d97 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.259803 Sep 10 10:51:37.341976 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2646/3152] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:37 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:37.387808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b3d4b276-6571-4e94-99f9-de5b5048787f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:37.388454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b3d4b276-6571-4e94-99f9-de5b5048787f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:37.394783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3d4b276-6571-4e94-99f9-de5b5048787f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:37.395288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3d4b276-6571-4e94-99f9-de5b5048787f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:37.395735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3d4b276-6571-4e94-99f9-de5b5048787f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:37.396984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3d4b276-6571-4e94-99f9-de5b5048787f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:37.397694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3d4b276-6571-4e94-99f9-de5b5048787f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:37.398130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3d4b276-6571-4e94-99f9-de5b5048787f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:37.555815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b3d4b276-6571-4e94-99f9-de5b5048787f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:37.570203 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b3d4b276-6571-4e94-99f9-de5b5048787f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1314 microversion: 2.1 time: 0.186230 Sep 10 10:51:37.570981 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2647/3153] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:37 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:37.769574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-884e67a4-7b0f-40c6-badd-802f8006dba0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:37.770883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-884e67a4-7b0f-40c6-badd-802f8006dba0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:37.778509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-884e67a4-7b0f-40c6-badd-802f8006dba0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:37.779175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-884e67a4-7b0f-40c6-badd-802f8006dba0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:37.780091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-884e67a4-7b0f-40c6-badd-802f8006dba0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:37.781042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-884e67a4-7b0f-40c6-badd-802f8006dba0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:37.781628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-884e67a4-7b0f-40c6-badd-802f8006dba0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:37.782260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-884e67a4-7b0f-40c6-badd-802f8006dba0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:37.940311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-884e67a4-7b0f-40c6-badd-802f8006dba0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:37.951301 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-884e67a4-7b0f-40c6-badd-802f8006dba0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1316 microversion: 2.1 time: 0.185306 Sep 10 10:51:37.952722 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2648/3154] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:37 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:37.968909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:37.970489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:37.983859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:37.984360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:37.984857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:37.985714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:37.986287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:37.987533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:38.069656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:38.080202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:38.085968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:38.089551 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d05d5c4-b617-424c-95e7-6db1e83231bd tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.132639 Sep 10 10:51:38.093360 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2649/3155] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:37 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:38.358705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea654b83-b3cf-419f-8c13-28151a74ad6f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:38.359569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea654b83-b3cf-419f-8c13-28151a74ad6f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:38.366617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea654b83-b3cf-419f-8c13-28151a74ad6f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:38.367325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea654b83-b3cf-419f-8c13-28151a74ad6f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:38.367906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea654b83-b3cf-419f-8c13-28151a74ad6f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:38.368605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea654b83-b3cf-419f-8c13-28151a74ad6f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:38.369058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea654b83-b3cf-419f-8c13-28151a74ad6f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:38.369502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea654b83-b3cf-419f-8c13-28151a74ad6f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:38.542868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ea654b83-b3cf-419f-8c13-28151a74ad6f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:38.550787 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea654b83-b3cf-419f-8c13-28151a74ad6f tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.198243 Sep 10 10:51:38.551569 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2650/3156] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:38 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:38.726857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1596060204", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": "none"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:38.789230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:51:38.789854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:51:38.790255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:51:38.790741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:51:38.791163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:51:38.801284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:38.801898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:38.802415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:38.803303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:38.803832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:38.804331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:38.823700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Getting quotas for project 8fab1dae5be24863bf66fd45d2fd08db. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:51:38.829304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Getting quotas for user bf1180445cc14a1e8c18f1b07a0e1039 and project 8fab1dae5be24863bf66fd45d2fd08db. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:51:38.843071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:51:38.845800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:51:38.891260 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-804d6ae1-90b4-4b1a-bc53-7674d6bb6a64 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.338753 Sep 10 10:51:38.898917 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2651/3157] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 10:51:38.902799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ff11d4d-8ea8-4084-b3ac-d2651b348ded tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:38.903479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ff11d4d-8ea8-4084-b3ac-d2651b348ded tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:38.910342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff11d4d-8ea8-4084-b3ac-d2651b348ded tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:38.910830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff11d4d-8ea8-4084-b3ac-d2651b348ded tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:38.911270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff11d4d-8ea8-4084-b3ac-d2651b348ded tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:38.912573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff11d4d-8ea8-4084-b3ac-d2651b348ded tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:38.913303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff11d4d-8ea8-4084-b3ac-d2651b348ded tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:38.913508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff11d4d-8ea8-4084-b3ac-d2651b348ded tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:38.919786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:39.067432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ff11d4d-8ea8-4084-b3ac-d2651b348ded tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:39.075701 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ff11d4d-8ea8-4084-b3ac-d2651b348ded tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1501 microversion: 2.1 time: 0.182632 Sep 10 10:51:39.076286 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2652/3158] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:38 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:39.086470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7e325165-5d4a-4d70-bb8a-33defa30b6e6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:39.087295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e325165-5d4a-4d70-bb8a-33defa30b6e6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:39.093671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:39.154573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e325165-5d4a-4d70-bb8a-33defa30b6e6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:39.163350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e325165-5d4a-4d70-bb8a-33defa30b6e6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:39.165057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e325165-5d4a-4d70-bb8a-33defa30b6e6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:39.172291 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7e325165-5d4a-4d70-bb8a-33defa30b6e6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1454 microversion: 2.91 time: 0.094518 Sep 10 10:51:39.173614 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2653/3159] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:39 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:39.178452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e84de55b-002c-4d78-ab09-557cb3c4e24e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:39.179212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e84de55b-002c-4d78-ab09-557cb3c4e24e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:39.195612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e84de55b-002c-4d78-ab09-557cb3c4e24e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:39.196670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e84de55b-002c-4d78-ab09-557cb3c4e24e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:39.197140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e84de55b-002c-4d78-ab09-557cb3c4e24e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:39.197965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e84de55b-002c-4d78-ab09-557cb3c4e24e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:39.198422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e84de55b-002c-4d78-ab09-557cb3c4e24e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:39.198845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e84de55b-002c-4d78-ab09-557cb3c4e24e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:39.367933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e84de55b-002c-4d78-ab09-557cb3c4e24e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:39.380786 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e84de55b-002c-4d78-ab09-557cb3c4e24e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1316 microversion: 2.1 time: 0.205763 Sep 10 10:51:39.381635 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2654/3160] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:39 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:39.386912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37c6181a-6c7b-459b-b977-9f5d31e020c6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:39.393471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37c6181a-6c7b-459b-b977-9f5d31e020c6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:39.393958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37c6181a-6c7b-459b-b977-9f5d31e020c6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:39.394391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37c6181a-6c7b-459b-b977-9f5d31e020c6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:39.422810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-37c6181a-6c7b-459b-b977-9f5d31e020c6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Going to try to stop instance {{(pid=128788) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 10:51:39.495778 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-37c6181a-6c7b-459b-b977-9f5d31e020c6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645/action" status: 202 len: 0 microversion: 2.1 time: 0.112666 Sep 10 10:51:39.502081 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2655/3161] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:51:39 2022] POST /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:39.507319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:39.509224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:39.522486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:39.523679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:39.524144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:39.524846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:39.525329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:39.525758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:39.599302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:39.611016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:39.612464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:39.613805 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2cd9f99-f618-4ef4-bda4-309cd124bbe5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.112209 Sep 10 10:51:39.629096 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2656/3162] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:39 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:39.629096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ff26590-f952-463d-926b-4772f15ac94c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:39.629096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ff26590-f952-463d-926b-4772f15ac94c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:39.629096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff26590-f952-463d-926b-4772f15ac94c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:39.629096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff26590-f952-463d-926b-4772f15ac94c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:39.629096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff26590-f952-463d-926b-4772f15ac94c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:39.629096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff26590-f952-463d-926b-4772f15ac94c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:39.629096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff26590-f952-463d-926b-4772f15ac94c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:39.629096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff26590-f952-463d-926b-4772f15ac94c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:39.800421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ff26590-f952-463d-926b-4772f15ac94c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:39.809307 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ff26590-f952-463d-926b-4772f15ac94c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.192813 Sep 10 10:51:39.809898 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2657/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:39 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:39.815503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d25899b-06de-492d-a633-c26ed57a1774 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:39.816118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d25899b-06de-492d-a633-c26ed57a1774 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:39.823381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d25899b-06de-492d-a633-c26ed57a1774 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:39.823871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d25899b-06de-492d-a633-c26ed57a1774 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:39.824307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d25899b-06de-492d-a633-c26ed57a1774 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:39.825003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d25899b-06de-492d-a633-c26ed57a1774 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:39.825605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d25899b-06de-492d-a633-c26ed57a1774 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:39.826132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d25899b-06de-492d-a633-c26ed57a1774 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:40.060762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d25899b-06de-492d-a633-c26ed57a1774 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:40.069766 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d25899b-06de-492d-a633-c26ed57a1774 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.258728 Sep 10 10:51:40.081570 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2658/3164] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:39 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:40.199831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:40.200476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:40.206441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:40.206930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:40.207368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:40.208056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:40.208512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:40.208977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:40.284305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:40.294433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:40.295929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:40.302052 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-54dbf1cf-698e-496b-b626-5c990be8cbff tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1506 microversion: 2.91 time: 0.105995 Sep 10 10:51:40.302691 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2659/3165] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:40 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1506 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:51:40.405408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ad4bc02-91f0-470b-b1b6-88e27a41cede tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:40.406090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ad4bc02-91f0-470b-b1b6-88e27a41cede tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:40.412778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ad4bc02-91f0-470b-b1b6-88e27a41cede tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:40.413315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ad4bc02-91f0-470b-b1b6-88e27a41cede tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:40.413750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ad4bc02-91f0-470b-b1b6-88e27a41cede tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:40.414437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ad4bc02-91f0-470b-b1b6-88e27a41cede tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:40.414885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ad4bc02-91f0-470b-b1b6-88e27a41cede tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:40.415302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ad4bc02-91f0-470b-b1b6-88e27a41cede tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:40.557310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5ad4bc02-91f0-470b-b1b6-88e27a41cede tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:40.566586 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ad4bc02-91f0-470b-b1b6-88e27a41cede tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1316 microversion: 2.1 time: 0.165158 Sep 10 10:51:40.567366 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2660/3166] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:40 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:40.643680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:40.644303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:40.651602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:40.652099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:40.652539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:40.653274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:40.653942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:40.655070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:40.731376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:40.740594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:40.743118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:40.744346 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bbd905ba-1520-491f-a09b-84989bd76bb5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.105696 Sep 10 10:51:40.744968 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2661/3167] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:40 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:51:40.831994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a48963e-805e-479b-9b75-6c8751529665 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:40.832617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1a48963e-805e-479b-9b75-6c8751529665 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:40.839900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a48963e-805e-479b-9b75-6c8751529665 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:40.840470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a48963e-805e-479b-9b75-6c8751529665 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:40.840917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a48963e-805e-479b-9b75-6c8751529665 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:40.841652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a48963e-805e-479b-9b75-6c8751529665 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:40.842117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a48963e-805e-479b-9b75-6c8751529665 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:40.842550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a48963e-805e-479b-9b75-6c8751529665 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:40.982636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1a48963e-805e-479b-9b75-6c8751529665 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:40.991387 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a48963e-805e-479b-9b75-6c8751529665 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.163188 Sep 10 10:51:40.991979 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2662/3168] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:40 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:41.097486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf8bc6a6-ceb8-438c-b59c-f663c2aa146e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:41.098064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bf8bc6a6-ceb8-438c-b59c-f663c2aa146e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:41.104418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf8bc6a6-ceb8-438c-b59c-f663c2aa146e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:41.104958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf8bc6a6-ceb8-438c-b59c-f663c2aa146e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:41.105403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf8bc6a6-ceb8-438c-b59c-f663c2aa146e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:41.106100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf8bc6a6-ceb8-438c-b59c-f663c2aa146e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:41.106558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf8bc6a6-ceb8-438c-b59c-f663c2aa146e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:41.106985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf8bc6a6-ceb8-438c-b59c-f663c2aa146e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:41.245763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bf8bc6a6-ceb8-438c-b59c-f663c2aa146e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:41.255780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf8bc6a6-ceb8-438c-b59c-f663c2aa146e tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.162320 Sep 10 10:51:41.256588 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2663/3169] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:41 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:41.329679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:41.330647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:41.338714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:41.339448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:41.340515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:41.341679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:41.342534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:41.343354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:41.435719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:41.447337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:41.449415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:41.456817 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bede44c6-3d27-4290-ae58-e33839eefd66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1512 microversion: 2.91 time: 0.130792 Sep 10 10:51:41.465675 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2664/3170] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:41 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1512 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:51:41.490652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1630146b-27cc-4ca4-b3db-9946988554ba req-34843ab7-e9f4-4ca3-8763-c2a4cc19aa80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2bfc6ba-e6cf-4263-b70c-e21afd2fe828", "name": "network-vif-plugged", "status": "completed", "tag": "e7c3aa12-f8f1-4dc6-80d9-9122ec45c547"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:41.503103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1630146b-27cc-4ca4-b3db-9946988554ba req-34843ab7-e9f4-4ca3-8763-c2a4cc19aa80 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:41.503596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1630146b-27cc-4ca4-b3db-9946988554ba req-34843ab7-e9f4-4ca3-8763-c2a4cc19aa80 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:41.504183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1630146b-27cc-4ca4-b3db-9946988554ba req-34843ab7-e9f4-4ca3-8763-c2a4cc19aa80 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:41.517152 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1630146b-27cc-4ca4-b3db-9946988554ba req-34843ab7-e9f4-4ca3-8763-c2a4cc19aa80 service nova] Creating event network-vif-plugged:e7c3aa12-f8f1-4dc6-80d9-9122ec45c547 for instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 on n-h2-856894-1 Sep 10 10:51:41.522143 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1630146b-27cc-4ca4-b3db-9946988554ba req-34843ab7-e9f4-4ca3-8763-c2a4cc19aa80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035874 Sep 10 10:51:41.522910 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2665/3171] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:41.592691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec3de305-860e-422f-84e0-721ec3fe2a68 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:41.593559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec3de305-860e-422f-84e0-721ec3fe2a68 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:41.601168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec3de305-860e-422f-84e0-721ec3fe2a68 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:41.601792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec3de305-860e-422f-84e0-721ec3fe2a68 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:41.602304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec3de305-860e-422f-84e0-721ec3fe2a68 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:41.603098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec3de305-860e-422f-84e0-721ec3fe2a68 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:41.603625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec3de305-860e-422f-84e0-721ec3fe2a68 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:41.604125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec3de305-860e-422f-84e0-721ec3fe2a68 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:41.767839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec3de305-860e-422f-84e0-721ec3fe2a68 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:41.776585 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec3de305-860e-422f-84e0-721ec3fe2a68 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1316 microversion: 2.1 time: 0.188180 Sep 10 10:51:41.781236 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2666/3172] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:41 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:41.786080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:41.787051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:41.794952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:41.795436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:41.795869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:41.796559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:41.797006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:41.797564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:41.873798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:41.882559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:41.884192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:41.886050 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb491bd0-8ca2-4605-883f-a34b69a7abbc tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.107810 Sep 10 10:51:41.886865 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2667/3173] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:41 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:42.017338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4f9e7f7-a5a9-48e1-a422-e18cf51ecb80 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:42.018072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4f9e7f7-a5a9-48e1-a422-e18cf51ecb80 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:42.027576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f9e7f7-a5a9-48e1-a422-e18cf51ecb80 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:42.028100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f9e7f7-a5a9-48e1-a422-e18cf51ecb80 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:42.028615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f9e7f7-a5a9-48e1-a422-e18cf51ecb80 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:42.029986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f9e7f7-a5a9-48e1-a422-e18cf51ecb80 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:42.030476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f9e7f7-a5a9-48e1-a422-e18cf51ecb80 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:42.030910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f9e7f7-a5a9-48e1-a422-e18cf51ecb80 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:42.219602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4f9e7f7-a5a9-48e1-a422-e18cf51ecb80 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:42.231647 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a4f9e7f7-a5a9-48e1-a422-e18cf51ecb80 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.218142 Sep 10 10:51:42.232652 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2668/3174] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:42 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:42.288945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0505f742-900b-4b73-8c25-73a316e0150b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:42.288945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0505f742-900b-4b73-8c25-73a316e0150b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:42.294349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0505f742-900b-4b73-8c25-73a316e0150b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:42.295165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0505f742-900b-4b73-8c25-73a316e0150b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:42.296677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0505f742-900b-4b73-8c25-73a316e0150b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:42.297673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0505f742-900b-4b73-8c25-73a316e0150b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:42.298329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0505f742-900b-4b73-8c25-73a316e0150b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:42.298966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0505f742-900b-4b73-8c25-73a316e0150b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:42.329959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:42.458153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0505f742-900b-4b73-8c25-73a316e0150b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:42.467005 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0505f742-900b-4b73-8c25-73a316e0150b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.190302 Sep 10 10:51:42.467783 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2669/3175] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:42 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:42.494831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:42.495539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:42.519922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:42.520425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:42.520949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:42.528071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:42.528850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:42.529588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:42.622177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:42.631257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:42.632712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:42.638209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a72a2926-78a6-473b-8c2c-352af913340b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1512 microversion: 2.91 time: 0.148788 Sep 10 10:51:42.640459 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2670/3176] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:42 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:51:42.799986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10f4b594-e615-42f1-8c56-5ce21a225f42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:42.800546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-10f4b594-e615-42f1-8c56-5ce21a225f42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:42.807032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10f4b594-e615-42f1-8c56-5ce21a225f42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:42.807512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10f4b594-e615-42f1-8c56-5ce21a225f42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:42.807948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10f4b594-e615-42f1-8c56-5ce21a225f42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:42.808632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10f4b594-e615-42f1-8c56-5ce21a225f42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:42.809095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10f4b594-e615-42f1-8c56-5ce21a225f42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:42.809525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10f4b594-e615-42f1-8c56-5ce21a225f42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:42.958125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-10f4b594-e615-42f1-8c56-5ce21a225f42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:42.966929 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10f4b594-e615-42f1-8c56-5ce21a225f42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1316 microversion: 2.1 time: 0.170797 Sep 10 10:51:42.968028 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2671/3177] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:42 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:42.972651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:42.973441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:42.984908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:42.985590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:42.986133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:42.987543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:42.987543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:42.988156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:43.055736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:43.064683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:43.066163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:43.067327 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7659397b-0b3f-46ad-b31e-dff3fc1a5ec0 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.098597 Sep 10 10:51:43.068641 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2672/3178] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:42 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:43.272619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c5a44c19-319d-422b-82ef-90234fe0cb7a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:43.276032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c5a44c19-319d-422b-82ef-90234fe0cb7a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:43.283433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5a44c19-319d-422b-82ef-90234fe0cb7a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:43.284046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5a44c19-319d-422b-82ef-90234fe0cb7a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:43.284581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5a44c19-319d-422b-82ef-90234fe0cb7a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:43.285384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5a44c19-319d-422b-82ef-90234fe0cb7a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:43.286044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5a44c19-319d-422b-82ef-90234fe0cb7a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:43.286535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5a44c19-319d-422b-82ef-90234fe0cb7a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:43.426807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5a44c19-319d-422b-82ef-90234fe0cb7a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:43.435662 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c5a44c19-319d-422b-82ef-90234fe0cb7a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.184848 Sep 10 10:51:43.436446 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2673/3179] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:43 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:43.492031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c4530490-3d42-45e4-913e-ea34435bb87b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:43.492810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4530490-3d42-45e4-913e-ea34435bb87b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:43.500389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4530490-3d42-45e4-913e-ea34435bb87b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:43.500899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4530490-3d42-45e4-913e-ea34435bb87b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:43.501371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4530490-3d42-45e4-913e-ea34435bb87b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:43.502148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4530490-3d42-45e4-913e-ea34435bb87b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:43.502552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4530490-3d42-45e4-913e-ea34435bb87b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:43.502977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4530490-3d42-45e4-913e-ea34435bb87b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:43.671335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c4530490-3d42-45e4-913e-ea34435bb87b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:43.683693 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c4530490-3d42-45e4-913e-ea34435bb87b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.195466 Sep 10 10:51:43.697096 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2674/3180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:43 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:43.697096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:43.697096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:43.697915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:43.700408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:43.700408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:43.700408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:43.700408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:43.700836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:43.788857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:43.798150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:43.799593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:43.808214 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05773bc8-dae4-4bf9-9cf7-28567c3502e0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1512 microversion: 2.91 time: 0.122290 Sep 10 10:51:43.809255 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2675/3181] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:43 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1512 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:43.990586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-70236677-a008-4a05-bc52-c02f2461fac7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:43.991249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-70236677-a008-4a05-bc52-c02f2461fac7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:43.998516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70236677-a008-4a05-bc52-c02f2461fac7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:43.999337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70236677-a008-4a05-bc52-c02f2461fac7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:43.999827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70236677-a008-4a05-bc52-c02f2461fac7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:44.000499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70236677-a008-4a05-bc52-c02f2461fac7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:44.000959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70236677-a008-4a05-bc52-c02f2461fac7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:44.001433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70236677-a008-4a05-bc52-c02f2461fac7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:44.204858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-70236677-a008-4a05-bc52-c02f2461fac7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:44.213331 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-70236677-a008-4a05-bc52-c02f2461fac7 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1316 microversion: 2.1 time: 0.227577 Sep 10 10:51:44.213922 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2676/3182] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:43 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:44.229399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:44.230022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:44.239615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:44.240547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:44.241390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:44.242596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:44.243544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:44.244497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:44.336139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:44.352098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:44.354073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:44.358391 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e04d40e-73ac-4322-9ffe-9ff163f9a36a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.141660 Sep 10 10:51:44.368837 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2677/3183] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:44 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:44.465095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e20a2ff2-fc51-4680-92fc-a10f748f8843 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:44.469864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e20a2ff2-fc51-4680-92fc-a10f748f8843 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:44.478299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20a2ff2-fc51-4680-92fc-a10f748f8843 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:44.479481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20a2ff2-fc51-4680-92fc-a10f748f8843 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:44.481218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20a2ff2-fc51-4680-92fc-a10f748f8843 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:44.482381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20a2ff2-fc51-4680-92fc-a10f748f8843 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:44.483371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20a2ff2-fc51-4680-92fc-a10f748f8843 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:44.484116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20a2ff2-fc51-4680-92fc-a10f748f8843 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:44.648623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e20a2ff2-fc51-4680-92fc-a10f748f8843 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:44.660640 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e20a2ff2-fc51-4680-92fc-a10f748f8843 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.205448 Sep 10 10:51:44.663057 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2678/3184] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:44 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:44.707893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23da3245-8f38-4d2a-8080-a3f726d4d6b2 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:44.708505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23da3245-8f38-4d2a-8080-a3f726d4d6b2 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:44.715316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23da3245-8f38-4d2a-8080-a3f726d4d6b2 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:44.715803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23da3245-8f38-4d2a-8080-a3f726d4d6b2 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:44.716243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23da3245-8f38-4d2a-8080-a3f726d4d6b2 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:44.716936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23da3245-8f38-4d2a-8080-a3f726d4d6b2 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:44.717413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23da3245-8f38-4d2a-8080-a3f726d4d6b2 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:44.717835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23da3245-8f38-4d2a-8080-a3f726d4d6b2 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:44.931697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23da3245-8f38-4d2a-8080-a3f726d4d6b2 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:44.945229 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23da3245-8f38-4d2a-8080-a3f726d4d6b2 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.241143 Sep 10 10:51:44.957500 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2679/3185] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:44 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:44.957500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:44.957500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:44.959341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:44.964004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:44.964004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:44.964004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:44.964004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:44.964004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.054504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:45.064739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:45.066395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:45.073629 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-937be15c-21de-43d5-8fd7-33a24c2cd556 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1533 microversion: 2.91 time: 0.126451 Sep 10 10:51:45.074439 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2680/3186] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:44 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1533 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:45.199409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-17a3c415-6ace-4007-85d9-7b493fdb0cf2 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:45.200050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-17a3c415-6ace-4007-85d9-7b493fdb0cf2 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:45.210275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17a3c415-6ace-4007-85d9-7b493fdb0cf2 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:45.210828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17a3c415-6ace-4007-85d9-7b493fdb0cf2 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:45.211920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17a3c415-6ace-4007-85d9-7b493fdb0cf2 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.213373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17a3c415-6ace-4007-85d9-7b493fdb0cf2 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:45.213933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17a3c415-6ace-4007-85d9-7b493fdb0cf2 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:45.214431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17a3c415-6ace-4007-85d9-7b493fdb0cf2 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.316458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-17a3c415-6ace-4007-85d9-7b493fdb0cf2 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lazy-loading 'services' on Instance uuid b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:45.341489 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-17a3c415-6ace-4007-85d9-7b493fdb0cf2 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1938 microversion: 2.91 time: 0.240023 Sep 10 10:51:45.342462 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2681/3187] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:45 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1938 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:45.347117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-13c0c47c-cb0e-4372-8930-b72de272d394 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:45.347883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-13c0c47c-cb0e-4372-8930-b72de272d394 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:45.355643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c0c47c-cb0e-4372-8930-b72de272d394 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:45.356132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c0c47c-cb0e-4372-8930-b72de272d394 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:45.356621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c0c47c-cb0e-4372-8930-b72de272d394 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.357355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c0c47c-cb0e-4372-8930-b72de272d394 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:45.357866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c0c47c-cb0e-4372-8930-b72de272d394 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:45.358391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13c0c47c-cb0e-4372-8930-b72de272d394 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.528507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-13c0c47c-cb0e-4372-8930-b72de272d394 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:45.539258 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-13c0c47c-cb0e-4372-8930-b72de272d394 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1504 microversion: 2.1 time: 0.195763 Sep 10 10:51:45.558934 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2682/3188] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:45 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:45.569323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d345d650-c491-4f18-83c9-6e8858d08d81 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:45.570110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d345d650-c491-4f18-83c9-6e8858d08d81 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:45.582474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d345d650-c491-4f18-83c9-6e8858d08d81 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:45.582982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d345d650-c491-4f18-83c9-6e8858d08d81 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:45.584144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d345d650-c491-4f18-83c9-6e8858d08d81 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.584865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d345d650-c491-4f18-83c9-6e8858d08d81 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:45.585523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d345d650-c491-4f18-83c9-6e8858d08d81 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:45.586088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d345d650-c491-4f18-83c9-6e8858d08d81 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.682458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d345d650-c491-4f18-83c9-6e8858d08d81 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lazy-loading 'services' on Instance uuid b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:45.709937 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d345d650-c491-4f18-83c9-6e8858d08d81 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1938 microversion: 2.91 time: 0.149719 Sep 10 10:51:45.732004 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2683/3189] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:45 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1938 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:45.733261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:45.733973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:45.745343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:45.746731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:45.747262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.748043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:45.748588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:45.749152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.853328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:45.863174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:45.864626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:45.866488 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-215f9f12-ab3d-4938-9f8f-a93221bc9c33 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.142830 Sep 10 10:51:45.867422 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2684/3190] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:45 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:45.872483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e90334bf-52f3-4aef-b642-fc9574e03bdf tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-561829746"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:45.873023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e90334bf-52f3-4aef-b642-fc9574e03bdf tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:45.889547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e90334bf-52f3-4aef-b642-fc9574e03bdf tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:45.890170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e90334bf-52f3-4aef-b642-fc9574e03bdf tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:45.890625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e90334bf-52f3-4aef-b642-fc9574e03bdf tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.891370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e90334bf-52f3-4aef-b642-fc9574e03bdf tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:45.891832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e90334bf-52f3-4aef-b642-fc9574e03bdf tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:45.892257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e90334bf-52f3-4aef-b642-fc9574e03bdf tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:45.913294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:46.066912 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.network.security_group_api [None req-e90334bf-52f3-4aef-b642-fc9574e03bdf tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Adding security group 6ef65047-ee2f-435f-b999-2051c119a595 to port e7c3aa12-f8f1-4dc6-80d9-9122ec45c547 Sep 10 10:51:46.446052 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e90334bf-52f3-4aef-b642-fc9574e03bdf tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828/action" status: 202 len: 0 microversion: 2.1 time: 0.577502 Sep 10 10:51:46.447440 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2685/3191] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:51:45 2022] POST /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:46.452726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-461dfce1-b372-4f52-9645-d2d22efc15a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:46.453926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-461dfce1-b372-4f52-9645-d2d22efc15a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:46.472040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461dfce1-b372-4f52-9645-d2d22efc15a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:46.472750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461dfce1-b372-4f52-9645-d2d22efc15a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:46.473501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461dfce1-b372-4f52-9645-d2d22efc15a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:46.475683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461dfce1-b372-4f52-9645-d2d22efc15a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:46.476311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461dfce1-b372-4f52-9645-d2d22efc15a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:46.476746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461dfce1-b372-4f52-9645-d2d22efc15a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:46.682611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-461dfce1-b372-4f52-9645-d2d22efc15a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:46.705523 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-461dfce1-b372-4f52-9645-d2d22efc15a5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.256760 Sep 10 10:51:46.706202 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2686/3192] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:46 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:46.726944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f461d40d-9543-4f84-8176-7cf359a11df3 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:46.732956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f461d40d-9543-4f84-8176-7cf359a11df3 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:46.733474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f461d40d-9543-4f84-8176-7cf359a11df3 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:46.733911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f461d40d-9543-4f84-8176-7cf359a11df3 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:46.734674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f461d40d-9543-4f84-8176-7cf359a11df3 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:46.735129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f461d40d-9543-4f84-8176-7cf359a11df3 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:46.735553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f461d40d-9543-4f84-8176-7cf359a11df3 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:46.761716 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f461d40d-9543-4f84-8176-7cf359a11df3 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.038978 Sep 10 10:51:46.769314 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2687/3193] 10.222.0.20 () {60 vars in 1217 bytes} [Sat Sep 10 10:51:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 10:51:46.774149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e55ec35-f5a5-407f-9983-148825befff9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:46.775161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e55ec35-f5a5-407f-9983-148825befff9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:46.781181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e55ec35-f5a5-407f-9983-148825befff9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:46.781666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e55ec35-f5a5-407f-9983-148825befff9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:46.782160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e55ec35-f5a5-407f-9983-148825befff9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:46.782994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e55ec35-f5a5-407f-9983-148825befff9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:46.783297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e55ec35-f5a5-407f-9983-148825befff9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:46.783716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e55ec35-f5a5-407f-9983-148825befff9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:46.988357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e55ec35-f5a5-407f-9983-148825befff9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:47.001618 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e55ec35-f5a5-407f-9983-148825befff9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.230987 Sep 10 10:51:47.004311 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2688/3194] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:46 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:47.011527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aea91e97-9a32-427c-9788-2da5f80b7b70 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcae2c3c10>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:47.142401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-aea91e97-9a32-427c-9788-2da5f80b7b70 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6ef65047-ee2f-435f-b999-2051c119a595 in use.", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:51:47.143111 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-aea91e97-9a32-427c-9788-2da5f80b7b70 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security Group 6ef65047-ee2f-435f-b999-2051c119a595 in use. Sep 10 10:51:47.143111 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-c007756d-1979-4400-8e7b-bc178499d6e6'] Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aea91e97-9a32-427c-9788-2da5f80b7b70 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/6ef65047-ee2f-435f-b999-2051c119a595 HTTP/1.1 Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: exception: Security Group 6ef65047-ee2f-435f-b999-2051c119a595 in use. Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-c007756d-1979-4400-8e7b-bc178499d6e6'] Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '6ef65047-ee2f-435f-b999-2051c119a595'} Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:51:47.145083 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6ef65047-ee2f-435f-b999-2051c119a595 in use. Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c007756d-1979-4400-8e7b-bc178499d6e6'] Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6ef65047-ee2f-435f-b999-2051c119a595 in use. Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c007756d-1979-4400-8e7b-bc178499d6e6'] Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6ef65047-ee2f-435f-b999-2051c119a595 in use. Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c007756d-1979-4400-8e7b-bc178499d6e6'] Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6ef65047-ee2f-435f-b999-2051c119a595 in use. Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c007756d-1979-4400-8e7b-bc178499d6e6'] Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aea91e97-9a32-427c-9788-2da5f80b7b70 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 400 to user: Security Group 6ef65047-ee2f-435f-b999-2051c119a595 in use. Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-c007756d-1979-4400-8e7b-bc178499d6e6'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aea91e97-9a32-427c-9788-2da5f80b7b70 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/6ef65047-ee2f-435f-b999-2051c119a595" status: 400 len: 185 microversion: 2.1 time: 0.141187 Sep 10 10:51:47.148515 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2689/3195] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:51:47 2022] DELETE /compute/v2.1/os-security-groups/6ef65047-ee2f-435f-b999-2051c119a595 => generated 185 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:51:47.153552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-65a95df4-5b2c-4540-a3e1-8c196ed9475b req-d677d16e-b2ec-437e-9f37-2f347c5ef6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2bfc6ba-e6cf-4263-b70c-e21afd2fe828", "tag": "e7c3aa12-f8f1-4dc6-80d9-9122ec45c547"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:47.167753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-65a95df4-5b2c-4540-a3e1-8c196ed9475b req-d677d16e-b2ec-437e-9f37-2f347c5ef6e9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.168344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-65a95df4-5b2c-4540-a3e1-8c196ed9475b req-d677d16e-b2ec-437e-9f37-2f347c5ef6e9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.168843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-65a95df4-5b2c-4540-a3e1-8c196ed9475b req-d677d16e-b2ec-437e-9f37-2f347c5ef6e9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:47.185360 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-65a95df4-5b2c-4540-a3e1-8c196ed9475b req-d677d16e-b2ec-437e-9f37-2f347c5ef6e9 service nova] Creating event network-changed:e7c3aa12-f8f1-4dc6-80d9-9122ec45c547 for instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 on n-h2-856894-1 Sep 10 10:51:47.193831 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-65a95df4-5b2c-4540-a3e1-8c196ed9475b req-d677d16e-b2ec-437e-9f37-2f347c5ef6e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043138 Sep 10 10:51:47.198252 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2690/3196] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:47.216571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4155592c-07d7-44bb-baac-ec01ac9ed3ae tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:47.217521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4155592c-07d7-44bb-baac-ec01ac9ed3ae tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:47.225666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4155592c-07d7-44bb-baac-ec01ac9ed3ae tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.226270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4155592c-07d7-44bb-baac-ec01ac9ed3ae tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.226944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4155592c-07d7-44bb-baac-ec01ac9ed3ae tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:47.227812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4155592c-07d7-44bb-baac-ec01ac9ed3ae tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.228481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4155592c-07d7-44bb-baac-ec01ac9ed3ae tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.228983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4155592c-07d7-44bb-baac-ec01ac9ed3ae tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:47.256337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4155592c-07d7-44bb-baac-ec01ac9ed3ae tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lazy-loading 'flavor' on Instance uuid b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:51:47.515847 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4155592c-07d7-44bb-baac-ec01ac9ed3ae tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "POST /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5/action" status: 202 len: 0 microversion: 2.91 time: 0.300854 Sep 10 10:51:47.521996 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2691/3197] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:51:47 2022] POST /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:51:47.524765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:47.525711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:47.549371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.549941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.550406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:47.551296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.551758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.553624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:47.651626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:47.661736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:47.663609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:47.673496 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7e3454c1-57df-4fd0-a07d-006806c0be5d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.153811 Sep 10 10:51:47.674637 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2692/3198] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:47 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:47.680329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-723b46c4-e9ff-4331-b72a-d546e9bc64b4 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:47.683023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-723b46c4-e9ff-4331-b72a-d546e9bc64b4 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:47.690420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723b46c4-e9ff-4331-b72a-d546e9bc64b4 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.691274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723b46c4-e9ff-4331-b72a-d546e9bc64b4 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.691992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723b46c4-e9ff-4331-b72a-d546e9bc64b4 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:47.693476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723b46c4-e9ff-4331-b72a-d546e9bc64b4 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.694275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723b46c4-e9ff-4331-b72a-d546e9bc64b4 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.694935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723b46c4-e9ff-4331-b72a-d546e9bc64b4 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:47.783738 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-723b46c4-e9ff-4331-b72a-d546e9bc64b4 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828/action" status: 202 len: 0 microversion: 2.1 time: 0.107484 Sep 10 10:51:47.787735 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2693/3199] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:51:47 2022] POST /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:47.792120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:47.792860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:47.796077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:47.801142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.801634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.802073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:47.803314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.803779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.804250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:47.882362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:47.890545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:47.892069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:47.899828 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50c4b959-94b2-48d2-99ae-dde391d78222 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.114136 Sep 10 10:51:47.901109 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2694/3200] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:47 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:47.907953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ebbfe82f-23ee-41dd-b2b1-3925d4d99c51 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:47.908582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ebbfe82f-23ee-41dd-b2b1-3925d4d99c51 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:47.930116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebbfe82f-23ee-41dd-b2b1-3925d4d99c51 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.930617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebbfe82f-23ee-41dd-b2b1-3925d4d99c51 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.931061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebbfe82f-23ee-41dd-b2b1-3925d4d99c51 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:47.931905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebbfe82f-23ee-41dd-b2b1-3925d4d99c51 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:47.932369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebbfe82f-23ee-41dd-b2b1-3925d4d99c51 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:47.932802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebbfe82f-23ee-41dd-b2b1-3925d4d99c51 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:48.100792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ebbfe82f-23ee-41dd-b2b1-3925d4d99c51 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:48.113205 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ebbfe82f-23ee-41dd-b2b1-3925d4d99c51 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.211303 Sep 10 10:51:48.113873 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2695/3201] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:47 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:48.119617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd74335a-5421-4615-8a17-af78e65d00ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:48.120370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd74335a-5421-4615-8a17-af78e65d00ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:48.135661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd74335a-5421-4615-8a17-af78e65d00ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:48.136980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd74335a-5421-4615-8a17-af78e65d00ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:48.137671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd74335a-5421-4615-8a17-af78e65d00ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:48.138395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd74335a-5421-4615-8a17-af78e65d00ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:48.138858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd74335a-5421-4615-8a17-af78e65d00ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:48.139437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd74335a-5421-4615-8a17-af78e65d00ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:48.313191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd74335a-5421-4615-8a17-af78e65d00ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:48.321859 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd74335a-5421-4615-8a17-af78e65d00ab tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1574 microversion: 2.1 time: 0.206744 Sep 10 10:51:48.323105 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2696/3202] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:48 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:48.328300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0ede07e9-13c5-4dfd-8e9a-ad6113e9fd40 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:48.328913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0ede07e9-13c5-4dfd-8e9a-ad6113e9fd40 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:48.335572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ede07e9-13c5-4dfd-8e9a-ad6113e9fd40 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:48.336216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ede07e9-13c5-4dfd-8e9a-ad6113e9fd40 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:48.336803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ede07e9-13c5-4dfd-8e9a-ad6113e9fd40 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:48.337708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ede07e9-13c5-4dfd-8e9a-ad6113e9fd40 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:48.338331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ede07e9-13c5-4dfd-8e9a-ad6113e9fd40 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:48.338915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ede07e9-13c5-4dfd-8e9a-ad6113e9fd40 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:48.485161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0ede07e9-13c5-4dfd-8e9a-ad6113e9fd40 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:48.496105 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0ede07e9-13c5-4dfd-8e9a-ad6113e9fd40 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.171708 Sep 10 10:51:48.497110 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2697/3203] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:48 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:48.702072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:48.702692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:48.709421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:48.709970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:48.710381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:48.711073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:48.711521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:48.711942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:48.796482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:48.808428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:48.810593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:48.811933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-54e2f053-f0d9-4cef-abe9-91b1fe0ed38d tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1408 microversion: 2.54 time: 0.113807 Sep 10 10:51:48.812541 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2698/3204] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:48 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1408 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:51:48.931795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:48.932599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:48.940840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:48.941445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:48.944692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:48.945470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:48.945949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:48.946392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:49.028272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:49.039186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:49.040819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:49.047774 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f38bea46-51a7-4de4-a68b-3390336c6d5d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.120960 Sep 10 10:51:49.048806 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2699/3205] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:48 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:51:49.147028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8b3817f-a27a-4953-813b-abf0abd42fd4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:49.147642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8b3817f-a27a-4953-813b-abf0abd42fd4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:49.158445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b3817f-a27a-4953-813b-abf0abd42fd4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:49.159037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b3817f-a27a-4953-813b-abf0abd42fd4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:49.161282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b3817f-a27a-4953-813b-abf0abd42fd4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:49.162691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b3817f-a27a-4953-813b-abf0abd42fd4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:49.163982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b3817f-a27a-4953-813b-abf0abd42fd4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:49.167367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b3817f-a27a-4953-813b-abf0abd42fd4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:49.168044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=19 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:49.395481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8b3817f-a27a-4953-813b-abf0abd42fd4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:49.403435 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8b3817f-a27a-4953-813b-abf0abd42fd4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.267621 Sep 10 10:51:49.404192 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2700/3206] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:49 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:49.416454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ec8e3cc-2d91-463b-a791-028bdc276d7f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:49.417539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ec8e3cc-2d91-463b-a791-028bdc276d7f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:49.424928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ec8e3cc-2d91-463b-a791-028bdc276d7f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:49.425535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ec8e3cc-2d91-463b-a791-028bdc276d7f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:49.426051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ec8e3cc-2d91-463b-a791-028bdc276d7f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:49.426905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ec8e3cc-2d91-463b-a791-028bdc276d7f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:49.428143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ec8e3cc-2d91-463b-a791-028bdc276d7f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:49.428586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ec8e3cc-2d91-463b-a791-028bdc276d7f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:49.604669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5ec8e3cc-2d91-463b-a791-028bdc276d7f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:49.608201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:49.614106 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ec8e3cc-2d91-463b-a791-028bdc276d7f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1574 microversion: 2.1 time: 0.208496 Sep 10 10:51:49.615307 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2701/3207] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:49 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1574 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:49.620664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eac43301-60ba-482b-8ea0-8eb3a9c8c760 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:49.621299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eac43301-60ba-482b-8ea0-8eb3a9c8c760 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:49.628696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eac43301-60ba-482b-8ea0-8eb3a9c8c760 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:49.629279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eac43301-60ba-482b-8ea0-8eb3a9c8c760 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:49.629716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eac43301-60ba-482b-8ea0-8eb3a9c8c760 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:49.630401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eac43301-60ba-482b-8ea0-8eb3a9c8c760 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:49.630848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eac43301-60ba-482b-8ea0-8eb3a9c8c760 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:49.631268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eac43301-60ba-482b-8ea0-8eb3a9c8c760 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:49.767196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eac43301-60ba-482b-8ea0-8eb3a9c8c760 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:49.774969 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eac43301-60ba-482b-8ea0-8eb3a9c8c760 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.158715 Sep 10 10:51:49.775545 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2702/3208] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:49 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:49.838537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:49.839236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:49.845258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:49.845744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:49.846177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:49.846861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:49.847311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:49.847744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:49.917103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:49.925484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:49.927056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:49.928847 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7063c7b5-07fc-429e-9721-1258dbdbd180 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1414 microversion: 2.54 time: 0.094907 Sep 10 10:51:49.929449 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2703/3209] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:49 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:51:50.097767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:50.098301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:50.105789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:50.106280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:50.106719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:50.107415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:50.107879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:50.108308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:50.195760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:50.204796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:50.206780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:50.217351 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b3ce4574-579b-489d-a292-fd926fa2f7f7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.123392 Sep 10 10:51:50.218399 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2704/3210] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:50 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:51:50.427545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5cec268c-bf93-4791-9ac7-305eb0f3bced tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:50.428226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5cec268c-bf93-4791-9ac7-305eb0f3bced tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:50.436064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cec268c-bf93-4791-9ac7-305eb0f3bced tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:50.436734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cec268c-bf93-4791-9ac7-305eb0f3bced tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:50.437202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cec268c-bf93-4791-9ac7-305eb0f3bced tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:50.437909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cec268c-bf93-4791-9ac7-305eb0f3bced tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:50.438488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cec268c-bf93-4791-9ac7-305eb0f3bced tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:50.438918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cec268c-bf93-4791-9ac7-305eb0f3bced tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:50.587548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5cec268c-bf93-4791-9ac7-305eb0f3bced tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:50.595877 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5cec268c-bf93-4791-9ac7-305eb0f3bced tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.172379 Sep 10 10:51:50.596674 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2705/3211] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:50 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:50.638142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d24a00b-14d4-45df-8e59-dd1f004c645d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:50.638827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d24a00b-14d4-45df-8e59-dd1f004c645d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:50.647432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d24a00b-14d4-45df-8e59-dd1f004c645d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:50.661409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d24a00b-14d4-45df-8e59-dd1f004c645d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:50.662599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d24a00b-14d4-45df-8e59-dd1f004c645d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:50.663897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d24a00b-14d4-45df-8e59-dd1f004c645d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:50.665575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d24a00b-14d4-45df-8e59-dd1f004c645d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:50.668322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d24a00b-14d4-45df-8e59-dd1f004c645d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:50.986421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d24a00b-14d4-45df-8e59-dd1f004c645d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:50.995321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d24a00b-14d4-45df-8e59-dd1f004c645d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1574 microversion: 2.1 time: 0.360971 Sep 10 10:51:50.996156 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2706/3212] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:50 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1574 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:51.012431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d5dce45-7338-42ff-86f3-82d96f6a0694 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:51.013250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d5dce45-7338-42ff-86f3-82d96f6a0694 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:51.022552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d5dce45-7338-42ff-86f3-82d96f6a0694 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:51.024483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d5dce45-7338-42ff-86f3-82d96f6a0694 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:51.025052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d5dce45-7338-42ff-86f3-82d96f6a0694 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:51.026343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d5dce45-7338-42ff-86f3-82d96f6a0694 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:51.026911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d5dce45-7338-42ff-86f3-82d96f6a0694 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:51.027474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d5dce45-7338-42ff-86f3-82d96f6a0694 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:51.199466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d5dce45-7338-42ff-86f3-82d96f6a0694 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:51.208055 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d5dce45-7338-42ff-86f3-82d96f6a0694 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.202387 Sep 10 10:51:51.208955 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2707/3213] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:50 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:51.220577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:51.221468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:51.229092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:51.229669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:51.230232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:51.230936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:51.231385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:51.231809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:51.306812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:51.315420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:51.316957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:51.318913 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2dfcabdc-b25d-474f-8000-b2e8ea057ab1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1414 microversion: 2.54 time: 0.102857 Sep 10 10:51:51.319571 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2708/3214] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:51 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:51.324381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:51.325302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:51.332061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:51.332876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:51.333653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:51.334584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:51.335237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:51.335851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:51.411127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:51.420092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:51.421561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:51.426993 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74a590fc-12c6-4859-89eb-ec3ebb7cd49d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.106243 Sep 10 10:51:51.428416 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2709/3215] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:51 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:51.620427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-03d81e17-6ace-4227-8a86-706ef25513b7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:51.621315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-03d81e17-6ace-4227-8a86-706ef25513b7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:51.627786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03d81e17-6ace-4227-8a86-706ef25513b7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:51.628518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03d81e17-6ace-4227-8a86-706ef25513b7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:51.629106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03d81e17-6ace-4227-8a86-706ef25513b7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:51.629952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03d81e17-6ace-4227-8a86-706ef25513b7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:51.631035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03d81e17-6ace-4227-8a86-706ef25513b7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:51.631607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03d81e17-6ace-4227-8a86-706ef25513b7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:51.904908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-03d81e17-6ace-4227-8a86-706ef25513b7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:51.917216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-03d81e17-6ace-4227-8a86-706ef25513b7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.299317 Sep 10 10:51:51.917944 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2710/3216] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:51 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:52.019832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10b4ad3c-3a71-4e25-8da9-5e71358904e3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:52.020880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-10b4ad3c-3a71-4e25-8da9-5e71358904e3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:52.027718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10b4ad3c-3a71-4e25-8da9-5e71358904e3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:52.028426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10b4ad3c-3a71-4e25-8da9-5e71358904e3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:52.028881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10b4ad3c-3a71-4e25-8da9-5e71358904e3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:52.030070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10b4ad3c-3a71-4e25-8da9-5e71358904e3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:52.030746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10b4ad3c-3a71-4e25-8da9-5e71358904e3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:52.031438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10b4ad3c-3a71-4e25-8da9-5e71358904e3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:52.332741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-10b4ad3c-3a71-4e25-8da9-5e71358904e3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:52.342614 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10b4ad3c-3a71-4e25-8da9-5e71358904e3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1574 microversion: 2.1 time: 0.327543 Sep 10 10:51:52.343147 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2711/3217] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:52 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1574 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:52.356840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2bc7892e-0ef7-44b6-93d2-5771ee1da43b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:52.357679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2bc7892e-0ef7-44b6-93d2-5771ee1da43b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:52.363980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc7892e-0ef7-44b6-93d2-5771ee1da43b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:52.364466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc7892e-0ef7-44b6-93d2-5771ee1da43b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:52.365655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc7892e-0ef7-44b6-93d2-5771ee1da43b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:52.366358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc7892e-0ef7-44b6-93d2-5771ee1da43b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:52.366815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc7892e-0ef7-44b6-93d2-5771ee1da43b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:52.367259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bc7892e-0ef7-44b6-93d2-5771ee1da43b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:52.576015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2bc7892e-0ef7-44b6-93d2-5771ee1da43b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:52.586391 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2bc7892e-0ef7-44b6-93d2-5771ee1da43b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.235864 Sep 10 10:51:52.587078 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2712/3218] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:52 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:52.591957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:52.592673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:52.598654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:52.599888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:52.600325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:52.601012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:52.601603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:52.602389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:52.668862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:52.683180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:52.684823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:52.686438 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93b02720-b959-432c-a587-7681982c97f1 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1399 microversion: 2.54 time: 0.098213 Sep 10 10:51:52.687324 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2713/3219] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:52 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1399 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:52.692173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:52.693479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:52.707909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:52.709859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:52.710474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:52.711156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:52.711618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:52.712102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:52.806809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:52.821368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:52.823335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:52.829837 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2ca3e3e-2aab-4ee7-ae90-2182d92148c7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.141488 Sep 10 10:51:52.841745 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2714/3220] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:52 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:52.847799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ecb6a734-bfae-4a64-a63f-b0e936855952 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '.version_select at 0x7efcae386af0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:52.872863 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ecb6a734-bfae-4a64-a63f-b0e936855952 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-360434032" status: 204 len: 0 microversion: 2.54 time: 0.029891 Sep 10 10:51:52.873547 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2715/3221] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Sep 10 10:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-360434032 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:51:52.887603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-695c3c5c-9393-4387-9a21-626cec9393e5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:52.888119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-695c3c5c-9393-4387-9a21-626cec9393e5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:52.894997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695c3c5c-9393-4387-9a21-626cec9393e5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:52.895566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695c3c5c-9393-4387-9a21-626cec9393e5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:52.896040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695c3c5c-9393-4387-9a21-626cec9393e5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:52.896919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695c3c5c-9393-4387-9a21-626cec9393e5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:52.899046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695c3c5c-9393-4387-9a21-626cec9393e5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:52.899518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-695c3c5c-9393-4387-9a21-626cec9393e5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:52.958330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-695c3c5c-9393-4387-9a21-626cec9393e5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:51:53.113370 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-695c3c5c-9393-4387-9a21-626cec9393e5 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 204 len: 0 microversion: 2.54 time: 0.231579 Sep 10 10:51:53.115821 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2716/3222] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:51:52 2022] DELETE /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:51:53.124333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8534740c-6b71-470f-8a8d-e101affe42d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:53.127808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8534740c-6b71-470f-8a8d-e101affe42d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:53.133745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8534740c-6b71-470f-8a8d-e101affe42d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:53.134280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8534740c-6b71-470f-8a8d-e101affe42d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:53.134838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8534740c-6b71-470f-8a8d-e101affe42d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:53.135992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8534740c-6b71-470f-8a8d-e101affe42d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:53.136615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8534740c-6b71-470f-8a8d-e101affe42d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:53.137205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8534740c-6b71-470f-8a8d-e101affe42d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:53.354371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8534740c-6b71-470f-8a8d-e101affe42d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:53.361591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:53.368202 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8534740c-6b71-470f-8a8d-e101affe42d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.252215 Sep 10 10:51:53.369638 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2717/3223] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:53 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:53.375147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:53.375822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:53.383092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:53.383748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:53.384339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:53.385729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:53.386324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:53.386938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:53.461191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:53.469934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:53.471631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:53.472929 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c473211-adcb-45a6-b01e-f17e4ba01601 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1405 microversion: 2.54 time: 0.102116 Sep 10 10:51:53.479482 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2718/3224] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:53 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:53.488826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1d82cee9-c503-4a8e-8256-d20ed8def64c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:53.490259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1d82cee9-c503-4a8e-8256-d20ed8def64c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:53.496812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d82cee9-c503-4a8e-8256-d20ed8def64c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:53.497521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d82cee9-c503-4a8e-8256-d20ed8def64c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:53.497962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d82cee9-c503-4a8e-8256-d20ed8def64c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:53.498836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d82cee9-c503-4a8e-8256-d20ed8def64c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:53.499295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d82cee9-c503-4a8e-8256-d20ed8def64c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:53.499852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d82cee9-c503-4a8e-8256-d20ed8def64c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:53.678811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1d82cee9-c503-4a8e-8256-d20ed8def64c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:53.688014 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1d82cee9-c503-4a8e-8256-d20ed8def64c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1579 microversion: 2.1 time: 0.206923 Sep 10 10:51:53.688963 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2719/3225] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:53 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1579 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:53.705423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2bea3b0e-5588-46c1-995d-787a347ae779 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:53.706263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2bea3b0e-5588-46c1-995d-787a347ae779 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:53.713433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bea3b0e-5588-46c1-995d-787a347ae779 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:53.714139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bea3b0e-5588-46c1-995d-787a347ae779 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:53.714658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bea3b0e-5588-46c1-995d-787a347ae779 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:53.715495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bea3b0e-5588-46c1-995d-787a347ae779 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:53.716034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bea3b0e-5588-46c1-995d-787a347ae779 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:53.716608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bea3b0e-5588-46c1-995d-787a347ae779 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:53.877687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2bea3b0e-5588-46c1-995d-787a347ae779 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:53.886406 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2bea3b0e-5588-46c1-995d-787a347ae779 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1516 microversion: 2.1 time: 0.186146 Sep 10 10:51:53.887154 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2720/3226] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:53 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:53.891840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:53.892439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:53.902433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:53.902958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:53.903410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:53.904111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:53.904835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:53.905304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:53.985462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:54.001482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:54.003940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:54.010085 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dc3d0f91-e5cd-4906-8351-cba8838c31e7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.121937 Sep 10 10:51:54.013211 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2721/3227] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:53 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:54.395959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c781c04-aa8d-4a41-9d46-72c6ae4a95e0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:54.396673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c781c04-aa8d-4a41-9d46-72c6ae4a95e0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:54.405494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c781c04-aa8d-4a41-9d46-72c6ae4a95e0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:54.406231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c781c04-aa8d-4a41-9d46-72c6ae4a95e0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:54.406763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c781c04-aa8d-4a41-9d46-72c6ae4a95e0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:54.407531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c781c04-aa8d-4a41-9d46-72c6ae4a95e0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:54.408049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c781c04-aa8d-4a41-9d46-72c6ae4a95e0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:54.408536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c781c04-aa8d-4a41-9d46-72c6ae4a95e0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:54.672730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3c781c04-aa8d-4a41-9d46-72c6ae4a95e0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:54.681201 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c781c04-aa8d-4a41-9d46-72c6ae4a95e0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.290821 Sep 10 10:51:54.681842 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2722/3228] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:54 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:54.693227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:54.694072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:54.701305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:54.701972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:54.702586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:54.703437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:54.704040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:54.704613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:54.818223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:54.832059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:54.836211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:54.837722 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b4d1688-a3e8-445d-a238-8dfc423f300e tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1405 microversion: 2.54 time: 0.154978 Sep 10 10:51:54.838794 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2723/3229] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:54 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:54.844154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa73b32d-51f5-469a-bc99-3331ea55ebe0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:54.844933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa73b32d-51f5-469a-bc99-3331ea55ebe0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:54.852273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa73b32d-51f5-469a-bc99-3331ea55ebe0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:54.852834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa73b32d-51f5-469a-bc99-3331ea55ebe0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:54.853432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa73b32d-51f5-469a-bc99-3331ea55ebe0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:54.855833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa73b32d-51f5-469a-bc99-3331ea55ebe0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:54.856558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa73b32d-51f5-469a-bc99-3331ea55ebe0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:54.857852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa73b32d-51f5-469a-bc99-3331ea55ebe0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:55.361759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fa73b32d-51f5-469a-bc99-3331ea55ebe0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:55.372609 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fa73b32d-51f5-469a-bc99-3331ea55ebe0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1572 microversion: 2.1 time: 0.532472 Sep 10 10:51:55.373215 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2724/3230] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:54 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1572 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:55.377985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8454644d-0ac1-4658-b3ef-1539fe1cc71a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:55.378593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8454644d-0ac1-4658-b3ef-1539fe1cc71a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:55.391013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8454644d-0ac1-4658-b3ef-1539fe1cc71a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:55.391513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8454644d-0ac1-4658-b3ef-1539fe1cc71a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:55.392176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8454644d-0ac1-4658-b3ef-1539fe1cc71a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:55.392881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8454644d-0ac1-4658-b3ef-1539fe1cc71a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:55.393364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8454644d-0ac1-4658-b3ef-1539fe1cc71a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:55.393794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8454644d-0ac1-4658-b3ef-1539fe1cc71a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:55.540942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8454644d-0ac1-4658-b3ef-1539fe1cc71a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:55.551778 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8454644d-0ac1-4658-b3ef-1539fe1cc71a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1522 microversion: 2.1 time: 0.177358 Sep 10 10:51:55.554059 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2725/3231] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:55 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:55.559023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:55.559639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:55.566048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:55.566729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:55.567360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:55.569317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:55.569924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:55.570491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:55.649606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:55.661761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:55.663221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:55.675043 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d8730108-b8ba-4002-b4dd-c69ce0361906 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.119632 Sep 10 10:51:55.675797 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2726/3232] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:55 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:55.680615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6f0b6b6-2cd8-41e0-903b-449f53b2cb42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1366370466"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:55.681309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d6f0b6b6-2cd8-41e0-903b-449f53b2cb42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:55.687584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f0b6b6-2cd8-41e0-903b-449f53b2cb42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:55.688131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f0b6b6-2cd8-41e0-903b-449f53b2cb42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:55.688716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f0b6b6-2cd8-41e0-903b-449f53b2cb42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:55.689475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f0b6b6-2cd8-41e0-903b-449f53b2cb42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:55.700413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f0b6b6-2cd8-41e0-903b-449f53b2cb42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:55.701287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6f0b6b6-2cd8-41e0-903b-449f53b2cb42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:55.846034 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.network.security_group_api [None req-d6f0b6b6-2cd8-41e0-903b-449f53b2cb42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Adding security group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 to port e7c3aa12-f8f1-4dc6-80d9-9122ec45c547 Sep 10 10:51:56.214055 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6f0b6b6-2cd8-41e0-903b-449f53b2cb42 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828/action" status: 202 len: 0 microversion: 2.1 time: 0.537111 Sep 10 10:51:56.217528 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2727/3233] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:51:55 2022] POST /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:51:56.223973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-20384574-d853-4780-bd95-c289bed981f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:56.225800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-20384574-d853-4780-bd95-c289bed981f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:56.241356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20384574-d853-4780-bd95-c289bed981f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:56.242384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20384574-d853-4780-bd95-c289bed981f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:56.242978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20384574-d853-4780-bd95-c289bed981f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:56.244347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20384574-d853-4780-bd95-c289bed981f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:56.245737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20384574-d853-4780-bd95-c289bed981f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:56.246332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20384574-d853-4780-bd95-c289bed981f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:56.437048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20384574-d853-4780-bd95-c289bed981f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:56.449213 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-20384574-d853-4780-bd95-c289bed981f5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.230254 Sep 10 10:51:56.449951 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2728/3234] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:56 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:56.454641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:56.455472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:56.463149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:56.463953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:56.464581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:56.465729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:56.466510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:56.467008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:56.565813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:56.577827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:56.580256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:56.582978 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a4ddc95d-01f4-413f-b84b-585d46cca565 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1405 microversion: 2.54 time: 0.131997 Sep 10 10:51:56.584121 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2729/3235] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:56 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:56.596963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36b9518b-c064-42c5-9bc7-54acaf89599c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcb2c07b80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:56.745325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:56.766576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-36b9518b-c064-42c5-9bc7-54acaf89599c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 in use.", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:51:56.767344 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-36b9518b-c064-42c5-9bc7-54acaf89599c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security Group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 in use. Sep 10 10:51:56.767344 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-e98658ff-c8ea-458f-9314-08ce5add0fa4'] Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36b9518b-c064-42c5-9bc7-54acaf89599c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/6d46a59d-7139-4b6e-ac7e-527c825c5c56 HTTP/1.1 Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: exception: Security Group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 in use. Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-e98658ff-c8ea-458f-9314-08ce5add0fa4'] Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '6d46a59d-7139-4b6e-ac7e-527c825c5c56'} Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:51:56.770689 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 in use. Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e98658ff-c8ea-458f-9314-08ce5add0fa4'] Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 in use. Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e98658ff-c8ea-458f-9314-08ce5add0fa4'] Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 in use. Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e98658ff-c8ea-458f-9314-08ce5add0fa4'] Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 in use. Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e98658ff-c8ea-458f-9314-08ce5add0fa4'] Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36b9518b-c064-42c5-9bc7-54acaf89599c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 400 to user: Security Group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 in use. Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-e98658ff-c8ea-458f-9314-08ce5add0fa4'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36b9518b-c064-42c5-9bc7-54acaf89599c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/6d46a59d-7139-4b6e-ac7e-527c825c5c56" status: 400 len: 185 microversion: 2.1 time: 0.185842 Sep 10 10:51:56.773836 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2730/3236] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:51:56 2022] DELETE /compute/v2.1/os-security-groups/6d46a59d-7139-4b6e-ac7e-527c825c5c56 => generated 185 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:51:56.783995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-44333ef8-92f0-487e-b0c3-18cd72d89fe5 req-6247dd29-9e0a-4158-a7c6-baf95778a261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2bfc6ba-e6cf-4263-b70c-e21afd2fe828", "tag": "e7c3aa12-f8f1-4dc6-80d9-9122ec45c547"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:51:56.805208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-44333ef8-92f0-487e-b0c3-18cd72d89fe5 req-6247dd29-9e0a-4158-a7c6-baf95778a261 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:56.805921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-44333ef8-92f0-487e-b0c3-18cd72d89fe5 req-6247dd29-9e0a-4158-a7c6-baf95778a261 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:56.806605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-44333ef8-92f0-487e-b0c3-18cd72d89fe5 req-6247dd29-9e0a-4158-a7c6-baf95778a261 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:56.819746 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-44333ef8-92f0-487e-b0c3-18cd72d89fe5 req-6247dd29-9e0a-4158-a7c6-baf95778a261 service nova] Creating event network-changed:e7c3aa12-f8f1-4dc6-80d9-9122ec45c547 for instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 on n-h2-856894-1 Sep 10 10:51:56.824825 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-44333ef8-92f0-487e-b0c3-18cd72d89fe5 req-6247dd29-9e0a-4158-a7c6-baf95778a261 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048202 Sep 10 10:51:56.825592 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2731/3237] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:51:56.831435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50c1ba4c-0ceb-4b84-b5eb-cd39c471b628 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:56.832237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50c1ba4c-0ceb-4b84-b5eb-cd39c471b628 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:56.839752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c1ba4c-0ceb-4b84-b5eb-cd39c471b628 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:56.840343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c1ba4c-0ceb-4b84-b5eb-cd39c471b628 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:56.840874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c1ba4c-0ceb-4b84-b5eb-cd39c471b628 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:56.841721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c1ba4c-0ceb-4b84-b5eb-cd39c471b628 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:56.842291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c1ba4c-0ceb-4b84-b5eb-cd39c471b628 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:56.842824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c1ba4c-0ceb-4b84-b5eb-cd39c471b628 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:56.995743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50c1ba4c-0ceb-4b84-b5eb-cd39c471b628 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:57.004253 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50c1ba4c-0ceb-4b84-b5eb-cd39c471b628 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1522 microversion: 2.1 time: 0.177423 Sep 10 10:51:57.004770 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2732/3238] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:56 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:57.009378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:57.010053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:57.016248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:57.016751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:57.017223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:57.018027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:57.018393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:57.018819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:57.090148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:57.099488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:57.100958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:57.105293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:57.108754 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-449014ad-6466-4aba-be9a-b0f4d34d9080 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.102893 Sep 10 10:51:57.109394 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2733/3239] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:57 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:57.114242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0ce639c-f4a0-446b-a3e2-45c3c513b63d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:57.114770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0ce639c-f4a0-446b-a3e2-45c3c513b63d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:57.120909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ce639c-f4a0-446b-a3e2-45c3c513b63d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:57.121429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ce639c-f4a0-446b-a3e2-45c3c513b63d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:57.121868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ce639c-f4a0-446b-a3e2-45c3c513b63d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:57.122567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ce639c-f4a0-446b-a3e2-45c3c513b63d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:57.123022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ce639c-f4a0-446b-a3e2-45c3c513b63d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:57.123447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0ce639c-f4a0-446b-a3e2-45c3c513b63d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:57.151602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0ce639c-f4a0-446b-a3e2-45c3c513b63d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:51:57.205978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:51:57.239345 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a0ce639c-f4a0-446b-a3e2-45c3c513b63d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 204 len: 0 microversion: 2.1 time: 0.128650 Sep 10 10:51:57.239961 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2734/3240] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:51:57 2022] DELETE /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:51:57.249160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-beed66b5-f947-45a4-8b07-806084430e34 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:57.250018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-beed66b5-f947-45a4-8b07-806084430e34 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:57.257102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beed66b5-f947-45a4-8b07-806084430e34 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:57.257702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beed66b5-f947-45a4-8b07-806084430e34 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:57.258249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beed66b5-f947-45a4-8b07-806084430e34 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:57.259049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beed66b5-f947-45a4-8b07-806084430e34 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:57.259693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beed66b5-f947-45a4-8b07-806084430e34 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:57.260323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-beed66b5-f947-45a4-8b07-806084430e34 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:57.440477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-beed66b5-f947-45a4-8b07-806084430e34 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:57.449576 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-beed66b5-f947-45a4-8b07-806084430e34 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1647 microversion: 2.1 time: 0.204551 Sep 10 10:51:57.450161 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2735/3241] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:57 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1647 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:57.474158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c4843f1f-babb-43ba-8a57-2111cb8111e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:57.474997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4843f1f-babb-43ba-8a57-2111cb8111e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:57.481257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4843f1f-babb-43ba-8a57-2111cb8111e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:57.481687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4843f1f-babb-43ba-8a57-2111cb8111e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:57.482127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4843f1f-babb-43ba-8a57-2111cb8111e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:57.482824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4843f1f-babb-43ba-8a57-2111cb8111e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:57.483281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4843f1f-babb-43ba-8a57-2111cb8111e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:57.483705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4843f1f-babb-43ba-8a57-2111cb8111e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:57.642104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c4843f1f-babb-43ba-8a57-2111cb8111e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:57.650577 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c4843f1f-babb-43ba-8a57-2111cb8111e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.180429 Sep 10 10:51:57.651262 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2736/3242] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:57 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:57.656125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:57.656870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:57.663149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:57.663624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:57.664052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:57.669131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:57.669131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:57.669131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:57.736890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:57.745215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:57.746693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:57.747849 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c749466c-801d-4ff0-9c23-2cb88f68fe4b tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1405 microversion: 2.54 time: 0.095672 Sep 10 10:51:57.748410 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2737/3243] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:57 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:58.031370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-564c43c4-9b03-49c4-b1ef-39b2dbda7a7c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:58.032625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-564c43c4-9b03-49c4-b1ef-39b2dbda7a7c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:58.041295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-564c43c4-9b03-49c4-b1ef-39b2dbda7a7c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:58.041588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-564c43c4-9b03-49c4-b1ef-39b2dbda7a7c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:58.042029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-564c43c4-9b03-49c4-b1ef-39b2dbda7a7c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:58.042781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-564c43c4-9b03-49c4-b1ef-39b2dbda7a7c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:58.043286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-564c43c4-9b03-49c4-b1ef-39b2dbda7a7c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:58.043774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-564c43c4-9b03-49c4-b1ef-39b2dbda7a7c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:58.204438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-564c43c4-9b03-49c4-b1ef-39b2dbda7a7c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:58.214184 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-564c43c4-9b03-49c4-b1ef-39b2dbda7a7c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1522 microversion: 2.1 time: 0.189720 Sep 10 10:51:58.217395 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2738/3244] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:58 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:58.221347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:58.221966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:58.230663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:58.231421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:58.231873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:58.232570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:58.233227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:58.233687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:58.305336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:58.314613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:58.316081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:58.322539 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-44c9e2dd-cc05-4f1b-9d97-341c3b9ac586 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.106602 Sep 10 10:51:58.323109 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2739/3245] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:58 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:58.475004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb0f0d55-2ad7-4aae-bbd7-80dc243d0f23 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:58.475708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bb0f0d55-2ad7-4aae-bbd7-80dc243d0f23 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:58.482955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb0f0d55-2ad7-4aae-bbd7-80dc243d0f23 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:58.483569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb0f0d55-2ad7-4aae-bbd7-80dc243d0f23 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:58.484122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb0f0d55-2ad7-4aae-bbd7-80dc243d0f23 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:58.484961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb0f0d55-2ad7-4aae-bbd7-80dc243d0f23 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:58.485557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb0f0d55-2ad7-4aae-bbd7-80dc243d0f23 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:58.486102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bb0f0d55-2ad7-4aae-bbd7-80dc243d0f23 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:58.713945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bb0f0d55-2ad7-4aae-bbd7-80dc243d0f23 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:58.724518 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb0f0d55-2ad7-4aae-bbd7-80dc243d0f23 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1647 microversion: 2.1 time: 0.254560 Sep 10 10:51:58.725133 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2740/3246] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:58 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1647 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:51:58.730135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-678d4857-3633-4ecd-83e7-5876d0ed8cfb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:58.730732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-678d4857-3633-4ecd-83e7-5876d0ed8cfb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:58.737022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-678d4857-3633-4ecd-83e7-5876d0ed8cfb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:58.737524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-678d4857-3633-4ecd-83e7-5876d0ed8cfb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:58.737962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-678d4857-3633-4ecd-83e7-5876d0ed8cfb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:58.738790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-678d4857-3633-4ecd-83e7-5876d0ed8cfb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:58.739275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-678d4857-3633-4ecd-83e7-5876d0ed8cfb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:58.739702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-678d4857-3633-4ecd-83e7-5876d0ed8cfb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:58.909525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-678d4857-3633-4ecd-83e7-5876d0ed8cfb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:58.918703 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-678d4857-3633-4ecd-83e7-5876d0ed8cfb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.192517 Sep 10 10:51:58.925404 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2741/3247] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:58 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:58.930937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:58.934305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:58.949307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:58.949954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:58.950588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:58.951415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:58.953551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:58.954103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:59.053490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:59.062685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:59.078717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b522b7dbd543eba814f05abeb5e864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10beb89155a4d2ba4ee3f52fb84abd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:59.081305 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d0cfd008-358e-4fac-aed1-14910a6d25f7 tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 200 len: 1405 microversion: 2.54 time: 0.154779 Sep 10 10:51:59.084558 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2742/3248] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:58 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:51:59.239248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f758da1-6f02-45e1-8048-0b6e8b143593 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:51:59.246458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0f758da1-6f02-45e1-8048-0b6e8b143593 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:51:59.267235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f758da1-6f02-45e1-8048-0b6e8b143593 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:59.272882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f758da1-6f02-45e1-8048-0b6e8b143593 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:59.273735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f758da1-6f02-45e1-8048-0b6e8b143593 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:59.278287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f758da1-6f02-45e1-8048-0b6e8b143593 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:51:59.278905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f758da1-6f02-45e1-8048-0b6e8b143593 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:51:59.279698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f758da1-6f02-45e1-8048-0b6e8b143593 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:51:59.950387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0f758da1-6f02-45e1-8048-0b6e8b143593 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:51:59.993051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f758da1-6f02-45e1-8048-0b6e8b143593 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1522 microversion: 2.1 time: 0.758396 Sep 10 10:51:59.994048 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2743/3249] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:51:59 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1522 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:51:59.998857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:00.002346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:00.031638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:00.042791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:00.043266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:00.044026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:00.044496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:00.044914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:00.439690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:00.448747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:00.454960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:00.461754 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9b13200b-1fb5-4222-8bab-6e3c3a4fdc34 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.466588 Sep 10 10:52:00.462936 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2744/3250] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:51:59 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:00.467887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d28a6f0-f36f-4dad-a6ff-ee4e846599b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:00.468941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d28a6f0-f36f-4dad-a6ff-ee4e846599b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:00.476371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d28a6f0-f36f-4dad-a6ff-ee4e846599b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:00.477241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d28a6f0-f36f-4dad-a6ff-ee4e846599b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:00.478123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d28a6f0-f36f-4dad-a6ff-ee4e846599b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:00.479058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d28a6f0-f36f-4dad-a6ff-ee4e846599b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:00.479739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d28a6f0-f36f-4dad-a6ff-ee4e846599b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:00.480368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d28a6f0-f36f-4dad-a6ff-ee4e846599b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:00.846364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d28a6f0-f36f-4dad-a6ff-ee4e846599b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:00.855349 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d28a6f0-f36f-4dad-a6ff-ee4e846599b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1647 microversion: 2.1 time: 0.390725 Sep 10 10:52:00.855484 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2745/3251] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:00 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1647 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:00.872261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4b888559-92bf-4afa-9a44-a0a31d46894e req-0b0b77c3-5711-447d-a26f-6b88b39e54c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30352b5-a583-40b8-8e8b-9065682fc622", "name": "network-vif-plugged", "status": "completed", "tag": "71c8ab6d-8672-4c8a-ab73-29ff25b4bb84"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:00.883515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4b888559-92bf-4afa-9a44-a0a31d46894e req-0b0b77c3-5711-447d-a26f-6b88b39e54c6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:00.884315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4b888559-92bf-4afa-9a44-a0a31d46894e req-0b0b77c3-5711-447d-a26f-6b88b39e54c6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:00.884977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4b888559-92bf-4afa-9a44-a0a31d46894e req-0b0b77c3-5711-447d-a26f-6b88b39e54c6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:00.899029 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4b888559-92bf-4afa-9a44-a0a31d46894e req-0b0b77c3-5711-447d-a26f-6b88b39e54c6 service nova] Creating event network-vif-plugged:71c8ab6d-8672-4c8a-ab73-29ff25b4bb84 for instance e30352b5-a583-40b8-8e8b-9065682fc622 on n-h2-856894-1 Sep 10 10:52:00.907201 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4b888559-92bf-4afa-9a44-a0a31d46894e req-0b0b77c3-5711-447d-a26f-6b88b39e54c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040867 Sep 10 10:52:00.908035 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2746/3252] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:00.915216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f7f107fd-3274-4a4d-9a49-6801c2b44bc3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:00.916059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f7f107fd-3274-4a4d-9a49-6801c2b44bc3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:00.923131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f107fd-3274-4a4d-9a49-6801c2b44bc3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:00.923776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f107fd-3274-4a4d-9a49-6801c2b44bc3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:00.924318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f107fd-3274-4a4d-9a49-6801c2b44bc3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:00.925252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f107fd-3274-4a4d-9a49-6801c2b44bc3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:00.925824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f107fd-3274-4a4d-9a49-6801c2b44bc3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:00.926429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f107fd-3274-4a4d-9a49-6801c2b44bc3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.363318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f7f107fd-3274-4a4d-9a49-6801c2b44bc3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:01.373733 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f7f107fd-3274-4a4d-9a49-6801c2b44bc3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.463890 Sep 10 10:52:01.374356 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2747/3253] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:00 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:01.379568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:01.381310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] [instance: b57cce22-deb4-4af2-aa98-d17032d6ed01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:01.388584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:01.389099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:01.389694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.390438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:01.390898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:01.391469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.407074 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] HTTP exception thrown: Instance b57cce22-deb4-4af2-aa98-d17032d6ed01 could not be found. Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Request method failure captured: Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 HTTP/1.1 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwZgHpnDSRnttK1z-3hnCweaX8Nqm5bfwHsq9RMsutPrBoCQeRA3Zq8bXdzqDwFk9CCg_g2kNuBo-Yop1cVJqi7uVez09gB_-DKTbn9Sn3EtxuXDrBKtDKS2dfjeF8lxUAHTBk850av2QSpT7NkDfQdUUC9FEEizSBYQlueHHtr-2w Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.54 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: a10beb89155a4d2ba4ee3f52fb84abd5 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerShowV254Test-1429529162 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a10beb89155a4d2ba4ee3f52fb84abd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a10beb89155a4d2ba4ee3f52fb84abd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a10beb89155a4d2ba4ee3f52fb84abd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a10beb89155a4d2ba4ee3f52fb84abd5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerShowV254Test-1429529162 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: a10beb89155a4d2ba4ee3f52fb84abd5 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerShowV254Test-1429529162 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerShowV254Test-1429529162-project Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 54b522b7dbd543eba814f05abeb5e864 Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerShowV254Test-1429529162-project Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance b57cce22-deb4-4af2-aa98-d17032d6ed01 could not be found. Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'b57cce22-deb4-4af2-aa98-d17032d6ed01'} Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57cce22-deb4-4af2-aa98-d17032d6ed01 could not be found. Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57cce22-deb4-4af2-aa98-d17032d6ed01 could not be found. Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:01.408805 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:01.413879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:01.413879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:01.413879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:01.413879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:01.413879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:01.413879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57cce22-deb4-4af2-aa98-d17032d6ed01 could not be found. Sep 10 10:52:01.413879 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:01.413879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] Returning 404 to user: Instance b57cce22-deb4-4af2-aa98-d17032d6ed01 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:01.413879 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a47f7128-0741-4750-9173-0f7f2cd0d35a tempest-ServerShowV254Test-1429529162 tempest-ServerShowV254Test-1429529162-project] 10.222.0.20 "GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01" status: 404 len: 111 microversion: 2.54 time: 0.034676 Sep 10 10:52:01.413879 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2748/3254] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:01 2022] GET /compute/v2.1/servers/b57cce22-deb4-4af2-aa98-d17032d6ed01 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:52:01.416592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b8d3df91-e404-4398-b980-5a32e6686d11 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:01.417139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b8d3df91-e404-4398-b980-5a32e6686d11 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:01.423040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8d3df91-e404-4398-b980-5a32e6686d11 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:01.423526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8d3df91-e404-4398-b980-5a32e6686d11 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:01.423964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8d3df91-e404-4398-b980-5a32e6686d11 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.424662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8d3df91-e404-4398-b980-5a32e6686d11 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:01.425225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8d3df91-e404-4398-b980-5a32e6686d11 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:01.425847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8d3df91-e404-4398-b980-5a32e6686d11 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.684701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b8d3df91-e404-4398-b980-5a32e6686d11 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:01.704642 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b8d3df91-e404-4398-b980-5a32e6686d11 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1522 microversion: 2.1 time: 0.291649 Sep 10 10:52:01.705793 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2749/3255] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:01 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:01.717029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3a8210c5-8cfe-4438-84f1-b56b64039381 req-17a19476-9c9c-47f5-9030-6b3a8f27d1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2bfc6ba-e6cf-4263-b70c-e21afd2fe828", "name": "network-vif-deleted", "tag": "e7c3aa12-f8f1-4dc6-80d9-9122ec45c547"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:01.734512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3a8210c5-8cfe-4438-84f1-b56b64039381 req-17a19476-9c9c-47f5-9030-6b3a8f27d1be service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:01.734921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3a8210c5-8cfe-4438-84f1-b56b64039381 req-17a19476-9c9c-47f5-9030-6b3a8f27d1be service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:01.735454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3a8210c5-8cfe-4438-84f1-b56b64039381 req-17a19476-9c9c-47f5-9030-6b3a8f27d1be service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.747724 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3a8210c5-8cfe-4438-84f1-b56b64039381 req-17a19476-9c9c-47f5-9030-6b3a8f27d1be service nova] Creating event network-vif-deleted:e7c3aa12-f8f1-4dc6-80d9-9122ec45c547 for instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 on n-h2-856894-1 Sep 10 10:52:01.753008 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3a8210c5-8cfe-4438-84f1-b56b64039381 req-17a19476-9c9c-47f5-9030-6b3a8f27d1be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045759 Sep 10 10:52:01.753884 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2750/3256] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:01.760105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:01.761114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:01.767514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:01.768172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:01.768616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.769336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:01.769793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:01.770621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.843955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:01.854183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:01.855704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:01.860790 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ad3bc2d-e870-4b94-94db-69afbcda7a36 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.105385 Sep 10 10:52:01.861405 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2751/3257] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:01 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:01.888242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:01.888773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:01.895400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:01.896519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:01.897020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.897740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:01.898386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:01.898872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.936754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:01.937434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:01.937983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:01.938544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lazy-loading 'fault' on Instance uuid c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:52:01.994057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:02.003343 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15d88f2f-2837-43af-b024-c9b9b52766fc tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 200 len: 1306 microversion: 2.1 time: 0.126690 Sep 10 10:52:02.003939 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2752/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:01 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 1306 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:02.398943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4eef869f-493b-4902-9d82-5de1a6797f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:02.400593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4eef869f-493b-4902-9d82-5de1a6797f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:02.411414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eef869f-493b-4902-9d82-5de1a6797f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:02.412132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eef869f-493b-4902-9d82-5de1a6797f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:02.412777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eef869f-493b-4902-9d82-5de1a6797f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:02.414728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eef869f-493b-4902-9d82-5de1a6797f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:02.415080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eef869f-493b-4902-9d82-5de1a6797f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:02.416425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4eef869f-493b-4902-9d82-5de1a6797f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:02.422228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:02.668509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4eef869f-493b-4902-9d82-5de1a6797f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:02.696271 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4eef869f-493b-4902-9d82-5de1a6797f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.302654 Sep 10 10:52:02.700352 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2753/3259] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:02 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:52:02.734049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d604496-bbde-4f05-905f-149d2413f772 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:02.742930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d604496-bbde-4f05-905f-149d2413f772 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:02.758424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d604496-bbde-4f05-905f-149d2413f772 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:02.760880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d604496-bbde-4f05-905f-149d2413f772 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:02.763902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d604496-bbde-4f05-905f-149d2413f772 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:02.764972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d604496-bbde-4f05-905f-149d2413f772 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:02.765614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d604496-bbde-4f05-905f-149d2413f772 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:02.766203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d604496-bbde-4f05-905f-149d2413f772 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:02.986669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d604496-bbde-4f05-905f-149d2413f772 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:03.003311 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d604496-bbde-4f05-905f-149d2413f772 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1522 microversion: 2.1 time: 0.276024 Sep 10 10:52:03.017218 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2754/3260] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:02 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:03.024412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:03.025382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:03.033355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:03.034467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:03.035196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:03.036747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:03.037659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:03.038689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:03.220407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:03.231877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:03.233492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:03.256499 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38958e88-12d6-49d2-9738-cf99dd4e8532 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.243230 Sep 10 10:52:03.261238 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2755/3261] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:03 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:03.275464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:03.277629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:03.291156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:03.326798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:03.327285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:03.328033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:03.328499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:03.328923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:03.358718 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 HTTP/1.1 Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'c2bfc6ba-e6cf-4263-b70c-e21afd2fe828'} Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:03.360683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:03.363863 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:03.363863 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:03.363863 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:03.363863 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:03.363863 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:03.363863 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:03.363863 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:03.366253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:03.367678 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5673ee75-d78d-4a44-a8d6-22ab02529e0e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 404 len: 111 microversion: 2.1 time: 0.105338 Sep 10 10:52:03.368784 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2756/3262] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:03 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:03.386786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c58328b7-b6d5-46e2-9da2-99237b267207 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcadcd7700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:03.769324 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c58328b7-b6d5-46e2-9da2-99237b267207 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/6ef65047-ee2f-435f-b999-2051c119a595" status: 202 len: 0 microversion: 2.1 time: 0.390571 Sep 10 10:52:03.773515 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2757/3263] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:03 2022] DELETE /compute/v2.1/os-security-groups/6ef65047-ee2f-435f-b999-2051c119a595 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:52:03.780354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e668a305-cbd9-43d9-8de2-c2feb29847c7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:03.780980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e668a305-cbd9-43d9-8de2-c2feb29847c7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:03.821203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e668a305-cbd9-43d9-8de2-c2feb29847c7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:03.821974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e668a305-cbd9-43d9-8de2-c2feb29847c7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:03.823174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e668a305-cbd9-43d9-8de2-c2feb29847c7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:03.824076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e668a305-cbd9-43d9-8de2-c2feb29847c7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:03.824767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e668a305-cbd9-43d9-8de2-c2feb29847c7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:03.825486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e668a305-cbd9-43d9-8de2-c2feb29847c7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:03.993216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e668a305-cbd9-43d9-8de2-c2feb29847c7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:04.024155 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e668a305-cbd9-43d9-8de2-c2feb29847c7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.247246 Sep 10 10:52:04.053636 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2758/3264] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:03 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:04.060625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43013041-58ac-4b10-8223-a3c9e06db0d3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcadd429d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:04.313810 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43013041-58ac-4b10-8223-a3c9e06db0d3 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/6d46a59d-7139-4b6e-ac7e-527c825c5c56" status: 202 len: 0 microversion: 2.1 time: 0.258096 Sep 10 10:52:04.314588 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2759/3265] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:04 2022] DELETE /compute/v2.1/os-security-groups/6d46a59d-7139-4b6e-ac7e-527c825c5c56 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:52:04.327341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79389e62-7e21-465d-9652-ec05d86fb7d5 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:04.328030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79389e62-7e21-465d-9652-ec05d86fb7d5 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:04.341865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79389e62-7e21-465d-9652-ec05d86fb7d5 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:04.342735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79389e62-7e21-465d-9652-ec05d86fb7d5 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:04.343391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79389e62-7e21-465d-9652-ec05d86fb7d5 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:04.344314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79389e62-7e21-465d-9652-ec05d86fb7d5 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:04.344982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79389e62-7e21-465d-9652-ec05d86fb7d5 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:04.346187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79389e62-7e21-465d-9652-ec05d86fb7d5 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:04.646885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79389e62-7e21-465d-9652-ec05d86fb7d5 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:04.660461 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79389e62-7e21-465d-9652-ec05d86fb7d5 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1507 microversion: 2.1 time: 0.338123 Sep 10 10:52:04.662943 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2760/3266] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:04 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:04.669860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:04.670840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:04.685181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:04.686110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:04.686852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:04.687825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:04.688555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:04.689773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:04.805383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:04.817730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:04.819348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:04.824859 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9365ea10-9656-4db7-b481-d342af0245dd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.160692 Sep 10 10:52:04.825743 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2761/3267] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:04 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:04.856596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b856226-e602-4fa3-bd7a-849d13a047b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'create', calling method: .version_select at 0x7efcad9e1160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1198631583", "description": "tempest-description-349154488"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:05.140250 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b856226-e602-4fa3-bd7a-849d13a047b0 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.304459 Sep 10 10:52:05.141182 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2762/3268] 10.222.0.20 () {60 vars in 1180 bytes} [Sat Sep 10 10:52:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:05.151684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-720dca2d-1e3a-4c59-83ed-5fdd0dcae937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:05.158558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-720dca2d-1e3a-4c59-83ed-5fdd0dcae937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:05.167448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-720dca2d-1e3a-4c59-83ed-5fdd0dcae937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:05.169224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-720dca2d-1e3a-4c59-83ed-5fdd0dcae937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:05.170191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-720dca2d-1e3a-4c59-83ed-5fdd0dcae937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:05.172200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-720dca2d-1e3a-4c59-83ed-5fdd0dcae937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:05.173395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-720dca2d-1e3a-4c59-83ed-5fdd0dcae937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:05.174104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-720dca2d-1e3a-4c59-83ed-5fdd0dcae937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:05.408678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-720dca2d-1e3a-4c59-83ed-5fdd0dcae937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:05.419214 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-720dca2d-1e3a-4c59-83ed-5fdd0dcae937 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 200 len: 1507 microversion: 2.1 time: 0.274604 Sep 10 10:52:05.420425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2763/3269] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:05 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:05.425920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15157ba5-299d-42fd-ba73-d88798c77fe5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:05.426939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15157ba5-299d-42fd-ba73-d88798c77fe5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:05.434171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15157ba5-299d-42fd-ba73-d88798c77fe5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:05.435154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15157ba5-299d-42fd-ba73-d88798c77fe5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:05.436174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15157ba5-299d-42fd-ba73-d88798c77fe5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:05.437421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15157ba5-299d-42fd-ba73-d88798c77fe5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:05.438505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15157ba5-299d-42fd-ba73-d88798c77fe5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:05.439176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15157ba5-299d-42fd-ba73-d88798c77fe5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:05.702154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15157ba5-299d-42fd-ba73-d88798c77fe5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:05.711338 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15157ba5-299d-42fd-ba73-d88798c77fe5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.289622 Sep 10 10:52:05.712295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2764/3270] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:05 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:05.727118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cd375f11-92fe-4995-b3a9-053b78ab50ac tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Action: 'update', calling method: .version_select at 0x7efcadd11e50>, body: {"security_group": {"name": "tempest-sg-hth-199846276", "description": "tempest-description-hth-824217641"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:05.935793 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cd375f11-92fe-4995-b3a9-053b78ab50ac tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/f511551b-a7ae-4663-924e-d4c6c5d13c4a" status: 200 len: 216 microversion: 2.1 time: 0.222130 Sep 10 10:52:05.939485 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2765/3271] 10.222.0.20 () {60 vars in 1290 bytes} [Sat Sep 10 10:52:05 2022] PUT /compute/v2.1/os-security-groups/f511551b-a7ae-4663-924e-d4c6c5d13c4a => generated 216 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:05.966885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d52bc318-be33-4c7b-90be-e8780dc2048c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:05.967604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d52bc318-be33-4c7b-90be-e8780dc2048c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:05.980559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d52bc318-be33-4c7b-90be-e8780dc2048c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:05.981294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d52bc318-be33-4c7b-90be-e8780dc2048c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:05.981973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d52bc318-be33-4c7b-90be-e8780dc2048c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:05.984466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d52bc318-be33-4c7b-90be-e8780dc2048c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:05.985157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d52bc318-be33-4c7b-90be-e8780dc2048c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:05.985741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d52bc318-be33-4c7b-90be-e8780dc2048c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:06.020376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d52bc318-be33-4c7b-90be-e8780dc2048c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:52:06.126476 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d52bc318-be33-4c7b-90be-e8780dc2048c tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 204 len: 0 microversion: 2.1 time: 0.184144 Sep 10 10:52:06.127089 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2766/3272] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:52:05 2022] DELETE /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:52:06.133065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:06.134061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:06.140068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:06.140991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:06.141657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:06.142518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:06.143794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:06.144375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:06.222358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:06.230737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:06.232202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:06.243942 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-739c1ddd-e947-45f4-b1cf-9078476769bb tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.115625 Sep 10 10:52:06.246058 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2767/3273] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:06 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:06.259338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42acdb3c-68ea-4c83-ade2-df6802cb9d5a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcadcd7820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:06.403309 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42acdb3c-68ea-4c83-ade2-df6802cb9d5a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/f511551b-a7ae-4663-924e-d4c6c5d13c4a" status: 200 len: 216 microversion: 2.1 time: 0.155988 Sep 10 10:52:06.403912 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2768/3274] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:52:06 2022] GET /compute/v2.1/os-security-groups/f511551b-a7ae-4663-924e-d4c6c5d13c4a => generated 216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:06.415253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1768610504", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "64cb3b23-4abb-49b9-b60e-201809cae02d"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:06.527827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] validate_networks() for [('64cb3b23-4abb-49b9-b60e-201809cae02d', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:52:07.114580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:52:07.115715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:52:07.116419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:52:07.117196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:52:07.117843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:52:07.130197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:07.131801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:07.132829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:07.133814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:07.134808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:07.135438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:07.156008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Getting quotas for project 827645d7a2374eb4bc75b115b8ccd6dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:52:07.162961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Getting quotas for user e3e819f2b7d9489497e408871a233377 and project 827645d7a2374eb4bc75b115b8ccd6dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:52:07.182854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:52:07.186327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:52:07.214137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:07.307742 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c7aaf9e-c7e6-4ad3-85a9-9d19df5b9120 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896119 Sep 10 10:52:07.308872 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2769/3275] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:52:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:52:07.319518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3bc07c1c-14d8-4223-ad2e-19a5d3bce526 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcaf101ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:07.818963 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3bc07c1c-14d8-4223-ad2e-19a5d3bce526 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f511551b-a7ae-4663-924e-d4c6c5d13c4a" status: 202 len: 0 microversion: 2.1 time: 0.508698 Sep 10 10:52:07.823295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2770/3276] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:07 2022] DELETE /compute/v2.1/os-security-groups/f511551b-a7ae-4663-924e-d4c6c5d13c4a => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:52:07.826441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2131e725-11ba-4372-a5f7-0713dc96136f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:07.827133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2131e725-11ba-4372-a5f7-0713dc96136f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:07.854624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2131e725-11ba-4372-a5f7-0713dc96136f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:07.858241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2131e725-11ba-4372-a5f7-0713dc96136f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:07.862370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2131e725-11ba-4372-a5f7-0713dc96136f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:07.867461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2131e725-11ba-4372-a5f7-0713dc96136f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:07.868565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2131e725-11ba-4372-a5f7-0713dc96136f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:07.870169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2131e725-11ba-4372-a5f7-0713dc96136f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:08.793113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2131e725-11ba-4372-a5f7-0713dc96136f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:08.825622 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2131e725-11ba-4372-a5f7-0713dc96136f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.997127 Sep 10 10:52:08.829122 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2771/3277] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:07 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:08.840427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:08.841315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:08.859789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:08.862157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:08.863269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:08.864439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:08.865044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:08.865608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:09.096007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:09.115760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:09.129880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:09.163676 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-333b538a-427a-4008-86c9-bde4f15227d9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.330624 Sep 10 10:52:09.165594 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2772/3278] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:08 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:09.191458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15f8fe9d-3d27-4af2-8656-aa8916aaebfe tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:09.192208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15f8fe9d-3d27-4af2-8656-aa8916aaebfe tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:09.218470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f8fe9d-3d27-4af2-8656-aa8916aaebfe tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:09.218975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f8fe9d-3d27-4af2-8656-aa8916aaebfe tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:09.225125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f8fe9d-3d27-4af2-8656-aa8916aaebfe tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:09.225960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f8fe9d-3d27-4af2-8656-aa8916aaebfe tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:09.229871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f8fe9d-3d27-4af2-8656-aa8916aaebfe tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:09.233653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f8fe9d-3d27-4af2-8656-aa8916aaebfe tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:09.421728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15f8fe9d-3d27-4af2-8656-aa8916aaebfe tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:09.448487 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15f8fe9d-3d27-4af2-8656-aa8916aaebfe tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1270 microversion: 2.1 time: 0.281765 Sep 10 10:52:09.455044 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2773/3279] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:09 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:09.469433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:09.474494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:09.495738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:09.496251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:09.496703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:09.499472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:09.499902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:09.500319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:09.528249 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 HTTP/1.1 Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'c2bfc6ba-e6cf-4263-b70c-e21afd2fe828'} Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:09.533047 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:09.536952 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.545153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:09.546219 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a70fcac5-b7a4-4006-b093-a437fcfbf91f tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 404 len: 111 microversion: 2.1 time: 0.089993 Sep 10 10:52:09.548741 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2774/3280] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:52:09 2022] DELETE /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:09.564475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-cf63b1f7-ff82-41db-b3ee-7789c9da9504 req-8c2ce478-e790-4680-87b6-d77771910a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30352b5-a583-40b8-8e8b-9065682fc622", "name": "network-vif-deleted", "tag": "71c8ab6d-8672-4c8a-ab73-29ff25b4bb84"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:09.585197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf63b1f7-ff82-41db-b3ee-7789c9da9504 req-8c2ce478-e790-4680-87b6-d77771910a45 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:09.588669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf63b1f7-ff82-41db-b3ee-7789c9da9504 req-8c2ce478-e790-4680-87b6-d77771910a45 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:09.589263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf63b1f7-ff82-41db-b3ee-7789c9da9504 req-8c2ce478-e790-4680-87b6-d77771910a45 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:09.613633 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-cf63b1f7-ff82-41db-b3ee-7789c9da9504 req-8c2ce478-e790-4680-87b6-d77771910a45 service nova] Creating event network-vif-deleted:71c8ab6d-8672-4c8a-ab73-29ff25b4bb84 for instance e30352b5-a583-40b8-8e8b-9065682fc622 on n-h2-856894-1 Sep 10 10:52:09.628296 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-cf63b1f7-ff82-41db-b3ee-7789c9da9504 req-8c2ce478-e790-4680-87b6-d77771910a45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073814 Sep 10 10:52:09.629403 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2775/3281] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:09.640407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:09.643245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: c2bfc6ba-e6cf-4263-b70c-e21afd2fe828] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:09.655040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:09.656035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:09.658047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:09.660176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:09.662601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:09.663110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:09.688920 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 HTTP/1.1 Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'c2bfc6ba-e6cf-4263-b70c-e21afd2fe828'} Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:09.702841 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.706592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.706592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:09.706592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:09.706592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:09.706592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:09.706592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. Sep 10 10:52:09.706592 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.708419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Instance c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:09.722229 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc122981-c241-40a1-9b32-ccf52088bc4d tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828" status: 404 len: 111 microversion: 2.1 time: 0.078786 Sep 10 10:52:09.724391 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2776/3282] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:09 2022] GET /compute/v2.1/servers/c2bfc6ba-e6cf-4263-b70c-e21afd2fe828 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:09.734979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38805edf-6dd8-4bb4-b22f-5442333210cb tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcad8a4b80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:09.775834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-38805edf-6dd8-4bb4-b22f-5442333210cb tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:52:09.776573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-38805edf-6dd8-4bb4-b22f-5442333210cb tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Neutron security group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:52:09.777205 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-38805edf-6dd8-4bb4-b22f-5442333210cb tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 does not exist Sep 10 10:52:09.777205 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-d0a37d82-1aab-46d9-a7c1-1d929a7926e7'] Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38805edf-6dd8-4bb4-b22f-5442333210cb tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/6d46a59d-7139-4b6e-ac7e-527c825c5c56 HTTP/1.1 Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 does not exist Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-d0a37d82-1aab-46d9-a7c1-1d929a7926e7'] Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '6d46a59d-7139-4b6e-ac7e-527c825c5c56'} Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:52:09.779666 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 does not exist Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0a37d82-1aab-46d9-a7c1-1d929a7926e7'] Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 does not exist Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0a37d82-1aab-46d9-a7c1-1d929a7926e7'] Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 does not exist Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0a37d82-1aab-46d9-a7c1-1d929a7926e7'] Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 does not exist Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0a37d82-1aab-46d9-a7c1-1d929a7926e7'] Sep 10 10:52:09.783080 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.788937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38805edf-6dd8-4bb4-b22f-5442333210cb tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Security group 6d46a59d-7139-4b6e-ac7e-527c825c5c56 does not exist Sep 10 10:52:09.788937 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-d0a37d82-1aab-46d9-a7c1-1d929a7926e7'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:09.791757 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38805edf-6dd8-4bb4-b22f-5442333210cb tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/6d46a59d-7139-4b6e-ac7e-527c825c5c56" status: 404 len: 194 microversion: 2.1 time: 0.063020 Sep 10 10:52:09.796460 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2777/3283] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:09 2022] DELETE /compute/v2.1/os-security-groups/6d46a59d-7139-4b6e-ac7e-527c825c5c56 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:09.812567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5bc66ea3-42c0-4ef0-bb07-6fe6dcadeec8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcad88bb80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:09.887713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-5bc66ea3-42c0-4ef0-bb07-6fe6dcadeec8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6ef65047-ee2f-435f-b999-2051c119a595 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:52:09.888381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-5bc66ea3-42c0-4ef0-bb07-6fe6dcadeec8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Neutron security group 6ef65047-ee2f-435f-b999-2051c119a595 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:52:09.888936 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5bc66ea3-42c0-4ef0-bb07-6fe6dcadeec8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security group 6ef65047-ee2f-435f-b999-2051c119a595 does not exist Sep 10 10:52:09.888936 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-6176e221-b54e-4e0d-9b0e-48e92d7fbac7'] Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5bc66ea3-42c0-4ef0-bb07-6fe6dcadeec8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/6ef65047-ee2f-435f-b999-2051c119a595 HTTP/1.1 Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 6ef65047-ee2f-435f-b999-2051c119a595 does not exist Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-6176e221-b54e-4e0d-9b0e-48e92d7fbac7'] Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '6ef65047-ee2f-435f-b999-2051c119a595'} Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:52:09.896629 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6ef65047-ee2f-435f-b999-2051c119a595 does not exist Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6176e221-b54e-4e0d-9b0e-48e92d7fbac7'] Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6ef65047-ee2f-435f-b999-2051c119a595 does not exist Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6176e221-b54e-4e0d-9b0e-48e92d7fbac7'] Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6ef65047-ee2f-435f-b999-2051c119a595 does not exist Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6176e221-b54e-4e0d-9b0e-48e92d7fbac7'] Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6ef65047-ee2f-435f-b999-2051c119a595 does not exist Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6176e221-b54e-4e0d-9b0e-48e92d7fbac7'] Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5bc66ea3-42c0-4ef0-bb07-6fe6dcadeec8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Security group 6ef65047-ee2f-435f-b999-2051c119a595 does not exist Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-6176e221-b54e-4e0d-9b0e-48e92d7fbac7'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:09.899657 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5bc66ea3-42c0-4ef0-bb07-6fe6dcadeec8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/6ef65047-ee2f-435f-b999-2051c119a595" status: 404 len: 194 microversion: 2.1 time: 0.097430 Sep 10 10:52:09.903405 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2778/3284] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:09 2022] DELETE /compute/v2.1/os-security-groups/6ef65047-ee2f-435f-b999-2051c119a595 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:09.921158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f7f983e7-a05f-4c2a-bf0c-9bb64c309129 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:09.922421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f7f983e7-a05f-4c2a-bf0c-9bb64c309129 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:09.948168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f983e7-a05f-4c2a-bf0c-9bb64c309129 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:09.948677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f983e7-a05f-4c2a-bf0c-9bb64c309129 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:09.949164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f983e7-a05f-4c2a-bf0c-9bb64c309129 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:09.949892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f983e7-a05f-4c2a-bf0c-9bb64c309129 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:09.950417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f983e7-a05f-4c2a-bf0c-9bb64c309129 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:09.950910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7f983e7-a05f-4c2a-bf0c-9bb64c309129 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:10.009028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:10.447039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f7f983e7-a05f-4c2a-bf0c-9bb64c309129 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:10.484598 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f7f983e7-a05f-4c2a-bf0c-9bb64c309129 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.581003 Sep 10 10:52:10.497519 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2779/3285] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:09 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:10.512629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a2dcd307-6e66-488f-b37a-e340ac1f9db8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcae2c3820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:10.607124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-a2dcd307-6e66-488f-b37a-e340ac1f9db8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:52:10.607745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-a2dcd307-6e66-488f-b37a-e340ac1f9db8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Neutron security group 668a489e-6fb3-4adf-8356-61e832e11eab not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:52:10.608279 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a2dcd307-6e66-488f-b37a-e340ac1f9db8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:52:10.608279 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-715587da-9ad9-4f80-bc3f-273a3cd30327'] Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a2dcd307-6e66-488f-b37a-e340ac1f9db8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/668a489e-6fb3-4adf-8356-61e832e11eab HTTP/1.1 Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-715587da-9ad9-4f80-bc3f-273a3cd30327'] Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '668a489e-6fb3-4adf-8356-61e832e11eab'} Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:52:10.620731 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-715587da-9ad9-4f80-bc3f-273a3cd30327'] Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-715587da-9ad9-4f80-bc3f-273a3cd30327'] Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-715587da-9ad9-4f80-bc3f-273a3cd30327'] Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-715587da-9ad9-4f80-bc3f-273a3cd30327'] Sep 10 10:52:10.624205 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:10.626136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a2dcd307-6e66-488f-b37a-e340ac1f9db8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Security group 668a489e-6fb3-4adf-8356-61e832e11eab does not exist Sep 10 10:52:10.626136 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-715587da-9ad9-4f80-bc3f-273a3cd30327'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:10.631786 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a2dcd307-6e66-488f-b37a-e340ac1f9db8 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/668a489e-6fb3-4adf-8356-61e832e11eab" status: 404 len: 194 microversion: 2.1 time: 0.128131 Sep 10 10:52:10.631786 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2780/3286] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:10 2022] DELETE /compute/v2.1/os-security-groups/668a489e-6fb3-4adf-8356-61e832e11eab => generated 194 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:10.640428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:10.641023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:10.652664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:10.653192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:10.653634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:10.654646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:10.655308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:10.665282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:10.974711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:10.996543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:11.000061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:11.011216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1395029-2b49-418c-849d-74d471db0a70 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.381633 Sep 10 10:52:11.011861 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2781/3287] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:10 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:11.051087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0d7a8bb-9f3a-4a62-9ae2-449cd5b7da58 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:11.052877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0d7a8bb-9f3a-4a62-9ae2-449cd5b7da58 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:11.079220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d7a8bb-9f3a-4a62-9ae2-449cd5b7da58 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:11.080111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d7a8bb-9f3a-4a62-9ae2-449cd5b7da58 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:11.085255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d7a8bb-9f3a-4a62-9ae2-449cd5b7da58 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:11.086530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d7a8bb-9f3a-4a62-9ae2-449cd5b7da58 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:11.087437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d7a8bb-9f3a-4a62-9ae2-449cd5b7da58 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:11.088114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d7a8bb-9f3a-4a62-9ae2-449cd5b7da58 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:11.369539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a0d7a8bb-9f3a-4a62-9ae2-449cd5b7da58 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:11.400438 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a0d7a8bb-9f3a-4a62-9ae2-449cd5b7da58 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1276 microversion: 2.1 time: 0.369357 Sep 10 10:52:11.401372 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2782/3288] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:11 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1276 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:11.406655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72898e5f-1f04-43c9-b2d9-9d0333f457ed tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcaebdc700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:11.478796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-72898e5f-1f04-43c9-b2d9-9d0333f457ed tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:52:11.479465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-72898e5f-1f04-43c9-b2d9-9d0333f457ed tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Neutron security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:52:11.480051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-72898e5f-1f04-43c9-b2d9-9d0333f457ed tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:52:11.480051 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-5825041d-77e0-478e-84b5-45db61623258'] Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72898e5f-1f04-43c9-b2d9-9d0333f457ed tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/2ece3566-ddbc-411a-9fb5-9c9259668cd5 HTTP/1.1 Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-5825041d-77e0-478e-84b5-45db61623258'] Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '2ece3566-ddbc-411a-9fb5-9c9259668cd5'} Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:52:11.482202 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5825041d-77e0-478e-84b5-45db61623258'] Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5825041d-77e0-478e-84b5-45db61623258'] Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5825041d-77e0-478e-84b5-45db61623258'] Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5825041d-77e0-478e-84b5-45db61623258'] Sep 10 10:52:11.486196 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.491475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72898e5f-1f04-43c9-b2d9-9d0333f457ed tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Security group 2ece3566-ddbc-411a-9fb5-9c9259668cd5 does not exist Sep 10 10:52:11.491475 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-5825041d-77e0-478e-84b5-45db61623258'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:11.492566 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72898e5f-1f04-43c9-b2d9-9d0333f457ed tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2ece3566-ddbc-411a-9fb5-9c9259668cd5" status: 404 len: 194 microversion: 2.1 time: 0.090065 Sep 10 10:52:11.493320 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2783/3289] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:11 2022] DELETE /compute/v2.1/os-security-groups/2ece3566-ddbc-411a-9fb5-9c9259668cd5 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:11.502353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef6ea427-f819-4ea1-a170-4e8a517dd5a5 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcad88b670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:11.586649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-ef6ea427-f819-4ea1-a170-4e8a517dd5a5 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:52:11.587252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-ef6ea427-f819-4ea1-a170-4e8a517dd5a5 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Neutron security group 8db26e38-2c28-4271-a6fc-7806046dbd59 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:52:11.587754 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-ef6ea427-f819-4ea1-a170-4e8a517dd5a5 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:52:11.587754 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-267e0e07-608e-4b41-b366-b35b23f89af9'] Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef6ea427-f819-4ea1-a170-4e8a517dd5a5 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/8db26e38-2c28-4271-a6fc-7806046dbd59 HTTP/1.1 Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-267e0e07-608e-4b41-b366-b35b23f89af9'] Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '8db26e38-2c28-4271-a6fc-7806046dbd59'} Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:52:11.590066 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-267e0e07-608e-4b41-b366-b35b23f89af9'] Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-267e0e07-608e-4b41-b366-b35b23f89af9'] Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-267e0e07-608e-4b41-b366-b35b23f89af9'] Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-267e0e07-608e-4b41-b366-b35b23f89af9'] Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef6ea427-f819-4ea1-a170-4e8a517dd5a5 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Security group 8db26e38-2c28-4271-a6fc-7806046dbd59 does not exist Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-267e0e07-608e-4b41-b366-b35b23f89af9'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef6ea427-f819-4ea1-a170-4e8a517dd5a5 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/8db26e38-2c28-4271-a6fc-7806046dbd59" status: 404 len: 194 microversion: 2.1 time: 0.093947 Sep 10 10:52:11.593766 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2784/3290] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:11 2022] DELETE /compute/v2.1/os-security-groups/8db26e38-2c28-4271-a6fc-7806046dbd59 => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:52:11.600964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5020cec0-ff09-4687-8554-37011134defd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:11.605546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5020cec0-ff09-4687-8554-37011134defd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:11.617718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5020cec0-ff09-4687-8554-37011134defd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:11.618465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5020cec0-ff09-4687-8554-37011134defd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:11.620228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5020cec0-ff09-4687-8554-37011134defd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:11.621127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5020cec0-ff09-4687-8554-37011134defd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:11.623185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5020cec0-ff09-4687-8554-37011134defd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:11.625680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5020cec0-ff09-4687-8554-37011134defd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:12.380514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5020cec0-ff09-4687-8554-37011134defd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:12.400401 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5020cec0-ff09-4687-8554-37011134defd tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.806349 Sep 10 10:52:12.413821 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2785/3291] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:11 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:12.413821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb99c3d7-9a48-4789-b0ba-394562a229e9 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcad898b80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:12.443461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-fb99c3d7-9a48-4789-b0ba-394562a229e9 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:52:12.444369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-fb99c3d7-9a48-4789-b0ba-394562a229e9 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Neutron security group f1cf2297-8083-4aa9-8ff0-877a65209b97 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:52:12.445288 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-fb99c3d7-9a48-4789-b0ba-394562a229e9 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:52:12.445288 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-f7efeda0-c83e-4e61-835e-34986eaaa21c'] Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb99c3d7-9a48-4789-b0ba-394562a229e9 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/f1cf2297-8083-4aa9-8ff0-877a65209b97 HTTP/1.1 Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-f7efeda0-c83e-4e61-835e-34986eaaa21c'] Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f1cf2297-8083-4aa9-8ff0-877a65209b97'} Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:52:12.447480 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7efeda0-c83e-4e61-835e-34986eaaa21c'] Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7efeda0-c83e-4e61-835e-34986eaaa21c'] Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7efeda0-c83e-4e61-835e-34986eaaa21c'] Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7efeda0-c83e-4e61-835e-34986eaaa21c'] Sep 10 10:52:12.450549 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:12.455530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb99c3d7-9a48-4789-b0ba-394562a229e9 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Security group f1cf2297-8083-4aa9-8ff0-877a65209b97 does not exist Sep 10 10:52:12.455530 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-f7efeda0-c83e-4e61-835e-34986eaaa21c'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:12.456641 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb99c3d7-9a48-4789-b0ba-394562a229e9 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f1cf2297-8083-4aa9-8ff0-877a65209b97" status: 404 len: 194 microversion: 2.1 time: 0.053754 Sep 10 10:52:12.458552 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2786/3292] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:12 2022] DELETE /compute/v2.1/os-security-groups/f1cf2297-8083-4aa9-8ff0-877a65209b97 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:12.466775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:12.469058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:12.478743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:12.479464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:12.480063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:12.480947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:12.481566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:12.482142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:12.590425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:12.632994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:12.634598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:12.648282 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb12236b-fdc7-4513-8169-950a6ec35f7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.188023 Sep 10 10:52:12.648782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2787/3293] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:12 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:12.653659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-293caaa1-1f4b-4050-bc26-9202a3a57ff3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:12.654792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-293caaa1-1f4b-4050-bc26-9202a3a57ff3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:12.669688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-293caaa1-1f4b-4050-bc26-9202a3a57ff3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:12.670654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-293caaa1-1f4b-4050-bc26-9202a3a57ff3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:12.671434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-293caaa1-1f4b-4050-bc26-9202a3a57ff3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:12.672377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-293caaa1-1f4b-4050-bc26-9202a3a57ff3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:12.673039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-293caaa1-1f4b-4050-bc26-9202a3a57ff3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:12.673690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-293caaa1-1f4b-4050-bc26-9202a3a57ff3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:13.065120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-293caaa1-1f4b-4050-bc26-9202a3a57ff3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:13.073644 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-293caaa1-1f4b-4050-bc26-9202a3a57ff3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1318 microversion: 2.1 time: 0.423674 Sep 10 10:52:13.113787 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2788/3294] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:12 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:13.128578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57508d6a-c878-4eae-b625-724ead1c3b2c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:13.133826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57508d6a-c878-4eae-b625-724ead1c3b2c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:13.140671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57508d6a-c878-4eae-b625-724ead1c3b2c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:13.141191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57508d6a-c878-4eae-b625-724ead1c3b2c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:13.141631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57508d6a-c878-4eae-b625-724ead1c3b2c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:13.142850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57508d6a-c878-4eae-b625-724ead1c3b2c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:13.143315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57508d6a-c878-4eae-b625-724ead1c3b2c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:13.143741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57508d6a-c878-4eae-b625-724ead1c3b2c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:13.204970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57508d6a-c878-4eae-b625-724ead1c3b2c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:52:13.415132 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57508d6a-c878-4eae-b625-724ead1c3b2c tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 204 len: 0 microversion: 2.1 time: 0.299538 Sep 10 10:52:13.417632 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2789/3295] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:52:13 2022] DELETE /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:52:13.442874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2734eb1-4e89-4b42-9fa3-8d06de5f38dd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:13.444442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e2734eb1-4e89-4b42-9fa3-8d06de5f38dd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:13.453128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2734eb1-4e89-4b42-9fa3-8d06de5f38dd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:13.454508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2734eb1-4e89-4b42-9fa3-8d06de5f38dd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:13.455259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2734eb1-4e89-4b42-9fa3-8d06de5f38dd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:13.456368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2734eb1-4e89-4b42-9fa3-8d06de5f38dd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:13.457065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2734eb1-4e89-4b42-9fa3-8d06de5f38dd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:13.458041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2734eb1-4e89-4b42-9fa3-8d06de5f38dd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:13.881365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e2734eb1-4e89-4b42-9fa3-8d06de5f38dd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:13.895727 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2734eb1-4e89-4b42-9fa3-8d06de5f38dd tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1646 microversion: 2.1 time: 0.462511 Sep 10 10:52:13.913936 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2790/3296] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:13 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1646 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:13.919042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed4fc47c-45e8-446b-8168-0caa5c559bb8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:13.919719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed4fc47c-45e8-446b-8168-0caa5c559bb8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:13.927427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed4fc47c-45e8-446b-8168-0caa5c559bb8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:13.927980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed4fc47c-45e8-446b-8168-0caa5c559bb8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:13.928569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed4fc47c-45e8-446b-8168-0caa5c559bb8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:13.929313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed4fc47c-45e8-446b-8168-0caa5c559bb8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:13.929774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed4fc47c-45e8-446b-8168-0caa5c559bb8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:13.930204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed4fc47c-45e8-446b-8168-0caa5c559bb8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:14.162463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed4fc47c-45e8-446b-8168-0caa5c559bb8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:14.173244 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed4fc47c-45e8-446b-8168-0caa5c559bb8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1511 microversion: 2.1 time: 0.258018 Sep 10 10:52:14.186594 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2791/3297] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:13 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:14.195895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:14.197046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:14.205283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:14.205889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:14.207087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:14.209539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:14.209741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:14.210355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:14.450197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:14.468029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:14.473017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:14.507007 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5159d658-3ede-4bc2-a695-c7c329436b14 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.298106 Sep 10 10:52:14.525516 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2792/3298] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:14 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:14.525516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9656714-cac7-43ce-80fc-4afc86e19a46 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:14.526610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9656714-cac7-43ce-80fc-4afc86e19a46 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:14.549205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9656714-cac7-43ce-80fc-4afc86e19a46 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:14.552563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9656714-cac7-43ce-80fc-4afc86e19a46 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:14.553029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9656714-cac7-43ce-80fc-4afc86e19a46 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:14.554676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9656714-cac7-43ce-80fc-4afc86e19a46 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:14.555145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9656714-cac7-43ce-80fc-4afc86e19a46 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:14.555581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9656714-cac7-43ce-80fc-4afc86e19a46 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:15.090518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9656714-cac7-43ce-80fc-4afc86e19a46 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:15.114607 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9656714-cac7-43ce-80fc-4afc86e19a46 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1318 microversion: 2.1 time: 0.599898 Sep 10 10:52:15.159875 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2793/3299] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:14 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:15.179643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-006de7d5-1c90-49d2-9cf4-f92c4d1729f7 req-cf816855-bd08-4674-8686-8395d97c1f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b383e2b5-b354-4937-81d5-0593373068e9", "tag": "a96d532a-0f87-4b2c-9d1a-c17395751a88"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:15.213128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-006de7d5-1c90-49d2-9cf4-f92c4d1729f7 req-cf816855-bd08-4674-8686-8395d97c1f43 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:15.216337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-006de7d5-1c90-49d2-9cf4-f92c4d1729f7 req-cf816855-bd08-4674-8686-8395d97c1f43 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:15.216882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-006de7d5-1c90-49d2-9cf4-f92c4d1729f7 req-cf816855-bd08-4674-8686-8395d97c1f43 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:15.249902 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-006de7d5-1c90-49d2-9cf4-f92c4d1729f7 req-cf816855-bd08-4674-8686-8395d97c1f43 service nova] Creating event network-changed:a96d532a-0f87-4b2c-9d1a-c17395751a88 for instance b383e2b5-b354-4937-81d5-0593373068e9 on n-h2-856894-1 Sep 10 10:52:15.266136 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-006de7d5-1c90-49d2-9cf4-f92c4d1729f7 req-cf816855-bd08-4674-8686-8395d97c1f43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098011 Sep 10 10:52:15.267910 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2794/3300] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:15.275354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc84d564-b5d9-457a-9d06-1e4cca0da649 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:15.277950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fc84d564-b5d9-457a-9d06-1e4cca0da649 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:15.303477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc84d564-b5d9-457a-9d06-1e4cca0da649 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:15.304278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc84d564-b5d9-457a-9d06-1e4cca0da649 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:15.304847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc84d564-b5d9-457a-9d06-1e4cca0da649 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:15.305715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc84d564-b5d9-457a-9d06-1e4cca0da649 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:15.306265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc84d564-b5d9-457a-9d06-1e4cca0da649 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:15.307342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc84d564-b5d9-457a-9d06-1e4cca0da649 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:16.141293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fc84d564-b5d9-457a-9d06-1e4cca0da649 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:16.150800 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc84d564-b5d9-457a-9d06-1e4cca0da649 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1646 microversion: 2.1 time: 0.881558 Sep 10 10:52:16.161128 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2795/3301] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:15 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1646 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:16.162061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-91fed4bb-4f4e-4bfa-abf5-886bd5120b60 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:16.163198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-91fed4bb-4f4e-4bfa-abf5-886bd5120b60 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:16.206733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91fed4bb-4f4e-4bfa-abf5-886bd5120b60 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:16.209839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91fed4bb-4f4e-4bfa-abf5-886bd5120b60 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:16.210528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91fed4bb-4f4e-4bfa-abf5-886bd5120b60 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:16.214950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91fed4bb-4f4e-4bfa-abf5-886bd5120b60 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:16.218627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91fed4bb-4f4e-4bfa-abf5-886bd5120b60 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:16.219283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-91fed4bb-4f4e-4bfa-abf5-886bd5120b60 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:16.833361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-91fed4bb-4f4e-4bfa-abf5-886bd5120b60 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:16.845718 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-91fed4bb-4f4e-4bfa-abf5-886bd5120b60 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1488 microversion: 2.1 time: 0.693126 Sep 10 10:52:16.846639 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2796/3302] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:16 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1488 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:16.854483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:16.855338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:16.869238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:16.869862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:16.871513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:16.873668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:16.874297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:16.876755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:16.994745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:17.008734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:17.010637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:17.017299 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf052d56-cc7f-4243-bbfb-2277f8e8ab09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.167891 Sep 10 10:52:17.037100 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2797/3303] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:16 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:17.050029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-abb53fd1-9ad5-4244-a74a-890f302b27e9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:17.053830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-abb53fd1-9ad5-4244-a74a-890f302b27e9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:17.086552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abb53fd1-9ad5-4244-a74a-890f302b27e9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:17.087079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abb53fd1-9ad5-4244-a74a-890f302b27e9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:17.087524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abb53fd1-9ad5-4244-a74a-890f302b27e9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:17.088259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abb53fd1-9ad5-4244-a74a-890f302b27e9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:17.088723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abb53fd1-9ad5-4244-a74a-890f302b27e9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:17.096270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abb53fd1-9ad5-4244-a74a-890f302b27e9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:17.164134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:17.172995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:17.404648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-abb53fd1-9ad5-4244-a74a-890f302b27e9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:17.415225 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-abb53fd1-9ad5-4244-a74a-890f302b27e9 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1318 microversion: 2.1 time: 0.389335 Sep 10 10:52:17.415860 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2798/3304] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:17 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:17.421288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-578a471f-0344-4432-9d4f-da097072f333 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:17.424472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-578a471f-0344-4432-9d4f-da097072f333 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:17.431487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-578a471f-0344-4432-9d4f-da097072f333 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:17.433206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-578a471f-0344-4432-9d4f-da097072f333 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:17.433801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-578a471f-0344-4432-9d4f-da097072f333 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:17.434659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-578a471f-0344-4432-9d4f-da097072f333 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:17.435264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-578a471f-0344-4432-9d4f-da097072f333 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:17.435921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-578a471f-0344-4432-9d4f-da097072f333 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:17.441107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:17.945866 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-578a471f-0344-4432-9d4f-da097072f333 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 200 len: 166 microversion: 2.1 time: 0.528044 Sep 10 10:52:17.947103 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2799/3305] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:52:17 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 166 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:17.955349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:17.956268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:17.983113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:17.988410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:17.989479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:17.991733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:17.996191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:17.996813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:18.130056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:18.130588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:18.131027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:18.131483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lazy-loading 'fault' on Instance uuid 07cffeb4-50b7-434d-be36-a6b74c2e750f {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:52:18.687697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1c03592e40a38dea70af40a8bd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b82ad978e47479334031e215abdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:18.701766 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9293fda-752e-4d0b-83b2-a0aaa2d23d9a tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 200 len: 1304 microversion: 2.1 time: 0.751392 Sep 10 10:52:18.705630 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2800/3306] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:17 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 1304 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:18.723491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5b8f27b1-02b1-4d1e-95a7-8bafad672aa4 req-c423a1bd-14ea-435e-af53-85bff930090b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cffeb4-50b7-434d-be36-a6b74c2e750f", "name": "network-vif-deleted", "tag": "193980e0-7ce9-46fe-ab55-1a5fdaabb1fe"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:18.752233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b8f27b1-02b1-4d1e-95a7-8bafad672aa4 req-c423a1bd-14ea-435e-af53-85bff930090b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:18.753565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b8f27b1-02b1-4d1e-95a7-8bafad672aa4 req-c423a1bd-14ea-435e-af53-85bff930090b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:18.755112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b8f27b1-02b1-4d1e-95a7-8bafad672aa4 req-c423a1bd-14ea-435e-af53-85bff930090b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:18.780697 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5b8f27b1-02b1-4d1e-95a7-8bafad672aa4 req-c423a1bd-14ea-435e-af53-85bff930090b service nova] Creating event network-vif-deleted:193980e0-7ce9-46fe-ab55-1a5fdaabb1fe for instance 07cffeb4-50b7-434d-be36-a6b74c2e750f on n-h2-856894-1 Sep 10 10:52:18.794998 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5b8f27b1-02b1-4d1e-95a7-8bafad672aa4 req-c423a1bd-14ea-435e-af53-85bff930090b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084817 Sep 10 10:52:18.800124 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2801/3307] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:18.825830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2bec8a0b-ee22-4252-89c9-b72b1aecd7cb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:18.828048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2bec8a0b-ee22-4252-89c9-b72b1aecd7cb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:18.846023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bec8a0b-ee22-4252-89c9-b72b1aecd7cb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:18.847846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bec8a0b-ee22-4252-89c9-b72b1aecd7cb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:18.849968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bec8a0b-ee22-4252-89c9-b72b1aecd7cb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:18.851333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bec8a0b-ee22-4252-89c9-b72b1aecd7cb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:18.853001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bec8a0b-ee22-4252-89c9-b72b1aecd7cb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:18.854594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2bec8a0b-ee22-4252-89c9-b72b1aecd7cb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:19.523437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2bec8a0b-ee22-4252-89c9-b72b1aecd7cb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:19.536777 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2bec8a0b-ee22-4252-89c9-b72b1aecd7cb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.733711 Sep 10 10:52:19.537447 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2802/3308] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:18 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:19.561973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:19.563007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:19.580693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:19.583150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:19.583843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:19.585057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:19.587107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:19.588316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:20.136633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:20.147116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:20.149383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:20.156188 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc56911c-3c25-4ab2-ac60-04ee15f20bd7 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1560 microversion: 2.91 time: 0.606599 Sep 10 10:52:20.169976 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2803/3309] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:19 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1560 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:20.177222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a4e8517-faee-4550-b950-2fce6e69d482 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:20.178234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a4e8517-faee-4550-b950-2fce6e69d482 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:20.191115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a4e8517-faee-4550-b950-2fce6e69d482 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:20.191990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a4e8517-faee-4550-b950-2fce6e69d482 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:20.192868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a4e8517-faee-4550-b950-2fce6e69d482 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:20.194703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a4e8517-faee-4550-b950-2fce6e69d482 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:20.197031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a4e8517-faee-4550-b950-2fce6e69d482 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:20.198087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a4e8517-faee-4550-b950-2fce6e69d482 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:20.417903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a4e8517-faee-4550-b950-2fce6e69d482 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:20.431559 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a4e8517-faee-4550-b950-2fce6e69d482 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1318 microversion: 2.1 time: 0.259773 Sep 10 10:52:20.451686 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2804/3310] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:20 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:20.464480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05efd377-d098-4173-b3e6-aaeb67115e0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:20.465477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05efd377-d098-4173-b3e6-aaeb67115e0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:20.476518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05efd377-d098-4173-b3e6-aaeb67115e0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:20.477715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05efd377-d098-4173-b3e6-aaeb67115e0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:20.478379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05efd377-d098-4173-b3e6-aaeb67115e0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:20.480127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05efd377-d098-4173-b3e6-aaeb67115e0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:20.482428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05efd377-d098-4173-b3e6-aaeb67115e0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:20.483174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05efd377-d098-4173-b3e6-aaeb67115e0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:20.666067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05efd377-d098-4173-b3e6-aaeb67115e0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:20.689791 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05efd377-d098-4173-b3e6-aaeb67115e0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.228939 Sep 10 10:52:20.691292 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2805/3311] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:20 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:20.701721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:20.704570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] [instance: 07cffeb4-50b7-434d-be36-a6b74c2e750f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:20.717867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:20.720349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:20.721017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:20.722201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:20.724646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:20.725891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:20.768605 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] HTTP exception thrown: Instance 07cffeb4-50b7-434d-be36-a6b74c2e750f could not be found. Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Request method failure captured: Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f HTTP/1.1 Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGwGnYaCO0jCZq24gCDWBCR2qcyFWQP62roWCw78zB4e4pkzL0rzTx3PZWydQ7VGd3WeGevpscE9-rAKcPzr0mMA4Hjz75qRVDKuB0yVvfwbBcMuBKMr8Q4kE6WxAxdzHj6EcgDNzWHLpH-HW-BXRBGWHWso_A-R9oCm363E9dRcc0M Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684b82ad978e47479334031e215abdc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684b82ad978e47479334031e215abdc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684b82ad978e47479334031e215abdc1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 684b82ad978e47479334031e215abdc1 Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1807043138 Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e9cd1c03592e40a38dea70af40a8bd7b Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsTestJSON-1807043138-project Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 07cffeb4-50b7-434d-be36-a6b74c2e750f could not be found. Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '07cffeb4-50b7-434d-be36-a6b74c2e750f'} Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07cffeb4-50b7-434d-be36-a6b74c2e750f could not be found. Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07cffeb4-50b7-434d-be36-a6b74c2e750f could not be found. Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:20.772544 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:20.777367 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:20.777367 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:20.777367 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:20.777367 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:20.777367 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:20.777367 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07cffeb4-50b7-434d-be36-a6b74c2e750f could not be found. Sep 10 10:52:20.777367 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:20.777367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Returning 404 to user: Instance 07cffeb4-50b7-434d-be36-a6b74c2e750f could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:20.777367 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a3b5ab8-2366-4ef7-b4c4-ae786310758e tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f" status: 404 len: 111 microversion: 2.1 time: 0.080073 Sep 10 10:52:20.779997 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2806/3312] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:20 2022] GET /compute/v2.1/servers/07cffeb4-50b7-434d-be36-a6b74c2e750f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:20.789521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85ba3261-0237-4a79-a437-52eeac7c54e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:20.791165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-85ba3261-0237-4a79-a437-52eeac7c54e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:20.824487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85ba3261-0237-4a79-a437-52eeac7c54e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:20.826497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85ba3261-0237-4a79-a437-52eeac7c54e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:20.828967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85ba3261-0237-4a79-a437-52eeac7c54e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:20.830726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85ba3261-0237-4a79-a437-52eeac7c54e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:20.834866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85ba3261-0237-4a79-a437-52eeac7c54e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:20.836804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85ba3261-0237-4a79-a437-52eeac7c54e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:21.067356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-85ba3261-0237-4a79-a437-52eeac7c54e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:21.085278 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85ba3261-0237-4a79-a437-52eeac7c54e2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.303231 Sep 10 10:52:21.087136 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2807/3313] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:20 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:21.097120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6dc27d10-600c-4324-aa23-fbd77228cb55 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcad8bcb80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:21.512471 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6dc27d10-600c-4324-aa23-fbd77228cb55 tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1cb4bc51-8675-441a-a2c4-3cfa0114250e" status: 202 len: 0 microversion: 2.1 time: 0.424010 Sep 10 10:52:21.516627 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2808/3314] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:21 2022] DELETE /compute/v2.1/os-security-groups/1cb4bc51-8675-441a-a2c4-3cfa0114250e => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:52:21.520831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8944eb7b-5fc0-4216-892a-dbec3f022850 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:21.523854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8944eb7b-5fc0-4216-892a-dbec3f022850 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:21.547507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8944eb7b-5fc0-4216-892a-dbec3f022850 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:21.548126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8944eb7b-5fc0-4216-892a-dbec3f022850 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:21.552208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8944eb7b-5fc0-4216-892a-dbec3f022850 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:21.553194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8944eb7b-5fc0-4216-892a-dbec3f022850 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:21.554269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8944eb7b-5fc0-4216-892a-dbec3f022850 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:21.554811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8944eb7b-5fc0-4216-892a-dbec3f022850 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:21.885204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8944eb7b-5fc0-4216-892a-dbec3f022850 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:21.898597 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8944eb7b-5fc0-4216-892a-dbec3f022850 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.382321 Sep 10 10:52:21.900865 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2809/3315] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:21 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:21.914415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:21.916159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:21.929275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:21.934362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:21.935183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:21.937426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:21.939356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:21.940092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:22.072701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:22.082487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:22.089765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:22.101428 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d90c133d-edad-4766-a00b-c9d0e468f77f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.196690 Sep 10 10:52:22.116906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2810/3316] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:21 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:22.116906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c3be8ab-4846-48e9-a657-e504e667ff1a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:22.116906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c3be8ab-4846-48e9-a657-e504e667ff1a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:22.133475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c3be8ab-4846-48e9-a657-e504e667ff1a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:22.133975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c3be8ab-4846-48e9-a657-e504e667ff1a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:22.134425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c3be8ab-4846-48e9-a657-e504e667ff1a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:22.137547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c3be8ab-4846-48e9-a657-e504e667ff1a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:22.137796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c3be8ab-4846-48e9-a657-e504e667ff1a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:22.138246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c3be8ab-4846-48e9-a657-e504e667ff1a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:22.433989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c3be8ab-4846-48e9-a657-e504e667ff1a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:22.446832 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c3be8ab-4846-48e9-a657-e504e667ff1a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1318 microversion: 2.1 time: 0.341446 Sep 10 10:52:22.448078 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2811/3317] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:22 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:22.454498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7efeabb2-fd3f-4848-aa23-f598049eb1aa tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] Calling method '.version_select at 0x7efcad8a2a60>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:22.733485 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7efeabb2-fd3f-4848-aa23-f598049eb1aa tempest-SecurityGroupsTestJSON-1807043138 tempest-SecurityGroupsTestJSON-1807043138-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ddc63294-8228-484a-bc08-3791c99a6026" status: 202 len: 0 microversion: 2.1 time: 0.283564 Sep 10 10:52:22.734062 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2812/3318] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:52:22 2022] DELETE /compute/v2.1/os-security-groups/ddc63294-8228-484a-bc08-3791c99a6026 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:52:23.129728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-142002846", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "911c37f7-035d-45d6-8f56-b6c556f84e6e"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:23.270571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] validate_networks() for [('911c37f7-035d-45d6-8f56-b6c556f84e6e', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:52:24.116034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:52:24.116583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:52:24.116864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:52:24.117318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:52:24.118196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:52:24.146078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:24.147907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:24.148378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:24.152192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:24.152695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:24.153648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:24.203372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Getting quotas for project e4b825118b2b472e9fd6c42aff0413a0. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:52:24.219189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:24.224864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Getting quotas for user 9c7786c4e8374bb0975d7ce2d9b16c7e and project e4b825118b2b472e9fd6c42aff0413a0. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:52:24.270039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:52:24.274462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:52:24.397115 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e8bfc86-7355-4095-a149-8db0bde2ba55 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654704 Sep 10 10:52:24.409596 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2813/3319] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:52:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:52:24.416063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f171a12d-fb06-422f-a571-2896caf65889 req-b37a58a1-0b49-4b32-b726-759428a1f34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b383e2b5-b354-4937-81d5-0593373068e9", "name": "network-vif-plugged", "status": "completed", "tag": "a96d532a-0f87-4b2c-9d1a-c17395751a88"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:24.438191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f171a12d-fb06-422f-a571-2896caf65889 req-b37a58a1-0b49-4b32-b726-759428a1f34d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:24.444602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f171a12d-fb06-422f-a571-2896caf65889 req-b37a58a1-0b49-4b32-b726-759428a1f34d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:24.445271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f171a12d-fb06-422f-a571-2896caf65889 req-b37a58a1-0b49-4b32-b726-759428a1f34d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:24.464121 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f171a12d-fb06-422f-a571-2896caf65889 req-b37a58a1-0b49-4b32-b726-759428a1f34d service nova] Creating event network-vif-plugged:a96d532a-0f87-4b2c-9d1a-c17395751a88 for instance b383e2b5-b354-4937-81d5-0593373068e9 on n-h2-856894-1 Sep 10 10:52:24.470699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f171a12d-fb06-422f-a571-2896caf65889 req-b37a58a1-0b49-4b32-b726-759428a1f34d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058375 Sep 10 10:52:24.471707 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2814/3320] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:24.486589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-563033187", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "17605326-3d0c-4135-8b61-c2da6b77cdca"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:24.587658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] validate_networks() for [('17605326-3d0c-4135-8b61-c2da6b77cdca', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:52:25.762543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:52:25.763169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:52:25.764034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:52:25.764512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:52:25.764937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:52:25.786448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:25.788738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:25.790467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:25.793504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:25.794152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:25.794743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:25.841852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for project 524c87c1679a4651a4e303650950283c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:52:25.860652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for user 2cccb6588d07459eb1cfa9c00f53f7e2 and project 524c87c1679a4651a4e303650950283c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:52:25.891939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:52:25.900798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:52:26.041747 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7295d897-aa93-4999-9020-2b87126c6b94 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566076 Sep 10 10:52:26.047270 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2815/3321] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:52:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:52:26.056760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:26.062031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:26.076472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:26.080126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:26.080690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:26.082901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:26.083575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:26.086960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:26.300811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:26.322854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:26.343850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:26.365234 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa3850a6-4df9-4aa4-a7b4-0d4bbf433abd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.314663 Sep 10 10:52:26.368459 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2816/3322] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:26 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:26.381862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c5d0907-d4a9-4730-8652-bc3835a1265a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:26.382587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c5d0907-d4a9-4730-8652-bc3835a1265a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:26.408815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c5d0907-d4a9-4730-8652-bc3835a1265a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:26.409430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c5d0907-d4a9-4730-8652-bc3835a1265a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:26.410174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c5d0907-d4a9-4730-8652-bc3835a1265a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:26.411091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c5d0907-d4a9-4730-8652-bc3835a1265a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:26.427165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c5d0907-d4a9-4730-8652-bc3835a1265a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:26.443767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c5d0907-d4a9-4730-8652-bc3835a1265a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:26.941063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c5d0907-d4a9-4730-8652-bc3835a1265a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:26.969564 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c5d0907-d4a9-4730-8652-bc3835a1265a tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1318 microversion: 2.1 time: 0.595490 Sep 10 10:52:26.970258 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2817/3323] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:26 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:27.001991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d235a9d-b36b-4b54-980e-c8935a7d4717 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:27.005516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d235a9d-b36b-4b54-980e-c8935a7d4717 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:27.026156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d235a9d-b36b-4b54-980e-c8935a7d4717 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:27.026658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d235a9d-b36b-4b54-980e-c8935a7d4717 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:27.031729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d235a9d-b36b-4b54-980e-c8935a7d4717 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:27.034292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d235a9d-b36b-4b54-980e-c8935a7d4717 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:27.037631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d235a9d-b36b-4b54-980e-c8935a7d4717 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:27.038278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d235a9d-b36b-4b54-980e-c8935a7d4717 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:27.228477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6d235a9d-b36b-4b54-980e-c8935a7d4717 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:27.240632 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6d235a9d-b36b-4b54-980e-c8935a7d4717 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1279 microversion: 2.1 time: 0.266529 Sep 10 10:52:27.241482 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2818/3324] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:26 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1279 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:27.273129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7e50b92b-af10-4d3c-82aa-d8f823086d44 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:27.273728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e50b92b-af10-4d3c-82aa-d8f823086d44 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:27.455693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e50b92b-af10-4d3c-82aa-d8f823086d44 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:27.470386 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7e50b92b-af10-4d3c-82aa-d8f823086d44 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1214 microversion: 2.1 time: 0.202820 Sep 10 10:52:27.473449 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2819/3325] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:27 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:27.502108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:27.512324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:27.553004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:27.565251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:27.565924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:27.567256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:27.567733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:27.584404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:27.881914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:27.896021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:27.900843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:27.916213 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a701aa64-d32b-48e5-86de-770dcebc2f80 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.439447 Sep 10 10:52:27.934032 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2820/3326] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:27 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:27.998680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5604f38b-a3cd-4129-97f6-c6f886c04dfa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:27.999975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5604f38b-a3cd-4129-97f6-c6f886c04dfa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:28.015164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5604f38b-a3cd-4129-97f6-c6f886c04dfa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:28.015982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5604f38b-a3cd-4129-97f6-c6f886c04dfa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:28.016595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5604f38b-a3cd-4129-97f6-c6f886c04dfa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:28.017497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5604f38b-a3cd-4129-97f6-c6f886c04dfa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:28.018472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5604f38b-a3cd-4129-97f6-c6f886c04dfa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:28.019047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5604f38b-a3cd-4129-97f6-c6f886c04dfa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:28.510378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5604f38b-a3cd-4129-97f6-c6f886c04dfa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:28.528582 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5604f38b-a3cd-4129-97f6-c6f886c04dfa tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1508 microversion: 2.1 time: 0.532633 Sep 10 10:52:28.554298 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2821/3327] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:27 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1508 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:52:28.566362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a78fa4d-0e28-4cca-bfc8-f7410f88ed50 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:28.568647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a78fa4d-0e28-4cca-bfc8-f7410f88ed50 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:28.597454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a78fa4d-0e28-4cca-bfc8-f7410f88ed50 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:28.600075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a78fa4d-0e28-4cca-bfc8-f7410f88ed50 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:28.601005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a78fa4d-0e28-4cca-bfc8-f7410f88ed50 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:28.603306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a78fa4d-0e28-4cca-bfc8-f7410f88ed50 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:28.604649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a78fa4d-0e28-4cca-bfc8-f7410f88ed50 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:28.605808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a78fa4d-0e28-4cca-bfc8-f7410f88ed50 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:28.663802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:28.756582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a78fa4d-0e28-4cca-bfc8-f7410f88ed50 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:28.777475 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a78fa4d-0e28-4cca-bfc8-f7410f88ed50 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1285 microversion: 2.1 time: 0.221622 Sep 10 10:52:28.780332 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2822/3328] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:28 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:28.786084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6afc5a1-049a-4001-b4db-66b9f4bd68d3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:28.786958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b6afc5a1-049a-4001-b4db-66b9f4bd68d3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:28.802959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6afc5a1-049a-4001-b4db-66b9f4bd68d3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:28.806423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6afc5a1-049a-4001-b4db-66b9f4bd68d3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:28.809681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6afc5a1-049a-4001-b4db-66b9f4bd68d3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:28.813905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6afc5a1-049a-4001-b4db-66b9f4bd68d3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:28.817880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6afc5a1-049a-4001-b4db-66b9f4bd68d3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:28.818446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6afc5a1-049a-4001-b4db-66b9f4bd68d3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:29.043644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b6afc5a1-049a-4001-b4db-66b9f4bd68d3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:29.067109 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b6afc5a1-049a-4001-b4db-66b9f4bd68d3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1266 microversion: 2.1 time: 0.285114 Sep 10 10:52:29.070724 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2823/3329] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:28 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:29.080714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14d033c2-a5b1-47b0-98e2-3ec82ccf5adf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:29.081592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14d033c2-a5b1-47b0-98e2-3ec82ccf5adf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:29.100236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14d033c2-a5b1-47b0-98e2-3ec82ccf5adf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:29.106409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14d033c2-a5b1-47b0-98e2-3ec82ccf5adf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:29.109480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14d033c2-a5b1-47b0-98e2-3ec82ccf5adf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:29.110208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14d033c2-a5b1-47b0-98e2-3ec82ccf5adf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:29.113945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14d033c2-a5b1-47b0-98e2-3ec82ccf5adf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:29.114515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14d033c2-a5b1-47b0-98e2-3ec82ccf5adf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:30.506216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14d033c2-a5b1-47b0-98e2-3ec82ccf5adf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:30.515540 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14d033c2-a5b1-47b0-98e2-3ec82ccf5adf tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1508 microversion: 2.1 time: 1.443505 Sep 10 10:52:30.521583 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2824/3330] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:29 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1508 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:30.528244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:30.545985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:30.570894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:30.574619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:30.575421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:30.580467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:30.581763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:30.587114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:30.989898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:31.002920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:31.009317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:31.024481 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8acfd44b-0dea-466f-b9d9-56aebc591c37 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.499484 Sep 10 10:52:31.043693 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2825/3331] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:30 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:31.064356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63a115b5-3286-4933-94b6-bf3e5241b1b2 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:31.067353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63a115b5-3286-4933-94b6-bf3e5241b1b2 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:31.076801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a115b5-3286-4933-94b6-bf3e5241b1b2 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:31.077602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a115b5-3286-4933-94b6-bf3e5241b1b2 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:31.079197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a115b5-3286-4933-94b6-bf3e5241b1b2 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:31.080374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a115b5-3286-4933-94b6-bf3e5241b1b2 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:31.081004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a115b5-3286-4933-94b6-bf3e5241b1b2 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:31.084174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63a115b5-3286-4933-94b6-bf3e5241b1b2 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:31.327730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63a115b5-3286-4933-94b6-bf3e5241b1b2 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:31.347933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63a115b5-3286-4933-94b6-bf3e5241b1b2 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1285 microversion: 2.1 time: 0.300090 Sep 10 10:52:31.367087 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2826/3332] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:31 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1285 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:31.378369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14e220af-dab3-4518-9185-3719ba647c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:31.382134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14e220af-dab3-4518-9185-3719ba647c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:31.420639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e220af-dab3-4518-9185-3719ba647c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:31.421471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e220af-dab3-4518-9185-3719ba647c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:31.423918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e220af-dab3-4518-9185-3719ba647c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:31.429419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e220af-dab3-4518-9185-3719ba647c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:31.430296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e220af-dab3-4518-9185-3719ba647c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:31.430963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14e220af-dab3-4518-9185-3719ba647c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:31.959975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14e220af-dab3-4518-9185-3719ba647c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:31.977986 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14e220af-dab3-4518-9185-3719ba647c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1272 microversion: 2.1 time: 0.609012 Sep 10 10:52:31.979525 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2827/3333] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:31 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1272 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:31.999666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d8254cc-2d1c-4a75-ae7b-76704e6b8cb3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:32.002371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d8254cc-2d1c-4a75-ae7b-76704e6b8cb3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:32.017802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d8254cc-2d1c-4a75-ae7b-76704e6b8cb3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:32.018611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d8254cc-2d1c-4a75-ae7b-76704e6b8cb3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:32.020270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d8254cc-2d1c-4a75-ae7b-76704e6b8cb3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:32.021278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d8254cc-2d1c-4a75-ae7b-76704e6b8cb3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:32.021947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d8254cc-2d1c-4a75-ae7b-76704e6b8cb3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:32.022598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d8254cc-2d1c-4a75-ae7b-76704e6b8cb3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:32.204899 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d8254cc-2d1c-4a75-ae7b-76704e6b8cb3 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "PUT /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1080 microversion: 2.1 time: 0.223889 Sep 10 10:52:32.205650 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2828/3334] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Sep 10 10:52:31 2022] PUT /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1080 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:32.222066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:32.222733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:32.232325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:32.232813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:32.233315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:32.234172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:32.238753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:32.239514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:32.397813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:32.406742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:32.411694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:32.428708 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c56dcb7c-e719-4b19-a392-972168bd514a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.221931 Sep 10 10:52:32.433410 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2829/3335] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:32 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:32.438321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97a37d29-a895-41b8-89b9-700fda08d844 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:32.445955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-97a37d29-a895-41b8-89b9-700fda08d844 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:32.460836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a37d29-a895-41b8-89b9-700fda08d844 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:32.463031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a37d29-a895-41b8-89b9-700fda08d844 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:32.464736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a37d29-a895-41b8-89b9-700fda08d844 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:32.465708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a37d29-a895-41b8-89b9-700fda08d844 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:32.467771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a37d29-a895-41b8-89b9-700fda08d844 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:32.468398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97a37d29-a895-41b8-89b9-700fda08d844 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:33.101905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-97a37d29-a895-41b8-89b9-700fda08d844 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:33.118539 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-97a37d29-a895-41b8-89b9-700fda08d844 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1506 microversion: 2.1 time: 0.676908 Sep 10 10:52:33.150955 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2830/3336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:32 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1506 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:33.197116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d12128c4-2388-4ebd-a5aa-24d3dc31635f tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:33.199227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d12128c4-2388-4ebd-a5aa-24d3dc31635f tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:33.241789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d12128c4-2388-4ebd-a5aa-24d3dc31635f tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:33.242208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d12128c4-2388-4ebd-a5aa-24d3dc31635f tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:33.242654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d12128c4-2388-4ebd-a5aa-24d3dc31635f tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:33.246870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d12128c4-2388-4ebd-a5aa-24d3dc31635f tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:33.247460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d12128c4-2388-4ebd-a5aa-24d3dc31635f tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:33.247919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d12128c4-2388-4ebd-a5aa-24d3dc31635f tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:34.190575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d12128c4-2388-4ebd-a5aa-24d3dc31635f tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:34.200271 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d12128c4-2388-4ebd-a5aa-24d3dc31635f tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1327 microversion: 2.1 time: 1.047237 Sep 10 10:52:34.203871 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2831/3337] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:33 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1327 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:34.215008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f23cf5a-9a2b-45c1-8314-828599b22255 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:34.225103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f23cf5a-9a2b-45c1-8314-828599b22255 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:34.231487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f23cf5a-9a2b-45c1-8314-828599b22255 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:34.232184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f23cf5a-9a2b-45c1-8314-828599b22255 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:34.232799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f23cf5a-9a2b-45c1-8314-828599b22255 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:34.233695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f23cf5a-9a2b-45c1-8314-828599b22255 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:34.234306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f23cf5a-9a2b-45c1-8314-828599b22255 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:34.252099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f23cf5a-9a2b-45c1-8314-828599b22255 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:35.003719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f23cf5a-9a2b-45c1-8314-828599b22255 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:35.014600 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f23cf5a-9a2b-45c1-8314-828599b22255 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1314 microversion: 2.1 time: 0.808057 Sep 10 10:52:35.017730 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2832/3338] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:34 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:35.034282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-67f230dd-4154-441e-ad96-27f5eaccd2dd tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:35.034827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-67f230dd-4154-441e-ad96-27f5eaccd2dd tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:35.050010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67f230dd-4154-441e-ad96-27f5eaccd2dd tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:35.050593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67f230dd-4154-441e-ad96-27f5eaccd2dd tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:35.051511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67f230dd-4154-441e-ad96-27f5eaccd2dd tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:35.052232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67f230dd-4154-441e-ad96-27f5eaccd2dd tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:35.062070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67f230dd-4154-441e-ad96-27f5eaccd2dd tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:35.062517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67f230dd-4154-441e-ad96-27f5eaccd2dd tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:35.821374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:36.027058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-67f230dd-4154-441e-ad96-27f5eaccd2dd tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:36.043239 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-67f230dd-4154-441e-ad96-27f5eaccd2dd tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1506 microversion: 2.1 time: 1.023788 Sep 10 10:52:36.045438 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2833/3339] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:35 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1506 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:36.062156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:36.062980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:36.076216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:36.076880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:36.077246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:36.080095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:36.080593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:36.081045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:36.577853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:36.587349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:36.588891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:36.614230 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c73420d6-3b4e-486f-8ff8-ddac969f8136 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.567656 Sep 10 10:52:36.617821 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2834/3340] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:36 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:36.626623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2d4773e5-8b1d-4b73-8499-faf3d63f5887 req-f63856ff-7315-423a-9b2d-9fb02f6abf09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988", "tag": "51864780-4e5c-4a4a-b179-dec63ff71462"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:36.691633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2d4773e5-8b1d-4b73-8499-faf3d63f5887 req-f63856ff-7315-423a-9b2d-9fb02f6abf09 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:36.692137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2d4773e5-8b1d-4b73-8499-faf3d63f5887 req-f63856ff-7315-423a-9b2d-9fb02f6abf09 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:36.692577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2d4773e5-8b1d-4b73-8499-faf3d63f5887 req-f63856ff-7315-423a-9b2d-9fb02f6abf09 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:36.732640 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2d4773e5-8b1d-4b73-8499-faf3d63f5887 req-f63856ff-7315-423a-9b2d-9fb02f6abf09 service nova] Creating event network-changed:51864780-4e5c-4a4a-b179-dec63ff71462 for instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 on n-h2-856894-1 Sep 10 10:52:36.761486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2d4773e5-8b1d-4b73-8499-faf3d63f5887 req-f63856ff-7315-423a-9b2d-9fb02f6abf09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141385 Sep 10 10:52:36.765465 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2835/3341] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:36.775055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ad997f0-419e-4ab4-aae6-034fb5ee63ad tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:36.775962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3ad997f0-419e-4ab4-aae6-034fb5ee63ad tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:36.791714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ad997f0-419e-4ab4-aae6-034fb5ee63ad tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:36.793976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ad997f0-419e-4ab4-aae6-034fb5ee63ad tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:36.795458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ad997f0-419e-4ab4-aae6-034fb5ee63ad tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:36.797904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ad997f0-419e-4ab4-aae6-034fb5ee63ad tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:36.805845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ad997f0-419e-4ab4-aae6-034fb5ee63ad tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:36.808190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ad997f0-419e-4ab4-aae6-034fb5ee63ad tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:37.462134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=14 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:37.623468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3ad997f0-419e-4ab4-aae6-034fb5ee63ad tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:37.636259 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3ad997f0-419e-4ab4-aae6-034fb5ee63ad tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1327 microversion: 2.1 time: 0.869534 Sep 10 10:52:37.653290 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2836/3342] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:36 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1327 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:37.663675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-da620c89-0e70-416b-ba3b-132d6c88d11d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:37.666860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-da620c89-0e70-416b-ba3b-132d6c88d11d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:37.691113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da620c89-0e70-416b-ba3b-132d6c88d11d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:37.699799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da620c89-0e70-416b-ba3b-132d6c88d11d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:37.700498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da620c89-0e70-416b-ba3b-132d6c88d11d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:37.702962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da620c89-0e70-416b-ba3b-132d6c88d11d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:37.703675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da620c89-0e70-416b-ba3b-132d6c88d11d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:37.705574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-da620c89-0e70-416b-ba3b-132d6c88d11d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:38.660891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-da620c89-0e70-416b-ba3b-132d6c88d11d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:38.678906 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-da620c89-0e70-416b-ba3b-132d6c88d11d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1314 microversion: 2.1 time: 1.035261 Sep 10 10:52:38.698906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2837/3343] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:37 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1314 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:38.718269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-acbf5a45-5501-473d-ad23-d2dd905c2b80 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:38.721559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-acbf5a45-5501-473d-ad23-d2dd905c2b80 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:38.730578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acbf5a45-5501-473d-ad23-d2dd905c2b80 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:38.733422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acbf5a45-5501-473d-ad23-d2dd905c2b80 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:38.735233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acbf5a45-5501-473d-ad23-d2dd905c2b80 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:38.736431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acbf5a45-5501-473d-ad23-d2dd905c2b80 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:38.737095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acbf5a45-5501-473d-ad23-d2dd905c2b80 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:38.738610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acbf5a45-5501-473d-ad23-d2dd905c2b80 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:38.802951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:38.852020 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-acbf5a45-5501-473d-ad23-d2dd905c2b80 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "PUT /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1082 microversion: 2.1 time: 0.151838 Sep 10 10:52:38.852828 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2838/3344] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Sep 10 10:52:38 2022] PUT /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1082 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:38.943939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:38.945542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:38.961379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:38.962143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:38.964876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:38.983552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:38.984780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:38.986521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:39.288138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:39.302352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:39.309732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:39.324977 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9926f1f8-fa74-4d6b-9ffd-142d199e8bc9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.437284 Sep 10 10:52:39.326295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2839/3345] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:38 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:39.336095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-229b3ba7-6fbe-4ce6-bce8-3d0ce28bc260 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:39.337877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-229b3ba7-6fbe-4ce6-bce8-3d0ce28bc260 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:39.363035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-229b3ba7-6fbe-4ce6-bce8-3d0ce28bc260 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:39.364596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-229b3ba7-6fbe-4ce6-bce8-3d0ce28bc260 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:39.366505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-229b3ba7-6fbe-4ce6-bce8-3d0ce28bc260 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:39.367417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-229b3ba7-6fbe-4ce6-bce8-3d0ce28bc260 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:39.368820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-229b3ba7-6fbe-4ce6-bce8-3d0ce28bc260 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:39.371232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-229b3ba7-6fbe-4ce6-bce8-3d0ce28bc260 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:40.713152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-229b3ba7-6fbe-4ce6-bce8-3d0ce28bc260 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:40.725722 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-229b3ba7-6fbe-4ce6-bce8-3d0ce28bc260 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1327 microversion: 2.1 time: 1.394653 Sep 10 10:52:40.728838 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2840/3346] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:39 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1327 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:40.745395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3ea4a3a-6e80-4a96-a999-577051bb9c79 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:40.746683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e3ea4a3a-6e80-4a96-a999-577051bb9c79 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:40.755037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ea4a3a-6e80-4a96-a999-577051bb9c79 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:40.767638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ea4a3a-6e80-4a96-a999-577051bb9c79 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:40.773964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ea4a3a-6e80-4a96-a999-577051bb9c79 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:40.776282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ea4a3a-6e80-4a96-a999-577051bb9c79 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:40.777344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ea4a3a-6e80-4a96-a999-577051bb9c79 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:40.779474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ea4a3a-6e80-4a96-a999-577051bb9c79 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:41.332658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e3ea4a3a-6e80-4a96-a999-577051bb9c79 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:41.345816 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3ea4a3a-6e80-4a96-a999-577051bb9c79 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1508 microversion: 2.1 time: 0.615741 Sep 10 10:52:41.346416 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2841/3347] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:40 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1508 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:41.378000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3d47a72e-9a90-428a-9a28-5ab11076bafa req-161caebf-7ec7-4e95-9ded-cad4f2e48eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6034e33-1269-4d6c-81a9-8a8f101bf8b1", "tag": "a220a107-c19a-4688-b299-339f7e0fbdb2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:41.419820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d47a72e-9a90-428a-9a28-5ab11076bafa req-161caebf-7ec7-4e95-9ded-cad4f2e48eea service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:41.422092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d47a72e-9a90-428a-9a28-5ab11076bafa req-161caebf-7ec7-4e95-9ded-cad4f2e48eea service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:41.422637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d47a72e-9a90-428a-9a28-5ab11076bafa req-161caebf-7ec7-4e95-9ded-cad4f2e48eea service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:41.463423 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3d47a72e-9a90-428a-9a28-5ab11076bafa req-161caebf-7ec7-4e95-9ded-cad4f2e48eea service nova] Creating event network-changed:a220a107-c19a-4688-b299-339f7e0fbdb2 for instance f6034e33-1269-4d6c-81a9-8a8f101bf8b1 on n-h2-856894-1 Sep 10 10:52:41.503119 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3d47a72e-9a90-428a-9a28-5ab11076bafa req-161caebf-7ec7-4e95-9ded-cad4f2e48eea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139283 Sep 10 10:52:41.505195 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2842/3348] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:41.526892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-060e7635-9a2f-4e83-9ba4-75eb8249adf5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:41.530218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-060e7635-9a2f-4e83-9ba4-75eb8249adf5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:41.538895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-060e7635-9a2f-4e83-9ba4-75eb8249adf5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:41.539987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-060e7635-9a2f-4e83-9ba4-75eb8249adf5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:41.540680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-060e7635-9a2f-4e83-9ba4-75eb8249adf5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:41.541915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-060e7635-9a2f-4e83-9ba4-75eb8249adf5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:41.542600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-060e7635-9a2f-4e83-9ba4-75eb8249adf5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:41.543261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-060e7635-9a2f-4e83-9ba4-75eb8249adf5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:42.230934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-060e7635-9a2f-4e83-9ba4-75eb8249adf5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:42.246738 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-060e7635-9a2f-4e83-9ba4-75eb8249adf5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1314 microversion: 2.1 time: 0.739005 Sep 10 10:52:42.249017 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2843/3349] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:41 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:42.265452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:42.266544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:42.286523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:42.288957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:42.289656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:42.290715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:42.292120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:42.294650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:42.559605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:42.577509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:42.582356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:42.597419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:42.607233 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-937d2f0e-8949-4e89-be32-1eff738ee037 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.350658 Sep 10 10:52:42.608617 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2844/3350] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:42 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:42.620082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6fec5002-5d07-47e4-956b-3ccf72e0d23b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:42.621106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6fec5002-5d07-47e4-956b-3ccf72e0d23b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:42.635162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fec5002-5d07-47e4-956b-3ccf72e0d23b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:42.636378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fec5002-5d07-47e4-956b-3ccf72e0d23b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:42.641914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fec5002-5d07-47e4-956b-3ccf72e0d23b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:42.643211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fec5002-5d07-47e4-956b-3ccf72e0d23b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:42.644301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fec5002-5d07-47e4-956b-3ccf72e0d23b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:42.644964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fec5002-5d07-47e4-956b-3ccf72e0d23b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:43.047874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6fec5002-5d07-47e4-956b-3ccf72e0d23b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:43.058131 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6fec5002-5d07-47e4-956b-3ccf72e0d23b tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1508 microversion: 2.1 time: 0.448125 Sep 10 10:52:43.062809 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2845/3351] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:42 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1508 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:43.069289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9986cecd-a64d-43db-821f-fe60a34c8143 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:43.074746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9986cecd-a64d-43db-821f-fe60a34c8143 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:43.089333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9986cecd-a64d-43db-821f-fe60a34c8143 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:43.096192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9986cecd-a64d-43db-821f-fe60a34c8143 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:43.096813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9986cecd-a64d-43db-821f-fe60a34c8143 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:43.098452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9986cecd-a64d-43db-821f-fe60a34c8143 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:43.099150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9986cecd-a64d-43db-821f-fe60a34c8143 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:43.099853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9986cecd-a64d-43db-821f-fe60a34c8143 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:43.449234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9986cecd-a64d-43db-821f-fe60a34c8143 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:43.467536 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9986cecd-a64d-43db-821f-fe60a34c8143 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1327 microversion: 2.1 time: 0.403152 Sep 10 10:52:43.470126 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2846/3352] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:43 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1327 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:43.484995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c534f5dc-483c-452e-826f-55cac14bcf9b req-1afd418d-c3f7-476d-95b6-4cbd5af72c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988", "name": "network-vif-plugged", "status": "completed", "tag": "51864780-4e5c-4a4a-b179-dec63ff71462"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:43.503415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c534f5dc-483c-452e-826f-55cac14bcf9b req-1afd418d-c3f7-476d-95b6-4cbd5af72c12 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:43.509891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c534f5dc-483c-452e-826f-55cac14bcf9b req-1afd418d-c3f7-476d-95b6-4cbd5af72c12 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:43.511579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c534f5dc-483c-452e-826f-55cac14bcf9b req-1afd418d-c3f7-476d-95b6-4cbd5af72c12 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:43.535319 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c534f5dc-483c-452e-826f-55cac14bcf9b req-1afd418d-c3f7-476d-95b6-4cbd5af72c12 service nova] Creating event network-vif-plugged:51864780-4e5c-4a4a-b179-dec63ff71462 for instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 on n-h2-856894-1 Sep 10 10:52:43.551546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c534f5dc-483c-452e-826f-55cac14bcf9b req-1afd418d-c3f7-476d-95b6-4cbd5af72c12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079427 Sep 10 10:52:43.552484 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2847/3353] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:43.563550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88d69cc5-d284-4d16-bb63-f8ff8b6b962c tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:43.569894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88d69cc5-d284-4d16-bb63-f8ff8b6b962c tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:43.581010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88d69cc5-d284-4d16-bb63-f8ff8b6b962c tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:43.585157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88d69cc5-d284-4d16-bb63-f8ff8b6b962c tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:43.585921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88d69cc5-d284-4d16-bb63-f8ff8b6b962c tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:43.586907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88d69cc5-d284-4d16-bb63-f8ff8b6b962c tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:43.587579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88d69cc5-d284-4d16-bb63-f8ff8b6b962c tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:43.591194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88d69cc5-d284-4d16-bb63-f8ff8b6b962c tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:43.749978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-88d69cc5-d284-4d16-bb63-f8ff8b6b962c tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lazy-loading 'services' on Instance uuid 0e051393-fa2f-41d0-a506-8e59eaee8e20 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:52:43.883355 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88d69cc5-d284-4d16-bb63-f8ff8b6b962c tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20/os-volume_attachments/984f583c-8875-40de-873f-fe85cb6eb3ef" status: 202 len: 0 microversion: 2.1 time: 0.329167 Sep 10 10:52:43.886197 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2848/3354] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 10:52:43 2022] DELETE /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20/os-volume_attachments/984f583c-8875-40de-873f-fe85cb6eb3ef => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:52:43.902989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2f7d830-7208-4e03-8a34-ae475f5c928d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:43.903832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2f7d830-7208-4e03-8a34-ae475f5c928d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:43.931680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2f7d830-7208-4e03-8a34-ae475f5c928d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:43.932191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2f7d830-7208-4e03-8a34-ae475f5c928d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:43.932644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2f7d830-7208-4e03-8a34-ae475f5c928d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:43.933395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2f7d830-7208-4e03-8a34-ae475f5c928d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:43.942541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2f7d830-7208-4e03-8a34-ae475f5c928d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:43.943065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2f7d830-7208-4e03-8a34-ae475f5c928d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:44.044517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2f7d830-7208-4e03-8a34-ae475f5c928d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:52:44.224101 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2f7d830-7208-4e03-8a34-ae475f5c928d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 204 len: 0 microversion: 2.1 time: 0.333455 Sep 10 10:52:44.226563 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2849/3355] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:52:43 2022] DELETE /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:52:44.239293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a92f029-dd3f-4b37-91e2-6abfc25fa36b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:44.240121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a92f029-dd3f-4b37-91e2-6abfc25fa36b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:44.251164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92f029-dd3f-4b37-91e2-6abfc25fa36b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:44.252087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92f029-dd3f-4b37-91e2-6abfc25fa36b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:44.252686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92f029-dd3f-4b37-91e2-6abfc25fa36b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:44.254287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92f029-dd3f-4b37-91e2-6abfc25fa36b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:44.254938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92f029-dd3f-4b37-91e2-6abfc25fa36b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:44.255371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a92f029-dd3f-4b37-91e2-6abfc25fa36b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:44.537575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a92f029-dd3f-4b37-91e2-6abfc25fa36b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:44.547093 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a92f029-dd3f-4b37-91e2-6abfc25fa36b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1314 microversion: 2.1 time: 0.319019 Sep 10 10:52:44.561482 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2850/3356] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:44 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:44.568922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:44.575008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:44.593623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:44.594870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:44.598308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:44.599253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:44.603026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:44.603504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:44.749142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:44.765027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:44.767598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:44.776830 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1b6d785-54b1-48ee-85e3-855f72fc7252 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.213740 Sep 10 10:52:44.778045 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2851/3357] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:44 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:44.787520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:44.788440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:44.795763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:44.796474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:44.797125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:44.797988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:44.798597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:44.799489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:44.835673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:52:44.881541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:44.897315 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.compute.api [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Instance is already in deleting state, ignoring this request Sep 10 10:52:44.898803 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c0ca03e6-727f-4246-bdcc-f43caa32dfa6 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 204 len: 0 microversion: 2.1 time: 0.119095 Sep 10 10:52:44.900097 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2852/3358] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:52:44 2022] DELETE /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:52:44.907755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-388ce538-aa72-4fb3-9874-4e6ffdef9fd3 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:44.908396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-388ce538-aa72-4fb3-9874-4e6ffdef9fd3 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:44.928145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-388ce538-aa72-4fb3-9874-4e6ffdef9fd3 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:44.928921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-388ce538-aa72-4fb3-9874-4e6ffdef9fd3 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:44.929885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-388ce538-aa72-4fb3-9874-4e6ffdef9fd3 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:44.931312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-388ce538-aa72-4fb3-9874-4e6ffdef9fd3 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:44.933176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-388ce538-aa72-4fb3-9874-4e6ffdef9fd3 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:44.934027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-388ce538-aa72-4fb3-9874-4e6ffdef9fd3 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:45.390785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-388ce538-aa72-4fb3-9874-4e6ffdef9fd3 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:45.402409 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-388ce538-aa72-4fb3-9874-4e6ffdef9fd3 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1327 microversion: 2.1 time: 0.501176 Sep 10 10:52:45.403009 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2853/3359] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:44 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1327 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:45.412516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9e88fb0-9c00-4774-bebf-061a633d35db tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:45.422898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f9e88fb0-9c00-4774-bebf-061a633d35db tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:45.442223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e88fb0-9c00-4774-bebf-061a633d35db tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:45.447184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e88fb0-9c00-4774-bebf-061a633d35db tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:45.447842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e88fb0-9c00-4774-bebf-061a633d35db tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:45.448981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e88fb0-9c00-4774-bebf-061a633d35db tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:45.449617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e88fb0-9c00-4774-bebf-061a633d35db tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:45.450199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e88fb0-9c00-4774-bebf-061a633d35db tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:45.760442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f9e88fb0-9c00-4774-bebf-061a633d35db tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:45.781635 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f9e88fb0-9c00-4774-bebf-061a633d35db tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1514 microversion: 2.1 time: 0.371396 Sep 10 10:52:45.782592 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2854/3360] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:45 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:45.789876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-599105f3-5193-4741-b4d8-daa5f267c03d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:45.791968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-599105f3-5193-4741-b4d8-daa5f267c03d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:45.805055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599105f3-5193-4741-b4d8-daa5f267c03d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:45.806761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599105f3-5193-4741-b4d8-daa5f267c03d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:45.809976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599105f3-5193-4741-b4d8-daa5f267c03d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:45.811110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599105f3-5193-4741-b4d8-daa5f267c03d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:45.813176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599105f3-5193-4741-b4d8-daa5f267c03d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:45.814860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-599105f3-5193-4741-b4d8-daa5f267c03d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:46.078038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-599105f3-5193-4741-b4d8-daa5f267c03d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:46.092219 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-599105f3-5193-4741-b4d8-daa5f267c03d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1314 microversion: 2.1 time: 0.308355 Sep 10 10:52:46.092830 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2855/3361] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:45 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:46.103464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:46.107574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:46.139655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:46.140191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:46.140612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:46.146463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:46.147351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:46.147957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:46.269584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:46.281895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:46.283251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:46.294861 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50ffc664-6233-4291-8376-c425a755cb29 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.196203 Sep 10 10:52:46.295877 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2856/3362] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:46 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:46.433706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5e838c1f-6f2c-4c87-8408-459684ee3690 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:46.434747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5e838c1f-6f2c-4c87-8408-459684ee3690 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:46.454131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e838c1f-6f2c-4c87-8408-459684ee3690 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:46.460605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e838c1f-6f2c-4c87-8408-459684ee3690 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:46.462900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e838c1f-6f2c-4c87-8408-459684ee3690 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:46.465977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e838c1f-6f2c-4c87-8408-459684ee3690 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:46.475741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e838c1f-6f2c-4c87-8408-459684ee3690 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:46.476350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e838c1f-6f2c-4c87-8408-459684ee3690 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:46.753948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e838c1f-6f2c-4c87-8408-459684ee3690 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:46.769930 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5e838c1f-6f2c-4c87-8408-459684ee3690 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1527 microversion: 2.1 time: 0.343258 Sep 10 10:52:46.797481 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2857/3363] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:46 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1527 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:46.797481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-40ae7960-2da2-4ae9-8a8f-ec0f30bcf382 req-f20d8c68-b374-476e-80e8-85ae497a42fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6034e33-1269-4d6c-81a9-8a8f101bf8b1", "name": "network-vif-plugged", "status": "completed", "tag": "a220a107-c19a-4688-b299-339f7e0fbdb2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:46.824976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-40ae7960-2da2-4ae9-8a8f-ec0f30bcf382 req-f20d8c68-b374-476e-80e8-85ae497a42fa service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:46.829764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-40ae7960-2da2-4ae9-8a8f-ec0f30bcf382 req-f20d8c68-b374-476e-80e8-85ae497a42fa service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:46.830481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-40ae7960-2da2-4ae9-8a8f-ec0f30bcf382 req-f20d8c68-b374-476e-80e8-85ae497a42fa service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:46.862961 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-40ae7960-2da2-4ae9-8a8f-ec0f30bcf382 req-f20d8c68-b374-476e-80e8-85ae497a42fa service nova] Creating event network-vif-plugged:a220a107-c19a-4688-b299-339f7e0fbdb2 for instance f6034e33-1269-4d6c-81a9-8a8f101bf8b1 on n-h2-856894-1 Sep 10 10:52:46.878974 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-40ae7960-2da2-4ae9-8a8f-ec0f30bcf382 req-f20d8c68-b374-476e-80e8-85ae497a42fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089103 Sep 10 10:52:46.883716 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2858/3364] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:46.894702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ccd9e87d-b9c6-403c-a4b0-04e7a60989aa tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:46.897944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ccd9e87d-b9c6-403c-a4b0-04e7a60989aa tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:46.915828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd9e87d-b9c6-403c-a4b0-04e7a60989aa tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:46.917058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd9e87d-b9c6-403c-a4b0-04e7a60989aa tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:46.917721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd9e87d-b9c6-403c-a4b0-04e7a60989aa tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:46.918586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd9e87d-b9c6-403c-a4b0-04e7a60989aa tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:46.919220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd9e87d-b9c6-403c-a4b0-04e7a60989aa tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:46.919641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ccd9e87d-b9c6-403c-a4b0-04e7a60989aa tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:47.537291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ccd9e87d-b9c6-403c-a4b0-04e7a60989aa tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:47.576239 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ccd9e87d-b9c6-403c-a4b0-04e7a60989aa tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1527 microversion: 2.1 time: 0.689345 Sep 10 10:52:47.579471 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2859/3365] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:46 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1527 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:47.610235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9ef4f8ce-a315-4980-8b5a-df46989bc3cb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:47.611929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9ef4f8ce-a315-4980-8b5a-df46989bc3cb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:47.631647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef4f8ce-a315-4980-8b5a-df46989bc3cb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:47.633591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef4f8ce-a315-4980-8b5a-df46989bc3cb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:47.634893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef4f8ce-a315-4980-8b5a-df46989bc3cb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:47.635832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef4f8ce-a315-4980-8b5a-df46989bc3cb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:47.637107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef4f8ce-a315-4980-8b5a-df46989bc3cb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:47.638764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef4f8ce-a315-4980-8b5a-df46989bc3cb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:48.172099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9ef4f8ce-a315-4980-8b5a-df46989bc3cb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:48.187573 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9ef4f8ce-a315-4980-8b5a-df46989bc3cb tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1514 microversion: 2.1 time: 0.603933 Sep 10 10:52:48.189408 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2860/3366] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:47 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1514 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:48.194571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-219639d6-89dc-4e0a-b7f5-b9a896aade67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:48.195432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-219639d6-89dc-4e0a-b7f5-b9a896aade67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:48.207738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219639d6-89dc-4e0a-b7f5-b9a896aade67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:48.216128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219639d6-89dc-4e0a-b7f5-b9a896aade67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:48.218360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219639d6-89dc-4e0a-b7f5-b9a896aade67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:48.222573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219639d6-89dc-4e0a-b7f5-b9a896aade67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:48.223301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219639d6-89dc-4e0a-b7f5-b9a896aade67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:48.224101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219639d6-89dc-4e0a-b7f5-b9a896aade67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:48.888237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-219639d6-89dc-4e0a-b7f5-b9a896aade67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:48.903857 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-219639d6-89dc-4e0a-b7f5-b9a896aade67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1314 microversion: 2.1 time: 0.713045 Sep 10 10:52:48.933784 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2861/3367] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:48 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:48.957556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:48.961249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:48.981947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:48.982456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:48.982907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:48.983628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:48.984090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:48.984552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:49.220471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:49.238830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:49.240454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:49.255679 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7da85fa7-0a1d-446e-a045-0a095f3f2262 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.319906 Sep 10 10:52:49.270065 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2862/3368] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:48 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:49.697461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:49.698107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:49.705732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:49.706866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:49.707491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:49.708463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:49.709123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:49.709872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:49.736941 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] HTTP exception thrown: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Request method failure captured: Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 HTTP/1.1 Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGxlD9-ZvlQOs9hbZdV5PLxcu8Kwd3AjCgQuAi4EaEFruQ5Q3qKuaTdZgn089oCBlNEDqR0cy86_WywjBXDsyvMlh-dKKzhs1re6Z8r4ZnOH1adtaebtImVf6ktZwl25EwhJHKqKmQx5OJ_Nd9lafvoXk8F1F8k8VoBp2qEbl9Ny2jY Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8bf6efe50b264a75a68be1d9ea9a24dd Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-28972940 Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bf6efe50b264a75a68be1d9ea9a24dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bf6efe50b264a75a68be1d9ea9a24dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bf6efe50b264a75a68be1d9ea9a24dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bf6efe50b264a75a68be1d9ea9a24dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-28972940 Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8bf6efe50b264a75a68be1d9ea9a24dd Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-28972940 Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestMultiTenantJSON-28972940-project Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 600947e6889c45e2abe5492da8a45f6b Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-28972940-project Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988'} Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:49.743640 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Returning 404 to user: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:49.747311 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf12443d-99ac-42fe-8a31-05e821370ea9 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 404 len: 111 microversion: 2.1 time: 0.475347 Sep 10 10:52:49.748222 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2863/3369] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:52:49 2022] DELETE /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 111 bytes in 478 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:49.764314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-93507ca5-4c05-4317-a31a-632d6483ad2a req-e775f4ad-19f5-4d3d-969a-a2a4e3b32a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b383e2b5-b354-4937-81d5-0593373068e9", "name": "network-vif-deleted", "tag": "a96d532a-0f87-4b2c-9d1a-c17395751a88"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:49.793196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-93507ca5-4c05-4317-a31a-632d6483ad2a req-e775f4ad-19f5-4d3d-969a-a2a4e3b32a39 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:49.795588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-93507ca5-4c05-4317-a31a-632d6483ad2a req-e775f4ad-19f5-4d3d-969a-a2a4e3b32a39 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:49.796243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-93507ca5-4c05-4317-a31a-632d6483ad2a req-e775f4ad-19f5-4d3d-969a-a2a4e3b32a39 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:49.839745 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-93507ca5-4c05-4317-a31a-632d6483ad2a req-e775f4ad-19f5-4d3d-969a-a2a4e3b32a39 service nova] Creating event network-vif-deleted:a96d532a-0f87-4b2c-9d1a-c17395751a88 for instance b383e2b5-b354-4937-81d5-0593373068e9 on n-h2-856894-1 Sep 10 10:52:49.854187 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-93507ca5-4c05-4317-a31a-632d6483ad2a req-e775f4ad-19f5-4d3d-969a-a2a4e3b32a39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104132 Sep 10 10:52:49.862069 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2864/3370] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:49.873096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:49.873975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:49.889157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:49.889659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:49.890097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:49.890874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:49.891338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:49.894753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:50.010618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:50.011140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:50.011582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:50.013219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lazy-loading 'fault' on Instance uuid b383e2b5-b354-4937-81d5-0593373068e9 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:52:50.210624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e819f2b7d9489497e408871a233377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827645d7a2374eb4bc75b115b8ccd6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:50.231521 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85e38272-bebe-4b41-aed8-fd1774c8c626 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 200 len: 1308 microversion: 2.1 time: 0.367832 Sep 10 10:52:50.233896 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2865/3371] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:49 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 1308 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:50.246163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79b088ce-e312-41f0-9314-f6302ee907c5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:50.246811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79b088ce-e312-41f0-9314-f6302ee907c5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:50.255853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79b088ce-e312-41f0-9314-f6302ee907c5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:50.256347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79b088ce-e312-41f0-9314-f6302ee907c5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:50.256787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79b088ce-e312-41f0-9314-f6302ee907c5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:50.257572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79b088ce-e312-41f0-9314-f6302ee907c5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:50.259359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79b088ce-e312-41f0-9314-f6302ee907c5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:50.259955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79b088ce-e312-41f0-9314-f6302ee907c5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:50.555523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79b088ce-e312-41f0-9314-f6302ee907c5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:50.566935 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79b088ce-e312-41f0-9314-f6302ee907c5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1527 microversion: 2.1 time: 0.330163 Sep 10 10:52:50.570281 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2866/3372] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:50 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1527 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:50.599456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff48e9ba-4992-4117-b237-ec596ea5d503 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:50.607132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff48e9ba-4992-4117-b237-ec596ea5d503 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:50.620378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff48e9ba-4992-4117-b237-ec596ea5d503 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:50.621106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff48e9ba-4992-4117-b237-ec596ea5d503 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:50.621709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff48e9ba-4992-4117-b237-ec596ea5d503 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:50.622646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff48e9ba-4992-4117-b237-ec596ea5d503 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:50.623342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff48e9ba-4992-4117-b237-ec596ea5d503 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:50.623940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff48e9ba-4992-4117-b237-ec596ea5d503 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:50.913350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff48e9ba-4992-4117-b237-ec596ea5d503 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:50.930123 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff48e9ba-4992-4117-b237-ec596ea5d503 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1500 microversion: 2.1 time: 0.354692 Sep 10 10:52:50.930976 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2867/3373] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:50 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1500 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:50.953984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:50.954841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:50.962528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:50.963077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:50.963566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:50.964339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:50.964809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:50.965279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:51.073832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:51.085259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:51.087096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:51.093607 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4d22011-745e-4cd6-9a9b-507c995f9f90 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1537 microversion: 2.91 time: 0.146627 Sep 10 10:52:51.115731 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2868/3374] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:50 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1537 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:51.126245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Action: 'update', calling method: >, body: {"server": {"name": "4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988_new"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:51.130086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:51.136820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:51.137741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:51.138284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:51.139069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:51.139605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:51.140601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:51.196188 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] HTTP exception thrown: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Request method failure captured: Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 HTTP/1.1 Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 64 Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGxlD9-ZvlQOs9hbZdV5PLxcu8Kwd3AjCgQuAi4EaEFruQ5Q3qKuaTdZgn089oCBlNEDqR0cy86_WywjBXDsyvMlh-dKKzhs1re6Z8r4ZnOH1adtaebtImVf6ktZwl25EwhJHKqKmQx5OJ_Nd9lafvoXk8F1F8k8VoBp2qEbl9Ny2jY Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8bf6efe50b264a75a68be1d9ea9a24dd Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-28972940 Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bf6efe50b264a75a68be1d9ea9a24dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8bf6efe50b264a75a68be1d9ea9a24dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8bf6efe50b264a75a68be1d9ea9a24dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8bf6efe50b264a75a68be1d9ea9a24dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-28972940 Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8bf6efe50b264a75a68be1d9ea9a24dd Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-28972940 Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestMultiTenantJSON-28972940-project Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 600947e6889c45e2abe5492da8a45f6b Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-28972940-project Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988_new"}} Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988', 'body': {'server': {'name': '4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988_new'}}} Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 10:52:51.198961 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:51.202345 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:51.204807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] Returning 404 to user: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:51.205933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-809d087b-6187-43f0-8f5a-bc1a13c3b123 tempest-ServersNegativeTestMultiTenantJSON-28972940 tempest-ServersNegativeTestMultiTenantJSON-28972940-project] 10.222.0.20 "PUT /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 404 len: 111 microversion: 2.1 time: 0.088726 Sep 10 10:52:51.212919 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2869/3375] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Sep 10 10:52:51 2022] PUT /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:51.218332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c71f9d62-a9cf-4025-aff9-661c96ca9713 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:51.221458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c71f9d62-a9cf-4025-aff9-661c96ca9713 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:51.231739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c71f9d62-a9cf-4025-aff9-661c96ca9713 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:51.233901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c71f9d62-a9cf-4025-aff9-661c96ca9713 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:51.234579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c71f9d62-a9cf-4025-aff9-661c96ca9713 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:51.235555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c71f9d62-a9cf-4025-aff9-661c96ca9713 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:51.236233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c71f9d62-a9cf-4025-aff9-661c96ca9713 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:51.236915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c71f9d62-a9cf-4025-aff9-661c96ca9713 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:51.915676 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c71f9d62-a9cf-4025-aff9-661c96ca9713 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action" status: 200 len: 14 microversion: 2.1 time: 0.699937 Sep 10 10:52:51.919387 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2870/3376] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:52:51 2022] POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action => generated 14 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:52:51.932528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cbe78fcb-fafa-41f6-8bb8-f80803ccdc7d tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:51.934857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cbe78fcb-fafa-41f6-8bb8-f80803ccdc7d tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:51.963457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbe78fcb-fafa-41f6-8bb8-f80803ccdc7d tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:51.965803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbe78fcb-fafa-41f6-8bb8-f80803ccdc7d tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:51.966444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbe78fcb-fafa-41f6-8bb8-f80803ccdc7d tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:51.967662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbe78fcb-fafa-41f6-8bb8-f80803ccdc7d tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:51.970461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbe78fcb-fafa-41f6-8bb8-f80803ccdc7d tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:51.971101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbe78fcb-fafa-41f6-8bb8-f80803ccdc7d tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:52.050864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cbe78fcb-fafa-41f6-8bb8-f80803ccdc7d tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:52:52.060411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:52.770781 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cbe78fcb-fafa-41f6-8bb8-f80803ccdc7d tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 204 len: 0 microversion: 2.1 time: 0.847027 Sep 10 10:52:52.771434 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2871/3377] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:52:51 2022] DELETE /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:52:52.780925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:52.781670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: b383e2b5-b354-4937-81d5-0593373068e9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:52.791276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:52.791786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:52.792287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:52.793086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:52.793624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:52.794100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:52.818812 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] HTTP exception thrown: Instance b383e2b5-b354-4937-81d5-0593373068e9 could not be found. Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Request method failure captured: Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 HTTP/1.1 Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGu33n5HUP0z-Ie61b84YePNRHbAKSlzJ7MqC8ZMUiPaag2DyYuMCep8X09u4XugRnR803sV5460flH6-oL3j8X2V9wmfnR-TkKFuCG4n9KyjrK1feXyCsfNlY9XnA6MJe_3R5w0A3a7M2U2cqguEPsO4t8ivgau7m6tfsoDV3uOfwY Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 827645d7a2374eb4bc75b115b8ccd6dd Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_827645d7a2374eb4bc75b115b8ccd6dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 827645d7a2374eb4bc75b115b8ccd6dd Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerDiskConfigTestJSON-671332052-project Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e3e819f2b7d9489497e408871a233377 Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerDiskConfigTestJSON-671332052-project Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance b383e2b5-b354-4937-81d5-0593373068e9 could not be found. Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'b383e2b5-b354-4937-81d5-0593373068e9'} Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b383e2b5-b354-4937-81d5-0593373068e9 could not be found. Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b383e2b5-b354-4937-81d5-0593373068e9 could not be found. Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:52.820585 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:52.824846 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:52.824846 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:52.824846 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:52.824846 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:52.824846 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:52.824846 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b383e2b5-b354-4937-81d5-0593373068e9 could not be found. Sep 10 10:52:52.824846 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:52.824846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Returning 404 to user: Instance b383e2b5-b354-4937-81d5-0593373068e9 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:52.837422 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8081702e-ef92-4560-8e64-3c85a2c58ee1 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9" status: 404 len: 111 microversion: 2.1 time: 0.046911 Sep 10 10:52:52.838631 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2872/3378] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:52 2022] GET /compute/v2.1/servers/b383e2b5-b354-4937-81d5-0593373068e9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:52.852765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:52.853430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:52.861914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:52.863222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:52.863680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:52.864392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:52.865814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:52.866272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:52.963288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:52.975578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:52.977132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:52.984438 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c23cfc66-6fbc-40e6-987b-2823f92db861 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1540 microversion: 2.91 time: 0.139673 Sep 10 10:52:52.989739 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2873/3379] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:52 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1540 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:52.996665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7f20caed-1935-4178-aa49-e4158a17e45e tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:52.997558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7f20caed-1935-4178-aa49-e4158a17e45e tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:53.005479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f20caed-1935-4178-aa49-e4158a17e45e tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:53.006376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f20caed-1935-4178-aa49-e4158a17e45e tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:53.007102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f20caed-1935-4178-aa49-e4158a17e45e tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:53.007907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f20caed-1935-4178-aa49-e4158a17e45e tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:53.008514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f20caed-1935-4178-aa49-e4158a17e45e tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:53.009044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f20caed-1935-4178-aa49-e4158a17e45e tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:53.256263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7f20caed-1935-4178-aa49-e4158a17e45e tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:53.268267 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7f20caed-1935-4178-aa49-e4158a17e45e tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1533 microversion: 2.1 time: 0.276522 Sep 10 10:52:53.270911 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2874/3380] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:52 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1533 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:53.281303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:53.281303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:53.301770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:53.302385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:53.303669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:53.306061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:53.308521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:53.309863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:53.339242 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] HTTP exception thrown: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Request method failure captured: Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 HTTP/1.1 Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGu33n5HUP0z-Ie61b84YePNRHbAKSlzJ7MqC8ZMUiPaag2DyYuMCep8X09u4XugRnR803sV5460flH6-oL3j8X2V9wmfnR-TkKFuCG4n9KyjrK1feXyCsfNlY9XnA6MJe_3R5w0A3a7M2U2cqguEPsO4t8ivgau7m6tfsoDV3uOfwY Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 827645d7a2374eb4bc75b115b8ccd6dd Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_827645d7a2374eb4bc75b115b8ccd6dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 827645d7a2374eb4bc75b115b8ccd6dd Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerDiskConfigTestJSON-671332052-project Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e3e819f2b7d9489497e408871a233377 Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerDiskConfigTestJSON-671332052-project Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e30352b5-a583-40b8-8e8b-9065682fc622'} Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:53.347807 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:53.351762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Returning 404 to user: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:53.352410 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-727eda9f-95b8-4f62-8659-1fa0350be109 tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 404 len: 111 microversion: 2.1 time: 0.080402 Sep 10 10:52:53.359684 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2875/3381] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:52:53 2022] DELETE /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:53.367720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a092816-9e63-4240-90bc-2dda135e13f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:53.375559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a092816-9e63-4240-90bc-2dda135e13f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:53.390561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a092816-9e63-4240-90bc-2dda135e13f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:53.391139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a092816-9e63-4240-90bc-2dda135e13f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:53.391791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a092816-9e63-4240-90bc-2dda135e13f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:53.392579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a092816-9e63-4240-90bc-2dda135e13f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:53.393192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a092816-9e63-4240-90bc-2dda135e13f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:53.395517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a092816-9e63-4240-90bc-2dda135e13f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:53.934285 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a092816-9e63-4240-90bc-2dda135e13f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action" status: 200 len: 14 microversion: 2.1 time: 0.571062 Sep 10 10:52:53.936628 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2876/3382] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:52:53 2022] POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action => generated 14 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:52:53.944199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b0330253-145d-4486-854c-2bc8e5e51d3e tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-856894-1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:53.960918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b0330253-145d-4486-854c-2bc8e5e51d3e tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:53.973537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0330253-145d-4486-854c-2bc8e5e51d3e tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:53.974214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0330253-145d-4486-854c-2bc8e5e51d3e tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:53.974848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0330253-145d-4486-854c-2bc8e5e51d3e tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:53.976659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0330253-145d-4486-854c-2bc8e5e51d3e tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:53.978127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0330253-145d-4486-854c-2bc8e5e51d3e tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:53.978726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0330253-145d-4486-854c-2bc8e5e51d3e tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:54.111337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b0330253-145d-4486-854c-2bc8e5e51d3e tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-856894-1". {{(pid=128788) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 10:52:54.266540 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b0330253-145d-4486-854c-2bc8e5e51d3e tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5/action" status: 202 len: 0 microversion: 2.91 time: 0.328159 Sep 10 10:52:54.270910 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2877/3383] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:52:53 2022] POST /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:52:54.290804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:54.295694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: e30352b5-a583-40b8-8e8b-9065682fc622] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:54.317730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:54.319573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:54.321044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:54.322080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:54.322975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:54.324509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:54.366808 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] HTTP exception thrown: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Request method failure captured: Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 HTTP/1.1 Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGu33n5HUP0z-Ie61b84YePNRHbAKSlzJ7MqC8ZMUiPaag2DyYuMCep8X09u4XugRnR803sV5460flH6-oL3j8X2V9wmfnR-TkKFuCG4n9KyjrK1feXyCsfNlY9XnA6MJe_3R5w0A3a7M2U2cqguEPsO4t8ivgau7m6tfsoDV3uOfwY Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 827645d7a2374eb4bc75b115b8ccd6dd Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_827645d7a2374eb4bc75b115b8ccd6dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 827645d7a2374eb4bc75b115b8ccd6dd Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerDiskConfigTestJSON-671332052-project Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e3e819f2b7d9489497e408871a233377 Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerDiskConfigTestJSON-671332052-project Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e30352b5-a583-40b8-8e8b-9065682fc622'} Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:54.369325 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:54.374251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:54.374251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:54.374251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:54.374251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:54.374251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:54.374251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. Sep 10 10:52:54.374251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:54.375984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Returning 404 to user: Instance e30352b5-a583-40b8-8e8b-9065682fc622 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:54.376875 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-190f778f-644c-4df2-bceb-5d99313370dc tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622" status: 404 len: 111 microversion: 2.1 time: 0.104881 Sep 10 10:52:54.381808 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2878/3384] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:54 2022] GET /compute/v2.1/servers/e30352b5-a583-40b8-8e8b-9065682fc622 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:54.392393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:54.395180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:54.410669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:54.411382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:54.412271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:54.414371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:54.415925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:54.416726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:54.644621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:54.656197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:54.657639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:54.681884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:54.705535 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a42e8cba-4392-4853-ab78-0f2f5926b755 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1488 microversion: 2.91 time: 0.320034 Sep 10 10:52:54.722433 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2879/3385] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:54 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1488 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:54.747754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-782a074f-221a-497c-bcc7-aaf30a168525 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:54.748410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-782a074f-221a-497c-bcc7-aaf30a168525 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:54.761822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-782a074f-221a-497c-bcc7-aaf30a168525 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:54.762340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-782a074f-221a-497c-bcc7-aaf30a168525 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:54.762806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-782a074f-221a-497c-bcc7-aaf30a168525 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:54.764326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-782a074f-221a-497c-bcc7-aaf30a168525 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:54.764804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-782a074f-221a-497c-bcc7-aaf30a168525 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:54.765274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-782a074f-221a-497c-bcc7-aaf30a168525 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:55.660517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-782a074f-221a-497c-bcc7-aaf30a168525 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:55.675946 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-782a074f-221a-497c-bcc7-aaf30a168525 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1533 microversion: 2.1 time: 0.950675 Sep 10 10:52:55.680389 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2880/3386] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:54 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1533 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:55.689302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:55.691816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:55.704846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:55.708308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:55.713025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:55.718337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:55.719056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:55.719660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:55.739742 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] HTTP exception thrown: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Request method failure captured: Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 HTTP/1.1 Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGu33n5HUP0z-Ie61b84YePNRHbAKSlzJ7MqC8ZMUiPaag2DyYuMCep8X09u4XugRnR803sV5460flH6-oL3j8X2V9wmfnR-TkKFuCG4n9KyjrK1feXyCsfNlY9XnA6MJe_3R5w0A3a7M2U2cqguEPsO4t8ivgau7m6tfsoDV3uOfwY Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 827645d7a2374eb4bc75b115b8ccd6dd Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_827645d7a2374eb4bc75b115b8ccd6dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 827645d7a2374eb4bc75b115b8ccd6dd Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerDiskConfigTestJSON-671332052-project Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e3e819f2b7d9489497e408871a233377 Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerDiskConfigTestJSON-671332052-project Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '1fbd1fad-d00f-4532-9b16-5dc493820bf7'} Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:55.748000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Returning 404 to user: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:55.751251 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-724f5831-93f6-447c-8cdb-0f60bb1bb97d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 404 len: 111 microversion: 2.1 time: 0.068110 Sep 10 10:52:55.755915 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2881/3387] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:52:55 2022] DELETE /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:55.798786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-12674d91-f000-4042-8877-8b133b828648 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:55.805691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-12674d91-f000-4042-8877-8b133b828648 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:55.819006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12674d91-f000-4042-8877-8b133b828648 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:55.819510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12674d91-f000-4042-8877-8b133b828648 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:55.820312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12674d91-f000-4042-8877-8b133b828648 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:55.821207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12674d91-f000-4042-8877-8b133b828648 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:55.821825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12674d91-f000-4042-8877-8b133b828648 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:55.822437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12674d91-f000-4042-8877-8b133b828648 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:55.927778 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-12674d91-f000-4042-8877-8b133b828648 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action" status: 200 len: 14 microversion: 2.1 time: 0.169203 Sep 10 10:52:55.933138 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2882/3388] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:52:55 2022] POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:52:55.946315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30c4919e-adaf-47fe-b96f-abbe74406507 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:55.947219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30c4919e-adaf-47fe-b96f-abbe74406507 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:55.954877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30c4919e-adaf-47fe-b96f-abbe74406507 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:55.955791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30c4919e-adaf-47fe-b96f-abbe74406507 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:55.957124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30c4919e-adaf-47fe-b96f-abbe74406507 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:55.958029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30c4919e-adaf-47fe-b96f-abbe74406507 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:55.958678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30c4919e-adaf-47fe-b96f-abbe74406507 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:55.959299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30c4919e-adaf-47fe-b96f-abbe74406507 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.047148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30c4919e-adaf-47fe-b96f-abbe74406507 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:52:56.294325 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30c4919e-adaf-47fe-b96f-abbe74406507 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 204 len: 0 microversion: 2.1 time: 0.357980 Sep 10 10:52:56.296008 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2883/3389] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:52:55 2022] DELETE /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:52:56.324866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:56.328333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:56.353516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:56.354260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:56.356081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.357152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:56.359939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:56.360606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.484894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:56.496450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:56.498404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:56.504619 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8d48656b-2121-42f9-afc4-a4382cb03af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1488 microversion: 2.91 time: 0.203537 Sep 10 10:52:56.505472 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2884/3390] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:56 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1488 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:56.511431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:56.511633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] [instance: 1fbd1fad-d00f-4532-9b16-5dc493820bf7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:56.524479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:56.524991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:56.525461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.526256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:56.526722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:56.527154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.545606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] HTTP exception thrown: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Request method failure captured: Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 HTTP/1.1 Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGu33n5HUP0z-Ie61b84YePNRHbAKSlzJ7MqC8ZMUiPaag2DyYuMCep8X09u4XugRnR803sV5460flH6-oL3j8X2V9wmfnR-TkKFuCG4n9KyjrK1feXyCsfNlY9XnA6MJe_3R5w0A3a7M2U2cqguEPsO4t8ivgau7m6tfsoDV3uOfwY Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 827645d7a2374eb4bc75b115b8ccd6dd Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/827645d7a2374eb4bc75b115b8ccd6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_827645d7a2374eb4bc75b115b8ccd6dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 827645d7a2374eb4bc75b115b8ccd6dd Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-671332052 Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerDiskConfigTestJSON-671332052-project Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e3e819f2b7d9489497e408871a233377 Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerDiskConfigTestJSON-671332052-project Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '1fbd1fad-d00f-4532-9b16-5dc493820bf7'} Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:56.546524 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:56.552329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:56.552329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:56.552329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:56.552329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:56.552329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:56.552329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. Sep 10 10:52:56.552329 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:56.552329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] Returning 404 to user: Instance 1fbd1fad-d00f-4532-9b16-5dc493820bf7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:56.552329 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa454bd2-4c2d-44d4-997a-71206909ec8d tempest-ServerDiskConfigTestJSON-671332052 tempest-ServerDiskConfigTestJSON-671332052-project] 10.222.0.20 "GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7" status: 404 len: 111 microversion: 2.1 time: 0.041637 Sep 10 10:52:56.554493 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2885/3391] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:56 2022] GET /compute/v2.1/servers/1fbd1fad-d00f-4532-9b16-5dc493820bf7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:56.557802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e05e8276-a15c-4d01-9590-382684934eb7 req-0accd1f9-326f-49ec-928d-927b41e83d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988", "name": "network-vif-deleted", "tag": "51864780-4e5c-4a4a-b179-dec63ff71462"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:56.570702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e05e8276-a15c-4d01-9590-382684934eb7 req-0accd1f9-326f-49ec-928d-927b41e83d85 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:56.571204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e05e8276-a15c-4d01-9590-382684934eb7 req-0accd1f9-326f-49ec-928d-927b41e83d85 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:56.571634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e05e8276-a15c-4d01-9590-382684934eb7 req-0accd1f9-326f-49ec-928d-927b41e83d85 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.592186 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e05e8276-a15c-4d01-9590-382684934eb7 req-0accd1f9-326f-49ec-928d-927b41e83d85 service nova] Creating event network-vif-deleted:51864780-4e5c-4a4a-b179-dec63ff71462 for instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 on n-h2-856894-1 Sep 10 10:52:56.602386 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e05e8276-a15c-4d01-9590-382684934eb7 req-0accd1f9-326f-49ec-928d-927b41e83d85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048645 Sep 10 10:52:56.602991 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2886/3392] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:52:56.615255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b2f4cd7-dff0-4d9c-9af7-be3bcc44a58f tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:56.616180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b2f4cd7-dff0-4d9c-9af7-be3bcc44a58f tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:56.623488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b2f4cd7-dff0-4d9c-9af7-be3bcc44a58f tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:56.625336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b2f4cd7-dff0-4d9c-9af7-be3bcc44a58f tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:56.625840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b2f4cd7-dff0-4d9c-9af7-be3bcc44a58f tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.626653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b2f4cd7-dff0-4d9c-9af7-be3bcc44a58f tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:56.627100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b2f4cd7-dff0-4d9c-9af7-be3bcc44a58f tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:56.627531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b2f4cd7-dff0-4d9c-9af7-be3bcc44a58f tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.858311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2b2f4cd7-dff0-4d9c-9af7-be3bcc44a58f tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:56.872768 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b2f4cd7-dff0-4d9c-9af7-be3bcc44a58f tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1470 microversion: 2.1 time: 0.263756 Sep 10 10:52:56.873737 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2887/3393] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:56 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:56.881009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:56.881915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:56.920196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:56.920196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:56.920196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.920196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:56.920196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:56.920196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.944385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:52:56.966994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:56.967500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:56.967949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:56.968463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lazy-loading 'fault' on Instance uuid 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:52:57.037270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7786c4e8374bb0975d7ce2d9b16c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b825118b2b472e9fd6c42aff0413a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:57.049915 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-657362b1-4dcf-4d42-acda-5b9f3e98d8b5 tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 200 len: 1317 microversion: 2.1 time: 0.174688 Sep 10 10:52:57.066366 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2888/3394] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:56 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:57.072446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ffc9480b-c66f-406f-b0f6-469d8636f110 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:57.075192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ffc9480b-c66f-406f-b0f6-469d8636f110 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:57.082972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffc9480b-c66f-406f-b0f6-469d8636f110 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:57.083690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffc9480b-c66f-406f-b0f6-469d8636f110 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:57.084343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffc9480b-c66f-406f-b0f6-469d8636f110 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:57.085256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffc9480b-c66f-406f-b0f6-469d8636f110 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:57.085858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffc9480b-c66f-406f-b0f6-469d8636f110 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:57.086696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffc9480b-c66f-406f-b0f6-469d8636f110 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:57.779708 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ffc9480b-c66f-406f-b0f6-469d8636f110 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action" status: 200 len: 14 microversion: 2.1 time: 0.711568 Sep 10 10:52:57.780770 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2889/3395] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:52:57 2022] POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action => generated 14 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:52:57.786860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:57.787579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:57.797596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:57.798932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:57.800426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:57.800426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:57.800781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:57.801262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:58.069923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:58.085440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:58.094394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:58.106876 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e83bfb5-f24e-482b-82bc-f4bbdfcef638 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1488 microversion: 2.91 time: 0.325300 Sep 10 10:52:58.110424 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2890/3396] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:57 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1488 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:58.121518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-530df1ff-ede0-4e18-bdf0-2a1358aaa1ed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:58.126964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-530df1ff-ede0-4e18-bdf0-2a1358aaa1ed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:58.138432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-530df1ff-ede0-4e18-bdf0-2a1358aaa1ed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:58.145881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-530df1ff-ede0-4e18-bdf0-2a1358aaa1ed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:58.146857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-530df1ff-ede0-4e18-bdf0-2a1358aaa1ed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:58.150636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-530df1ff-ede0-4e18-bdf0-2a1358aaa1ed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:58.151616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-530df1ff-ede0-4e18-bdf0-2a1358aaa1ed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:58.152276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-530df1ff-ede0-4e18-bdf0-2a1358aaa1ed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:58.690643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-530df1ff-ede0-4e18-bdf0-2a1358aaa1ed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:58.706936 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-530df1ff-ede0-4e18-bdf0-2a1358aaa1ed tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1470 microversion: 2.1 time: 0.589258 Sep 10 10:52:58.707802 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2891/3397] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:58 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1470 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:52:58.718372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:58.723004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] [instance: 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:58.739516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:58.742209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:58.744293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:58.745524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:58.747429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:58.748134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:58.788469 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] HTTP exception thrown: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Request method failure captured: Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 HTTP/1.1 Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGxc8arb9yYdnkXTOkvnf1LDZNly142jeNk7p1STcksDfNMKLEdZMvcmRe_sSb3e3kO1TpzCRalq88Cx5ZrgiTj_gXzVHJ8UsOsAdNVZp0iAinhWPNrjlJnZmQfPgDc1cq8gKYbrVg5XvBk_0gTYFAyn23VoD3oFWVnwjsB1-e3UINk Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: e4b825118b2b472e9fd6c42aff0413a0 Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-512079946 Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4b825118b2b472e9fd6c42aff0413a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4b825118b2b472e9fd6c42aff0413a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4b825118b2b472e9fd6c42aff0413a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4b825118b2b472e9fd6c42aff0413a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-512079946 Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: e4b825118b2b472e9fd6c42aff0413a0 Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-512079946 Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestMultiTenantJSON-512079946-project Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 9c7786c4e8374bb0975d7ce2d9b16c7e Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-512079946-project Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988'} Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:58.792862 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:58.796295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:52:58.796295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:58.796295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:52:58.796295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:52:58.796295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:52:58.796295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:52:58.796295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:52:58.796295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. Sep 10 10:52:58.796295 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:52:58.802725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] Returning 404 to user: Instance 4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:52:58.808506 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b76aa34-0803-46f6-b58f-f3513c123ced tempest-ServersNegativeTestMultiTenantJSON-512079946 tempest-ServersNegativeTestMultiTenantJSON-512079946-project] 10.222.0.20 "GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988" status: 404 len: 111 microversion: 2.1 time: 0.099293 Sep 10 10:52:58.810643 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2892/3398] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:58 2022] GET /compute/v2.1/servers/4a91cf13-a6f7-42fa-9cf2-c5bf7ab72988 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:52:59.260872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62477e36-1b3f-4550-8361-71e2b96a48f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:52:59.263371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62477e36-1b3f-4550-8361-71e2b96a48f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:59.276089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62477e36-1b3f-4550-8361-71e2b96a48f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:59.276605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62477e36-1b3f-4550-8361-71e2b96a48f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:59.277053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62477e36-1b3f-4550-8361-71e2b96a48f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:59.280363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62477e36-1b3f-4550-8361-71e2b96a48f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:59.280840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62477e36-1b3f-4550-8361-71e2b96a48f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:59.284110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62477e36-1b3f-4550-8361-71e2b96a48f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:59.357611 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62477e36-1b3f-4550-8361-71e2b96a48f4 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action" status: 200 len: 14 microversion: 2.1 time: 0.544498 Sep 10 10:52:59.361638 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2893/3399] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:52:58 2022] POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action => generated 14 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:52:59.378961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:59.379683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:59.391737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:59.392239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:59.392688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:59.393488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:59.393957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:59.394393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:59.824953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:59.834737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:59.847853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:52:59.867614 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56a24531-e239-4b36-b36a-5e089641cb68 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.503421 Sep 10 10:52:59.868846 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2894/3400] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:52:59 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:52:59.887457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-148eda43-d018-45af-a3fa-b5494ebb1365 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:52:59.888360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-148eda43-d018-45af-a3fa-b5494ebb1365 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:52:59.900394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-148eda43-d018-45af-a3fa-b5494ebb1365 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:59.900902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-148eda43-d018-45af-a3fa-b5494ebb1365 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:59.905621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-148eda43-d018-45af-a3fa-b5494ebb1365 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:52:59.906383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-148eda43-d018-45af-a3fa-b5494ebb1365 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:52:59.906869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-148eda43-d018-45af-a3fa-b5494ebb1365 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:52:59.907317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-148eda43-d018-45af-a3fa-b5494ebb1365 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:01.108131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-148eda43-d018-45af-a3fa-b5494ebb1365 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:01.118166 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-148eda43-d018-45af-a3fa-b5494ebb1365 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1470 microversion: 2.1 time: 1.247811 Sep 10 10:53:01.118705 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2895/3401] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:52:59 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1470 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:01.157472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3caeb3e1-7784-470c-a6c9-5696b084ad7b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:01.161921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3caeb3e1-7784-470c-a6c9-5696b084ad7b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:01.182544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3caeb3e1-7784-470c-a6c9-5696b084ad7b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:01.183389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3caeb3e1-7784-470c-a6c9-5696b084ad7b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:01.184051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3caeb3e1-7784-470c-a6c9-5696b084ad7b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:01.184971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3caeb3e1-7784-470c-a6c9-5696b084ad7b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:01.185629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3caeb3e1-7784-470c-a6c9-5696b084ad7b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:01.186449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3caeb3e1-7784-470c-a6c9-5696b084ad7b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:01.240559 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3caeb3e1-7784-470c-a6c9-5696b084ad7b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action" status: 200 len: 14 microversion: 2.1 time: 0.099362 Sep 10 10:53:01.241955 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2896/3402] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:53:01 2022] POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:53:01.249011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:01.256811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:01.282148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:01.282988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:01.284518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:01.285752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:01.286461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:01.287347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:01.416410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:01.429961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:01.438598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:01.454293 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9baca417-7839-4fd8-9d82-8cdb6ce99efe tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.206420 Sep 10 10:53:01.457665 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2897/3403] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:01 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:01.475348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e6b26bea-0060-4804-bbd8-67004b0ec6a5 req-423b24d4-227d-495b-a032-c6a24b6972e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e051393-fa2f-41d0-a506-8e59eaee8e20", "name": "network-vif-deleted", "tag": "990ea5b5-eb74-4af6-aab1-32b4d04f1739"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:01.494837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e6b26bea-0060-4804-bbd8-67004b0ec6a5 req-423b24d4-227d-495b-a032-c6a24b6972e7 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:01.501404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e6b26bea-0060-4804-bbd8-67004b0ec6a5 req-423b24d4-227d-495b-a032-c6a24b6972e7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:01.501404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e6b26bea-0060-4804-bbd8-67004b0ec6a5 req-423b24d4-227d-495b-a032-c6a24b6972e7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:01.568250 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e6b26bea-0060-4804-bbd8-67004b0ec6a5 req-423b24d4-227d-495b-a032-c6a24b6972e7 service nova] Creating event network-vif-deleted:990ea5b5-eb74-4af6-aab1-32b4d04f1739 for instance 0e051393-fa2f-41d0-a506-8e59eaee8e20 on n-h2-856894-1 Sep 10 10:53:01.580200 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e6b26bea-0060-4804-bbd8-67004b0ec6a5 req-423b24d4-227d-495b-a032-c6a24b6972e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117754 Sep 10 10:53:01.584372 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2898/3404] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:53:02.148959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:02.150612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:02.182741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:02.183338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:02.183790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:02.184516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:02.184983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:02.198086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:02.341794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:02.346009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:02.347458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:02.348402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lazy-loading 'fault' on Instance uuid 0e051393-fa2f-41d0-a506-8e59eaee8e20 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:53:02.636527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2fcd9534fd4d728edd4e5865ab6cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d6a37e411c4416813b48bbd959f8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:02.654167 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2752fc70-5156-4133-9057-5749e0ae9366 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 200 len: 1304 microversion: 2.1 time: 0.511839 Sep 10 10:53:02.655057 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2899/3405] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:02 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 1304 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:02.708603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4dac500f-9405-4b38-86c6-e8baf4239670 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:02.719976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4dac500f-9405-4b38-86c6-e8baf4239670 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:02.771142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dac500f-9405-4b38-86c6-e8baf4239670 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:02.771741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dac500f-9405-4b38-86c6-e8baf4239670 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:02.772240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dac500f-9405-4b38-86c6-e8baf4239670 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:02.773431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dac500f-9405-4b38-86c6-e8baf4239670 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:02.778237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dac500f-9405-4b38-86c6-e8baf4239670 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:02.778867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4dac500f-9405-4b38-86c6-e8baf4239670 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:02.927572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4dac500f-9405-4b38-86c6-e8baf4239670 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action" status: 200 len: 8195 microversion: 2.1 time: 0.245947 Sep 10 10:53:02.928340 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2900/3406] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:53:02 2022] POST /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1/action => generated 8195 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:02.956917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:02.957791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:02.998207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:03.007952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:03.008693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:03.015538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:03.019076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:03.020179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:03.527591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:03.563873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:03.566041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:03.592096 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-39baf171-f031-4443-91b9-ab37ba6c19b4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.662271 Sep 10 10:53:03.593940 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2901/3407] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:02 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:03.601607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-306ac729-396b-40aa-8749-9dfc35970b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:03.602266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-306ac729-396b-40aa-8749-9dfc35970b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:03.609485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-306ac729-396b-40aa-8749-9dfc35970b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:03.610193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-306ac729-396b-40aa-8749-9dfc35970b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:03.610814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-306ac729-396b-40aa-8749-9dfc35970b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:03.611921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-306ac729-396b-40aa-8749-9dfc35970b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:03.612546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-306ac729-396b-40aa-8749-9dfc35970b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:03.613222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-306ac729-396b-40aa-8749-9dfc35970b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:04.275922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-306ac729-396b-40aa-8749-9dfc35970b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:04.296356 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-306ac729-396b-40aa-8749-9dfc35970b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.701277 Sep 10 10:53:04.311363 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2902/3408] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:03 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:04.342370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:04.359310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] [instance: 0e051393-fa2f-41d0-a506-8e59eaee8e20] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:04.386457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:04.388778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:04.391264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:04.392177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:04.400611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:04.403990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:04.454763 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] HTTP exception thrown: Instance 0e051393-fa2f-41d0-a506-8e59eaee8e20 could not be found. Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Request method failure captured: Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 HTTP/1.1 Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGvxJSC4mYEkBcvDMNP0e0ksHZ8sFYOKM1hn1kOlNqrl8CEODzHgwXlFTXevebXE_GGArhETOQT7Vy_FxAXkOuXJ71iLNeKpT7wvGpLHfhrzi7IMLb4Dx9W9HH8wPVbYOsT4apMtjFdORXTyj3IvNCd7brVzGQK51kSUmtMeYDVCb4s Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 44d6a37e411c4416813b48bbd959f8fb Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesBackupsTest-541032511 Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/44d6a37e411c4416813b48bbd959f8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/44d6a37e411c4416813b48bbd959f8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/44d6a37e411c4416813b48bbd959f8fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_44d6a37e411c4416813b48bbd959f8fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesBackupsTest-541032511 Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 44d6a37e411c4416813b48bbd959f8fb Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesBackupsTest-541032511 Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesBackupsTest-541032511-project Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 5d2fcd9534fd4d728edd4e5865ab6cf1 Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesBackupsTest-541032511-project Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 0e051393-fa2f-41d0-a506-8e59eaee8e20 could not be found. Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '0e051393-fa2f-41d0-a506-8e59eaee8e20'} Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e051393-fa2f-41d0-a506-8e59eaee8e20 could not be found. Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e051393-fa2f-41d0-a506-8e59eaee8e20 could not be found. Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:53:04.461840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:53:04.465617 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:53:04.465617 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:53:04.465617 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:53:04.465617 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:53:04.465617 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:53:04.465617 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e051393-fa2f-41d0-a506-8e59eaee8e20 could not be found. Sep 10 10:53:04.465617 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:53:04.467663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] Returning 404 to user: Instance 0e051393-fa2f-41d0-a506-8e59eaee8e20 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:53:04.472338 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-49145761-8e6d-45aa-ab8b-ce93188a4a55 tempest-VolumesBackupsTest-541032511 tempest-VolumesBackupsTest-541032511-project] 10.222.0.20 "GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20" status: 404 len: 111 microversion: 2.1 time: 0.133663 Sep 10 10:53:04.476398 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2903/3409] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:04 2022] GET /compute/v2.1/servers/0e051393-fa2f-41d0-a506-8e59eaee8e20 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:53:04.494180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6da7e3c4-037a-4aa8-ac80-add2d3c98946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:04.495168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6da7e3c4-037a-4aa8-ac80-add2d3c98946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:04.504246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6da7e3c4-037a-4aa8-ac80-add2d3c98946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:04.504861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6da7e3c4-037a-4aa8-ac80-add2d3c98946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:04.505460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6da7e3c4-037a-4aa8-ac80-add2d3c98946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:04.506411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6da7e3c4-037a-4aa8-ac80-add2d3c98946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:04.507104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6da7e3c4-037a-4aa8-ac80-add2d3c98946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:04.507849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6da7e3c4-037a-4aa8-ac80-add2d3c98946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:05.072087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6da7e3c4-037a-4aa8-ac80-add2d3c98946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:05.104281 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6da7e3c4-037a-4aa8-ac80-add2d3c98946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.614172 Sep 10 10:53:05.106601 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2904/3410] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:04 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:05.128371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:05.139584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:05.178408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:05.181921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:05.191540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:05.201645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:05.202609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:05.205342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:05.597617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:05.617852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:05.621806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:05.648099 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-46bd7d9e-27ce-4960-9294-5c5e6e4409c9 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.540116 Sep 10 10:53:05.652952 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2905/3411] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:05 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:05.661499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff59c5bd-b725-4f21-8499-1a7edb6255af tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:05.679095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff59c5bd-b725-4f21-8499-1a7edb6255af tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:05.703033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff59c5bd-b725-4f21-8499-1a7edb6255af tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:05.704057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff59c5bd-b725-4f21-8499-1a7edb6255af tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:05.705478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff59c5bd-b725-4f21-8499-1a7edb6255af tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:05.718311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff59c5bd-b725-4f21-8499-1a7edb6255af tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:05.719184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff59c5bd-b725-4f21-8499-1a7edb6255af tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:05.719911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff59c5bd-b725-4f21-8499-1a7edb6255af tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:06.311565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff59c5bd-b725-4f21-8499-1a7edb6255af tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:06.335780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff59c5bd-b725-4f21-8499-1a7edb6255af tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.673711 Sep 10 10:53:06.347396 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2906/3412] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:05 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:06.370757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-993e0e6f-bdd8-4c9a-86b0-a73574aa41fe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:06.371379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-993e0e6f-bdd8-4c9a-86b0-a73574aa41fe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:06.411711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993e0e6f-bdd8-4c9a-86b0-a73574aa41fe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:06.421510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993e0e6f-bdd8-4c9a-86b0-a73574aa41fe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:06.422247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993e0e6f-bdd8-4c9a-86b0-a73574aa41fe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:06.426043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993e0e6f-bdd8-4c9a-86b0-a73574aa41fe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:06.426528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993e0e6f-bdd8-4c9a-86b0-a73574aa41fe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:06.426974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-993e0e6f-bdd8-4c9a-86b0-a73574aa41fe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:07.493341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-993e0e6f-bdd8-4c9a-86b0-a73574aa41fe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:07.505430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:07.518071 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-993e0e6f-bdd8-4c9a-86b0-a73574aa41fe tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 1.150992 Sep 10 10:53:07.523547 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2907/3413] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:06 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:07.561034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:07.562398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:07.590226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:07.591293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:07.591929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:07.593243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:07.594029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:07.595268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:08.042305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:08.059201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:08.077989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:08.100071 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-19bbc0cf-ae83-4543-ba83-428e59b728ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.550299 Sep 10 10:53:08.101871 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2908/3414] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:07 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:08.115827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-47bc459a-f7a3-47b5-afbc-4befd39c1781 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:08.119905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47bc459a-f7a3-47b5-afbc-4befd39c1781 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:08.133819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47bc459a-f7a3-47b5-afbc-4befd39c1781 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:08.136293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47bc459a-f7a3-47b5-afbc-4befd39c1781 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:08.137159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47bc459a-f7a3-47b5-afbc-4befd39c1781 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:08.139146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47bc459a-f7a3-47b5-afbc-4befd39c1781 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:08.139656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47bc459a-f7a3-47b5-afbc-4befd39c1781 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:08.141856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47bc459a-f7a3-47b5-afbc-4befd39c1781 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:08.297272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47bc459a-f7a3-47b5-afbc-4befd39c1781 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Locking {{(pid=128788) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 10 10:53:08.451878 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-47bc459a-f7a3-47b5-afbc-4befd39c1781 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.348522 Sep 10 10:53:08.452926 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2909/3415] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:53:08 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:53:08.465174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9244c64b-0d74-4201-ad09-3a63b516ab3e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:08.467476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9244c64b-0d74-4201-ad09-3a63b516ab3e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:08.482532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9244c64b-0d74-4201-ad09-3a63b516ab3e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:08.483982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9244c64b-0d74-4201-ad09-3a63b516ab3e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:08.484689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9244c64b-0d74-4201-ad09-3a63b516ab3e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:08.485738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9244c64b-0d74-4201-ad09-3a63b516ab3e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:08.486456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9244c64b-0d74-4201-ad09-3a63b516ab3e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:08.487799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9244c64b-0d74-4201-ad09-3a63b516ab3e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:08.836157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9244c64b-0d74-4201-ad09-3a63b516ab3e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:08.865582 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9244c64b-0d74-4201-ad09-3a63b516ab3e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.405949 Sep 10 10:53:08.885162 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2910/3416] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:08 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:08.903716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9184f47b-f7f3-4216-b930-332b6f3e9524 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:08.930749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9184f47b-f7f3-4216-b930-332b6f3e9524 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:08.932480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9184f47b-f7f3-4216-b930-332b6f3e9524 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:08.943651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9184f47b-f7f3-4216-b930-332b6f3e9524 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:08.984912 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9184f47b-f7f3-4216-b930-332b6f3e9524 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] HTTP exception thrown: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 is locked Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9184f47b-f7f3-4216-b930-332b6f3e9524 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Request method failure captured: Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action HTTP/1.1 Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 15 Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGteXl1e-hAw6XiTQIFIHZpjOFH3LyNvDq2Jp5-9mD1eNO8FqxuehXxaCJTaSZqtqNEpKdqKeFAGSty1sDCnAg7xDRB9cZeEHOlu6NwV0sQ54jfeAmVZITRhNMqOinMUIr7XAVe-oWNQ5kCGtEmg_938l6s4SBd3Xy7X_t0g_hbbsig Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/524c87c1679a4651a4e303650950283c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_524c87c1679a4651a4e303650950283c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 2cccb6588d07459eb1cfa9c00f53f7e2 Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: {"os-stop": {}} Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 is locked Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5', 'body': {'os-stop': {}}} Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 is locked Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 is locked Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 is locked Sep 10 10:53:08.989628 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:53:08.994328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9184f47b-f7f3-4216-b930-332b6f3e9524 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Returning 409 to user: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 is locked {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:53:09.015994 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9184f47b-f7f3-4216-b930-332b6f3e9524 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 409 len: 107 microversion: 2.1 time: 0.091825 Sep 10 10:53:09.021137 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2911/3417] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:53:08 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 107 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:53:09.049891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fda9cd08-9654-4e71-a876-5fcc360f54f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:09.051041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fda9cd08-9654-4e71-a876-5fcc360f54f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:09.061439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fda9cd08-9654-4e71-a876-5fcc360f54f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:09.065674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fda9cd08-9654-4e71-a876-5fcc360f54f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:09.072037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fda9cd08-9654-4e71-a876-5fcc360f54f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:09.073201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fda9cd08-9654-4e71-a876-5fcc360f54f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:09.082868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fda9cd08-9654-4e71-a876-5fcc360f54f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:09.084288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fda9cd08-9654-4e71-a876-5fcc360f54f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:09.214495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fda9cd08-9654-4e71-a876-5fcc360f54f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Unlocking {{(pid=128788) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 10 10:53:09.333628 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fda9cd08-9654-4e71-a876-5fcc360f54f9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.310005 Sep 10 10:53:09.341227 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2912/3418] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:53:09 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:53:09.380419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:09.386142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:09.396755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:09.397605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:09.419743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:09.439592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:09.440150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:09.440598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:09.653729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:09.674913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:09.676691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:09.683439 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-276333f5-a814-4d98-ac90-fafe5166c579 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.339326 Sep 10 10:53:09.714876 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2913/3419] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:09 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:09.728369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef64b474-14cd-4236-8a3b-eeee12027363 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:09.737901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef64b474-14cd-4236-8a3b-eeee12027363 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:09.738422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef64b474-14cd-4236-8a3b-eeee12027363 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:09.738876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef64b474-14cd-4236-8a3b-eeee12027363 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:09.774313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef64b474-14cd-4236-8a3b-eeee12027363 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Going to try to stop instance {{(pid=128788) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 10:53:09.848946 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef64b474-14cd-4236-8a3b-eeee12027363 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.130364 Sep 10 10:53:09.849589 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2914/3420] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:53:09 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:53:09.879967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a78aef9a-4b1b-43cb-8976-185cbd99803f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:09.885083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a78aef9a-4b1b-43cb-8976-185cbd99803f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:09.902408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78aef9a-4b1b-43cb-8976-185cbd99803f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:09.904578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78aef9a-4b1b-43cb-8976-185cbd99803f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:09.906957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78aef9a-4b1b-43cb-8976-185cbd99803f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:09.910060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78aef9a-4b1b-43cb-8976-185cbd99803f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:09.911159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78aef9a-4b1b-43cb-8976-185cbd99803f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:09.912762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78aef9a-4b1b-43cb-8976-185cbd99803f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:10.402132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a78aef9a-4b1b-43cb-8976-185cbd99803f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:10.418635 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a78aef9a-4b1b-43cb-8976-185cbd99803f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.554857 Sep 10 10:53:10.420022 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2915/3421] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:09 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:10.734595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:10.735342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:10.763770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:10.772421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:10.773031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:10.773583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:10.774423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:10.774795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:10.781523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:10.965881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:10.981108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:11.010086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:11.025432 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-12ca81ab-e243-4c45-8e0e-ae5492ee0794 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.295862 Sep 10 10:53:11.049713 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2916/3422] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:10 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:53:11.445412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b53ef99d-769c-407a-b094-e4fa24c33c55 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:11.445949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b53ef99d-769c-407a-b094-e4fa24c33c55 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:11.460859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b53ef99d-769c-407a-b094-e4fa24c33c55 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:11.463567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b53ef99d-769c-407a-b094-e4fa24c33c55 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:11.465213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b53ef99d-769c-407a-b094-e4fa24c33c55 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:11.466230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b53ef99d-769c-407a-b094-e4fa24c33c55 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:11.466800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b53ef99d-769c-407a-b094-e4fa24c33c55 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:11.467360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b53ef99d-769c-407a-b094-e4fa24c33c55 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:11.919080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b53ef99d-769c-407a-b094-e4fa24c33c55 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:11.931235 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b53ef99d-769c-407a-b094-e4fa24c33c55 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.490616 Sep 10 10:53:11.945188 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2917/3423] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:11 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:12.060209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:12.060855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:12.076868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:12.077480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:12.077953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:12.078802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:12.079166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:12.090318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:12.276747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:12.281417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:12.316969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:12.319397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:12.332136 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-64335de9-55dd-4e60-86cd-44806c88fc1a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.277172 Sep 10 10:53:12.342857 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2918/3424] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:12 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:53:12.982093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b4eba58-dbbb-416f-944a-52a8f44d5370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:12.983213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b4eba58-dbbb-416f-944a-52a8f44d5370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:13.001426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b4eba58-dbbb-416f-944a-52a8f44d5370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:13.002828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b4eba58-dbbb-416f-944a-52a8f44d5370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:13.003532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b4eba58-dbbb-416f-944a-52a8f44d5370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:13.004672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b4eba58-dbbb-416f-944a-52a8f44d5370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:13.005627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b4eba58-dbbb-416f-944a-52a8f44d5370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:13.006217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b4eba58-dbbb-416f-944a-52a8f44d5370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:13.489997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG neutronclient.v2_0.client [None req-114c03e8-fe63-4eca-9826-842f41cb2507 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=128787) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:53:13.491200 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-114c03e8-fe63-4eca-9826-842f41cb2507 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 901.194904 Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack [None req-114c03e8-fe63-4eca-9826-842f41cb2507 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack Traceback (most recent call last): Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self.find_resource_by_id(resource, name_or_id, Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack raise exceptions.NotFound(message=not_found_message) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'tempest-securitygroup--986323876' Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack Traceback (most recent call last): Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack raise client_exc(message=error_message, Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-968380eb-d165-4537-8507-0066f3aea576'] Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack Traceback (most recent call last): Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return req.get_response(self.application) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack self._log_req(req, res, start) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack self.force_reraise() Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack raise self.value Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack res = req.get_response(self.application) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return resp(environ, start_response) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return request.get_response(self.application) Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 10 10:53:13.536646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack response = req.get_response(self._app) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return resp(environ, start_response) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return resp(environ, start_response) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack response = self.app(environ, start_response) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return resp(environ, start_response) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return method(req=request, **action_args) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return f(*args, **kwargs) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack [Previous line repeated 10 more times] Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self._create_instance( Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack security_groups = self._check_requested_secgroups( Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return neutronv20.find_resourceid_by_name_or_id( Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return find_resource_by_name_or_id(client, resource, name_or_id, Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return client.find_resource(resource, name_or_id, project_id, Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 10 10:53:13.540814 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self._find_resource_by_name( Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 457, in _find_resource_by_name Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack data = obj_lister(**params) Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1063, in list_security_groups Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self.list('security_groups', self.security_groups_path, Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack res = self.get(path, params=params) Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack raise exception.Unauthorized() Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack Sep 10 10:53:13.544944 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack [None req-114c03e8-fe63-4eca-9826-842f41cb2507 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] http://10.222.0.20/compute/v2.1/servers returned with HTTP 401 Sep 10 10:53:13.547940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-114c03e8-fe63-4eca-9826-842f41cb2507 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:53:13.548657 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:53:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 10:53:13.548657 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:53:13 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.20) Sep 10 10:53:13.550069 n-d-856894-1 devstack@n-api.service[128787]: CRITICAL nova [None req-114c03e8-fe63-4eca-9826-842f41cb2507 tempest-ServersTestBootFromVolume-336901701 tempest-ServersTestBootFromVolume-336901701-project] Unhandled error: OSError: write error Sep 10 10:53:13.550069 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova OSError: write error Sep 10 10:53:13.550069 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova Sep 10 10:53:13.550381 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 507/3425] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:38:12 2022] POST /compute/v2.1/servers => generated 0 bytes in 901260 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Sep 10 10:53:13.558457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:13.558457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:13.572953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:13.573993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:13.574752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:13.576697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:13.577497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:13.578311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:13.884602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:13.895780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2b4eba58-dbbb-416f-944a-52a8f44d5370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:13.901290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:13.905830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:13.914312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b4eba58-dbbb-416f-944a-52a8f44d5370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.953908 Sep 10 10:53:13.915688 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2919/3426] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:12 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:13.922293 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a53c0fa2-5b53-4327-b60a-73a1aa98d43a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.370677 Sep 10 10:53:13.949257 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 508/3427] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:13 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:14.941575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cfaa1aed-c68c-4f16-a1a4-54683ffd03b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:14.942382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cfaa1aed-c68c-4f16-a1a4-54683ffd03b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:14.962346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:14.963474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:14.966646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfaa1aed-c68c-4f16-a1a4-54683ffd03b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:14.973106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfaa1aed-c68c-4f16-a1a4-54683ffd03b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:14.975303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfaa1aed-c68c-4f16-a1a4-54683ffd03b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:14.977053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfaa1aed-c68c-4f16-a1a4-54683ffd03b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:14.978792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfaa1aed-c68c-4f16-a1a4-54683ffd03b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:14.979748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfaa1aed-c68c-4f16-a1a4-54683ffd03b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:14.983915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:14.988985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:14.993106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:14.995044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:15.003396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:15.005011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:15.180387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:15.190849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:15.199687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:15.218022 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bc683996-917d-4187-8129-aecffdf954b6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.264992 Sep 10 10:53:15.226445 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 509/3428] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:14 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:15.431113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cfaa1aed-c68c-4f16-a1a4-54683ffd03b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:15.440780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cfaa1aed-c68c-4f16-a1a4-54683ffd03b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.504760 Sep 10 10:53:15.448208 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2920/3429] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:14 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:15.653695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-386338047", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "b8d82f1f-45ce-4b21-8cb6-190274f5678d"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:15.813838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] validate_networks() for [('b8d82f1f-45ce-4b21-8cb6-190274f5678d', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:53:16.255814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:16.257350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:16.305597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:16.308056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:16.308743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:16.309863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:16.310338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:16.311128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:16.975094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:16.999251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:17.005294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:17.020780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bfa25e22-2b29-404c-97ee-2cca460a8260 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.770609 Sep 10 10:53:17.022033 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2921/3430] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:16 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:53:17.032707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-489a5bbb-1a6d-42c4-9cda-8d12e31693b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:17.036146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-489a5bbb-1a6d-42c4-9cda-8d12e31693b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:17.055887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-489a5bbb-1a6d-42c4-9cda-8d12e31693b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:17.056268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-489a5bbb-1a6d-42c4-9cda-8d12e31693b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:17.056709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-489a5bbb-1a6d-42c4-9cda-8d12e31693b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:17.057438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-489a5bbb-1a6d-42c4-9cda-8d12e31693b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:17.057888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-489a5bbb-1a6d-42c4-9cda-8d12e31693b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:17.058314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-489a5bbb-1a6d-42c4-9cda-8d12e31693b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:17.391705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-489a5bbb-1a6d-42c4-9cda-8d12e31693b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:17.401045 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-489a5bbb-1a6d-42c4-9cda-8d12e31693b8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.375947 Sep 10 10:53:17.401670 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2922/3431] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:17 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:17.553206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:53:17.553738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:53:17.556185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:53:17.556695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:53:17.557217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:53:17.571976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:17.574720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:17.575177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:17.575956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:17.576432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:17.576873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:17.624679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Getting quotas for project 40548aa2295d455fa563e34370502954. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:53:17.631867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Getting quotas for user d83ca354612b4f90a53e958948d91c18 and project 40548aa2295d455fa563e34370502954. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:53:17.649720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:53:17.652412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:53:17.723469 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2dd791b0-5b4a-4c3a-8596-1c1bcdacf15b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.154184 Sep 10 10:53:17.729617 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 510/3432] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:53:17.831048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1559394358", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "b8d82f1f-45ce-4b21-8cb6-190274f5678d"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:18.052091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:18.052809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:18.071956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:18.079673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:18.104289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:18.105290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:18.108235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:18.109210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:18.275939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:18.293000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:18.298209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:18.313046 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ab88a8bb-2136-40ae-9aa1-4d1ecdfc1519 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.264887 Sep 10 10:53:18.325194 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 511/3433] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:18 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:53:18.427540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bf9ad3de-aba0-4ad8-8dae-b3612409798d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:18.428474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bf9ad3de-aba0-4ad8-8dae-b3612409798d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:18.441217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ad3de-aba0-4ad8-8dae-b3612409798d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:18.441989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ad3de-aba0-4ad8-8dae-b3612409798d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:18.443172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ad3de-aba0-4ad8-8dae-b3612409798d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:18.445908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ad3de-aba0-4ad8-8dae-b3612409798d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:18.446799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ad3de-aba0-4ad8-8dae-b3612409798d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:18.448196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ad3de-aba0-4ad8-8dae-b3612409798d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:18.815559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bf9ad3de-aba0-4ad8-8dae-b3612409798d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:18.830301 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bf9ad3de-aba0-4ad8-8dae-b3612409798d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.408237 Sep 10 10:53:18.846530 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 512/3434] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:18 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:19.349882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:19.350664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:19.359676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:19.360230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:19.361169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:19.362653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:19.363383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:19.363886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:19.467464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:19.480731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:19.483163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:19.495065 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5df2f158-23de-4947-a6a1-a0359c88823a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.149257 Sep 10 10:53:19.496158 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 513/3435] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:19 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:19.857406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b8524725-ca59-4828-8de2-31e8285f96d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:19.858063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b8524725-ca59-4828-8de2-31e8285f96d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:19.870329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8524725-ca59-4828-8de2-31e8285f96d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:19.870914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8524725-ca59-4828-8de2-31e8285f96d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:19.871442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8524725-ca59-4828-8de2-31e8285f96d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:19.872320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8524725-ca59-4828-8de2-31e8285f96d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:19.872985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8524725-ca59-4828-8de2-31e8285f96d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:19.873656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8524725-ca59-4828-8de2-31e8285f96d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:20.151036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b8524725-ca59-4828-8de2-31e8285f96d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:20.175028 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b8524725-ca59-4828-8de2-31e8285f96d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.320638 Sep 10 10:53:20.193105 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 514/3436] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:19 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:20.525618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:20.526870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:20.532972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:20.533546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:20.533976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:20.534656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:20.535778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:20.537362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:20.669553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:20.679369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:20.680818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:20.686568 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c636bc5d-f662-4f4c-b18c-a32c80544992 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.164739 Sep 10 10:53:20.691050 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 515/3437] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:20 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:53:21.201344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6885c747-5d71-4d85-9a0d-d0b9822f1af8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:21.205669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6885c747-5d71-4d85-9a0d-d0b9822f1af8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:21.216197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6885c747-5d71-4d85-9a0d-d0b9822f1af8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:21.216691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6885c747-5d71-4d85-9a0d-d0b9822f1af8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:21.221626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6885c747-5d71-4d85-9a0d-d0b9822f1af8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:21.225425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6885c747-5d71-4d85-9a0d-d0b9822f1af8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:21.226202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6885c747-5d71-4d85-9a0d-d0b9822f1af8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:21.226923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6885c747-5d71-4d85-9a0d-d0b9822f1af8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:21.506861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6885c747-5d71-4d85-9a0d-d0b9822f1af8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:21.514977 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6885c747-5d71-4d85-9a0d-d0b9822f1af8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1657 microversion: 2.1 time: 0.319425 Sep 10 10:53:21.533030 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 516/3438] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:21 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1657 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:21.539859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a15a5517-0cc5-40f4-8607-38580e9fb229 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:21.548255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a15a5517-0cc5-40f4-8607-38580e9fb229 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:21.548778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a15a5517-0cc5-40f4-8607-38580e9fb229 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:21.549423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a15a5517-0cc5-40f4-8607-38580e9fb229 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:21.616885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a15a5517-0cc5-40f4-8607-38580e9fb229 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Going to try to start instance {{(pid=128787) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 10:53:21.679641 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a15a5517-0cc5-40f4-8607-38580e9fb229 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.142487 Sep 10 10:53:21.680377 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 517/3439] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:53:21 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:53:21.697112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c4475c76-31aa-4878-a7cc-ffb2431d3a75 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:21.700445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c4475c76-31aa-4878-a7cc-ffb2431d3a75 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:21.718795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4475c76-31aa-4878-a7cc-ffb2431d3a75 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:21.720039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4475c76-31aa-4878-a7cc-ffb2431d3a75 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:21.723114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4475c76-31aa-4878-a7cc-ffb2431d3a75 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:21.724200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4475c76-31aa-4878-a7cc-ffb2431d3a75 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:21.725058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4475c76-31aa-4878-a7cc-ffb2431d3a75 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:21.725670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4475c76-31aa-4878-a7cc-ffb2431d3a75 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:22.054809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c4475c76-31aa-4878-a7cc-ffb2431d3a75 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:22.081808 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c4475c76-31aa-4878-a7cc-ffb2431d3a75 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1666 microversion: 2.1 time: 0.391768 Sep 10 10:53:22.084647 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 518/3440] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:21 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1666 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:22.094556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:22.095438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:22.102213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:22.102819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:22.103415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:22.104456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:22.110101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:22.110679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:22.264112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:22.285545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:22.287752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:22.302141 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-72f18377-ab52-48f8-9937-210d0e9564bd tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.214243 Sep 10 10:53:22.303460 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 519/3441] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:22 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:22.483952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-5a6ecf7c-efc5-4d8f-9797-c47b50abde5d req-82256ec9-d052-46dd-afea-982358eec44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41aa1034-4e4f-4032-a6d9-796d34c15854", "tag": "f1a155e8-50b4-433e-b29d-c93592bbdcc0"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:22.506805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5a6ecf7c-efc5-4d8f-9797-c47b50abde5d req-82256ec9-d052-46dd-afea-982358eec44d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:22.507562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5a6ecf7c-efc5-4d8f-9797-c47b50abde5d req-82256ec9-d052-46dd-afea-982358eec44d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:22.508154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5a6ecf7c-efc5-4d8f-9797-c47b50abde5d req-82256ec9-d052-46dd-afea-982358eec44d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:22.523354 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-5a6ecf7c-efc5-4d8f-9797-c47b50abde5d req-82256ec9-d052-46dd-afea-982358eec44d service nova] Creating event network-changed:f1a155e8-50b4-433e-b29d-c93592bbdcc0 for instance 41aa1034-4e4f-4032-a6d9-796d34c15854 on n-h2-856894-1 Sep 10 10:53:22.532230 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-5a6ecf7c-efc5-4d8f-9797-c47b50abde5d req-82256ec9-d052-46dd-afea-982358eec44d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061019 Sep 10 10:53:22.534401 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 520/3442] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:53:23.123185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8d37684e-6c99-456a-a776-c0689d33ac2e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:23.124007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8d37684e-6c99-456a-a776-c0689d33ac2e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:23.132215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d37684e-6c99-456a-a776-c0689d33ac2e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:23.133312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d37684e-6c99-456a-a776-c0689d33ac2e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:23.133949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d37684e-6c99-456a-a776-c0689d33ac2e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:23.135026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d37684e-6c99-456a-a776-c0689d33ac2e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:23.136904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d37684e-6c99-456a-a776-c0689d33ac2e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:23.137519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d37684e-6c99-456a-a776-c0689d33ac2e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:23.351789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8d37684e-6c99-456a-a776-c0689d33ac2e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:23.360422 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8d37684e-6c99-456a-a776-c0689d33ac2e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1666 microversion: 2.1 time: 0.247397 Sep 10 10:53:23.362776 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 521/3443] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:23 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1666 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:23.370508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:23.371386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:23.380507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:23.381223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:23.381842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:23.382840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:23.383487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:23.384090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:23.478774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:23.489862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:23.491472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:23.497751 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4d95103f-bba8-4417-b313-1a87e4ec095b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.133592 Sep 10 10:53:23.499247 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 522/3444] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:23 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:24.398473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-806eb38b-da10-4c83-98f2-cd57a470b34a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:24.399628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-806eb38b-da10-4c83-98f2-cd57a470b34a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:24.421459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-806eb38b-da10-4c83-98f2-cd57a470b34a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:24.421968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-806eb38b-da10-4c83-98f2-cd57a470b34a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:24.422408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-806eb38b-da10-4c83-98f2-cd57a470b34a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:24.430780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-806eb38b-da10-4c83-98f2-cd57a470b34a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:24.431445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-806eb38b-da10-4c83-98f2-cd57a470b34a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:24.432173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-806eb38b-da10-4c83-98f2-cd57a470b34a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:24.756455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-806eb38b-da10-4c83-98f2-cd57a470b34a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:24.768800 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-806eb38b-da10-4c83-98f2-cd57a470b34a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1666 microversion: 2.1 time: 0.383290 Sep 10 10:53:24.769487 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 523/3445] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:24 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1666 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:24.775018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:24.775624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:24.789537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:24.790173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:24.790797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:24.791797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:24.792442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:24.793143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:24.905259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:24.916158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:24.930105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:24.932281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:24.957911 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bf33f528-efed-4aa9-bf59-3bd6f21b148d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.186878 Sep 10 10:53:24.973102 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 524/3446] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:24 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:25.793521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5a601d9e-b548-4952-ae26-88efb2117553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:25.794935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5a601d9e-b548-4952-ae26-88efb2117553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:25.803519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a601d9e-b548-4952-ae26-88efb2117553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:25.804098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a601d9e-b548-4952-ae26-88efb2117553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:25.804761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a601d9e-b548-4952-ae26-88efb2117553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:25.805581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a601d9e-b548-4952-ae26-88efb2117553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:25.806250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a601d9e-b548-4952-ae26-88efb2117553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:25.806880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a601d9e-b548-4952-ae26-88efb2117553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:25.971005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5a601d9e-b548-4952-ae26-88efb2117553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:25.979413 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5a601d9e-b548-4952-ae26-88efb2117553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.190620 Sep 10 10:53:25.980216 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 525/3447] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:25 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:26.006985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:26.007810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:26.017538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:26.018190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:26.018699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:26.019532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:26.020004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:26.020441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:26.100073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:26.114629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:26.116393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:26.122694 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4e33b923-9a9c-4536-8807-c2366daab1f8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.120193 Sep 10 10:53:26.123290 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 526/3448] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:25 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:26.128428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-88cff6ab-ad1d-4a60-83fa-702f6c90d683 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:26.129037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-88cff6ab-ad1d-4a60-83fa-702f6c90d683 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:26.135262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88cff6ab-ad1d-4a60-83fa-702f6c90d683 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:26.135755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88cff6ab-ad1d-4a60-83fa-702f6c90d683 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:26.136193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88cff6ab-ad1d-4a60-83fa-702f6c90d683 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:26.136891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88cff6ab-ad1d-4a60-83fa-702f6c90d683 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:26.137509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88cff6ab-ad1d-4a60-83fa-702f6c90d683 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:26.137975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88cff6ab-ad1d-4a60-83fa-702f6c90d683 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:26.301749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-88cff6ab-ad1d-4a60-83fa-702f6c90d683 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:26.318550 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-88cff6ab-ad1d-4a60-83fa-702f6c90d683 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.194198 Sep 10 10:53:26.319613 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 527/3449] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:26 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:26.344050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a22f5c3c-fa0d-40c1-9dbb-c138d0e424e6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:26.344665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a22f5c3c-fa0d-40c1-9dbb-c138d0e424e6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:26.353065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a22f5c3c-fa0d-40c1-9dbb-c138d0e424e6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:26.354007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a22f5c3c-fa0d-40c1-9dbb-c138d0e424e6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:26.354525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a22f5c3c-fa0d-40c1-9dbb-c138d0e424e6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:26.357883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a22f5c3c-fa0d-40c1-9dbb-c138d0e424e6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:26.358351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a22f5c3c-fa0d-40c1-9dbb-c138d0e424e6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:26.358778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a22f5c3c-fa0d-40c1-9dbb-c138d0e424e6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:26.445313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a22f5c3c-fa0d-40c1-9dbb-c138d0e424e6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Unlocking {{(pid=128787) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 10 10:53:26.588747 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a22f5c3c-fa0d-40c1-9dbb-c138d0e424e6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.250391 Sep 10 10:53:26.597524 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 528/3450] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:53:26 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:53:26.603754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-308db8df-c262-480d-95c7-70916e0af27e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:26.604474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-308db8df-c262-480d-95c7-70916e0af27e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:26.615335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308db8df-c262-480d-95c7-70916e0af27e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:26.616155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308db8df-c262-480d-95c7-70916e0af27e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:26.616602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308db8df-c262-480d-95c7-70916e0af27e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:26.617340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308db8df-c262-480d-95c7-70916e0af27e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:26.617793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308db8df-c262-480d-95c7-70916e0af27e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:26.618217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308db8df-c262-480d-95c7-70916e0af27e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:26.808116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-308db8df-c262-480d-95c7-70916e0af27e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:26.819782 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-308db8df-c262-480d-95c7-70916e0af27e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.220939 Sep 10 10:53:26.821307 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 529/3451] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:26 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:26.846129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-70c52f77-0ad9-4c79-8f8d-069060c52684 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:26.847009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-70c52f77-0ad9-4c79-8f8d-069060c52684 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:26.853469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70c52f77-0ad9-4c79-8f8d-069060c52684 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:26.853957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70c52f77-0ad9-4c79-8f8d-069060c52684 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:26.854396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70c52f77-0ad9-4c79-8f8d-069060c52684 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:26.855153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70c52f77-0ad9-4c79-8f8d-069060c52684 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:26.857496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70c52f77-0ad9-4c79-8f8d-069060c52684 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:26.857496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70c52f77-0ad9-4c79-8f8d-069060c52684 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:27.011885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-70c52f77-0ad9-4c79-8f8d-069060c52684 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:27.025871 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-70c52f77-0ad9-4c79-8f8d-069060c52684 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.183192 Sep 10 10:53:27.029156 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 530/3452] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:26 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:27.048273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e22fa901-38e9-4f46-a6c9-8f35c417f8d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:27.049474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e22fa901-38e9-4f46-a6c9-8f35c417f8d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:27.056421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e22fa901-38e9-4f46-a6c9-8f35c417f8d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:27.056921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e22fa901-38e9-4f46-a6c9-8f35c417f8d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:27.057399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e22fa901-38e9-4f46-a6c9-8f35c417f8d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:27.058120 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e22fa901-38e9-4f46-a6c9-8f35c417f8d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:27.058712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e22fa901-38e9-4f46-a6c9-8f35c417f8d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:27.059659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e22fa901-38e9-4f46-a6c9-8f35c417f8d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:27.261110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e22fa901-38e9-4f46-a6c9-8f35c417f8d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:27.275261 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e22fa901-38e9-4f46-a6c9-8f35c417f8d5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.230727 Sep 10 10:53:27.276171 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 531/3453] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:27 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:27.302598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:27.303216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:27.310327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:27.310855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:27.311299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:27.312009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:27.312554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:27.312954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:27.386267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:27.396327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:27.397878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:27.399849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=24 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:27.403562 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-631a6563-41cb-4f9b-9dc0-3e45c2b3ac0e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.112794 Sep 10 10:53:27.404144 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 532/3454] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:27 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:27.409464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b45f843e-e38e-4d42-bd49-384dd64b8101 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:27.409992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b45f843e-e38e-4d42-bd49-384dd64b8101 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:27.415946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b45f843e-e38e-4d42-bd49-384dd64b8101 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:27.416428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b45f843e-e38e-4d42-bd49-384dd64b8101 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:27.416855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b45f843e-e38e-4d42-bd49-384dd64b8101 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:27.417568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b45f843e-e38e-4d42-bd49-384dd64b8101 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:27.418017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b45f843e-e38e-4d42-bd49-384dd64b8101 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:27.418435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b45f843e-e38e-4d42-bd49-384dd64b8101 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:27.516095 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b45f843e-e38e-4d42-bd49-384dd64b8101 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.110310 Sep 10 10:53:27.520569 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 533/3455] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:53:27 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:53:27.527838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c0c8120a-a94f-46d5-8332-88666b68a92c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:27.528455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c0c8120a-a94f-46d5-8332-88666b68a92c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:27.536535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0c8120a-a94f-46d5-8332-88666b68a92c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:27.537060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0c8120a-a94f-46d5-8332-88666b68a92c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:27.537510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0c8120a-a94f-46d5-8332-88666b68a92c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:27.538210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0c8120a-a94f-46d5-8332-88666b68a92c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:27.538678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0c8120a-a94f-46d5-8332-88666b68a92c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:27.539085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0c8120a-a94f-46d5-8332-88666b68a92c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:27.604678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:27.643831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:27.744149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c0c8120a-a94f-46d5-8332-88666b68a92c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:27.760607 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c0c8120a-a94f-46d5-8332-88666b68a92c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1675 microversion: 2.1 time: 0.238353 Sep 10 10:53:27.761927 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 534/3456] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:27 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1675 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:27.846181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=21 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:28.431774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:28.432379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:28.438960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:28.440236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:28.440665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:28.441570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:28.442018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:28.442603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:28.518946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:28.532276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:28.534084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:28.540333 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1ea50835-1826-493e-8b47-9a0971c4bba2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.112226 Sep 10 10:53:28.541865 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 535/3457] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:28 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:28.686757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-1c0686d2-146c-4ce3-b7e8-582e30f0e73a req-a2bfa608-758d-45d9-9783-59d69f7071d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41aa1034-4e4f-4032-a6d9-796d34c15854", "name": "network-vif-plugged", "status": "completed", "tag": "f1a155e8-50b4-433e-b29d-c93592bbdcc0"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:28.712527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1c0686d2-146c-4ce3-b7e8-582e30f0e73a req-a2bfa608-758d-45d9-9783-59d69f7071d0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:28.713627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1c0686d2-146c-4ce3-b7e8-582e30f0e73a req-a2bfa608-758d-45d9-9783-59d69f7071d0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:28.714073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1c0686d2-146c-4ce3-b7e8-582e30f0e73a req-a2bfa608-758d-45d9-9783-59d69f7071d0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:28.750220 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-1c0686d2-146c-4ce3-b7e8-582e30f0e73a req-a2bfa608-758d-45d9-9783-59d69f7071d0 service nova] Creating event network-vif-plugged:f1a155e8-50b4-433e-b29d-c93592bbdcc0 for instance 41aa1034-4e4f-4032-a6d9-796d34c15854 on n-h2-856894-1 Sep 10 10:53:28.760514 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-1c0686d2-146c-4ce3-b7e8-582e30f0e73a req-a2bfa608-758d-45d9-9783-59d69f7071d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078965 Sep 10 10:53:28.762848 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 536/3458] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:53:28.786021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2cb917d6-d694-4e5f-81e7-e7f9ea40d355 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:28.788201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2cb917d6-d694-4e5f-81e7-e7f9ea40d355 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:28.805528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cb917d6-d694-4e5f-81e7-e7f9ea40d355 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:28.806430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cb917d6-d694-4e5f-81e7-e7f9ea40d355 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:28.807026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cb917d6-d694-4e5f-81e7-e7f9ea40d355 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:28.807887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cb917d6-d694-4e5f-81e7-e7f9ea40d355 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:28.808486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cb917d6-d694-4e5f-81e7-e7f9ea40d355 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:28.809087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cb917d6-d694-4e5f-81e7-e7f9ea40d355 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:29.030863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2cb917d6-d694-4e5f-81e7-e7f9ea40d355 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:29.042919 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2cb917d6-d694-4e5f-81e7-e7f9ea40d355 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1655 microversion: 2.1 time: 0.261715 Sep 10 10:53:29.043520 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 537/3459] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:28 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1655 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:29.066519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e899b86-1a60-4fc5-bd0d-2f869aeb3a25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:29.067142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4e899b86-1a60-4fc5-bd0d-2f869aeb3a25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:29.073614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e899b86-1a60-4fc5-bd0d-2f869aeb3a25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:29.074107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e899b86-1a60-4fc5-bd0d-2f869aeb3a25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:29.074555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e899b86-1a60-4fc5-bd0d-2f869aeb3a25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:29.075276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e899b86-1a60-4fc5-bd0d-2f869aeb3a25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:29.075719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e899b86-1a60-4fc5-bd0d-2f869aeb3a25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:29.076195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e899b86-1a60-4fc5-bd0d-2f869aeb3a25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:29.108750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:29.155167 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4e899b86-1a60-4fc5-bd0d-2f869aeb3a25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.092335 Sep 10 10:53:29.156182 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 538/3460] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:53:29 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:53:29.166274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6adfce4a-a9e3-4845-a1f8-b79678aaa07e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:29.167231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6adfce4a-a9e3-4845-a1f8-b79678aaa07e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:29.171484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:29.176978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6adfce4a-a9e3-4845-a1f8-b79678aaa07e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:29.177674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6adfce4a-a9e3-4845-a1f8-b79678aaa07e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:29.178117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6adfce4a-a9e3-4845-a1f8-b79678aaa07e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:29.179175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6adfce4a-a9e3-4845-a1f8-b79678aaa07e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:29.179693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6adfce4a-a9e3-4845-a1f8-b79678aaa07e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:29.180118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6adfce4a-a9e3-4845-a1f8-b79678aaa07e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:29.345115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6adfce4a-a9e3-4845-a1f8-b79678aaa07e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:29.357230 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6adfce4a-a9e3-4845-a1f8-b79678aaa07e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1662 microversion: 2.1 time: 0.193912 Sep 10 10:53:29.357230 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 539/3461] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:29 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1662 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:29.573299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:29.574046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:29.580874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:29.581466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:29.581970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:29.583077 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:29.583603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:29.584251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:29.706423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:29.715041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:29.716685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:29.722733 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-61b9d897-e9fb-4764-aa7b-a3521b79ef6a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.153438 Sep 10 10:53:29.723668 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 540/3462] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:29 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:30.379837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fd4e0e18-5c2c-4c74-b4ee-97829680cd72 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:30.380476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fd4e0e18-5c2c-4c74-b4ee-97829680cd72 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:30.387003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd4e0e18-5c2c-4c74-b4ee-97829680cd72 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:30.387664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd4e0e18-5c2c-4c74-b4ee-97829680cd72 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:30.388304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd4e0e18-5c2c-4c74-b4ee-97829680cd72 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:30.389555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd4e0e18-5c2c-4c74-b4ee-97829680cd72 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:30.390166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd4e0e18-5c2c-4c74-b4ee-97829680cd72 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:30.390742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd4e0e18-5c2c-4c74-b4ee-97829680cd72 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:30.543190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fd4e0e18-5c2c-4c74-b4ee-97829680cd72 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:30.555201 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fd4e0e18-5c2c-4c74-b4ee-97829680cd72 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.179795 Sep 10 10:53:30.556101 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 541/3463] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:30 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:30.578379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fbc8983b-7d47-4a66-8e7c-49e90d310c40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:30.579050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fbc8983b-7d47-4a66-8e7c-49e90d310c40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:30.587032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbc8983b-7d47-4a66-8e7c-49e90d310c40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:30.587681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbc8983b-7d47-4a66-8e7c-49e90d310c40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:30.588131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbc8983b-7d47-4a66-8e7c-49e90d310c40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:30.588825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbc8983b-7d47-4a66-8e7c-49e90d310c40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:30.589317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbc8983b-7d47-4a66-8e7c-49e90d310c40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:30.589737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbc8983b-7d47-4a66-8e7c-49e90d310c40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:30.756889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fbc8983b-7d47-4a66-8e7c-49e90d310c40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:30.774442 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fbc8983b-7d47-4a66-8e7c-49e90d310c40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.199850 Sep 10 10:53:30.775660 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 542/3464] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:30 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:30.792670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:30.792670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:30.807094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:30.809667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:30.810756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:30.815098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:30.816122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:30.817024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:30.919338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:30.932872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:30.934457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:30.940485 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3e6ce2e0-6f61-4a31-a68c-dcc3c0cc52fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.162222 Sep 10 10:53:30.941387 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 543/3465] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:30 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:30.960056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-203e1c18-74f1-4f4d-85da-586e3fe6913a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:30.960685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-203e1c18-74f1-4f4d-85da-586e3fe6913a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:30.966810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-203e1c18-74f1-4f4d-85da-586e3fe6913a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:30.967432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-203e1c18-74f1-4f4d-85da-586e3fe6913a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:30.967899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-203e1c18-74f1-4f4d-85da-586e3fe6913a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:30.968602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-203e1c18-74f1-4f4d-85da-586e3fe6913a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:30.969090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-203e1c18-74f1-4f4d-85da-586e3fe6913a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:30.969548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-203e1c18-74f1-4f4d-85da-586e3fe6913a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:31.163570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-203e1c18-74f1-4f4d-85da-586e3fe6913a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:31.174196 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-203e1c18-74f1-4f4d-85da-586e3fe6913a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.231118 Sep 10 10:53:31.190923 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 544/3466] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:30 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:31.198883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b72b5afa-01b6-4d4d-ad6e-5cb1bbc56fb0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:31.199504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b72b5afa-01b6-4d4d-ad6e-5cb1bbc56fb0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:31.206733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b72b5afa-01b6-4d4d-ad6e-5cb1bbc56fb0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:31.207230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b72b5afa-01b6-4d4d-ad6e-5cb1bbc56fb0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:31.207671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b72b5afa-01b6-4d4d-ad6e-5cb1bbc56fb0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:31.208711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b72b5afa-01b6-4d4d-ad6e-5cb1bbc56fb0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:31.211838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b72b5afa-01b6-4d4d-ad6e-5cb1bbc56fb0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:31.211838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b72b5afa-01b6-4d4d-ad6e-5cb1bbc56fb0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:31.376913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b72b5afa-01b6-4d4d-ad6e-5cb1bbc56fb0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:31.385911 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b72b5afa-01b6-4d4d-ad6e-5cb1bbc56fb0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.191012 Sep 10 10:53:31.392839 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 545/3467] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:31 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:31.409989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0d66f094-492a-4b1a-8c22-944f49393b28 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:31.410688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0d66f094-492a-4b1a-8c22-944f49393b28 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:31.419969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d66f094-492a-4b1a-8c22-944f49393b28 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:31.419969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d66f094-492a-4b1a-8c22-944f49393b28 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:31.419969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d66f094-492a-4b1a-8c22-944f49393b28 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:31.419969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d66f094-492a-4b1a-8c22-944f49393b28 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:31.419969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d66f094-492a-4b1a-8c22-944f49393b28 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:31.419969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d66f094-492a-4b1a-8c22-944f49393b28 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:31.586187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0d66f094-492a-4b1a-8c22-944f49393b28 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:31.598104 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0d66f094-492a-4b1a-8c22-944f49393b28 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.192621 Sep 10 10:53:31.598696 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 546/3468] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:31 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:31.620530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-41821f04-69ef-41a5-819f-17ef4a7d3768 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:31.621164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-41821f04-69ef-41a5-819f-17ef4a7d3768 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:31.629516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41821f04-69ef-41a5-819f-17ef4a7d3768 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:31.630232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41821f04-69ef-41a5-819f-17ef4a7d3768 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:31.630667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41821f04-69ef-41a5-819f-17ef4a7d3768 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:31.631360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41821f04-69ef-41a5-819f-17ef4a7d3768 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:31.631812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41821f04-69ef-41a5-819f-17ef4a7d3768 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:31.632228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41821f04-69ef-41a5-819f-17ef4a7d3768 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:31.803674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-41821f04-69ef-41a5-819f-17ef4a7d3768 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:31.810103 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-41821f04-69ef-41a5-819f-17ef4a7d3768 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.193237 Sep 10 10:53:31.815307 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 547/3469] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:31 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:31.984740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:31.985526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:31.992523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:31.993012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:31.993509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:31.994206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:31.997527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:31.998196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:32.093654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:32.107407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:32.110051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:32.118597 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2e40f328-51b2-4aa5-a8cc-82f3b4963d9e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.140586 Sep 10 10:53:32.120454 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 548/3470] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:31 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:33.155635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:33.157305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:33.164381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:33.165105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:33.165708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:33.166914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:33.167485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:33.167794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:33.257754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:33.268452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:33.270057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:33.276738 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e2166d51-1076-4273-8376-bfc2bfef0709 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.127338 Sep 10 10:53:33.285552 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 549/3471] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:33 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:34.305058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:34.306995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:34.321582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:34.322301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:34.323186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:34.323712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:34.324370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:34.324859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:34.406908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:34.417642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:34.419621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:34.425924 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-300d5c39-1d78-4006-a653-7128c044f9fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.125865 Sep 10 10:53:34.426496 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 550/3472] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:34 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:35.453977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:35.455788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:35.463439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:35.464484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:35.465026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:35.465768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:35.469340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:35.470074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:35.544962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:35.554859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:35.556794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:35.563341 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-eff5caab-b12e-4f4c-aec9-1ae9a566e5ee tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.113087 Sep 10 10:53:35.568121 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 551/3473] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:35 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:36.593982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:36.596278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:36.604314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:36.604871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:36.605452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:36.606226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:36.606684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:36.607107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:36.728420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:36.740550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:36.747903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:36.755911 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f790f376-140d-487d-b7b2-a535e102b052 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.167758 Sep 10 10:53:36.757323 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 552/3474] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:36 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:53:37.027779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] validate_networks() for [('b8d82f1f-45ce-4b21-8cb6-190274f5678d', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:53:37.785588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:37.786821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:37.800910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:37.807067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:37.809385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:37.811578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:37.812982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:37.814684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:38.088948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:53:38.089995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:53:38.090658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:53:38.091233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:53:38.091655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:53:38.107904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:38.108693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:38.109102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:38.110095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:38.114713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:38.114713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:38.140348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:38.150638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Getting quotas for project 40548aa2295d455fa563e34370502954. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:53:38.150767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:38.152198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:38.159174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Getting quotas for user d83ca354612b4f90a53e958948d91c18 and project 40548aa2295d455fa563e34370502954. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:53:38.165472 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5b9e01b9-c6f1-47b5-b201-bfb067c0e2fa tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1533 microversion: 2.91 time: 0.384194 Sep 10 10:53:38.166677 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 553/3475] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:37 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1533 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:53:38.176692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:53:38.179794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:53:38.193322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cb9a066e-c6f3-46e8-ad42-c45ba9480777 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:38.194156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cb9a066e-c6f3-46e8-ad42-c45ba9480777 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:38.200816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb9a066e-c6f3-46e8-ad42-c45ba9480777 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:38.201586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb9a066e-c6f3-46e8-ad42-c45ba9480777 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:38.202251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb9a066e-c6f3-46e8-ad42-c45ba9480777 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:38.203188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb9a066e-c6f3-46e8-ad42-c45ba9480777 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:38.203888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb9a066e-c6f3-46e8-ad42-c45ba9480777 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:38.205061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb9a066e-c6f3-46e8-ad42-c45ba9480777 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:38.265321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-44cadc60-de0f-4437-b868-0fc8b26300db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 20.438861 Sep 10 10:53:38.267626 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2923/3476] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:53:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 20442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:53:38.273648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:38.383262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-cb9a066e-c6f3-46e8-ad42-c45ba9480777 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lazy-loading 'services' on Instance uuid b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:53:38.404853 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cb9a066e-c6f3-46e8-ad42-c45ba9480777 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1938 microversion: 2.91 time: 0.214706 Sep 10 10:53:38.405877 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 554/3477] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:38 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1938 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:53:38.433890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97050c90-18fb-4cf2-aa60-9e6fc1e3ba09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:38.434420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-97050c90-18fb-4cf2-aa60-9e6fc1e3ba09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:38.442309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97050c90-18fb-4cf2-aa60-9e6fc1e3ba09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:38.443013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97050c90-18fb-4cf2-aa60-9e6fc1e3ba09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:38.443619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97050c90-18fb-4cf2-aa60-9e6fc1e3ba09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:38.444479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97050c90-18fb-4cf2-aa60-9e6fc1e3ba09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:38.445291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97050c90-18fb-4cf2-aa60-9e6fc1e3ba09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:38.445874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97050c90-18fb-4cf2-aa60-9e6fc1e3ba09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:38.480852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-97050c90-18fb-4cf2-aa60-9e6fc1e3ba09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lazy-loading 'flavor' on Instance uuid b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:53:38.518062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-733158452", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "451", "networks": [{"uuid": "b8d82f1f-45ce-4b21-8cb6-190274f5678d"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:38.670603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] validate_networks() for [('b8d82f1f-45ce-4b21-8cb6-190274f5678d', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:53:38.992047 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-97050c90-18fb-4cf2-aa60-9e6fc1e3ba09 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "POST /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5/action" status: 202 len: 0 microversion: 2.91 time: 0.562419 Sep 10 10:53:38.999299 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2924/3478] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:53:38 2022] POST /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:53:39.020520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:39.024235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:39.052239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:39.052829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:39.053309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:39.055118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:39.055118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:39.055118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:39.237410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:39.245958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:39.247426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:39.262970 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0a0a970-39b4-4001-82a4-9925600841ce tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.261026 Sep 10 10:53:39.271859 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2925/3479] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:38 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:39.569344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:53:39.570335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:53:39.571691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:53:39.572891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:53:39.573759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:53:39.589558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:39.589887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:39.590317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:39.591112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:39.591570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:39.592194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:39.611966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Getting quotas for project 40548aa2295d455fa563e34370502954. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:53:39.636586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Getting quotas for user d83ca354612b4f90a53e958948d91c18 and project 40548aa2295d455fa563e34370502954. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:53:39.670390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:53:39.679112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:53:39.859190 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8923c1f1-50e2-4613-9084-1fafb4d2b045 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.340104 Sep 10 10:53:39.869706 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 555/3480] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:53:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 10:53:39.873570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d7fb3623-1f35-4be0-983b-e8173f16e195 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:39.875522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d7fb3623-1f35-4be0-983b-e8173f16e195 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:40.027649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7fb3623-1f35-4be0-983b-e8173f16e195 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:40.043401 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d7fb3623-1f35-4be0-983b-e8173f16e195 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1220 microversion: 2.1 time: 0.173006 Sep 10 10:53:40.044121 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2926/3481] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:39 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1220 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:40.292609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:40.293264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:40.303481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:40.304922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:40.305623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:40.307786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:40.311303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:40.312122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:40.658252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:40.691588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:40.693054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:40.717881 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-24d34cba-07c8-4910-b15a-3cfc411dcd15 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.429108 Sep 10 10:53:40.718486 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 556/3482] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:40 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:41.075463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2aff7870-ee5d-4016-917b-5ce72009cbab tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:41.076098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2aff7870-ee5d-4016-917b-5ce72009cbab tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:41.097065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aff7870-ee5d-4016-917b-5ce72009cbab tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:41.097896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aff7870-ee5d-4016-917b-5ce72009cbab tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:41.098357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aff7870-ee5d-4016-917b-5ce72009cbab tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:41.099141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aff7870-ee5d-4016-917b-5ce72009cbab tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:41.099609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aff7870-ee5d-4016-917b-5ce72009cbab tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:41.100047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2aff7870-ee5d-4016-917b-5ce72009cbab tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:41.250917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2aff7870-ee5d-4016-917b-5ce72009cbab tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:41.260875 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2aff7870-ee5d-4016-917b-5ce72009cbab tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1216 microversion: 2.1 time: 0.192753 Sep 10 10:53:41.261641 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2927/3483] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:41 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:41.758533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:41.759154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:41.778168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:41.778695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:41.779150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:41.790583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:41.791154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:41.791735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:42.215187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:42.230049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:42.242494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:42.261755 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3c25ee44-09cb-4bbe-88a5-f8eabaf70a23 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.506724 Sep 10 10:53:42.262363 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 557/3484] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:41 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:42.299287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-008112b4-bf0c-4178-aafd-9e2b1bacf760 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:42.301162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-008112b4-bf0c-4178-aafd-9e2b1bacf760 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:42.318476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-008112b4-bf0c-4178-aafd-9e2b1bacf760 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:42.321032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-008112b4-bf0c-4178-aafd-9e2b1bacf760 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:42.322553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-008112b4-bf0c-4178-aafd-9e2b1bacf760 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:42.323632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-008112b4-bf0c-4178-aafd-9e2b1bacf760 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:42.324254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-008112b4-bf0c-4178-aafd-9e2b1bacf760 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:42.325336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-008112b4-bf0c-4178-aafd-9e2b1bacf760 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:42.626403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-008112b4-bf0c-4178-aafd-9e2b1bacf760 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:42.634776 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-008112b4-bf0c-4178-aafd-9e2b1bacf760 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1290 microversion: 2.1 time: 0.353068 Sep 10 10:53:42.638574 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2928/3485] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:42 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1290 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:43.295812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:43.297040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:43.306935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:43.309626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:43.310280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:43.311198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:43.317850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:43.318416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:43.463176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:43.482973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:43.484766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:43.495137 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ffc1e871-1baf-46ac-86dd-95750f7e4d7d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.203086 Sep 10 10:53:43.501162 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 558/3486] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:43 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:43.662770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e009481-7a61-4f71-9f47-f3d610eb1282 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:43.664076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e009481-7a61-4f71-9f47-f3d610eb1282 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:43.675839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e009481-7a61-4f71-9f47-f3d610eb1282 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:43.676612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e009481-7a61-4f71-9f47-f3d610eb1282 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:43.677584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e009481-7a61-4f71-9f47-f3d610eb1282 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:43.680761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e009481-7a61-4f71-9f47-f3d610eb1282 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:43.681681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e009481-7a61-4f71-9f47-f3d610eb1282 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:43.682298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e009481-7a61-4f71-9f47-f3d610eb1282 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:44.537726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:44.539089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:44.548153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:44.549317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:44.549956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:44.550916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:44.552412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:44.553118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:44.593592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e009481-7a61-4f71-9f47-f3d610eb1282 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:44.610945 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e009481-7a61-4f71-9f47-f3d610eb1282 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1320 microversion: 2.1 time: 0.949403 Sep 10 10:53:44.629340 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2929/3487] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:43 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1320 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:45.033151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:45.070248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:45.072591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:45.090685 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0aaa96a6-744d-40a3-b78b-04d05f361384 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.558375 Sep 10 10:53:45.092258 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 559/3488] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:44 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:45.565350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8ef77193-1064-4f9e-a0c7-25b4e1d804bd req-cfb592f1-0afb-4f26-a79b-75ec9bc6ee2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d", "tag": "2e9e60af-ee9d-4615-b961-2ba0535250ac"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:45.591699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8ef77193-1064-4f9e-a0c7-25b4e1d804bd req-cfb592f1-0afb-4f26-a79b-75ec9bc6ee2b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:45.592551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8ef77193-1064-4f9e-a0c7-25b4e1d804bd req-cfb592f1-0afb-4f26-a79b-75ec9bc6ee2b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:45.593836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8ef77193-1064-4f9e-a0c7-25b4e1d804bd req-cfb592f1-0afb-4f26-a79b-75ec9bc6ee2b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:45.616368 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8ef77193-1064-4f9e-a0c7-25b4e1d804bd req-cfb592f1-0afb-4f26-a79b-75ec9bc6ee2b service nova] Creating event network-changed:2e9e60af-ee9d-4615-b961-2ba0535250ac for instance 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d on n-h2-856894-1 Sep 10 10:53:45.621330 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8ef77193-1064-4f9e-a0c7-25b4e1d804bd req-cfb592f1-0afb-4f26-a79b-75ec9bc6ee2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062196 Sep 10 10:53:45.622035 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2930/3489] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:53:45.634845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d8eb05cb-bd81-483d-ba1c-38fee114a546 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:45.637910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d8eb05cb-bd81-483d-ba1c-38fee114a546 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:45.663172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8eb05cb-bd81-483d-ba1c-38fee114a546 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:45.664057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8eb05cb-bd81-483d-ba1c-38fee114a546 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:45.675061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8eb05cb-bd81-483d-ba1c-38fee114a546 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:45.676401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8eb05cb-bd81-483d-ba1c-38fee114a546 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:45.677242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8eb05cb-bd81-483d-ba1c-38fee114a546 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:45.678916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8eb05cb-bd81-483d-ba1c-38fee114a546 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:46.096593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d8eb05cb-bd81-483d-ba1c-38fee114a546 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:46.118125 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d8eb05cb-bd81-483d-ba1c-38fee114a546 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1320 microversion: 2.1 time: 0.486945 Sep 10 10:53:46.119520 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 560/3490] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:45 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1320 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:46.130722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:46.131835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:46.238969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:46.243446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:46.244757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:46.245747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:46.247180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:46.247836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:46.443124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:46.504486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:46.506335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:46.547312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62b11578-6b34-4153-a710-dbf6a503a2cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.430226 Sep 10 10:53:46.552537 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2931/3491] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:46 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:47.156490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b52043f4-8a59-400b-b857-e1d43f023d25 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:47.158106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b52043f4-8a59-400b-b857-e1d43f023d25 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:47.180063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b52043f4-8a59-400b-b857-e1d43f023d25 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:47.183964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b52043f4-8a59-400b-b857-e1d43f023d25 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:47.185383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b52043f4-8a59-400b-b857-e1d43f023d25 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:47.187516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b52043f4-8a59-400b-b857-e1d43f023d25 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:47.190310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b52043f4-8a59-400b-b857-e1d43f023d25 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:47.191113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b52043f4-8a59-400b-b857-e1d43f023d25 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:47.382733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b52043f4-8a59-400b-b857-e1d43f023d25 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:47.391145 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b52043f4-8a59-400b-b857-e1d43f023d25 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1320 microversion: 2.1 time: 0.246908 Sep 10 10:53:47.392680 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 561/3492] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:47 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:47.586314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:47.587909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:47.598962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:47.600029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:47.600876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:47.602257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:47.603086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:47.603625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:47.671809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-c9f50b26-d2a7-4d44-a599-65b4743a4704 req-01e0e86f-e65d-4e7c-a625-ffa8989ba413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c735898-c187-46f3-8cd5-8f8c25d6090a", "tag": "76a310f1-6068-463e-ba5b-661445876ea6"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:47.710003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c9f50b26-d2a7-4d44-a599-65b4743a4704 req-01e0e86f-e65d-4e7c-a625-ffa8989ba413 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:47.710945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c9f50b26-d2a7-4d44-a599-65b4743a4704 req-01e0e86f-e65d-4e7c-a625-ffa8989ba413 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:47.711682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c9f50b26-d2a7-4d44-a599-65b4743a4704 req-01e0e86f-e65d-4e7c-a625-ffa8989ba413 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:47.732769 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-c9f50b26-d2a7-4d44-a599-65b4743a4704 req-01e0e86f-e65d-4e7c-a625-ffa8989ba413 service nova] Creating event network-changed:76a310f1-6068-463e-ba5b-661445876ea6 for instance 7c735898-c187-46f3-8cd5-8f8c25d6090a on n-h2-856894-1 Sep 10 10:53:47.771187 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-c9f50b26-d2a7-4d44-a599-65b4743a4704 req-01e0e86f-e65d-4e7c-a625-ffa8989ba413 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122839 Sep 10 10:53:47.771520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:47.773063 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 562/3493] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:53:47.791540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:47.807991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:47.832740 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-39c64ec6-bb21-4b54-a7e0-c51d9fb39200 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.252250 Sep 10 10:53:47.833374 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2932/3494] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:47 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:48.419424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96c84515-5c97-44e4-8332-366a956b9803 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:48.420668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-96c84515-5c97-44e4-8332-366a956b9803 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:48.437665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c84515-5c97-44e4-8332-366a956b9803 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:48.438641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c84515-5c97-44e4-8332-366a956b9803 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:48.439236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c84515-5c97-44e4-8332-366a956b9803 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:48.440104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c84515-5c97-44e4-8332-366a956b9803 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:48.440743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c84515-5c97-44e4-8332-366a956b9803 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:48.441346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c84515-5c97-44e4-8332-366a956b9803 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:48.867635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:48.868337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:48.875593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:48.899515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:48.901629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:48.907950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:48.908799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:48.909422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:48.910132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:49.128552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:49.154858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:49.158141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:49.166660 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-03069323-e595-4fd4-bdda-102d95938fa4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.303415 Sep 10 10:53:49.186977 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2933/3495] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:48 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:49.224228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-96c84515-5c97-44e4-8332-366a956b9803 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:49.235573 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-96c84515-5c97-44e4-8332-366a956b9803 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1320 microversion: 2.1 time: 0.823241 Sep 10 10:53:49.247137 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 563/3496] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:48 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1320 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:50.203529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:50.205585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:50.214208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:50.223806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:50.224456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:50.225130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:50.226450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:50.227690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:50.228423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:50.269904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2e22219f-9104-49e5-b9c8-e4c32c9f71f3 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:50.270566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2e22219f-9104-49e5-b9c8-e4c32c9f71f3 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:50.273250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:50.274771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:50.298003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e22219f-9104-49e5-b9c8-e4c32c9f71f3 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:50.300213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e22219f-9104-49e5-b9c8-e4c32c9f71f3 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:50.301356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e22219f-9104-49e5-b9c8-e4c32c9f71f3 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:50.305322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e22219f-9104-49e5-b9c8-e4c32c9f71f3 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:50.306546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e22219f-9104-49e5-b9c8-e4c32c9f71f3 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:50.309229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e22219f-9104-49e5-b9c8-e4c32c9f71f3 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:50.488883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:50.502150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:50.503669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:50.521577 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fcb70307-568c-4ce8-a582-c462540ee2d0 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.325374 Sep 10 10:53:50.522831 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2934/3497] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:50 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:51.111511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2e22219f-9104-49e5-b9c8-e4c32c9f71f3 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:51.122471 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2e22219f-9104-49e5-b9c8-e4c32c9f71f3 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1320 microversion: 2.1 time: 0.856793 Sep 10 10:53:51.123060 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 564/3498] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:50 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1320 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:51.553857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:51.555070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:51.571650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:51.573461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:51.573461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:51.573461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:51.573751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:51.581466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:51.754556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:51.765958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:51.767994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:51.782298 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-461ce173-1398-4a58-af97-f8d0e76d9829 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1560 microversion: 2.91 time: 0.232138 Sep 10 10:53:51.790099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2935/3499] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:51 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:52.149920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dc8d163f-6d87-401e-bfba-8621a9c2028f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:52.151709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dc8d163f-6d87-401e-bfba-8621a9c2028f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:52.161318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8d163f-6d87-401e-bfba-8621a9c2028f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:52.161974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8d163f-6d87-401e-bfba-8621a9c2028f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:52.162955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8d163f-6d87-401e-bfba-8621a9c2028f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:52.164079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8d163f-6d87-401e-bfba-8621a9c2028f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:52.164850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8d163f-6d87-401e-bfba-8621a9c2028f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:52.165579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8d163f-6d87-401e-bfba-8621a9c2028f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:52.338823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dc8d163f-6d87-401e-bfba-8621a9c2028f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:52.353404 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dc8d163f-6d87-401e-bfba-8621a9c2028f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1320 microversion: 2.1 time: 0.208536 Sep 10 10:53:52.354441 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 565/3500] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:52 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1320 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:52.820708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:52.821579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:52.834997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:52.835501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:52.840348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:52.841313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:52.842116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:52.843239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:53.008057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:53.019490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:53.026080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:53.042024 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4cf33b6f-8527-47cd-a6df-f70cfa86da35 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.224036 Sep 10 10:53:53.042766 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2936/3501] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:52 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:53.387644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-da3c2135-19ed-4f9a-93bf-8fa1e82e67b2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:53.388976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-da3c2135-19ed-4f9a-93bf-8fa1e82e67b2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:53.400528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da3c2135-19ed-4f9a-93bf-8fa1e82e67b2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:53.401488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da3c2135-19ed-4f9a-93bf-8fa1e82e67b2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:53.403013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da3c2135-19ed-4f9a-93bf-8fa1e82e67b2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:53.405163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da3c2135-19ed-4f9a-93bf-8fa1e82e67b2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:53.408492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da3c2135-19ed-4f9a-93bf-8fa1e82e67b2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:53.409358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da3c2135-19ed-4f9a-93bf-8fa1e82e67b2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:53.423407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d287e436-0e85-4566-a688-9a0c43fd029d req-70c1d027-af9e-453a-9c30-58a4b5e18519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d", "name": "network-vif-plugged", "status": "completed", "tag": "2e9e60af-ee9d-4615-b961-2ba0535250ac"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:53.507860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d287e436-0e85-4566-a688-9a0c43fd029d req-70c1d027-af9e-453a-9c30-58a4b5e18519 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:53.511456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d287e436-0e85-4566-a688-9a0c43fd029d req-70c1d027-af9e-453a-9c30-58a4b5e18519 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:53.512203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d287e436-0e85-4566-a688-9a0c43fd029d req-70c1d027-af9e-453a-9c30-58a4b5e18519 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:53.584901 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d287e436-0e85-4566-a688-9a0c43fd029d req-70c1d027-af9e-453a-9c30-58a4b5e18519 service nova] Creating event network-vif-plugged:2e9e60af-ee9d-4615-b961-2ba0535250ac for instance 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d on n-h2-856894-1 Sep 10 10:53:53.599023 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d287e436-0e85-4566-a688-9a0c43fd029d req-70c1d027-af9e-453a-9c30-58a4b5e18519 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180485 Sep 10 10:53:53.600823 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2937/3502] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:53:53.774323 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:53:53.774655 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:53:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a (ip 10.222.0.20) !!! Sep 10 10:53:54.057559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-da3c2135-19ed-4f9a-93bf-8fa1e82e67b2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:54.073003 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-da3c2135-19ed-4f9a-93bf-8fa1e82e67b2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1320 microversion: 2.1 time: 0.699128 Sep 10 10:53:54.076661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:54.081873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:54.090954 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 566/3503] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:53 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1320 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:54.101242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:54.117722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:54.118209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:54.118985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:54.119458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:54.119910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:54.435385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:54.447121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:54.452027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:54.472493 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51937724-0269-4661-89d7-e6598a12ad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.400184 Sep 10 10:53:54.478699 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2938/3504] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:54 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:53:55.101668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-37e98c9d-0ee3-4ed9-be7b-540ebc675a01 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:55.102887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-37e98c9d-0ee3-4ed9-be7b-540ebc675a01 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:55.119948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37e98c9d-0ee3-4ed9-be7b-540ebc675a01 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:55.126898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37e98c9d-0ee3-4ed9-be7b-540ebc675a01 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:55.128989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37e98c9d-0ee3-4ed9-be7b-540ebc675a01 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:55.130752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37e98c9d-0ee3-4ed9-be7b-540ebc675a01 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:55.133908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37e98c9d-0ee3-4ed9-be7b-540ebc675a01 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:55.137096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37e98c9d-0ee3-4ed9-be7b-540ebc675a01 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:55.509808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:55.510538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:55.527506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:55.529906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:55.534161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:55.535118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:55.535861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:55.536523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:55.613141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-37e98c9d-0ee3-4ed9-be7b-540ebc675a01 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:55.639105 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-37e98c9d-0ee3-4ed9-be7b-540ebc675a01 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1320 microversion: 2.1 time: 0.540009 Sep 10 10:53:55.642352 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 567/3505] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:55 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1320 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:55.704681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-d7044c6d-1aaa-4083-91ef-fd8cae292dfc req-6090aa86-4b0b-4261-bb66-6fc3beb948db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c735898-c187-46f3-8cd5-8f8c25d6090a", "name": "network-vif-plugged", "status": "completed", "tag": "76a310f1-6068-463e-ba5b-661445876ea6"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:53:55.723604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d7044c6d-1aaa-4083-91ef-fd8cae292dfc req-6090aa86-4b0b-4261-bb66-6fc3beb948db service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:55.727447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d7044c6d-1aaa-4083-91ef-fd8cae292dfc req-6090aa86-4b0b-4261-bb66-6fc3beb948db service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:55.727927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d7044c6d-1aaa-4083-91ef-fd8cae292dfc req-6090aa86-4b0b-4261-bb66-6fc3beb948db service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:55.734978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:55.747454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:55.752043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:55.756927 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-d7044c6d-1aaa-4083-91ef-fd8cae292dfc req-6090aa86-4b0b-4261-bb66-6fc3beb948db service nova] Creating event network-vif-plugged:76a310f1-6068-463e-ba5b-661445876ea6 for instance 7c735898-c187-46f3-8cd5-8f8c25d6090a on n-h2-856894-1 Sep 10 10:53:55.762408 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02ff6d55-97e5-4da6-966a-4e1447c0cc53 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.256690 Sep 10 10:53:55.765823 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2939/3506] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:55 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:55.784102 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-d7044c6d-1aaa-4083-91ef-fd8cae292dfc req-6090aa86-4b0b-4261-bb66-6fc3beb948db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087422 Sep 10 10:53:55.791078 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 568/3507] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:53:56.662870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-980f8423-c4de-41a1-af35-a9ab2984716d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:56.664089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-980f8423-c4de-41a1-af35-a9ab2984716d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:56.677260 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:53:56.680367 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 10:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a (ip 10.222.0.20) !!! Sep 10 10:53:56.697452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-980f8423-c4de-41a1-af35-a9ab2984716d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:56.704330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-980f8423-c4de-41a1-af35-a9ab2984716d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:56.705605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-980f8423-c4de-41a1-af35-a9ab2984716d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:56.708485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-980f8423-c4de-41a1-af35-a9ab2984716d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:56.711825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-980f8423-c4de-41a1-af35-a9ab2984716d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:56.715799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-980f8423-c4de-41a1-af35-a9ab2984716d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:56.798310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:56.801189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:56.806979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:56.813716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:53:56.828563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:56.829853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:56.831203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:56.835228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:56.835904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:56.837243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:57.048412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:57.144579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:57.169558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:57.190958 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-30bc8bf3-b217-4b3f-ae20-9e4f2ae32450 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.400438 Sep 10 10:53:57.205773 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 569/3508] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:56 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:57.284498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-980f8423-c4de-41a1-af35-a9ab2984716d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:57.298249 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-980f8423-c4de-41a1-af35-a9ab2984716d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1320 microversion: 2.1 time: 0.638594 Sep 10 10:53:57.300594 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2940/3509] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:56 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1320 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:58.228526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:58.232133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:58.255284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:58.260479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:58.262358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:58.263742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:58.267442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:58.269050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:58.328400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2980d89c-5c7d-4e09-85bb-3159ec1a9559 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:58.329679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2980d89c-5c7d-4e09-85bb-3159ec1a9559 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:58.346766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2980d89c-5c7d-4e09-85bb-3159ec1a9559 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:58.352781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2980d89c-5c7d-4e09-85bb-3159ec1a9559 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:58.362186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2980d89c-5c7d-4e09-85bb-3159ec1a9559 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:58.364162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2980d89c-5c7d-4e09-85bb-3159ec1a9559 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:58.365848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2980d89c-5c7d-4e09-85bb-3159ec1a9559 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:58.368183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2980d89c-5c7d-4e09-85bb-3159ec1a9559 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:58.467669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:58.487685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:58.489279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:58.509906 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0b07a7e6-da58-4f27-9a4a-40aa8c25272b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.293117 Sep 10 10:53:58.514747 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 570/3510] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:58 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:53:58.747396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2980d89c-5c7d-4e09-85bb-3159ec1a9559 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:58.761779 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2980d89c-5c7d-4e09-85bb-3159ec1a9559 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1510 microversion: 2.1 time: 0.432853 Sep 10 10:53:58.778836 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2941/3511] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:58 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1510 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:53:58.792384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ee126688-c658-452a-8b6e-4134b5d96602 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:58.793441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ee126688-c658-452a-8b6e-4134b5d96602 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:58.804445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee126688-c658-452a-8b6e-4134b5d96602 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:58.805201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee126688-c658-452a-8b6e-4134b5d96602 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:58.805813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee126688-c658-452a-8b6e-4134b5d96602 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:58.808216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee126688-c658-452a-8b6e-4134b5d96602 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:58.809365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee126688-c658-452a-8b6e-4134b5d96602 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:58.811315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee126688-c658-452a-8b6e-4134b5d96602 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:59.374507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ee126688-c658-452a-8b6e-4134b5d96602 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:59.402638 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ee126688-c658-452a-8b6e-4134b5d96602 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1510 microversion: 2.1 time: 0.613037 Sep 10 10:53:59.418794 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 571/3512] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:58 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1510 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:59.432152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-190b4775-06d3-4796-b9f5-9aa5e06cbd52 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:59.433474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-190b4775-06d3-4796-b9f5-9aa5e06cbd52 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:59.444009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190b4775-06d3-4796-b9f5-9aa5e06cbd52 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:59.444526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190b4775-06d3-4796-b9f5-9aa5e06cbd52 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:59.444954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190b4775-06d3-4796-b9f5-9aa5e06cbd52 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:59.445705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190b4775-06d3-4796-b9f5-9aa5e06cbd52 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:59.462629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190b4775-06d3-4796-b9f5-9aa5e06cbd52 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:59.463092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-190b4775-06d3-4796-b9f5-9aa5e06cbd52 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:59.546635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:59.549206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:53:59.576187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:59.578670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:59.580094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:59.584998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:59.589822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:59.597276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:59.833312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-190b4775-06d3-4796-b9f5-9aa5e06cbd52 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:59.859539 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-190b4775-06d3-4796-b9f5-9aa5e06cbd52 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d" status: 200 len: 1512 microversion: 2.1 time: 0.432542 Sep 10 10:53:59.865648 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2942/3513] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:53:59 2022] GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d => generated 1512 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:53:59.893877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:53:59.904147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:53:59.908063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:53:59.944639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:59.947084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:59.949880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:53:59.952163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:53:59.954438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:53:59.955826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:00.091756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:00.100461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:00.147354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:00.164296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:00.219972 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a04a6515-f97f-4e2b-ad0b-9a334d6ceb62 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.671698 Sep 10 10:54:00.234974 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 572/3514] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:53:59 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:00.324427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:00.879827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:00.984316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:00.990225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:00.992342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:01.270511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:01.271849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:01.293662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:01.295043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:01.301473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:01.304717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:01.305808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:01.306870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:01.626576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:01.645916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:01.647508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:01.661235 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-326d050d-7b76-43ce-89cd-4633ea2a3f75 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.398804 Sep 10 10:54:01.681864 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 573/3515] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:01 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:02.219195 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-edd01287-179a-4a47-b99c-64626b313e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 2.330669 Sep 10 10:54:02.219935 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2943/3516] 10.222.0.20 () {58 vars in 1167 bytes} [Sat Sep 10 10:53:59 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:54:02.266231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:02.276788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:02.294428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-386338047', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:02.345231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:02.350230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:02.353458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:02.354317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:02.359948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:02.360451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:02.713322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:02.714492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:02.733672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:02.735653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:02.736298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:02.737246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:02.737763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:02.738215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:02.841797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:02.843782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:02.872218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:02.889152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:02.924952 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-12167b8c-ff17-4b43-812a-8b696e4786ed tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.219042 Sep 10 10:54:02.930817 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2944/3517] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:02 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:03.009368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:03.028819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:03.033273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:03.033993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:03.471203 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1205e0e1-f961-4711-8a9c-b336ce7a148d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-386338047" status: 200 len: 1513 microversion: 2.1 time: 1.217217 Sep 10 10:54:03.481723 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 574/3518] 10.222.0.20 () {58 vars in 1261 bytes} [Sat Sep 10 10:54:02 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-386338047 => generated 1513 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:03.504198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:03.521373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:03.522955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:03.546727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:03.547207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:03.548369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:03.549299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:03.549948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:03.554963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:03.577191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f0cda3e6-ede4-4463-b8c7-73965e12c723 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:03.585921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f0cda3e6-ede4-4463-b8c7-73965e12c723 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:03.607279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0cda3e6-ede4-4463-b8c7-73965e12c723 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:03.613788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0cda3e6-ede4-4463-b8c7-73965e12c723 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:03.615645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0cda3e6-ede4-4463-b8c7-73965e12c723 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:03.629982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0cda3e6-ede4-4463-b8c7-73965e12c723 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:03.635931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0cda3e6-ede4-4463-b8c7-73965e12c723 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:03.637477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0cda3e6-ede4-4463-b8c7-73965e12c723 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:03.966514 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f0cda3e6-ede4-4463-b8c7-73965e12c723 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.393279 Sep 10 10:54:03.981377 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 575/3519] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:54:03 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:54:04.047505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:04.071470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:04.100591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:04.124099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:04.124545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:04.125321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:04.143674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:04.144472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:04.186570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:04.556025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:04.570003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:04.570975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:04.571632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:04.652773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:04.667137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:04.673673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:04.693589 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6c82bbad-5fd9-43df-bfbf-eafad27732ef tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.702465 Sep 10 10:54:04.695332 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 576/3520] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:03 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:04.705371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6d9705ab-28d5-4c40-a179-dd6b419ddd6f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:04.706321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6d9705ab-28d5-4c40-a179-dd6b419ddd6f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:04.716743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9705ab-28d5-4c40-a179-dd6b419ddd6f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:04.717625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9705ab-28d5-4c40-a179-dd6b419ddd6f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:04.718302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9705ab-28d5-4c40-a179-dd6b419ddd6f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:04.719265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9705ab-28d5-4c40-a179-dd6b419ddd6f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:04.719958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9705ab-28d5-4c40-a179-dd6b419ddd6f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:04.720601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9705ab-28d5-4c40-a179-dd6b419ddd6f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:05.601895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6d9705ab-28d5-4c40-a179-dd6b419ddd6f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:05.619575 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6d9705ab-28d5-4c40-a179-dd6b419ddd6f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1672 microversion: 2.1 time: 0.921753 Sep 10 10:54:05.625712 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 577/3521] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:04 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1672 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:05.660955 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f939122-f993-40b0-97ff-647de38863db tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 2.165853 Sep 10 10:54:05.662018 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2945/3522] 10.222.0.20 () {58 vars in 1173 bytes} [Sat Sep 10 10:54:03 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:05.702844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:05.718238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:05.719158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.compute.servers [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Removing options 'limit' from query {{(pid=128787) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 10:54:05.720251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:05.739680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:05.741541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:05.742185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:05.742562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:05.742813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:05.744731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:05.745923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:05.746732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:05.751197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:05.751696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:05.752144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:05.752844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:05.769730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:05.772835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:05.994744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:06.014192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:06.015748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:06.015748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:06.282600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:06.304784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:06.306565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:06.322294 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53ea8fe4-e3b3-4375-808a-79c395d6586d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.583946 Sep 10 10:54:06.323458 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2946/3523] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:05 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:06.658261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b5af7864-942f-4674-a1b4-fade08aa376c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:06.664902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b5af7864-942f-4674-a1b4-fade08aa376c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:06.780790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5af7864-942f-4674-a1b4-fade08aa376c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:06.793415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5af7864-942f-4674-a1b4-fade08aa376c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:06.794389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5af7864-942f-4674-a1b4-fade08aa376c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:06.796883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5af7864-942f-4674-a1b4-fade08aa376c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:06.807045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5af7864-942f-4674-a1b4-fade08aa376c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:06.823172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5af7864-942f-4674-a1b4-fade08aa376c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:07.023978 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2380e76a-c792-45f0-9f75-d08d6d790003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 1.324779 Sep 10 10:54:07.025469 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 578/3524] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 10:54:05 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:54:07.041111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-62637531-665b-4394-9241-6c04cf51400e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Action: 'create', calling method: .version_select at 0x7efcae935790>, body: {"keypair": {"name": "tempest-keypair-1027599784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4wuGh33tBSdlSkrLjEPgsRSr3AyR8OkGqSXbRO7fCniXOfArsjj2PkFi1ophtNPY7RzId5+nNYrT6IWFI5V/dFHHT5Sl4R8sKm/uQEedXqb3ESUIc/E/htGxk/i62sqA=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:07.077055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-62637531-665b-4394-9241-6c04cf51400e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Getting quotas for project 141bb28f6f6d46f5a25f1054965680d5. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:54:07.097264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-62637531-665b-4394-9241-6c04cf51400e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Getting quotas for user bbdeb113a53948238295920304efc98c and project 141bb28f6f6d46f5a25f1054965680d5. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:54:07.164377 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-62637531-665b-4394-9241-6c04cf51400e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.137315 Sep 10 10:54:07.165718 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 579/3525] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Sep 10 10:54:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 10:54:07.177761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:07.183784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:07.184646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:07.207426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:07.209685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:07.210383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:07.216473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:07.217382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:07.218844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:07.557367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:07.727115 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f3c2e7a8-bbe3-44bc-961a-909c046a615d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.559683 Sep 10 10:54:07.729458 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 580/3526] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 10:54:07 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:07.742825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:07.743697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:07.760577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:07.763139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:07.764188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:07.765666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:07.767097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:07.768398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:08.436367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:08.452498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:08.457627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:08.475107 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-77c0c851-3c99-41b2-be17-d6216de0e641 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.742959 Sep 10 10:54:08.493243 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 581/3527] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:07 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:08.516459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:08.539930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:08.540891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.compute.servers [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Removing options 'limit' from query {{(pid=128787) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 10:54:08.542306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:08.563923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:08.564848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:08.569554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:08.570598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:08.572290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:08.577698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:08.689547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:08.720288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b5af7864-942f-4674-a1b4-fade08aa376c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:08.739026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b5af7864-942f-4674-a1b4-fade08aa376c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1672 microversion: 2.1 time: 2.087234 Sep 10 10:54:08.740506 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2947/3528] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:06 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1672 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:08.792716 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d56c684f-b503-4bf6-96fb-830b3071ac78 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.282044 Sep 10 10:54:08.797691 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 582/3529] 10.222.0.20 () {58 vars in 1150 bytes} [Sat Sep 10 10:54:08 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:08.806686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:08.812341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:08.828414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:08.838545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:08.840756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:08.844579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:08.845261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:08.846417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:08.847238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:08.847892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:08.936187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:08.979935 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9babdc22-a18f-4d00-aae9-3eac4a35788d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.177356 Sep 10 10:54:08.987410 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2948/3530] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 10:54:08 2022] GET /compute/v2.1/servers => generated 1010 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:09.005809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:09.012293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:09.020916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:09.073485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:09.082272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:09.085682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:09.091145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:09.091623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:09.097167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:09.403959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:09.510231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:09.511193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:09.534516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:09.537684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:09.538554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:09.548282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:09.549059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:09.549706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:09.589691 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1e134434-ca22-458f-a588-7ff9bcb453a5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.589102 Sep 10 10:54:09.591184 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 583/3531] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:54:08 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:09.603907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:09.634551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:09.641922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.compute.servers [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Removing options 'limit' from query {{(pid=128787) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 10:54:09.646938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:09.720249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:09.722410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:09.724075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:09.726044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:09.730872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:09.731580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:09.814643 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3e587175-270b-45e3-ad2a-aa5038638a77 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.209909 Sep 10 10:54:09.821119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:09.821663 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 584/3532] 10.222.0.20 () {58 vars in 1140 bytes} [Sat Sep 10 10:54:09 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:09.834310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:09.843004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:09.857054 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73b7cbed-feb3-468b-a993-d18dc4056886 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.351130 Sep 10 10:54:09.857499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0a7affb5-9736-4381-be2e-49e2b1054497 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:09.858193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0a7affb5-9736-4381-be2e-49e2b1054497 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:09.861315 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2949/3533] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:09 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:09.870586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:09.887158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:09.888296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-386338047', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:09.898854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:09.899045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a7affb5-9736-4381-be2e-49e2b1054497 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:09.900123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:09.900701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a7affb5-9736-4381-be2e-49e2b1054497 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:09.901175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a7affb5-9736-4381-be2e-49e2b1054497 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:09.901730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:09.901869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a7affb5-9736-4381-be2e-49e2b1054497 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:09.902680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a7affb5-9736-4381-be2e-49e2b1054497 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:09.904878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a7affb5-9736-4381-be2e-49e2b1054497 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:09.906237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:09.909131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:09.914500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:10.161445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:10.266527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0a7affb5-9736-4381-be2e-49e2b1054497 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:10.277966 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0a7affb5-9736-4381-be2e-49e2b1054497 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1677 microversion: 2.1 time: 0.451661 Sep 10 10:54:10.290095 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 585/3534] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:09 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1677 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:10.311555 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a7727c3-53c2-4f59-9bcc-f26db030a267 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-386338047" status: 200 len: 345 microversion: 2.1 time: 0.448477 Sep 10 10:54:10.312425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2950/3535] 10.222.0.20 () {58 vars in 1240 bytes} [Sat Sep 10 10:54:09 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-386338047 => generated 345 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:10.326440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fce3dc57-755a-493a-be69-b3c7d1c7a397 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:10.341240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fce3dc57-755a-493a-be69-b3c7d1c7a397 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:10.353209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fce3dc57-755a-493a-be69-b3c7d1c7a397 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:10.355507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fce3dc57-755a-493a-be69-b3c7d1c7a397 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:10.432173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fce3dc57-755a-493a-be69-b3c7d1c7a397 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Going to try to stop instance {{(pid=128787) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 10:54:10.508176 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fce3dc57-755a-493a-be69-b3c7d1c7a397 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "POST /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854/action" status: 202 len: 0 microversion: 2.1 time: 0.185761 Sep 10 10:54:10.511928 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 586/3536] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:54:10 2022] POST /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:54:10.517758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d145f01-44c4-4d0a-a966-820bc202cd08 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:10.518528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d145f01-44c4-4d0a-a966-820bc202cd08 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:10.527971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d145f01-44c4-4d0a-a966-820bc202cd08 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:10.530446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d145f01-44c4-4d0a-a966-820bc202cd08 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:10.532760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d145f01-44c4-4d0a-a966-820bc202cd08 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:10.534097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d145f01-44c4-4d0a-a966-820bc202cd08 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:10.536738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d145f01-44c4-4d0a-a966-820bc202cd08 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:10.537454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d145f01-44c4-4d0a-a966-820bc202cd08 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:10.826635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d145f01-44c4-4d0a-a966-820bc202cd08 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:10.839385 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d145f01-44c4-4d0a-a966-820bc202cd08 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.325701 Sep 10 10:54:10.840971 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2951/3537] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:10 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:10.908296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:10.908996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:10.932671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:10.933229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:10.933858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:10.934818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:10.942508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:10.942967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:10.971388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:11.029947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1614353513", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "733864f4-5971-49ab-a698-e9a9851cce52"}, {"port": "2e99224d-0501-467d-80fb-e947a4f8ae28", "tag": "port-1"}, {"port": "f09e2e61-cd03-4c4b-9620-fc31f1da96b0", "tag": "port-2"}, {"uuid": "1dd8cfb8-810a-48d9-b3d2-5cd50f4d9fc1", "tag": "net-1"}, {"uuid": "1dd8cfb8-810a-48d9-b3d2-5cd50f4d9fc1"}, {"uuid": "bc509476-1185-4df0-9c87-c57a443589f5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "bc509476-1185-4df0-9c87-c57a443589f5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "da46e223-7922-40b5-9469-e5ee9273e32e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6a0c2cd8-fd05-4097-b65b-d76a3d2d3d9c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "51b7aea9-0e3d-4d12-945b-88da3578d436", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1672308274"}], "key_name": "tempest-keypair-1027599784", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:11.084698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:11.097135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:11.099142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:11.105547 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ec3fdfe8-4839-4f88-8da7-eba0d9d7248e tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.202780 Sep 10 10:54:11.106872 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 587/3538] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:10 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:11.321591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-90c5c2a4-2e1a-4c61-9f9e-f301ebf03b1e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:11.322649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-90c5c2a4-2e1a-4c61-9f9e-f301ebf03b1e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:11.337181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90c5c2a4-2e1a-4c61-9f9e-f301ebf03b1e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:11.341313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90c5c2a4-2e1a-4c61-9f9e-f301ebf03b1e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:11.341960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90c5c2a4-2e1a-4c61-9f9e-f301ebf03b1e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:11.342898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90c5c2a4-2e1a-4c61-9f9e-f301ebf03b1e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:11.343631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] validate_networks() for [('733864f4-5971-49ab-a698-e9a9851cce52', None, None, None, None, None), (None, None, '2e99224d-0501-467d-80fb-e947a4f8ae28', None, None, None), (None, None, 'f09e2e61-cd03-4c4b-9620-fc31f1da96b0', None, None, None), ('1dd8cfb8-810a-48d9-b3d2-5cd50f4d9fc1', None, None, None, None, None), ('1dd8cfb8-810a-48d9-b3d2-5cd50f4d9fc1', None, None, None, None, None), ('bc509476-1185-4df0-9c87-c57a443589f5', '10.2.2.100', None, None, None, None), ('bc509476-1185-4df0-9c87-c57a443589f5', '10.2.2.200', None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:54:11.348556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90c5c2a4-2e1a-4c61-9f9e-f301ebf03b1e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:11.352312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90c5c2a4-2e1a-4c61-9f9e-f301ebf03b1e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:11.865854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-90c5c2a4-2e1a-4c61-9f9e-f301ebf03b1e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:11.873992 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-90c5c2a4-2e1a-4c61-9f9e-f301ebf03b1e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1677 microversion: 2.1 time: 0.558782 Sep 10 10:54:11.879862 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 588/3539] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:11 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1677 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:11.895396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ff43b37a-d79e-431e-8bc7-e7febacc98e0 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:11.918029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ff43b37a-d79e-431e-8bc7-e7febacc98e0 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:11.956003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff43b37a-d79e-431e-8bc7-e7febacc98e0 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:11.959158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff43b37a-d79e-431e-8bc7-e7febacc98e0 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:11.959710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff43b37a-d79e-431e-8bc7-e7febacc98e0 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:11.961001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff43b37a-d79e-431e-8bc7-e7febacc98e0 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:11.962973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff43b37a-d79e-431e-8bc7-e7febacc98e0 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:11.965048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff43b37a-d79e-431e-8bc7-e7febacc98e0 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:12.388528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ff43b37a-d79e-431e-8bc7-e7febacc98e0 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:12.409905 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ff43b37a-d79e-431e-8bc7-e7febacc98e0 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.528757 Sep 10 10:54:12.419981 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 589/3540] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:11 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:12.427755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:12.439420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:12.456942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:12.463617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:12.465050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:12.466052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:12.466735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:12.467389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:12.637026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:12.671015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:12.676330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:12.686783 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-840c4705-b71d-4c8b-bb21-f68e35b97174 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.265264 Sep 10 10:54:12.701114 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 590/3541] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:12 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:12.903753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-572370e5-7f2a-4e31-9b37-3b92634394d8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:12.905259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-572370e5-7f2a-4e31-9b37-3b92634394d8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:12.914899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-572370e5-7f2a-4e31-9b37-3b92634394d8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:12.917694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-572370e5-7f2a-4e31-9b37-3b92634394d8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:12.918347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-572370e5-7f2a-4e31-9b37-3b92634394d8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:12.919685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-572370e5-7f2a-4e31-9b37-3b92634394d8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:12.921406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-572370e5-7f2a-4e31-9b37-3b92634394d8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:12.922087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-572370e5-7f2a-4e31-9b37-3b92634394d8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:13.255967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-572370e5-7f2a-4e31-9b37-3b92634394d8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:13.269798 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-572370e5-7f2a-4e31-9b37-3b92634394d8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1677 microversion: 2.1 time: 0.365517 Sep 10 10:54:13.270066 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 591/3542] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:12 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1677 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:13.449490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9e28d9aa-6a8c-4ba6-90e5-631379f80999 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:13.450396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9e28d9aa-6a8c-4ba6-90e5-631379f80999 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:13.459181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e28d9aa-6a8c-4ba6-90e5-631379f80999 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:13.459940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e28d9aa-6a8c-4ba6-90e5-631379f80999 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:13.460539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e28d9aa-6a8c-4ba6-90e5-631379f80999 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:13.463675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e28d9aa-6a8c-4ba6-90e5-631379f80999 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:13.464416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e28d9aa-6a8c-4ba6-90e5-631379f80999 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:13.465040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e28d9aa-6a8c-4ba6-90e5-631379f80999 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:14.122502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9e28d9aa-6a8c-4ba6-90e5-631379f80999 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:14.138366 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9e28d9aa-6a8c-4ba6-90e5-631379f80999 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.693782 Sep 10 10:54:14.141788 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 592/3543] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:13 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:54:14.151585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:14.160329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:14.176005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:14.178550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:14.179189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:14.182808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:14.183038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:14.183793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:14.378622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:14.387550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:14.388989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:14.425786 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7222ffc6-9051-4b56-aa8b-fdc0827286cc tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.277395 Sep 10 10:54:14.428183 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 593/3544] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:14 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:14.443961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d5a31173-bb83-48b4-9077-70495a10bf3b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:14.447636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d5a31173-bb83-48b4-9077-70495a10bf3b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:14.465906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5a31173-bb83-48b4-9077-70495a10bf3b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:14.466666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5a31173-bb83-48b4-9077-70495a10bf3b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:14.467341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5a31173-bb83-48b4-9077-70495a10bf3b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:14.468405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5a31173-bb83-48b4-9077-70495a10bf3b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:14.469832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5a31173-bb83-48b4-9077-70495a10bf3b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:14.470637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5a31173-bb83-48b4-9077-70495a10bf3b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:14.554274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:15.489178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d5a31173-bb83-48b4-9077-70495a10bf3b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:15.507004 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d5a31173-bb83-48b4-9077-70495a10bf3b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1677 microversion: 2.1 time: 1.074984 Sep 10 10:54:15.525133 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 594/3545] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:14 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1677 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:15.534046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-736103e8-3c2e-4463-be6b-2fe24732426d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:15.534926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-736103e8-3c2e-4463-be6b-2fe24732426d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:15.542971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-736103e8-3c2e-4463-be6b-2fe24732426d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:15.543737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-736103e8-3c2e-4463-be6b-2fe24732426d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:15.544400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-736103e8-3c2e-4463-be6b-2fe24732426d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:15.545352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-736103e8-3c2e-4463-be6b-2fe24732426d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:15.546023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-736103e8-3c2e-4463-be6b-2fe24732426d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:15.546672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-736103e8-3c2e-4463-be6b-2fe24732426d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:15.966894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-736103e8-3c2e-4463-be6b-2fe24732426d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:15.977447 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-736103e8-3c2e-4463-be6b-2fe24732426d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.450747 Sep 10 10:54:15.978041 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 595/3546] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:15 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:15.988375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:15.992144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:16.010215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:16.015364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:16.017119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:16.018413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:16.019664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:16.020755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:16.220063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:16.230099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:16.238907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:16.246773 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-75c74865-08ff-421b-9a74-06739f303e84 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.267567 Sep 10 10:54:16.247987 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 596/3547] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:15 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:16.263312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:54:16.263860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:54:16.264423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:54:16.277679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:54:16.278236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:54:16.300732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:16.301272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:16.301757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:16.302696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:16.303304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:16.303931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:16.346908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Getting quotas for project 141bb28f6f6d46f5a25f1054965680d5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:54:16.354077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Getting quotas for user bbdeb113a53948238295920304efc98c and project 141bb28f6f6d46f5a25f1054965680d5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:54:16.534700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8e5acbee-ea95-45f0-9292-76013e624937 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:16.535471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8e5acbee-ea95-45f0-9292-76013e624937 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:16.543996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:54:16.554477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='da46e223-7922-40b5-9469-e5ee9273e32e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6a0c2cd8-fd05-4097-b65b-d76a3d2d3d9c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51b7aea9-0e3d-4d12-945b-88da3578d436',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:54:16.555330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e5acbee-ea95-45f0-9292-76013e624937 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:16.556987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e5acbee-ea95-45f0-9292-76013e624937 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:16.557470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e5acbee-ea95-45f0-9292-76013e624937 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:16.560490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e5acbee-ea95-45f0-9292-76013e624937 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:16.561129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e5acbee-ea95-45f0-9292-76013e624937 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:16.562686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e5acbee-ea95-45f0-9292-76013e624937 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:16.779628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8e5acbee-ea95-45f0-9292-76013e624937 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:16.793096 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8e5acbee-ea95-45f0-9292-76013e624937 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.264375 Sep 10 10:54:16.793946 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 597/3548] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:16 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:54:17.004532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b793364b-2e6f-40fa-a2a2-c61ae5e918f2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:17.005367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b793364b-2e6f-40fa-a2a2-c61ae5e918f2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:17.018346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b793364b-2e6f-40fa-a2a2-c61ae5e918f2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:17.018843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b793364b-2e6f-40fa-a2a2-c61ae5e918f2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:17.019278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b793364b-2e6f-40fa-a2a2-c61ae5e918f2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:17.019987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b793364b-2e6f-40fa-a2a2-c61ae5e918f2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:17.020441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b793364b-2e6f-40fa-a2a2-c61ae5e918f2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:17.020864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b793364b-2e6f-40fa-a2a2-c61ae5e918f2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:17.118396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:17.291161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b793364b-2e6f-40fa-a2a2-c61ae5e918f2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:17.303209 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b793364b-2e6f-40fa-a2a2-c61ae5e918f2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.303222 Sep 10 10:54:17.305853 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 598/3549] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:16 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:54:17.321601 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-54f5130b-cfb3-49a9-9f62-ad8299c1ec73 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.295419 Sep 10 10:54:17.338910 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2952/3550] 10.222.0.20 () {62 vars in 1189 bytes} [Sat Sep 10 10:54:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 6314 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 10:54:17.348864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:17.349559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:17.355831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-241a0690-f32a-428f-be4e-2bf8653b1fd6 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:17.356688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-241a0690-f32a-428f-be4e-2bf8653b1fd6 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:17.366315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:17.366815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:17.367249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:17.369541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:17.373666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:17.374300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:17.510122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-241a0690-f32a-428f-be4e-2bf8653b1fd6 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:17.525983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-241a0690-f32a-428f-be4e-2bf8653b1fd6 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:17.535252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-241a0690-f32a-428f-be4e-2bf8653b1fd6 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:17.537333 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-241a0690-f32a-428f-be4e-2bf8653b1fd6 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1286 microversion: 2.32 time: 0.196358 Sep 10 10:54:17.538427 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2953/3551] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:17 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:17.592064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:17.605681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:17.611533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:17.628767 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1b8510cd-0a60-41c2-8c4c-bc06b4a01a4f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.309802 Sep 10 10:54:17.636577 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 599/3552] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:17 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:18.329845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-40e12d98-2b44-4102-90e9-06e4ca73111f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:18.334999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-40e12d98-2b44-4102-90e9-06e4ca73111f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:18.343672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40e12d98-2b44-4102-90e9-06e4ca73111f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:18.344901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40e12d98-2b44-4102-90e9-06e4ca73111f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:18.345587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40e12d98-2b44-4102-90e9-06e4ca73111f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:18.346488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40e12d98-2b44-4102-90e9-06e4ca73111f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:18.347137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40e12d98-2b44-4102-90e9-06e4ca73111f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:18.347771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40e12d98-2b44-4102-90e9-06e4ca73111f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:18.575896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b0c07c1e-e205-4b3a-b30a-02dcd3113591 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:18.579064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b0c07c1e-e205-4b3a-b30a-02dcd3113591 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:18.588944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:18.658659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-40e12d98-2b44-4102-90e9-06e4ca73111f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:18.689157 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-40e12d98-2b44-4102-90e9-06e4ca73111f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.363789 Sep 10 10:54:18.711795 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2954/3553] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:18 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:18.718885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:18.719934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:18.728270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:18.729228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:18.729945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:18.731067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:18.731688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:18.732540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:18.759205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b0c07c1e-e205-4b3a-b30a-02dcd3113591 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:18.782454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b0c07c1e-e205-4b3a-b30a-02dcd3113591 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:18.786672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b0c07c1e-e205-4b3a-b30a-02dcd3113591 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:18.789023 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b0c07c1e-e205-4b3a-b30a-02dcd3113591 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1286 microversion: 2.32 time: 0.225410 Sep 10 10:54:18.790182 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 600/3554] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:18 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1286 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:19.072044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:19.087117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:19.088903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:19.102881 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-824915fc-5657-4090-a3be-40aa6dcdfdf1 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.388700 Sep 10 10:54:19.122935 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2955/3555] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:18 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:19.717833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-997afc29-eb57-416c-8cf2-86bbd460421b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:19.718760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-997afc29-eb57-416c-8cf2-86bbd460421b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:19.737211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-997afc29-eb57-416c-8cf2-86bbd460421b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:19.737733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-997afc29-eb57-416c-8cf2-86bbd460421b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:19.738700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-997afc29-eb57-416c-8cf2-86bbd460421b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:19.740197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-997afc29-eb57-416c-8cf2-86bbd460421b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:19.740818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-997afc29-eb57-416c-8cf2-86bbd460421b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:19.741453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-997afc29-eb57-416c-8cf2-86bbd460421b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:19.752127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=12 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:19.823348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:19.827554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:19.838644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:19.840367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:19.840896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:19.841731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:19.842314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:19.843798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:20.051428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:20.058464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:20.068271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:20.071102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:20.074565 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6daea574-58e0-473f-b743-08106bd9dcac tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1576 microversion: 2.32 time: 0.259254 Sep 10 10:54:20.088959 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2956/3556] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:19 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:20.122627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-997afc29-eb57-416c-8cf2-86bbd460421b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:20.140025 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-997afc29-eb57-416c-8cf2-86bbd460421b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.426085 Sep 10 10:54:20.144144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:20.145454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:20.152460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:20.153164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:20.154624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:20.155719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:20.157015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:20.157725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:20.160897 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 601/3557] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:19 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:20.264974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:20.284644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:20.289401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:20.309586 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2cef8ff4-016f-48a5-8206-fa2e2bda8b1b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.173696 Sep 10 10:54:20.329174 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2957/3558] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:20 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:21.112094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:21.112827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:21.132537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:21.133237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:21.133481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:21.138097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:21.138777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:21.141434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:21.169966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b20b435-69bb-4483-9a83-20036e33dd69 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:21.170592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1b20b435-69bb-4483-9a83-20036e33dd69 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:21.183817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b20b435-69bb-4483-9a83-20036e33dd69 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:21.184337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b20b435-69bb-4483-9a83-20036e33dd69 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:21.184781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b20b435-69bb-4483-9a83-20036e33dd69 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:21.185520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b20b435-69bb-4483-9a83-20036e33dd69 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:21.185979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b20b435-69bb-4483-9a83-20036e33dd69 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:21.186408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b20b435-69bb-4483-9a83-20036e33dd69 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:21.489503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:21.506005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:21.507782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:21.509106 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-97964383-60db-416f-ae39-5722c1dbaf9e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1594 microversion: 2.32 time: 0.402822 Sep 10 10:54:21.510844 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 602/3559] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:21 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1594 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:21.535512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:21.536120 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:21.543473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:21.544680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:21.545318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:21.546502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:21.561483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:21.562232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:21.739895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:21.748325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:21.749832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:21.765870 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-55d4a497-e1bb-4bed-886c-01d249bbd5a6 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1555 microversion: 2.91 time: 0.235384 Sep 10 10:54:21.767453 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 603/3560] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:21 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:21.874648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1b20b435-69bb-4483-9a83-20036e33dd69 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:21.889312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b20b435-69bb-4483-9a83-20036e33dd69 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.723049 Sep 10 10:54:21.890679 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2958/3561] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:21 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:54:22.538671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:22.540740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:22.551402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:22.552201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:22.553415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:22.554942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:22.555967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:22.556613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:22.778211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:22.789870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:22.806449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:22.808952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:22.809446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:22.818551 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-05ab22ec-be58-457a-9727-222a3755a26c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1662 microversion: 2.32 time: 0.285874 Sep 10 10:54:22.823609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:22.824607 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 604/3562] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:22 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1662 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:22.825356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:22.826600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:22.829553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:22.830299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:22.832467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:22.917459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-be7b8313-09e8-4488-aa4a-a3f213280d12 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:22.918356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-be7b8313-09e8-4488-aa4a-a3f213280d12 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:22.942967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be7b8313-09e8-4488-aa4a-a3f213280d12 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:22.943491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be7b8313-09e8-4488-aa4a-a3f213280d12 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:22.943934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be7b8313-09e8-4488-aa4a-a3f213280d12 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:22.956710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be7b8313-09e8-4488-aa4a-a3f213280d12 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:22.956710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be7b8313-09e8-4488-aa4a-a3f213280d12 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:22.956710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be7b8313-09e8-4488-aa4a-a3f213280d12 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:22.959736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:23.003812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:23.018499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:23.020462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:23.037406 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d163ab5-7a6d-4288-90c3-24af110a359a tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1537 microversion: 2.91 time: 0.241258 Sep 10 10:54:23.038021 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2959/3563] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:22 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:23.190518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-be7b8313-09e8-4488-aa4a-a3f213280d12 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:23.202976 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-be7b8313-09e8-4488-aa4a-a3f213280d12 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.289190 Sep 10 10:54:23.217107 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 605/3564] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:22 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:54:23.852312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:23.853736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:23.862234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:23.862944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:23.863989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:23.864906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:23.865611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:23.866263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:24.075627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:24.076240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:24.092760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:24.093293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:24.094608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:24.095362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:24.095819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:24.097831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:24.341604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:24.355244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:24.358887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:24.403512 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a250cc75-9f9c-4565-8abe-695fd2b21af4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1540 microversion: 2.91 time: 0.331697 Sep 10 10:54:24.414594 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 606/3565] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:24 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1540 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:24.422456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-affb2403-b118-4219-8025-085e93a4a6aa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:24.434229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-affb2403-b118-4219-8025-085e93a4a6aa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:24.455679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:24.472891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-affb2403-b118-4219-8025-085e93a4a6aa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:24.473797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-affb2403-b118-4219-8025-085e93a4a6aa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:24.474501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-affb2403-b118-4219-8025-085e93a4a6aa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:24.475437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-affb2403-b118-4219-8025-085e93a4a6aa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:24.476441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-affb2403-b118-4219-8025-085e93a4a6aa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:24.477307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-affb2403-b118-4219-8025-085e93a4a6aa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:24.489861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:24.494463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:24.497032 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8852085c-af68-4750-b1a2-fcc0e2d0d511 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1662 microversion: 2.32 time: 0.649048 Sep 10 10:54:24.513046 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2960/3566] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:23 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1662 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:24.545235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7e1395b9-d94e-482d-960d-5c4fa6f99a65 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-856894-1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:24.548682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e1395b9-d94e-482d-960d-5c4fa6f99a65 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:24.555937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1395b9-d94e-482d-960d-5c4fa6f99a65 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:24.556858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1395b9-d94e-482d-960d-5c4fa6f99a65 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:24.557560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1395b9-d94e-482d-960d-5c4fa6f99a65 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:24.558612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1395b9-d94e-482d-960d-5c4fa6f99a65 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:24.559570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1395b9-d94e-482d-960d-5c4fa6f99a65 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:24.560230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e1395b9-d94e-482d-960d-5c4fa6f99a65 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:24.610234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e1395b9-d94e-482d-960d-5c4fa6f99a65 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-856894-1". {{(pid=128788) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 10:54:24.849962 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7e1395b9-d94e-482d-960d-5c4fa6f99a65 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5/action" status: 202 len: 0 microversion: 2.91 time: 0.324656 Sep 10 10:54:24.854507 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2961/3567] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:54:24 2022] POST /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:54:24.893194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:24.893833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:24.916372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:24.916887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:24.918468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:24.921875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:24.923985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:24.924748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:25.194358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:25.211151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:25.212869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:25.236835 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f5ea4e39-74ac-4889-b442-16be9af05e0f tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1488 microversion: 2.91 time: 0.377106 Sep 10 10:54:25.237472 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2962/3568] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:24 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1488 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:25.547526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:25.548496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:25.561151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:25.568617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:25.569498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:25.571066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:25.571750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:25.572439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:25.581540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-affb2403-b118-4219-8025-085e93a4a6aa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:25.591264 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-affb2403-b118-4219-8025-085e93a4a6aa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 1.174853 Sep 10 10:54:25.599292 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 607/3569] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:24 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:25.980355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:26.003796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:26.009416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:26.013725 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c52dd197-3d6b-4621-a3c6-27484150dffe tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1709 microversion: 2.32 time: 0.483976 Sep 10 10:54:26.038223 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2963/3570] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:25 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1709 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:26.270790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:26.272553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:26.285352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:26.290832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:26.291486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:26.307480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:26.310119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:26.313505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:26.457776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=10 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:26.567827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] Calling method '.version_select at 0x7efcaebc4e50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:26.570060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:26.570666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:26.571737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:26.605383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:26.613254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:26.613974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:26.639526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:26.640577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:26.641308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:26.650375 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c018d506-0da7-4a32-ba51-b1a1a206693a tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2041207527-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.197949 Sep 10 10:54:26.658869 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2964/3571] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:54:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:26.670468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6de17169-e8ab-4bdb-8006-a7ee28d23455 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:26.676763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6de17169-e8ab-4bdb-8006-a7ee28d23455 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:26.690041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6de17169-e8ab-4bdb-8006-a7ee28d23455 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:26.692815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6de17169-e8ab-4bdb-8006-a7ee28d23455 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:26.693779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6de17169-e8ab-4bdb-8006-a7ee28d23455 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:26.695255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6de17169-e8ab-4bdb-8006-a7ee28d23455 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:26.696015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6de17169-e8ab-4bdb-8006-a7ee28d23455 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:26.696675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6de17169-e8ab-4bdb-8006-a7ee28d23455 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:27.413096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:27.427729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:27.436175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:27.470254 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3a056b14-e57c-4353-bc8d-6b23725f5356 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1488 microversion: 2.91 time: 1.204349 Sep 10 10:54:27.471435 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 608/3572] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:26 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1488 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:27.478454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:27.486116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6de17169-e8ab-4bdb-8006-a7ee28d23455 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:27.503276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:27.503765 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6de17169-e8ab-4bdb-8006-a7ee28d23455 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.841357 Sep 10 10:54:27.517770 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2965/3573] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:26 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:27.552999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:27.553726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:27.559116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:27.559962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:27.560538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:27.561266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:28.403651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:28.454773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:28.461542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:28.464966 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8cc6391b-81e6-4657-8199-5bfd828b6907 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1756 microversion: 2.32 time: 0.992342 Sep 10 10:54:28.469387 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 609/3574] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:27 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1756 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:28.507279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:28.508173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:28.511015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:28.538134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7df60733-02c7-47e6-b985-3e6663730e3d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:28.538958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7df60733-02c7-47e6-b985-3e6663730e3d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:28.546312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7df60733-02c7-47e6-b985-3e6663730e3d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:28.547376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7df60733-02c7-47e6-b985-3e6663730e3d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:28.548592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:28.552765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:28.553569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:28.554589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:28.555298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7df60733-02c7-47e6-b985-3e6663730e3d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:28.555934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:28.556833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7df60733-02c7-47e6-b985-3e6663730e3d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:28.557471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:28.564050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7df60733-02c7-47e6-b985-3e6663730e3d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:28.567861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7df60733-02c7-47e6-b985-3e6663730e3d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:28.711234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:28.736512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:28.738672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:28.749117 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80d0f274-f042-49bc-939a-fabb0f07df20 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.245242 Sep 10 10:54:28.751302 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2966/3575] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:28 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:28.775667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:29.128896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7df60733-02c7-47e6-b985-3e6663730e3d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:29.141737 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7df60733-02c7-47e6-b985-3e6663730e3d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.604641 Sep 10 10:54:29.142970 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 610/3576] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:28 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:54:29.501909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:29.502943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:29.512666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:29.513312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:29.518022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:29.518955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:29.519549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:29.521483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:29.785325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:29.786122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:29.800766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:29.801647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:29.806619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:29.807409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:29.807895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:29.808328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:30.058766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:30.085375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:30.100969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:30.112313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:30.114491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:30.115935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:30.118228 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-001443df-02f0-4ddf-ab8e-4fde183d7192 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1756 microversion: 2.32 time: 0.626693 Sep 10 10:54:30.142176 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2967/3577] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:29 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1756 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:30.156725 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-59bfdc8e-93ad-4dee-a591-7645e7efad66 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.376779 Sep 10 10:54:30.157610 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 611/3578] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:29 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:30.173411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1cbe5f3-9702-4ccc-ba8d-df9a3208b003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:30.174304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1cbe5f3-9702-4ccc-ba8d-df9a3208b003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:30.186473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1cbe5f3-9702-4ccc-ba8d-df9a3208b003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:30.187266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1cbe5f3-9702-4ccc-ba8d-df9a3208b003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:30.187865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1cbe5f3-9702-4ccc-ba8d-df9a3208b003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:30.188933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1cbe5f3-9702-4ccc-ba8d-df9a3208b003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:30.189565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1cbe5f3-9702-4ccc-ba8d-df9a3208b003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:30.195707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1cbe5f3-9702-4ccc-ba8d-df9a3208b003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:30.816189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1cbe5f3-9702-4ccc-ba8d-df9a3208b003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:30.830607 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1cbe5f3-9702-4ccc-ba8d-df9a3208b003 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1520 microversion: 2.1 time: 0.657111 Sep 10 10:54:30.833714 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2968/3579] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:30 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1520 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:31.150432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:31.151867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:31.169903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:31.177891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:31.178630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:31.179642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:31.180267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:31.180871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:31.192665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:31.193577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:31.204790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:31.234417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:31.235166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:31.236076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:31.236697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:31.237330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:31.696670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:31.717345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:31.719371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:31.751268 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9009272-b760-46ea-957e-f9c165fbb344 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.562643 Sep 10 10:54:31.753229 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2969/3580] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:31 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:31.857848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc0cad8f-a504-4a8e-9fac-e6b80e9c2334 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:31.860827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cc0cad8f-a504-4a8e-9fac-e6b80e9c2334 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:31.861175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:31.878521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc0cad8f-a504-4a8e-9fac-e6b80e9c2334 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:31.882633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc0cad8f-a504-4a8e-9fac-e6b80e9c2334 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:31.883484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc0cad8f-a504-4a8e-9fac-e6b80e9c2334 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:31.884406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc0cad8f-a504-4a8e-9fac-e6b80e9c2334 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:31.884733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:31.885044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc0cad8f-a504-4a8e-9fac-e6b80e9c2334 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:31.898846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:31.900787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc0cad8f-a504-4a8e-9fac-e6b80e9c2334 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:31.904932 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6bb7ac57-724c-429f-8023-4f482bda6e1d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1803 microversion: 2.32 time: 0.758658 Sep 10 10:54:31.957921 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 612/3581] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:31 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1803 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:32.390685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cc0cad8f-a504-4a8e-9fac-e6b80e9c2334 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:32.401320 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cc0cad8f-a504-4a8e-9fac-e6b80e9c2334 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1497 microversion: 2.1 time: 0.547970 Sep 10 10:54:32.423528 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2970/3582] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:31 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1497 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:32.442499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:32.457408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:32.458322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:32.502776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:32.506224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:32.508858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:32.514264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:32.523400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:32.524122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:32.602086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:32.637930 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dc901dbe-7e6d-4ae6-a0fb-81f9192a972a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.200598 Sep 10 10:54:32.651380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4849bc74-f4e5-4ed3-bb42-91c9c457d530 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:32.657994 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 613/3583] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Sep 10 10:54:32 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:32.664472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4849bc74-f4e5-4ed3-bb42-91c9c457d530 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:32.665425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4849bc74-f4e5-4ed3-bb42-91c9c457d530 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:32.666149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4849bc74-f4e5-4ed3-bb42-91c9c457d530 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:32.704840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4849bc74-f4e5-4ed3-bb42-91c9c457d530 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Going to try to start instance {{(pid=128788) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 10:54:32.758728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:32.784396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:32.785621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:32.800893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:32.800893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:32.800893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:32.803391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:32.804549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:32.805295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:32.811477 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4849bc74-f4e5-4ed3-bb42-91c9c457d530 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "POST /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854/action" status: 202 len: 0 microversion: 2.1 time: 0.164174 Sep 10 10:54:32.824582 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2971/3584] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:54:32 2022] POST /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:54:32.835107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a3b99c38-51ec-4b35-85e6-88f82f6bd5fc tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:32.848650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a3b99c38-51ec-4b35-85e6-88f82f6bd5fc tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:32.881707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3b99c38-51ec-4b35-85e6-88f82f6bd5fc tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:32.882371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3b99c38-51ec-4b35-85e6-88f82f6bd5fc tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:32.885201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3b99c38-51ec-4b35-85e6-88f82f6bd5fc tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:32.886000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3b99c38-51ec-4b35-85e6-88f82f6bd5fc tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:32.891351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3b99c38-51ec-4b35-85e6-88f82f6bd5fc tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:32.892276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3b99c38-51ec-4b35-85e6-88f82f6bd5fc tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:33.533438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:33.566468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:33.568340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:33.611649 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-996bfdb1-f5a0-4fd9-9921-138d99193d51 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.832963 Sep 10 10:54:33.615691 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 614/3585] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:32 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:33.641745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:33.644440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:33.678160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:33.679012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:33.679642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:33.680583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:33.695667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:33.696600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:35.051044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3b99c38-51ec-4b35-85e6-88f82f6bd5fc tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:35.066825 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a3b99c38-51ec-4b35-85e6-88f82f6bd5fc tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1506 microversion: 2.1 time: 2.236605 Sep 10 10:54:35.067755 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2972/3586] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:32 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1506 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:35.118929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:35.124392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:35.162050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:35.162050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:35.162050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:35.162050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:35.162050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:35.162050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:35.334705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:35.354643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:35.360869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:35.363812 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b1848a0a-47b6-4709-a343-44ee0a49541b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1850 microversion: 2.32 time: 1.745752 Sep 10 10:54:35.366272 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 615/3587] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:33 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1850 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:35.412545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:35.429618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:35.432800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:35.446525 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd2afaa5-99b4-41d9-8fdd-c7f41ffa7b87 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.361482 Sep 10 10:54:35.448688 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2973/3588] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:35 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:36.095584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9fdc3a61-6683-4abc-86d1-f4affa9e71c2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:36.096335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9fdc3a61-6683-4abc-86d1-f4affa9e71c2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:36.107259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fdc3a61-6683-4abc-86d1-f4affa9e71c2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:36.107781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fdc3a61-6683-4abc-86d1-f4affa9e71c2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:36.108229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fdc3a61-6683-4abc-86d1-f4affa9e71c2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:36.109532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fdc3a61-6683-4abc-86d1-f4affa9e71c2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:36.109995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fdc3a61-6683-4abc-86d1-f4affa9e71c2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:36.110424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fdc3a61-6683-4abc-86d1-f4affa9e71c2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:36.282599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-fecd4b9b-237c-4970-b86c-a68ba08e149f req-0c926dad-c79b-4e39-8512-82d8dbd77d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "tag": "db6226c6-d5ed-4db3-92af-4e1534088960"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:36.306561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fecd4b9b-237c-4970-b86c-a68ba08e149f req-0c926dad-c79b-4e39-8512-82d8dbd77d00 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:36.308432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fecd4b9b-237c-4970-b86c-a68ba08e149f req-0c926dad-c79b-4e39-8512-82d8dbd77d00 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:36.310327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fecd4b9b-237c-4970-b86c-a68ba08e149f req-0c926dad-c79b-4e39-8512-82d8dbd77d00 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:36.347889 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-fecd4b9b-237c-4970-b86c-a68ba08e149f req-0c926dad-c79b-4e39-8512-82d8dbd77d00 service nova] Creating event network-changed:db6226c6-d5ed-4db3-92af-4e1534088960 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:54:36.362433 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-fecd4b9b-237c-4970-b86c-a68ba08e149f req-0c926dad-c79b-4e39-8512-82d8dbd77d00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.340505 Sep 10 10:54:36.365993 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 616/3589] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:36.404748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:36.407576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:36.438423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:36.440074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:36.443704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:36.448375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:36.450681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:36.453150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:38.020854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9fdc3a61-6683-4abc-86d1-f4affa9e71c2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:38.031515 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9fdc3a61-6683-4abc-86d1-f4affa9e71c2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1506 microversion: 2.1 time: 1.939622 Sep 10 10:54:38.039503 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2974/3590] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:36 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1506 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:38.051066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:38.054516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:38.070825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:38.071331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:38.071779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:38.072503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:38.072967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:38.076453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:38.739240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:38.766800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:38.769245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:38.770637 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-af9755f5-0945-431a-80b8-b7b3379c78be tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1850 microversion: 2.32 time: 2.382023 Sep 10 10:54:38.771815 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 617/3591] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:36 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1850 bytes in 2384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:38.855264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:38.882200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:38.883798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:38.905135 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9695df13-5a9a-4580-bcb0-8f76d466f3ac tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.864003 Sep 10 10:54:38.922128 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2975/3592] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:38 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:39.060507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-506c4978-9e25-4657-8a46-ded0cd37b12f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:39.062248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-506c4978-9e25-4657-8a46-ded0cd37b12f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:39.076469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506c4978-9e25-4657-8a46-ded0cd37b12f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:39.084180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506c4978-9e25-4657-8a46-ded0cd37b12f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:39.085022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506c4978-9e25-4657-8a46-ded0cd37b12f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:39.086045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506c4978-9e25-4657-8a46-ded0cd37b12f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:39.086671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506c4978-9e25-4657-8a46-ded0cd37b12f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:39.087251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506c4978-9e25-4657-8a46-ded0cd37b12f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:39.527066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-506c4978-9e25-4657-8a46-ded0cd37b12f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:39.537633 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-506c4978-9e25-4657-8a46-ded0cd37b12f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1510 microversion: 2.1 time: 0.481361 Sep 10 10:54:39.566896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:39.572115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:39.572565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.servers [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Removing options 'limit' from query {{(pid=128788) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 10:54:39.573357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:39.579682 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 618/3593] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:39 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:39.581351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:39.582044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:39.582692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:39.583658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:39.584938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:39.585945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:39.589006 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3e2a1332-1536-4602-bd7e-898bbf3241d2 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.025768 Sep 10 10:54:39.603400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a8ff654e-f80f-4225-af27-68f5b83ccd6d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:39.604411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a8ff654e-f80f-4225-af27-68f5b83ccd6d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:39.609961 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2976/3594] 10.222.0.20 () {58 vars in 1140 bytes} [Sat Sep 10 10:54:39 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:54:39.612526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8ff654e-f80f-4225-af27-68f5b83ccd6d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:39.613308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8ff654e-f80f-4225-af27-68f5b83ccd6d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:39.613975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8ff654e-f80f-4225-af27-68f5b83ccd6d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:39.614946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8ff654e-f80f-4225-af27-68f5b83ccd6d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:39.615625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8ff654e-f80f-4225-af27-68f5b83ccd6d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:39.616278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8ff654e-f80f-4225-af27-68f5b83ccd6d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:39.799371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:39.800717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:39.814518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:39.820580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:39.826482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:39.828429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:39.830714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:39.832223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:39.834168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:40.578736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:40.601851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:40.603784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:40.606614 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-017038fe-3cb2-47ff-9bd5-89d0a55bc324 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1871 microversion: 2.32 time: 0.811257 Sep 10 10:54:40.608182 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2977/3595] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:39 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1871 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:40.616452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-13600f65-8b5e-4a43-8dc2-5048de61dec9 req-5cd6065f-20ab-4acb-bd35-a72ab67b66b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "tag": "2e99224d-0501-467d-80fb-e947a4f8ae28"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:40.658050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-13600f65-8b5e-4a43-8dc2-5048de61dec9 req-5cd6065f-20ab-4acb-bd35-a72ab67b66b8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:40.660712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-13600f65-8b5e-4a43-8dc2-5048de61dec9 req-5cd6065f-20ab-4acb-bd35-a72ab67b66b8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:40.661312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-13600f65-8b5e-4a43-8dc2-5048de61dec9 req-5cd6065f-20ab-4acb-bd35-a72ab67b66b8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:40.665635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a8ff654e-f80f-4225-af27-68f5b83ccd6d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:40.683664 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a8ff654e-f80f-4225-af27-68f5b83ccd6d tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1510 microversion: 2.1 time: 1.080225 Sep 10 10:54:40.686164 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 619/3596] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:39 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1510 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:40.687041 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-13600f65-8b5e-4a43-8dc2-5048de61dec9 req-5cd6065f-20ab-4acb-bd35-a72ab67b66b8 service nova] Creating event network-changed:2e99224d-0501-467d-80fb-e947a4f8ae28 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:54:40.699197 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-13600f65-8b5e-4a43-8dc2-5048de61dec9 req-5cd6065f-20ab-4acb-bd35-a72ab67b66b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087891 Sep 10 10:54:40.700017 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2978/3597] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:40.703392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:40.706170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:40.715621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-082692ff-b48b-42c0-ae44-10d0708596c6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:40.721141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-082692ff-b48b-42c0-ae44-10d0708596c6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:40.741492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082692ff-b48b-42c0-ae44-10d0708596c6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:40.742478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082692ff-b48b-42c0-ae44-10d0708596c6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:40.743175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082692ff-b48b-42c0-ae44-10d0708596c6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:40.744341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082692ff-b48b-42c0-ae44-10d0708596c6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:40.745317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082692ff-b48b-42c0-ae44-10d0708596c6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:40.747151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-082692ff-b48b-42c0-ae44-10d0708596c6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:40.756660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:40.758729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:40.761577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:40.768379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:40.769314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:40.770021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:41.060073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:41.078566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:41.083888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:41.110747 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-08930cd6-88df-4621-9ac4-66b5a8c0eee2 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.422430 Sep 10 10:54:41.113703 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 620/3598] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:40 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:41.374131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-082692ff-b48b-42c0-ae44-10d0708596c6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:41.382298 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-082692ff-b48b-42c0-ae44-10d0708596c6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d" status: 200 len: 1512 microversion: 2.1 time: 0.674428 Sep 10 10:54:41.382895 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2979/3599] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:40 2022] GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d => generated 1512 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:41.408585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b1bd5f2-0e5d-4b45-9ed1-db955a182dfe tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:41.409683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0b1bd5f2-0e5d-4b45-9ed1-db955a182dfe tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:41.435402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b1bd5f2-0e5d-4b45-9ed1-db955a182dfe tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:41.443136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b1bd5f2-0e5d-4b45-9ed1-db955a182dfe tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:41.450032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b1bd5f2-0e5d-4b45-9ed1-db955a182dfe tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:41.451195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b1bd5f2-0e5d-4b45-9ed1-db955a182dfe tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:41.458148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b1bd5f2-0e5d-4b45-9ed1-db955a182dfe tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:41.459514 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b1bd5f2-0e5d-4b45-9ed1-db955a182dfe tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:41.632710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:41.633354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:41.643834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:41.653883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:41.654842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:41.656337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:41.657855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:41.661983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:42.536694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:43.302064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0b1bd5f2-0e5d-4b45-9ed1-db955a182dfe tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:43.310477 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0b1bd5f2-0e5d-4b45-9ed1-db955a182dfe tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1510 microversion: 2.1 time: 1.906770 Sep 10 10:54:43.311056 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 621/3600] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:41 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1510 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:43.320254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:43.328666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:43.386511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:43.392043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:43.394770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:43.398218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:43.412628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:43.415394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:43.485564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:43.514945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:43.516517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:43.534711 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ddf09dce-d5e2-418c-85bd-50689212d4d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1892 microversion: 2.32 time: 1.888925 Sep 10 10:54:43.550996 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2980/3601] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:41 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1892 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:43.563594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:43.576619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:43.581826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:43.602220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:43.813628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:43.823180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:43.837135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:43.843667 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dfe08bef-b000-4a50-ada1-de704b95d5c8 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.527081 Sep 10 10:54:43.845600 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 622/3602] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:43 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:43.929894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:43.930384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:43.930823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:43.931682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:43.933234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:43.933933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:44.204331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:44.332820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-b9b6760b-33ea-4c24-bb57-bcc23ac3b533 req-00314e42-0954-4929-8795-fd4ad44a74cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "tag": "f09e2e61-cd03-4c4b-9620-fc31f1da96b0"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:44.363631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b9b6760b-33ea-4c24-bb57-bcc23ac3b533 req-00314e42-0954-4929-8795-fd4ad44a74cd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:44.364108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b9b6760b-33ea-4c24-bb57-bcc23ac3b533 req-00314e42-0954-4929-8795-fd4ad44a74cd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:44.364561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b9b6760b-33ea-4c24-bb57-bcc23ac3b533 req-00314e42-0954-4929-8795-fd4ad44a74cd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:44.412868 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-b9b6760b-33ea-4c24-bb57-bcc23ac3b533 req-00314e42-0954-4929-8795-fd4ad44a74cd service nova] Creating event network-changed:f09e2e61-cd03-4c4b-9620-fc31f1da96b0 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:54:44.420096 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7ed990d9-f347-4311-a5cb-0a6f3a0007de tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.867891 Sep 10 10:54:44.426585 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2981/3603] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Sep 10 10:54:43 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:44.436095 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-b9b6760b-33ea-4c24-bb57-bcc23ac3b533 req-00314e42-0954-4929-8795-fd4ad44a74cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099627 Sep 10 10:54:44.438753 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 623/3604] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:44.439369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f58af4f7-1bf3-494b-9f12-33cd6538b687 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:44.439896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f58af4f7-1bf3-494b-9f12-33cd6538b687 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:44.476774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f58af4f7-1bf3-494b-9f12-33cd6538b687 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:44.478593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f58af4f7-1bf3-494b-9f12-33cd6538b687 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:44.485202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f58af4f7-1bf3-494b-9f12-33cd6538b687 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:44.488582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f58af4f7-1bf3-494b-9f12-33cd6538b687 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:44.490726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f58af4f7-1bf3-494b-9f12-33cd6538b687 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:44.491331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f58af4f7-1bf3-494b-9f12-33cd6538b687 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:44.568504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:44.569291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:44.579663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:44.584026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:44.584813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:44.585730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:44.587979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:44.588584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:45.257680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f58af4f7-1bf3-494b-9f12-33cd6538b687 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:45.272834 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f58af4f7-1bf3-494b-9f12-33cd6538b687 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1510 microversion: 2.1 time: 0.837964 Sep 10 10:54:45.273732 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2982/3605] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:44 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1510 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:45.284942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:45.287181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:45.305095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:45.305908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:45.306840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:45.307795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:45.310751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:45.312181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:45.322335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:45.342278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:45.347716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:45.351292 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b339ad8e-62ca-4f0e-9467-63fd1262c4ce tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1892 microversion: 2.32 time: 0.787086 Sep 10 10:54:45.369558 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 624/3606] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:44 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1892 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:45.384814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d5be220c-5544-4b16-8701-2aab6d4d81eb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:45.385478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d5be220c-5544-4b16-8701-2aab6d4d81eb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:45.403431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5be220c-5544-4b16-8701-2aab6d4d81eb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:45.403922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5be220c-5544-4b16-8701-2aab6d4d81eb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:45.404364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5be220c-5544-4b16-8701-2aab6d4d81eb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:45.405997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5be220c-5544-4b16-8701-2aab6d4d81eb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:45.406451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5be220c-5544-4b16-8701-2aab6d4d81eb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:45.407312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5be220c-5544-4b16-8701-2aab6d4d81eb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:45.492747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:45.515643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:45.517482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:45.527239 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-acccb858-0693-4c23-ae9a-b515c150f0de tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.252011 Sep 10 10:54:45.527858 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2983/3607] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:45 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:45.804577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d5be220c-5544-4b16-8701-2aab6d4d81eb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:45.814929 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d5be220c-5544-4b16-8701-2aab6d4d81eb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d" status: 200 len: 1512 microversion: 2.1 time: 0.444209 Sep 10 10:54:45.816405 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 625/3608] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:45 2022] GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d => generated 1512 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:45.841733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-680ede12-6868-40bf-b0b4-45fd56adfe20 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:45.843328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-680ede12-6868-40bf-b0b4-45fd56adfe20 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:45.860906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680ede12-6868-40bf-b0b4-45fd56adfe20 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:45.869675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680ede12-6868-40bf-b0b4-45fd56adfe20 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:45.870447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680ede12-6868-40bf-b0b4-45fd56adfe20 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:45.871432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680ede12-6868-40bf-b0b4-45fd56adfe20 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:45.872234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680ede12-6868-40bf-b0b4-45fd56adfe20 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:45.872890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-680ede12-6868-40bf-b0b4-45fd56adfe20 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:46.191888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-680ede12-6868-40bf-b0b4-45fd56adfe20 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:46.203205 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-680ede12-6868-40bf-b0b4-45fd56adfe20 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1510 microversion: 2.1 time: 0.365389 Sep 10 10:54:46.204768 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2984/3609] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:45 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:46.230148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:46.236146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:46.240882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:46.252587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:46.260989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:46.261892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:46.262956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:46.263659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:46.264320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:46.326382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:46.383766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:46.384682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:46.394195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:46.396596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:46.398456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:46.400421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:46.401827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:46.403134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:46.557488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:46.574898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:46.577132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:46.577750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:47.304612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:47.315017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:47.317669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:47.324946 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c5f1aa2-2a30-4d34-871e-d75129ccfb58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1892 microversion: 2.32 time: 0.945222 Sep 10 10:54:47.330259 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2985/3610] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:46 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1892 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:47.345227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:47.351577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:47.375038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:47.379985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:47.380554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:47.381450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:47.382034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:47.382577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:47.694262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:47.713130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:47.716132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:47.723258 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c8335bf-c380-406b-881f-619b6933a35c tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1546 microversion: 2.91 time: 0.386941 Sep 10 10:54:47.733842 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2986/3611] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:47 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1546 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:47.814278 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8d4deb18-d993-407f-a5a9-5afc0d1d0efa tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 1.588050 Sep 10 10:54:47.814889 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 626/3612] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 10:54:46 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:47.846532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:47.853499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:47.857950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:48.177007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:48.177810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:48.178473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:48.179443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:48.180151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:48.180818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:48.257217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:48.337336 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d42c1016-f125-4f0f-9f06-566e9315ca93 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.473763 Sep 10 10:54:48.340442 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2987/3613] 10.222.0.20 () {58 vars in 1150 bytes} [Sat Sep 10 10:54:47 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:48.354671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:48.358322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:48.359133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:48.362766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:48.363770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:48.381379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:48.383885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:48.384487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:48.384890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:48.385179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:48.385797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:48.386845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:48.387262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:48.387649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:48.388240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:48.394638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:48.397692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:48.679680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:48.854958 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7c18940d-7a29-4bcf-9018-41be5477dbe5 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.504537 Sep 10 10:54:48.866237 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 627/3614] 10.222.0.20 () {58 vars in 1212 bytes} [Sat Sep 10 10:54:48 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:48.876216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-eb3471b8-7a40-46fb-9ce4-555d15b0f8fc req-c8807e6f-1d33-4af1-ac5c-e3549ff91554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "tag": "0e5561b7-d18e-4cc7-baa7-94dad55f2c42"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:48.896320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=73 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:48.902868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eb3471b8-7a40-46fb-9ce4-555d15b0f8fc req-c8807e6f-1d33-4af1-ac5c-e3549ff91554 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:48.913896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eb3471b8-7a40-46fb-9ce4-555d15b0f8fc req-c8807e6f-1d33-4af1-ac5c-e3549ff91554 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:48.914642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eb3471b8-7a40-46fb-9ce4-555d15b0f8fc req-c8807e6f-1d33-4af1-ac5c-e3549ff91554 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:48.935520 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-eb3471b8-7a40-46fb-9ce4-555d15b0f8fc req-c8807e6f-1d33-4af1-ac5c-e3549ff91554 service nova] Creating event network-changed:0e5561b7-d18e-4cc7-baa7-94dad55f2c42 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:54:48.946313 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-eb3471b8-7a40-46fb-9ce4-555d15b0f8fc req-c8807e6f-1d33-4af1-ac5c-e3549ff91554 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078395 Sep 10 10:54:48.946962 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 628/3615] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:48.957423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:48.958135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:48.976268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:48.976761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:48.977269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:48.977988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:48.978445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:49.007168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:49.347974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:49.357348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:49.366838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:49.385299 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e9815c67-951a-4fb9-b589-5b492856fbb4 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1533 microversion: 2.91 time: 0.431098 Sep 10 10:54:49.385970 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 629/3616] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:48 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1533 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:49.416569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:49.428192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:49.442145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:49.448621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:49.449985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:49.450848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:49.458509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:49.461098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:49.461726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:49.678800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:49.796268 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-60f3300a-fcab-49ba-86e5-0550458846d1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.393552 Sep 10 10:54:49.809974 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 630/3617] 10.222.0.20 () {58 vars in 1196 bytes} [Sat Sep 10 10:54:49 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:49.821057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-db6920a6-3fca-45c5-8ca7-9117331f29d5 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:49.821703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-db6920a6-3fca-45c5-8ca7-9117331f29d5 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:49.828574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db6920a6-3fca-45c5-8ca7-9117331f29d5 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:49.829062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db6920a6-3fca-45c5-8ca7-9117331f29d5 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:49.829523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db6920a6-3fca-45c5-8ca7-9117331f29d5 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:49.830244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db6920a6-3fca-45c5-8ca7-9117331f29d5 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:49.830703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db6920a6-3fca-45c5-8ca7-9117331f29d5 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:49.831133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db6920a6-3fca-45c5-8ca7-9117331f29d5 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:50.261514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:50.265056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:50.278564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:50.280821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:50.282065 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36563abc-9dc1-4510-a5a9-112d9880bd3b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1892 microversion: 2.32 time: 1.928615 Sep 10 10:54:50.290023 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2988/3618] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:48 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1892 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:54:50.295131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-04d09464-7536-4216-9a1d-264417dee9f6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:50.296513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-04d09464-7536-4216-9a1d-264417dee9f6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:50.311385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d09464-7536-4216-9a1d-264417dee9f6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:50.318650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d09464-7536-4216-9a1d-264417dee9f6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:50.321675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d09464-7536-4216-9a1d-264417dee9f6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:50.323373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d09464-7536-4216-9a1d-264417dee9f6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:50.324793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d09464-7536-4216-9a1d-264417dee9f6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:50.325613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04d09464-7536-4216-9a1d-264417dee9f6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:50.331637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-db6920a6-3fca-45c5-8ca7-9117331f29d5 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] Lazy-loading 'services' on Instance uuid b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:54:50.403655 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-db6920a6-3fca-45c5-8ca7-9117331f29d5 tempest-UnshelveToHostMultiNodesTest-1750709318 tempest-UnshelveToHostMultiNodesTest-1750709318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1938 microversion: 2.91 time: 0.592489 Sep 10 10:54:50.404260 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 631/3619] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:49 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1938 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:50.429097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:50.449889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:50.451074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'name': '-386338047', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:50.492911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:50.493428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:50.494038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:50.497222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:50.498582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:50.499228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:50.778264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:50.857711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-04d09464-7536-4216-9a1d-264417dee9f6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:50.872587 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-04d09464-7536-4216-9a1d-264417dee9f6 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.578053 Sep 10 10:54:50.888030 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2989/3620] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:50 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:50.900877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a051af8-3664-40cc-9716-1789e06bec8d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:50.910804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0a051af8-3664-40cc-9716-1789e06bec8d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:50.919109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a051af8-3664-40cc-9716-1789e06bec8d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:50.919790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a051af8-3664-40cc-9716-1789e06bec8d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:50.927122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a051af8-3664-40cc-9716-1789e06bec8d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:50.928074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a051af8-3664-40cc-9716-1789e06bec8d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:50.928702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a051af8-3664-40cc-9716-1789e06bec8d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:50.929311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a051af8-3664-40cc-9716-1789e06bec8d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:50.929816 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-01adda8b-d01e-46c1-9278-7180005f0620 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-386338047" status: 200 len: 345 microversion: 2.1 time: 0.524213 Sep 10 10:54:50.938349 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 632/3621] 10.222.0.20 () {58 vars in 1156 bytes} [Sat Sep 10 10:54:50 2022] GET /compute/v2.1/servers?name=-386338047 => generated 345 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:50.949121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-44271450-232e-4035-ae8d-de6f2bb8139c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:50.949667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-44271450-232e-4035-ae8d-de6f2bb8139c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:50.967915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44271450-232e-4035-ae8d-de6f2bb8139c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:50.970607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44271450-232e-4035-ae8d-de6f2bb8139c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:50.971142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44271450-232e-4035-ae8d-de6f2bb8139c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:50.971785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44271450-232e-4035-ae8d-de6f2bb8139c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:50.972247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44271450-232e-4035-ae8d-de6f2bb8139c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:50.974877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44271450-232e-4035-ae8d-de6f2bb8139c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:50.991577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0a051af8-3664-40cc-9716-1789e06bec8d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:54:51.180244 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0a051af8-3664-40cc-9716-1789e06bec8d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 204 len: 0 microversion: 2.91 time: 0.290479 Sep 10 10:54:51.181163 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2990/3622] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:54:50 2022] DELETE /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:54:51.193587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:51.210470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:51.211514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:51.223573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:51.225118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:51.231539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:51.232546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:51.233928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:51.234512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:51.442863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-44271450-232e-4035-ae8d-de6f2bb8139c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:51.458675 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-44271450-232e-4035-ae8d-de6f2bb8139c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.526818 Sep 10 10:54:51.459451 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 633/3623] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:50 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:51.461805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:51.470446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:51.482760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:51.511020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:51.514744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:51.516186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:51.521330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:51.522132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:51.525678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:51.604700 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2cd44afe-e49b-404a-a3a8-efa17c061eda tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.421890 Sep 10 10:54:51.613461 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2991/3624] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Sep 10 10:54:51 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:51.623476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:51.629269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:51.639043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:51.640105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:51.644279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:51.645377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:51.646000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:51.647109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:51.782793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:51.798382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:51.800671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:51.831947 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ddffab77-bdff-40e7-8dd8-81fc48043d8b tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.368948 Sep 10 10:54:51.835252 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 634/3625] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:51 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:51.848962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9e0cd590-1950-49da-9e4f-93a17c375a29 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:51.853242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9e0cd590-1950-49da-9e4f-93a17c375a29 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:51.870466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e0cd590-1950-49da-9e4f-93a17c375a29 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:51.873119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e0cd590-1950-49da-9e4f-93a17c375a29 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:51.874698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e0cd590-1950-49da-9e4f-93a17c375a29 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:51.875629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e0cd590-1950-49da-9e4f-93a17c375a29 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:51.878893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e0cd590-1950-49da-9e4f-93a17c375a29 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:51.879655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e0cd590-1950-49da-9e4f-93a17c375a29 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:52.530218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:52.542426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:52.544290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:52.545860 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a77d7108-2e97-41b7-b81a-80c2b9f0ba7e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1892 microversion: 2.32 time: 0.931186 Sep 10 10:54:52.546657 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2992/3626] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:51 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1892 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:52.553586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:52.559131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:52.560055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-38633804', 'deleted': False, 'project_id': '40548aa2295d455fa563e34370502954'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 10:54:52.573757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:52.576872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:52.578096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:52.582531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:52.584754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:52.585501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:52.669558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9e0cd590-1950-49da-9e4f-93a17c375a29 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:52.682088 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9e0cd590-1950-49da-9e4f-93a17c375a29 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.845445 Sep 10 10:54:52.689903 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 635/3627] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:51 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:52.703428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-5ac98e0f-63ad-4091-bd73-b1938dc75263 req-e35fa878-f9ad-4e8d-a08f-eaa6f07b9a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "tag": "c47b0e0e-8474-4e97-a4ca-67dcd2219a5f"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:52.739458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5ac98e0f-63ad-4091-bd73-b1938dc75263 req-e35fa878-f9ad-4e8d-a08f-eaa6f07b9a0d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:52.740390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5ac98e0f-63ad-4091-bd73-b1938dc75263 req-e35fa878-f9ad-4e8d-a08f-eaa6f07b9a0d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:52.744389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5ac98e0f-63ad-4091-bd73-b1938dc75263 req-e35fa878-f9ad-4e8d-a08f-eaa6f07b9a0d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:52.749309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 10:54:52.791043 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-5ac98e0f-63ad-4091-bd73-b1938dc75263 req-e35fa878-f9ad-4e8d-a08f-eaa6f07b9a0d service nova] Creating event network-changed:c47b0e0e-8474-4e97-a4ca-67dcd2219a5f for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:54:52.802720 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-5ac98e0f-63ad-4091-bd73-b1938dc75263 req-e35fa878-f9ad-4e8d-a08f-eaa6f07b9a0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111176 Sep 10 10:54:52.823421 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 636/3628] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:52.839594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-905ff913-a074-4e82-be69-573c57855611 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:52.846933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-905ff913-a074-4e82-be69-573c57855611 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:52.870824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-905ff913-a074-4e82-be69-573c57855611 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:52.879097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-905ff913-a074-4e82-be69-573c57855611 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:52.879302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-905ff913-a074-4e82-be69-573c57855611 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:52.880169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-905ff913-a074-4e82-be69-573c57855611 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:52.880824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-905ff913-a074-4e82-be69-573c57855611 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:52.881352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-905ff913-a074-4e82-be69-573c57855611 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:52.932768 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c246d91-44b6-4606-aba3-c01d89f9927c tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-38633804" status: 200 len: 345 microversion: 2.1 time: 0.384780 Sep 10 10:54:52.945856 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2993/3629] 10.222.0.20 () {58 vars in 1226 bytes} [Sat Sep 10 10:54:52 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-38633804 => generated 345 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:52.962878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:52.964983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:52.978027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:52.981476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:52.982217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:52.986336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:52.987029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:52.987839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:53.239146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:53.253547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:53.255358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1180445cc14a1e8c18f1b07a0e1039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fab1dae5be24863bf66fd45d2fd08db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:53.269475 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0692fb99-c8d4-408c-aa59-692b9852f70d tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 200 len: 1539 microversion: 2.91 time: 0.321609 Sep 10 10:54:53.270990 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2994/3630] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:52 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 1539 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:53.280422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-863a91c4-bd4c-46a1-bafa-75bee3a22d0a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:53.285526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-863a91c4-bd4c-46a1-bafa-75bee3a22d0a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:53.302620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863a91c4-bd4c-46a1-bafa-75bee3a22d0a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:53.303148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863a91c4-bd4c-46a1-bafa-75bee3a22d0a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:53.303751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863a91c4-bd4c-46a1-bafa-75bee3a22d0a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:53.304451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863a91c4-bd4c-46a1-bafa-75bee3a22d0a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:53.304903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863a91c4-bd4c-46a1-bafa-75bee3a22d0a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:53.307137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863a91c4-bd4c-46a1-bafa-75bee3a22d0a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:53.373971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-863a91c4-bd4c-46a1-bafa-75bee3a22d0a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:54:53.511932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-905ff913-a074-4e82-be69-573c57855611 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:53.526409 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-905ff913-a074-4e82-be69-573c57855611 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.692695 Sep 10 10:54:53.539460 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 637/3631] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:52 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:53.574349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:53.575975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:53.602668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:53.609337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:53.610324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:53.611345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:53.614461 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-863a91c4-bd4c-46a1-bafa-75bee3a22d0a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 204 len: 0 microversion: 2.1 time: 0.341346 Sep 10 10:54:53.616614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:53.618606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:53.619923 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2995/3632] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:54:53 2022] DELETE /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:54:53.631048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1280c44-2b53-49b2-9bff-568236f3f303 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:53.632897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1280c44-2b53-49b2-9bff-568236f3f303 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:53.647093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1280c44-2b53-49b2-9bff-568236f3f303 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:53.649330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1280c44-2b53-49b2-9bff-568236f3f303 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:53.649920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1280c44-2b53-49b2-9bff-568236f3f303 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:53.653237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1280c44-2b53-49b2-9bff-568236f3f303 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:53.655302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1280c44-2b53-49b2-9bff-568236f3f303 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:53.656710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1280c44-2b53-49b2-9bff-568236f3f303 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:54.425288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:54.433168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:54:54.455500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:54.458778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:54.468841 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-df488249-2511-463e-841c-4eb45660494c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1892 microversion: 2.32 time: 0.891686 Sep 10 10:54:54.471173 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 638/3633] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:53 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1892 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:54.480047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-222450691", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "17605326-3d0c-4135-8b61-c2da6b77cdca"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:54.647189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] validate_networks() for [('17605326-3d0c-4135-8b61-c2da6b77cdca', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:54:55.791311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1280c44-2b53-49b2-9bff-568236f3f303 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:55.803597 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1280c44-2b53-49b2-9bff-568236f3f303 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1516 microversion: 2.1 time: 2.179766 Sep 10 10:54:55.817790 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2996/3634] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:53 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1516 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:55.817790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:55.823239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] [instance: b86e00a2-f0ef-42c9-bf3c-10a85762cfd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:55.834624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:55.835124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:55.840147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:55.841289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:55.841765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:55.842201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:55.864623 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] HTTP exception thrown: Instance b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 could not be found. Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Request method failure captured: Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 HTTP/1.1 Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGw5jdR8dOfYkAq_QebHQkUpy2AJrWJYrdgBkbDtxCNOhsrIILJrTyz3TZIrYRhwbfWCMclGcZ9-5-yXHlVvDMYO1_i7pIbMr25HM_XynbziLaqkQxJXZOK9Vs-h8_AB5UfVhN-8qqQkfXSX7pxkr3JuctgRPA2b7GRZTpbLf6qkpwA Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.91 Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8fab1dae5be24863bf66fd45d2fd08db Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1538627434 Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8fab1dae5be24863bf66fd45d2fd08db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8fab1dae5be24863bf66fd45d2fd08db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8fab1dae5be24863bf66fd45d2fd08db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8fab1dae5be24863bf66fd45d2fd08db", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1538627434 Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8fab1dae5be24863bf66fd45d2fd08db Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1538627434 Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-UnshelveToHostMultiNodesTest-1538627434-project Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: bf1180445cc14a1e8c18f1b07a0e1039 Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1538627434-project Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 could not be found. Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'b86e00a2-f0ef-42c9-bf3c-10a85762cfd5'} Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 could not be found. Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 could not be found. Sep 10 10:54:55.867852 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 could not be found. Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] Returning 404 to user: Instance b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:54:55.872680 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d490280c-beac-4298-8437-ed5d5ecb7d83 tempest-UnshelveToHostMultiNodesTest-1538627434 tempest-UnshelveToHostMultiNodesTest-1538627434-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5" status: 404 len: 111 microversion: 2.91 time: 0.064279 Sep 10 10:54:55.873939 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2997/3635] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:55 2022] GET /compute/v2.1/servers/b86e00a2-f0ef-42c9-bf3c-10a85762cfd5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:54:55.878750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:55.879399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:55.895598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:55.896109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:55.896938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:55.897313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:55.897782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:55.898235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:56.478726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:54:56.479273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:54:56.488404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:54:56.490275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:54:56.491375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:54:56.577800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:56.579948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:56.582129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:56.585761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:56.586934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:56.589094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:56.662718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for project 524c87c1679a4651a4e303650950283c. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:54:56.675591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for user 2cccb6588d07459eb1cfa9c00f53f7e2 and project 524c87c1679a4651a4e303650950283c. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:54:56.757838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:54:56.767420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:54:56.865535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:56.880082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:56.881858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:56.890906 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-df486d84-93ba-412c-a819-e7da4f845214 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1892 microversion: 2.32 time: 1.011206 Sep 10 10:54:56.899955 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fcd4fe9a-f046-4211-afd0-c994f6000a0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.427473 Sep 10 10:54:56.901983 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 639/3636] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:54:56.917927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6b9f6d64-fc84-48a7-b742-4d6fb8b10df1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:56.918862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6b9f6d64-fc84-48a7-b742-4d6fb8b10df1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:56.921799 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2998/3637] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:55 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1892 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:56.928889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6a99c9d9-b60c-418a-9e49-2c561c121daf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:56.931367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b9f6d64-fc84-48a7-b742-4d6fb8b10df1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:56.931816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b9f6d64-fc84-48a7-b742-4d6fb8b10df1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:56.932255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b9f6d64-fc84-48a7-b742-4d6fb8b10df1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:56.932959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b9f6d64-fc84-48a7-b742-4d6fb8b10df1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:56.935274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6a99c9d9-b60c-418a-9e49-2c561c121daf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:56.937770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b9f6d64-fc84-48a7-b742-4d6fb8b10df1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:56.940223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b9f6d64-fc84-48a7-b742-4d6fb8b10df1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:57.196070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6a99c9d9-b60c-418a-9e49-2c561c121daf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:57.206704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6a99c9d9-b60c-418a-9e49-2c561c121daf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1214 microversion: 2.1 time: 0.281322 Sep 10 10:54:57.208222 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 2999/3638] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:56 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:57.364576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6b9f6d64-fc84-48a7-b742-4d6fb8b10df1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:57.383518 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6b9f6d64-fc84-48a7-b742-4d6fb8b10df1 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1474 microversion: 2.1 time: 0.479360 Sep 10 10:54:57.386649 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 640/3639] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:56 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1474 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:57.457888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-27ed9539-e7ae-4670-8693-fc3dfdf42f30 req-a2a0cdf0-44d9-46d6-ad09-6e3da5d0e7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c735898-c187-46f3-8cd5-8f8c25d6090a", "name": "network-vif-deleted", "tag": "76a310f1-6068-463e-ba5b-661445876ea6"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:57.480734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-27ed9539-e7ae-4670-8693-fc3dfdf42f30 req-a2a0cdf0-44d9-46d6-ad09-6e3da5d0e7a6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:57.485784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-27ed9539-e7ae-4670-8693-fc3dfdf42f30 req-a2a0cdf0-44d9-46d6-ad09-6e3da5d0e7a6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:57.486446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-27ed9539-e7ae-4670-8693-fc3dfdf42f30 req-a2a0cdf0-44d9-46d6-ad09-6e3da5d0e7a6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:57.513408 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-27ed9539-e7ae-4670-8693-fc3dfdf42f30 req-a2a0cdf0-44d9-46d6-ad09-6e3da5d0e7a6 service nova] Creating event network-vif-deleted:76a310f1-6068-463e-ba5b-661445876ea6 for instance 7c735898-c187-46f3-8cd5-8f8c25d6090a on n-h2-856894-1 Sep 10 10:54:57.531776 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-27ed9539-e7ae-4670-8693-fc3dfdf42f30 req-a2a0cdf0-44d9-46d6-ad09-6e3da5d0e7a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073610 Sep 10 10:54:57.534387 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3000/3640] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:57.676829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-30e62def-7441-408f-ada1-b121a1c7a2f7 req-3dbfcb6a-bfd8-47ad-b171-3cf05455d2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "tag": "875f226e-ca50-4e2c-adf6-17cf98c280d2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:54:57.724970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-30e62def-7441-408f-ada1-b121a1c7a2f7 req-3dbfcb6a-bfd8-47ad-b171-3cf05455d2b6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:57.727154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-30e62def-7441-408f-ada1-b121a1c7a2f7 req-3dbfcb6a-bfd8-47ad-b171-3cf05455d2b6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:57.730910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-30e62def-7441-408f-ada1-b121a1c7a2f7 req-3dbfcb6a-bfd8-47ad-b171-3cf05455d2b6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:57.781184 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-30e62def-7441-408f-ada1-b121a1c7a2f7 req-3dbfcb6a-bfd8-47ad-b171-3cf05455d2b6 service nova] Creating event network-changed:875f226e-ca50-4e2c-adf6-17cf98c280d2 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:54:57.850929 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-30e62def-7441-408f-ada1-b121a1c7a2f7 req-3dbfcb6a-bfd8-47ad-b171-3cf05455d2b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177685 Sep 10 10:54:57.857688 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 641/3641] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:54:57.924213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:57.926099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:57.939585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:57.949946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:57.950407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:57.951158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:57.951800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:57.961510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:58.239303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-68d2dd4b-7f1a-403e-b6d2-4f90344148c5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:58.242793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-68d2dd4b-7f1a-403e-b6d2-4f90344148c5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:58.271069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68d2dd4b-7f1a-403e-b6d2-4f90344148c5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:58.273043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68d2dd4b-7f1a-403e-b6d2-4f90344148c5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:58.273665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68d2dd4b-7f1a-403e-b6d2-4f90344148c5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:58.275310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68d2dd4b-7f1a-403e-b6d2-4f90344148c5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:58.276594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68d2dd4b-7f1a-403e-b6d2-4f90344148c5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:58.278609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68d2dd4b-7f1a-403e-b6d2-4f90344148c5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:58.466017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-68d2dd4b-7f1a-403e-b6d2-4f90344148c5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:58.477553 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-68d2dd4b-7f1a-403e-b6d2-4f90344148c5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1218 microversion: 2.1 time: 0.245531 Sep 10 10:54:58.478161 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 642/3642] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:58 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1218 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:58.490460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:58.493281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:58.507760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:58.509556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:58.510163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:58.512845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:58.515910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:58.516545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:58.604710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:58.605593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:58.607220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:58.609226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lazy-loading 'fault' on Instance uuid 7c735898-c187-46f3-8cd5-8f8c25d6090a {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:54:59.230577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:59.243728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:59.249919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:59.261536 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ab7d80fc-e1cc-4382-8503-52c3ed60bcbb tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 200 len: 1310 microversion: 2.1 time: 0.778832 Sep 10 10:54:59.262200 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 643/3643] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:58 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 1310 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:54:59.271601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:59.275602 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a6e0befb-7a8c-4513-a394-d3e570bc858f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.358173 Sep 10 10:54:59.279249 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3001/3644] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:54:57 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:54:59.504703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-40d456f6-aea3-4863-b892-020a7d6d7e9b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:54:59.505162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-40d456f6-aea3-4863-b892-020a7d6d7e9b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:54:59.523037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-40d456f6-aea3-4863-b892-020a7d6d7e9b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:59.523641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-40d456f6-aea3-4863-b892-020a7d6d7e9b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:59.524360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-40d456f6-aea3-4863-b892-020a7d6d7e9b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:59.525653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-40d456f6-aea3-4863-b892-020a7d6d7e9b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:54:59.526342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-40d456f6-aea3-4863-b892-020a7d6d7e9b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:54:59.526932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-40d456f6-aea3-4863-b892-020a7d6d7e9b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:54:59.779108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-40d456f6-aea3-4863-b892-020a7d6d7e9b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:54:59.794923 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-40d456f6-aea3-4863-b892-020a7d6d7e9b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1266 microversion: 2.1 time: 0.290424 Sep 10 10:54:59.797653 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 644/3645] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:54:59 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:00.291825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:00.292457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 7c735898-c187-46f3-8cd5-8f8c25d6090a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:00.312237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:00.313095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:00.319922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:00.320347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:00.320787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:00.327662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:00.328180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:00.328625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:00.333683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:00.334177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:00.339968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:00.340476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:00.341100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:00.343145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:00.408531 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] HTTP exception thrown: Instance 7c735898-c187-46f3-8cd5-8f8c25d6090a could not be found. Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Request method failure captured: Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a HTTP/1.1 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGyamAiWX7Up7KwADxvW7_4VvidoeX6b94frX4S3zEcABn9rW4eAxgWzIk1eDXVQmEeEWRnWJbcqNaiG_Xs7rcsmTRO-D5QXkBN7qzCu73JMr-8zD_fWWtKSZm3eOwGxYXC0vL5NP3s8RwDdLD3CxVbreoSfnsqV6ic9AUM0oGx0GU4 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 40548aa2295d455fa563e34370502954 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServerFiltersTestJSON-242985444 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/40548aa2295d455fa563e34370502954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/40548aa2295d455fa563e34370502954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/40548aa2295d455fa563e34370502954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_40548aa2295d455fa563e34370502954", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServerFiltersTestJSON-242985444 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 40548aa2295d455fa563e34370502954 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-242985444 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServerFiltersTestJSON-242985444-project Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d83ca354612b4f90a53e958948d91c18 Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServerFiltersTestJSON-242985444-project Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7c735898-c187-46f3-8cd5-8f8c25d6090a could not be found. Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7c735898-c187-46f3-8cd5-8f8c25d6090a'} Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c735898-c187-46f3-8cd5-8f8c25d6090a could not be found. Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c735898-c187-46f3-8cd5-8f8c25d6090a could not be found. Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:00.410431 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:00.414219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:00.414219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:00.414219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:00.414219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:55:00.414219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:55:00.414219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c735898-c187-46f3-8cd5-8f8c25d6090a could not be found. Sep 10 10:55:00.414219 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:00.414219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Returning 404 to user: Instance 7c735898-c187-46f3-8cd5-8f8c25d6090a could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:55:00.430630 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07d818e6-3df4-4c50-b7d4-4d3f17c0f76a tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a" status: 404 len: 111 microversion: 2.1 time: 0.142832 Sep 10 10:55:00.431336 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3002/3646] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:00 2022] GET /compute/v2.1/servers/7c735898-c187-46f3-8cd5-8f8c25d6090a => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:55:00.450125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-775704f4-7c4f-403a-8246-d34cc648977f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:00.450636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-775704f4-7c4f-403a-8246-d34cc648977f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:00.472523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-775704f4-7c4f-403a-8246-d34cc648977f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:00.484658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-775704f4-7c4f-403a-8246-d34cc648977f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:00.485506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-775704f4-7c4f-403a-8246-d34cc648977f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:00.490152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-775704f4-7c4f-403a-8246-d34cc648977f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:00.491219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-775704f4-7c4f-403a-8246-d34cc648977f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:00.491827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-775704f4-7c4f-403a-8246-d34cc648977f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:00.591139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-775704f4-7c4f-403a-8246-d34cc648977f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:55:00.750267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:00.917351 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-775704f4-7c4f-403a-8246-d34cc648977f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d" status: 204 len: 0 microversion: 2.1 time: 0.481128 Sep 10 10:55:00.918279 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3003/3647] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:55:00 2022] DELETE /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:55:00.931786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07ca2e8b-5c95-4fba-839a-2e1a6f5e8138 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:00.932491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07ca2e8b-5c95-4fba-839a-2e1a6f5e8138 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:00.955083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07ca2e8b-5c95-4fba-839a-2e1a6f5e8138 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:00.955584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07ca2e8b-5c95-4fba-839a-2e1a6f5e8138 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:00.957907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07ca2e8b-5c95-4fba-839a-2e1a6f5e8138 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:00.962761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07ca2e8b-5c95-4fba-839a-2e1a6f5e8138 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:00.963444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07ca2e8b-5c95-4fba-839a-2e1a6f5e8138 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:00.964361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07ca2e8b-5c95-4fba-839a-2e1a6f5e8138 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:01.975181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:01.994150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:02.002057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:02.009954 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ae21841b-434d-4a0b-a361-b852cbdaff0d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.700416 Sep 10 10:55:02.012617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-07ca2e8b-5c95-4fba-839a-2e1a6f5e8138 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:02.015570 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 645/3648] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:00 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:55:02.025816 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07ca2e8b-5c95-4fba-839a-2e1a6f5e8138 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1272 microversion: 2.1 time: 1.106261 Sep 10 10:55:02.032300 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3004/3649] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:00 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1272 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:02.041959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-58de6001-94d3-459f-a628-d9b9b9d01648 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:02.043214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-58de6001-94d3-459f-a628-d9b9b9d01648 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:02.056525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58de6001-94d3-459f-a628-d9b9b9d01648 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:02.070172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58de6001-94d3-459f-a628-d9b9b9d01648 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:02.070935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58de6001-94d3-459f-a628-d9b9b9d01648 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:02.071935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58de6001-94d3-459f-a628-d9b9b9d01648 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:02.072570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58de6001-94d3-459f-a628-d9b9b9d01648 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:02.073786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58de6001-94d3-459f-a628-d9b9b9d01648 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:02.912108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-58de6001-94d3-459f-a628-d9b9b9d01648 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:02.927051 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-58de6001-94d3-459f-a628-d9b9b9d01648 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d" status: 200 len: 1518 microversion: 2.1 time: 0.910225 Sep 10 10:55:02.937718 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 646/3650] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:02 2022] GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d => generated 1518 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:03.043121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:03.043939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:03.054860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:03.061637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3569616d-adc1-4cb2-8720-8128900ee44e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:03.068343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3569616d-adc1-4cb2-8720-8128900ee44e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:03.073275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:03.078368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:03.080571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:03.082601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:03.083254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:03.086392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:03.095124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3569616d-adc1-4cb2-8720-8128900ee44e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:03.095962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3569616d-adc1-4cb2-8720-8128900ee44e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:03.099177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3569616d-adc1-4cb2-8720-8128900ee44e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:03.100782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3569616d-adc1-4cb2-8720-8128900ee44e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:03.101952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3569616d-adc1-4cb2-8720-8128900ee44e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:03.103347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3569616d-adc1-4cb2-8720-8128900ee44e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:03.740574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:03.759427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:03.761324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:03.762797 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6cfadd2-e893-4880-899b-c949d47f0b8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.723717 Sep 10 10:55:03.763625 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3005/3651] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:03 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:03.781789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-83a6a6a0-fcee-4157-8b27-40fe887a600e req-797eb48f-8006-4054-a752-9d353398f043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "tag": "afc48537-d094-475a-90d1-6025c8a4d182"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:03.803927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-83a6a6a0-fcee-4157-8b27-40fe887a600e req-797eb48f-8006-4054-a752-9d353398f043 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:03.804574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-83a6a6a0-fcee-4157-8b27-40fe887a600e req-797eb48f-8006-4054-a752-9d353398f043 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:03.805146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-83a6a6a0-fcee-4157-8b27-40fe887a600e req-797eb48f-8006-4054-a752-9d353398f043 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:03.823027 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-83a6a6a0-fcee-4157-8b27-40fe887a600e req-797eb48f-8006-4054-a752-9d353398f043 service nova] Creating event network-changed:afc48537-d094-475a-90d1-6025c8a4d182 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:55:03.832292 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-83a6a6a0-fcee-4157-8b27-40fe887a600e req-797eb48f-8006-4054-a752-9d353398f043 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065307 Sep 10 10:55:03.834923 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3006/3652] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:55:03.949025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3569616d-adc1-4cb2-8720-8128900ee44e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:03.957812 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3569616d-adc1-4cb2-8720-8128900ee44e tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1314 microversion: 2.1 time: 0.903767 Sep 10 10:55:03.968190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a5a9bec-c6f4-4f4a-b594-a8f91740a1ef tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:03.968686 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 647/3653] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:03 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:03.968904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a5a9bec-c6f4-4f4a-b594-a8f91740a1ef tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:04.013738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5a9bec-c6f4-4f4a-b594-a8f91740a1ef tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:04.015415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5a9bec-c6f4-4f4a-b594-a8f91740a1ef tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:04.016186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5a9bec-c6f4-4f4a-b594-a8f91740a1ef tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:04.016917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5a9bec-c6f4-4f4a-b594-a8f91740a1ef tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:04.022751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5a9bec-c6f4-4f4a-b594-a8f91740a1ef tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:04.023206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5a9bec-c6f4-4f4a-b594-a8f91740a1ef tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:04.168948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-78ccff6b-8612-4a4e-823a-615c47ff3cd3 req-c404eb9e-15ef-415e-aa3e-fe1feb621ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5310a126-b532-4a13-ae0b-c8c28404e216", "tag": "2afd01b6-b544-4775-aa92-3d29b23ff0e8"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:04.211649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-78ccff6b-8612-4a4e-823a-615c47ff3cd3 req-c404eb9e-15ef-415e-aa3e-fe1feb621ac2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:04.215083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-78ccff6b-8612-4a4e-823a-615c47ff3cd3 req-c404eb9e-15ef-415e-aa3e-fe1feb621ac2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:04.216387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-78ccff6b-8612-4a4e-823a-615c47ff3cd3 req-c404eb9e-15ef-415e-aa3e-fe1feb621ac2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:04.250335 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-78ccff6b-8612-4a4e-823a-615c47ff3cd3 req-c404eb9e-15ef-415e-aa3e-fe1feb621ac2 service nova] Creating event network-changed:2afd01b6-b544-4775-aa92-3d29b23ff0e8 for instance 5310a126-b532-4a13-ae0b-c8c28404e216 on n-h2-856894-1 Sep 10 10:55:04.265119 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-78ccff6b-8612-4a4e-823a-615c47ff3cd3 req-c404eb9e-15ef-415e-aa3e-fe1feb621ac2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096603 Sep 10 10:55:04.266604 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 648/3654] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:55:04.774785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a5a9bec-c6f4-4f4a-b594-a8f91740a1ef tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:04.793146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:04.794188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:04.814644 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a5a9bec-c6f4-4f4a-b594-a8f91740a1ef tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d" status: 200 len: 1518 microversion: 2.1 time: 0.851929 Sep 10 10:55:04.839257 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3007/3655] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:03 2022] GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d => generated 1518 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:55:04.841574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:04.842130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:04.842572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:04.843297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:04.843755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:04.844181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:04.992425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-92cf36f8-4815-4637-8bb8-501accd00bc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:04.993888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-92cf36f8-4815-4637-8bb8-501accd00bc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:05.011450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92cf36f8-4815-4637-8bb8-501accd00bc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:05.013901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92cf36f8-4815-4637-8bb8-501accd00bc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:05.015588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92cf36f8-4815-4637-8bb8-501accd00bc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:05.017346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92cf36f8-4815-4637-8bb8-501accd00bc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:05.018017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92cf36f8-4815-4637-8bb8-501accd00bc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:05.018598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92cf36f8-4815-4637-8bb8-501accd00bc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:06.363658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:06.371930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-92cf36f8-4815-4637-8bb8-501accd00bc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:06.377350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:06.387829 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-92cf36f8-4815-4637-8bb8-501accd00bc1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1314 microversion: 2.1 time: 1.401901 Sep 10 10:55:06.400910 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3008/3656] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:04 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1314 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:06.404419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:06.408423 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3b360217-1a89-4594-9011-6c80e706c1d2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.620913 Sep 10 10:55:06.409282 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 649/3657] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:04 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:06.417339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-4adf6650-74fb-4c5c-a63a-0791704f814e req-33d0e214-5152-4930-8147-170c2cb1d0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d", "name": "network-vif-deleted", "tag": "2e9e60af-ee9d-4615-b961-2ba0535250ac"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:06.417564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:06.418075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:06.435435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4adf6650-74fb-4c5c-a63a-0791704f814e req-33d0e214-5152-4930-8147-170c2cb1d0d2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:06.439213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4adf6650-74fb-4c5c-a63a-0791704f814e req-33d0e214-5152-4930-8147-170c2cb1d0d2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:06.448161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4adf6650-74fb-4c5c-a63a-0791704f814e req-33d0e214-5152-4930-8147-170c2cb1d0d2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:06.448715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:06.449440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:06.451167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:06.454628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:06.455608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:06.456200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:06.462358 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-4adf6650-74fb-4c5c-a63a-0791704f814e req-33d0e214-5152-4930-8147-170c2cb1d0d2 service nova] Creating event network-vif-deleted:2e9e60af-ee9d-4615-b961-2ba0535250ac for instance 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d on n-h2-856894-1 Sep 10 10:55:06.478257 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-4adf6650-74fb-4c5c-a63a-0791704f814e req-33d0e214-5152-4930-8147-170c2cb1d0d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067436 Sep 10 10:55:06.479424 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 650/3658] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:55:06.498122 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] HTTP exception thrown: Instance 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d could not be found. Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Request method failure captured: Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d HTTP/1.1 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGyamAiWX7Up7KwADxvW7_4VvidoeX6b94frX4S3zEcABn9rW4eAxgWzIk1eDXVQmEeEWRnWJbcqNaiG_Xs7rcsmTRO-D5QXkBN7qzCu73JMr-8zD_fWWtKSZm3eOwGxYXC0vL5NP3s8RwDdLD3CxVbreoSfnsqV6ic9AUM0oGx0GU4 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 40548aa2295d455fa563e34370502954 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServerFiltersTestJSON-242985444 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/40548aa2295d455fa563e34370502954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/40548aa2295d455fa563e34370502954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/40548aa2295d455fa563e34370502954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_40548aa2295d455fa563e34370502954", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServerFiltersTestJSON-242985444 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 40548aa2295d455fa563e34370502954 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-242985444 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServerFiltersTestJSON-242985444-project Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d83ca354612b4f90a53e958948d91c18 Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServerFiltersTestJSON-242985444-project Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d could not be found. Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d'} Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d could not be found. Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d could not be found. Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:06.504741 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:06.508782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:06.508782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:06.508782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:06.508782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:55:06.508782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:55:06.508782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d could not be found. Sep 10 10:55:06.508782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:06.508782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Returning 404 to user: Instance 4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:55:06.508782 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b9fa2bd8-2d9f-40da-b2c8-cd730a1921b7 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d" status: 404 len: 111 microversion: 2.1 time: 0.102070 Sep 10 10:55:06.517012 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3009/3659] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:06 2022] GET /compute/v2.1/servers/4ec7d7ab-eecb-4e77-83c5-b7d2ba76150d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:55:06.519913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e66b9e7-4e17-4513-899a-e96204688857 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:06.520717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1e66b9e7-4e17-4513-899a-e96204688857 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:06.543424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e66b9e7-4e17-4513-899a-e96204688857 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:06.550741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e66b9e7-4e17-4513-899a-e96204688857 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:06.552522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e66b9e7-4e17-4513-899a-e96204688857 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:06.553554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e66b9e7-4e17-4513-899a-e96204688857 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:06.554233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e66b9e7-4e17-4513-899a-e96204688857 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:06.554859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e66b9e7-4e17-4513-899a-e96204688857 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:06.608366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1e66b9e7-4e17-4513-899a-e96204688857 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:55:06.661972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=10 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:06.719692 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1e66b9e7-4e17-4513-899a-e96204688857 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 204 len: 0 microversion: 2.1 time: 0.203992 Sep 10 10:55:06.720878 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 651/3660] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:55:06 2022] DELETE /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:55:06.729327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e05f0be-52db-4038-a786-01e237f2b53f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:06.730266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e05f0be-52db-4038-a786-01e237f2b53f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:06.738568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e05f0be-52db-4038-a786-01e237f2b53f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:06.739284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e05f0be-52db-4038-a786-01e237f2b53f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:06.739953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e05f0be-52db-4038-a786-01e237f2b53f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:06.740808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e05f0be-52db-4038-a786-01e237f2b53f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:06.741514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e05f0be-52db-4038-a786-01e237f2b53f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:06.742179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e05f0be-52db-4038-a786-01e237f2b53f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:07.204893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:07.348483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e05f0be-52db-4038-a786-01e237f2b53f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:07.365932 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e05f0be-52db-4038-a786-01e237f2b53f tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1516 microversion: 2.1 time: 0.640817 Sep 10 10:55:07.366803 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3010/3661] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:06 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1516 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:07.416263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-67a34e4c-537b-429d-8fea-a456e65ff662 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:07.416983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-67a34e4c-537b-429d-8fea-a456e65ff662 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:07.420081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:07.426993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a34e4c-537b-429d-8fea-a456e65ff662 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:07.427790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a34e4c-537b-429d-8fea-a456e65ff662 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:07.428392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a34e4c-537b-429d-8fea-a456e65ff662 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:07.429908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a34e4c-537b-429d-8fea-a456e65ff662 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:07.430672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a34e4c-537b-429d-8fea-a456e65ff662 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:07.431294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a34e4c-537b-429d-8fea-a456e65ff662 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:07.436372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:07.437006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:07.448023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:07.448531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:07.448979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:07.449736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:07.450202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:07.450634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:07.840476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-67a34e4c-537b-429d-8fea-a456e65ff662 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:07.859272 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-67a34e4c-537b-429d-8fea-a456e65ff662 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1314 microversion: 2.1 time: 0.447645 Sep 10 10:55:07.861988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:07.864351 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 652/3662] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:07 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:55:07.871481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:07.878253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:07.893018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b72c89c-9d0c-48af-9bfc-ec9d6d5b0a3f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.453303 Sep 10 10:55:07.894330 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3011/3663] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:07 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:08.393303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9cd402f4-7d5a-47a6-a88b-24ddac75c751 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:08.394095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9cd402f4-7d5a-47a6-a88b-24ddac75c751 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:08.405093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cd402f4-7d5a-47a6-a88b-24ddac75c751 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:08.405816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cd402f4-7d5a-47a6-a88b-24ddac75c751 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:08.406891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cd402f4-7d5a-47a6-a88b-24ddac75c751 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:08.409022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cd402f4-7d5a-47a6-a88b-24ddac75c751 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:08.411217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cd402f4-7d5a-47a6-a88b-24ddac75c751 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:08.411817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cd402f4-7d5a-47a6-a88b-24ddac75c751 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:08.913006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4845f3aa-8e7d-4b1a-b347-5829f32732a7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:08.919633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4845f3aa-8e7d-4b1a-b347-5829f32732a7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:08.961143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4845f3aa-8e7d-4b1a-b347-5829f32732a7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:08.965094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4845f3aa-8e7d-4b1a-b347-5829f32732a7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:08.965977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4845f3aa-8e7d-4b1a-b347-5829f32732a7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:08.974246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9cd402f4-7d5a-47a6-a88b-24ddac75c751 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:08.979406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4845f3aa-8e7d-4b1a-b347-5829f32732a7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:08.979917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4845f3aa-8e7d-4b1a-b347-5829f32732a7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:08.985221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4845f3aa-8e7d-4b1a-b347-5829f32732a7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:08.996126 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9cd402f4-7d5a-47a6-a88b-24ddac75c751 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1516 microversion: 2.1 time: 0.607032 Sep 10 10:55:09.023279 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 653/3664] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:08 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1516 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:09.036940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:09.040066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:09.120001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:09.120937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:09.122243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:09.122965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:09.123985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:09.124410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:10.087407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4845f3aa-8e7d-4b1a-b347-5829f32732a7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:10.097776 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4845f3aa-8e7d-4b1a-b347-5829f32732a7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1314 microversion: 2.1 time: 1.212837 Sep 10 10:55:10.103818 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3012/3665] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:08 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1314 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:10.114882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72202429-e0d6-4bc7-b016-a3deb4be6e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:10.115883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-72202429-e0d6-4bc7-b016-a3deb4be6e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:10.118237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:10.133217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72202429-e0d6-4bc7-b016-a3deb4be6e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:10.133992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72202429-e0d6-4bc7-b016-a3deb4be6e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:10.134659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72202429-e0d6-4bc7-b016-a3deb4be6e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:10.146138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72202429-e0d6-4bc7-b016-a3deb4be6e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:10.146975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72202429-e0d6-4bc7-b016-a3deb4be6e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:10.147698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72202429-e0d6-4bc7-b016-a3deb4be6e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:10.617670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:10.632063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:10.633690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:10.646509 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2020b90b-910a-4b65-a314-c20a855c0e23 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.619967 Sep 10 10:55:10.647662 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 654/3666] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:09 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:10.720673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-72202429-e0d6-4bc7-b016-a3deb4be6e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:10.728725 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72202429-e0d6-4bc7-b016-a3deb4be6e94 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1516 microversion: 2.1 time: 0.623559 Sep 10 10:55:10.732059 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3013/3667] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:10 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1516 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:11.127852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6a51a87e-3d6a-4c9e-b621-b640d0bf7fe7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:11.128847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6a51a87e-3d6a-4c9e-b621-b640d0bf7fe7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:11.144536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a51a87e-3d6a-4c9e-b621-b640d0bf7fe7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:11.145426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a51a87e-3d6a-4c9e-b621-b640d0bf7fe7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:11.146100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a51a87e-3d6a-4c9e-b621-b640d0bf7fe7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:11.147069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a51a87e-3d6a-4c9e-b621-b640d0bf7fe7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:11.147763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a51a87e-3d6a-4c9e-b621-b640d0bf7fe7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:11.148420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a51a87e-3d6a-4c9e-b621-b640d0bf7fe7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:11.703213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:11.708259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:11.739905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:11.740962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:11.742402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:11.743523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:11.744221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:11.745384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:12.376379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6a51a87e-3d6a-4c9e-b621-b640d0bf7fe7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:12.384803 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6a51a87e-3d6a-4c9e-b621-b640d0bf7fe7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1314 microversion: 2.1 time: 1.261289 Sep 10 10:55:12.389568 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 655/3668] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:11 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1314 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:12.399583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-66bb6d70-330d-43e2-ba9e-360f50de24b4 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:12.402550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-66bb6d70-330d-43e2-ba9e-360f50de24b4 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:12.425942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66bb6d70-330d-43e2-ba9e-360f50de24b4 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:12.436307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66bb6d70-330d-43e2-ba9e-360f50de24b4 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:12.439442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66bb6d70-330d-43e2-ba9e-360f50de24b4 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:12.443393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66bb6d70-330d-43e2-ba9e-360f50de24b4 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:12.445689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66bb6d70-330d-43e2-ba9e-360f50de24b4 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:12.446731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66bb6d70-330d-43e2-ba9e-360f50de24b4 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:12.498731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:12.962449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-66bb6d70-330d-43e2-ba9e-360f50de24b4 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:12.976061 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-66bb6d70-330d-43e2-ba9e-360f50de24b4 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1474 microversion: 2.1 time: 0.585283 Sep 10 10:55:12.976940 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 656/3669] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:12 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1474 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:13.126608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:13.148897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:13.156902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:13.162525 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a410db5b-7a36-4232-961d-665ce733c36b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.486000 Sep 10 10:55:13.178725 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3014/3670] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:11 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:13.190854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f59e95d3-4123-479e-94f4-832bc77b1a81 req-56eb8510-8b10-4df1-b92e-51bec0c1e84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41aa1034-4e4f-4032-a6d9-796d34c15854", "name": "network-vif-deleted", "tag": "f1a155e8-50b4-433e-b29d-c93592bbdcc0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:13.215337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f59e95d3-4123-479e-94f4-832bc77b1a81 req-56eb8510-8b10-4df1-b92e-51bec0c1e84f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:13.216002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f59e95d3-4123-479e-94f4-832bc77b1a81 req-56eb8510-8b10-4df1-b92e-51bec0c1e84f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:13.220371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f59e95d3-4123-479e-94f4-832bc77b1a81 req-56eb8510-8b10-4df1-b92e-51bec0c1e84f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:13.245748 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f59e95d3-4123-479e-94f4-832bc77b1a81 req-56eb8510-8b10-4df1-b92e-51bec0c1e84f service nova] Creating event network-vif-deleted:f1a155e8-50b4-433e-b29d-c93592bbdcc0 for instance 41aa1034-4e4f-4032-a6d9-796d34c15854 on n-h2-856894-1 Sep 10 10:55:13.277667 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f59e95d3-4123-479e-94f4-832bc77b1a81 req-56eb8510-8b10-4df1-b92e-51bec0c1e84f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096947 Sep 10 10:55:13.284593 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3015/3671] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:55:13.405716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-603aacff-cbe8-4c08-8eb7-f2be2c97ba3d req-9e08577e-b9ae-481d-b299-8dcc8c22e21c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5310a126-b532-4a13-ae0b-c8c28404e216", "name": "network-vif-plugged", "status": "completed", "tag": "2afd01b6-b544-4775-aa92-3d29b23ff0e8"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:13.412424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8483940a-fb2a-4b59-8623-40884e689a67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:13.413390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8483940a-fb2a-4b59-8623-40884e689a67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:13.433596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8483940a-fb2a-4b59-8623-40884e689a67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:13.444475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-603aacff-cbe8-4c08-8eb7-f2be2c97ba3d req-9e08577e-b9ae-481d-b299-8dcc8c22e21c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:13.447255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8483940a-fb2a-4b59-8623-40884e689a67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:13.447500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-603aacff-cbe8-4c08-8eb7-f2be2c97ba3d req-9e08577e-b9ae-481d-b299-8dcc8c22e21c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:13.448775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8483940a-fb2a-4b59-8623-40884e689a67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:13.449382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-603aacff-cbe8-4c08-8eb7-f2be2c97ba3d req-9e08577e-b9ae-481d-b299-8dcc8c22e21c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:13.450899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8483940a-fb2a-4b59-8623-40884e689a67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:13.456373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8483940a-fb2a-4b59-8623-40884e689a67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:13.458445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8483940a-fb2a-4b59-8623-40884e689a67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:13.476868 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-603aacff-cbe8-4c08-8eb7-f2be2c97ba3d req-9e08577e-b9ae-481d-b299-8dcc8c22e21c service nova] Creating event network-vif-plugged:2afd01b6-b544-4775-aa92-3d29b23ff0e8 for instance 5310a126-b532-4a13-ae0b-c8c28404e216 on n-h2-856894-1 Sep 10 10:55:13.508786 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-603aacff-cbe8-4c08-8eb7-f2be2c97ba3d req-9e08577e-b9ae-481d-b299-8dcc8c22e21c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.524761 Sep 10 10:55:13.517912 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 657/3672] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:55:14.007305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:14.008964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:14.025558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:14.027949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:14.028370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:14.034104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:14.034983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:14.035444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:14.175896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:14.179912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:14.180818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:14.188710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lazy-loading 'fault' on Instance uuid 41aa1034-4e4f-4032-a6d9-796d34c15854 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:55:14.713106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83ca354612b4f90a53e958948d91c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40548aa2295d455fa563e34370502954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:14.728674 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3aa2cf1b-dc7c-4d4a-aaee-f192a6dac2e6 tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 200 len: 1310 microversion: 2.1 time: 0.723521 Sep 10 10:55:14.729345 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 658/3673] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:13 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 1310 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:14.756900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:14.761949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:14.782448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:14.782943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:14.783381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:14.784088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:14.790172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:14.790662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:15.101494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8483940a-fb2a-4b59-8623-40884e689a67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:15.120902 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8483940a-fb2a-4b59-8623-40884e689a67 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1314 microversion: 2.1 time: 1.712003 Sep 10 10:55:15.123781 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3016/3674] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:13 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1314 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:55:15.378358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:15.403754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:15.407246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:15.414143 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3d9c84f4-048f-4a77-aea2-aa197fdc9b9a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.680260 Sep 10 10:55:15.414934 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 659/3675] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:14 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:15.761435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:15.762744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] [instance: 41aa1034-4e4f-4032-a6d9-796d34c15854] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:15.774388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:15.775714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:15.778216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:15.780417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:15.781124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:15.781768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:15.819677 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] HTTP exception thrown: Instance 41aa1034-4e4f-4032-a6d9-796d34c15854 could not be found. Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Request method failure captured: Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 HTTP/1.1 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGyamAiWX7Up7KwADxvW7_4VvidoeX6b94frX4S3zEcABn9rW4eAxgWzIk1eDXVQmEeEWRnWJbcqNaiG_Xs7rcsmTRO-D5QXkBN7qzCu73JMr-8zD_fWWtKSZm3eOwGxYXC0vL5NP3s8RwDdLD3CxVbreoSfnsqV6ic9AUM0oGx0GU4 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 40548aa2295d455fa563e34370502954 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ListServerFiltersTestJSON-242985444 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/40548aa2295d455fa563e34370502954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/40548aa2295d455fa563e34370502954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/40548aa2295d455fa563e34370502954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_40548aa2295d455fa563e34370502954", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ListServerFiltersTestJSON-242985444 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 40548aa2295d455fa563e34370502954 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-242985444 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ListServerFiltersTestJSON-242985444-project Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d83ca354612b4f90a53e958948d91c18 Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ListServerFiltersTestJSON-242985444-project Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 41aa1034-4e4f-4032-a6d9-796d34c15854 could not be found. Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '41aa1034-4e4f-4032-a6d9-796d34c15854'} Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41aa1034-4e4f-4032-a6d9-796d34c15854 could not be found. Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41aa1034-4e4f-4032-a6d9-796d34c15854 could not be found. Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:15.821849 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:15.826727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:15.826727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:15.826727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:15.826727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:55:15.826727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:55:15.826727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41aa1034-4e4f-4032-a6d9-796d34c15854 could not be found. Sep 10 10:55:15.826727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:15.828940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] Returning 404 to user: Instance 41aa1034-4e4f-4032-a6d9-796d34c15854 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:55:15.830728 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0a00c1e6-e502-4e8e-9403-31140a2d240b tempest-ListServerFiltersTestJSON-242985444 tempest-ListServerFiltersTestJSON-242985444-project] 10.222.0.20 "GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854" status: 404 len: 111 microversion: 2.1 time: 0.075009 Sep 10 10:55:15.836271 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3017/3676] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:15 2022] GET /compute/v2.1/servers/41aa1034-4e4f-4032-a6d9-796d34c15854 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:55:16.148049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ee58de07-d703-4cc3-8141-f1b4a650211b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:16.149346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ee58de07-d703-4cc3-8141-f1b4a650211b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:16.184195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee58de07-d703-4cc3-8141-f1b4a650211b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:16.184706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee58de07-d703-4cc3-8141-f1b4a650211b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:16.187634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee58de07-d703-4cc3-8141-f1b4a650211b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:16.188417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee58de07-d703-4cc3-8141-f1b4a650211b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:16.188890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee58de07-d703-4cc3-8141-f1b4a650211b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:16.189369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee58de07-d703-4cc3-8141-f1b4a650211b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:16.460036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:16.462905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:16.475391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:16.476868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:16.477522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:16.479828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:16.480706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:16.481344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:17.479918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ee58de07-d703-4cc3-8141-f1b4a650211b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:17.491515 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ee58de07-d703-4cc3-8141-f1b4a650211b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1314 microversion: 2.1 time: 1.351249 Sep 10 10:55:17.495416 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 660/3677] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:16 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1314 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:17.516184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:17.536837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:17.541196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:17.546600 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab63b39c-3ec6-403f-a56d-e6a418d22c48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.106927 Sep 10 10:55:17.547378 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3018/3678] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:16 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:55:18.516743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dd7e4609-50f8-4f83-91a5-1d73a678d0d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:18.518734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dd7e4609-50f8-4f83-91a5-1d73a678d0d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:18.528300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd7e4609-50f8-4f83-91a5-1d73a678d0d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:18.530065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd7e4609-50f8-4f83-91a5-1d73a678d0d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:18.530757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd7e4609-50f8-4f83-91a5-1d73a678d0d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:18.531703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd7e4609-50f8-4f83-91a5-1d73a678d0d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:18.532444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd7e4609-50f8-4f83-91a5-1d73a678d0d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:18.533181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd7e4609-50f8-4f83-91a5-1d73a678d0d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:18.579141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:18.581389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:18.608656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:18.613732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:18.615286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:18.620153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:18.624131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:18.624805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:19.942555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dd7e4609-50f8-4f83-91a5-1d73a678d0d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:19.960747 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dd7e4609-50f8-4f83-91a5-1d73a678d0d9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1500 microversion: 2.1 time: 1.447507 Sep 10 10:55:19.962036 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 661/3679] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:18 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1500 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:19.987472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e409c4a3-9960-4262-a20d-8b04dc2d6b2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:19.988810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e409c4a3-9960-4262-a20d-8b04dc2d6b2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:19.991717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:19.999946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e409c4a3-9960-4262-a20d-8b04dc2d6b2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:20.001604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e409c4a3-9960-4262-a20d-8b04dc2d6b2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:20.002354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e409c4a3-9960-4262-a20d-8b04dc2d6b2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:20.004293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e409c4a3-9960-4262-a20d-8b04dc2d6b2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:20.005357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e409c4a3-9960-4262-a20d-8b04dc2d6b2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:20.007140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e409c4a3-9960-4262-a20d-8b04dc2d6b2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:20.160581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:20.178289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:20.186579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:20.190669 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d49f5fa1-a063-4c20-8c14-0aea016e292b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.614805 Sep 10 10:55:20.194400 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3019/3680] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:18 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:55:20.805577 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.network.security_group_api [None req-e409c4a3-9960-4262-a20d-8b04dc2d6b2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Removing security group 3638c158-e177-4053-a733-77e2e55843f3 from port 2afd01b6-b544-4775-aa92-3d29b23ff0e8 Sep 10 10:55:21.287271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c14371e8-387d-4553-9bf8-8627f79ef8f2 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Action: 'create', calling method: .version_select at 0x7efcae747ee0>, body: {"pool": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:22.284253 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e409c4a3-9960-4262-a20d-8b04dc2d6b2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216/action" status: 202 len: 0 microversion: 2.1 time: 2.303323 Sep 10 10:55:22.285036 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 662/3681] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:55:19 2022] POST /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216/action => generated 0 bytes in 2305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:55:22.293680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:22.294796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:22.314225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:22.314747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:22.315203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:22.315976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:22.316418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:22.316841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:22.992792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:23.015270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:23.016803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:23.027162 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9e83aa2-3fb1-43f0-8700-5dd1e14c2e64 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.735890 Sep 10 10:55:23.027847 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 663/3682] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:22 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:23.048466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6a1f3e43-aebe-4099-b07b-b9863e146c4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:23.073876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6a1f3e43-aebe-4099-b07b-b9863e146c4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:23.093375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a1f3e43-aebe-4099-b07b-b9863e146c4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:23.093884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a1f3e43-aebe-4099-b07b-b9863e146c4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:23.094328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a1f3e43-aebe-4099-b07b-b9863e146c4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:23.101429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a1f3e43-aebe-4099-b07b-b9863e146c4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:23.102292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a1f3e43-aebe-4099-b07b-b9863e146c4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:23.104905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a1f3e43-aebe-4099-b07b-b9863e146c4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:23.355004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6a1f3e43-aebe-4099-b07b-b9863e146c4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:23.369634 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6a1f3e43-aebe-4099-b07b-b9863e146c4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1458 microversion: 2.1 time: 0.324941 Sep 10 10:55:23.382534 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 664/3683] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:23 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1458 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:23.406811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-267a3fdf-521d-4dad-ba18-1755023a7ae9 req-c259653c-c354-40b1-9321-cc55a1a98117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5310a126-b532-4a13-ae0b-c8c28404e216", "tag": "2afd01b6-b544-4775-aa92-3d29b23ff0e8"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:23.427058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-267a3fdf-521d-4dad-ba18-1755023a7ae9 req-c259653c-c354-40b1-9321-cc55a1a98117 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:23.431383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-267a3fdf-521d-4dad-ba18-1755023a7ae9 req-c259653c-c354-40b1-9321-cc55a1a98117 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:23.432130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-267a3fdf-521d-4dad-ba18-1755023a7ae9 req-c259653c-c354-40b1-9321-cc55a1a98117 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:23.458422 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-267a3fdf-521d-4dad-ba18-1755023a7ae9 req-c259653c-c354-40b1-9321-cc55a1a98117 service nova] Creating event network-changed:2afd01b6-b544-4775-aa92-3d29b23ff0e8 for instance 5310a126-b532-4a13-ae0b-c8c28404e216 on n-h2-856894-1 Sep 10 10:55:23.472595 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-267a3fdf-521d-4dad-ba18-1755023a7ae9 req-c259653c-c354-40b1-9321-cc55a1a98117 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081859 Sep 10 10:55:23.478262 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 665/3684] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:55:23.503066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-013dc783-a75b-4616-9a68-11ff9712f326 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:23.504119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-013dc783-a75b-4616-9a68-11ff9712f326 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:23.518951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-013dc783-a75b-4616-9a68-11ff9712f326 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:23.523328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-013dc783-a75b-4616-9a68-11ff9712f326 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:23.524041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-013dc783-a75b-4616-9a68-11ff9712f326 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:23.526436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-013dc783-a75b-4616-9a68-11ff9712f326 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:23.527212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-013dc783-a75b-4616-9a68-11ff9712f326 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:23.531451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-013dc783-a75b-4616-9a68-11ff9712f326 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:24.815856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-013dc783-a75b-4616-9a68-11ff9712f326 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:24.825060 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-013dc783-a75b-4616-9a68-11ff9712f326 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 1.345111 Sep 10 10:55:24.836195 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 666/3685] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:23 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:24.842634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:24.843512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:24.852833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:24.858296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:24.859026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:24.859942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:24.860552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:24.861200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:25.591048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:25.608191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:25.609690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:25.610876 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9b101104-1219-4eb6-b091-06aa81619d38 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.772649 Sep 10 10:55:25.621231 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 667/3686] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:24 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:25.796578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-38280c3b-f521-4bf5-9fb1-54ac67d7e6a1 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1910617690", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:25.801151 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-38280c3b-f521-4bf5-9fb1-54ac67d7e6a1 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] HTTP exception thrown: min_count must be <= max_count Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-38280c3b-f521-4bf5-9fb1-54ac67d7e6a1 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Request method failure captured: Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 184 Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG0c3GMsKwHw4T9UqR1qOu5jFCYU0UwXETZKcQUs9QLjxLnGOiKfjYfRdPTWV34xgbrq5DALrvtw1FS9240-RPhWLVMqug5Y20lGco_8GSU95W0i9rR_4JjxFuW53OLwEvODmWG67mst17PxZ2aAqpqwRiwdxINwU9p5gb94g40JP3o Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 449afbae397341f385a3f74ae6b36b27 Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_449afbae397341f385a3f74ae6b36b27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 449afbae397341f385a3f74ae6b36b27 Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-MultipleCreateNegativeTestJSON-1180529642-project Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 6f44f54140c949209634be05fbe4fd75 Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1180529642-project Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1910617690", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: exception: min_count must be <= max_count Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1910617690', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 10 10:55:25.802958 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:25.808173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-38280c3b-f521-4bf5-9fb1-54ac67d7e6a1 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Returning 400 to user: min_count must be <= max_count {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:55:25.809250 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-38280c3b-f521-4bf5-9fb1-54ac67d7e6a1 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.186755 Sep 10 10:55:25.810871 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 668/3687] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:55:25 2022] POST /compute/v2.1/servers => generated 74 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:55:25.815845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e29bdda6-7125-421c-9d07-faf7d6a38200 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:25.816645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e29bdda6-7125-421c-9d07-faf7d6a38200 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:25.836878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e29bdda6-7125-421c-9d07-faf7d6a38200 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:25.840334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e29bdda6-7125-421c-9d07-faf7d6a38200 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:25.843205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e29bdda6-7125-421c-9d07-faf7d6a38200 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:25.844156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e29bdda6-7125-421c-9d07-faf7d6a38200 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:25.844790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e29bdda6-7125-421c-9d07-faf7d6a38200 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:25.845421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e29bdda6-7125-421c-9d07-faf7d6a38200 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:26.910589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e29bdda6-7125-421c-9d07-faf7d6a38200 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:26.923541 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e29bdda6-7125-421c-9d07-faf7d6a38200 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 1.111268 Sep 10 10:55:26.938721 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 669/3688] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:25 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:26.965470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f742d16-860f-4d45-a8b1-67ff5768e83e tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-23313631", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "max_count": 0}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f742d16-860f-4d45-a8b1-67ff5768e83e tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Request method failure captured: Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 166 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG0c3GMsKwHw4T9UqR1qOu5jFCYU0UwXETZKcQUs9QLjxLnGOiKfjYfRdPTWV34xgbrq5DALrvtw1FS9240-RPhWLVMqug5Y20lGco_8GSU95W0i9rR_4JjxFuW53OLwEvODmWG67mst17PxZ2aAqpqwRiwdxINwU9p5gb94g40JP3o Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 449afbae397341f385a3f74ae6b36b27 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_449afbae397341f385a3f74ae6b36b27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 449afbae397341f385a3f74ae6b36b27 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-MultipleCreateNegativeTestJSON-1180529642-project Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 6f44f54140c949209634be05fbe4fd75 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1180529642-project Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-23313631", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "max_count": 0}} Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-23313631', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'max_count': 0}}} Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 0 Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:55:26.983995 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 10 10:55:26.988140 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:26.991220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f742d16-860f-4d45-a8b1-67ff5768e83e tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:55:26.992275 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7f742d16-860f-4d45-a8b1-67ff5768e83e tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.052443 Sep 10 10:55:27.003447 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 670/3689] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:55:26 2022] POST /compute/v2.1/servers => generated 130 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:55:27.009526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:27.010221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:27.018711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:27.019523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:27.020145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:27.021061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:27.021724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:27.022336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:27.540364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:27.560021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:27.562079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:27.566679 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-74f4817f-7935-40a7-9a5d-a19fe3ca0ec3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.560726 Sep 10 10:55:27.581827 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 671/3690] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:27 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:27.590983 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c14371e8-387d-4553-9bf8-8627f79ef8f2 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.569552 Sep 10 10:55:27.590983 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3020/3691] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:55:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:55:27.594608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ae833b15-856b-4ea8-80c8-51455fee0192 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:27.595348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-18a2a971-a3e0-4ac2-9bf5-7c1ed9de5e54 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1465323507", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "max_count": 2.5}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:27.595725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ae833b15-856b-4ea8-80c8-51455fee0192 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:27.603578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae833b15-856b-4ea8-80c8-51455fee0192 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:27.604335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae833b15-856b-4ea8-80c8-51455fee0192 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-18a2a971-a3e0-4ac2-9bf5-7c1ed9de5e54 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Request method failure captured: Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 170 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG0c3GMsKwHw4T9UqR1qOu5jFCYU0UwXETZKcQUs9QLjxLnGOiKfjYfRdPTWV34xgbrq5DALrvtw1FS9240-RPhWLVMqug5Y20lGco_8GSU95W0i9rR_4JjxFuW53OLwEvODmWG67mst17PxZ2aAqpqwRiwdxINwU9p5gb94g40JP3o Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 449afbae397341f385a3f74ae6b36b27 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_449afbae397341f385a3f74ae6b36b27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 449afbae397341f385a3f74ae6b36b27 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-MultipleCreateNegativeTestJSON-1180529642-project Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 6f44f54140c949209634be05fbe4fd75 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1180529642-project Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1465323507", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "max_count": 2.5}} Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1465323507', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'max_count': 2.5}}} Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 2.5 Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:55:27.604777 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-18a2a971-a3e0-4ac2-9bf5-7c1ed9de5e54 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-18a2a971-a3e0-4ac2-9bf5-7c1ed9de5e54 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015856 Sep 10 10:55:27.619704 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3021/3692] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:55:27 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:55:27.621928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae833b15-856b-4ea8-80c8-51455fee0192 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:27.622981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae833b15-856b-4ea8-80c8-51455fee0192 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:27.623614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae833b15-856b-4ea8-80c8-51455fee0192 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:27.624200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae833b15-856b-4ea8-80c8-51455fee0192 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:27.640233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-122b28b6-f5db-4a36-a988-8735ce8883ce tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Calling method '.version_select at 0x7efcae747670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:28.609007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=13 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:28.769548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ae833b15-856b-4ea8-80c8-51455fee0192 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:28.773689 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-122b28b6-f5db-4a36-a988-8735ce8883ce tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/cad3628d-63c4-4742-9b86-dc3886e1caab" status: 200 len: 142 microversion: 2.1 time: 1.164915 Sep 10 10:55:28.774983 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3022/3693] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:55:27 2022] GET /compute/v2.1/os-floating-ips/cad3628d-63c4-4742-9b86-dc3886e1caab => generated 142 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:55:28.780300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3cc4230b-4b61-44e1-b824-1dca5be32bd4 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1366128974", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 0}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:28.788437 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ae833b15-856b-4ea8-80c8-51455fee0192 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 1.205155 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3cc4230b-4b61-44e1-b824-1dca5be32bd4 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Request method failure captured: Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 168 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG0c3GMsKwHw4T9UqR1qOu5jFCYU0UwXETZKcQUs9QLjxLnGOiKfjYfRdPTWV34xgbrq5DALrvtw1FS9240-RPhWLVMqug5Y20lGco_8GSU95W0i9rR_4JjxFuW53OLwEvODmWG67mst17PxZ2aAqpqwRiwdxINwU9p5gb94g40JP3o Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 449afbae397341f385a3f74ae6b36b27 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_449afbae397341f385a3f74ae6b36b27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 449afbae397341f385a3f74ae6b36b27 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-MultipleCreateNegativeTestJSON-1180529642-project Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 6f44f54140c949209634be05fbe4fd75 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1180529642-project Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1366128974", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 0}} Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1366128974', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'min_count': 0}}} Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 0 Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:55:28.790260 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 10 10:55:28.795706 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:28.797841 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 672/3694] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:27 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:28.801574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3cc4230b-4b61-44e1-b824-1dca5be32bd4 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:55:28.802657 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3cc4230b-4b61-44e1-b824-1dca5be32bd4 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.026659 Sep 10 10:55:28.803553 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3023/3695] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:55:28 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:55:28.815091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-109b6e3c-c01e-42fe-956a-046c4e085b28 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Calling method '.version_select at 0x7efcae6c4040>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:28.832705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:28.833359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:28.846670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:28.847478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:28.848123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:28.849059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:28.849744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:28.852441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:29.353585 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-109b6e3c-c01e-42fe-956a-046c4e085b28 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.546720 Sep 10 10:55:29.354273 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3024/3696] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:55:28 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:55:29.359670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c584f583-27e4-445a-99f7-cc3a8e30db4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:29.360365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c584f583-27e4-445a-99f7-cc3a8e30db4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:29.372527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c584f583-27e4-445a-99f7-cc3a8e30db4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:29.373354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c584f583-27e4-445a-99f7-cc3a8e30db4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:29.373975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c584f583-27e4-445a-99f7-cc3a8e30db4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:29.374878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c584f583-27e4-445a-99f7-cc3a8e30db4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:29.377963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c584f583-27e4-445a-99f7-cc3a8e30db4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:29.378569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c584f583-27e4-445a-99f7-cc3a8e30db4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:29.379483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:29.390414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:29.392653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:29.394245 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-74424378-12d4-423d-9989-d0d98b222aa4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.593691 Sep 10 10:55:29.395051 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 673/3697] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:28 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:29.413728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0fae0ef0-6b6c-4604-8315-9d90f4eee703 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-327159077", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 2.5}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0fae0ef0-6b6c-4604-8315-9d90f4eee703 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Request method failure captured: Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 169 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG0c3GMsKwHw4T9UqR1qOu5jFCYU0UwXETZKcQUs9QLjxLnGOiKfjYfRdPTWV34xgbrq5DALrvtw1FS9240-RPhWLVMqug5Y20lGco_8GSU95W0i9rR_4JjxFuW53OLwEvODmWG67mst17PxZ2aAqpqwRiwdxINwU9p5gb94g40JP3o Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 449afbae397341f385a3f74ae6b36b27 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/449afbae397341f385a3f74ae6b36b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_449afbae397341f385a3f74ae6b36b27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 449afbae397341f385a3f74ae6b36b27 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1180529642 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-MultipleCreateNegativeTestJSON-1180529642-project Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 6f44f54140c949209634be05fbe4fd75 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1180529642-project Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-327159077", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 2.5}} Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-327159077', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'min_count': 2.5}}} Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 2.5 Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:55:29.418538 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 10:55:29.422436 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:29.425592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0fae0ef0-6b6c-4604-8315-9d90f4eee703 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:55:29.431175 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0fae0ef0-6b6c-4604-8315-9d90f4eee703 tempest-MultipleCreateNegativeTestJSON-1180529642 tempest-MultipleCreateNegativeTestJSON-1180529642-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034669 Sep 10 10:55:29.432040 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 674/3698] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:55:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:55:29.451663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f70c8ed9-3c23-4c89-bb7d-16249d5560e1 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Calling method '.version_select at 0x7efcaebc58b0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:29.820257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c584f583-27e4-445a-99f7-cc3a8e30db4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:29.832369 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c584f583-27e4-445a-99f7-cc3a8e30db4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.476774 Sep 10 10:55:29.834633 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3025/3699] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:29 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:30.043609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1674589029", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "17605326-3d0c-4135-8b61-c2da6b77cdca"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:30.147481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] validate_networks() for [('17605326-3d0c-4135-8b61-c2da6b77cdca', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:55:31.730084 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f70c8ed9-3c23-4c89-bb7d-16249d5560e1 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/cad3628d-63c4-4742-9b86-dc3886e1caab" status: 202 len: 0 microversion: 2.1 time: 2.296497 Sep 10 10:55:31.733537 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 675/3700] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:55:29 2022] DELETE /compute/v2.1/os-floating-ips/cad3628d-63c4-4742-9b86-dc3886e1caab => generated 0 bytes in 2300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:55:31.740863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:31.742494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:31.763991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:31.764903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:31.765547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:31.766424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:31.766897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:31.767325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:31.811670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:55:31.812135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:55:31.812567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:55:31.812982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:55:31.813594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:55:31.854347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:31.858268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:31.859028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:31.862290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:31.863880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:31.866287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:31.902737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:31.992659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for project 524c87c1679a4651a4e303650950283c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:55:31.999713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Getting quotas for user 2cccb6588d07459eb1cfa9c00f53f7e2 and project 524c87c1679a4651a4e303650950283c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:55:32.014739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:55:32.018811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:55:32.125896 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3eb7c8fb-83f4-43c5-9d2c-960e34b563c8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.086823 Sep 10 10:55:32.138064 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3026/3701] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:55:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:55:32.144135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:32.156140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:32.157817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:32.159787 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-00148baf-3691-4b61-b4b9-a9161444224c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.425072 Sep 10 10:55:32.160931 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 676/3702] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:31 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:32.166153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9eb59fc0-180a-411b-99ed-cfc8ba5c7d0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:32.167034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9eb59fc0-180a-411b-99ed-cfc8ba5c7d0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:32.181965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8655f377-886a-4256-a28f-70f0c7fb9ec5 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Action: 'create', calling method: .version_select at 0x7efcae747d30>, body: {"pool": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:32.248400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9eb59fc0-180a-411b-99ed-cfc8ba5c7d0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:32.256921 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9eb59fc0-180a-411b-99ed-cfc8ba5c7d0f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1215 microversion: 2.1 time: 0.094563 Sep 10 10:55:32.261586 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 677/3703] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:32 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:33.197524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:33.198184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:33.209386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:33.209877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:33.210312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:33.222641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:33.225752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:33.237198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:33.727085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:33.742399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:33.747060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:33.750481 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a127ea96-0b4a-4db0-99a7-bada04b25806 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.556799 Sep 10 10:55:33.752060 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 678/3704] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:33 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:55:33.762892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-19da9577-e983-4760-90d0-5daf8fc902f7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:33.765737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-19da9577-e983-4760-90d0-5daf8fc902f7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:33.877693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-19da9577-e983-4760-90d0-5daf8fc902f7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:33.887782 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-19da9577-e983-4760-90d0-5daf8fc902f7 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1215 microversion: 2.1 time: 0.130811 Sep 10 10:55:33.891538 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 679/3705] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:33 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:34.604107 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8655f377-886a-4256-a28f-70f0c7fb9ec5 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.463585 Sep 10 10:55:34.604938 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3027/3706] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:55:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:55:34.627527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94a876ba-0f46-4602-a92d-b7021677364f tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Calling method '.version_select at 0x7efcaebbb310>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:34.789331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:34.789953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:34.803053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:34.813045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:34.819610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:34.829425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:34.829847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:34.830292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:36.096764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:36.127196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:36.135062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:36.139412 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-afe8d921-b5ee-466d-b98d-9eb7a0f7eabf tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.356407 Sep 10 10:55:36.141218 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3028/3707] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:34 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:36.167291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6fd56a50-0bf6-4533-8d9b-9b7ebdc5b088 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:36.169048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6fd56a50-0bf6-4533-8d9b-9b7ebdc5b088 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:36.178797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd56a50-0bf6-4533-8d9b-9b7ebdc5b088 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:36.180453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd56a50-0bf6-4533-8d9b-9b7ebdc5b088 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:36.181146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd56a50-0bf6-4533-8d9b-9b7ebdc5b088 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:36.182059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd56a50-0bf6-4533-8d9b-9b7ebdc5b088 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:36.183136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd56a50-0bf6-4533-8d9b-9b7ebdc5b088 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:36.183778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fd56a50-0bf6-4533-8d9b-9b7ebdc5b088 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:36.484914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6fd56a50-0bf6-4533-8d9b-9b7ebdc5b088 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:36.526142 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6fd56a50-0bf6-4533-8d9b-9b7ebdc5b088 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1273 microversion: 2.1 time: 0.383423 Sep 10 10:55:36.530988 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3029/3708] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:36 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1273 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:37.172032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:37.172968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:37.198005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:37.201792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:37.202328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:37.209225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:37.209868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:37.213834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:38.184149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:38.201970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:38.203507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:38.208808 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d9fc3c4-1912-43c3-ae6d-8f8dcfc290de tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.037364 Sep 10 10:55:38.241183 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3030/3709] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:37 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:55:38.259225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d68d20a5-b75b-4d8c-b4d1-04d8e854b949 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:38.259860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d68d20a5-b75b-4d8c-b4d1-04d8e854b949 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:38.270143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68d20a5-b75b-4d8c-b4d1-04d8e854b949 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:38.270640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68d20a5-b75b-4d8c-b4d1-04d8e854b949 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:38.271075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68d20a5-b75b-4d8c-b4d1-04d8e854b949 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:38.271785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68d20a5-b75b-4d8c-b4d1-04d8e854b949 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:38.272240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68d20a5-b75b-4d8c-b4d1-04d8e854b949 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:38.272664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d68d20a5-b75b-4d8c-b4d1-04d8e854b949 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:38.496500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d68d20a5-b75b-4d8c-b4d1-04d8e854b949 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:38.511668 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d68d20a5-b75b-4d8c-b4d1-04d8e854b949 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1273 microversion: 2.1 time: 0.264191 Sep 10 10:55:38.522404 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3031/3710] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:38 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:38.659013 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-94a876ba-0f46-4602-a92d-b7021677364f tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/a2a88e44-a4d2-4efb-8678-69d2f41669a2" status: 202 len: 0 microversion: 2.1 time: 4.044120 Sep 10 10:55:38.661149 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 680/3711] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:55:34 2022] DELETE /compute/v2.1/os-floating-ips/a2a88e44-a4d2-4efb-8678-69d2f41669a2 => generated 0 bytes in 4047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:55:38.667758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc2f42ba-748b-427b-9707-9f5407352d36 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Calling method '.version_select at 0x7efcae2844c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:38.985900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-cc2f42ba-748b-427b-9707-9f5407352d36 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a2a88e44-a4d2-4efb-8678-69d2f41669a2 could not be found", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:55:38.986654 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-cc2f42ba-748b-427b-9707-9f5407352d36 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] HTTP exception thrown: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc2f42ba-748b-427b-9707-9f5407352d36 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Request method failure captured: Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-floating-ips/a2a88e44-a4d2-4efb-8678-69d2f41669a2 HTTP/1.1 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG0YwkMgbHKnSgB95v9VU3Ku4xUwBCa_4iMexxfbuyZGbDT_wy16v4RKbUoXgEy7bBh74NIW-YYYkyR_L58QR8L4zicO_LFXb2QweALA7p0TTadg4zQLad49Db-PDetR62e7EGqLWm_rcgu7KXqZ3cf4V--V5foQ3e2Ys4_WgmhqelI Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: dd34566d57754c2196de5374be08e290 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FloatingIPsTestJSON-599633451 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd34566d57754c2196de5374be08e290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dd34566d57754c2196de5374be08e290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd34566d57754c2196de5374be08e290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dd34566d57754c2196de5374be08e290", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FloatingIPsTestJSON-599633451 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: dd34566d57754c2196de5374be08e290 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FloatingIPsTestJSON-599633451 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FloatingIPsTestJSON-599633451-project Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 9bc5c0c4c57945c4822d32dd0d7f52e1 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FloatingIPsTestJSON-599633451-project Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: exception: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'a2a88e44-a4d2-4efb-8678-69d2f41669a2'} Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a2a88e44-a4d2-4efb-8678-69d2f41669a2 could not be found Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c641e6c-2544-48f6-a91f-ec1b19fcf11a'] Sep 10 10:55:38.988546 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2. Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2 Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2 Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc2f42ba-748b-427b-9707-9f5407352d36 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Returning 404 to user: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2 {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:55:38.993794 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cc2f42ba-748b-427b-9707-9f5407352d36 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/a2a88e44-a4d2-4efb-8678-69d2f41669a2" status: 404 len: 111 microversion: 2.1 time: 0.326315 Sep 10 10:55:38.997035 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3032/3712] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:55:38 2022] GET /compute/v2.1/os-floating-ips/a2a88e44-a4d2-4efb-8678-69d2f41669a2 => generated 111 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:55:39.001638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e56961fb-0bce-4897-a233-ac959c4a38b0 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Calling method '.version_select at 0x7efcaebc5280>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:39.243646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:39.244267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:39.272825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:39.273355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:39.273793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:39.274497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:39.274953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:39.275378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:39.319718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG neutronclient.v2_0.client [None req-e56961fb-0bce-4897-a233-ac959c4a38b0 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a2a88e44-a4d2-4efb-8678-69d2f41669a2 could not be found", "detail": ""}} {{(pid=128787) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:55:39.320535 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-e56961fb-0bce-4897-a233-ac959c4a38b0 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] HTTP exception thrown: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e56961fb-0bce-4897-a233-ac959c4a38b0 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Request method failure captured: Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/os-floating-ips/a2a88e44-a4d2-4efb-8678-69d2f41669a2 HTTP/1.1 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG0YwkMgbHKnSgB95v9VU3Ku4xUwBCa_4iMexxfbuyZGbDT_wy16v4RKbUoXgEy7bBh74NIW-YYYkyR_L58QR8L4zicO_LFXb2QweALA7p0TTadg4zQLad49Db-PDetR62e7EGqLWm_rcgu7KXqZ3cf4V--V5foQ3e2Ys4_WgmhqelI Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: dd34566d57754c2196de5374be08e290 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FloatingIPsTestJSON-599633451 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd34566d57754c2196de5374be08e290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dd34566d57754c2196de5374be08e290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dd34566d57754c2196de5374be08e290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dd34566d57754c2196de5374be08e290", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FloatingIPsTestJSON-599633451 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: dd34566d57754c2196de5374be08e290 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FloatingIPsTestJSON-599633451 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FloatingIPsTestJSON-599633451-project Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 9bc5c0c4c57945c4822d32dd0d7f52e1 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FloatingIPsTestJSON-599633451-project Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: exception: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'a2a88e44-a4d2-4efb-8678-69d2f41669a2'} Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a2a88e44-a4d2-4efb-8678-69d2f41669a2 could not be found Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27e9c98c-848b-4dec-b6f0-ba1c0cd1845b'] Sep 10 10:55:39.322777 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2. Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2 Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2 Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e56961fb-0bce-4897-a233-ac959c4a38b0 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] Returning 404 to user: Floating IP not found for ID a2a88e44-a4d2-4efb-8678-69d2f41669a2 {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:55:39.327501 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e56961fb-0bce-4897-a233-ac959c4a38b0 tempest-FloatingIPsTestJSON-599633451 tempest-FloatingIPsTestJSON-599633451-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/a2a88e44-a4d2-4efb-8678-69d2f41669a2" status: 404 len: 111 microversion: 2.1 time: 0.330612 Sep 10 10:55:39.332716 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 681/3713] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:55:38 2022] DELETE /compute/v2.1/os-floating-ips/a2a88e44-a4d2-4efb-8678-69d2f41669a2 => generated 111 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:55:39.540140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f3dc6392-87c6-4045-b5f9-b7cf471057c9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:39.541304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f3dc6392-87c6-4045-b5f9-b7cf471057c9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:39.553016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3dc6392-87c6-4045-b5f9-b7cf471057c9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:39.561626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3dc6392-87c6-4045-b5f9-b7cf471057c9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:39.564229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3dc6392-87c6-4045-b5f9-b7cf471057c9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:39.566028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3dc6392-87c6-4045-b5f9-b7cf471057c9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:39.569087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3dc6392-87c6-4045-b5f9-b7cf471057c9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:39.569661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3dc6392-87c6-4045-b5f9-b7cf471057c9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:39.644021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:40.266589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f3dc6392-87c6-4045-b5f9-b7cf471057c9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:40.275309 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f3dc6392-87c6-4045-b5f9-b7cf471057c9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 0.742645 Sep 10 10:55:40.279135 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 682/3714] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:39 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:55:40.358191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:40.377484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:40.385214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:40.386746 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5000ddc1-a0c4-4a12-8143-39ebe1488659 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.148090 Sep 10 10:55:40.392147 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3033/3715] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:39 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:41.304788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7b6ab1cf-0f8b-4686-bbf0-91a2dfbe4150 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:41.305825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7b6ab1cf-0f8b-4686-bbf0-91a2dfbe4150 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:41.321441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b6ab1cf-0f8b-4686-bbf0-91a2dfbe4150 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:41.322329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b6ab1cf-0f8b-4686-bbf0-91a2dfbe4150 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:41.323110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b6ab1cf-0f8b-4686-bbf0-91a2dfbe4150 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:41.339945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b6ab1cf-0f8b-4686-bbf0-91a2dfbe4150 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:41.345573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b6ab1cf-0f8b-4686-bbf0-91a2dfbe4150 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:41.347452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b6ab1cf-0f8b-4686-bbf0-91a2dfbe4150 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:41.423947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:41.425561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:41.433705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:41.435245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:41.435917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:41.436780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:41.437529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:41.438258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:41.905460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:42.009813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:42.232144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7b6ab1cf-0f8b-4686-bbf0-91a2dfbe4150 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:42.237127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:42.253898 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7b6ab1cf-0f8b-4686-bbf0-91a2dfbe4150 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 0.953203 Sep 10 10:55:42.254517 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 683/3716] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:41 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:55:42.257367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:42.260125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:42.263833 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dff0e3b4-7a3e-4d2e-892b-0e0a18bc10c4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.846507 Sep 10 10:55:42.266741 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3034/3717] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:41 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:43.277996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-25d4fd62-fa39-4fe5-935a-c5c47e5019b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:43.279243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-25d4fd62-fa39-4fe5-935a-c5c47e5019b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:43.295331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:43.296156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:43.315123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25d4fd62-fa39-4fe5-935a-c5c47e5019b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:43.316981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:43.317223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25d4fd62-fa39-4fe5-935a-c5c47e5019b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:43.319544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25d4fd62-fa39-4fe5-935a-c5c47e5019b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:43.320321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25d4fd62-fa39-4fe5-935a-c5c47e5019b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:43.320794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25d4fd62-fa39-4fe5-935a-c5c47e5019b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:43.330560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25d4fd62-fa39-4fe5-935a-c5c47e5019b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:43.330768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:43.330768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:43.330768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:43.330768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:43.330768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:43.886042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:44.944959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-25d4fd62-fa39-4fe5-935a-c5c47e5019b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:44.973851 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-25d4fd62-fa39-4fe5-935a-c5c47e5019b2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 1.699491 Sep 10 10:55:44.978568 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 684/3718] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:43 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:45.114333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-eb72b931-681c-49f7-bcf2-e5fe4b1ac94d req-38afd2b4-1645-44f2-a8fe-1e4b5cb240f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f28c4d-0eff-48f6-8fc0-51f95a07d38e", "tag": "0b358bb6-e978-4218-93e3-25b76d5933d4"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:45.147478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eb72b931-681c-49f7-bcf2-e5fe4b1ac94d req-38afd2b4-1645-44f2-a8fe-1e4b5cb240f0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:45.152142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eb72b931-681c-49f7-bcf2-e5fe4b1ac94d req-38afd2b4-1645-44f2-a8fe-1e4b5cb240f0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:45.154612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eb72b931-681c-49f7-bcf2-e5fe4b1ac94d req-38afd2b4-1645-44f2-a8fe-1e4b5cb240f0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:45.214002 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-eb72b931-681c-49f7-bcf2-e5fe4b1ac94d req-38afd2b4-1645-44f2-a8fe-1e4b5cb240f0 service nova] Creating event network-changed:0b358bb6-e978-4218-93e3-25b76d5933d4 for instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e on n-h2-856894-1 Sep 10 10:55:45.232297 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-eb72b931-681c-49f7-bcf2-e5fe4b1ac94d req-38afd2b4-1645-44f2-a8fe-1e4b5cb240f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122661 Sep 10 10:55:45.236168 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 685/3719] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:55:45.415979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:45.435591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:45.438036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:45.439620 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2ff83f38-7284-4b5a-811f-cb390d8a7952 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 2.148782 Sep 10 10:55:45.446135 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3035/3720] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:43 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:46.003626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1f1bccd0-a07a-4c8f-91be-051494c472ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:46.004659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1f1bccd0-a07a-4c8f-91be-051494c472ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:46.039572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f1bccd0-a07a-4c8f-91be-051494c472ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:46.040124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f1bccd0-a07a-4c8f-91be-051494c472ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:46.040672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f1bccd0-a07a-4c8f-91be-051494c472ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:46.041443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f1bccd0-a07a-4c8f-91be-051494c472ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:46.045921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f1bccd0-a07a-4c8f-91be-051494c472ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:46.046653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f1bccd0-a07a-4c8f-91be-051494c472ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:46.504906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:46.506400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:46.522157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:46.523174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:46.524135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:46.525414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:46.526304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:46.526933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:47.422837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1f1bccd0-a07a-4c8f-91be-051494c472ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:47.437585 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1f1bccd0-a07a-4c8f-91be-051494c472ab tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 1.439928 Sep 10 10:55:47.439872 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 686/3721] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:45 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:47.957652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:47.973262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:47.984476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:47.987118 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de9a11fa-3b19-4f2c-95a9-1213bd073ab4 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.515933 Sep 10 10:55:48.002108 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3036/3722] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:46 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:55:48.475962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f0d542cb-25f7-4795-9021-315ac3f15cdf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:48.476600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f0d542cb-25f7-4795-9021-315ac3f15cdf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:48.492937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d542cb-25f7-4795-9021-315ac3f15cdf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:48.493689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d542cb-25f7-4795-9021-315ac3f15cdf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:48.494299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d542cb-25f7-4795-9021-315ac3f15cdf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:48.495463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d542cb-25f7-4795-9021-315ac3f15cdf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:48.496086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d542cb-25f7-4795-9021-315ac3f15cdf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:48.496707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d542cb-25f7-4795-9021-315ac3f15cdf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:48.978315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f0d542cb-25f7-4795-9021-315ac3f15cdf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:48.994032 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f0d542cb-25f7-4795-9021-315ac3f15cdf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 0.521802 Sep 10 10:55:48.994919 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 687/3723] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:48 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:49.013864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:49.014576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:49.021562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:49.026958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:49.029212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:49.032145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:49.032782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:49.034517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:50.018717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ad728e36-61d8-444e-8b54-1d03c1da5442 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:50.020917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ad728e36-61d8-444e-8b54-1d03c1da5442 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:50.036640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad728e36-61d8-444e-8b54-1d03c1da5442 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:50.037176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad728e36-61d8-444e-8b54-1d03c1da5442 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:50.037625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad728e36-61d8-444e-8b54-1d03c1da5442 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:50.038338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad728e36-61d8-444e-8b54-1d03c1da5442 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:50.038799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad728e36-61d8-444e-8b54-1d03c1da5442 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:50.039235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad728e36-61d8-444e-8b54-1d03c1da5442 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:50.380939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:50.393313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:50.396041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:50.399036 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8891bee-55d4-426e-a2b1-53b499d30c1b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.388512 Sep 10 10:55:50.400340 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3037/3724] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:49 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:50.722537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ad728e36-61d8-444e-8b54-1d03c1da5442 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:50.732771 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ad728e36-61d8-444e-8b54-1d03c1da5442 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 0.717938 Sep 10 10:55:50.753098 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 688/3725] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:50 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:51.436859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:51.437646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:51.458148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:51.459935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:51.462668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:51.465019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:51.465622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:51.466080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:52.101880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:52.124104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:52.138912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:52.140238 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a802e190-7a7e-4320-b740-35375c638da3 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.708904 Sep 10 10:55:52.165639 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3038/3726] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:51 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:52.165639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c4d41384-094c-49c5-a39f-296d5048808f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:52.165639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4d41384-094c-49c5-a39f-296d5048808f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:52.184704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-63822829", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:55:52.199643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4d41384-094c-49c5-a39f-296d5048808f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:52.200706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4d41384-094c-49c5-a39f-296d5048808f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:52.207088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=46 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:52.209738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4d41384-094c-49c5-a39f-296d5048808f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:52.210684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4d41384-094c-49c5-a39f-296d5048808f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:52.211181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4d41384-094c-49c5-a39f-296d5048808f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:52.217843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4d41384-094c-49c5-a39f-296d5048808f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:52.317813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] validate_networks() for [('5965e34a-c1b4-44c0-8b96-d4d7d1a762c7', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:55:53.267697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c4d41384-094c-49c5-a39f-296d5048808f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:53.280897 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c4d41384-094c-49c5-a39f-296d5048808f tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 1.131287 Sep 10 10:55:53.282514 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3039/3727] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:52 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:53.299164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:53.300161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:53.306707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:53.307526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:53.313533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:53.316062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:53.316666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:53.317270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:54.602154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:54.623141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:54.628751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:54.641004 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fa49bfc8-5dbc-4d0a-b331-a525cbf7f14f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.355799 Sep 10 10:55:54.654254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:55:54.654254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:55:54.654254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:55:54.654254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:55:54.654254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:55:54.665241 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3040/3728] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:53 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:54.682026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfd361e9-7dde-4eee-a123-59d7ee163157 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:54.682968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfd361e9-7dde-4eee-a123-59d7ee163157 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:54.700918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd361e9-7dde-4eee-a123-59d7ee163157 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:54.704866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:54.705564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:54.706008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd361e9-7dde-4eee-a123-59d7ee163157 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:54.706125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:54.706853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:54.707306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:54.708396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd361e9-7dde-4eee-a123-59d7ee163157 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:54.711578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd361e9-7dde-4eee-a123-59d7ee163157 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:54.712339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd361e9-7dde-4eee-a123-59d7ee163157 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:54.713017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfd361e9-7dde-4eee-a123-59d7ee163157 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:54.716240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:54.783950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Getting quotas for project 37f51916719346ba88aa44e3cae5bb9e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:55:54.799523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Getting quotas for user 608cf43f926c48fa9bd302ecc6ef79d3 and project 37f51916719346ba88aa44e3cae5bb9e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:55:54.859525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:55:54.862319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:55:54.958235 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-86f0c960-6e4f-41e3-a271-e0cb5188cef3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.400797 Sep 10 10:55:54.966664 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 689/3729] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:55:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:55:54.974902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f6b06951-bebf-4064-8436-fdd1b03955ce tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:54.976707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f6b06951-bebf-4064-8436-fdd1b03955ce tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:55.175149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f6b06951-bebf-4064-8436-fdd1b03955ce tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:55.182493 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f6b06951-bebf-4064-8436-fdd1b03955ce tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1215 microversion: 2.1 time: 0.213416 Sep 10 10:55:55.186494 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 690/3730] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:54 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:55.548038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfd361e9-7dde-4eee-a123-59d7ee163157 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:55.563879 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfd361e9-7dde-4eee-a123-59d7ee163157 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 0.896133 Sep 10 10:55:55.564492 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3041/3731] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:54 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:55.671963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:55.672801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:55.693876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:55.695937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:55.696587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:55.701916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:55.704845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:55.705646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:56.076343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:56.108133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:56.113829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:56.115816 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7c85f34a-fae1-4972-b014-459c24bb30d0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.447923 Sep 10 10:55:56.117779 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 691/3732] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:55 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:56.210886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e192793-e817-4a1d-8b20-51ede41e0b2e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:56.211661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e192793-e817-4a1d-8b20-51ede41e0b2e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:56.224788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e192793-e817-4a1d-8b20-51ede41e0b2e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:56.226758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e192793-e817-4a1d-8b20-51ede41e0b2e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:56.227861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e192793-e817-4a1d-8b20-51ede41e0b2e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:56.230741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e192793-e817-4a1d-8b20-51ede41e0b2e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:56.232119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e192793-e817-4a1d-8b20-51ede41e0b2e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:56.235186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e192793-e817-4a1d-8b20-51ede41e0b2e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:56.594006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ce6f4df4-66ce-4a8e-bc60-4caa6dbf15b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:56.595379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ce6f4df4-66ce-4a8e-bc60-4caa6dbf15b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:56.608078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce6f4df4-66ce-4a8e-bc60-4caa6dbf15b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:56.608755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce6f4df4-66ce-4a8e-bc60-4caa6dbf15b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:56.610539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce6f4df4-66ce-4a8e-bc60-4caa6dbf15b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:56.612605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce6f4df4-66ce-4a8e-bc60-4caa6dbf15b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:56.614676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce6f4df4-66ce-4a8e-bc60-4caa6dbf15b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:56.615359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce6f4df4-66ce-4a8e-bc60-4caa6dbf15b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:56.647088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e192793-e817-4a1d-8b20-51ede41e0b2e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:56.658424 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e192793-e817-4a1d-8b20-51ede41e0b2e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1219 microversion: 2.1 time: 0.451270 Sep 10 10:55:56.664192 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3042/3733] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:56 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1219 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:57.114808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ce6f4df4-66ce-4a8e-bc60-4caa6dbf15b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:57.123312 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ce6f4df4-66ce-4a8e-bc60-4caa6dbf15b1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 0.534928 Sep 10 10:55:57.130413 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 692/3734] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:56 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:55:57.146968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:57.148751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:57.159226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:57.159746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:57.164091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:57.164877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:57.165402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:57.168515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:57.699866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b809b691-7b74-4704-a2c8-098755ab7bc0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:57.700631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b809b691-7b74-4704-a2c8-098755ab7bc0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:57.703329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:57.732826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b809b691-7b74-4704-a2c8-098755ab7bc0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:57.736825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b809b691-7b74-4704-a2c8-098755ab7bc0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:57.738615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:57.743871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:57.748378 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e6c639a-0836-4123-9c98-32e314e162d1 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.605962 Sep 10 10:55:57.749418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b809b691-7b74-4704-a2c8-098755ab7bc0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:57.750194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b809b691-7b74-4704-a2c8-098755ab7bc0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:57.750678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b809b691-7b74-4704-a2c8-098755ab7bc0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:57.751767 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3043/3735] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:57 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:55:57.758816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b809b691-7b74-4704-a2c8-098755ab7bc0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:57.923369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b809b691-7b74-4704-a2c8-098755ab7bc0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:57.952948 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b809b691-7b74-4704-a2c8-098755ab7bc0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1275 microversion: 2.1 time: 0.262423 Sep 10 10:55:57.953619 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 693/3736] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:57 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1275 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:55:58.154360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19bb3b78-a7e4-4c9d-8a6a-53fcf64e508b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:58.155506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-19bb3b78-a7e4-4c9d-8a6a-53fcf64e508b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:58.166521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bb3b78-a7e4-4c9d-8a6a-53fcf64e508b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:58.174280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bb3b78-a7e4-4c9d-8a6a-53fcf64e508b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:58.174927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bb3b78-a7e4-4c9d-8a6a-53fcf64e508b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:58.176560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bb3b78-a7e4-4c9d-8a6a-53fcf64e508b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:58.177305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bb3b78-a7e4-4c9d-8a6a-53fcf64e508b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:58.178076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19bb3b78-a7e4-4c9d-8a6a-53fcf64e508b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:58.579655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19bb3b78-a7e4-4c9d-8a6a-53fcf64e508b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:58.587952 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-19bb3b78-a7e4-4c9d-8a6a-53fcf64e508b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 0.438490 Sep 10 10:55:58.617460 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3044/3737] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:58 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:55:58.781481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:58.782108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:58.819155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:58.819652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:58.820092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:58.820799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:58.829473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:58.830542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:58.980313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b337fb1-75fe-4631-9e87-ffec667c038d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:58.982170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9b337fb1-75fe-4631-9e87-ffec667c038d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:59.002302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:59.004799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b337fb1-75fe-4631-9e87-ffec667c038d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:59.005692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b337fb1-75fe-4631-9e87-ffec667c038d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:59.008263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b337fb1-75fe-4631-9e87-ffec667c038d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:59.008263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b337fb1-75fe-4631-9e87-ffec667c038d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:59.010117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b337fb1-75fe-4631-9e87-ffec667c038d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:59.018690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b337fb1-75fe-4631-9e87-ffec667c038d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:59.074875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:55:59.548841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9b337fb1-75fe-4631-9e87-ffec667c038d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:59.562448 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9b337fb1-75fe-4631-9e87-ffec667c038d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1273 microversion: 2.1 time: 0.585984 Sep 10 10:55:59.568040 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3045/3738] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:58 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1273 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:55:59.620876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9de14f52-1d01-4d34-9a3b-c235e0342ce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:55:59.623411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9de14f52-1d01-4d34-9a3b-c235e0342ce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:55:59.633676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9de14f52-1d01-4d34-9a3b-c235e0342ce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:59.634589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9de14f52-1d01-4d34-9a3b-c235e0342ce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:59.635308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9de14f52-1d01-4d34-9a3b-c235e0342ce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:59.636505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9de14f52-1d01-4d34-9a3b-c235e0342ce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:55:59.637815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9de14f52-1d01-4d34-9a3b-c235e0342ce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:55:59.638628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9de14f52-1d01-4d34-9a3b-c235e0342ce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:55:59.825202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:59.844757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:59.854756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:55:59.857525 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5dc55ca9-7772-4782-9866-14b36381aaa2 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.080908 Sep 10 10:55:59.878162 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 694/3739] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:55:58 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:56:00.520006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9de14f52-1d01-4d34-9a3b-c235e0342ce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:00.535361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9de14f52-1d01-4d34-9a3b-c235e0342ce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 0.923712 Sep 10 10:56:00.558024 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3046/3740] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:55:59 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:00.597455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b5f35504-e023-4ebe-8ed1-eff4738f67d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:00.597937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b5f35504-e023-4ebe-8ed1-eff4738f67d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:00.607161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5f35504-e023-4ebe-8ed1-eff4738f67d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:00.618093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5f35504-e023-4ebe-8ed1-eff4738f67d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:00.618666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5f35504-e023-4ebe-8ed1-eff4738f67d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:00.619431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5f35504-e023-4ebe-8ed1-eff4738f67d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:00.624534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5f35504-e023-4ebe-8ed1-eff4738f67d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:00.625308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5f35504-e023-4ebe-8ed1-eff4738f67d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:00.901466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:00.904195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:00.922435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:00.923579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:00.924017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:00.924776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:00.925299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:00.933342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:01.871242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b5f35504-e023-4ebe-8ed1-eff4738f67d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:01.879922 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b5f35504-e023-4ebe-8ed1-eff4738f67d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1315 microversion: 2.1 time: 1.287930 Sep 10 10:56:01.887872 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 695/3741] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:00 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1315 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:01.902060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6b0fbb11-26d9-44b9-b96b-0f2b499ebce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:01.905796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6b0fbb11-26d9-44b9-b96b-0f2b499ebce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:01.924089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb11-26d9-44b9-b96b-0f2b499ebce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:01.926713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb11-26d9-44b9-b96b-0f2b499ebce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:01.928039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb11-26d9-44b9-b96b-0f2b499ebce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:01.939642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb11-26d9-44b9-b96b-0f2b499ebce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:01.940380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb11-26d9-44b9-b96b-0f2b499ebce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:01.943391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b0fbb11-26d9-44b9-b96b-0f2b499ebce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:02.546073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:02.561970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:02.563721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:02.572193 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9cd9cd87-084e-4b1b-a085-7cd0baea9201 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.672964 Sep 10 10:56:02.598111 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3047/3742] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:56:00 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:56:02.915689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-105563f5-c996-4262-9535-649f7877bb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:02.916441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-105563f5-c996-4262-9535-649f7877bb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:02.931286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-105563f5-c996-4262-9535-649f7877bb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:02.940791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-105563f5-c996-4262-9535-649f7877bb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:02.941443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-105563f5-c996-4262-9535-649f7877bb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:02.942494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-105563f5-c996-4262-9535-649f7877bb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:02.946669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-105563f5-c996-4262-9535-649f7877bb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:02.947258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-105563f5-c996-4262-9535-649f7877bb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:02.979494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6b0fbb11-26d9-44b9-b96b-0f2b499ebce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:02.993711 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6b0fbb11-26d9-44b9-b96b-0f2b499ebce9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 1.102269 Sep 10 10:56:02.999828 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 696/3743] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:01 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:03.603341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:03.605903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:03.615221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:03.630065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:03.634041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:03.640837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:03.641790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:03.643625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:04.058078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-105563f5-c996-4262-9535-649f7877bb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:04.072689 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-105563f5-c996-4262-9535-649f7877bb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1315 microversion: 2.1 time: 1.162235 Sep 10 10:56:04.075294 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3048/3744] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:02 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1315 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:04.084373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff581b31-a836-4564-8a9d-bb6dbf36aaa3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:04.085798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff581b31-a836-4564-8a9d-bb6dbf36aaa3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:04.094590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff581b31-a836-4564-8a9d-bb6dbf36aaa3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:04.095456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff581b31-a836-4564-8a9d-bb6dbf36aaa3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:04.096359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff581b31-a836-4564-8a9d-bb6dbf36aaa3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:04.097358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff581b31-a836-4564-8a9d-bb6dbf36aaa3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:04.098044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff581b31-a836-4564-8a9d-bb6dbf36aaa3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:04.098950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff581b31-a836-4564-8a9d-bb6dbf36aaa3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:04.755067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:05.036529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:05.058151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:05.060278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:05.061728 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b1f366a3-1efb-4a7f-8db3-e0f037e31e48 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.462666 Sep 10 10:56:05.065197 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 697/3745] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:56:03 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:56:05.070635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-4eded7c4-aaaa-48d4-b7bd-daa8ee81ea5a req-eb4994e6-d280-4ec8-b824-a4b46b96aeae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-plugged", "status": "completed", "tag": "2e99224d-0501-467d-80fb-e947a4f8ae28"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:05.081950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4eded7c4-aaaa-48d4-b7bd-daa8ee81ea5a req-eb4994e6-d280-4ec8-b824-a4b46b96aeae service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:05.082590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4eded7c4-aaaa-48d4-b7bd-daa8ee81ea5a req-eb4994e6-d280-4ec8-b824-a4b46b96aeae service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:05.094705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4eded7c4-aaaa-48d4-b7bd-daa8ee81ea5a req-eb4994e6-d280-4ec8-b824-a4b46b96aeae service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:05.110474 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-4eded7c4-aaaa-48d4-b7bd-daa8ee81ea5a req-eb4994e6-d280-4ec8-b824-a4b46b96aeae service nova] Creating event network-vif-plugged:2e99224d-0501-467d-80fb-e947a4f8ae28 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:56:05.116010 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-4eded7c4-aaaa-48d4-b7bd-daa8ee81ea5a req-eb4994e6-d280-4ec8-b824-a4b46b96aeae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049374 Sep 10 10:56:05.116623 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 698/3746] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:05.123088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-f12211c3-8fd0-4985-88b4-5f2bca165c27 req-00a1e3e5-f7c2-4a81-8c91-5b082c54cf2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1fff5af-b5bc-4a39-a5a3-81c17a2b397b", "tag": "fdf28f35-cdeb-4bbe-a940-e39781700167"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:05.133702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f12211c3-8fd0-4985-88b4-5f2bca165c27 req-00a1e3e5-f7c2-4a81-8c91-5b082c54cf2a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:05.134458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f12211c3-8fd0-4985-88b4-5f2bca165c27 req-00a1e3e5-f7c2-4a81-8c91-5b082c54cf2a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:05.135057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f12211c3-8fd0-4985-88b4-5f2bca165c27 req-00a1e3e5-f7c2-4a81-8c91-5b082c54cf2a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:05.151674 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-f12211c3-8fd0-4985-88b4-5f2bca165c27 req-00a1e3e5-f7c2-4a81-8c91-5b082c54cf2a service nova] Creating event network-changed:fdf28f35-cdeb-4bbe-a940-e39781700167 for instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b on n-h2-856894-1 Sep 10 10:56:05.163636 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-f12211c3-8fd0-4985-88b4-5f2bca165c27 req-00a1e3e5-f7c2-4a81-8c91-5b082c54cf2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041127 Sep 10 10:56:05.165165 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 699/3747] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:05.172987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7a73c4ff-cf9e-4c26-bbeb-a6d0169e20ae tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:05.173953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7a73c4ff-cf9e-4c26-bbeb-a6d0169e20ae tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:05.182221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:05.184243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a73c4ff-cf9e-4c26-bbeb-a6d0169e20ae tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:05.185122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a73c4ff-cf9e-4c26-bbeb-a6d0169e20ae tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:05.185856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a73c4ff-cf9e-4c26-bbeb-a6d0169e20ae tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:05.187201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a73c4ff-cf9e-4c26-bbeb-a6d0169e20ae tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:05.188000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a73c4ff-cf9e-4c26-bbeb-a6d0169e20ae tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:05.189726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a73c4ff-cf9e-4c26-bbeb-a6d0169e20ae tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:05.560365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff581b31-a836-4564-8a9d-bb6dbf36aaa3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:05.574871 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff581b31-a836-4564-8a9d-bb6dbf36aaa3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 1.493607 Sep 10 10:56:05.575553 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3049/3748] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:04 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:05.708543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7a73c4ff-cf9e-4c26-bbeb-a6d0169e20ae tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:05.721002 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7a73c4ff-cf9e-4c26-bbeb-a6d0169e20ae tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1315 microversion: 2.1 time: 0.552725 Sep 10 10:56:05.723641 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 700/3749] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:05 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:06.091472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:06.092350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:06.103028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:06.105266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:06.107718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:06.108644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:06.109293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:06.110846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:06.600481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9a3f00be-b4ef-43ea-8ea0-65493f97d03a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:06.601125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9a3f00be-b4ef-43ea-8ea0-65493f97d03a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:06.612249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a3f00be-b4ef-43ea-8ea0-65493f97d03a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:06.612758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a3f00be-b4ef-43ea-8ea0-65493f97d03a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:06.613207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a3f00be-b4ef-43ea-8ea0-65493f97d03a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:06.613932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a3f00be-b4ef-43ea-8ea0-65493f97d03a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:06.614347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a3f00be-b4ef-43ea-8ea0-65493f97d03a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:06.619004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a3f00be-b4ef-43ea-8ea0-65493f97d03a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:07.467032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9a3f00be-b4ef-43ea-8ea0-65493f97d03a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:07.482098 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9a3f00be-b4ef-43ea-8ea0-65493f97d03a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 0.887739 Sep 10 10:56:07.484885 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 701/3750] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:06 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:07.490371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-977ef143-b06e-4ea2-8560-105f967ab03e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:07.491268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-977ef143-b06e-4ea2-8560-105f967ab03e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:07.499111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-977ef143-b06e-4ea2-8560-105f967ab03e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:07.501157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-977ef143-b06e-4ea2-8560-105f967ab03e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:07.501864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-977ef143-b06e-4ea2-8560-105f967ab03e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:07.502805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-977ef143-b06e-4ea2-8560-105f967ab03e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:07.503521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-977ef143-b06e-4ea2-8560-105f967ab03e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:07.504225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-977ef143-b06e-4ea2-8560-105f967ab03e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:07.548468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:07.751483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:07.774394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:07.780515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:07.783745 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a30c0661-8c66-40f1-a9be-c5c7f410afed tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.695489 Sep 10 10:56:07.784548 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3050/3751] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:56:06 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:56:07.797285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5b07490c-dc15-4e96-b378-89a3622cfd8f req-e9e150bc-8776-4479-936f-9d6dee787f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-plugged", "status": "completed", "tag": "afc48537-d094-475a-90d1-6025c8a4d182"}, {"server_uuid": "15f28c4d-0eff-48f6-8fc0-51f95a07d38e", "name": "network-vif-plugged", "status": "completed", "tag": "0b358bb6-e978-4218-93e3-25b76d5933d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:07.822419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b07490c-dc15-4e96-b378-89a3622cfd8f req-e9e150bc-8776-4479-936f-9d6dee787f20 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:07.823328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b07490c-dc15-4e96-b378-89a3622cfd8f req-e9e150bc-8776-4479-936f-9d6dee787f20 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:07.825594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b07490c-dc15-4e96-b378-89a3622cfd8f req-e9e150bc-8776-4479-936f-9d6dee787f20 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:07.868798 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5b07490c-dc15-4e96-b378-89a3622cfd8f req-e9e150bc-8776-4479-936f-9d6dee787f20 service nova] Creating event network-vif-plugged:afc48537-d094-475a-90d1-6025c8a4d182 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:56:07.871827 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5b07490c-dc15-4e96-b378-89a3622cfd8f req-e9e150bc-8776-4479-936f-9d6dee787f20 service nova] Creating event network-vif-plugged:0b358bb6-e978-4218-93e3-25b76d5933d4 for instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e on n-h2-856894-1 Sep 10 10:56:07.898506 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5b07490c-dc15-4e96-b378-89a3622cfd8f req-e9e150bc-8776-4479-936f-9d6dee787f20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.109095 Sep 10 10:56:07.901818 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3051/3752] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:08.226498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-977ef143-b06e-4ea2-8560-105f967ab03e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:08.246542 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-977ef143-b06e-4ea2-8560-105f967ab03e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1315 microversion: 2.1 time: 0.760120 Sep 10 10:56:08.247681 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 702/3753] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:07 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:08.510863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2f0ecf47-ee11-46fc-9efd-506bb4351e49 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:08.511486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2f0ecf47-ee11-46fc-9efd-506bb4351e49 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:08.525017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f0ecf47-ee11-46fc-9efd-506bb4351e49 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:08.529487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f0ecf47-ee11-46fc-9efd-506bb4351e49 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:08.530600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f0ecf47-ee11-46fc-9efd-506bb4351e49 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:08.533151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f0ecf47-ee11-46fc-9efd-506bb4351e49 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:08.537598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f0ecf47-ee11-46fc-9efd-506bb4351e49 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:08.544614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f0ecf47-ee11-46fc-9efd-506bb4351e49 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:08.581016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-930091350", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "225d4f58-0f1e-435c-90d4-d12917652e53"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:08.656434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] validate_networks() for [('225d4f58-0f1e-435c-90d4-d12917652e53', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:56:09.345757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2f0ecf47-ee11-46fc-9efd-506bb4351e49 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:09.387623 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2f0ecf47-ee11-46fc-9efd-506bb4351e49 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1315 microversion: 2.1 time: 0.881524 Sep 10 10:56:09.388951 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 703/3754] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:08 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:09.410986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:09.412339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:09.429355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:09.430111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:09.430714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:09.432526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:09.433190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:09.434813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:10.484753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:10.514029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:10.523259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:10.527215 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5c065470-f880-454c-ac85-8373a821d9d7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.135814 Sep 10 10:56:10.528488 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 704/3755] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:56:09 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:56:10.532682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:56:10.533827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:56:10.534637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:56:10.535219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:56:10.535803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:56:10.553614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f13a8550-7926-4d44-a224-431ecb8560f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:10.554435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f13a8550-7926-4d44-a224-431ecb8560f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:10.556436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:10.556926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:10.557408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:10.558144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:10.559264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:10.559700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:10.570584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f13a8550-7926-4d44-a224-431ecb8560f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:10.572316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f13a8550-7926-4d44-a224-431ecb8560f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:10.576220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f13a8550-7926-4d44-a224-431ecb8560f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:10.578116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f13a8550-7926-4d44-a224-431ecb8560f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:10.580401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f13a8550-7926-4d44-a224-431ecb8560f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:10.581313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f13a8550-7926-4d44-a224-431ecb8560f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:10.602393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Getting quotas for project dedc5802df604af99afeca8e8fb9b0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:56:10.612069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Getting quotas for user b536a4f15c4e47f1a5cfda2b8ad861f8 and project dedc5802df604af99afeca8e8fb9b0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:56:10.647057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:56:10.650032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:56:10.774021 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3fb4181c-22ea-4e70-80cd-a67e96a44ac4 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.332506 Sep 10 10:56:10.778679 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3052/3756] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:56:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:56:10.822877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c63f8940-557a-4a4a-8cab-b3829944a2f1 req-cc86ef88-6c98-43dd-8258-8102481da724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-plugged", "status": "completed", "tag": "875f226e-ca50-4e2c-adf6-17cf98c280d2"}, {"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-plugged", "status": "completed", "tag": "c47b0e0e-8474-4e97-a4ca-67dcd2219a5f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:10.855028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c63f8940-557a-4a4a-8cab-b3829944a2f1 req-cc86ef88-6c98-43dd-8258-8102481da724 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:10.856410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c63f8940-557a-4a4a-8cab-b3829944a2f1 req-cc86ef88-6c98-43dd-8258-8102481da724 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:10.857162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c63f8940-557a-4a4a-8cab-b3829944a2f1 req-cc86ef88-6c98-43dd-8258-8102481da724 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:10.892677 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c63f8940-557a-4a4a-8cab-b3829944a2f1 req-cc86ef88-6c98-43dd-8258-8102481da724 service nova] Creating event network-vif-plugged:875f226e-ca50-4e2c-adf6-17cf98c280d2 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:56:10.893759 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c63f8940-557a-4a4a-8cab-b3829944a2f1 req-cc86ef88-6c98-43dd-8258-8102481da724 service nova] Creating event network-vif-plugged:c47b0e0e-8474-4e97-a4ca-67dcd2219a5f for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:56:10.910220 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c63f8940-557a-4a4a-8cab-b3829944a2f1 req-cc86ef88-6c98-43dd-8258-8102481da724 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.123723 Sep 10 10:56:10.911431 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3053/3757] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:10.920970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-64ce8d0a-442c-44bc-8edd-36b595aa1372 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:10.927373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-64ce8d0a-442c-44bc-8edd-36b595aa1372 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:10.944381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64ce8d0a-442c-44bc-8edd-36b595aa1372 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:10.946176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64ce8d0a-442c-44bc-8edd-36b595aa1372 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:10.947589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64ce8d0a-442c-44bc-8edd-36b595aa1372 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:10.952932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64ce8d0a-442c-44bc-8edd-36b595aa1372 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:10.953785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64ce8d0a-442c-44bc-8edd-36b595aa1372 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:10.954252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64ce8d0a-442c-44bc-8edd-36b595aa1372 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:10.956165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f13a8550-7926-4d44-a224-431ecb8560f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:10.970850 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f13a8550-7926-4d44-a224-431ecb8560f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1315 microversion: 2.1 time: 0.440706 Sep 10 10:56:10.971406 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 705/3758] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:10 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:10.992408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3c6df402-8e74-4d60-9fad-643b9fe0e402 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:10.999825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3c6df402-8e74-4d60-9fad-643b9fe0e402 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:11.224634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c6df402-8e74-4d60-9fad-643b9fe0e402 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:11.236641 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3c6df402-8e74-4d60-9fad-643b9fe0e402 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1231 microversion: 2.1 time: 0.255278 Sep 10 10:56:11.243758 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 706/3759] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:10 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1231 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:11.316439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-64ce8d0a-442c-44bc-8edd-36b595aa1372 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:11.328863 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-64ce8d0a-442c-44bc-8edd-36b595aa1372 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1501 microversion: 2.1 time: 0.412185 Sep 10 10:56:11.329599 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3054/3760] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:10 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1501 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:11.359485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d18f0231-b530-422b-8d54-be86fb5f8add tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:11.362572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d18f0231-b530-422b-8d54-be86fb5f8add tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:11.375518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d18f0231-b530-422b-8d54-be86fb5f8add tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:11.381787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d18f0231-b530-422b-8d54-be86fb5f8add tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:11.382453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d18f0231-b530-422b-8d54-be86fb5f8add tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:11.383380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d18f0231-b530-422b-8d54-be86fb5f8add tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:11.384021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d18f0231-b530-422b-8d54-be86fb5f8add tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:11.384623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d18f0231-b530-422b-8d54-be86fb5f8add tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:11.522839 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d18f0231-b530-422b-8d54-be86fb5f8add tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e/action" status: 202 len: 0 microversion: 2.1 time: 0.166937 Sep 10 10:56:11.526892 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 707/3761] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:56:11 2022] POST /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:56:11.541321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b509da36-1e35-4d8a-af8c-c825c3a402f3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:11.550153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b509da36-1e35-4d8a-af8c-c825c3a402f3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:11.566852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:11.571175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:11.602341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b509da36-1e35-4d8a-af8c-c825c3a402f3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:11.603033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b509da36-1e35-4d8a-af8c-c825c3a402f3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:11.603556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b509da36-1e35-4d8a-af8c-c825c3a402f3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:11.607281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:11.607787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:11.608229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:11.609688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b509da36-1e35-4d8a-af8c-c825c3a402f3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:11.610184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b509da36-1e35-4d8a-af8c-c825c3a402f3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:11.610632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b509da36-1e35-4d8a-af8c-c825c3a402f3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:11.613426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:11.616157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:11.616633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:12.438909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:12.454117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:12.458349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:12.462125 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dc9e16c6-622d-40a3-bb99-66b0ae401d80 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.908892 Sep 10 10:56:12.464571 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 708/3762] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:56:11 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:56:12.476234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ad274018-da09-4afd-96ec-699565867ed8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:12.477531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ad274018-da09-4afd-96ec-699565867ed8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:12.483524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b509da36-1e35-4d8a-af8c-c825c3a402f3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:12.499345 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b509da36-1e35-4d8a-af8c-c825c3a402f3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1506 microversion: 2.1 time: 0.970648 Sep 10 10:56:12.500137 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3055/3763] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:11 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1506 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:12.504241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad274018-da09-4afd-96ec-699565867ed8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:12.504761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad274018-da09-4afd-96ec-699565867ed8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:12.505234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad274018-da09-4afd-96ec-699565867ed8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:12.505954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad274018-da09-4afd-96ec-699565867ed8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:12.506419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad274018-da09-4afd-96ec-699565867ed8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:12.518134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad274018-da09-4afd-96ec-699565867ed8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:12.534957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a15ecaf5-de46-496b-8167-dbab8f86ded0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:12.538473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a15ecaf5-de46-496b-8167-dbab8f86ded0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:12.555596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a15ecaf5-de46-496b-8167-dbab8f86ded0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:12.556232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a15ecaf5-de46-496b-8167-dbab8f86ded0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:12.558697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a15ecaf5-de46-496b-8167-dbab8f86ded0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:12.559549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a15ecaf5-de46-496b-8167-dbab8f86ded0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:12.561793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a15ecaf5-de46-496b-8167-dbab8f86ded0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:12.562379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a15ecaf5-de46-496b-8167-dbab8f86ded0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:12.758451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a15ecaf5-de46-496b-8167-dbab8f86ded0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:12.770504 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a15ecaf5-de46-496b-8167-dbab8f86ded0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1283 microversion: 2.1 time: 0.267977 Sep 10 10:56:12.775273 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3056/3764] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:12 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1283 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:12.955900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ad274018-da09-4afd-96ec-699565867ed8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:12.969777 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ad274018-da09-4afd-96ec-699565867ed8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1315 microversion: 2.1 time: 0.502838 Sep 10 10:56:12.975008 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 709/3765] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:12 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:13.003533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d79e182b-4a93-461a-8a2d-2967f528a12a req-2c3a2ac2-57d2-4316-b665-f832f85d27ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-plugged", "status": "completed", "tag": "0e5561b7-d18e-4cc7-baa7-94dad55f2c42"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:13.021275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d79e182b-4a93-461a-8a2d-2967f528a12a req-2c3a2ac2-57d2-4316-b665-f832f85d27ae service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:13.022587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d79e182b-4a93-461a-8a2d-2967f528a12a req-2c3a2ac2-57d2-4316-b665-f832f85d27ae service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:13.024038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d79e182b-4a93-461a-8a2d-2967f528a12a req-2c3a2ac2-57d2-4316-b665-f832f85d27ae service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:13.046267 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d79e182b-4a93-461a-8a2d-2967f528a12a req-2c3a2ac2-57d2-4316-b665-f832f85d27ae service nova] Creating event network-vif-plugged:0e5561b7-d18e-4cc7-baa7-94dad55f2c42 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:56:13.053208 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d79e182b-4a93-461a-8a2d-2967f528a12a req-2c3a2ac2-57d2-4316-b665-f832f85d27ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053431 Sep 10 10:56:13.054441 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3057/3766] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:13.500336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:13.500781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:13.509897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:13.513530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:13.514785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:13.517699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:13.519885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:13.520776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:13.531993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ff5653e-b281-419d-b53d-6703d992f3cc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:13.533251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7ff5653e-b281-419d-b53d-6703d992f3cc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:13.553545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ff5653e-b281-419d-b53d-6703d992f3cc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:13.554061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ff5653e-b281-419d-b53d-6703d992f3cc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:13.554501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ff5653e-b281-419d-b53d-6703d992f3cc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:13.555217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ff5653e-b281-419d-b53d-6703d992f3cc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:13.555686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ff5653e-b281-419d-b53d-6703d992f3cc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:13.556246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ff5653e-b281-419d-b53d-6703d992f3cc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:14.321905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:14.345405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7ff5653e-b281-419d-b53d-6703d992f3cc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:14.354528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:14.358689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:14.359024 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7ff5653e-b281-419d-b53d-6703d992f3cc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1486 microversion: 2.1 time: 0.829417 Sep 10 10:56:14.361858 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3058/3767] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:13 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1486 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:14.368255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78ba0049-9c7b-47a2-87d2-4c0e02d6812c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:14.368872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78ba0049-9c7b-47a2-87d2-4c0e02d6812c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:14.374537 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8723c731-b23b-427f-bf48-01e5dc690439 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.880599 Sep 10 10:56:14.376570 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 710/3768] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:56:13 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:56:14.389554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-835f5d06-ad8c-4f80-9cef-203f88b2a166 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:14.390175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-835f5d06-ad8c-4f80-9cef-203f88b2a166 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:14.414957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78ba0049-9c7b-47a2-87d2-4c0e02d6812c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:14.415459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78ba0049-9c7b-47a2-87d2-4c0e02d6812c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:14.415901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78ba0049-9c7b-47a2-87d2-4c0e02d6812c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:14.416612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78ba0049-9c7b-47a2-87d2-4c0e02d6812c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:14.417086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78ba0049-9c7b-47a2-87d2-4c0e02d6812c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:14.417520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78ba0049-9c7b-47a2-87d2-4c0e02d6812c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:14.421368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-835f5d06-ad8c-4f80-9cef-203f88b2a166 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:14.421889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-835f5d06-ad8c-4f80-9cef-203f88b2a166 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:14.422345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-835f5d06-ad8c-4f80-9cef-203f88b2a166 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:14.426741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-835f5d06-ad8c-4f80-9cef-203f88b2a166 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:14.427238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-835f5d06-ad8c-4f80-9cef-203f88b2a166 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:14.427686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-835f5d06-ad8c-4f80-9cef-203f88b2a166 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:14.739269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-78ba0049-9c7b-47a2-87d2-4c0e02d6812c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:14.760264 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78ba0049-9c7b-47a2-87d2-4c0e02d6812c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1289 microversion: 2.1 time: 0.397058 Sep 10 10:56:14.762303 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3059/3769] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:14 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1289 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:14.791441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9cd2c2f-7313-4dbc-b7f1-4bca07796472 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:14.795035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9cd2c2f-7313-4dbc-b7f1-4bca07796472 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:14.831046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9cd2c2f-7313-4dbc-b7f1-4bca07796472 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:14.833496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9cd2c2f-7313-4dbc-b7f1-4bca07796472 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:14.834439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9cd2c2f-7313-4dbc-b7f1-4bca07796472 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:14.836374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9cd2c2f-7313-4dbc-b7f1-4bca07796472 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:14.841442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9cd2c2f-7313-4dbc-b7f1-4bca07796472 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:14.842319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9cd2c2f-7313-4dbc-b7f1-4bca07796472 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:14.911002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d9cd2c2f-7313-4dbc-b7f1-4bca07796472 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lazy-loading 'flavor' on Instance uuid 15f28c4d-0eff-48f6-8fc0-51f95a07d38e {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:56:15.114725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-835f5d06-ad8c-4f80-9cef-203f88b2a166 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:15.124494 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-835f5d06-ad8c-4f80-9cef-203f88b2a166 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1315 microversion: 2.1 time: 0.747586 Sep 10 10:56:15.126791 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 711/3770] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:14 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:15.141061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-8e930208-c7bc-4d64-a76b-fbdc0a387c08 req-b0c373f7-e04f-4fff-bb58-45a3f6cac1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-plugged", "status": "completed", "tag": "f09e2e61-cd03-4c4b-9620-fc31f1da96b0"}, {"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-plugged", "status": "completed", "tag": "db6226c6-d5ed-4db3-92af-4e1534088960"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:15.169369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8e930208-c7bc-4d64-a76b-fbdc0a387c08 req-b0c373f7-e04f-4fff-bb58-45a3f6cac1a8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:15.169856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8e930208-c7bc-4d64-a76b-fbdc0a387c08 req-b0c373f7-e04f-4fff-bb58-45a3f6cac1a8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:15.170330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8e930208-c7bc-4d64-a76b-fbdc0a387c08 req-b0c373f7-e04f-4fff-bb58-45a3f6cac1a8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:15.190426 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-8e930208-c7bc-4d64-a76b-fbdc0a387c08 req-b0c373f7-e04f-4fff-bb58-45a3f6cac1a8 service nova] Creating event network-vif-plugged:f09e2e61-cd03-4c4b-9620-fc31f1da96b0 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:56:15.191019 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-8e930208-c7bc-4d64-a76b-fbdc0a387c08 req-b0c373f7-e04f-4fff-bb58-45a3f6cac1a8 service nova] Creating event network-vif-plugged:db6226c6-d5ed-4db3-92af-4e1534088960 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:56:15.212402 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-8e930208-c7bc-4d64-a76b-fbdc0a387c08 req-b0c373f7-e04f-4fff-bb58-45a3f6cac1a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075072 Sep 10 10:56:15.213838 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 712/3771] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:15.425424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:15.430765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:15.437248 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9cd2c2f-7313-4dbc-b7f1-4bca07796472 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e/action" status: 202 len: 0 microversion: 2.1 time: 0.665926 Sep 10 10:56:15.437902 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3060/3772] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:56:14 2022] POST /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:56:15.462907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:15.469248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:15.472608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:15.477521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:15.477829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9f664ed6-d01e-48a2-ba14-f02c1360ea64 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:15.479722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:15.481975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:15.482639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9f664ed6-d01e-48a2-ba14-f02c1360ea64 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:15.518384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f664ed6-d01e-48a2-ba14-f02c1360ea64 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:15.521982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f664ed6-d01e-48a2-ba14-f02c1360ea64 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:15.523627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f664ed6-d01e-48a2-ba14-f02c1360ea64 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:15.526755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f664ed6-d01e-48a2-ba14-f02c1360ea64 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:15.529239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f664ed6-d01e-48a2-ba14-f02c1360ea64 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:15.531949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f664ed6-d01e-48a2-ba14-f02c1360ea64 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:16.236591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9f664ed6-d01e-48a2-ba14-f02c1360ea64 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:16.247613 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9f664ed6-d01e-48a2-ba14-f02c1360ea64 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1492 microversion: 2.1 time: 0.801970 Sep 10 10:56:16.265660 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3061/3773] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:15 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1492 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:16.276594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c03745c4-fa54-4deb-9e39-513991fb8fb5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:16.279684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c03745c4-fa54-4deb-9e39-513991fb8fb5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:16.295239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03745c4-fa54-4deb-9e39-513991fb8fb5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:16.298478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03745c4-fa54-4deb-9e39-513991fb8fb5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:16.299196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03745c4-fa54-4deb-9e39-513991fb8fb5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:16.301134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03745c4-fa54-4deb-9e39-513991fb8fb5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:16.301829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03745c4-fa54-4deb-9e39-513991fb8fb5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:16.304549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03745c4-fa54-4deb-9e39-513991fb8fb5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:16.406371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:16.421440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:16.424425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:16.430225 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3db6e13e-4620-4271-ac40-56f8d8fbcf82 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 1.020718 Sep 10 10:56:16.435460 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 713/3774] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:56:15 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:56:16.443123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-12cb93e4-6dbb-4f27-872a-d87a026b2fb2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:16.443951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-12cb93e4-6dbb-4f27-872a-d87a026b2fb2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:16.461721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12cb93e4-6dbb-4f27-872a-d87a026b2fb2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:16.462545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12cb93e4-6dbb-4f27-872a-d87a026b2fb2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:16.463685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12cb93e4-6dbb-4f27-872a-d87a026b2fb2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:16.464692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12cb93e4-6dbb-4f27-872a-d87a026b2fb2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:16.467031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12cb93e4-6dbb-4f27-872a-d87a026b2fb2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:16.471751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12cb93e4-6dbb-4f27-872a-d87a026b2fb2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:16.719262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-12cb93e4-6dbb-4f27-872a-d87a026b2fb2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:16.734219 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-12cb93e4-6dbb-4f27-872a-d87a026b2fb2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1315 microversion: 2.1 time: 0.296843 Sep 10 10:56:16.736793 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 714/3775] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:16 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:16.847830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c03745c4-fa54-4deb-9e39-513991fb8fb5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:16.854704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:16.865667 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c03745c4-fa54-4deb-9e39-513991fb8fb5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1331 microversion: 2.1 time: 0.598320 Sep 10 10:56:16.869278 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3062/3776] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:16 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1331 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:17.271829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7d142fc0-2acf-4e2f-8194-60ae8b406be3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:17.272705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7d142fc0-2acf-4e2f-8194-60ae8b406be3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:17.285379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d142fc0-2acf-4e2f-8194-60ae8b406be3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:17.286165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d142fc0-2acf-4e2f-8194-60ae8b406be3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:17.286760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d142fc0-2acf-4e2f-8194-60ae8b406be3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:17.287639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d142fc0-2acf-4e2f-8194-60ae8b406be3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:17.289933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d142fc0-2acf-4e2f-8194-60ae8b406be3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:17.290999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d142fc0-2acf-4e2f-8194-60ae8b406be3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:17.422430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2a42b5ea-c362-443f-875d-53cfc4f17c3a req-fa5c1493-65f9-49c9-baf6-432c29f8c24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1fff5af-b5bc-4a39-a5a3-81c17a2b397b", "name": "network-vif-plugged", "status": "completed", "tag": "fdf28f35-cdeb-4bbe-a940-e39781700167"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:17.452169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2a42b5ea-c362-443f-875d-53cfc4f17c3a req-fa5c1493-65f9-49c9-baf6-432c29f8c24f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:17.452855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2a42b5ea-c362-443f-875d-53cfc4f17c3a req-fa5c1493-65f9-49c9-baf6-432c29f8c24f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:17.453493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2a42b5ea-c362-443f-875d-53cfc4f17c3a req-fa5c1493-65f9-49c9-baf6-432c29f8c24f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:17.486237 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2a42b5ea-c362-443f-875d-53cfc4f17c3a req-fa5c1493-65f9-49c9-baf6-432c29f8c24f service nova] Creating event network-vif-plugged:fdf28f35-cdeb-4bbe-a940-e39781700167 for instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b on n-h2-856894-1 Sep 10 10:56:17.499082 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2a42b5ea-c362-443f-875d-53cfc4f17c3a req-fa5c1493-65f9-49c9-baf6-432c29f8c24f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080590 Sep 10 10:56:17.500342 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3063/3777] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:17.508769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:17.512181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:17.528229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:17.539549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:17.540243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:17.541368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:17.542464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:17.542940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:17.702993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7d142fc0-2acf-4e2f-8194-60ae8b406be3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:17.711441 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7d142fc0-2acf-4e2f-8194-60ae8b406be3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1513 microversion: 2.1 time: 0.443605 Sep 10 10:56:17.713737 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 715/3778] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:17 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1513 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:17.761303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3a0e998d-0443-40cd-97df-4348a6b9bcb7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:17.762572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3a0e998d-0443-40cd-97df-4348a6b9bcb7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:17.771927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e998d-0443-40cd-97df-4348a6b9bcb7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:17.774155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e998d-0443-40cd-97df-4348a6b9bcb7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:17.780107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e998d-0443-40cd-97df-4348a6b9bcb7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:17.780880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e998d-0443-40cd-97df-4348a6b9bcb7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:17.781373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e998d-0443-40cd-97df-4348a6b9bcb7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:17.782190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e998d-0443-40cd-97df-4348a6b9bcb7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:18.311416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:18.334928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:18.339634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:18.342773 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-327eade1-5653-4e51-8c74-41a33e23e585 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1880 microversion: 2.32 time: 0.840316 Sep 10 10:56:18.344383 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3064/3779] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:56:17 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1880 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:56:18.350107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3cae577f-80c0-4a0e-af55-b24b2d40a4da tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:18.351081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3cae577f-80c0-4a0e-af55-b24b2d40a4da tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:18.359797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cae577f-80c0-4a0e-af55-b24b2d40a4da tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:18.360654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cae577f-80c0-4a0e-af55-b24b2d40a4da tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:18.361324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cae577f-80c0-4a0e-af55-b24b2d40a4da tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:18.362395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cae577f-80c0-4a0e-af55-b24b2d40a4da tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:18.363037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cae577f-80c0-4a0e-af55-b24b2d40a4da tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:18.363614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cae577f-80c0-4a0e-af55-b24b2d40a4da tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:18.441098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3a0e998d-0443-40cd-97df-4348a6b9bcb7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:18.454589 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3a0e998d-0443-40cd-97df-4348a6b9bcb7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1315 microversion: 2.1 time: 0.697234 Sep 10 10:56:18.457693 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 716/3780] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:17 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:18.750010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-702ca3f3-8a44-45d4-aea4-98e3e654b416 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:18.753512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-702ca3f3-8a44-45d4-aea4-98e3e654b416 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:18.775955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-702ca3f3-8a44-45d4-aea4-98e3e654b416 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:18.780822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-702ca3f3-8a44-45d4-aea4-98e3e654b416 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:18.783210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-702ca3f3-8a44-45d4-aea4-98e3e654b416 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:18.785416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-702ca3f3-8a44-45d4-aea4-98e3e654b416 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:18.786666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-702ca3f3-8a44-45d4-aea4-98e3e654b416 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:18.788058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-702ca3f3-8a44-45d4-aea4-98e3e654b416 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:19.168375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3cae577f-80c0-4a0e-af55-b24b2d40a4da tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:19.189843 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3cae577f-80c0-4a0e-af55-b24b2d40a4da tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1331 microversion: 2.1 time: 0.842368 Sep 10 10:56:19.192540 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3065/3781] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:18 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1331 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:19.374960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:19.380483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:19.407525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:19.410970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:19.412078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:19.413428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:19.414500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:19.415333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:19.633606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-702ca3f3-8a44-45d4-aea4-98e3e654b416 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:19.649142 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-702ca3f3-8a44-45d4-aea4-98e3e654b416 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 0.913363 Sep 10 10:56:19.653293 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 717/3782] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:18 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:19.665949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b1b18099-2309-4182-93c3-b313be564d1d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:19.668917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b1b18099-2309-4182-93c3-b313be564d1d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:19.683530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1b18099-2309-4182-93c3-b313be564d1d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:19.687667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1b18099-2309-4182-93c3-b313be564d1d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:19.688381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1b18099-2309-4182-93c3-b313be564d1d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:19.689393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1b18099-2309-4182-93c3-b313be564d1d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:19.690291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1b18099-2309-4182-93c3-b313be564d1d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:19.690894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1b18099-2309-4182-93c3-b313be564d1d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:20.124654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1b18099-2309-4182-93c3-b313be564d1d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:20.135352 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b1b18099-2309-4182-93c3-b313be564d1d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1315 microversion: 2.1 time: 0.480390 Sep 10 10:56:20.141416 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 718/3783] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:19 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:20.161232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-451a6e9a-335d-4c43-b441-567c42058e5f req-1a607f5b-b10a-4bed-8229-09d040f14b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6660934d-2fe2-435d-8901-5dc605841bb8", "tag": "b47a35b5-20a2-4086-8189-336a210a37db"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:20.197955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-451a6e9a-335d-4c43-b441-567c42058e5f req-1a607f5b-b10a-4bed-8229-09d040f14b8f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:20.200350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-451a6e9a-335d-4c43-b441-567c42058e5f req-1a607f5b-b10a-4bed-8229-09d040f14b8f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:20.201030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-451a6e9a-335d-4c43-b441-567c42058e5f req-1a607f5b-b10a-4bed-8229-09d040f14b8f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:20.244179 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-451a6e9a-335d-4c43-b441-567c42058e5f req-1a607f5b-b10a-4bed-8229-09d040f14b8f service nova] Creating event network-changed:b47a35b5-20a2-4086-8189-336a210a37db for instance 6660934d-2fe2-435d-8901-5dc605841bb8 on n-h2-856894-1 Sep 10 10:56:20.254027 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-451a6e9a-335d-4c43-b441-567c42058e5f req-1a607f5b-b10a-4bed-8229-09d040f14b8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104890 Sep 10 10:56:20.260613 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 719/3784] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:20.272012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-923e5dc9-ef79-4620-abb8-06839139acc3 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:20.273248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-923e5dc9-ef79-4620-abb8-06839139acc3 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:20.284540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-923e5dc9-ef79-4620-abb8-06839139acc3 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:20.290015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-923e5dc9-ef79-4620-abb8-06839139acc3 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:20.291231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-923e5dc9-ef79-4620-abb8-06839139acc3 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:20.294136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-923e5dc9-ef79-4620-abb8-06839139acc3 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:20.294844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-923e5dc9-ef79-4620-abb8-06839139acc3 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:20.297785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-923e5dc9-ef79-4620-abb8-06839139acc3 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:20.372447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:20.532141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:20.550642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:20.552131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:20.553459 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc827091-4c36-427c-a9d3-6ab8e0f0089d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2831 microversion: 2.32 time: 1.183033 Sep 10 10:56:20.576508 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3066/3785] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:56:19 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2831 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:56:20.593804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c685f225-3b43-46e6-9703-c10138976161 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:20.594243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c685f225-3b43-46e6-9703-c10138976161 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:20.600938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:20.616641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c685f225-3b43-46e6-9703-c10138976161 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:20.619816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c685f225-3b43-46e6-9703-c10138976161 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:20.620282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c685f225-3b43-46e6-9703-c10138976161 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:20.623774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c685f225-3b43-46e6-9703-c10138976161 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:20.624570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c685f225-3b43-46e6-9703-c10138976161 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:20.625976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c685f225-3b43-46e6-9703-c10138976161 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:20.635164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:21.232023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:21.476165 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c685f225-3b43-46e6-9703-c10138976161 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.893688 Sep 10 10:56:21.476743 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3067/3786] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Sep 10 10:56:20 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939/os-interface => generated 1830 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:56:21.495740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-952d1dbf-9155-4577-b79e-3b224f72df6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:21.500354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-952d1dbf-9155-4577-b79e-3b224f72df6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:21.528956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952d1dbf-9155-4577-b79e-3b224f72df6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:21.528956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952d1dbf-9155-4577-b79e-3b224f72df6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:21.535178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952d1dbf-9155-4577-b79e-3b224f72df6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:21.539204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952d1dbf-9155-4577-b79e-3b224f72df6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:21.539891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952d1dbf-9155-4577-b79e-3b224f72df6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:21.541395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-952d1dbf-9155-4577-b79e-3b224f72df6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:21.857303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-923e5dc9-ef79-4620-abb8-06839139acc3 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:21.869843 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-923e5dc9-ef79-4620-abb8-06839139acc3 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1331 microversion: 2.1 time: 1.606625 Sep 10 10:56:21.870443 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 720/3787] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:20 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1331 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:21.877783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-df1e07ee-e05b-42a5-ba0c-601f06912f5e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:21.885962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-df1e07ee-e05b-42a5-ba0c-601f06912f5e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:21.897219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df1e07ee-e05b-42a5-ba0c-601f06912f5e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:21.897992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df1e07ee-e05b-42a5-ba0c-601f06912f5e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:21.898585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df1e07ee-e05b-42a5-ba0c-601f06912f5e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:21.899515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df1e07ee-e05b-42a5-ba0c-601f06912f5e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:21.900122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df1e07ee-e05b-42a5-ba0c-601f06912f5e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:21.900702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df1e07ee-e05b-42a5-ba0c-601f06912f5e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:22.573448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-952d1dbf-9155-4577-b79e-3b224f72df6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:22.587417 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-952d1dbf-9155-4577-b79e-3b224f72df6c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 1.108983 Sep 10 10:56:22.588989 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3068/3788] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:21 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:22.899427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3f1f653-1019-49d8-9d8a-ab24879a9a96 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:22.900322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e3f1f653-1019-49d8-9d8a-ab24879a9a96 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:22.910284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3f1f653-1019-49d8-9d8a-ab24879a9a96 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:22.914443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3f1f653-1019-49d8-9d8a-ab24879a9a96 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:22.915073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3f1f653-1019-49d8-9d8a-ab24879a9a96 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:22.915991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3f1f653-1019-49d8-9d8a-ab24879a9a96 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:22.918252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3f1f653-1019-49d8-9d8a-ab24879a9a96 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:22.920644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3f1f653-1019-49d8-9d8a-ab24879a9a96 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:22.967490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-df1e07ee-e05b-42a5-ba0c-601f06912f5e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:22.976656 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-df1e07ee-e05b-42a5-ba0c-601f06912f5e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.104409 Sep 10 10:56:22.984877 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 721/3789] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:21 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:23.087041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-48334777-7ff8-4b99-90a4-608b2d2be8d2 req-035e0a40-ccd3-4ece-91d9-4b02b68cee47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f28c4d-0eff-48f6-8fc0-51f95a07d38e", "name": "network-vif-plugged", "status": "completed", "tag": "0b358bb6-e978-4218-93e3-25b76d5933d4"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:23.106204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:23.114394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-48334777-7ff8-4b99-90a4-608b2d2be8d2 req-035e0a40-ccd3-4ece-91d9-4b02b68cee47 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:23.114894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-48334777-7ff8-4b99-90a4-608b2d2be8d2 req-035e0a40-ccd3-4ece-91d9-4b02b68cee47 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:23.115329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-48334777-7ff8-4b99-90a4-608b2d2be8d2 req-035e0a40-ccd3-4ece-91d9-4b02b68cee47 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:23.150544 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-48334777-7ff8-4b99-90a4-608b2d2be8d2 req-035e0a40-ccd3-4ece-91d9-4b02b68cee47 service nova] Creating event network-vif-plugged:0b358bb6-e978-4218-93e3-25b76d5933d4 for instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e on n-h2-856894-1 Sep 10 10:56:23.172557 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-48334777-7ff8-4b99-90a4-608b2d2be8d2 req-035e0a40-ccd3-4ece-91d9-4b02b68cee47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089378 Sep 10 10:56:23.173183 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 722/3790] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:56:23.239837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1557475608", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:23.353426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] validate_networks() for [('5965e34a-c1b4-44c0-8b96-d4d7d1a762c7', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:56:24.481682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e3f1f653-1019-49d8-9d8a-ab24879a9a96 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:24.504376 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3f1f653-1019-49d8-9d8a-ab24879a9a96 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1331 microversion: 2.1 time: 1.608653 Sep 10 10:56:24.504980 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3069/3791] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:22 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1331 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:24.543052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f6ed987-4303-4806-8093-af0df3d62a2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:24.547434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f6ed987-4303-4806-8093-af0df3d62a2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:24.570263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f6ed987-4303-4806-8093-af0df3d62a2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:24.571013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f6ed987-4303-4806-8093-af0df3d62a2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:24.579743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f6ed987-4303-4806-8093-af0df3d62a2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:24.580503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f6ed987-4303-4806-8093-af0df3d62a2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:24.584199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f6ed987-4303-4806-8093-af0df3d62a2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:24.584855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f6ed987-4303-4806-8093-af0df3d62a2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:25.531966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1f6ed987-4303-4806-8093-af0df3d62a2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:25.631085 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f6ed987-4303-4806-8093-af0df3d62a2b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 1.115829 Sep 10 10:56:25.656743 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3070/3792] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:24 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:25.684745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-108eb71a-debf-442f-8a03-ee6aded2e239 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:25.692143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-108eb71a-debf-442f-8a03-ee6aded2e239 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:25.708135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-108eb71a-debf-442f-8a03-ee6aded2e239 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:25.732170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-108eb71a-debf-442f-8a03-ee6aded2e239 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:25.732715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-108eb71a-debf-442f-8a03-ee6aded2e239 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:25.733693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-108eb71a-debf-442f-8a03-ee6aded2e239 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:25.734426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-108eb71a-debf-442f-8a03-ee6aded2e239 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:25.734869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-108eb71a-debf-442f-8a03-ee6aded2e239 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:26.089902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:56:26.090451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:56:26.090802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:56:26.091429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:56:26.092020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:56:26.109740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:26.110446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:26.112025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:26.117239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:26.118456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:26.120043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:26.208523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Getting quotas for project 37f51916719346ba88aa44e3cae5bb9e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:56:26.215810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Getting quotas for user 608cf43f926c48fa9bd302ecc6ef79d3 and project 37f51916719346ba88aa44e3cae5bb9e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:56:26.251256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:56:26.258347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:56:26.435251 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1f28edc5-f213-46cc-9bff-1b4b3bf1a9d5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.200398 Sep 10 10:56:26.438060 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 723/3793] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:56:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:56:26.470126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e148f26d-56c6-4f05-9979-4d1a8a46f277 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:26.472991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e148f26d-56c6-4f05-9979-4d1a8a46f277 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:26.512356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-108eb71a-debf-442f-8a03-ee6aded2e239 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:26.529818 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-108eb71a-debf-442f-8a03-ee6aded2e239 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1331 microversion: 2.1 time: 0.871335 Sep 10 10:56:26.541153 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3071/3794] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:25 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1331 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:26.665822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-571bdaec-1fb7-462c-8d35-d2ed7137dbba tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:26.665822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-571bdaec-1fb7-462c-8d35-d2ed7137dbba tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:26.699528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571bdaec-1fb7-462c-8d35-d2ed7137dbba tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:26.710348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571bdaec-1fb7-462c-8d35-d2ed7137dbba tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:26.712589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571bdaec-1fb7-462c-8d35-d2ed7137dbba tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:26.713381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571bdaec-1fb7-462c-8d35-d2ed7137dbba tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:26.713844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571bdaec-1fb7-462c-8d35-d2ed7137dbba tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:26.714269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-571bdaec-1fb7-462c-8d35-d2ed7137dbba tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:26.898786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e148f26d-56c6-4f05-9979-4d1a8a46f277 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:26.916856 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e148f26d-56c6-4f05-9979-4d1a8a46f277 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1217 microversion: 2.1 time: 0.472173 Sep 10 10:56:26.925492 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 724/3795] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:26 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1217 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:27.499877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-571bdaec-1fb7-462c-8d35-d2ed7137dbba tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:27.509751 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-571bdaec-1fb7-462c-8d35-d2ed7137dbba tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 0.849304 Sep 10 10:56:27.524181 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3072/3796] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:26 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:27.580023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d4e74a8a-7bfb-4159-b784-9c41183f0e5e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:27.581652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d4e74a8a-7bfb-4159-b784-9c41183f0e5e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:27.645767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4e74a8a-7bfb-4159-b784-9c41183f0e5e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:27.653814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4e74a8a-7bfb-4159-b784-9c41183f0e5e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:27.654166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4e74a8a-7bfb-4159-b784-9c41183f0e5e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:27.655194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4e74a8a-7bfb-4159-b784-9c41183f0e5e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:27.655679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4e74a8a-7bfb-4159-b784-9c41183f0e5e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:27.659265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4e74a8a-7bfb-4159-b784-9c41183f0e5e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:27.969540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf409b9d-c3ae-44df-817c-f5e91a22261b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:27.970331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf409b9d-c3ae-44df-817c-f5e91a22261b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:27.989562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf409b9d-c3ae-44df-817c-f5e91a22261b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:27.993757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf409b9d-c3ae-44df-817c-f5e91a22261b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:27.996925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf409b9d-c3ae-44df-817c-f5e91a22261b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:27.999007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf409b9d-c3ae-44df-817c-f5e91a22261b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:28.002346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf409b9d-c3ae-44df-817c-f5e91a22261b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:28.003549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf409b9d-c3ae-44df-817c-f5e91a22261b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:28.378403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cf409b9d-c3ae-44df-817c-f5e91a22261b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:28.400517 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf409b9d-c3ae-44df-817c-f5e91a22261b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1213 microversion: 2.1 time: 0.427242 Sep 10 10:56:28.416690 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3073/3797] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:27 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1213 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:28.538082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-99e0d928-e4da-42c1-9860-e63c96d44f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:28.538689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-99e0d928-e4da-42c1-9860-e63c96d44f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:28.550030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99e0d928-e4da-42c1-9860-e63c96d44f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:28.551708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99e0d928-e4da-42c1-9860-e63c96d44f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:28.553768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99e0d928-e4da-42c1-9860-e63c96d44f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:28.554775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99e0d928-e4da-42c1-9860-e63c96d44f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:28.557014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99e0d928-e4da-42c1-9860-e63c96d44f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:28.557973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99e0d928-e4da-42c1-9860-e63c96d44f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:28.779436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d4e74a8a-7bfb-4159-b784-9c41183f0e5e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:28.800618 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d4e74a8a-7bfb-4159-b784-9c41183f0e5e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1331 microversion: 2.1 time: 1.236065 Sep 10 10:56:28.801228 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 725/3798] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:27 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1331 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:28.838512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-44f5224b-dde8-403c-9520-f01d9c503a27 req-7a9af0f5-e4ca-42f9-9093-118332026d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "tag": "db6226c6-d5ed-4db3-92af-4e1534088960"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:28.891750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-44f5224b-dde8-403c-9520-f01d9c503a27 req-7a9af0f5-e4ca-42f9-9093-118332026d44 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:28.892496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-44f5224b-dde8-403c-9520-f01d9c503a27 req-7a9af0f5-e4ca-42f9-9093-118332026d44 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:28.894589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-44f5224b-dde8-403c-9520-f01d9c503a27 req-7a9af0f5-e4ca-42f9-9093-118332026d44 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:28.924165 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-44f5224b-dde8-403c-9520-f01d9c503a27 req-7a9af0f5-e4ca-42f9-9093-118332026d44 service nova] Creating event network-changed:db6226c6-d5ed-4db3-92af-4e1534088960 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:56:28.940181 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-44f5224b-dde8-403c-9520-f01d9c503a27 req-7a9af0f5-e4ca-42f9-9093-118332026d44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105738 Sep 10 10:56:28.942937 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 726/3799] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:56:29.123565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-99e0d928-e4da-42c1-9860-e63c96d44f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:29.139957 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-99e0d928-e4da-42c1-9860-e63c96d44f40 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 0.604525 Sep 10 10:56:29.157542 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3074/3800] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:28 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:29.426475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3ac2f680-7ff0-4487-a6e6-6ef1f0a9227e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:29.427617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3ac2f680-7ff0-4487-a6e6-6ef1f0a9227e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:29.445254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ac2f680-7ff0-4487-a6e6-6ef1f0a9227e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:29.448160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ac2f680-7ff0-4487-a6e6-6ef1f0a9227e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:29.450749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ac2f680-7ff0-4487-a6e6-6ef1f0a9227e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:29.454245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ac2f680-7ff0-4487-a6e6-6ef1f0a9227e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:29.456109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ac2f680-7ff0-4487-a6e6-6ef1f0a9227e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:29.460984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ac2f680-7ff0-4487-a6e6-6ef1f0a9227e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:29.660839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3ac2f680-7ff0-4487-a6e6-6ef1f0a9227e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:29.673149 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3ac2f680-7ff0-4487-a6e6-6ef1f0a9227e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1275 microversion: 2.1 time: 0.249909 Sep 10 10:56:29.674149 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 727/3801] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:29 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:29.829432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-979a8212-2dd1-47bd-a1cc-790659ce9f90 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:29.830179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-979a8212-2dd1-47bd-a1cc-790659ce9f90 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:29.842514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:29.850790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-979a8212-2dd1-47bd-a1cc-790659ce9f90 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:29.852327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-979a8212-2dd1-47bd-a1cc-790659ce9f90 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:29.856299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-979a8212-2dd1-47bd-a1cc-790659ce9f90 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:29.861028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-979a8212-2dd1-47bd-a1cc-790659ce9f90 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:29.862272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-979a8212-2dd1-47bd-a1cc-790659ce9f90 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:29.865459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-979a8212-2dd1-47bd-a1cc-790659ce9f90 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:30.185682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9f2aab93-2d95-4e08-aab7-0e13faf9ffa1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:30.186407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9f2aab93-2d95-4e08-aab7-0e13faf9ffa1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:30.209102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f2aab93-2d95-4e08-aab7-0e13faf9ffa1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:30.213428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f2aab93-2d95-4e08-aab7-0e13faf9ffa1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:30.214230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f2aab93-2d95-4e08-aab7-0e13faf9ffa1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:30.216126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f2aab93-2d95-4e08-aab7-0e13faf9ffa1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:30.216826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f2aab93-2d95-4e08-aab7-0e13faf9ffa1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:30.217492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f2aab93-2d95-4e08-aab7-0e13faf9ffa1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:30.521738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-979a8212-2dd1-47bd-a1cc-790659ce9f90 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:30.537355 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-979a8212-2dd1-47bd-a1cc-790659ce9f90 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1331 microversion: 2.1 time: 0.710288 Sep 10 10:56:30.538459 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3075/3802] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:29 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1331 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:30.644766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b14deb3d-aa5e-4b36-8c68-1376c68cdd17 req-847a2294-906f-458c-a632-13380aee292b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6660934d-2fe2-435d-8901-5dc605841bb8", "name": "network-vif-plugged", "status": "completed", "tag": "b47a35b5-20a2-4086-8189-336a210a37db"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:30.671431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b14deb3d-aa5e-4b36-8c68-1376c68cdd17 req-847a2294-906f-458c-a632-13380aee292b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:30.688678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b14deb3d-aa5e-4b36-8c68-1376c68cdd17 req-847a2294-906f-458c-a632-13380aee292b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:30.690109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b14deb3d-aa5e-4b36-8c68-1376c68cdd17 req-847a2294-906f-458c-a632-13380aee292b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:30.738423 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b14deb3d-aa5e-4b36-8c68-1376c68cdd17 req-847a2294-906f-458c-a632-13380aee292b service nova] Creating event network-vif-plugged:b47a35b5-20a2-4086-8189-336a210a37db for instance 6660934d-2fe2-435d-8901-5dc605841bb8 on n-h2-856894-1 Sep 10 10:56:30.772847 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b14deb3d-aa5e-4b36-8c68-1376c68cdd17 req-847a2294-906f-458c-a632-13380aee292b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133205 Sep 10 10:56:30.775440 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3076/3803] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:30.813485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1858282c-a991-4a24-a209-b23234414aba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:30.824480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1858282c-a991-4a24-a209-b23234414aba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:30.846305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1858282c-a991-4a24-a209-b23234414aba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:30.847010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1858282c-a991-4a24-a209-b23234414aba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:30.848557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1858282c-a991-4a24-a209-b23234414aba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:30.850925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1858282c-a991-4a24-a209-b23234414aba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:30.854609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1858282c-a991-4a24-a209-b23234414aba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:30.856511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1858282c-a991-4a24-a209-b23234414aba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:31.117452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1858282c-a991-4a24-a209-b23234414aba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:31.137044 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1858282c-a991-4a24-a209-b23234414aba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1275 microversion: 2.1 time: 0.356330 Sep 10 10:56:31.137770 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3077/3804] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:30 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:31.141197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9f2aab93-2d95-4e08-aab7-0e13faf9ffa1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:31.153272 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9f2aab93-2d95-4e08-aab7-0e13faf9ffa1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 0.971762 Sep 10 10:56:31.165811 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 728/3805] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:30 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:31.567208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3bc5ad71-03b0-4a59-b6be-5fc115a75d4c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:31.568151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3bc5ad71-03b0-4a59-b6be-5fc115a75d4c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:31.580827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc5ad71-03b0-4a59-b6be-5fc115a75d4c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:31.582060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc5ad71-03b0-4a59-b6be-5fc115a75d4c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:31.582761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc5ad71-03b0-4a59-b6be-5fc115a75d4c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:31.584614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc5ad71-03b0-4a59-b6be-5fc115a75d4c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:31.586438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc5ad71-03b0-4a59-b6be-5fc115a75d4c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:31.587619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc5ad71-03b0-4a59-b6be-5fc115a75d4c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:32.053813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3bc5ad71-03b0-4a59-b6be-5fc115a75d4c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:32.067817 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3bc5ad71-03b0-4a59-b6be-5fc115a75d4c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1331 microversion: 2.1 time: 0.505019 Sep 10 10:56:32.069642 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3078/3806] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:31 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1331 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:32.165393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-31846da1-175c-4ff0-b083-f2cca7acbd24 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:32.170255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-31846da1-175c-4ff0-b083-f2cca7acbd24 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:32.179205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6278d87c-986a-40e5-b7aa-356f32d56b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:32.180117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6278d87c-986a-40e5-b7aa-356f32d56b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:32.205188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6278d87c-986a-40e5-b7aa-356f32d56b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:32.205695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6278d87c-986a-40e5-b7aa-356f32d56b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:32.206133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6278d87c-986a-40e5-b7aa-356f32d56b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:32.220803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31846da1-175c-4ff0-b083-f2cca7acbd24 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:32.221336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31846da1-175c-4ff0-b083-f2cca7acbd24 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:32.229440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6278d87c-986a-40e5-b7aa-356f32d56b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:32.243801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6278d87c-986a-40e5-b7aa-356f32d56b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:32.244432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6278d87c-986a-40e5-b7aa-356f32d56b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:32.244683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31846da1-175c-4ff0-b083-f2cca7acbd24 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:32.247652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31846da1-175c-4ff0-b083-f2cca7acbd24 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:32.251310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31846da1-175c-4ff0-b083-f2cca7acbd24 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:32.255316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31846da1-175c-4ff0-b083-f2cca7acbd24 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:32.634003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-31846da1-175c-4ff0-b083-f2cca7acbd24 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:32.658851 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-31846da1-175c-4ff0-b083-f2cca7acbd24 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1275 microversion: 2.1 time: 0.493058 Sep 10 10:56:32.664684 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 729/3807] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:32 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1275 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:32.886910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6278d87c-986a-40e5-b7aa-356f32d56b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:32.913483 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6278d87c-986a-40e5-b7aa-356f32d56b92 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 0.739590 Sep 10 10:56:32.914350 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3079/3808] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:32 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:33.093211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-46d2c37e-ccf2-45ad-8c89-4b8de1791dc9 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:33.093834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-46d2c37e-ccf2-45ad-8c89-4b8de1791dc9 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:33.116976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46d2c37e-ccf2-45ad-8c89-4b8de1791dc9 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:33.117643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46d2c37e-ccf2-45ad-8c89-4b8de1791dc9 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:33.118080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46d2c37e-ccf2-45ad-8c89-4b8de1791dc9 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:33.118791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46d2c37e-ccf2-45ad-8c89-4b8de1791dc9 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:33.119242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46d2c37e-ccf2-45ad-8c89-4b8de1791dc9 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:33.119664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46d2c37e-ccf2-45ad-8c89-4b8de1791dc9 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:33.687587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e9e872b4-fd21-4463-b4f4-e465eaee3938 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:33.688473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e9e872b4-fd21-4463-b4f4-e465eaee3938 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:33.716828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9e872b4-fd21-4463-b4f4-e465eaee3938 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:33.718360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9e872b4-fd21-4463-b4f4-e465eaee3938 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:33.719017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9e872b4-fd21-4463-b4f4-e465eaee3938 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:33.719955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9e872b4-fd21-4463-b4f4-e465eaee3938 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:33.723028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9e872b4-fd21-4463-b4f4-e465eaee3938 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:33.726549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9e872b4-fd21-4463-b4f4-e465eaee3938 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:34.234809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-46d2c37e-ccf2-45ad-8c89-4b8de1791dc9 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:34.256134 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-46d2c37e-ccf2-45ad-8c89-4b8de1791dc9 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1534 microversion: 2.1 time: 1.168076 Sep 10 10:56:34.261061 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 730/3809] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:33 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1534 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:34.268396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ad7c0187-d82e-4af1-920c-2e11aaf20c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:34.269352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ad7c0187-d82e-4af1-920c-2e11aaf20c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:34.276078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad7c0187-d82e-4af1-920c-2e11aaf20c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:34.277406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad7c0187-d82e-4af1-920c-2e11aaf20c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:34.278151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad7c0187-d82e-4af1-920c-2e11aaf20c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:34.279843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad7c0187-d82e-4af1-920c-2e11aaf20c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:34.281035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad7c0187-d82e-4af1-920c-2e11aaf20c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:34.281724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad7c0187-d82e-4af1-920c-2e11aaf20c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:34.390580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9e872b4-fd21-4463-b4f4-e465eaee3938 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:34.402748 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e9e872b4-fd21-4463-b4f4-e465eaee3938 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1317 microversion: 2.1 time: 0.721085 Sep 10 10:56:34.403995 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3080/3810] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:33 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1317 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:34.409847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4898ebcf-e377-4e12-b6b9-d9ca9d4a72d6 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Action: 'create', calling method: .version_select at 0x7efcae835430>, body: {"pool": "be469d3d-0481-4230-a0e7-ee870dd27e19"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:35.453800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ad7c0187-d82e-4af1-920c-2e11aaf20c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:35.472037 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ad7c0187-d82e-4af1-920c-2e11aaf20c90 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 1.208972 Sep 10 10:56:35.473142 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 731/3811] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:34 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:35.481853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dcb57fc4-e19e-46f1-a643-bf954dbb5293 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:35.487136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dcb57fc4-e19e-46f1-a643-bf954dbb5293 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:35.520979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb57fc4-e19e-46f1-a643-bf954dbb5293 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:35.523258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb57fc4-e19e-46f1-a643-bf954dbb5293 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:35.524303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb57fc4-e19e-46f1-a643-bf954dbb5293 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:35.526152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb57fc4-e19e-46f1-a643-bf954dbb5293 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:35.528740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb57fc4-e19e-46f1-a643-bf954dbb5293 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:35.530225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcb57fc4-e19e-46f1-a643-bf954dbb5293 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:36.138850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:36.432271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dcb57fc4-e19e-46f1-a643-bf954dbb5293 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:36.441389 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dcb57fc4-e19e-46f1-a643-bf954dbb5293 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1317 microversion: 2.1 time: 0.966928 Sep 10 10:56:36.448983 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 732/3812] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:35 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1317 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:36.514871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e975d13b-b9a4-4e07-ba5d-966c973e7de9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:36.515732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e975d13b-b9a4-4e07-ba5d-966c973e7de9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:36.534613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e975d13b-b9a4-4e07-ba5d-966c973e7de9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:36.538728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e975d13b-b9a4-4e07-ba5d-966c973e7de9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:36.545298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e975d13b-b9a4-4e07-ba5d-966c973e7de9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:36.546351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e975d13b-b9a4-4e07-ba5d-966c973e7de9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:36.547239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e975d13b-b9a4-4e07-ba5d-966c973e7de9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:36.550098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e975d13b-b9a4-4e07-ba5d-966c973e7de9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:36.914483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:37.537652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e975d13b-b9a4-4e07-ba5d-966c973e7de9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:37.566562 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e975d13b-b9a4-4e07-ba5d-966c973e7de9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 1.066383 Sep 10 10:56:37.568057 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 733/3813] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:36 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:37.583479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-478ff0e6-b5a8-48bc-a26d-b4659caa337d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:37.590401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-478ff0e6-b5a8-48bc-a26d-b4659caa337d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:37.616492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-478ff0e6-b5a8-48bc-a26d-b4659caa337d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:37.617002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-478ff0e6-b5a8-48bc-a26d-b4659caa337d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:37.617965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-478ff0e6-b5a8-48bc-a26d-b4659caa337d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:37.618760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-478ff0e6-b5a8-48bc-a26d-b4659caa337d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:37.619139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-478ff0e6-b5a8-48bc-a26d-b4659caa337d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:37.622061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-478ff0e6-b5a8-48bc-a26d-b4659caa337d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:38.417669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-478ff0e6-b5a8-48bc-a26d-b4659caa337d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:38.435324 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-478ff0e6-b5a8-48bc-a26d-b4659caa337d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1317 microversion: 2.1 time: 0.862395 Sep 10 10:56:38.442264 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 734/3814] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:37 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:38.463470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-27f7ab18-5ec9-4eee-b28b-91744116a246 req-b48bc060-3628-4c3b-8387-c0b43f507af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d66fe4eb-5aa7-4bad-8612-0322c812178b", "tag": "fc166757-0b43-4439-9cf7-3917e581453e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:38.507013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-27f7ab18-5ec9-4eee-b28b-91744116a246 req-b48bc060-3628-4c3b-8387-c0b43f507af1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:38.532334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-27f7ab18-5ec9-4eee-b28b-91744116a246 req-b48bc060-3628-4c3b-8387-c0b43f507af1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:38.533581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-27f7ab18-5ec9-4eee-b28b-91744116a246 req-b48bc060-3628-4c3b-8387-c0b43f507af1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:38.582370 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-27f7ab18-5ec9-4eee-b28b-91744116a246 req-b48bc060-3628-4c3b-8387-c0b43f507af1 service nova] Creating event network-changed:fc166757-0b43-4439-9cf7-3917e581453e for instance d66fe4eb-5aa7-4bad-8612-0322c812178b on n-h2-856894-1 Sep 10 10:56:38.599364 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-27f7ab18-5ec9-4eee-b28b-91744116a246 req-b48bc060-3628-4c3b-8387-c0b43f507af1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155414 Sep 10 10:56:38.607578 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 735/3815] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:38.626669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-965d7a04-e9d2-45ca-83e0-af5dc83d9946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:38.634484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-965d7a04-e9d2-45ca-83e0-af5dc83d9946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:38.649816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965d7a04-e9d2-45ca-83e0-af5dc83d9946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:38.650313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965d7a04-e9d2-45ca-83e0-af5dc83d9946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:38.650749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965d7a04-e9d2-45ca-83e0-af5dc83d9946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:38.651487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965d7a04-e9d2-45ca-83e0-af5dc83d9946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:38.652479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965d7a04-e9d2-45ca-83e0-af5dc83d9946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:38.652901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965d7a04-e9d2-45ca-83e0-af5dc83d9946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:39.572812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-965d7a04-e9d2-45ca-83e0-af5dc83d9946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:39.585428 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-965d7a04-e9d2-45ca-83e0-af5dc83d9946 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 0.976245 Sep 10 10:56:39.586019 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 736/3816] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:38 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:39.600142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-04f42aec-19f6-47c9-952b-e7d2d35bd26c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:39.600785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-04f42aec-19f6-47c9-952b-e7d2d35bd26c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:39.619243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04f42aec-19f6-47c9-952b-e7d2d35bd26c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:39.619751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04f42aec-19f6-47c9-952b-e7d2d35bd26c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:39.625042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04f42aec-19f6-47c9-952b-e7d2d35bd26c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:39.626101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04f42aec-19f6-47c9-952b-e7d2d35bd26c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:39.626743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04f42aec-19f6-47c9-952b-e7d2d35bd26c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:39.627439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04f42aec-19f6-47c9-952b-e7d2d35bd26c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:39.895102 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4898ebcf-e377-4e12-b6b9-d9ca9d4a72d6 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.489738 Sep 10 10:56:39.896794 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3081/3817] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:56:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:39.909728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.149"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:39.913489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:39.933968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:39.934575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:39.935531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:39.936375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:39.936847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:39.937321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:39.950344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:40.010522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:56:40.011727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquired lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:56:40.299929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-04f42aec-19f6-47c9-952b-e7d2d35bd26c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:40.311893 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-04f42aec-19f6-47c9-952b-e7d2d35bd26c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1317 microversion: 2.1 time: 0.724606 Sep 10 10:56:40.312281 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 737/3818] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:39 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1317 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:40.617838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a04f1536-686c-4d39-9a33-f22a428a5671 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:40.619083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a04f1536-686c-4d39-9a33-f22a428a5671 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:40.642821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04f1536-686c-4d39-9a33-f22a428a5671 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:40.645703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04f1536-686c-4d39-9a33-f22a428a5671 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:40.646539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04f1536-686c-4d39-9a33-f22a428a5671 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:40.648022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04f1536-686c-4d39-9a33-f22a428a5671 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:40.654073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04f1536-686c-4d39-9a33-f22a428a5671 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:40.655241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a04f1536-686c-4d39-9a33-f22a428a5671 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:41.073103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a04f1536-686c-4d39-9a33-f22a428a5671 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:41.082303 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a04f1536-686c-4d39-9a33-f22a428a5671 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 0.472257 Sep 10 10:56:41.082883 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 738/3819] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:40 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:41.348123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b265898b-85c1-47ac-ad2e-f6ae2fd09cf5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:41.348926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b265898b-85c1-47ac-ad2e-f6ae2fd09cf5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:41.358602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b265898b-85c1-47ac-ad2e-f6ae2fd09cf5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:41.359418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b265898b-85c1-47ac-ad2e-f6ae2fd09cf5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:41.360068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b265898b-85c1-47ac-ad2e-f6ae2fd09cf5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:41.360992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b265898b-85c1-47ac-ad2e-f6ae2fd09cf5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:41.361658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b265898b-85c1-47ac-ad2e-f6ae2fd09cf5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:41.362259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b265898b-85c1-47ac-ad2e-f6ae2fd09cf5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:42.350568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b265898b-85c1-47ac-ad2e-f6ae2fd09cf5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:42.363660 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b265898b-85c1-47ac-ad2e-f6ae2fd09cf5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1317 microversion: 2.1 time: 1.028821 Sep 10 10:56:42.364977 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 739/3820] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:41 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1317 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:42.382192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-38026d52-b64e-4e33-9edf-b8b811c541b0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:42.382836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-38026d52-b64e-4e33-9edf-b8b811c541b0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:42.417421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38026d52-b64e-4e33-9edf-b8b811c541b0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:42.421321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38026d52-b64e-4e33-9edf-b8b811c541b0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:42.421890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38026d52-b64e-4e33-9edf-b8b811c541b0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:42.423722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38026d52-b64e-4e33-9edf-b8b811c541b0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:42.424199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38026d52-b64e-4e33-9edf-b8b811c541b0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:42.424630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38026d52-b64e-4e33-9edf-b8b811c541b0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:43.156288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-38026d52-b64e-4e33-9edf-b8b811c541b0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:43.161188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:43.188426 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-38026d52-b64e-4e33-9edf-b8b811c541b0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1508 microversion: 2.1 time: 0.803231 Sep 10 10:56:43.191487 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 740/3821] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:42 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1508 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:43.394958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-15b6eddf-107e-4afe-8581-0cd64cdcc6e8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:43.396913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-15b6eddf-107e-4afe-8581-0cd64cdcc6e8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:43.410965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b6eddf-107e-4afe-8581-0cd64cdcc6e8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:43.411730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b6eddf-107e-4afe-8581-0cd64cdcc6e8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:43.412614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b6eddf-107e-4afe-8581-0cd64cdcc6e8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:43.413816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b6eddf-107e-4afe-8581-0cd64cdcc6e8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:43.414430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b6eddf-107e-4afe-8581-0cd64cdcc6e8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:43.415065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b6eddf-107e-4afe-8581-0cd64cdcc6e8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:43.510077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Building network info cache for instance {{(pid=128788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 10:56:44.443083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-15b6eddf-107e-4afe-8581-0cd64cdcc6e8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:44.454478 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-15b6eddf-107e-4afe-8581-0cd64cdcc6e8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1317 microversion: 2.1 time: 1.065049 Sep 10 10:56:44.456010 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 741/3822] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:43 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1317 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:44.461180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-53594001-c87d-42bc-8ac5-052222926df1 req-43e3560c-8f4e-4919-bcaf-66c569d188b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6660934d-2fe2-435d-8901-5dc605841bb8", "tag": "b47a35b5-20a2-4086-8189-336a210a37db"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:44.472723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-53594001-c87d-42bc-8ac5-052222926df1 req-43e3560c-8f4e-4919-bcaf-66c569d188b8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:44.473576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-53594001-c87d-42bc-8ac5-052222926df1 req-43e3560c-8f4e-4919-bcaf-66c569d188b8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:44.474544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-53594001-c87d-42bc-8ac5-052222926df1 req-43e3560c-8f4e-4919-bcaf-66c569d188b8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:44.490700 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-53594001-c87d-42bc-8ac5-052222926df1 req-43e3560c-8f4e-4919-bcaf-66c569d188b8 service nova] Creating event network-changed:b47a35b5-20a2-4086-8189-336a210a37db for instance 6660934d-2fe2-435d-8901-5dc605841bb8 on n-h2-856894-1 Sep 10 10:56:44.510174 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-53594001-c87d-42bc-8ac5-052222926df1 req-43e3560c-8f4e-4919-bcaf-66c569d188b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052450 Sep 10 10:56:44.512258 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 742/3823] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:44.519627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7c84e433-cf31-4415-aeb3-27837d1de7ee tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:44.521161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7c84e433-cf31-4415-aeb3-27837d1de7ee tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:44.531436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c84e433-cf31-4415-aeb3-27837d1de7ee tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:44.532375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c84e433-cf31-4415-aeb3-27837d1de7ee tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:44.533448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c84e433-cf31-4415-aeb3-27837d1de7ee tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:44.534608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c84e433-cf31-4415-aeb3-27837d1de7ee tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:44.535292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c84e433-cf31-4415-aeb3-27837d1de7ee tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:44.536016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c84e433-cf31-4415-aeb3-27837d1de7ee tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:45.346034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7c84e433-cf31-4415-aeb3-27837d1de7ee tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:45.356221 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7c84e433-cf31-4415-aeb3-27837d1de7ee tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1505 microversion: 2.1 time: 0.840420 Sep 10 10:56:45.356843 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 743/3824] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:44 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1505 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:45.483456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e85fbc3a-434c-42fd-8e47-46b01aaa748e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:45.484886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e85fbc3a-434c-42fd-8e47-46b01aaa748e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:45.500959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e85fbc3a-434c-42fd-8e47-46b01aaa748e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:45.503110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e85fbc3a-434c-42fd-8e47-46b01aaa748e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:45.503780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e85fbc3a-434c-42fd-8e47-46b01aaa748e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:45.506847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e85fbc3a-434c-42fd-8e47-46b01aaa748e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:45.508527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e85fbc3a-434c-42fd-8e47-46b01aaa748e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:45.513992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e85fbc3a-434c-42fd-8e47-46b01aaa748e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:46.263128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Updating instance_info_cache with network_info: [{"id": "b47a35b5-20a2-4086-8189-336a210a37db", "address": "fa:16:3e:12:87:a8", "network": {"id": "225d4f58-0f1e-435c-90d4-d12917652e53", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-837707835-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dedc5802df604af99afeca8e8fb9b0b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb47a35b5-20", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:56:46.286689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Releasing lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:56:46.287426 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0ca2c2b3-9ad7-47ff-a0ea-92696c0ae470 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action" status: 202 len: 0 microversion: 2.1 time: 6.382785 Sep 10 10:56:46.288056 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3082/3825] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:56:39 2022] POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action => generated 0 bytes in 6384 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 10 10:56:46.309823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4426e24f-fd7a-425d-9e49-f7ea21aa33ca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Action: 'create', calling method: .version_select at 0x7efcaea2f1f0>, body: {"pool": "be469d3d-0481-4230-a0e7-ee870dd27e19"} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:47.106534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e85fbc3a-434c-42fd-8e47-46b01aaa748e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:47.174346 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e85fbc3a-434c-42fd-8e47-46b01aaa748e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1317 microversion: 2.1 time: 1.697054 Sep 10 10:56:47.180898 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 744/3826] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:45 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1317 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:47.201770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6cf6fac2-45c9-42a8-9368-11afbef20fbc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:47.202788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6cf6fac2-45c9-42a8-9368-11afbef20fbc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:47.209245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6cf6fac2-45c9-42a8-9368-11afbef20fbc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:47.210208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6cf6fac2-45c9-42a8-9368-11afbef20fbc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:47.211019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6cf6fac2-45c9-42a8-9368-11afbef20fbc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:47.211988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6cf6fac2-45c9-42a8-9368-11afbef20fbc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:47.212772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6cf6fac2-45c9-42a8-9368-11afbef20fbc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:47.213445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6cf6fac2-45c9-42a8-9368-11afbef20fbc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:47.527578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6cf6fac2-45c9-42a8-9368-11afbef20fbc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:47.536215 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6cf6fac2-45c9-42a8-9368-11afbef20fbc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1505 microversion: 2.1 time: 0.348100 Sep 10 10:56:47.536808 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 745/3827] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:47 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:47.564045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-abbdadad-d0ca-4cdf-8edd-0b06cf0cb391 req-38762653-dacf-4472-91e2-bde85f41b011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f28c4d-0eff-48f6-8fc0-51f95a07d38e", "name": "network-vif-unplugged", "status": "completed", "tag": "0b358bb6-e978-4218-93e3-25b76d5933d4"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:47.586100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-abbdadad-d0ca-4cdf-8edd-0b06cf0cb391 req-38762653-dacf-4472-91e2-bde85f41b011 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:47.586859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-abbdadad-d0ca-4cdf-8edd-0b06cf0cb391 req-38762653-dacf-4472-91e2-bde85f41b011 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:47.587703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-abbdadad-d0ca-4cdf-8edd-0b06cf0cb391 req-38762653-dacf-4472-91e2-bde85f41b011 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:47.602233 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-abbdadad-d0ca-4cdf-8edd-0b06cf0cb391 req-38762653-dacf-4472-91e2-bde85f41b011 service nova] Creating event network-vif-unplugged:0b358bb6-e978-4218-93e3-25b76d5933d4 for instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e on n-h2-856894-1 Sep 10 10:56:47.608685 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-abbdadad-d0ca-4cdf-8edd-0b06cf0cb391 req-38762653-dacf-4472-91e2-bde85f41b011 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070465 Sep 10 10:56:47.609677 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 746/3828] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:48.212711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0034297e-3648-43b6-8587-5ea502c09915 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:48.214390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0034297e-3648-43b6-8587-5ea502c09915 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:48.233501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0034297e-3648-43b6-8587-5ea502c09915 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:48.234143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0034297e-3648-43b6-8587-5ea502c09915 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:48.235464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0034297e-3648-43b6-8587-5ea502c09915 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:48.237435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0034297e-3648-43b6-8587-5ea502c09915 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:48.238770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0034297e-3648-43b6-8587-5ea502c09915 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:48.242391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0034297e-3648-43b6-8587-5ea502c09915 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:49.080706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0034297e-3648-43b6-8587-5ea502c09915 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:49.106916 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0034297e-3648-43b6-8587-5ea502c09915 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1317 microversion: 2.1 time: 0.904694 Sep 10 10:56:49.108270 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 747/3829] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:48 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:49.115893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2c3015bb-e387-48cb-98ba-2f7429ba31e9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:49.116848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2c3015bb-e387-48cb-98ba-2f7429ba31e9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:49.127491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c3015bb-e387-48cb-98ba-2f7429ba31e9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:49.128847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c3015bb-e387-48cb-98ba-2f7429ba31e9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:49.130096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c3015bb-e387-48cb-98ba-2f7429ba31e9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:49.131884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c3015bb-e387-48cb-98ba-2f7429ba31e9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:49.132602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c3015bb-e387-48cb-98ba-2f7429ba31e9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:49.133474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c3015bb-e387-48cb-98ba-2f7429ba31e9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:49.484400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2c3015bb-e387-48cb-98ba-2f7429ba31e9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:49.513630 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2c3015bb-e387-48cb-98ba-2f7429ba31e9 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 200 len: 1448 microversion: 2.1 time: 0.398460 Sep 10 10:56:49.515404 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 748/3830] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:49 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 1448 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:49.542935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-132777e9-6fa8-4a91-8025-fa1b884b399d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:49.545303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-132777e9-6fa8-4a91-8025-fa1b884b399d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:49.563184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132777e9-6fa8-4a91-8025-fa1b884b399d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:49.564070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132777e9-6fa8-4a91-8025-fa1b884b399d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:49.564720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132777e9-6fa8-4a91-8025-fa1b884b399d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:49.566534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132777e9-6fa8-4a91-8025-fa1b884b399d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:49.567378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132777e9-6fa8-4a91-8025-fa1b884b399d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:49.568004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132777e9-6fa8-4a91-8025-fa1b884b399d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:49.928847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=13 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:50.020261 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-132777e9-6fa8-4a91-8025-fa1b884b399d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:50.033175 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-132777e9-6fa8-4a91-8025-fa1b884b399d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.493940 Sep 10 10:56:50.035870 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 749/3831] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:49 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:50.054464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7f2f63ae-8708-4939-b822-f3438d2fc4be req-f5f7a00f-d33b-4ea0-965a-2255da990308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66fe4eb-5aa7-4bad-8612-0322c812178b", "name": "network-vif-plugged", "status": "completed", "tag": "fc166757-0b43-4439-9cf7-3917e581453e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:50.076758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7f2f63ae-8708-4939-b822-f3438d2fc4be req-f5f7a00f-d33b-4ea0-965a-2255da990308 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:50.077284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7f2f63ae-8708-4939-b822-f3438d2fc4be req-f5f7a00f-d33b-4ea0-965a-2255da990308 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:50.077894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7f2f63ae-8708-4939-b822-f3438d2fc4be req-f5f7a00f-d33b-4ea0-965a-2255da990308 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:50.093132 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7f2f63ae-8708-4939-b822-f3438d2fc4be req-f5f7a00f-d33b-4ea0-965a-2255da990308 service nova] Creating event network-vif-plugged:fc166757-0b43-4439-9cf7-3917e581453e for instance d66fe4eb-5aa7-4bad-8612-0322c812178b on n-h2-856894-1 Sep 10 10:56:50.099473 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-7f2f63ae-8708-4939-b822-f3438d2fc4be req-f5f7a00f-d33b-4ea0-965a-2255da990308 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061953 Sep 10 10:56:50.100381 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 750/3832] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:50.106599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c4b1976d-a3ed-4043-b3fa-611ee8f19c47 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:50.107571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c4b1976d-a3ed-4043-b3fa-611ee8f19c47 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:50.145645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4b1976d-a3ed-4043-b3fa-611ee8f19c47 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:50.146539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4b1976d-a3ed-4043-b3fa-611ee8f19c47 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:50.155351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4b1976d-a3ed-4043-b3fa-611ee8f19c47 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:50.156632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4b1976d-a3ed-4043-b3fa-611ee8f19c47 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:50.158158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4b1976d-a3ed-4043-b3fa-611ee8f19c47 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:50.161997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4b1976d-a3ed-4043-b3fa-611ee8f19c47 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:50.209693 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4426e24f-fd7a-425d-9e49-f7ea21aa33ca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.915249 Sep 10 10:56:50.224091 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3083/3833] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:56:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:50.234775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b3a9d0d0-d122-4049-a8f4-cceb8abf3a2c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:50.235569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b3a9d0d0-d122-4049-a8f4-cceb8abf3a2c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:50.261843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a9d0d0-d122-4049-a8f4-cceb8abf3a2c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:50.262476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a9d0d0-d122-4049-a8f4-cceb8abf3a2c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:50.263963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a9d0d0-d122-4049-a8f4-cceb8abf3a2c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:50.264709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a9d0d0-d122-4049-a8f4-cceb8abf3a2c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:50.267117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a9d0d0-d122-4049-a8f4-cceb8abf3a2c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:50.267653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a9d0d0-d122-4049-a8f4-cceb8abf3a2c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:50.572425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b3a9d0d0-d122-4049-a8f4-cceb8abf3a2c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:50.600403 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b3a9d0d0-d122-4049-a8f4-cceb8abf3a2c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1317 microversion: 2.1 time: 0.375015 Sep 10 10:56:50.601962 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3084/3834] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:50 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:50.613275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.176"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:50.623543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:50.632620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:50.633678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:50.634506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:50.636800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:50.641579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c4b1976d-a3ed-4043-b3fa-611ee8f19c47 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:50.652423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:50.654189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:50.658305 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c4b1976d-a3ed-4043-b3fa-611ee8f19c47 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.556271 Sep 10 10:56:50.659171 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 751/3835] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:50 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:50.684522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-44040c79-9a8b-4845-841d-875a779b6ebc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:50.685178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-44040c79-9a8b-4845-841d-875a779b6ebc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:50.691718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44040c79-9a8b-4845-841d-875a779b6ebc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:50.692439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44040c79-9a8b-4845-841d-875a779b6ebc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:50.693031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44040c79-9a8b-4845-841d-875a779b6ebc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:50.693977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44040c79-9a8b-4845-841d-875a779b6ebc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:50.694581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44040c79-9a8b-4845-841d-875a779b6ebc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:50.695161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44040c79-9a8b-4845-841d-875a779b6ebc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:50.769189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:56:50.780792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquired lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:56:51.975069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.176 (581942ee-d72c-4f5f-b024-351ef9418059) with port b47a35b5-20a2-4086-8189-336a210a37db using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network be469d3d-0481-4230-a0e7-ee870dd27e19.", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:56:51.975999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Releasing lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:56:51.976259 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.176 (581942ee-d72c-4f5f-b024-351ef9418059) with port b47a35b5-20a2-4086-8189-336a210a37db using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network be469d3d-0481-4230-a0e7-ee870dd27e19. Sep 10 10:56:51.976259 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-d8d53d19-bfe2-4c33-a0b8-49254703df35'] Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Request method failure captured: Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action HTTP/1.1 Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 46 Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG1I_-FOgBWXw6TxCLc4FZv8gjQDzaB61z2ObO11uOlEyDRUxY-JsbzE3WPY1XHKefb6SPI6dkSTorcZHJgf_YIB3rSxGJUdiQdjfs-d2wYGOJw53KEvpSRfwzWwIaTRVoVCqAHphK0jdoE4PnmRzAvZqcnGyJEzPgpweIF7bull58o Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: dedc5802df604af99afeca8e8fb9b0b2 Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dedc5802df604af99afeca8e8fb9b0b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: dedc5802df604af99afeca8e8fb9b0b2 Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: b536a4f15c4e47f1a5cfda2b8ad861f8 Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: {"addFloatingIp": {"address": "172.25.6.176"}} Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot associate floating IP 172.25.6.176 (581942ee-d72c-4f5f-b024-351ef9418059) with port b47a35b5-20a2-4086-8189-336a210a37db using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network be469d3d-0481-4230-a0e7-ee870dd27e19. Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-d8d53d19-bfe2-4c33-a0b8-49254703df35'] Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '6660934d-2fe2-435d-8901-5dc605841bb8', 'body': {'addFloatingIp': {'address': '172.25.6.176'}}} Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:56:51.978541 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.176 (581942ee-d72c-4f5f-b024-351ef9418059) with port b47a35b5-20a2-4086-8189-336a210a37db using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network be469d3d-0481-4230-a0e7-ee870dd27e19. Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8d53d19-bfe2-4c33-a0b8-49254703df35'] Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.176 (581942ee-d72c-4f5f-b024-351ef9418059) with port b47a35b5-20a2-4086-8189-336a210a37db using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network be469d3d-0481-4230-a0e7-ee870dd27e19. Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8d53d19-bfe2-4c33-a0b8-49254703df35'] Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.176 (581942ee-d72c-4f5f-b024-351ef9418059) with port b47a35b5-20a2-4086-8189-336a210a37db using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network be469d3d-0481-4230-a0e7-ee870dd27e19. Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8d53d19-bfe2-4c33-a0b8-49254703df35'] Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.176 (581942ee-d72c-4f5f-b024-351ef9418059) with port b47a35b5-20a2-4086-8189-336a210a37db using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network be469d3d-0481-4230-a0e7-ee870dd27e19. Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8d53d19-bfe2-4c33-a0b8-49254703df35'] Sep 10 10:56:51.983425 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:51.987718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Returning 400 to user: Cannot associate floating IP 172.25.6.176 (581942ee-d72c-4f5f-b024-351ef9418059) with port b47a35b5-20a2-4086-8189-336a210a37db using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network be469d3d-0481-4230-a0e7-ee870dd27e19. Sep 10 10:56:51.987718 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-d8d53d19-bfe2-4c33-a0b8-49254703df35'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:56:51.987718 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8f5783e-a352-4dce-8dcb-e5262b1779a5 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action" status: 400 len: 381 microversion: 2.1 time: 1.374627 Sep 10 10:56:51.987718 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3085/3836] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:56:50 2022] POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action => generated 381 bytes in 1381 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:56:51.997738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-44040c79-9a8b-4845-841d-875a779b6ebc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:51.998346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d899a38f-6e9e-4d79-9b0a-688bec9db259 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:51.998640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d899a38f-6e9e-4d79-9b0a-688bec9db259 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:52.017667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d899a38f-6e9e-4d79-9b0a-688bec9db259 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:52.017902 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-44040c79-9a8b-4845-841d-875a779b6ebc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 1.336901 Sep 10 10:56:52.018057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d899a38f-6e9e-4d79-9b0a-688bec9db259 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:52.019233 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 752/3837] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:50 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:52.019354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d899a38f-6e9e-4d79-9b0a-688bec9db259 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:52.020010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d899a38f-6e9e-4d79-9b0a-688bec9db259 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:52.020478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d899a38f-6e9e-4d79-9b0a-688bec9db259 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:52.020910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d899a38f-6e9e-4d79-9b0a-688bec9db259 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:52.053421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-86529dd6-a8e3-403e-aa5b-ebf75217f57e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '.version_select at 0x7efcaf11a160>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:52.582519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d899a38f-6e9e-4d79-9b0a-688bec9db259 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:52.595091 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d899a38f-6e9e-4d79-9b0a-688bec9db259 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1507 microversion: 2.1 time: 0.609539 Sep 10 10:56:52.617890 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3086/3838] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:51 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1507 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:52.623376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78e09393-b270-4432-a7ee-2cf59ed61f10 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:52.631122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78e09393-b270-4432-a7ee-2cf59ed61f10 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:52.647950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e09393-b270-4432-a7ee-2cf59ed61f10 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:52.648463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e09393-b270-4432-a7ee-2cf59ed61f10 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:52.648914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e09393-b270-4432-a7ee-2cf59ed61f10 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:52.654571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e09393-b270-4432-a7ee-2cf59ed61f10 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:52.655754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e09393-b270-4432-a7ee-2cf59ed61f10 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:52.657500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78e09393-b270-4432-a7ee-2cf59ed61f10 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:53.717591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-78e09393-b270-4432-a7ee-2cf59ed61f10 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:53.731627 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78e09393-b270-4432-a7ee-2cf59ed61f10 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 1.112248 Sep 10 10:56:53.742180 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3087/3839] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:52 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:53.749969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23857acf-697b-4e87-bde4-697f72d71161 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:53.750349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23857acf-697b-4e87-bde4-697f72d71161 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:53.762203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857acf-697b-4e87-bde4-697f72d71161 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:53.762693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857acf-697b-4e87-bde4-697f72d71161 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:53.768761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857acf-697b-4e87-bde4-697f72d71161 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:53.773468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857acf-697b-4e87-bde4-697f72d71161 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:53.774148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857acf-697b-4e87-bde4-697f72d71161 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:53.774747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23857acf-697b-4e87-bde4-697f72d71161 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:53.831012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23857acf-697b-4e87-bde4-697f72d71161 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:56:54.002072 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23857acf-697b-4e87-bde4-697f72d71161 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 204 len: 0 microversion: 2.1 time: 0.257636 Sep 10 10:56:54.002697 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3088/3840] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:56:53 2022] DELETE /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:56:54.015045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aeda6eac-2977-48a4-9afe-2bd06f18a756 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:54.040713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeda6eac-2977-48a4-9afe-2bd06f18a756 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:54.043954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeda6eac-2977-48a4-9afe-2bd06f18a756 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:54.044436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeda6eac-2977-48a4-9afe-2bd06f18a756 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:54.091472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aeda6eac-2977-48a4-9afe-2bd06f18a756 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Going to try to stop instance {{(pid=128788) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 10:56:54.150739 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aeda6eac-2977-48a4-9afe-2bd06f18a756 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.146132 Sep 10 10:56:54.155852 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3089/3841] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:56:54 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:56:54.160030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8874667-21c0-4e90-aa1e-423ce4c8f70a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:54.160830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8874667-21c0-4e90-aa1e-423ce4c8f70a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:54.170133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8874667-21c0-4e90-aa1e-423ce4c8f70a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:54.170459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8874667-21c0-4e90-aa1e-423ce4c8f70a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:54.170842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8874667-21c0-4e90-aa1e-423ce4c8f70a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:54.171550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8874667-21c0-4e90-aa1e-423ce4c8f70a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:54.172338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8874667-21c0-4e90-aa1e-423ce4c8f70a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:54.174165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8874667-21c0-4e90-aa1e-423ce4c8f70a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:54.522706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c8874667-21c0-4e90-aa1e-423ce4c8f70a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:54.534573 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8874667-21c0-4e90-aa1e-423ce4c8f70a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1513 microversion: 2.1 time: 0.380486 Sep 10 10:56:54.535373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3090/3842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:54 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1513 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:54.545260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48b9c4df-ec0c-4132-a99a-cf232e816c0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:54.546457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-48b9c4df-ec0c-4132-a99a-cf232e816c0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:54.569193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48b9c4df-ec0c-4132-a99a-cf232e816c0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:54.570547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48b9c4df-ec0c-4132-a99a-cf232e816c0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:54.571000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48b9c4df-ec0c-4132-a99a-cf232e816c0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:54.572749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48b9c4df-ec0c-4132-a99a-cf232e816c0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:54.581294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48b9c4df-ec0c-4132-a99a-cf232e816c0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:54.583465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48b9c4df-ec0c-4132-a99a-cf232e816c0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:54.894262 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-86529dd6-a8e3-403e-aa5b-ebf75217f57e tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/581942ee-d72c-4f5f-b024-351ef9418059" status: 202 len: 0 microversion: 2.1 time: 2.873327 Sep 10 10:56:54.898241 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 753/3843] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:56:52 2022] DELETE /compute/v2.1/os-floating-ips/581942ee-d72c-4f5f-b024-351ef9418059 => generated 0 bytes in 2878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:56:54.904149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Action: 'action', calling method: .version_select at 0x7efcb1115820>, body: {"removeFloatingIp": {"address": "172.25.6.149"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:55.027944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-48b9c4df-ec0c-4132-a99a-cf232e816c0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:55.041872 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-48b9c4df-ec0c-4132-a99a-cf232e816c0a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.502800 Sep 10 10:56:55.044952 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3091/3844] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:54 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:55.232661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:55.251921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:55.253521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:55.254033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:55.254548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:55.255272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:55.266750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:55.267215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:55.562480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5aec8453-7cab-428f-adbb-4d5e9bc46e83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:55.563354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5aec8453-7cab-428f-adbb-4d5e9bc46e83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:55.573427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5aec8453-7cab-428f-adbb-4d5e9bc46e83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:55.602009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5aec8453-7cab-428f-adbb-4d5e9bc46e83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:55.602710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5aec8453-7cab-428f-adbb-4d5e9bc46e83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:55.603626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5aec8453-7cab-428f-adbb-4d5e9bc46e83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:55.604799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5aec8453-7cab-428f-adbb-4d5e9bc46e83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:55.606046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5aec8453-7cab-428f-adbb-4d5e9bc46e83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:56.018989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5aec8453-7cab-428f-adbb-4d5e9bc46e83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:56.036552 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5aec8453-7cab-428f-adbb-4d5e9bc46e83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1513 microversion: 2.1 time: 0.476440 Sep 10 10:56:56.057268 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3092/3845] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:55 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1513 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:56.072490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b16bf110-d4ec-46dd-b104-cd90557bdedc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:56.073629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b16bf110-d4ec-46dd-b104-cd90557bdedc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:56.091816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b16bf110-d4ec-46dd-b104-cd90557bdedc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:56.096815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b16bf110-d4ec-46dd-b104-cd90557bdedc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:56.097683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b16bf110-d4ec-46dd-b104-cd90557bdedc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:56.099140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b16bf110-d4ec-46dd-b104-cd90557bdedc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:56.099989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b16bf110-d4ec-46dd-b104-cd90557bdedc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:56.100850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b16bf110-d4ec-46dd-b104-cd90557bdedc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:56.156108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:56:56.156628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquired lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:56:56.621381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b16bf110-d4ec-46dd-b104-cd90557bdedc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:56.631666 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b16bf110-d4ec-46dd-b104-cd90557bdedc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.563299 Sep 10 10:56:56.632263 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3093/3846] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:56 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:57.069774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-197a6fe4-293f-45e6-8519-bf5b564e9b63 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:57.071346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-197a6fe4-293f-45e6-8519-bf5b564e9b63 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:57.085280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-197a6fe4-293f-45e6-8519-bf5b564e9b63 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:57.086368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-197a6fe4-293f-45e6-8519-bf5b564e9b63 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:57.087102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-197a6fe4-293f-45e6-8519-bf5b564e9b63 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:57.088965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-197a6fe4-293f-45e6-8519-bf5b564e9b63 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:57.089755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-197a6fe4-293f-45e6-8519-bf5b564e9b63 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:57.091482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-197a6fe4-293f-45e6-8519-bf5b564e9b63 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:57.362151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-197a6fe4-293f-45e6-8519-bf5b564e9b63 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:57.375787 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-197a6fe4-293f-45e6-8519-bf5b564e9b63 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1513 microversion: 2.1 time: 0.310190 Sep 10 10:56:57.377264 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3094/3847] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:57 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:57.660547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-08a05cd5-e494-4cf8-9234-5d0023953f38 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:57.661384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-08a05cd5-e494-4cf8-9234-5d0023953f38 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:57.677009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a05cd5-e494-4cf8-9234-5d0023953f38 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:57.677948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a05cd5-e494-4cf8-9234-5d0023953f38 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:57.678781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a05cd5-e494-4cf8-9234-5d0023953f38 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:57.679565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a05cd5-e494-4cf8-9234-5d0023953f38 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:57.680249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a05cd5-e494-4cf8-9234-5d0023953f38 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:57.681552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08a05cd5-e494-4cf8-9234-5d0023953f38 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:58.150172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-08a05cd5-e494-4cf8-9234-5d0023953f38 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:58.168238 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-08a05cd5-e494-4cf8-9234-5d0023953f38 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.510239 Sep 10 10:56:58.173927 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3095/3848] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:57 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:58.181334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-48b16afe-7588-4502-af8b-fdc03f36f45d req-1e8dc8a2-b21c-4dcc-894d-36ad2dad4c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66fe4eb-5aa7-4bad-8612-0322c812178b", "name": "network-vif-deleted", "tag": "fc166757-0b43-4439-9cf7-3917e581453e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:56:58.209375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-48b16afe-7588-4502-af8b-fdc03f36f45d req-1e8dc8a2-b21c-4dcc-894d-36ad2dad4c1b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:58.211215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-48b16afe-7588-4502-af8b-fdc03f36f45d req-1e8dc8a2-b21c-4dcc-894d-36ad2dad4c1b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:58.213023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-48b16afe-7588-4502-af8b-fdc03f36f45d req-1e8dc8a2-b21c-4dcc-894d-36ad2dad4c1b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:58.242327 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-48b16afe-7588-4502-af8b-fdc03f36f45d req-1e8dc8a2-b21c-4dcc-894d-36ad2dad4c1b service nova] Creating event network-vif-deleted:fc166757-0b43-4439-9cf7-3917e581453e for instance d66fe4eb-5aa7-4bad-8612-0322c812178b on n-h2-856894-1 Sep 10 10:56:58.253300 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-48b16afe-7588-4502-af8b-fdc03f36f45d req-1e8dc8a2-b21c-4dcc-894d-36ad2dad4c1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077731 Sep 10 10:56:58.256206 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3096/3849] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:56:58.399971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:58.401227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:58.412712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:58.421810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:58.422389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:58.423162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:58.423643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:58.424071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:58.429917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:56:58.588100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:58.589738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:58.590378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:58.591075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lazy-loading 'fault' on Instance uuid d66fe4eb-5aa7-4bad-8612-0322c812178b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:56:58.793180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:58.808670 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b2dffffb-ee20-4fe4-994a-f03364c95b75 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 200 len: 1307 microversion: 2.1 time: 0.412957 Sep 10 10:56:58.826966 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3097/3850] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:58 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 1307 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:56:58.856944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Building network info cache for instance {{(pid=128787) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 10:56:59.195712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a43ac6db-001d-4a3a-a19c-439b734bc40c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:59.196341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a43ac6db-001d-4a3a-a19c-439b734bc40c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:59.219827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a43ac6db-001d-4a3a-a19c-439b734bc40c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:59.220328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a43ac6db-001d-4a3a-a19c-439b734bc40c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:59.220772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a43ac6db-001d-4a3a-a19c-439b734bc40c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:59.221604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a43ac6db-001d-4a3a-a19c-439b734bc40c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:59.222067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a43ac6db-001d-4a3a-a19c-439b734bc40c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:59.223016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a43ac6db-001d-4a3a-a19c-439b734bc40c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:59.649723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a43ac6db-001d-4a3a-a19c-439b734bc40c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:56:59.659175 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a43ac6db-001d-4a3a-a19c-439b734bc40c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.467235 Sep 10 10:56:59.674247 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3098/3851] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:59 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:56:59.872303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:59.878438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:59.892258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:59.892820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:59.893773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:59.894563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:59.895031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:59.895468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:59.918732 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b HTTP/1.1 Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd66fe4eb-5aa7-4bad-8612-0322c812178b'} Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:56:59.920411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:59.933824 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:56:59.933824 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:56:59.933824 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:56:59.933824 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:56:59.933824 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:56:59.933824 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:56:59.933824 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:56:59.933824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:56:59.936332 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ada3ebe6-1caf-48c9-a05c-af0ec551c91d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 404 len: 111 microversion: 2.1 time: 0.070420 Sep 10 10:56:59.938516 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3099/3852] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:59 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:56:59.955991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2236279-6a3e-4904-87df-5d3c7d605b0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:56:59.962133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e2236279-6a3e-4904-87df-5d3c7d605b0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:56:59.972856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2236279-6a3e-4904-87df-5d3c7d605b0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:59.985324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2236279-6a3e-4904-87df-5d3c7d605b0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:59.985985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2236279-6a3e-4904-87df-5d3c7d605b0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:56:59.986916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2236279-6a3e-4904-87df-5d3c7d605b0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:56:59.992897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2236279-6a3e-4904-87df-5d3c7d605b0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:56:59.994392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2236279-6a3e-4904-87df-5d3c7d605b0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:01.493500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e2236279-6a3e-4904-87df-5d3c7d605b0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:01.504025 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2236279-6a3e-4904-87df-5d3c7d605b0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.553574 Sep 10 10:57:01.504787 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3100/3853] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:56:59 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:01.509477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-61e496a7-eb00-4af3-8922-ffcb123eb60e req-46bd70d4-39ad-4dee-bef7-07afe324f94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6660934d-2fe2-435d-8901-5dc605841bb8", "tag": "b47a35b5-20a2-4086-8189-336a210a37db"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:01.529850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-61e496a7-eb00-4af3-8922-ffcb123eb60e req-46bd70d4-39ad-4dee-bef7-07afe324f94d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:01.530589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-61e496a7-eb00-4af3-8922-ffcb123eb60e req-46bd70d4-39ad-4dee-bef7-07afe324f94d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:01.531021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-61e496a7-eb00-4af3-8922-ffcb123eb60e req-46bd70d4-39ad-4dee-bef7-07afe324f94d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:01.568918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-61e496a7-eb00-4af3-8922-ffcb123eb60e req-46bd70d4-39ad-4dee-bef7-07afe324f94d service nova] Creating event network-changed:b47a35b5-20a2-4086-8189-336a210a37db for instance 6660934d-2fe2-435d-8901-5dc605841bb8 on n-h2-856894-1 Sep 10 10:57:01.581105 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-61e496a7-eb00-4af3-8922-ffcb123eb60e req-46bd70d4-39ad-4dee-bef7-07afe324f94d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074940 Sep 10 10:57:01.596202 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3101/3854] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:57:01.607736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9f1c1818-fee3-499f-8f53-f1c7e3129bd0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:01.608458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9f1c1818-fee3-499f-8f53-f1c7e3129bd0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:01.621428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1c1818-fee3-499f-8f53-f1c7e3129bd0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:01.621924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1c1818-fee3-499f-8f53-f1c7e3129bd0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:01.622423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1c1818-fee3-499f-8f53-f1c7e3129bd0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:01.623687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1c1818-fee3-499f-8f53-f1c7e3129bd0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:01.624522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1c1818-fee3-499f-8f53-f1c7e3129bd0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:01.637379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1c1818-fee3-499f-8f53-f1c7e3129bd0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:02.996484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9f1c1818-fee3-499f-8f53-f1c7e3129bd0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:03.019262 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9f1c1818-fee3-499f-8f53-f1c7e3129bd0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 1.417375 Sep 10 10:57:03.021767 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3102/3855] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:01 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:03.034013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ad86600-d203-4721-a7b1-d940d2d11448 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ad86600-d203-4721-a7b1-d940d2d11448 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 163 Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": 12345, "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 12345 Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:57:03.042338 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 10 10:57:03.048392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:03.055449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ad86600-d203-4721-a7b1-d940d2d11448 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:03.058516 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3ad86600-d203-4721-a7b1-d940d2d11448 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.034074 Sep 10 10:57:03.060258 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3103/3856] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:03 2022] POST /compute/v2.1/servers => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:57:03.072016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bff25d21-8211-4605-881d-7c8194cf05af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:03.076318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bff25d21-8211-4605-881d-7c8194cf05af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:03.092023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bff25d21-8211-4605-881d-7c8194cf05af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:03.096208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bff25d21-8211-4605-881d-7c8194cf05af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:03.099367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bff25d21-8211-4605-881d-7c8194cf05af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:03.100510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bff25d21-8211-4605-881d-7c8194cf05af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:03.103622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bff25d21-8211-4605-881d-7c8194cf05af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:03.105470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bff25d21-8211-4605-881d-7c8194cf05af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:03.180793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Updating instance_info_cache with network_info: [{"id": "b47a35b5-20a2-4086-8189-336a210a37db", "address": "fa:16:3e:12:87:a8", "network": {"id": "225d4f58-0f1e-435c-90d4-d12917652e53", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-837707835-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dedc5802df604af99afeca8e8fb9b0b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb47a35b5-20", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128787) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:57:03.201341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Releasing lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:57:03.202999 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bf66f6e8-8b98-45b8-85a0-b16b1d286076 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action" status: 202 len: 0 microversion: 2.1 time: 8.303633 Sep 10 10:57:03.232873 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 754/3857] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:56:54 2022] POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action => generated 0 bytes in 8334 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 10:57:03.250018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-974d7bbf-7be0-4324-a310-3d15fd8dde54 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '.version_select at 0x7efcaeb69430>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:03.862120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bff25d21-8211-4605-881d-7c8194cf05af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:03.882179 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bff25d21-8211-4605-881d-7c8194cf05af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.814922 Sep 10 10:57:03.885440 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3104/3858] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:03 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:03.914298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4c04f12-8a4d-4570-b572-508aa9bb4f0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:03.915249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d4c04f12-8a4d-4570-b572-508aa9bb4f0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:03.931071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4c04f12-8a4d-4570-b572-508aa9bb4f0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:03.931639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4c04f12-8a4d-4570-b572-508aa9bb4f0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:03.932894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4c04f12-8a4d-4570-b572-508aa9bb4f0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:03.933874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4c04f12-8a4d-4570-b572-508aa9bb4f0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:03.934547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4c04f12-8a4d-4570-b572-508aa9bb4f0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:03.937234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4c04f12-8a4d-4570-b572-508aa9bb4f0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:04.454351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4c04f12-8a4d-4570-b572-508aa9bb4f0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:04.469754 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4c04f12-8a4d-4570-b572-508aa9bb4f0d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.561663 Sep 10 10:57:04.495547 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3105/3859] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:03 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:04.518397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b03d3029-8ac8-441d-91f5-afba62337107 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:04.533687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b03d3029-8ac8-441d-91f5-afba62337107 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:04.546886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b03d3029-8ac8-441d-91f5-afba62337107 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:04.547529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b03d3029-8ac8-441d-91f5-afba62337107 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:04.548375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b03d3029-8ac8-441d-91f5-afba62337107 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:04.549314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b03d3029-8ac8-441d-91f5-afba62337107 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:04.550000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b03d3029-8ac8-441d-91f5-afba62337107 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:04.552935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b03d3029-8ac8-441d-91f5-afba62337107 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:04.845172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b03d3029-8ac8-441d-91f5-afba62337107 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:04.860405 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b03d3029-8ac8-441d-91f5-afba62337107 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1680 microversion: 2.1 time: 0.363459 Sep 10 10:57:04.863835 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3106/3860] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:04 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1680 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:05.304466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:05.883922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-31a0c227-e589-4ede-beda-02e4e0657b07 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:05.885576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-31a0c227-e589-4ede-beda-02e4e0657b07 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:05.904071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31a0c227-e589-4ede-beda-02e4e0657b07 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:05.906799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31a0c227-e589-4ede-beda-02e4e0657b07 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:05.910988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31a0c227-e589-4ede-beda-02e4e0657b07 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:05.911835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31a0c227-e589-4ede-beda-02e4e0657b07 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:05.912322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31a0c227-e589-4ede-beda-02e4e0657b07 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:05.912764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31a0c227-e589-4ede-beda-02e4e0657b07 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:06.417693 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-974d7bbf-7be0-4324-a310-3d15fd8dde54 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/92f261f8-b48b-4bb5-a9d1-4988a310ffad" status: 202 len: 0 microversion: 2.1 time: 3.183291 Sep 10 10:57:06.418741 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 755/3861] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:57:03 2022] DELETE /compute/v2.1/os-floating-ips/92f261f8-b48b-4bb5-a9d1-4988a310ffad => generated 0 bytes in 3185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:57:06.430120 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5628864a-6faa-432b-99e5-151dacfcb0fa tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Action: 'action', calling method: .version_select at 0x7efcb068f310>, body: {"addFloatingIp": {"address": ""}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5628864a-6faa-432b-99e5-151dacfcb0fa tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Request method failure captured: Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action HTTP/1.1 Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 34 Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG1I_-FOgBWXw6TxCLc4FZv8gjQDzaB61z2ObO11uOlEyDRUxY-JsbzE3WPY1XHKefb6SPI6dkSTorcZHJgf_YIB3rSxGJUdiQdjfs-d2wYGOJw53KEvpSRfwzWwIaTRVoVCqAHphK0jdoE4PnmRzAvZqcnGyJEzPgpweIF7bull58o Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: dedc5802df604af99afeca8e8fb9b0b2 Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dedc5802df604af99afeca8e8fb9b0b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: dedc5802df604af99afeca8e8fb9b0b2 Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b536a4f15c4e47f1a5cfda2b8ad861f8 Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: {"addFloatingIp": {"address": ""}} Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '6660934d-2fe2-435d-8901-5dc605841bb8', 'body': {'addFloatingIp': {'address': ''}}} Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi '' Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:57:06.434443 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.438681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5628864a-6faa-432b-99e5-151dacfcb0fa tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:06.441036 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5628864a-6faa-432b-99e5-151dacfcb0fa tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action" status: 400 len: 142 microversion: 2.1 time: 0.010476 Sep 10 10:57:06.453417 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 756/3862] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:06 2022] POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action => generated 142 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:57:06.469651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:06.472042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:06.497096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:06.497595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:06.498030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:06.498743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:06.499196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:06.506027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:06.596019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 10:57:06.596337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquired lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 10:57:06.728407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-31a0c227-e589-4ede-beda-02e4e0657b07 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:06.741356 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-31a0c227-e589-4ede-beda-02e4e0657b07 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1657 microversion: 2.1 time: 0.858178 Sep 10 10:57:06.750657 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3107/3863] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:05 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1657 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:06.779528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-033cf25c-e0ef-4ff5-bfae-c2e109009370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:06.793452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-033cf25c-e0ef-4ff5-bfae-c2e109009370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:06.793956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-033cf25c-e0ef-4ff5-bfae-c2e109009370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:06.802797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-033cf25c-e0ef-4ff5-bfae-c2e109009370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:06.877138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Releasing lock "refresh_cache-6660934d-2fe2-435d-8901-5dc605841bb8" {{(pid=128787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 10:57:06.878011 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] HTTP exception thrown: floating IP not found Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Request method failure captured: Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action HTTP/1.1 Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 41 Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG1I_-FOgBWXw6TxCLc4FZv8gjQDzaB61z2ObO11uOlEyDRUxY-JsbzE3WPY1XHKefb6SPI6dkSTorcZHJgf_YIB3rSxGJUdiQdjfs-d2wYGOJw53KEvpSRfwzWwIaTRVoVCqAHphK0jdoE4PnmRzAvZqcnGyJEzPgpweIF7bull58o Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: dedc5802df604af99afeca8e8fb9b0b2 Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dedc5802df604af99afeca8e8fb9b0b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: dedc5802df604af99afeca8e8fb9b0b2 Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b536a4f15c4e47f1a5cfda2b8ad861f8 Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: exception: floating IP not found Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '6660934d-2fe2-435d-8901-5dc605841bb8', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 10 10:57:06.880122 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.885254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:06.885254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.885254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:06.885254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:06.885254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:06.885254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:06.885254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:06.885254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 10 10:57:06.885254 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:06.887410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Returning 404 to user: floating IP not found {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:06.888570 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b9dbd50c-05eb-4fe3-a87d-6f1712104331 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action" status: 404 len: 67 microversion: 2.1 time: 0.434106 Sep 10 10:57:06.889602 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 757/3864] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:06 2022] POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action => generated 67 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:57:06.903154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f47f94a-746f-4934-bd1e-76fd3b3150e0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:06.932604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-033cf25c-e0ef-4ff5-bfae-c2e109009370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Going to try to start instance {{(pid=128788) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 10:57:07.005764 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-033cf25c-e0ef-4ff5-bfae-c2e109009370 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.231414 Sep 10 10:57:07.007143 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3108/3865] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:06 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:57:07.022800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3977c87d-b369-472a-985f-4f8f5a186bf1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:07.027232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3977c87d-b369-472a-985f-4f8f5a186bf1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:07.044590 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-7f47f94a-746f-4934-bd1e-76fd3b3150e0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f47f94a-746f-4934-bd1e-76fd3b3150e0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Request method failure captured: Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action HTTP/1.1 Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 44 Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG1I_-FOgBWXw6TxCLc4FZv8gjQDzaB61z2ObO11uOlEyDRUxY-JsbzE3WPY1XHKefb6SPI6dkSTorcZHJgf_YIB3rSxGJUdiQdjfs-d2wYGOJw53KEvpSRfwzWwIaTRVoVCqAHphK0jdoE4PnmRzAvZqcnGyJEzPgpweIF7bull58o Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: dedc5802df604af99afeca8e8fb9b0b2 Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dedc5802df604af99afeca8e8fb9b0b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: dedc5802df604af99afeca8e8fb9b0b2 Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b536a4f15c4e47f1a5cfda2b8ad861f8 Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: exception: Floating IP not found for address 0.0.0.0. Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '6660934d-2fe2-435d-8901-5dc605841bb8', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 10 10:57:07.046866 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 10 10:57:07.051843 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:07.054025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f47f94a-746f-4934-bd1e-76fd3b3150e0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:07.056337 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7f47f94a-746f-4934-bd1e-76fd3b3150e0 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action" status: 404 len: 88 microversion: 2.1 time: 0.158221 Sep 10 10:57:07.061055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3977c87d-b369-472a-985f-4f8f5a186bf1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:07.063864 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 758/3866] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:06 2022] POST /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8/action => generated 88 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:57:07.066396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3977c87d-b369-472a-985f-4f8f5a186bf1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:07.067400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3977c87d-b369-472a-985f-4f8f5a186bf1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:07.071275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6b2f15a9-6fe2-409a-a776-9e74e48b1c8c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:07.071627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3977c87d-b369-472a-985f-4f8f5a186bf1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:07.072296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3977c87d-b369-472a-985f-4f8f5a186bf1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:07.072797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6b2f15a9-6fe2-409a-a776-9e74e48b1c8c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:07.074279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3977c87d-b369-472a-985f-4f8f5a186bf1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:07.112437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b2f15a9-6fe2-409a-a776-9e74e48b1c8c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:07.113173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b2f15a9-6fe2-409a-a776-9e74e48b1c8c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:07.113774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b2f15a9-6fe2-409a-a776-9e74e48b1c8c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:07.115897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b2f15a9-6fe2-409a-a776-9e74e48b1c8c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:07.118870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b2f15a9-6fe2-409a-a776-9e74e48b1c8c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:07.121850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b2f15a9-6fe2-409a-a776-9e74e48b1c8c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:07.178689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6b2f15a9-6fe2-409a-a776-9e74e48b1c8c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:57:07.361563 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6b2f15a9-6fe2-409a-a776-9e74e48b1c8c tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 204 len: 0 microversion: 2.1 time: 0.296286 Sep 10 10:57:07.364993 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 759/3867] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:57:07 2022] DELETE /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:57:07.380108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b817f06d-7265-4647-99f1-ee694e856eca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:07.380847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b817f06d-7265-4647-99f1-ee694e856eca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:07.388319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b817f06d-7265-4647-99f1-ee694e856eca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:07.389056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b817f06d-7265-4647-99f1-ee694e856eca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:07.389714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b817f06d-7265-4647-99f1-ee694e856eca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:07.390592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b817f06d-7265-4647-99f1-ee694e856eca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:07.391413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b817f06d-7265-4647-99f1-ee694e856eca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:07.392000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b817f06d-7265-4647-99f1-ee694e856eca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:08.043466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3977c87d-b369-472a-985f-4f8f5a186bf1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:08.049268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b817f06d-7265-4647-99f1-ee694e856eca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:08.053789 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3977c87d-b369-472a-985f-4f8f5a186bf1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1666 microversion: 2.1 time: 1.042294 Sep 10 10:57:08.064898 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b817f06d-7265-4647-99f1-ee694e856eca tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1540 microversion: 2.1 time: 0.697603 Sep 10 10:57:08.066344 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 760/3868] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:07 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1540 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:08.071664 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3109/3869] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:07 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1666 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:08.081359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e3303dc-be71-43eb-9ad9-419a7c9eb4b7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1152639538", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a6bd0e0b-5d47-484e-8417-6f1643aa4b2d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:08.202282 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-4e3303dc-be71-43eb-9ad9-419a7c9eb4b7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Block Device a6bd0e0b-5d47-484e-8417-6f1643aa4b2d is not bootable. Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e3303dc-be71-43eb-9ad9-419a7c9eb4b7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 358 Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1152639538", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a6bd0e0b-5d47-484e-8417-6f1643aa4b2d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: exception: Block Device a6bd0e0b-5d47-484e-8417-6f1643aa4b2d is not bootable. Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1152639538', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a6bd0e0b-5d47-484e-8417-6f1643aa4b2d'}], 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a6bd0e0b-5d47-484e-8417-6f1643aa4b2d is not bootable. Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:08.210086 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a6bd0e0b-5d47-484e-8417-6f1643aa4b2d is not bootable. Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a6bd0e0b-5d47-484e-8417-6f1643aa4b2d is not bootable. Sep 10 10:57:08.214816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:08.222171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e3303dc-be71-43eb-9ad9-419a7c9eb4b7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Block Device a6bd0e0b-5d47-484e-8417-6f1643aa4b2d is not bootable. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:08.223330 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4e3303dc-be71-43eb-9ad9-419a7c9eb4b7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.155841 Sep 10 10:57:08.224153 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 761/3870] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:08 2022] POST /compute/v2.1/servers => generated 110 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:57:08.234180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f949e467-e4d3-49a2-94d8-2ddaabe49fa0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:08.235191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f949e467-e4d3-49a2-94d8-2ddaabe49fa0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:08.243074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f949e467-e4d3-49a2-94d8-2ddaabe49fa0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:08.243798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f949e467-e4d3-49a2-94d8-2ddaabe49fa0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:08.245227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f949e467-e4d3-49a2-94d8-2ddaabe49fa0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:08.246355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f949e467-e4d3-49a2-94d8-2ddaabe49fa0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:08.246969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f949e467-e4d3-49a2-94d8-2ddaabe49fa0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:08.248098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f949e467-e4d3-49a2-94d8-2ddaabe49fa0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:09.098078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-163e7b4a-7f8f-4fb6-b78e-bc01455cd8d0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:09.098670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-163e7b4a-7f8f-4fb6-b78e-bc01455cd8d0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:09.111576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-163e7b4a-7f8f-4fb6-b78e-bc01455cd8d0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:09.112084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-163e7b4a-7f8f-4fb6-b78e-bc01455cd8d0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:09.112529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-163e7b4a-7f8f-4fb6-b78e-bc01455cd8d0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:09.116275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-163e7b4a-7f8f-4fb6-b78e-bc01455cd8d0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:09.116921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-163e7b4a-7f8f-4fb6-b78e-bc01455cd8d0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:09.118091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-163e7b4a-7f8f-4fb6-b78e-bc01455cd8d0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:09.135989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:09.880209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f949e467-e4d3-49a2-94d8-2ddaabe49fa0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:09.890513 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f949e467-e4d3-49a2-94d8-2ddaabe49fa0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.660992 Sep 10 10:57:09.909896 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3110/3871] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:08 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:09.940810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c268d6f2-78c8-491c-b0ac-28892689d36a tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:09.941467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c268d6f2-78c8-491c-b0ac-28892689d36a tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:09.961325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c268d6f2-78c8-491c-b0ac-28892689d36a tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:09.961685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c268d6f2-78c8-491c-b0ac-28892689d36a tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:09.962351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c268d6f2-78c8-491c-b0ac-28892689d36a tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:09.963613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c268d6f2-78c8-491c-b0ac-28892689d36a tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:09.965605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c268d6f2-78c8-491c-b0ac-28892689d36a tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:09.966146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c268d6f2-78c8-491c-b0ac-28892689d36a tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:10.385243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-163e7b4a-7f8f-4fb6-b78e-bc01455cd8d0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:10.429286 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-163e7b4a-7f8f-4fb6-b78e-bc01455cd8d0 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1666 microversion: 2.1 time: 1.338018 Sep 10 10:57:10.440467 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 762/3872] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:09 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1666 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:10.457839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-02014c5e-204a-4efe-9623-e0e2e0d3befe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:10.458746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-02014c5e-204a-4efe-9623-e0e2e0d3befe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:10.482117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02014c5e-204a-4efe-9623-e0e2e0d3befe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:10.482637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02014c5e-204a-4efe-9623-e0e2e0d3befe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:10.483181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02014c5e-204a-4efe-9623-e0e2e0d3befe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:10.484438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02014c5e-204a-4efe-9623-e0e2e0d3befe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:10.485208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02014c5e-204a-4efe-9623-e0e2e0d3befe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:10.485843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02014c5e-204a-4efe-9623-e0e2e0d3befe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:10.759399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c268d6f2-78c8-491c-b0ac-28892689d36a tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:10.773006 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c268d6f2-78c8-491c-b0ac-28892689d36a tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1540 microversion: 2.1 time: 0.861762 Sep 10 10:57:10.777398 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3111/3873] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:09 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1540 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:11.162322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-02014c5e-204a-4efe-9623-e0e2e0d3befe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:11.181887 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-02014c5e-204a-4efe-9623-e0e2e0d3befe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.739533 Sep 10 10:57:11.223390 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 763/3874] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:10 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:11.465700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d040ffcb-9162-4808-9fab-f954954eed4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:11.466916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d040ffcb-9162-4808-9fab-f954954eed4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:11.482173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d040ffcb-9162-4808-9fab-f954954eed4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:11.487785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d040ffcb-9162-4808-9fab-f954954eed4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:11.500063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d040ffcb-9162-4808-9fab-f954954eed4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:11.506823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d040ffcb-9162-4808-9fab-f954954eed4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:11.509654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d040ffcb-9162-4808-9fab-f954954eed4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:11.510836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d040ffcb-9162-4808-9fab-f954954eed4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:11.809821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-386b4ff0-cd3b-4b7e-9018-9c1e4e035277 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:11.811096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-386b4ff0-cd3b-4b7e-9018-9c1e4e035277 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:11.830828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-386b4ff0-cd3b-4b7e-9018-9c1e4e035277 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:11.832328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-386b4ff0-cd3b-4b7e-9018-9c1e4e035277 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:11.833029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-386b4ff0-cd3b-4b7e-9018-9c1e4e035277 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:11.834045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-386b4ff0-cd3b-4b7e-9018-9c1e4e035277 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:11.834801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-386b4ff0-cd3b-4b7e-9018-9c1e4e035277 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:11.835462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-386b4ff0-cd3b-4b7e-9018-9c1e4e035277 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:12.149248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-386b4ff0-cd3b-4b7e-9018-9c1e4e035277 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:12.164015 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-386b4ff0-cd3b-4b7e-9018-9c1e4e035277 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1498 microversion: 2.1 time: 0.368201 Sep 10 10:57:12.164626 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 764/3875] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:11 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1498 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:12.208191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-dfef7246-207d-4e71-be6e-4fc50efec293 req-475a710e-2b1d-423d-ba12-5f3e19945ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6660934d-2fe2-435d-8901-5dc605841bb8", "name": "network-vif-deleted", "tag": "b47a35b5-20a2-4086-8189-336a210a37db"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:12.235170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-dfef7246-207d-4e71-be6e-4fc50efec293 req-475a710e-2b1d-423d-ba12-5f3e19945ea8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:12.235987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-dfef7246-207d-4e71-be6e-4fc50efec293 req-475a710e-2b1d-423d-ba12-5f3e19945ea8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:12.239699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-dfef7246-207d-4e71-be6e-4fc50efec293 req-475a710e-2b1d-423d-ba12-5f3e19945ea8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:12.267717 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-dfef7246-207d-4e71-be6e-4fc50efec293 req-475a710e-2b1d-423d-ba12-5f3e19945ea8 service nova] Creating event network-vif-deleted:b47a35b5-20a2-4086-8189-336a210a37db for instance 6660934d-2fe2-435d-8901-5dc605841bb8 on n-h2-856894-1 Sep 10 10:57:12.296519 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-dfef7246-207d-4e71-be6e-4fc50efec293 req-475a710e-2b1d-423d-ba12-5f3e19945ea8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123055 Sep 10 10:57:12.299570 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 765/3876] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:57:12.531069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d040ffcb-9162-4808-9fab-f954954eed4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:12.545583 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d040ffcb-9162-4808-9fab-f954954eed4b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1666 microversion: 2.1 time: 1.085529 Sep 10 10:57:12.546185 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3112/3877] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:11 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1666 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:13.193870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:13.195115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:13.212478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:13.223982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:13.225981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:13.229121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:13.248529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:13.249551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:13.309480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:13.312949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:13.314996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:13.315532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lazy-loading 'fault' on Instance uuid 6660934d-2fe2-435d-8901-5dc605841bb8 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:57:13.392484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b536a4f15c4e47f1a5cfda2b8ad861f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc5802df604af99afeca8e8fb9b0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:13.402022 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-96786f7f-f4ea-4462-b41b-929875ec6f93 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 200 len: 1321 microversion: 2.1 time: 0.213888 Sep 10 10:57:13.408137 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 766/3878] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:13 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:13.591987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c66de44f-db74-453c-9061-1a7a41ed8b4c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:13.599974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c66de44f-db74-453c-9061-1a7a41ed8b4c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:13.621025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c66de44f-db74-453c-9061-1a7a41ed8b4c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:13.644359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c66de44f-db74-453c-9061-1a7a41ed8b4c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:13.645101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c66de44f-db74-453c-9061-1a7a41ed8b4c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:13.650016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c66de44f-db74-453c-9061-1a7a41ed8b4c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:13.651108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c66de44f-db74-453c-9061-1a7a41ed8b4c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:13.666291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c66de44f-db74-453c-9061-1a7a41ed8b4c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:14.175865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c66de44f-db74-453c-9061-1a7a41ed8b4c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:14.186408 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c66de44f-db74-453c-9061-1a7a41ed8b4c tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.614141 Sep 10 10:57:14.187249 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3113/3879] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:13 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:14.216754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-987b8397-7101-475b-95f0-29b43f787c2d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:14.218928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-987b8397-7101-475b-95f0-29b43f787c2d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:14.227795 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:57:14.228311 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 10:57:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 (ip 10.222.0.20) !!! Sep 10 10:57:14.232841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-987b8397-7101-475b-95f0-29b43f787c2d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:14.233654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-987b8397-7101-475b-95f0-29b43f787c2d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:14.234350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-987b8397-7101-475b-95f0-29b43f787c2d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:14.235406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-987b8397-7101-475b-95f0-29b43f787c2d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:14.236089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-987b8397-7101-475b-95f0-29b43f787c2d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:14.237541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-987b8397-7101-475b-95f0-29b43f787c2d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:14.401518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f83f6d3f-cfde-4bc4-bb00-7c7a891ac834 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1843514611", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "destination_type": "local"}, {"source_type": "volume", "uuid": "c18924a0-82dc-4e6f-9b23-7019ae87c551", "destination_type": "invalid"}], "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f83f6d3f-cfde-4bc4-bb00-7c7a891ac834 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 495 Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1843514611", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "destination_type": "local"}, {"source_type": "volume", "uuid": "c18924a0-82dc-4e6f-9b23-7019ae87c551", "destination_type": "invalid"}], "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1843514611', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c18924a0-82dc-4e6f-9b23-7019ae87c551', 'destination_type': 'invalid'}], 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:14.407084 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 10 10:57:14.412135 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:14.414839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f83f6d3f-cfde-4bc4-bb00-7c7a891ac834 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:14.416030 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f83f6d3f-cfde-4bc4-bb00-7c7a891ac834 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020242 Sep 10 10:57:14.417223 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3114/3880] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:14 2022] POST /compute/v2.1/servers => generated 155 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 10:57:14.429274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5e7cffc1-5088-4b30-bd1e-9bc5652ca7d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:14.430329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5e7cffc1-5088-4b30-bd1e-9bc5652ca7d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:14.439245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e7cffc1-5088-4b30-bd1e-9bc5652ca7d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:14.440271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e7cffc1-5088-4b30-bd1e-9bc5652ca7d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:14.441083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e7cffc1-5088-4b30-bd1e-9bc5652ca7d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:14.441920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e7cffc1-5088-4b30-bd1e-9bc5652ca7d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:14.442655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e7cffc1-5088-4b30-bd1e-9bc5652ca7d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:14.443566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e7cffc1-5088-4b30-bd1e-9bc5652ca7d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:15.105212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-987b8397-7101-475b-95f0-29b43f787c2d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:15.114373 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-987b8397-7101-475b-95f0-29b43f787c2d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.902669 Sep 10 10:57:15.115278 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 767/3881] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:14 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:15.156476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:15.158157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] [instance: 6660934d-2fe2-435d-8901-5dc605841bb8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:15.164993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:15.167054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:15.167861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:15.172226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e7cffc1-5088-4b30-bd1e-9bc5652ca7d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:15.176532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:15.182060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:15.184533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:15.187722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:15.200550 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5e7cffc1-5088-4b30-bd1e-9bc5652ca7d1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.765514 Sep 10 10:57:15.203908 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3115/3882] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:14 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:15.211045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b131d5fd-7b23-4982-922f-953311afb553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:15.211955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b131d5fd-7b23-4982-922f-953311afb553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:15.228971 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] HTTP exception thrown: Instance 6660934d-2fe2-435d-8901-5dc605841bb8 could not be found. Sep 10 10:57:15.236459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b131d5fd-7b23-4982-922f-953311afb553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Request method failure captured: Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 HTTP/1.1 Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG1I_-FOgBWXw6TxCLc4FZv8gjQDzaB61z2ObO11uOlEyDRUxY-JsbzE3WPY1XHKefb6SPI6dkSTorcZHJgf_YIB3rSxGJUdiQdjfs-d2wYGOJw53KEvpSRfwzWwIaTRVoVCqAHphK0jdoE4PnmRzAvZqcnGyJEzPgpweIF7bull58o Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: dedc5802df604af99afeca8e8fb9b0b2 Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dedc5802df604af99afeca8e8fb9b0b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dedc5802df604af99afeca8e8fb9b0b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: dedc5802df604af99afeca8e8fb9b0b2 Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b536a4f15c4e47f1a5cfda2b8ad861f8 Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 6660934d-2fe2-435d-8901-5dc605841bb8 could not be found. Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '6660934d-2fe2-435d-8901-5dc605841bb8'} Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6660934d-2fe2-435d-8901-5dc605841bb8 could not be found. Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6660934d-2fe2-435d-8901-5dc605841bb8 could not be found. Sep 10 10:57:15.237942 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.241840 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:15.241840 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.241840 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:15.241840 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:15.241840 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:15.241840 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:15.241840 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:15.241840 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6660934d-2fe2-435d-8901-5dc605841bb8 could not be found. Sep 10 10:57:15.241840 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.265007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b131d5fd-7b23-4982-922f-953311afb553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:15.269877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b131d5fd-7b23-4982-922f-953311afb553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:15.272391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] Returning 404 to user: Instance 6660934d-2fe2-435d-8901-5dc605841bb8 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:15.273231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b131d5fd-7b23-4982-922f-953311afb553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:15.275682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b131d5fd-7b23-4982-922f-953311afb553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:15.276030 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8f2adb91-6a45-485b-9601-de8db9849320 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227 tempest-FloatingIPsAssociationNegativeTestJSON-1332206227-project] 10.222.0.20 "GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8" status: 404 len: 111 microversion: 2.1 time: 0.146492 Sep 10 10:57:15.277039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b131d5fd-7b23-4982-922f-953311afb553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:15.284795 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 768/3883] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:15 2022] GET /compute/v2.1/servers/6660934d-2fe2-435d-8901-5dc605841bb8 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:15.301657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5b46e1cc-7ff0-451b-83c1-c3a642f72679 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:15.306590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5b46e1cc-7ff0-451b-83c1-c3a642f72679 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:15.324311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b46e1cc-7ff0-451b-83c1-c3a642f72679 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:15.325200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b46e1cc-7ff0-451b-83c1-c3a642f72679 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:15.325868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b46e1cc-7ff0-451b-83c1-c3a642f72679 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:15.326797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b46e1cc-7ff0-451b-83c1-c3a642f72679 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:15.327466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b46e1cc-7ff0-451b-83c1-c3a642f72679 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:15.328125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b46e1cc-7ff0-451b-83c1-c3a642f72679 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:15.777747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5b46e1cc-7ff0-451b-83c1-c3a642f72679 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:15.796150 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5b46e1cc-7ff0-451b-83c1-c3a642f72679 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.509898 Sep 10 10:57:15.796754 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 769/3884] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:15 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:15.888560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9cda763c-1dd6-4160-a020-365e663f353c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1000546013", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9cda763c-1dd6-4160-a020-365e663f353c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 492 Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1000546013", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1000546013', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.895428 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9cda763c-1dd6-4160-a020-365e663f353c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:15.899250 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9cda763c-1dd6-4160-a020-365e663f353c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.013174 Sep 10 10:57:15.901896 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 770/3885] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:15 2022] POST /compute/v2.1/servers => generated 624 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 10:57:15.914069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8668ac44-332b-4e0b-a4cb-65a24b350858 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:15.916681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8668ac44-332b-4e0b-a4cb-65a24b350858 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:15.934779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8668ac44-332b-4e0b-a4cb-65a24b350858 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:15.936803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8668ac44-332b-4e0b-a4cb-65a24b350858 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:15.937293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8668ac44-332b-4e0b-a4cb-65a24b350858 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:15.939551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8668ac44-332b-4e0b-a4cb-65a24b350858 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:15.940031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8668ac44-332b-4e0b-a4cb-65a24b350858 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:15.940469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8668ac44-332b-4e0b-a4cb-65a24b350858 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:16.054500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b131d5fd-7b23-4982-922f-953311afb553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:16.069818 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b131d5fd-7b23-4982-922f-953311afb553 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.864428 Sep 10 10:57:16.081095 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3116/3886] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:15 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:16.094405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60269cc9-6d50-4047-8381-4498f1be1a8d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:16.095027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60269cc9-6d50-4047-8381-4498f1be1a8d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:16.110854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60269cc9-6d50-4047-8381-4498f1be1a8d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:16.112870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60269cc9-6d50-4047-8381-4498f1be1a8d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:16.114891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60269cc9-6d50-4047-8381-4498f1be1a8d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:16.115890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60269cc9-6d50-4047-8381-4498f1be1a8d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:16.116970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60269cc9-6d50-4047-8381-4498f1be1a8d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:16.119828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60269cc9-6d50-4047-8381-4498f1be1a8d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:16.583001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8668ac44-332b-4e0b-a4cb-65a24b350858 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:16.593536 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8668ac44-332b-4e0b-a4cb-65a24b350858 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.691205 Sep 10 10:57:16.594743 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 771/3887] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:15 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:16.595431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60269cc9-6d50-4047-8381-4498f1be1a8d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:16.605195 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60269cc9-6d50-4047-8381-4498f1be1a8d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.514755 Sep 10 10:57:16.605975 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3117/3888] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:16 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:16.623813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4b572de4-e113-440a-a684-b8085cc60b4b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:16.624438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4b572de4-e113-440a-a684-b8085cc60b4b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:16.632108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1eb10a6f-e53b-4fc3-bdf5-a2909f8a2328 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:16.633690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1eb10a6f-e53b-4fc3-bdf5-a2909f8a2328 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:16.638309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b572de4-e113-440a-a684-b8085cc60b4b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:16.638818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b572de4-e113-440a-a684-b8085cc60b4b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:16.639254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b572de4-e113-440a-a684-b8085cc60b4b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:16.640145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b572de4-e113-440a-a684-b8085cc60b4b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:16.640595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b572de4-e113-440a-a684-b8085cc60b4b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:16.641231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b572de4-e113-440a-a684-b8085cc60b4b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:16.644589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1eb10a6f-e53b-4fc3-bdf5-a2909f8a2328 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:16.645386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1eb10a6f-e53b-4fc3-bdf5-a2909f8a2328 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:16.646106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1eb10a6f-e53b-4fc3-bdf5-a2909f8a2328 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:16.647045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1eb10a6f-e53b-4fc3-bdf5-a2909f8a2328 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:16.647753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1eb10a6f-e53b-4fc3-bdf5-a2909f8a2328 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:16.648547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1eb10a6f-e53b-4fc3-bdf5-a2909f8a2328 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:17.180761 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 10:57:17.181012 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 10:57:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 (ip 10.222.0.20) !!! Sep 10 10:57:17.383614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1eb10a6f-e53b-4fc3-bdf5-a2909f8a2328 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:17.396043 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1eb10a6f-e53b-4fc3-bdf5-a2909f8a2328 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.768567 Sep 10 10:57:17.396742 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3118/3889] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:16 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:17.420002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4b572de4-e113-440a-a684-b8085cc60b4b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:17.427890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e37f98fd-da65-4fd0-8176-8f579b1f03c2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:17.428527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e37f98fd-da65-4fd0-8176-8f579b1f03c2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:17.429601 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4b572de4-e113-440a-a684-b8085cc60b4b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.811737 Sep 10 10:57:17.435294 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 772/3890] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:16 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:17.470107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e37f98fd-da65-4fd0-8176-8f579b1f03c2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:17.470853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e37f98fd-da65-4fd0-8176-8f579b1f03c2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:17.471795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e37f98fd-da65-4fd0-8176-8f579b1f03c2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:17.474684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e37f98fd-da65-4fd0-8176-8f579b1f03c2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:17.475411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e37f98fd-da65-4fd0-8176-8f579b1f03c2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:17.476185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e37f98fd-da65-4fd0-8176-8f579b1f03c2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:17.522667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d71f096-5f1c-4de7-89b9-f2ffe364d137 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:17.523500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-e37f98fd-da65-4fd0-8176-8f579b1f03c2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lazy-loading 'flavor' on Instance uuid 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d71f096-5f1c-4de7-89b9-f2ffe364d137 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 416 Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:17.527058 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d71f096-5f1c-4de7-89b9-f2ffe364d137 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:17.534251 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d71f096-5f1c-4de7-89b9-f2ffe364d137 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.010581 Sep 10 10:57:17.537453 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 773/3891] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:17 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:57:17.551613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-91cd646e-b48e-4855-ad2a-2166deff1c07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:17.553592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-91cd646e-b48e-4855-ad2a-2166deff1c07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:17.573925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91cd646e-b48e-4855-ad2a-2166deff1c07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:17.574829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91cd646e-b48e-4855-ad2a-2166deff1c07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:17.575513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91cd646e-b48e-4855-ad2a-2166deff1c07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:17.577150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91cd646e-b48e-4855-ad2a-2166deff1c07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:17.580210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91cd646e-b48e-4855-ad2a-2166deff1c07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:17.580986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91cd646e-b48e-4855-ad2a-2166deff1c07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:17.668787 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e37f98fd-da65-4fd0-8176-8f579b1f03c2 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.242916 Sep 10 10:57:17.672412 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3119/3892] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:17 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:57:17.689126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ce1ca53-39c5-4cf4-8bef-b80af6188ff8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:17.691439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ce1ca53-39c5-4cf4-8bef-b80af6188ff8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:17.709331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce1ca53-39c5-4cf4-8bef-b80af6188ff8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:17.711277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce1ca53-39c5-4cf4-8bef-b80af6188ff8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:17.711739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce1ca53-39c5-4cf4-8bef-b80af6188ff8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:17.716043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce1ca53-39c5-4cf4-8bef-b80af6188ff8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:17.716608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce1ca53-39c5-4cf4-8bef-b80af6188ff8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:17.717092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce1ca53-39c5-4cf4-8bef-b80af6188ff8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:18.245769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-91cd646e-b48e-4855-ad2a-2166deff1c07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:18.258628 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-91cd646e-b48e-4855-ad2a-2166deff1c07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.719995 Sep 10 10:57:18.259717 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 774/3893] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:17 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:18.289382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-34a2cfa7-7cd2-4cc1-b7af-634d8e44b52f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:18.290193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-34a2cfa7-7cd2-4cc1-b7af-634d8e44b52f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:18.300535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34a2cfa7-7cd2-4cc1-b7af-634d8e44b52f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:18.301046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34a2cfa7-7cd2-4cc1-b7af-634d8e44b52f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:18.301527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34a2cfa7-7cd2-4cc1-b7af-634d8e44b52f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:18.302243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34a2cfa7-7cd2-4cc1-b7af-634d8e44b52f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:18.302709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34a2cfa7-7cd2-4cc1-b7af-634d8e44b52f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:18.308038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34a2cfa7-7cd2-4cc1-b7af-634d8e44b52f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:18.366538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5ce1ca53-39c5-4cf4-8bef-b80af6188ff8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:18.379095 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ce1ca53-39c5-4cf4-8bef-b80af6188ff8 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1678 microversion: 2.1 time: 0.703380 Sep 10 10:57:18.382281 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3120/3894] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:17 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1678 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:18.582062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:18.583780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:18.592085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:18.592939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:18.593580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:18.594695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:18.595318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:18.595963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:18.794357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-34a2cfa7-7cd2-4cc1-b7af-634d8e44b52f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:18.807536 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-34a2cfa7-7cd2-4cc1-b7af-634d8e44b52f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.526428 Sep 10 10:57:18.808134 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 775/3895] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:18 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:18.886038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f03f964d-c7df-467d-9b0d-b94380a495dc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-927855518", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": -1, "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:18.898827 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-f03f964d-c7df-467d-9b0d-b94380a495dc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Flavor -1 could not be found. Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f03f964d-c7df-467d-9b0d-b94380a495dc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 205 Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-927855518", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": -1, "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: exception: Flavor -1 could not be found. Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-927855518', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': -1, 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:18.900976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 10 10:57:18.905768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:18.908542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f03f964d-c7df-467d-9b0d-b94380a495dc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:18.910040 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f03f964d-c7df-467d-9b0d-b94380a495dc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.031902 Sep 10 10:57:18.911315 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 776/3896] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:18 2022] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:57:18.922172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-373fa3ee-e666-447b-8baf-c00dbcb0a879 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:18.922829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-373fa3ee-e666-447b-8baf-c00dbcb0a879 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:18.931247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-373fa3ee-e666-447b-8baf-c00dbcb0a879 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:18.932662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-373fa3ee-e666-447b-8baf-c00dbcb0a879 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:18.933411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-373fa3ee-e666-447b-8baf-c00dbcb0a879 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:18.934712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-373fa3ee-e666-447b-8baf-c00dbcb0a879 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:18.935351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-373fa3ee-e666-447b-8baf-c00dbcb0a879 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:18.935957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-373fa3ee-e666-447b-8baf-c00dbcb0a879 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:19.622205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:19.631563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:19.632994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:19.649512 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41af8f15-f25f-407f-bc8b-928ce5766702 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2950 microversion: 2.32 time: 1.071741 Sep 10 10:57:19.650171 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3121/3897] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:57:18 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2950 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:57:19.661687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86f27b0e-0a3f-4aa8-9a92-8227b9af7430 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:19.662582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86f27b0e-0a3f-4aa8-9a92-8227b9af7430 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:19.697736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86f27b0e-0a3f-4aa8-9a92-8227b9af7430 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:19.699255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86f27b0e-0a3f-4aa8-9a92-8227b9af7430 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:19.699712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86f27b0e-0a3f-4aa8-9a92-8227b9af7430 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:19.701884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86f27b0e-0a3f-4aa8-9a92-8227b9af7430 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:19.703668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86f27b0e-0a3f-4aa8-9a92-8227b9af7430 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:19.707317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86f27b0e-0a3f-4aa8-9a92-8227b9af7430 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:19.730000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-373fa3ee-e666-447b-8baf-c00dbcb0a879 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:19.740805 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-373fa3ee-e666-447b-8baf-c00dbcb0a879 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.822756 Sep 10 10:57:19.750280 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 777/3898] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:18 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:19.768466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-717a8f2c-2b82-4554-8cfe-1538bde3e967 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:19.771109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-717a8f2c-2b82-4554-8cfe-1538bde3e967 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:19.790907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717a8f2c-2b82-4554-8cfe-1538bde3e967 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:19.791405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717a8f2c-2b82-4554-8cfe-1538bde3e967 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:19.791840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717a8f2c-2b82-4554-8cfe-1538bde3e967 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:19.792543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717a8f2c-2b82-4554-8cfe-1538bde3e967 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:19.792998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717a8f2c-2b82-4554-8cfe-1538bde3e967 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:19.793452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717a8f2c-2b82-4554-8cfe-1538bde3e967 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:20.031889 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-717a8f2c-2b82-4554-8cfe-1538bde3e967 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.267448 Sep 10 10:57:20.041886 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 778/3899] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Sep 10 10:57:19 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939/os-interface => generated 1830 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:57:20.041886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0f228f10-6600-49d6-9cc5-09d05a5cb844 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:20.041886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0f228f10-6600-49d6-9cc5-09d05a5cb844 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:20.065026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f228f10-6600-49d6-9cc5-09d05a5cb844 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:20.075795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f228f10-6600-49d6-9cc5-09d05a5cb844 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:20.076506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f228f10-6600-49d6-9cc5-09d05a5cb844 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:20.077702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f228f10-6600-49d6-9cc5-09d05a5cb844 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:20.078294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f228f10-6600-49d6-9cc5-09d05a5cb844 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:20.078794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f228f10-6600-49d6-9cc5-09d05a5cb844 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:20.254043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-86f27b0e-0a3f-4aa8-9a92-8227b9af7430 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:20.264010 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86f27b0e-0a3f-4aa8-9a92-8227b9af7430 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1661 microversion: 2.1 time: 0.606092 Sep 10 10:57:20.270742 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3122/3900] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:19 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1661 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:20.290175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be53af81-98bb-41ce-b4ac-0c287a71c0fb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:20.292815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be53af81-98bb-41ce-b4ac-0c287a71c0fb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:20.301936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:20.317170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be53af81-98bb-41ce-b4ac-0c287a71c0fb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:20.317933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be53af81-98bb-41ce-b4ac-0c287a71c0fb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:20.319275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be53af81-98bb-41ce-b4ac-0c287a71c0fb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:20.320172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be53af81-98bb-41ce-b4ac-0c287a71c0fb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:20.323086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be53af81-98bb-41ce-b4ac-0c287a71c0fb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:20.323947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be53af81-98bb-41ce-b4ac-0c287a71c0fb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:20.579764 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be53af81-98bb-41ce-b4ac-0c287a71c0fb tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.291951 Sep 10 10:57:20.583587 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3123/3901] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:20 2022] POST /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:57:20.632439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0f228f10-6600-49d6-9cc5-09d05a5cb844 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:20.634328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-353090ea-b7a6-4cfe-9799-2c761f8ee419 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:20.643797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-353090ea-b7a6-4cfe-9799-2c761f8ee419 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:20.644878 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0f228f10-6600-49d6-9cc5-09d05a5cb844 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.609865 Sep 10 10:57:20.647073 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 779/3902] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:20 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:20.682512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-353090ea-b7a6-4cfe-9799-2c761f8ee419 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:20.683058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-353090ea-b7a6-4cfe-9799-2c761f8ee419 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:20.689881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-353090ea-b7a6-4cfe-9799-2c761f8ee419 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:20.690722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-353090ea-b7a6-4cfe-9799-2c761f8ee419 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:20.691209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-353090ea-b7a6-4cfe-9799-2c761f8ee419 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:20.691647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-353090ea-b7a6-4cfe-9799-2c761f8ee419 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:20.794382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cedc1f94-9963-4b0b-aaf8-18be563e8dd1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-876622601", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cedc1f94-9963-4b0b-aaf8-18be563e8dd1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 172 Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-876622601", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-876622601', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi -1 Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:57:20.813521 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cedc1f94-9963-4b0b-aaf8-18be563e8dd1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cedc1f94-9963-4b0b-aaf8-18be563e8dd1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.027043 Sep 10 10:57:20.818518 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 780/3903] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:20 2022] POST /compute/v2.1/servers => generated 145 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:57:20.828350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e6138708-4256-416d-94fc-8da55e74cf93 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:20.838539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e6138708-4256-416d-94fc-8da55e74cf93 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:20.864997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6138708-4256-416d-94fc-8da55e74cf93 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:20.874012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6138708-4256-416d-94fc-8da55e74cf93 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:20.876207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6138708-4256-416d-94fc-8da55e74cf93 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:20.882000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6138708-4256-416d-94fc-8da55e74cf93 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:20.891202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6138708-4256-416d-94fc-8da55e74cf93 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:20.892322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6138708-4256-416d-94fc-8da55e74cf93 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:21.628121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-353090ea-b7a6-4cfe-9799-2c761f8ee419 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:21.644044 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-353090ea-b7a6-4cfe-9799-2c761f8ee419 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1667 microversion: 2.1 time: 1.054407 Sep 10 10:57:21.657098 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3124/3904] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:20 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1667 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:22.020993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e6138708-4256-416d-94fc-8da55e74cf93 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:22.059746 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e6138708-4256-416d-94fc-8da55e74cf93 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.223148 Sep 10 10:57:22.060667 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 781/3905] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:20 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:22.083681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9548a644-5114-4efa-a0a1-c2d1a542ddd7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:22.085035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9548a644-5114-4efa-a0a1-c2d1a542ddd7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:22.108996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9548a644-5114-4efa-a0a1-c2d1a542ddd7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:22.109603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9548a644-5114-4efa-a0a1-c2d1a542ddd7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:22.110066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9548a644-5114-4efa-a0a1-c2d1a542ddd7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:22.110797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9548a644-5114-4efa-a0a1-c2d1a542ddd7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:22.111257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9548a644-5114-4efa-a0a1-c2d1a542ddd7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:22.111688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9548a644-5114-4efa-a0a1-c2d1a542ddd7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:22.680162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0fdc9a5a-8ca9-4b76-b10f-243affde2c0d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:22.681456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0fdc9a5a-8ca9-4b76-b10f-243affde2c0d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:22.707949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fdc9a5a-8ca9-4b76-b10f-243affde2c0d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:22.708198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fdc9a5a-8ca9-4b76-b10f-243affde2c0d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:22.708744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fdc9a5a-8ca9-4b76-b10f-243affde2c0d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:22.711056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fdc9a5a-8ca9-4b76-b10f-243affde2c0d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:22.711727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fdc9a5a-8ca9-4b76-b10f-243affde2c0d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:22.715529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fdc9a5a-8ca9-4b76-b10f-243affde2c0d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:22.898694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9548a644-5114-4efa-a0a1-c2d1a542ddd7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:22.912139 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9548a644-5114-4efa-a0a1-c2d1a542ddd7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.832319 Sep 10 10:57:22.912785 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3125/3906] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:22 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:23.030029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5fa06cae-c616-41bb-9be2-21090292f4a4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1148985827", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:23.036715 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5fa06cae-c616-41bb-9be2-21090292f4a4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5fa06cae-c616-41bb-9be2-21090292f4a4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 216 Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1148985827", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1148985827', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:23.038408 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:23.042939 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:23.042939 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:23.042939 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:23.042939 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:23.042939 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:23.042939 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 10:57:23.042939 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:23.042939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5fa06cae-c616-41bb-9be2-21090292f4a4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:23.042939 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5fa06cae-c616-41bb-9be2-21090292f4a4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.015244 Sep 10 10:57:23.047252 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3126/3907] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:23 2022] POST /compute/v2.1/servers => generated 123 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 10:57:23.050671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-24cc801c-0cc6-4a60-92a7-0d05281f077f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:23.051307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-24cc801c-0cc6-4a60-92a7-0d05281f077f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:23.060260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24cc801c-0cc6-4a60-92a7-0d05281f077f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:23.061217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24cc801c-0cc6-4a60-92a7-0d05281f077f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:23.061917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24cc801c-0cc6-4a60-92a7-0d05281f077f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:23.062833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24cc801c-0cc6-4a60-92a7-0d05281f077f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:23.063625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24cc801c-0cc6-4a60-92a7-0d05281f077f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:23.064238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24cc801c-0cc6-4a60-92a7-0d05281f077f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:23.591563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0fdc9a5a-8ca9-4b76-b10f-243affde2c0d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:23.613203 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0fdc9a5a-8ca9-4b76-b10f-243affde2c0d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1667 microversion: 2.1 time: 0.926786 Sep 10 10:57:23.614985 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 782/3908] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:22 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1667 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:23.624079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-24cc801c-0cc6-4a60-92a7-0d05281f077f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:23.655706 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-24cc801c-0cc6-4a60-92a7-0d05281f077f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.602590 Sep 10 10:57:23.668276 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3127/3909] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:23 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:23.682540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-464c498e-b7fb-4b3c-9bf6-2afb4c3645f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:23.683159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-464c498e-b7fb-4b3c-9bf6-2afb4c3645f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:23.701295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-464c498e-b7fb-4b3c-9bf6-2afb4c3645f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:23.701886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-464c498e-b7fb-4b3c-9bf6-2afb4c3645f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:23.702343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-464c498e-b7fb-4b3c-9bf6-2afb4c3645f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:23.703086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-464c498e-b7fb-4b3c-9bf6-2afb4c3645f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:23.703545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-464c498e-b7fb-4b3c-9bf6-2afb4c3645f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:23.703967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-464c498e-b7fb-4b3c-9bf6-2afb4c3645f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:24.299727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-464c498e-b7fb-4b3c-9bf6-2afb4c3645f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:24.310837 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-464c498e-b7fb-4b3c-9bf6-2afb4c3645f0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.632637 Sep 10 10:57:24.312910 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 783/3910] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:23 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:24.410676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f6aa303-250d-497b-ada3-661e6b6542de tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-791346088", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "key_name": "tempest-key-935226198", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:24.544149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-2f6aa303-250d-497b-ada3-661e6b6542de tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] validate_networks() for [('5965e34a-c1b4-44c0-8b96-d4d7d1a762c7', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:57:24.656164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-195426a5-573a-4e7e-bdb3-bffcbf2d95e3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:24.656164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-195426a5-573a-4e7e-bdb3-bffcbf2d95e3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:24.671805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-195426a5-573a-4e7e-bdb3-bffcbf2d95e3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:24.677277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-195426a5-573a-4e7e-bdb3-bffcbf2d95e3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:24.680875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-195426a5-573a-4e7e-bdb3-bffcbf2d95e3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:24.685592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-195426a5-573a-4e7e-bdb3-bffcbf2d95e3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:24.686275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-195426a5-573a-4e7e-bdb3-bffcbf2d95e3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:24.689627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-195426a5-573a-4e7e-bdb3-bffcbf2d95e3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:24.766767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:25.332045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-195426a5-573a-4e7e-bdb3-bffcbf2d95e3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:25.353181 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-195426a5-573a-4e7e-bdb3-bffcbf2d95e3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1667 microversion: 2.1 time: 0.711581 Sep 10 10:57:25.354423 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 784/3911] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:24 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1667 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:25.488000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2f6aa303-250d-497b-ada3-661e6b6542de tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Invalid key_name provided. Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f6aa303-250d-497b-ada3-661e6b6542de tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 245 Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-791346088", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "key_name": "tempest-key-935226198", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid key_name provided. Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-791346088', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'key_name': 'tempest-key-935226198', 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-935226198 not found for user 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:25.497343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f6aa303-250d-497b-ada3-661e6b6542de tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid key_name provided. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f6aa303-250d-497b-ada3-661e6b6542de tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.092314 Sep 10 10:57:25.501697 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3128/3912] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:24 2022] POST /compute/v2.1/servers => generated 70 bytes in 1094 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:57:25.507753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-46e093b4-ce72-44b9-95ea-ad28644ec896 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:25.509023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-46e093b4-ce72-44b9-95ea-ad28644ec896 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:25.526750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46e093b4-ce72-44b9-95ea-ad28644ec896 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:25.527260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46e093b4-ce72-44b9-95ea-ad28644ec896 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:25.540420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46e093b4-ce72-44b9-95ea-ad28644ec896 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:25.541442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46e093b4-ce72-44b9-95ea-ad28644ec896 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:25.541940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46e093b4-ce72-44b9-95ea-ad28644ec896 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:25.542428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46e093b4-ce72-44b9-95ea-ad28644ec896 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:26.063002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-46e093b4-ce72-44b9-95ea-ad28644ec896 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:26.072594 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-46e093b4-ce72-44b9-95ea-ad28644ec896 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.568994 Sep 10 10:57:26.073695 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 785/3913] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:25 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:26.102336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-563c74e1-86da-40a0-86d1-5d4ff9d2d7b4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:26.104305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-563c74e1-86da-40a0-86d1-5d4ff9d2d7b4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:26.123124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-563c74e1-86da-40a0-86d1-5d4ff9d2d7b4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:26.123625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-563c74e1-86da-40a0-86d1-5d4ff9d2d7b4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:26.124064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-563c74e1-86da-40a0-86d1-5d4ff9d2d7b4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:26.126487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-563c74e1-86da-40a0-86d1-5d4ff9d2d7b4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:26.127764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-563c74e1-86da-40a0-86d1-5d4ff9d2d7b4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:26.128199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-563c74e1-86da-40a0-86d1-5d4ff9d2d7b4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:26.386162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e17d2fa4-9ba5-4e36-8c05-fe23422e70e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:26.386793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e17d2fa4-9ba5-4e36-8c05-fe23422e70e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:26.395136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e17d2fa4-9ba5-4e36-8c05-fe23422e70e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:26.395906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e17d2fa4-9ba5-4e36-8c05-fe23422e70e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:26.396353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e17d2fa4-9ba5-4e36-8c05-fe23422e70e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:26.400337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e17d2fa4-9ba5-4e36-8c05-fe23422e70e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:26.401825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e17d2fa4-9ba5-4e36-8c05-fe23422e70e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:26.402327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e17d2fa4-9ba5-4e36-8c05-fe23422e70e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:26.605129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-563c74e1-86da-40a0-86d1-5d4ff9d2d7b4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:26.637663 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-563c74e1-86da-40a0-86d1-5d4ff9d2d7b4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.542124 Sep 10 10:57:26.638274 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3129/3914] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:26 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:26.772564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3f6b197-9aad-4638-b39f-81e2305e38a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1251478807", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:27.695750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e17d2fa4-9ba5-4e36-8c05-fe23422e70e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:27.709888 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e17d2fa4-9ba5-4e36-8c05-fe23422e70e1 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 1.327714 Sep 10 10:57:27.712183 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 786/3915] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:26 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:27.734952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-11f2c180-f05c-45c2-9ed0-4105aaa1193d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:27.736295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-11f2c180-f05c-45c2-9ed0-4105aaa1193d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:27.750380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11f2c180-f05c-45c2-9ed0-4105aaa1193d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:27.751413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11f2c180-f05c-45c2-9ed0-4105aaa1193d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:27.754444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11f2c180-f05c-45c2-9ed0-4105aaa1193d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:27.756112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11f2c180-f05c-45c2-9ed0-4105aaa1193d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:27.756784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11f2c180-f05c-45c2-9ed0-4105aaa1193d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:27.759647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11f2c180-f05c-45c2-9ed0-4105aaa1193d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:27.761101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-f3f6b197-9aad-4638-b39f-81e2305e38a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Neutron security group does_not_exist not found {{(pid=128788) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 10 10:57:27.761694 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f3f6b197-9aad-4638-b39f-81e2305e38a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3f6b197-9aad-4638-b39f-81e2305e38a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 258 Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1251478807", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1251478807', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 10 10:57:27.764516 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 10 10:57:27.769014 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:27.778623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3f6b197-9aad-4638-b39f-81e2305e38a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:27.778623 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f3f6b197-9aad-4638-b39f-81e2305e38a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 1.008252 Sep 10 10:57:27.778623 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3130/3916] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:26 2022] POST /compute/v2.1/servers => generated 106 bytes in 1011 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 10:57:27.786007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9aabd1ab-85e2-4d16-b8bc-6db27380544c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:27.787991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9aabd1ab-85e2-4d16-b8bc-6db27380544c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:27.811816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9aabd1ab-85e2-4d16-b8bc-6db27380544c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:27.812713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9aabd1ab-85e2-4d16-b8bc-6db27380544c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:27.813312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9aabd1ab-85e2-4d16-b8bc-6db27380544c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:27.814218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9aabd1ab-85e2-4d16-b8bc-6db27380544c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:27.814836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9aabd1ab-85e2-4d16-b8bc-6db27380544c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:27.818327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9aabd1ab-85e2-4d16-b8bc-6db27380544c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:28.198440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-11f2c180-f05c-45c2-9ed0-4105aaa1193d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:28.207142 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-11f2c180-f05c-45c2-9ed0-4105aaa1193d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1670 microversion: 2.1 time: 0.476330 Sep 10 10:57:28.207652 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 787/3917] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:27 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1670 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:28.238005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:28.239904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:28.247831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:28.248617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:28.249282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:28.250196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:28.250849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:28.251443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:28.310224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:57:28.314897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9aabd1ab-85e2-4d16-b8bc-6db27380544c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:28.318727 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.compute.api [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Working on deleting snapshot 442b90ac-af39-45fd-b832-6da20410d9cf from shelved instance... Sep 10 10:57:28.334437 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9aabd1ab-85e2-4d16-b8bc-6db27380544c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.552045 Sep 10 10:57:28.336902 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3131/3918] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:27 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:28.364654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8fd7e4e3-ed29-482c-80f7-bc1a50c48d2a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:28.365339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8fd7e4e3-ed29-482c-80f7-bc1a50c48d2a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:28.384989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fd7e4e3-ed29-482c-80f7-bc1a50c48d2a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:28.385636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fd7e4e3-ed29-482c-80f7-bc1a50c48d2a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:28.386086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fd7e4e3-ed29-482c-80f7-bc1a50c48d2a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:28.388507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fd7e4e3-ed29-482c-80f7-bc1a50c48d2a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:28.393219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fd7e4e3-ed29-482c-80f7-bc1a50c48d2a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:28.395676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fd7e4e3-ed29-482c-80f7-bc1a50c48d2a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:28.718894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8fd7e4e3-ed29-482c-80f7-bc1a50c48d2a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:28.723300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:28.737404 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8fd7e4e3-ed29-482c-80f7-bc1a50c48d2a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.377929 Sep 10 10:57:28.753251 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3132/3919] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:28 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:28.769337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65c3d42e-78d8-4148-b82a-0e2fb3ba0366 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:28.776382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65c3d42e-78d8-4148-b82a-0e2fb3ba0366 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: 532f43e1-aed1-4aec-90b5-566d4f4cb9af] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:28.801788 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-65c3d42e-78d8-4148-b82a-0e2fb3ba0366 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance 532f43e1-aed1-4aec-90b5-566d4f4cb9af could not be found. Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65c3d42e-78d8-4148-b82a-0e2fb3ba0366 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/532f43e1-aed1-4aec-90b5-566d4f4cb9af HTTP/1.1 Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 532f43e1-aed1-4aec-90b5-566d4f4cb9af could not be found. Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '532f43e1-aed1-4aec-90b5-566d4f4cb9af'} Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532f43e1-aed1-4aec-90b5-566d4f4cb9af could not be found. Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532f43e1-aed1-4aec-90b5-566d4f4cb9af could not be found. Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:28.804980 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:28.809915 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:28.809915 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:28.809915 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:28.809915 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:28.809915 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:28.809915 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:28.809915 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532f43e1-aed1-4aec-90b5-566d4f4cb9af could not be found. Sep 10 10:57:28.809915 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:28.809915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65c3d42e-78d8-4148-b82a-0e2fb3ba0366 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance 532f43e1-aed1-4aec-90b5-566d4f4cb9af could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:28.809915 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65c3d42e-78d8-4148-b82a-0e2fb3ba0366 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "DELETE /compute/v2.1/servers/532f43e1-aed1-4aec-90b5-566d4f4cb9af" status: 404 len: 111 microversion: 2.1 time: 0.044222 Sep 10 10:57:28.810881 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3133/3920] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:57:28 2022] DELETE /compute/v2.1/servers/532f43e1-aed1-4aec-90b5-566d4f4cb9af => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:28.821354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69675935-ad57-473a-83a3-c5d7759f19a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:28.825093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69675935-ad57-473a-83a3-c5d7759f19a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:28.849958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69675935-ad57-473a-83a3-c5d7759f19a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:28.852215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69675935-ad57-473a-83a3-c5d7759f19a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:28.852854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69675935-ad57-473a-83a3-c5d7759f19a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:28.855358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69675935-ad57-473a-83a3-c5d7759f19a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:28.855987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69675935-ad57-473a-83a3-c5d7759f19a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:28.856843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69675935-ad57-473a-83a3-c5d7759f19a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:29.130200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-69675935-ad57-473a-83a3-c5d7759f19a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:29.153540 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69675935-ad57-473a-83a3-c5d7759f19a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.336615 Sep 10 10:57:29.154641 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3134/3921] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:28 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:29.181871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dffd9d1a-f63d-4bf5-8a8b-44c171828ace tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:29.182648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dffd9d1a-f63d-4bf5-8a8b-44c171828ace tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:29.190039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffd9d1a-f63d-4bf5-8a8b-44c171828ace tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:29.190834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffd9d1a-f63d-4bf5-8a8b-44c171828ace tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:29.191347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffd9d1a-f63d-4bf5-8a8b-44c171828ace tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:29.192163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffd9d1a-f63d-4bf5-8a8b-44c171828ace tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:29.192606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffd9d1a-f63d-4bf5-8a8b-44c171828ace tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:29.193032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dffd9d1a-f63d-4bf5-8a8b-44c171828ace tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:29.421119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dffd9d1a-f63d-4bf5-8a8b-44c171828ace tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:29.442245 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dffd9d1a-f63d-4bf5-8a8b-44c171828ace tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.264967 Sep 10 10:57:29.446528 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3135/3922] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:29 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:29.479082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a7e276b-b68f-484c-896b-de791a15b9a3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:29.479743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a7e276b-b68f-484c-896b-de791a15b9a3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 10:57:29.480798 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9a7e276b-b68f-484c-896b-de791a15b9a3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a7e276b-b68f-484c-896b-de791a15b9a3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 9223372036854775808 could not be found. Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '9223372036854775808'} Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:29.484760 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:29.490795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:29.490795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:29.490795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:29.490795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 10 10:57:29.490795 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:29.490795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a7e276b-b68f-484c-896b-de791a15b9a3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:29.491486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a7e276b-b68f-484c-896b-de791a15b9a3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.025564 Sep 10 10:57:29.499505 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3136/3923] 10.222.0.20 () {58 vars in 1188 bytes} [Sat Sep 10 10:57:29 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:57:29.504633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c46772d5-53b4-439f-8f1d-593f0991e08c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:29.511555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c46772d5-53b4-439f-8f1d-593f0991e08c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:29.530046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c46772d5-53b4-439f-8f1d-593f0991e08c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:29.538529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c46772d5-53b4-439f-8f1d-593f0991e08c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:29.539079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c46772d5-53b4-439f-8f1d-593f0991e08c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:29.539853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c46772d5-53b4-439f-8f1d-593f0991e08c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:29.550904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c46772d5-53b4-439f-8f1d-593f0991e08c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:29.551441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c46772d5-53b4-439f-8f1d-593f0991e08c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:29.644542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Doing local delete in cell de407895-2d2a-4843-aa8e-31011e0cfcb8(cell1) {{(pid=128787) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 10 10:57:29.646652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:29.647565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:29.648415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:29.649609 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.compute.api [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 10 10:57:29.661959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] deallocate_for_instance() {{(pid=128787) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 10 10:57:29.887549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c46772d5-53b4-439f-8f1d-593f0991e08c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:29.902224 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c46772d5-53b4-439f-8f1d-593f0991e08c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.400470 Sep 10 10:57:29.905749 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3137/3924] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:29 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:29.941900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae545108-00af-4e90-8e81-ec2c2e4c751d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:29.946281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ae545108-00af-4e90-8e81-ec2c2e4c751d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:29.961424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae545108-00af-4e90-8e81-ec2c2e4c751d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:29.965651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae545108-00af-4e90-8e81-ec2c2e4c751d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:29.969590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae545108-00af-4e90-8e81-ec2c2e4c751d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:29.970922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae545108-00af-4e90-8e81-ec2c2e4c751d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:29.971654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae545108-00af-4e90-8e81-ec2c2e4c751d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:29.972361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae545108-00af-4e90-8e81-ec2c2e4c751d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:30.298013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae545108-00af-4e90-8e81-ec2c2e4c751d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:30.309932 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae545108-00af-4e90-8e81-ec2c2e4c751d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.381429 Sep 10 10:57:30.315108 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3138/3925] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:29 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:30.346614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-484697d5-2625-425f-acef-168a37ffafc6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:30.347645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-484697d5-2625-425f-acef-168a37ffafc6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Failed to fetch instance by id -1 {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 10:57:30.348421 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-484697d5-2625-425f-acef-168a37ffafc6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance -1 could not be found. Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-484697d5-2625-425f-acef-168a37ffafc6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance -1 could not be found. Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '-1'} Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:30.355881 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:30.360182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:30.360182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:30.360182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 10 10:57:30.360182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:30.364255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-484697d5-2625-425f-acef-168a37ffafc6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:30.365434 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-484697d5-2625-425f-acef-168a37ffafc6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.028219 Sep 10 10:57:30.366273 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3139/3926] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 10:57:30 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:57:30.379125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9ebf2c9a-7147-44f9-b5c8-405e76a0e18c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:30.381350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9ebf2c9a-7147-44f9-b5c8-405e76a0e18c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:30.394788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebf2c9a-7147-44f9-b5c8-405e76a0e18c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:30.395310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebf2c9a-7147-44f9-b5c8-405e76a0e18c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:30.395779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebf2c9a-7147-44f9-b5c8-405e76a0e18c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:30.396506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebf2c9a-7147-44f9-b5c8-405e76a0e18c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:30.396970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebf2c9a-7147-44f9-b5c8-405e76a0e18c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:30.397946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ebf2c9a-7147-44f9-b5c8-405e76a0e18c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:30.705285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9ebf2c9a-7147-44f9-b5c8-405e76a0e18c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:30.718070 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9ebf2c9a-7147-44f9-b5c8-405e76a0e18c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.347195 Sep 10 10:57:30.733719 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3140/3927] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:30 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:30.744491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d77a55b0-17dd-46d3-9f5c-68551003b691 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:30.745439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d77a55b0-17dd-46d3-9f5c-68551003b691 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:30.752499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d77a55b0-17dd-46d3-9f5c-68551003b691 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:30.753585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d77a55b0-17dd-46d3-9f5c-68551003b691 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:30.754250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d77a55b0-17dd-46d3-9f5c-68551003b691 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:30.755150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d77a55b0-17dd-46d3-9f5c-68551003b691 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:30.755795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d77a55b0-17dd-46d3-9f5c-68551003b691 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:30.756413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d77a55b0-17dd-46d3-9f5c-68551003b691 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:31.536566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d77a55b0-17dd-46d3-9f5c-68551003b691 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:31.571525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Updating instance_info_cache with network_info: [] {{(pid=128787) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 10:57:31.591721 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d77a55b0-17dd-46d3-9f5c-68551003b691 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.849762 Sep 10 10:57:31.594400 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3141/3928] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:30 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:31.622052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7d1e812b-2441-4e3f-971b-70e27593987e req-f68ef24c-48c0-40c5-a3bd-3ea9ef081cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f28c4d-0eff-48f6-8fc0-51f95a07d38e", "name": "network-vif-deleted", "tag": "0b358bb6-e978-4218-93e3-25b76d5933d4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:31.667020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7d1e812b-2441-4e3f-971b-70e27593987e req-f68ef24c-48c0-40c5-a3bd-3ea9ef081cd8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:31.667519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7d1e812b-2441-4e3f-971b-70e27593987e req-f68ef24c-48c0-40c5-a3bd-3ea9ef081cd8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:31.668045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7d1e812b-2441-4e3f-971b-70e27593987e req-f68ef24c-48c0-40c5-a3bd-3ea9ef081cd8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:31.701678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.server_external_events [req-7d1e812b-2441-4e3f-971b-70e27593987e req-f68ef24c-48c0-40c5-a3bd-3ea9ef081cd8 service nova] Unable to find a host for instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e. Dropping event network-vif-deleted {{(pid=128788) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 10:57:31.710259 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7d1e812b-2441-4e3f-971b-70e27593987e req-f68ef24c-48c0-40c5-a3bd-3ea9ef081cd8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.110513 Sep 10 10:57:31.720824 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3142/3929] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 125 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 10:57:31.729553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-025ed8cc-d1e1-4c8e-8764-a6f9ffb0dad0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:31.730099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-025ed8cc-d1e1-4c8e-8764-a6f9ffb0dad0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f6b6b808-35a3-41e3-a0f6-302213ac2d1c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:31.756175 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-025ed8cc-d1e1-4c8e-8764-a6f9ffb0dad0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance f6b6b808-35a3-41e3-a0f6-302213ac2d1c could not be found. Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-025ed8cc-d1e1-4c8e-8764-a6f9ffb0dad0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/f6b6b808-35a3-41e3-a0f6-302213ac2d1c/action HTTP/1.1 Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 19 Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: {"forceDelete": {}} Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f6b6b808-35a3-41e3-a0f6-302213ac2d1c could not be found. Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f6b6b808-35a3-41e3-a0f6-302213ac2d1c', 'body': {'forceDelete': {}}} Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b6b808-35a3-41e3-a0f6-302213ac2d1c could not be found. Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b6b808-35a3-41e3-a0f6-302213ac2d1c could not be found. Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:31.766265 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:31.771594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:31.771594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:31.771594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b6b808-35a3-41e3-a0f6-302213ac2d1c could not be found. Sep 10 10:57:31.771594 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:31.771594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-025ed8cc-d1e1-4c8e-8764-a6f9ffb0dad0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance f6b6b808-35a3-41e3-a0f6-302213ac2d1c could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:31.771594 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-025ed8cc-d1e1-4c8e-8764-a6f9ffb0dad0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f6b6b808-35a3-41e3-a0f6-302213ac2d1c/action" status: 404 len: 111 microversion: 2.1 time: 0.045575 Sep 10 10:57:31.772582 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3143/3930] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:31 2022] POST /compute/v2.1/servers/f6b6b808-35a3-41e3-a0f6-302213ac2d1c/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:31.786185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e257eb66-10b4-4d0c-9276-a75ad9e4c7a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:31.786818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e257eb66-10b4-4d0c-9276-a75ad9e4c7a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:31.810388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e257eb66-10b4-4d0c-9276-a75ad9e4c7a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:31.810388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e257eb66-10b4-4d0c-9276-a75ad9e4c7a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:31.810618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e257eb66-10b4-4d0c-9276-a75ad9e4c7a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:31.811136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e257eb66-10b4-4d0c-9276-a75ad9e4c7a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:31.811650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e257eb66-10b4-4d0c-9276-a75ad9e4c7a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:31.812466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e257eb66-10b4-4d0c-9276-a75ad9e4c7a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:32.192475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e257eb66-10b4-4d0c-9276-a75ad9e4c7a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:32.202392 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e257eb66-10b4-4d0c-9276-a75ad9e4c7a9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.429252 Sep 10 10:57:32.231110 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3144/3931] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:31 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:32.238541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d1eff549-f056-48d3-bb0b-a5016bea8d7e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:32.239324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d1eff549-f056-48d3-bb0b-a5016bea8d7e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:32.248483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1eff549-f056-48d3-bb0b-a5016bea8d7e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:32.249439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1eff549-f056-48d3-bb0b-a5016bea8d7e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:32.250051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1eff549-f056-48d3-bb0b-a5016bea8d7e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:32.251224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1eff549-f056-48d3-bb0b-a5016bea8d7e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:32.252037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1eff549-f056-48d3-bb0b-a5016bea8d7e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:32.252621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1eff549-f056-48d3-bb0b-a5016bea8d7e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:32.539027 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-60cd240e-4324-43f7-b9a5-3c9aecd2b53b tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "DELETE /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 204 len: 0 microversion: 2.1 time: 4.305980 Sep 10 10:57:32.541353 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 788/3932] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:57:28 2022] DELETE /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 0 bytes in 4310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:57:32.555860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:32.557508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 15f28c4d-0eff-48f6-8fc0-51f95a07d38e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:32.585675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:32.586956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:32.589971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:32.591262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:32.594193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:32.595337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:32.604529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d1eff549-f056-48d3-bb0b-a5016bea8d7e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:32.624296 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d1eff549-f056-48d3-bb0b-a5016bea8d7e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.391491 Sep 10 10:57:32.628726 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3145/3933] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:32 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:32.635723 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] HTTP exception thrown: Instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e could not be found. Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Request method failure captured: Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e HTTP/1.1 Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGteXl1e-hAw6XiTQIFIHZpjOFH3LyNvDq2Jp5-9mD1eNO8FqxuehXxaCJTaSZqtqNEpKdqKeFAGSty1sDCnAg7xDRB9cZeEHOlu6NwV0sQ54jfeAmVZITRhNMqOinMUIr7XAVe-oWNQ5kCGtEmg_938l6s4SBd3Xy7X_t0g_hbbsig Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/524c87c1679a4651a4e303650950283c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_524c87c1679a4651a4e303650950283c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 2cccb6588d07459eb1cfa9c00f53f7e2 Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e could not be found. Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '15f28c4d-0eff-48f6-8fc0-51f95a07d38e'} Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e could not be found. Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e could not be found. Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:32.637736 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:32.642258 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:32.642258 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:32.642258 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:32.642258 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:32.642258 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:32.642258 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e could not be found. Sep 10 10:57:32.642258 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:32.642258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Returning 404 to user: Instance 15f28c4d-0eff-48f6-8fc0-51f95a07d38e could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:32.642258 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fba82dc0-05f9-4d9f-be68-c36d96247751 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e" status: 404 len: 111 microversion: 2.1 time: 0.088219 Sep 10 10:57:32.642258 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 789/3934] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:32 2022] GET /compute/v2.1/servers/15f28c4d-0eff-48f6-8fc0-51f95a07d38e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:32.649220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ccf726a-4983-4c25-897f-576e9c84a676 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:32.649926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ccf726a-4983-4c25-897f-576e9c84a676 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:32.667351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccf726a-4983-4c25-897f-576e9c84a676 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:32.670693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccf726a-4983-4c25-897f-576e9c84a676 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:32.671665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccf726a-4983-4c25-897f-576e9c84a676 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:32.674311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccf726a-4983-4c25-897f-576e9c84a676 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:32.674907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccf726a-4983-4c25-897f-576e9c84a676 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:32.678190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ccf726a-4983-4c25-897f-576e9c84a676 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:32.679958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a388f6f0-74f0-4877-b33c-21bb35f1fa89 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:32.686602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a388f6f0-74f0-4877-b33c-21bb35f1fa89 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: dbcee1dc-b18c-46b9-8621-d9527a3add68] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:32.699334 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-a388f6f0-74f0-4877-b33c-21bb35f1fa89 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance dbcee1dc-b18c-46b9-8621-d9527a3add68 could not be found. Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a388f6f0-74f0-4877-b33c-21bb35f1fa89 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/dbcee1dc-b18c-46b9-8621-d9527a3add68/action HTTP/1.1 Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 39 Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: {"os-getConsoleOutput": {"length": 10}} Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance dbcee1dc-b18c-46b9-8621-d9527a3add68 could not be found. Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'dbcee1dc-b18c-46b9-8621-d9527a3add68', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbcee1dc-b18c-46b9-8621-d9527a3add68 could not be found. Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbcee1dc-b18c-46b9-8621-d9527a3add68 could not be found. Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:32.709053 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:32.714239 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:32.714239 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:32.714239 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:32.714239 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:32.714239 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbcee1dc-b18c-46b9-8621-d9527a3add68 could not be found. Sep 10 10:57:32.714239 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:32.714239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a388f6f0-74f0-4877-b33c-21bb35f1fa89 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance dbcee1dc-b18c-46b9-8621-d9527a3add68 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:32.716394 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a388f6f0-74f0-4877-b33c-21bb35f1fa89 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/dbcee1dc-b18c-46b9-8621-d9527a3add68/action" status: 404 len: 111 microversion: 2.1 time: 0.058179 Sep 10 10:57:32.717854 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 790/3935] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:32 2022] POST /compute/v2.1/servers/dbcee1dc-b18c-46b9-8621-d9527a3add68/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:32.732872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4fb6068-2963-4614-b5d8-503fa5f99574 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:32.735365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b4fb6068-2963-4614-b5d8-503fa5f99574 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:32.756758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4fb6068-2963-4614-b5d8-503fa5f99574 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:32.760706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ccf726a-4983-4c25-897f-576e9c84a676 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:57:32.761379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4fb6068-2963-4614-b5d8-503fa5f99574 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:32.762828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4fb6068-2963-4614-b5d8-503fa5f99574 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:32.763701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4fb6068-2963-4614-b5d8-503fa5f99574 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:32.764687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4fb6068-2963-4614-b5d8-503fa5f99574 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:32.766461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4fb6068-2963-4614-b5d8-503fa5f99574 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:32.977310 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ccf726a-4983-4c25-897f-576e9c84a676 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 204 len: 0 microversion: 2.1 time: 0.330191 Sep 10 10:57:32.980877 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3146/3936] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:57:32 2022] DELETE /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:57:32.989452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69897371-8103-4832-930b-2d17c0f91c05 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:32.990587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69897371-8103-4832-930b-2d17c0f91c05 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:32.999494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69897371-8103-4832-930b-2d17c0f91c05 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:33.000430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69897371-8103-4832-930b-2d17c0f91c05 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:33.001320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69897371-8103-4832-930b-2d17c0f91c05 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:33.002202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69897371-8103-4832-930b-2d17c0f91c05 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:33.002863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69897371-8103-4832-930b-2d17c0f91c05 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:33.003290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69897371-8103-4832-930b-2d17c0f91c05 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:33.192176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-69897371-8103-4832-930b-2d17c0f91c05 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:33.205460 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69897371-8103-4832-930b-2d17c0f91c05 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1464 microversion: 2.1 time: 0.220425 Sep 10 10:57:33.207014 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3147/3937] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:32 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1464 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:33.253277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b4fb6068-2963-4614-b5d8-503fa5f99574 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:33.262900 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b4fb6068-2963-4614-b5d8-503fa5f99574 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.541352 Sep 10 10:57:33.264090 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 791/3938] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:32 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:33.295454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4493a396-a4dc-4bbd-bb34-b98e9a298940 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:33.297668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4493a396-a4dc-4bbd-bb34-b98e9a298940 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:33.305362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4493a396-a4dc-4bbd-bb34-b98e9a298940 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:33.306277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4493a396-a4dc-4bbd-bb34-b98e9a298940 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:33.306926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4493a396-a4dc-4bbd-bb34-b98e9a298940 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:33.308053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4493a396-a4dc-4bbd-bb34-b98e9a298940 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:33.308734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4493a396-a4dc-4bbd-bb34-b98e9a298940 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:33.309840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4493a396-a4dc-4bbd-bb34-b98e9a298940 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:33.678290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4493a396-a4dc-4bbd-bb34-b98e9a298940 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:33.694157 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4493a396-a4dc-4bbd-bb34-b98e9a298940 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.407698 Sep 10 10:57:33.700602 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3148/3939] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:33 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:33.722764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-68f59c4c-fd58-4cce-82bb-11482a1bf500 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:33.723381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-68f59c4c-fd58-4cce-82bb-11482a1bf500 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: adf92c38-d9c9-43f1-b035-fd6268d4ba27] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:33.729249 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-68f59c4c-fd58-4cce-82bb-11482a1bf500 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance adf92c38-d9c9-43f1-b035-fd6268d4ba27 could not be found. Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-68f59c4c-fd58-4cce-82bb-11482a1bf500 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/adf92c38-d9c9-43f1-b035-fd6268d4ba27 HTTP/1.1 Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance adf92c38-d9c9-43f1-b035-fd6268d4ba27 could not be found. Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'adf92c38-d9c9-43f1-b035-fd6268d4ba27'} Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf92c38-d9c9-43f1-b035-fd6268d4ba27 could not be found. Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf92c38-d9c9-43f1-b035-fd6268d4ba27 could not be found. Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:33.730759 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:33.738885 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:33.738885 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:33.738885 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:33.738885 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf92c38-d9c9-43f1-b035-fd6268d4ba27 could not be found. Sep 10 10:57:33.738885 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:33.738885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-68f59c4c-fd58-4cce-82bb-11482a1bf500 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance adf92c38-d9c9-43f1-b035-fd6268d4ba27 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:33.738885 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-68f59c4c-fd58-4cce-82bb-11482a1bf500 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/adf92c38-d9c9-43f1-b035-fd6268d4ba27" status: 404 len: 111 microversion: 2.1 time: 0.013349 Sep 10 10:57:33.740696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c9e854a5-28e6-4bc0-bf20-631948cbe967 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:33.750686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c9e854a5-28e6-4bc0-bf20-631948cbe967 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:33.758235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9e854a5-28e6-4bc0-bf20-631948cbe967 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:33.758773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9e854a5-28e6-4bc0-bf20-631948cbe967 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:33.759809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9e854a5-28e6-4bc0-bf20-631948cbe967 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:33.760486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9e854a5-28e6-4bc0-bf20-631948cbe967 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:33.760958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9e854a5-28e6-4bc0-bf20-631948cbe967 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:33.771584 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 792/3940] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:33 2022] GET /compute/v2.1/servers/adf92c38-d9c9-43f1-b035-fd6268d4ba27 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:33.772236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9e854a5-28e6-4bc0-bf20-631948cbe967 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:34.132821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c9e854a5-28e6-4bc0-bf20-631948cbe967 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:34.149703 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c9e854a5-28e6-4bc0-bf20-631948cbe967 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.412247 Sep 10 10:57:34.152338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3149/3941] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:33 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:34.180826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-67ebcd05-965c-4173-9c76-ced1286290d3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:34.193112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-67ebcd05-965c-4173-9c76-ced1286290d3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:34.208205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ebcd05-965c-4173-9c76-ced1286290d3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:34.208768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ebcd05-965c-4173-9c76-ced1286290d3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:34.209258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ebcd05-965c-4173-9c76-ced1286290d3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:34.209981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ebcd05-965c-4173-9c76-ced1286290d3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:34.210441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ebcd05-965c-4173-9c76-ced1286290d3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:34.219058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ebcd05-965c-4173-9c76-ced1286290d3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:34.237964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa87a11a-40dd-4717-9250-9a41a7adc61d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:34.238838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa87a11a-40dd-4717-9250-9a41a7adc61d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:34.253176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa87a11a-40dd-4717-9250-9a41a7adc61d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:34.253756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa87a11a-40dd-4717-9250-9a41a7adc61d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:34.255796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa87a11a-40dd-4717-9250-9a41a7adc61d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:34.256718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa87a11a-40dd-4717-9250-9a41a7adc61d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:34.258400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa87a11a-40dd-4717-9250-9a41a7adc61d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:34.259586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa87a11a-40dd-4717-9250-9a41a7adc61d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:34.518480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa87a11a-40dd-4717-9250-9a41a7adc61d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:34.535478 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa87a11a-40dd-4717-9250-9a41a7adc61d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1464 microversion: 2.1 time: 0.305181 Sep 10 10:57:34.543773 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3150/3942] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:34 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1464 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:34.810139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-67ebcd05-965c-4173-9c76-ced1286290d3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:34.826820 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-67ebcd05-965c-4173-9c76-ced1286290d3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.649671 Sep 10 10:57:34.837156 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 793/3943] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:34 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:35.119129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7748845-5cfe-4f57-abcc-c0b39e7dcb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1456716613", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7748845-5cfe-4f57-abcc-c0b39e7dcb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 238 Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1456716613", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1456716613', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:35.136700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7748845-5cfe-4f57-abcc-c0b39e7dcb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7748845-5cfe-4f57-abcc-c0b39e7dcb48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024459 Sep 10 10:57:35.147838 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3151/3944] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:57:35.152573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-017cb8b6-36f6-4f73-969f-853d6d9e7eac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:35.152573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-017cb8b6-36f6-4f73-969f-853d6d9e7eac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:35.168555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-017cb8b6-36f6-4f73-969f-853d6d9e7eac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:35.169099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-017cb8b6-36f6-4f73-969f-853d6d9e7eac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:35.169537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-017cb8b6-36f6-4f73-969f-853d6d9e7eac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:35.176053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-017cb8b6-36f6-4f73-969f-853d6d9e7eac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:35.176541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-017cb8b6-36f6-4f73-969f-853d6d9e7eac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:35.176985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-017cb8b6-36f6-4f73-969f-853d6d9e7eac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:35.564116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c7aa7a11-b022-4df5-99de-bf2e7e4a2882 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:35.565122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c7aa7a11-b022-4df5-99de-bf2e7e4a2882 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:35.578085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7aa7a11-b022-4df5-99de-bf2e7e4a2882 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:35.579640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7aa7a11-b022-4df5-99de-bf2e7e4a2882 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:35.580305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7aa7a11-b022-4df5-99de-bf2e7e4a2882 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:35.582319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7aa7a11-b022-4df5-99de-bf2e7e4a2882 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:35.583054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7aa7a11-b022-4df5-99de-bf2e7e4a2882 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:35.583701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7aa7a11-b022-4df5-99de-bf2e7e4a2882 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:35.591793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-017cb8b6-36f6-4f73-969f-853d6d9e7eac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:35.604999 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-017cb8b6-36f6-4f73-969f-853d6d9e7eac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.460931 Sep 10 10:57:35.606910 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 794/3945] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:35 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:35.633203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b5c10e6d-a134-41b5-8a3c-bbac00a6a10c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:35.633863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b5c10e6d-a134-41b5-8a3c-bbac00a6a10c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:35.637724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:35.644377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5c10e6d-a134-41b5-8a3c-bbac00a6a10c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:35.645226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5c10e6d-a134-41b5-8a3c-bbac00a6a10c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:35.645671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5c10e6d-a134-41b5-8a3c-bbac00a6a10c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:35.649578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5c10e6d-a134-41b5-8a3c-bbac00a6a10c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:35.650145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5c10e6d-a134-41b5-8a3c-bbac00a6a10c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:35.650642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5c10e6d-a134-41b5-8a3c-bbac00a6a10c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:35.875211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c7aa7a11-b022-4df5-99de-bf2e7e4a2882 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:35.886170 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c7aa7a11-b022-4df5-99de-bf2e7e4a2882 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1464 microversion: 2.1 time: 0.328705 Sep 10 10:57:35.903772 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3152/3946] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:35 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:36.329681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e640d648-14e0-4190-b59f-159d7a4cbfd2 req-74210c57-0fe9-4aa6-8448-9d74723334e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5310a126-b532-4a13-ae0b-c8c28404e216", "name": "network-vif-deleted", "tag": "2afd01b6-b544-4775-aa92-3d29b23ff0e8"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:36.355575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e640d648-14e0-4190-b59f-159d7a4cbfd2 req-74210c57-0fe9-4aa6-8448-9d74723334e6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:36.359238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e640d648-14e0-4190-b59f-159d7a4cbfd2 req-74210c57-0fe9-4aa6-8448-9d74723334e6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:36.359739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e640d648-14e0-4190-b59f-159d7a4cbfd2 req-74210c57-0fe9-4aa6-8448-9d74723334e6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:36.392982 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e640d648-14e0-4190-b59f-159d7a4cbfd2 req-74210c57-0fe9-4aa6-8448-9d74723334e6 service nova] Creating event network-vif-deleted:2afd01b6-b544-4775-aa92-3d29b23ff0e8 for instance 5310a126-b532-4a13-ae0b-c8c28404e216 on n-h2-856894-1 Sep 10 10:57:36.405726 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e640d648-14e0-4190-b59f-159d7a4cbfd2 req-74210c57-0fe9-4aa6-8448-9d74723334e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080017 Sep 10 10:57:36.406711 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3153/3947] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:57:36.430142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b5c10e6d-a134-41b5-8a3c-bbac00a6a10c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:36.453963 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b5c10e6d-a134-41b5-8a3c-bbac00a6a10c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.824923 Sep 10 10:57:36.454900 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 795/3948] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:35 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:36.603592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-12e4a98b-0b51-47e6-9e49-9ae067683870 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1139526249", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-12e4a98b-0b51-47e6-9e49-9ae067683870 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 235 Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1139526249", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1139526249', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:36.623472 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 10 10:57:36.630893 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:36.638835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-12e4a98b-0b51-47e6-9e49-9ae067683870 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:36.643397 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-12e4a98b-0b51-47e6-9e49-9ae067683870 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.046702 Sep 10 10:57:36.646412 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3154/3949] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:36 2022] POST /compute/v2.1/servers => generated 133 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 10:57:36.666024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cec5ad23-bd51-44a9-96ab-e1a477a62d46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:36.666959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cec5ad23-bd51-44a9-96ab-e1a477a62d46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:36.690325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec5ad23-bd51-44a9-96ab-e1a477a62d46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:36.691341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec5ad23-bd51-44a9-96ab-e1a477a62d46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:36.692213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec5ad23-bd51-44a9-96ab-e1a477a62d46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:36.693669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec5ad23-bd51-44a9-96ab-e1a477a62d46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:36.695062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec5ad23-bd51-44a9-96ab-e1a477a62d46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:36.695928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec5ad23-bd51-44a9-96ab-e1a477a62d46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:36.913367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:36.914643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:36.936534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:36.937940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:36.939345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:36.941451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:36.942167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:36.942834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:36.947869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:37.056693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:37.057214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:37.057657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:37.058112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lazy-loading 'fault' on Instance uuid 5310a126-b532-4a13-ae0b-c8c28404e216 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:57:37.186398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:37.197520 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-408fdc4b-d9f4-497b-bd7e-da3f147e0dff tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 200 len: 1304 microversion: 2.1 time: 0.288233 Sep 10 10:57:37.198874 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3155/3950] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:36 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 1304 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:37.214682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cec5ad23-bd51-44a9-96ab-e1a477a62d46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:37.223046 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cec5ad23-bd51-44a9-96ab-e1a477a62d46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.571567 Sep 10 10:57:37.223628 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 796/3951] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:36 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:37.248864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1993c9f2-5869-4f16-8072-a8fc68814086 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:37.249950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1993c9f2-5869-4f16-8072-a8fc68814086 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:37.260188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1993c9f2-5869-4f16-8072-a8fc68814086 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:37.261036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1993c9f2-5869-4f16-8072-a8fc68814086 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:37.261585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1993c9f2-5869-4f16-8072-a8fc68814086 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:37.262616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1993c9f2-5869-4f16-8072-a8fc68814086 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:37.263071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1993c9f2-5869-4f16-8072-a8fc68814086 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:37.264143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1993c9f2-5869-4f16-8072-a8fc68814086 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:37.550501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1993c9f2-5869-4f16-8072-a8fc68814086 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:37.567970 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1993c9f2-5869-4f16-8072-a8fc68814086 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.319776 Sep 10 10:57:37.582363 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3156/3952] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:37 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:37.593583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2a019b91-5e1d-475e-9b63-cb78c0fca135 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:37.594950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2a019b91-5e1d-475e-9b63-cb78c0fca135 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f4b7314d-de92-45da-8eae-6fc01416219c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:37.603596 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-2a019b91-5e1d-475e-9b63-cb78c0fca135 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance f4b7314d-de92-45da-8eae-6fc01416219c could not be found. Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2a019b91-5e1d-475e-9b63-cb78c0fca135 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/f4b7314d-de92-45da-8eae-6fc01416219c/action HTTP/1.1 Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 13 Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: {"pause": {}} Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance f4b7314d-de92-45da-8eae-6fc01416219c could not be found. Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f4b7314d-de92-45da-8eae-6fc01416219c', 'body': {'pause': {}}} Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b7314d-de92-45da-8eae-6fc01416219c could not be found. Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b7314d-de92-45da-8eae-6fc01416219c could not be found. Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:37.614654 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:37.619391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:37.619391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:37.619391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b7314d-de92-45da-8eae-6fc01416219c could not be found. Sep 10 10:57:37.619391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:37.621405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2a019b91-5e1d-475e-9b63-cb78c0fca135 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance f4b7314d-de92-45da-8eae-6fc01416219c could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:37.624323 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2a019b91-5e1d-475e-9b63-cb78c0fca135 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f4b7314d-de92-45da-8eae-6fc01416219c/action" status: 404 len: 111 microversion: 2.1 time: 0.033469 Sep 10 10:57:37.636710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-58919a01-1b5f-49e5-9e0e-e496953b7e92 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:37.638004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-58919a01-1b5f-49e5-9e0e-e496953b7e92 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:37.639410 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 797/3953] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:37 2022] POST /compute/v2.1/servers/f4b7314d-de92-45da-8eae-6fc01416219c/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:37.648956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58919a01-1b5f-49e5-9e0e-e496953b7e92 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:37.650557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58919a01-1b5f-49e5-9e0e-e496953b7e92 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:37.651571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58919a01-1b5f-49e5-9e0e-e496953b7e92 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:37.652504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58919a01-1b5f-49e5-9e0e-e496953b7e92 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:37.653148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58919a01-1b5f-49e5-9e0e-e496953b7e92 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:37.653799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58919a01-1b5f-49e5-9e0e-e496953b7e92 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:38.144086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-58919a01-1b5f-49e5-9e0e-e496953b7e92 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:38.175551 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-58919a01-1b5f-49e5-9e0e-e496953b7e92 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.525082 Sep 10 10:57:38.176979 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3157/3954] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:37 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:38.202763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-698424eb-44ce-4566-84fa-0afb619c2945 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:38.203515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-698424eb-44ce-4566-84fa-0afb619c2945 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:38.218449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698424eb-44ce-4566-84fa-0afb619c2945 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:38.222900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698424eb-44ce-4566-84fa-0afb619c2945 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:38.223619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698424eb-44ce-4566-84fa-0afb619c2945 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:38.224682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698424eb-44ce-4566-84fa-0afb619c2945 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:38.224804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:38.225369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 5310a126-b532-4a13-ae0b-c8c28404e216] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:38.225907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698424eb-44ce-4566-84fa-0afb619c2945 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:38.228524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698424eb-44ce-4566-84fa-0afb619c2945 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:38.236356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:38.284513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:38.285186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:38.285730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:38.289945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:38.292060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:38.292600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:38.336972 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] HTTP exception thrown: Instance 5310a126-b532-4a13-ae0b-c8c28404e216 could not be found. Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Request method failure captured: Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 HTTP/1.1 Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGteXl1e-hAw6XiTQIFIHZpjOFH3LyNvDq2Jp5-9mD1eNO8FqxuehXxaCJTaSZqtqNEpKdqKeFAGSty1sDCnAg7xDRB9cZeEHOlu6NwV0sQ54jfeAmVZITRhNMqOinMUIr7XAVe-oWNQ5kCGtEmg_938l6s4SBd3Xy7X_t0g_hbbsig Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/524c87c1679a4651a4e303650950283c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_524c87c1679a4651a4e303650950283c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 2cccb6588d07459eb1cfa9c00f53f7e2 Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 5310a126-b532-4a13-ae0b-c8c28404e216 could not be found. Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '5310a126-b532-4a13-ae0b-c8c28404e216'} Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5310a126-b532-4a13-ae0b-c8c28404e216 could not be found. Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5310a126-b532-4a13-ae0b-c8c28404e216 could not be found. Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:38.346051 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:38.351532 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:38.351532 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:38.351532 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:38.351532 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:38.351532 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:38.351532 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5310a126-b532-4a13-ae0b-c8c28404e216 could not be found. Sep 10 10:57:38.351532 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:38.352958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Returning 404 to user: Instance 5310a126-b532-4a13-ae0b-c8c28404e216 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:38.354653 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa36d0a3-b033-4f35-8153-6ef69e2c283d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216" status: 404 len: 111 microversion: 2.1 time: 0.134007 Sep 10 10:57:38.359696 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3158/3955] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:38 2022] GET /compute/v2.1/servers/5310a126-b532-4a13-ae0b-c8c28404e216 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:38.368042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-203494aa-036f-4984-8222-df2eff7debb5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:38.374716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-203494aa-036f-4984-8222-df2eff7debb5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:38.388624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-203494aa-036f-4984-8222-df2eff7debb5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:38.389152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-203494aa-036f-4984-8222-df2eff7debb5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:38.392969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-203494aa-036f-4984-8222-df2eff7debb5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:38.393959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-203494aa-036f-4984-8222-df2eff7debb5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:38.394449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-203494aa-036f-4984-8222-df2eff7debb5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:38.395653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-203494aa-036f-4984-8222-df2eff7debb5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:38.471152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-203494aa-036f-4984-8222-df2eff7debb5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:57:38.689674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-698424eb-44ce-4566-84fa-0afb619c2945 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:38.745608 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-698424eb-44ce-4566-84fa-0afb619c2945 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.546464 Sep 10 10:57:38.748491 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-203494aa-036f-4984-8222-df2eff7debb5 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 204 len: 0 microversion: 2.1 time: 0.385153 Sep 10 10:57:38.755652 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3159/3956] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:57:38 2022] DELETE /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:57:38.772002 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 798/3957] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:38 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:38.783171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-198f89ff-e6cc-4438-8b95-c3c2a46da97d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:38.783886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-198f89ff-e6cc-4438-8b95-c3c2a46da97d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:38.804366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d02ee0fb-32b4-47fa-baa3-513d09ef4611 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:38.820521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d02ee0fb-32b4-47fa-baa3-513d09ef4611 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:38.838250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-198f89ff-e6cc-4438-8b95-c3c2a46da97d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:38.841702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-198f89ff-e6cc-4438-8b95-c3c2a46da97d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:38.843504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02ee0fb-32b4-47fa-baa3-513d09ef4611 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:38.844196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-198f89ff-e6cc-4438-8b95-c3c2a46da97d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:38.851439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02ee0fb-32b4-47fa-baa3-513d09ef4611 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:38.851897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02ee0fb-32b4-47fa-baa3-513d09ef4611 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:38.852688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02ee0fb-32b4-47fa-baa3-513d09ef4611 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:38.854571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-198f89ff-e6cc-4438-8b95-c3c2a46da97d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:38.855230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-198f89ff-e6cc-4438-8b95-c3c2a46da97d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:38.855689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-198f89ff-e6cc-4438-8b95-c3c2a46da97d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:38.862041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02ee0fb-32b4-47fa-baa3-513d09ef4611 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:38.862531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d02ee0fb-32b4-47fa-baa3-513d09ef4611 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:39.094994 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d02ee0fb-32b4-47fa-baa3-513d09ef4611 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 202 len: 0 microversion: 2.1 time: 0.303554 Sep 10 10:57:39.095654 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 799/3958] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:38 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:57:39.110306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-60de1e54-5af6-4d18-8e7c-e93e5b1242a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:39.111587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-60de1e54-5af6-4d18-8e7c-e93e5b1242a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:39.126047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60de1e54-5af6-4d18-8e7c-e93e5b1242a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:39.131318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60de1e54-5af6-4d18-8e7c-e93e5b1242a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:39.132695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60de1e54-5af6-4d18-8e7c-e93e5b1242a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:39.136631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60de1e54-5af6-4d18-8e7c-e93e5b1242a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:39.137291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60de1e54-5af6-4d18-8e7c-e93e5b1242a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:39.137952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60de1e54-5af6-4d18-8e7c-e93e5b1242a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:39.812570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-198f89ff-e6cc-4438-8b95-c3c2a46da97d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:39.822799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-60de1e54-5af6-4d18-8e7c-e93e5b1242a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:39.841621 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-60de1e54-5af6-4d18-8e7c-e93e5b1242a2 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1510 microversion: 2.1 time: 0.739623 Sep 10 10:57:39.859257 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-198f89ff-e6cc-4438-8b95-c3c2a46da97d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1506 microversion: 2.1 time: 1.067454 Sep 10 10:57:39.860003 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 800/3960] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:39 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1510 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:39.860298 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3160/3960] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:38 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1506 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:40.871871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dabb99be-03ed-483c-9eb3-b3ce15fa66cd tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:40.873424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dabb99be-03ed-483c-9eb3-b3ce15fa66cd tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:40.887802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c907e0a6-17f2-42fd-8cf8-ecd7c9fabbcf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:40.889530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c907e0a6-17f2-42fd-8cf8-ecd7c9fabbcf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:40.913164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dabb99be-03ed-483c-9eb3-b3ce15fa66cd tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:40.919580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c907e0a6-17f2-42fd-8cf8-ecd7c9fabbcf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:40.920186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dabb99be-03ed-483c-9eb3-b3ce15fa66cd tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:40.922140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c907e0a6-17f2-42fd-8cf8-ecd7c9fabbcf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:40.923641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dabb99be-03ed-483c-9eb3-b3ce15fa66cd tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:40.924591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dabb99be-03ed-483c-9eb3-b3ce15fa66cd tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:40.925577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c907e0a6-17f2-42fd-8cf8-ecd7c9fabbcf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:40.927543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dabb99be-03ed-483c-9eb3-b3ce15fa66cd tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:40.927911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dabb99be-03ed-483c-9eb3-b3ce15fa66cd tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:40.934931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c907e0a6-17f2-42fd-8cf8-ecd7c9fabbcf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:40.935135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c907e0a6-17f2-42fd-8cf8-ecd7c9fabbcf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:40.935527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c907e0a6-17f2-42fd-8cf8-ecd7c9fabbcf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:41.226463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c907e0a6-17f2-42fd-8cf8-ecd7c9fabbcf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:41.240914 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c907e0a6-17f2-42fd-8cf8-ecd7c9fabbcf tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1464 microversion: 2.1 time: 0.357581 Sep 10 10:57:41.243217 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3161/3961] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:40 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1464 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:41.395305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9dcc2d2d-cf76-4977-b4de-f3c7eb484c12 req-7dae7470-256a-4b12-a287-82f4719b9f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6034e33-1269-4d6c-81a9-8a8f101bf8b1", "name": "network-vif-deleted", "tag": "a220a107-c19a-4688-b299-339f7e0fbdb2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:41.438160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9dcc2d2d-cf76-4977-b4de-f3c7eb484c12 req-7dae7470-256a-4b12-a287-82f4719b9f6e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:41.441985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9dcc2d2d-cf76-4977-b4de-f3c7eb484c12 req-7dae7470-256a-4b12-a287-82f4719b9f6e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:41.442533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9dcc2d2d-cf76-4977-b4de-f3c7eb484c12 req-7dae7470-256a-4b12-a287-82f4719b9f6e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:41.474457 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9dcc2d2d-cf76-4977-b4de-f3c7eb484c12 req-7dae7470-256a-4b12-a287-82f4719b9f6e service nova] Creating event network-vif-deleted:a220a107-c19a-4688-b299-339f7e0fbdb2 for instance f6034e33-1269-4d6c-81a9-8a8f101bf8b1 on n-h2-856894-1 Sep 10 10:57:41.500047 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9dcc2d2d-cf76-4977-b4de-f3c7eb484c12 req-7dae7470-256a-4b12-a287-82f4719b9f6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103587 Sep 10 10:57:41.503485 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3162/3962] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:57:41.600927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dabb99be-03ed-483c-9eb3-b3ce15fa66cd tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:41.626617 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dabb99be-03ed-483c-9eb3-b3ce15fa66cd tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1490 microversion: 2.1 time: 0.760130 Sep 10 10:57:41.627245 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 801/3963] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:40 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1490 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:41.658204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:41.659286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:41.699823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:41.700254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:41.700857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:41.702636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:41.703106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:41.705819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:41.788391 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Cannot 'pause' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state paused Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action HTTP/1.1 Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 13 Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: {"pause": {}} Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'pause' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state paused Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f1fff5af-b5bc-4a39-a5a3-81c17a2b397b', 'body': {'pause': {}}} Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b in vm_state paused. Cannot pause while the instance is in this state. Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state paused Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:41.797418 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:41.803078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:41.803078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:41.803078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:41.803078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state paused Sep 10 10:57:41.803078 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:41.803078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 409 to user: Cannot 'pause' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state paused {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:41.803078 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e605e179-8da0-4c07-b783-f4157d77a45e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 409 len: 143 microversion: 2.1 time: 0.147813 Sep 10 10:57:41.803873 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3163/3964] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:41 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 143 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:57:41.814667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bf9ef9dc-f186-43c6-be87-c6eeda405a07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:41.815231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bf9ef9dc-f186-43c6-be87-c6eeda405a07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:41.846982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ef9dc-f186-43c6-be87-c6eeda405a07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:41.846982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ef9dc-f186-43c6-be87-c6eeda405a07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:41.846982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ef9dc-f186-43c6-be87-c6eeda405a07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:41.847381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ef9dc-f186-43c6-be87-c6eeda405a07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:41.847836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ef9dc-f186-43c6-be87-c6eeda405a07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:41.848256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf9ef9dc-f186-43c6-be87-c6eeda405a07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:42.071112 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bf9ef9dc-f186-43c6-be87-c6eeda405a07 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 202 len: 0 microversion: 2.1 time: 0.261550 Sep 10 10:57:42.078829 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 802/3965] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:41 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:57:42.080814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9075f24-bc05-4ad9-ae18-9a6463621668 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:42.081536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b9075f24-bc05-4ad9-ae18-9a6463621668 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:42.103162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9075f24-bc05-4ad9-ae18-9a6463621668 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:42.104088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9075f24-bc05-4ad9-ae18-9a6463621668 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:42.109839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9075f24-bc05-4ad9-ae18-9a6463621668 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:42.111111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9075f24-bc05-4ad9-ae18-9a6463621668 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:42.113951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9075f24-bc05-4ad9-ae18-9a6463621668 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:42.115195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9075f24-bc05-4ad9-ae18-9a6463621668 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:42.269108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:42.270285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:42.282547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:42.332950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:42.335929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:42.346050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:42.348907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:42.350451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:42.465405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:42.466479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:42.469433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:42.470218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lazy-loading 'fault' on Instance uuid f6034e33-1269-4d6c-81a9-8a8f101bf8b1 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:57:42.572584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:42.587970 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-037e7f2c-6262-4d60-aa27-54871eba8960 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 200 len: 1304 microversion: 2.1 time: 0.322391 Sep 10 10:57:42.588555 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 803/3966] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:42 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 1304 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:42.754404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9075f24-bc05-4ad9-ae18-9a6463621668 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:42.776155 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b9075f24-bc05-4ad9-ae18-9a6463621668 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1497 microversion: 2.1 time: 0.693940 Sep 10 10:57:42.776827 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3164/3967] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:42 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1497 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:43.617379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:43.618237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: f6034e33-1269-4d6c-81a9-8a8f101bf8b1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:43.632469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:43.633296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:43.637215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:43.643271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:43.643662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:43.645627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:43.706539 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] HTTP exception thrown: Instance f6034e33-1269-4d6c-81a9-8a8f101bf8b1 could not be found. Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Request method failure captured: Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 HTTP/1.1 Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGteXl1e-hAw6XiTQIFIHZpjOFH3LyNvDq2Jp5-9mD1eNO8FqxuehXxaCJTaSZqtqNEpKdqKeFAGSty1sDCnAg7xDRB9cZeEHOlu6NwV0sQ54jfeAmVZITRhNMqOinMUIr7XAVe-oWNQ5kCGtEmg_938l6s4SBd3Xy7X_t0g_hbbsig Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/524c87c1679a4651a4e303650950283c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_524c87c1679a4651a4e303650950283c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 2cccb6588d07459eb1cfa9c00f53f7e2 Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance f6034e33-1269-4d6c-81a9-8a8f101bf8b1 could not be found. Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f6034e33-1269-4d6c-81a9-8a8f101bf8b1'} Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6034e33-1269-4d6c-81a9-8a8f101bf8b1 could not be found. Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6034e33-1269-4d6c-81a9-8a8f101bf8b1 could not be found. Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:43.708249 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:43.713378 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:43.713378 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:43.713378 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:43.713378 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:43.713378 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:43.713378 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6034e33-1269-4d6c-81a9-8a8f101bf8b1 could not be found. Sep 10 10:57:43.713378 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:43.713378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Returning 404 to user: Instance f6034e33-1269-4d6c-81a9-8a8f101bf8b1 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:43.713378 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-89899318-c99a-440f-b2dd-5c822625916a tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1" status: 404 len: 111 microversion: 2.1 time: 0.097003 Sep 10 10:57:43.713378 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 804/3968] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:43 2022] GET /compute/v2.1/servers/f6034e33-1269-4d6c-81a9-8a8f101bf8b1 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:43.720866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02dcf9a1-aec3-4a05-962d-2e2a441999dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:43.721455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02dcf9a1-aec3-4a05-962d-2e2a441999dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:43.794683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02dcf9a1-aec3-4a05-962d-2e2a441999dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:43.795904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02dcf9a1-aec3-4a05-962d-2e2a441999dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:43.796443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02dcf9a1-aec3-4a05-962d-2e2a441999dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:43.797330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02dcf9a1-aec3-4a05-962d-2e2a441999dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:43.800481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02dcf9a1-aec3-4a05-962d-2e2a441999dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:43.800957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02dcf9a1-aec3-4a05-962d-2e2a441999dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:43.821017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d285abd3-23a9-41d4-935a-b988b0e50de9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:43.827335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d285abd3-23a9-41d4-935a-b988b0e50de9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:43.846369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d285abd3-23a9-41d4-935a-b988b0e50de9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:43.846869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d285abd3-23a9-41d4-935a-b988b0e50de9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:43.847308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d285abd3-23a9-41d4-935a-b988b0e50de9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:43.848010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d285abd3-23a9-41d4-935a-b988b0e50de9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:43.848460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d285abd3-23a9-41d4-935a-b988b0e50de9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:43.848878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d285abd3-23a9-41d4-935a-b988b0e50de9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:43.850859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02dcf9a1-aec3-4a05-962d-2e2a441999dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:57:43.982771 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02dcf9a1-aec3-4a05-962d-2e2a441999dc tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 204 len: 0 microversion: 2.1 time: 0.267374 Sep 10 10:57:43.986609 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3165/3969] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:57:43 2022] DELETE /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:57:43.992842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e92def58-a802-4f32-92b8-588d7d8dbc25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:43.994155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e92def58-a802-4f32-92b8-588d7d8dbc25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:44.000645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e92def58-a802-4f32-92b8-588d7d8dbc25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:44.001334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e92def58-a802-4f32-92b8-588d7d8dbc25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:44.002160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e92def58-a802-4f32-92b8-588d7d8dbc25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:44.009704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e92def58-a802-4f32-92b8-588d7d8dbc25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:44.010590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e92def58-a802-4f32-92b8-588d7d8dbc25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:44.011383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e92def58-a802-4f32-92b8-588d7d8dbc25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:44.168050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d285abd3-23a9-41d4-935a-b988b0e50de9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:44.203758 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d285abd3-23a9-41d4-935a-b988b0e50de9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.375493 Sep 10 10:57:44.203758 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 805/3970] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:43 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:44.428462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e92def58-a802-4f32-92b8-588d7d8dbc25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:44.439839 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e92def58-a802-4f32-92b8-588d7d8dbc25 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1494 microversion: 2.1 time: 0.448973 Sep 10 10:57:44.440463 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3166/3971] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:43 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1494 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:44.460501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-336f55d4-5c13-4bf2-954d-84917af946d9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:44.461016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-336f55d4-5c13-4bf2-954d-84917af946d9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:44.471032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:44.483417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-336f55d4-5c13-4bf2-954d-84917af946d9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:44.484172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-336f55d4-5c13-4bf2-954d-84917af946d9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:44.486539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-336f55d4-5c13-4bf2-954d-84917af946d9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:44.487432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-336f55d4-5c13-4bf2-954d-84917af946d9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:44.490595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-336f55d4-5c13-4bf2-954d-84917af946d9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:44.491255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-336f55d4-5c13-4bf2-954d-84917af946d9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:44.735532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3dce3843-af88-4353-b397-094e145621a5 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Action: 'create', calling method: .version_select at 0x7efcaec3ef70>, body: {"pool": null} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:45.256150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-336f55d4-5c13-4bf2-954d-84917af946d9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:45.270183 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-336f55d4-5c13-4bf2-954d-84917af946d9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.827935 Sep 10 10:57:45.287927 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3167/3972] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:44 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:45.293767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:45.305491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:45.317140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:45.317871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:45.318466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:45.319398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:45.323965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:45.324559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b/action HTTP/1.1 Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 28 Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: {"reboot": {"type": "SOFT"}} Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd66fe4eb-5aa7-4bad-8612-0322c812178b', 'body': {'reboot': {'type': 'SOFT'}}} Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 10:57:45.364905 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:57:45.370683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:45.377664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:45.382489 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76ba1e38-4f3f-4474-af1f-f59688b1fe22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b/action" status: 404 len: 111 microversion: 2.1 time: 0.089805 Sep 10 10:57:45.384831 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3168/3973] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:45 2022] POST /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b/action => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:57:45.394569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c58cca0-2a76-4765-a9e6-76252ec59170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:45.396624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c58cca0-2a76-4765-a9e6-76252ec59170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:45.411984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c58cca0-2a76-4765-a9e6-76252ec59170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:45.415737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c58cca0-2a76-4765-a9e6-76252ec59170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:45.421735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c58cca0-2a76-4765-a9e6-76252ec59170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:45.422720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c58cca0-2a76-4765-a9e6-76252ec59170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:45.423310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c58cca0-2a76-4765-a9e6-76252ec59170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:45.424013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c58cca0-2a76-4765-a9e6-76252ec59170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:45.913858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3c58cca0-2a76-4765-a9e6-76252ec59170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:45.922994 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c58cca0-2a76-4765-a9e6-76252ec59170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.532261 Sep 10 10:57:45.946130 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3169/3974] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:45 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:45.955043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:45.959503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:45.976094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:45.978013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:45.978883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:45.981362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:45.982363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:45.983829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:46.025975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:46.071856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:46.073712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:46.078361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:46.078883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lazy-loading 'fault' on Instance uuid bc0e028d-c34c-4d5d-b7fa-1e494522b645 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:57:46.183900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:46.195859 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-df3c37aa-1716-4068-bf6e-fe2534f1e6ed tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 200 len: 1304 microversion: 2.1 time: 0.247722 Sep 10 10:57:46.196991 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3170/3975] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:45 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 1304 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:46.209867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-01affff4-2511-4278-bd74-1fc5d44a163e req-5738b478-98b2-43ea-89a3-8e4e4dfa8efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0e028d-c34c-4d5d-b7fa-1e494522b645", "name": "network-vif-deleted", "tag": "f965aab7-c91f-4c1b-a122-49ea634fb346"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:46.232234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-01affff4-2511-4278-bd74-1fc5d44a163e req-5738b478-98b2-43ea-89a3-8e4e4dfa8efe service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:46.232626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-01affff4-2511-4278-bd74-1fc5d44a163e req-5738b478-98b2-43ea-89a3-8e4e4dfa8efe service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:46.233056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-01affff4-2511-4278-bd74-1fc5d44a163e req-5738b478-98b2-43ea-89a3-8e4e4dfa8efe service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:46.272469 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-01affff4-2511-4278-bd74-1fc5d44a163e req-5738b478-98b2-43ea-89a3-8e4e4dfa8efe service nova] Creating event network-vif-deleted:f965aab7-c91f-4c1b-a122-49ea634fb346 for instance bc0e028d-c34c-4d5d-b7fa-1e494522b645 on n-h2-856894-1 Sep 10 10:57:46.285569 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-01affff4-2511-4278-bd74-1fc5d44a163e req-5738b478-98b2-43ea-89a3-8e4e4dfa8efe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083010 Sep 10 10:57:46.286200 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3171/3976] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:57:46.301403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-159b88d9-b791-42b5-9888-19f0999abee4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:46.304667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-159b88d9-b791-42b5-9888-19f0999abee4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:46.334226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-159b88d9-b791-42b5-9888-19f0999abee4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:46.334984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-159b88d9-b791-42b5-9888-19f0999abee4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:46.335603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-159b88d9-b791-42b5-9888-19f0999abee4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:46.339131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-159b88d9-b791-42b5-9888-19f0999abee4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:46.341024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-159b88d9-b791-42b5-9888-19f0999abee4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:46.342956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-159b88d9-b791-42b5-9888-19f0999abee4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:46.818182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-159b88d9-b791-42b5-9888-19f0999abee4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:46.828642 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-159b88d9-b791-42b5-9888-19f0999abee4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.538775 Sep 10 10:57:46.833361 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3172/3977] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:46 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:46.859892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4af23f9-da5c-4071-9525-83df54ec2ef5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:46.864214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4af23f9-da5c-4071-9525-83df54ec2ef5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: 4137f9eb-572d-4291-8c1f-5a0fbd4df304] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:46.871862 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a4af23f9-da5c-4071-9525-83df54ec2ef5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance 4137f9eb-572d-4291-8c1f-5a0fbd4df304 could not be found. Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4af23f9-da5c-4071-9525-83df54ec2ef5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/4137f9eb-572d-4291-8c1f-5a0fbd4df304/action HTTP/1.1 Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 28 Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: {"reboot": {"type": "SOFT"}} Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 4137f9eb-572d-4291-8c1f-5a0fbd4df304 could not be found. Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '4137f9eb-572d-4291-8c1f-5a0fbd4df304', 'body': {'reboot': {'type': 'SOFT'}}} Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4137f9eb-572d-4291-8c1f-5a0fbd4df304 could not be found. Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4137f9eb-572d-4291-8c1f-5a0fbd4df304 could not be found. Sep 10 10:57:46.873548 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4137f9eb-572d-4291-8c1f-5a0fbd4df304 could not be found. Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4af23f9-da5c-4071-9525-83df54ec2ef5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance 4137f9eb-572d-4291-8c1f-5a0fbd4df304 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:46.879258 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a4af23f9-da5c-4071-9525-83df54ec2ef5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/4137f9eb-572d-4291-8c1f-5a0fbd4df304/action" status: 404 len: 111 microversion: 2.1 time: 0.023988 Sep 10 10:57:46.882753 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3173/3978] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:46 2022] POST /compute/v2.1/servers/4137f9eb-572d-4291-8c1f-5a0fbd4df304/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:46.889848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-303cf172-0427-407b-8483-8869d62dad22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:46.890740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-303cf172-0427-407b-8483-8869d62dad22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:46.898901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-303cf172-0427-407b-8483-8869d62dad22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:46.900128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-303cf172-0427-407b-8483-8869d62dad22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:46.900692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-303cf172-0427-407b-8483-8869d62dad22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:46.901506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-303cf172-0427-407b-8483-8869d62dad22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:46.902038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-303cf172-0427-407b-8483-8869d62dad22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:46.902604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-303cf172-0427-407b-8483-8869d62dad22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:47.167595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-303cf172-0427-407b-8483-8869d62dad22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:47.181538 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-303cf172-0427-407b-8483-8869d62dad22 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.294664 Sep 10 10:57:47.185458 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3174/3979] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:46 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:47.211192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f635a419-0347-44cd-87b5-29b11ae6aebc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:47.212796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f635a419-0347-44cd-87b5-29b11ae6aebc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:47.222830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f635a419-0347-44cd-87b5-29b11ae6aebc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:47.226696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f635a419-0347-44cd-87b5-29b11ae6aebc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:47.227323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f635a419-0347-44cd-87b5-29b11ae6aebc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:47.228784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f635a419-0347-44cd-87b5-29b11ae6aebc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:47.231338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f635a419-0347-44cd-87b5-29b11ae6aebc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:47.232006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f635a419-0347-44cd-87b5-29b11ae6aebc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:47.710778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f635a419-0347-44cd-87b5-29b11ae6aebc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:47.719230 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f635a419-0347-44cd-87b5-29b11ae6aebc tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.512410 Sep 10 10:57:47.719806 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3175/3980] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:47 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:47.736092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:47.736720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: bc0e028d-c34c-4d5d-b7fa-1e494522b645] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:47.747303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:47.747988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:47.748231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:47.748927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:47.749409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:47.749830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:47.772064 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] HTTP exception thrown: Instance bc0e028d-c34c-4d5d-b7fa-1e494522b645 could not be found. Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Request method failure captured: Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 HTTP/1.1 Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGteXl1e-hAw6XiTQIFIHZpjOFH3LyNvDq2Jp5-9mD1eNO8FqxuehXxaCJTaSZqtqNEpKdqKeFAGSty1sDCnAg7xDRB9cZeEHOlu6NwV0sQ54jfeAmVZITRhNMqOinMUIr7XAVe-oWNQ5kCGtEmg_938l6s4SBd3Xy7X_t0g_hbbsig Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/524c87c1679a4651a4e303650950283c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_524c87c1679a4651a4e303650950283c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 2cccb6588d07459eb1cfa9c00f53f7e2 Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance bc0e028d-c34c-4d5d-b7fa-1e494522b645 could not be found. Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'bc0e028d-c34c-4d5d-b7fa-1e494522b645'} Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0e028d-c34c-4d5d-b7fa-1e494522b645 could not be found. Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0e028d-c34c-4d5d-b7fa-1e494522b645 could not be found. Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:47.773667 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:47.780087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:47.780087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:47.780087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:47.780087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:47.780087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:47.780087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0e028d-c34c-4d5d-b7fa-1e494522b645 could not be found. Sep 10 10:57:47.780087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:47.780087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Returning 404 to user: Instance bc0e028d-c34c-4d5d-b7fa-1e494522b645 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:47.780087 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82c68555-69ff-4414-be5e-b4575ec60742 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645" status: 404 len: 111 microversion: 2.1 time: 0.054947 Sep 10 10:57:47.782535 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3176/3981] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:47 2022] GET /compute/v2.1/servers/bc0e028d-c34c-4d5d-b7fa-1e494522b645 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:47.786068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:47.788912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:47.796109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:47.796797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:47.797467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:47.798326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:47.798959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:47.799636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:47.824144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b/action HTTP/1.1 Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 65 Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd66fe4eb-5aa7-4bad-8612-0322c812178b', 'body': {'rebuild': {'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5'}}} Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 10 10:57:47.827586 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 10:57:47.835517 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:57:47.838924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:47.840051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2e33846-aaaa-4086-93ae-8d06f015b198 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b/action" status: 404 len: 111 microversion: 2.1 time: 0.058004 Sep 10 10:57:47.840836 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3177/3982] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:47 2022] POST /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:47.860340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d5c7c192-8dbc-4f03-b65c-0b88740eeb06 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:47.861260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d5c7c192-8dbc-4f03-b65c-0b88740eeb06 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:47.872598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5c7c192-8dbc-4f03-b65c-0b88740eeb06 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:47.873130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5c7c192-8dbc-4f03-b65c-0b88740eeb06 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:47.873579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5c7c192-8dbc-4f03-b65c-0b88740eeb06 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:47.874294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5c7c192-8dbc-4f03-b65c-0b88740eeb06 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:47.875046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5c7c192-8dbc-4f03-b65c-0b88740eeb06 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:47.875667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5c7c192-8dbc-4f03-b65c-0b88740eeb06 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:47.937372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d5c7c192-8dbc-4f03-b65c-0b88740eeb06 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:57:48.151153 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d5c7c192-8dbc-4f03-b65c-0b88740eeb06 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 204 len: 0 microversion: 2.1 time: 0.307882 Sep 10 10:57:48.158291 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3178/3983] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:57:47 2022] DELETE /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:57:48.164880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e02ad4b5-d28a-4497-baa1-57babcdfd537 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:48.165859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e02ad4b5-d28a-4497-baa1-57babcdfd537 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:48.173891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02ad4b5-d28a-4497-baa1-57babcdfd537 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:48.174647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02ad4b5-d28a-4497-baa1-57babcdfd537 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:48.174842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02ad4b5-d28a-4497-baa1-57babcdfd537 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:48.175777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02ad4b5-d28a-4497-baa1-57babcdfd537 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:48.176569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02ad4b5-d28a-4497-baa1-57babcdfd537 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:48.177065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e02ad4b5-d28a-4497-baa1-57babcdfd537 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:48.473935 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3dce3843-af88-4353-b397-094e145621a5 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.289514 Sep 10 10:57:48.476949 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 806/3984] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:57:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:57:48.487342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-494d78c7-30a0-46c8-9a71-145b6aa2c72d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:48.488340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-494d78c7-30a0-46c8-9a71-145b6aa2c72d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:48.497537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-494d78c7-30a0-46c8-9a71-145b6aa2c72d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:48.498508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-494d78c7-30a0-46c8-9a71-145b6aa2c72d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:48.499225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-494d78c7-30a0-46c8-9a71-145b6aa2c72d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:48.500334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-494d78c7-30a0-46c8-9a71-145b6aa2c72d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:48.501197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-494d78c7-30a0-46c8-9a71-145b6aa2c72d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:48.502002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-494d78c7-30a0-46c8-9a71-145b6aa2c72d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:48.506737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e02ad4b5-d28a-4497-baa1-57babcdfd537 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:48.518282 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e02ad4b5-d28a-4497-baa1-57babcdfd537 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.357861 Sep 10 10:57:48.521932 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3179/3985] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:48 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:48.529416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8625a1a8-ac5f-464e-baf4-63005033a7b7 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Action: 'create', calling method: .version_select at 0x7efcad3d18b0>, body: {"pool": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:48.930313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-494d78c7-30a0-46c8-9a71-145b6aa2c72d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:48.943263 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-494d78c7-30a0-46c8-9a71-145b6aa2c72d tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1676 microversion: 2.1 time: 0.464432 Sep 10 10:57:48.943985 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 807/3986] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:48 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1676 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:48.964383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-faa3671f-0d64-4b58-9179-bc211a5e777e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:48.965355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-faa3671f-0d64-4b58-9179-bc211a5e777e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:48.974126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faa3671f-0d64-4b58-9179-bc211a5e777e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:48.974624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faa3671f-0d64-4b58-9179-bc211a5e777e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:48.975059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faa3671f-0d64-4b58-9179-bc211a5e777e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:48.975758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faa3671f-0d64-4b58-9179-bc211a5e777e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:48.976210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faa3671f-0d64-4b58-9179-bc211a5e777e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:48.976633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faa3671f-0d64-4b58-9179-bc211a5e777e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:49.256066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-faa3671f-0d64-4b58-9179-bc211a5e777e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:49.267031 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-faa3671f-0d64-4b58-9179-bc211a5e777e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.321613 Sep 10 10:57:49.278640 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 808/3987] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:48 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:49.331805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f9e015d2-42ae-41ef-b675-9dce9802e8c4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:49.340115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f9e015d2-42ae-41ef-b675-9dce9802e8c4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: c6692da5-2d11-4a68-b0e2-73e76be13504] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:49.356119 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-f9e015d2-42ae-41ef-b675-9dce9802e8c4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance c6692da5-2d11-4a68-b0e2-73e76be13504 could not be found. Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f9e015d2-42ae-41ef-b675-9dce9802e8c4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/c6692da5-2d11-4a68-b0e2-73e76be13504/action HTTP/1.1 Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 65 Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance c6692da5-2d11-4a68-b0e2-73e76be13504 could not be found. Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'c6692da5-2d11-4a68-b0e2-73e76be13504', 'body': {'rebuild': {'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5'}}} Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6692da5-2d11-4a68-b0e2-73e76be13504 could not be found. Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 10:57:49.358722 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6692da5-2d11-4a68-b0e2-73e76be13504 could not be found. Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6692da5-2d11-4a68-b0e2-73e76be13504 could not be found. Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f9e015d2-42ae-41ef-b675-9dce9802e8c4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance c6692da5-2d11-4a68-b0e2-73e76be13504 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:49.365413 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f9e015d2-42ae-41ef-b675-9dce9802e8c4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/c6692da5-2d11-4a68-b0e2-73e76be13504/action" status: 404 len: 111 microversion: 2.1 time: 0.068745 Sep 10 10:57:49.372731 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 809/3988] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:49 2022] POST /compute/v2.1/servers/c6692da5-2d11-4a68-b0e2-73e76be13504/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:49.389399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c1f17d7e-584e-41b7-9b7c-a93f4df89d70 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:49.390085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c1f17d7e-584e-41b7-9b7c-a93f4df89d70 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:49.406994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f17d7e-584e-41b7-9b7c-a93f4df89d70 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:49.408348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f17d7e-584e-41b7-9b7c-a93f4df89d70 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:49.408798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f17d7e-584e-41b7-9b7c-a93f4df89d70 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:49.411586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f17d7e-584e-41b7-9b7c-a93f4df89d70 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:49.411993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f17d7e-584e-41b7-9b7c-a93f4df89d70 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:49.412437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f17d7e-584e-41b7-9b7c-a93f4df89d70 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:50.157049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c1f17d7e-584e-41b7-9b7c-a93f4df89d70 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:50.166759 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c1f17d7e-584e-41b7-9b7c-a93f4df89d70 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.794438 Sep 10 10:57:50.177446 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 810/3989] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:49 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:50.183112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fa79544e-fc93-4731-9223-b32b8c1b9ec3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:50.186184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fa79544e-fc93-4731-9223-b32b8c1b9ec3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:50.198784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa79544e-fc93-4731-9223-b32b8c1b9ec3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:50.199504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa79544e-fc93-4731-9223-b32b8c1b9ec3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:50.200310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa79544e-fc93-4731-9223-b32b8c1b9ec3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:50.201248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa79544e-fc93-4731-9223-b32b8c1b9ec3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:50.202280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa79544e-fc93-4731-9223-b32b8c1b9ec3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:50.207193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa79544e-fc93-4731-9223-b32b8c1b9ec3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:50.615396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fa79544e-fc93-4731-9223-b32b8c1b9ec3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:50.624944 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fa79544e-fc93-4731-9223-b32b8c1b9ec3 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1676 microversion: 2.1 time: 0.445875 Sep 10 10:57:50.626891 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 811/3990] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:50 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1676 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:50.632889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-01a19848-06f2-461e-acc6-d2912d3dad62 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:50.638041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-01a19848-06f2-461e-acc6-d2912d3dad62 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:50.687399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01a19848-06f2-461e-acc6-d2912d3dad62 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:50.690787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01a19848-06f2-461e-acc6-d2912d3dad62 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:50.691404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01a19848-06f2-461e-acc6-d2912d3dad62 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:50.692438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01a19848-06f2-461e-acc6-d2912d3dad62 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:50.698192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01a19848-06f2-461e-acc6-d2912d3dad62 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:50.698963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01a19848-06f2-461e-acc6-d2912d3dad62 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:51.412410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-01a19848-06f2-461e-acc6-d2912d3dad62 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:51.446561 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-01a19848-06f2-461e-acc6-d2912d3dad62 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.800208 Sep 10 10:57:51.450564 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 812/3991] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:50 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:51.486971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ba1de786-9b1c-4425-bc93-1f21f3220827 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:51.487213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ba1de786-9b1c-4425-bc93-1f21f3220827 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: 75c9e51a-52fe-4246-9756-5905390cbcd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:51.499557 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-ba1de786-9b1c-4425-bc93-1f21f3220827 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance 75c9e51a-52fe-4246-9756-5905390cbcd5 could not be found. Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ba1de786-9b1c-4425-bc93-1f21f3220827 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/75c9e51a-52fe-4246-9756-5905390cbcd5/action HTTP/1.1 Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 15 Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: {"restore": {}} Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 75c9e51a-52fe-4246-9756-5905390cbcd5 could not be found. Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '75c9e51a-52fe-4246-9756-5905390cbcd5', 'body': {'restore': {}}} Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c9e51a-52fe-4246-9756-5905390cbcd5 could not be found. Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c9e51a-52fe-4246-9756-5905390cbcd5 could not be found. Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:51.513543 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:51.519231 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:51.519231 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:51.519231 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c9e51a-52fe-4246-9756-5905390cbcd5 could not be found. Sep 10 10:57:51.519231 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:51.525785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ba1de786-9b1c-4425-bc93-1f21f3220827 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance 75c9e51a-52fe-4246-9756-5905390cbcd5 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:51.527953 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ba1de786-9b1c-4425-bc93-1f21f3220827 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/75c9e51a-52fe-4246-9756-5905390cbcd5/action" status: 404 len: 111 microversion: 2.1 time: 0.056612 Sep 10 10:57:51.531953 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 813/3992] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:51 2022] POST /compute/v2.1/servers/75c9e51a-52fe-4246-9756-5905390cbcd5/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:57:51.552401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fa99adfe-8fdd-4361-9ec6-495c2f0627f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:51.554244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fa99adfe-8fdd-4361-9ec6-495c2f0627f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:51.591595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa99adfe-8fdd-4361-9ec6-495c2f0627f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:51.592477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa99adfe-8fdd-4361-9ec6-495c2f0627f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:51.593213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa99adfe-8fdd-4361-9ec6-495c2f0627f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:51.594354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa99adfe-8fdd-4361-9ec6-495c2f0627f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:51.596034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa99adfe-8fdd-4361-9ec6-495c2f0627f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:51.596787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fa99adfe-8fdd-4361-9ec6-495c2f0627f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:52.172453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fa99adfe-8fdd-4361-9ec6-495c2f0627f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:52.181109 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fa99adfe-8fdd-4361-9ec6-495c2f0627f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.640438 Sep 10 10:57:52.197460 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 814/3993] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:51 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:52.206494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-93c2841f-984b-47d4-a898-80f34933ac91 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:52.207410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-93c2841f-984b-47d4-a898-80f34933ac91 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:52.214143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93c2841f-984b-47d4-a898-80f34933ac91 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:52.214904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93c2841f-984b-47d4-a898-80f34933ac91 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:52.215800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93c2841f-984b-47d4-a898-80f34933ac91 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:52.216905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93c2841f-984b-47d4-a898-80f34933ac91 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:52.218109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93c2841f-984b-47d4-a898-80f34933ac91 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:52.218812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93c2841f-984b-47d4-a898-80f34933ac91 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:52.370129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-93c2841f-984b-47d4-a898-80f34933ac91 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:52.382379 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-93c2841f-984b-47d4-a898-80f34933ac91 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1609 microversion: 2.1 time: 0.183372 Sep 10 10:57:52.383173 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 815/3994] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:52 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1609 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:52.407835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cdae6255-872a-4b75-b633-a4d38b9fe886 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:52.408641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cdae6255-872a-4b75-b633-a4d38b9fe886 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:52.415800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae6255-872a-4b75-b633-a4d38b9fe886 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:52.416423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae6255-872a-4b75-b633-a4d38b9fe886 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:52.416874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae6255-872a-4b75-b633-a4d38b9fe886 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:52.418065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae6255-872a-4b75-b633-a4d38b9fe886 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:52.418634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae6255-872a-4b75-b633-a4d38b9fe886 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:52.419290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae6255-872a-4b75-b633-a4d38b9fe886 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:52.424693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:52.580548 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8625a1a8-ac5f-464e-baf4-63005033a7b7 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.057165 Sep 10 10:57:52.581632 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3180/3995] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:57:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:57:52.595290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-99f08a2a-bc92-4de4-9b66-0de2a0ab656a tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Action: 'create', calling method: .version_select at 0x7efcad876ca0>, body: {"pool": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:52.921713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cdae6255-872a-4b75-b633-a4d38b9fe886 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:52.937297 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cdae6255-872a-4b75-b633-a4d38b9fe886 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.538470 Sep 10 10:57:52.937892 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 816/3996] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:52 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:52.965869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:52.966406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:52.981260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:52.981757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:52.982203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:52.983499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:52.983967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:52.984601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:53.025911 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Cannot 'restore' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action HTTP/1.1 Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 15 Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: {"restore": {}} Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: exception: Cannot 'restore' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f1fff5af-b5bc-4a39-a5a3-81c17a2b397b', 'body': {'restore': {}}} Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b in vm_state active. Cannot restore while the instance is in this state. Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:53.027391 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:53.032017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:53.032017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:53.032017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:53.032017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 10:57:53.032017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:53.032017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 409 to user: Cannot 'restore' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:53.032017 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-94b924e1-6db2-49e0-b9dc-8fa37dd856af tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 409 len: 145 microversion: 2.1 time: 0.070062 Sep 10 10:57:53.034033 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 817/3997] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:52 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 145 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 10:57:53.059045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d163bcc3-ad45-494f-8427-38c6f468f2ac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:53.059789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d163bcc3-ad45-494f-8427-38c6f468f2ac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:53.069121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d163bcc3-ad45-494f-8427-38c6f468f2ac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:53.069781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d163bcc3-ad45-494f-8427-38c6f468f2ac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:53.070320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d163bcc3-ad45-494f-8427-38c6f468f2ac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:53.071757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d163bcc3-ad45-494f-8427-38c6f468f2ac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:53.072319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d163bcc3-ad45-494f-8427-38c6f468f2ac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:53.072844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d163bcc3-ad45-494f-8427-38c6f468f2ac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:53.502138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d163bcc3-ad45-494f-8427-38c6f468f2ac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:53.513691 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d163bcc3-ad45-494f-8427-38c6f468f2ac tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.468946 Sep 10 10:57:53.523044 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 818/3998] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:53 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:53.532442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-f827295c-ce8f-4f68-9d50-4e70c1ff0abb req-1d82efba-73a7-4c7f-a758-4159100d2dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5", "name": "network-vif-deleted", "tag": "a9a5c077-18b4-45a9-ab46-131e14788b74"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:53.566936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f827295c-ce8f-4f68-9d50-4e70c1ff0abb req-1d82efba-73a7-4c7f-a758-4159100d2dec service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:53.568091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f827295c-ce8f-4f68-9d50-4e70c1ff0abb req-1d82efba-73a7-4c7f-a758-4159100d2dec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:53.568854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f827295c-ce8f-4f68-9d50-4e70c1ff0abb req-1d82efba-73a7-4c7f-a758-4159100d2dec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:53.582297 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-f827295c-ce8f-4f68-9d50-4e70c1ff0abb req-1d82efba-73a7-4c7f-a758-4159100d2dec service nova] Creating event network-vif-deleted:a9a5c077-18b4-45a9-ab46-131e14788b74 for instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 on n-h2-856894-1 Sep 10 10:57:53.591831 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-f827295c-ce8f-4f68-9d50-4e70c1ff0abb req-1d82efba-73a7-4c7f-a758-4159100d2dec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067061 Sep 10 10:57:53.593923 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 819/3999] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:57:53.601092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:53.602082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:53.636496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:53.638640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:53.650777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:53.652033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:53.652756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:53.654355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:53.779741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:53.784608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:53.785301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:53.785848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lazy-loading 'fault' on Instance uuid 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:57:54.002342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cccb6588d07459eb1cfa9c00f53f7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524c87c1679a4651a4e303650950283c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:54.064957 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3131c00b-d5be-4d3a-875f-e08449f62308 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 200 len: 1329 microversion: 2.1 time: 0.469349 Sep 10 10:57:54.068368 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 820/4000] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:53 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 1329 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:54.091741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7d4c8824-f77b-4989-9c8a-20ca48e66df7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:54.093486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7d4c8824-f77b-4989-9c8a-20ca48e66df7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:54.134408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d4c8824-f77b-4989-9c8a-20ca48e66df7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:54.134915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d4c8824-f77b-4989-9c8a-20ca48e66df7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:54.135353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d4c8824-f77b-4989-9c8a-20ca48e66df7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:54.136065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d4c8824-f77b-4989-9c8a-20ca48e66df7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:54.146944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d4c8824-f77b-4989-9c8a-20ca48e66df7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:54.153463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d4c8824-f77b-4989-9c8a-20ca48e66df7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:55.153436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7d4c8824-f77b-4989-9c8a-20ca48e66df7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:55.168669 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7d4c8824-f77b-4989-9c8a-20ca48e66df7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.098084 Sep 10 10:57:55.173563 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 821/4001] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:54 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:55.208352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:55.213427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] [instance: 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:55.248917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:55.250467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:55.251089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:55.252447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:55.253100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:55.253715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:55.273735 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] HTTP exception thrown: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 could not be found. Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Request method failure captured: Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 HTTP/1.1 Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGteXl1e-hAw6XiTQIFIHZpjOFH3LyNvDq2Jp5-9mD1eNO8FqxuehXxaCJTaSZqtqNEpKdqKeFAGSty1sDCnAg7xDRB9cZeEHOlu6NwV0sQ54jfeAmVZITRhNMqOinMUIr7XAVe-oWNQ5kCGtEmg_938l6s4SBd3Xy7X_t0g_hbbsig Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/524c87c1679a4651a4e303650950283c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/524c87c1679a4651a4e303650950283c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_524c87c1679a4651a4e303650950283c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 524c87c1679a4651a4e303650950283c Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerActionsTestJSON-1752790460 Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 2cccb6588d07459eb1cfa9c00f53f7e2 Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerActionsTestJSON-1752790460-project Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 could not be found. Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5'} Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 could not be found. Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 could not be found. Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:55.277136 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:55.282461 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:55.282461 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:55.282461 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:55.282461 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:55.282461 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:55.282461 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 could not be found. Sep 10 10:57:55.282461 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:55.285684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Returning 404 to user: Instance 0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:55.287559 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-58ba2b65-d38e-4ac5-bba7-12352f247424 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5" status: 404 len: 111 microversion: 2.1 time: 0.112018 Sep 10 10:57:55.288666 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 822/4002] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:55 2022] GET /compute/v2.1/servers/0f6af74e-2cbb-4c00-a188-0dacfe1b7fa5 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:55.295043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8163810a-7a6d-4d1f-a48a-82c57fbf416c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:55.295812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8163810a-7a6d-4d1f-a48a-82c57fbf416c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:55.302562 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-8163810a-7a6d-4d1f-a48a-82c57fbf416c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6 could not be found. Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8163810a-7a6d-4d1f-a48a-82c57fbf416c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6/action HTTP/1.1 Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 14 Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: {"resume": {}} Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6 could not be found. Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6', 'body': {'resume': {}}} Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6 could not be found. Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6 could not be found. Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:55.306751 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:55.311831 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:55.311831 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:55.311831 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6 could not be found. Sep 10 10:57:55.311831 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:55.313802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8163810a-7a6d-4d1f-a48a-82c57fbf416c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:55.315426 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8163810a-7a6d-4d1f-a48a-82c57fbf416c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6/action" status: 404 len: 111 microversion: 2.1 time: 0.025055 Sep 10 10:57:55.316523 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 823/4003] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:55 2022] POST /compute/v2.1/servers/dfb3048a-ccaa-4ce0-a8ef-e22e838d25b6/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:57:55.322700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-10a55c9f-eb48-494d-b548-a05343439702 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] Calling method '.version_select at 0x7efcb2cbfdc0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:55.364006 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-10a55c9f-eb48-494d-b548-a05343439702 tempest-ServerActionsTestJSON-1752790460 tempest-ServerActionsTestJSON-1752790460-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068908624" status: 202 len: 0 microversion: 2.1 time: 0.044861 Sep 10 10:57:55.364916 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 824/4004] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 10:57:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068908624 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:57:55.388948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-00ea3432-6a1e-4236-b1cb-b014acab39da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:55.389854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-00ea3432-6a1e-4236-b1cb-b014acab39da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:55.406903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00ea3432-6a1e-4236-b1cb-b014acab39da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:55.408932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00ea3432-6a1e-4236-b1cb-b014acab39da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:55.413801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00ea3432-6a1e-4236-b1cb-b014acab39da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:55.415845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00ea3432-6a1e-4236-b1cb-b014acab39da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:55.416698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00ea3432-6a1e-4236-b1cb-b014acab39da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:55.417758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00ea3432-6a1e-4236-b1cb-b014acab39da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:55.959554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-00ea3432-6a1e-4236-b1cb-b014acab39da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:55.974141 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-00ea3432-6a1e-4236-b1cb-b014acab39da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.607621 Sep 10 10:57:55.998231 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 825/4005] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:55 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:56.012408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-075ee3cd-f7f5-49de-97b3-2612ab65b964 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:56.014696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-075ee3cd-f7f5-49de-97b3-2612ab65b964 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:56.027263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-075ee3cd-f7f5-49de-97b3-2612ab65b964 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:56.028293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-075ee3cd-f7f5-49de-97b3-2612ab65b964 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:56.029017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-075ee3cd-f7f5-49de-97b3-2612ab65b964 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:56.030019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-075ee3cd-f7f5-49de-97b3-2612ab65b964 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:56.031470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-075ee3cd-f7f5-49de-97b3-2612ab65b964 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:56.036536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-075ee3cd-f7f5-49de-97b3-2612ab65b964 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:56.318852 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-99f08a2a-bc92-4de4-9b66-0de2a0ab656a tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.726855 Sep 10 10:57:56.320268 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3181/4006] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:57:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:57:56.334936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82b459a8-e229-48c5-8caf-75aca951ec1c tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Action: 'create', calling method: .version_select at 0x7efcad3d1c10>, body: {"pool": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:56.557210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-075ee3cd-f7f5-49de-97b3-2612ab65b964 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:56.587780 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-075ee3cd-f7f5-49de-97b3-2612ab65b964 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.571167 Sep 10 10:57:56.588486 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 826/4007] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:55 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:56.618174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:56.619091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:56.634011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:56.635275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:56.635895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:56.637159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:56.638008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:56.638613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:56.694871 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Cannot 'resume' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action HTTP/1.1 Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 14 Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: {"resume": {}} Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: exception: Cannot 'resume' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f1fff5af-b5bc-4a39-a5a3-81c17a2b397b', 'body': {'resume': {}}} Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b in vm_state active. Cannot resume while the instance is in this state. Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:56.702246 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:56.707052 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:56.707052 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:56.707052 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:56.707052 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:56.707052 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:56.707052 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 10:57:56.707052 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:56.710176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 409 to user: Cannot 'resume' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:56.711565 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-12b8cd91-3e87-4388-b4d7-4335e1e47c7c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 409 len: 144 microversion: 2.1 time: 0.103175 Sep 10 10:57:56.731486 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 827/4008] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:56 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 144 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 10:57:56.743703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8cf5c377-afa6-45d0-9fb9-6466367d2a46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:56.747762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8cf5c377-afa6-45d0-9fb9-6466367d2a46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:56.764985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cf5c377-afa6-45d0-9fb9-6466367d2a46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:56.765905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cf5c377-afa6-45d0-9fb9-6466367d2a46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:56.766519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cf5c377-afa6-45d0-9fb9-6466367d2a46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:56.767656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cf5c377-afa6-45d0-9fb9-6466367d2a46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:56.768275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cf5c377-afa6-45d0-9fb9-6466367d2a46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:56.768886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cf5c377-afa6-45d0-9fb9-6466367d2a46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:57.305578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8cf5c377-afa6-45d0-9fb9-6466367d2a46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:57.322058 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8cf5c377-afa6-45d0-9fb9-6466367d2a46 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.582828 Sep 10 10:57:57.322949 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 828/4009] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:56 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:57.355617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d95e3a4-f179-4300-bd5e-19507db6fb9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:57.356704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2d95e3a4-f179-4300-bd5e-19507db6fb9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:57.371651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d95e3a4-f179-4300-bd5e-19507db6fb9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:57.374528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d95e3a4-f179-4300-bd5e-19507db6fb9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:57.377059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d95e3a4-f179-4300-bd5e-19507db6fb9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:57.379163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d95e3a4-f179-4300-bd5e-19507db6fb9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:57.380025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d95e3a4-f179-4300-bd5e-19507db6fb9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:57.381635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d95e3a4-f179-4300-bd5e-19507db6fb9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:58.104306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d95e3a4-f179-4300-bd5e-19507db6fb9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:58.118194 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d95e3a4-f179-4300-bd5e-19507db6fb9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.767035 Sep 10 10:57:58.150104 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 829/4010] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:57 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:57:58.173400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:58.328017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4701d673-930b-42cf-8d17-185b52f605d8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4701d673-930b-42cf-8d17-185b52f605d8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 160 Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "5965e34a-c1b4-44c0-8b96-d4d7d1a762c7"}]}} Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'server': {'name': '', 'imageRef': 'df822980-bfab-4f6c-b4bc-2e31dca2c2a5', 'flavorRef': '452', 'networks': [{'uuid': '5965e34a-c1b4-44c0-8b96-d4d7d1a762c7'}]}}} Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi '' Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:57:58.336627 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 10:57:58.341533 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:58.348458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4701d673-930b-42cf-8d17-185b52f605d8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:58.349964 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4701d673-930b-42cf-8d17-185b52f605d8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.032303 Sep 10 10:57:58.356659 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 830/4011] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:57:58 2022] POST /compute/v2.1/servers => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:57:58.368858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-68dfec52-9f0d-4e2b-85b6-94fdb22e8136 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:58.369796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-68dfec52-9f0d-4e2b-85b6-94fdb22e8136 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:58.388029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dfec52-9f0d-4e2b-85b6-94fdb22e8136 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:58.389448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dfec52-9f0d-4e2b-85b6-94fdb22e8136 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:58.390101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dfec52-9f0d-4e2b-85b6-94fdb22e8136 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:58.391020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dfec52-9f0d-4e2b-85b6-94fdb22e8136 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:58.391651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dfec52-9f0d-4e2b-85b6-94fdb22e8136 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:58.392273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dfec52-9f0d-4e2b-85b6-94fdb22e8136 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:58.512470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:57:58.836091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-68dfec52-9f0d-4e2b-85b6-94fdb22e8136 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:58.851584 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-68dfec52-9f0d-4e2b-85b6-94fdb22e8136 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.490942 Sep 10 10:57:58.866408 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 831/4012] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:58 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:58.886959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0e932d8b-136a-4e2d-8a34-5edda97bfac7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:58.888893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0e932d8b-136a-4e2d-8a34-5edda97bfac7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:58.918053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e932d8b-136a-4e2d-8a34-5edda97bfac7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:58.918704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e932d8b-136a-4e2d-8a34-5edda97bfac7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:58.925819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e932d8b-136a-4e2d-8a34-5edda97bfac7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:58.926792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e932d8b-136a-4e2d-8a34-5edda97bfac7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:58.927525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e932d8b-136a-4e2d-8a34-5edda97bfac7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:58.928055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e932d8b-136a-4e2d-8a34-5edda97bfac7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:59.298893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0e932d8b-136a-4e2d-8a34-5edda97bfac7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:57:59.312728 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0e932d8b-136a-4e2d-8a34-5edda97bfac7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.430617 Sep 10 10:57:59.321924 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 832/4013] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:58 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:57:59.346586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-187e8a48-7f22-4822-b55e-43502c3f9c3c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:57:59.347516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-187e8a48-7f22-4822-b55e-43502c3f9c3c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: b686661e-9914-4310-87fd-b89659fe5bfe] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:59.362045 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-187e8a48-7f22-4822-b55e-43502c3f9c3c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance b686661e-9914-4310-87fd-b89659fe5bfe could not be found. Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-187e8a48-7f22-4822-b55e-43502c3f9c3c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/b686661e-9914-4310-87fd-b89659fe5bfe/action HTTP/1.1 Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 14 Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: {"shelve": {}} Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance b686661e-9914-4310-87fd-b89659fe5bfe could not be found. Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'b686661e-9914-4310-87fd-b89659fe5bfe', 'body': {'shelve': {}}} Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b686661e-9914-4310-87fd-b89659fe5bfe could not be found. Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b686661e-9914-4310-87fd-b89659fe5bfe could not be found. Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:57:59.370015 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:57:59.374482 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:57:59.374482 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:57:59.374482 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b686661e-9914-4310-87fd-b89659fe5bfe could not be found. Sep 10 10:57:59.374482 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:57:59.374482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-187e8a48-7f22-4822-b55e-43502c3f9c3c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance b686661e-9914-4310-87fd-b89659fe5bfe could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:57:59.374482 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-187e8a48-7f22-4822-b55e-43502c3f9c3c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/b686661e-9914-4310-87fd-b89659fe5bfe/action" status: 404 len: 111 microversion: 2.1 time: 0.029615 Sep 10 10:57:59.374482 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 833/4014] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:57:59 2022] POST /compute/v2.1/servers/b686661e-9914-4310-87fd-b89659fe5bfe/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:57:59.384446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a0d43453-2622-4b9a-b2f9-9e050fa91db7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:57:59.400662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a0d43453-2622-4b9a-b2f9-9e050fa91db7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:57:59.429669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a0d43453-2622-4b9a-b2f9-9e050fa91db7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:59.430907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a0d43453-2622-4b9a-b2f9-9e050fa91db7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:59.431368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a0d43453-2622-4b9a-b2f9-9e050fa91db7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:57:59.432114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a0d43453-2622-4b9a-b2f9-9e050fa91db7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:57:59.432578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a0d43453-2622-4b9a-b2f9-9e050fa91db7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:57:59.437458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a0d43453-2622-4b9a-b2f9-9e050fa91db7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:00.198284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a0d43453-2622-4b9a-b2f9-9e050fa91db7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:00.212124 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a0d43453-2622-4b9a-b2f9-9e050fa91db7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.833929 Sep 10 10:58:00.215339 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 834/4015] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:57:59 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:00.240437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-401ea346-8382-4d1e-8ace-aec4fc47256f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:00.241086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-401ea346-8382-4d1e-8ace-aec4fc47256f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:00.252169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-401ea346-8382-4d1e-8ace-aec4fc47256f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:00.252677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-401ea346-8382-4d1e-8ace-aec4fc47256f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:00.253133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-401ea346-8382-4d1e-8ace-aec4fc47256f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:00.254034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-401ea346-8382-4d1e-8ace-aec4fc47256f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:00.257390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-401ea346-8382-4d1e-8ace-aec4fc47256f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:00.258182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-401ea346-8382-4d1e-8ace-aec4fc47256f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:00.659580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-401ea346-8382-4d1e-8ace-aec4fc47256f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:00.697386 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-401ea346-8382-4d1e-8ace-aec4fc47256f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.447343 Sep 10 10:58:00.712509 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 835/4016] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:00 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:00.735143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-60955bb3-eeec-4fe7-9f46-46e7d0270f40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:00.737489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-60955bb3-eeec-4fe7-9f46-46e7d0270f40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:00.747177 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82b459a8-e229-48c5-8caf-75aca951ec1c tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.416114 Sep 10 10:58:00.749685 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3182/4017] 10.222.0.20 () {60 vars in 1170 bytes} [Sat Sep 10 10:57:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:58:00.761787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60955bb3-eeec-4fe7-9f46-46e7d0270f40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:00.762534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60955bb3-eeec-4fe7-9f46-46e7d0270f40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:00.763146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60955bb3-eeec-4fe7-9f46-46e7d0270f40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:00.763315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8bece71b-ccdb-474f-bb1f-cbfba7520425 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Calling method '.version_select at 0x7efcae8351f0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:00.764270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60955bb3-eeec-4fe7-9f46-46e7d0270f40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:00.765034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60955bb3-eeec-4fe7-9f46-46e7d0270f40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:00.765680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60955bb3-eeec-4fe7-9f46-46e7d0270f40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:00.846290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-60955bb3-eeec-4fe7-9f46-46e7d0270f40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lazy-loading 'flavor' on Instance uuid f1fff5af-b5bc-4a39-a5a3-81c17a2b397b {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:58:01.039960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:01.248665 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-60955bb3-eeec-4fe7-9f46-46e7d0270f40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 202 len: 0 microversion: 2.1 time: 0.529671 Sep 10 10:58:01.249883 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 836/4018] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:58:00 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:58:01.274879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ad0a5f50-9a4d-4456-8a91-d8d2696cb17e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:01.275779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ad0a5f50-9a4d-4456-8a91-d8d2696cb17e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:01.288751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0a5f50-9a4d-4456-8a91-d8d2696cb17e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:01.289342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0a5f50-9a4d-4456-8a91-d8d2696cb17e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:01.289881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0a5f50-9a4d-4456-8a91-d8d2696cb17e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:01.290596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0a5f50-9a4d-4456-8a91-d8d2696cb17e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:01.291462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0a5f50-9a4d-4456-8a91-d8d2696cb17e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:01.291957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0a5f50-9a4d-4456-8a91-d8d2696cb17e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:01.472101 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8bece71b-ccdb-474f-bb1f-cbfba7520425 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/c579ec50-738e-4e7c-bd82-c5628ca92ab3" status: 200 len: 142 microversion: 2.1 time: 0.713312 Sep 10 10:58:01.472646 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3183/4019] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Sep 10 10:58:00 2022] GET /compute/v2.1/os-floating-ips/c579ec50-738e-4e7c-bd82-c5628ca92ab3 => generated 142 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:58:01.489507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-254026a0-ac7c-4c92-89ed-08ba11da63ec tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Calling method '.version_select at 0x7efcae99d550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:02.315515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ad0a5f50-9a4d-4456-8a91-d8d2696cb17e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:02.325035 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ad0a5f50-9a4d-4456-8a91-d8d2696cb17e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 1.070523 Sep 10 10:58:02.338181 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 837/4020] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:01 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:03.350221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4ba9ca2f-dd92-48b4-a58e-f51a6e9c3a43 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:03.350880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4ba9ca2f-dd92-48b4-a58e-f51a6e9c3a43 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:03.362839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca2f-dd92-48b4-a58e-f51a6e9c3a43 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:03.363328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca2f-dd92-48b4-a58e-f51a6e9c3a43 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:03.363763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca2f-dd92-48b4-a58e-f51a6e9c3a43 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:03.364468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca2f-dd92-48b4-a58e-f51a6e9c3a43 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:03.364917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca2f-dd92-48b4-a58e-f51a6e9c3a43 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:03.377639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca2f-dd92-48b4-a58e-f51a6e9c3a43 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:03.748281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4ba9ca2f-dd92-48b4-a58e-f51a6e9c3a43 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:03.758338 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4ba9ca2f-dd92-48b4-a58e-f51a6e9c3a43 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.412207 Sep 10 10:58:03.782753 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 838/4021] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:03 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:03.790950 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-254026a0-ac7c-4c92-89ed-08ba11da63ec tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/c579ec50-738e-4e7c-bd82-c5628ca92ab3" status: 202 len: 0 microversion: 2.1 time: 2.309781 Sep 10 10:58:03.792063 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3184/4022] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:58:01 2022] DELETE /compute/v2.1/os-floating-ips/c579ec50-738e-4e7c-bd82-c5628ca92ab3 => generated 0 bytes in 2312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:58:03.801426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2381d672-42fe-4a3c-9afe-e58d62bf87d9 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Calling method '.version_select at 0x7efcb2d5a4c0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:04.161060 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2381d672-42fe-4a3c-9afe-e58d62bf87d9 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.363642 Sep 10 10:58:04.161681 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 839/4023] 10.222.0.20 () {58 vars in 1164 bytes} [Sat Sep 10 10:58:03 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:58:04.176638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69591620-bbd2-4ebb-a802-cc5011c2eace tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Calling method '.version_select at 0x7efcae835700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:04.458942 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69591620-bbd2-4ebb-a802-cc5011c2eace tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.289467 Sep 10 10:58:04.469184 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3185/4024] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Sep 10 10:58:04 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:58:04.478951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-08b18d31-9646-4519-981c-06558d19d2bf tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Calling method '.version_select at 0x7efcae5d24c0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:04.790395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-98245afa-f304-4d4f-aefb-441264535e5c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:04.790946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-98245afa-f304-4d4f-aefb-441264535e5c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:04.797595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98245afa-f304-4d4f-aefb-441264535e5c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:04.798823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98245afa-f304-4d4f-aefb-441264535e5c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:04.799745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98245afa-f304-4d4f-aefb-441264535e5c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:04.800730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98245afa-f304-4d4f-aefb-441264535e5c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:04.801450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98245afa-f304-4d4f-aefb-441264535e5c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:04.802100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98245afa-f304-4d4f-aefb-441264535e5c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:05.248393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-98245afa-f304-4d4f-aefb-441264535e5c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:05.287800 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-98245afa-f304-4d4f-aefb-441264535e5c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.504513 Sep 10 10:58:05.289177 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3186/4025] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:04 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:06.122351 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-08b18d31-9646-4519-981c-06558d19d2bf tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/a29559c4-0dbd-451b-a2cb-4be61e3a5682" status: 202 len: 0 microversion: 2.1 time: 1.648592 Sep 10 10:58:06.123369 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 840/4026] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:58:04 2022] DELETE /compute/v2.1/os-floating-ips/a29559c4-0dbd-451b-a2cb-4be61e3a5682 => generated 0 bytes in 1650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:58:06.132365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88021d6a-2d67-48d7-942b-7875d567fdc6 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Calling method '.version_select at 0x7efcad3f43a0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:06.311488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5e1ba74f-99c4-4c44-9c5b-a61bd08f2362 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:06.312117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5e1ba74f-99c4-4c44-9c5b-a61bd08f2362 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:06.323873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:06.328296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e1ba74f-99c4-4c44-9c5b-a61bd08f2362 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:06.328830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e1ba74f-99c4-4c44-9c5b-a61bd08f2362 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:06.331737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e1ba74f-99c4-4c44-9c5b-a61bd08f2362 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:06.334171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e1ba74f-99c4-4c44-9c5b-a61bd08f2362 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:06.334702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e1ba74f-99c4-4c44-9c5b-a61bd08f2362 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:06.336893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e1ba74f-99c4-4c44-9c5b-a61bd08f2362 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:06.661548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5e1ba74f-99c4-4c44-9c5b-a61bd08f2362 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:06.679831 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5e1ba74f-99c4-4c44-9c5b-a61bd08f2362 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.372173 Sep 10 10:58:06.683430 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 841/4027] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:06 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:06.962773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1365531128", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": "none"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:07.097142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:58:07.097564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:58:07.098034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:58:07.098436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:58:07.101215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:58:07.119746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:07.126161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:07.126788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:07.127558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:07.128032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:07.128469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:07.177615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Getting quotas for project 8235178d765c4488ba6a258375c8b2ab. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:07.190153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Getting quotas for user b962052234884e8ab01b819c1e982376 and project 8235178d765c4488ba6a258375c8b2ab. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:07.208766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:58:07.215066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:58:07.299186 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-38b0dcdd-1878-4154-9e80-749ffa7dd736 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.602701 Sep 10 10:58:07.299987 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 842/4028] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 10:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 10:58:07.311961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a2396eb3-2023-4588-9232-d6f45917faa1 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:07.312587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a2396eb3-2023-4588-9232-d6f45917faa1 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:07.408345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a2396eb3-2023-4588-9232-d6f45917faa1 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:07.440764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a2396eb3-2023-4588-9232-d6f45917faa1 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:07.446641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a2396eb3-2023-4588-9232-d6f45917faa1 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:07.448220 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a2396eb3-2023-4588-9232-d6f45917faa1 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 200 len: 1281 microversion: 2.47 time: 0.140624 Sep 10 10:58:07.450094 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 843/4029] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:58:07 2022] GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 1281 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:58:07.520801 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88021d6a-2d67-48d7-942b-7875d567fdc6 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/96bb2219-5051-4713-ae71-cd9e4ec9be93" status: 202 len: 0 microversion: 2.1 time: 1.392815 Sep 10 10:58:07.521466 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3187/4030] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:58:06 2022] DELETE /compute/v2.1/os-floating-ips/96bb2219-5051-4713-ae71-cd9e4ec9be93 => generated 0 bytes in 1394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:58:07.530829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8800a90f-a443-4589-8fba-fefcec077454 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] Calling method '.version_select at 0x7efcae5c7430>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:07.708253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf4cca9a-ed16-4903-9d3c-de2f6030f690 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:07.710519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bf4cca9a-ed16-4903-9d3c-de2f6030f690 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:07.723963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf4cca9a-ed16-4903-9d3c-de2f6030f690 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:07.724658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf4cca9a-ed16-4903-9d3c-de2f6030f690 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:07.725502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf4cca9a-ed16-4903-9d3c-de2f6030f690 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:07.726541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf4cca9a-ed16-4903-9d3c-de2f6030f690 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:07.728197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf4cca9a-ed16-4903-9d3c-de2f6030f690 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:07.728795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bf4cca9a-ed16-4903-9d3c-de2f6030f690 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:08.165793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bf4cca9a-ed16-4903-9d3c-de2f6030f690 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:08.180378 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf4cca9a-ed16-4903-9d3c-de2f6030f690 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.475906 Sep 10 10:58:08.194004 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3188/4031] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:07 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:08.477517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:08.478621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:08.494828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:08.495350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:08.495835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:08.496568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:08.497033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:08.497497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:08.636806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:08.647146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:08.648790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:08.650066 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2155f9ab-93da-456e-8a85-560737ccd018 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 200 len: 1333 microversion: 2.47 time: 0.178555 Sep 10 10:58:08.650977 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3189/4032] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:58:08 2022] GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 1333 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:58:08.814982 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8800a90f-a443-4589-8fba-fefcec077454 tempest-FloatingIPDetailsTestJSON-2021674115 tempest-FloatingIPDetailsTestJSON-2021674115-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/1e6dffec-1c8a-4fc8-8aa5-2b40e5a47412" status: 202 len: 0 microversion: 2.1 time: 1.288338 Sep 10 10:58:08.819220 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 844/4033] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 10:58:07 2022] DELETE /compute/v2.1/os-floating-ips/1e6dffec-1c8a-4fc8-8aa5-2b40e5a47412 => generated 0 bytes in 1293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:58:09.209359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ffaf73ab-9288-42cf-b742-e4cc17810f9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:09.210084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ffaf73ab-9288-42cf-b742-e4cc17810f9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:09.224012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffaf73ab-9288-42cf-b742-e4cc17810f9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:09.224639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffaf73ab-9288-42cf-b742-e4cc17810f9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:09.225173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffaf73ab-9288-42cf-b742-e4cc17810f9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:09.225885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffaf73ab-9288-42cf-b742-e4cc17810f9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:09.226508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffaf73ab-9288-42cf-b742-e4cc17810f9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:09.227495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffaf73ab-9288-42cf-b742-e4cc17810f9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:09.503456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffaf73ab-9288-42cf-b742-e4cc17810f9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:09.512198 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ffaf73ab-9288-42cf-b742-e4cc17810f9d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.308998 Sep 10 10:58:09.512787 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3190/4034] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:09 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:09.683913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:09.684715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:09.692664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:09.693540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:09.694236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:09.695197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:09.696637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:09.697341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:10.010522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:10.019215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:10.020573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:10.024986 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d46d20f-3a4f-4540-9ff0-343f229f836a tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 200 len: 1339 microversion: 2.47 time: 0.346375 Sep 10 10:58:10.025627 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 845/4035] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:58:09 2022] GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 1339 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:58:10.536380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30bb8b9e-22e3-4782-bb8e-b5809d841944 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:10.536961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30bb8b9e-22e3-4782-bb8e-b5809d841944 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:10.549252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30bb8b9e-22e3-4782-bb8e-b5809d841944 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:10.553294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30bb8b9e-22e3-4782-bb8e-b5809d841944 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:10.554189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30bb8b9e-22e3-4782-bb8e-b5809d841944 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:10.555253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30bb8b9e-22e3-4782-bb8e-b5809d841944 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:10.557797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30bb8b9e-22e3-4782-bb8e-b5809d841944 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:10.558430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30bb8b9e-22e3-4782-bb8e-b5809d841944 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:10.950332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30bb8b9e-22e3-4782-bb8e-b5809d841944 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:10.961523 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30bb8b9e-22e3-4782-bb8e-b5809d841944 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.429199 Sep 10 10:58:10.963000 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3191/4036] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:10 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:11.056689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:11.058192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:11.090256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:11.094382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:11.095160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:11.096146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:11.097666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:11.098348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:11.200939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:11.242544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:11.244119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:11.245372 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8209e4d7-f5c3-4cf6-93a7-f6fa2bca253b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 200 len: 1339 microversion: 2.47 time: 0.193839 Sep 10 10:58:11.246523 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 846/4037] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:58:11 2022] GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 1339 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:58:11.986278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac2fedd6-0821-42c8-bd1f-c2bc3a7cda04 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:11.986899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac2fedd6-0821-42c8-bd1f-c2bc3a7cda04 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:11.995121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac2fedd6-0821-42c8-bd1f-c2bc3a7cda04 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:11.996061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac2fedd6-0821-42c8-bd1f-c2bc3a7cda04 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:11.996866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac2fedd6-0821-42c8-bd1f-c2bc3a7cda04 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:11.997984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac2fedd6-0821-42c8-bd1f-c2bc3a7cda04 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:11.998730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac2fedd6-0821-42c8-bd1f-c2bc3a7cda04 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:11.999511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac2fedd6-0821-42c8-bd1f-c2bc3a7cda04 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:12.272778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:12.273997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:12.290681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:12.291753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:12.292746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:12.294486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:12.295135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:12.295856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:12.371049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ac2fedd6-0821-42c8-bd1f-c2bc3a7cda04 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:12.392422 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac2fedd6-0821-42c8-bd1f-c2bc3a7cda04 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.409854 Sep 10 10:58:12.393167 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3192/4038] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:11 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:12.490127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:12.516828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:12.519179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:12.521616 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1663115b-b8ad-4f4c-8779-dc45acf5525f tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 200 len: 1360 microversion: 2.47 time: 0.253104 Sep 10 10:58:12.522843 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 847/4039] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:58:12 2022] GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 1360 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:58:12.548491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3db08dc7-0317-447d-a4ba-e693d97415b2 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1844675516"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:12.551300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3db08dc7-0317-447d-a4ba-e693d97415b2 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:12.557639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3db08dc7-0317-447d-a4ba-e693d97415b2 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:12.558350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3db08dc7-0317-447d-a4ba-e693d97415b2 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:12.558971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3db08dc7-0317-447d-a4ba-e693d97415b2 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:12.559844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3db08dc7-0317-447d-a4ba-e693d97415b2 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:12.560466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3db08dc7-0317-447d-a4ba-e693d97415b2 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:12.561061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3db08dc7-0317-447d-a4ba-e693d97415b2 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:12.873276 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3db08dc7-0317-447d-a4ba-e693d97415b2 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "POST /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b/action" status: 202 len: 52 microversion: 2.47 time: 0.328840 Sep 10 10:58:12.886466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9704351d-626e-4b94-8b54-3439f01dc172 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:12.887259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9704351d-626e-4b94-8b54-3439f01dc172 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:12.891487 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3193/4040] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 10:58:12 2022] POST /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b/action => generated 52 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 10 10:58:12.902470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9704351d-626e-4b94-8b54-3439f01dc172 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:12.903282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9704351d-626e-4b94-8b54-3439f01dc172 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:12.904731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9704351d-626e-4b94-8b54-3439f01dc172 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:12.906118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9704351d-626e-4b94-8b54-3439f01dc172 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:12.906876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9704351d-626e-4b94-8b54-3439f01dc172 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:12.907636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9704351d-626e-4b94-8b54-3439f01dc172 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:12.959066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9704351d-626e-4b94-8b54-3439f01dc172 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:58:13.104046 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9704351d-626e-4b94-8b54-3439f01dc172 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "DELETE /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 204 len: 0 microversion: 2.47 time: 0.221180 Sep 10 10:58:13.108448 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 848/4041] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:58:12 2022] DELETE /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:58:13.114831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:13.115770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:13.125370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:13.126380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:13.127147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:13.128083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:13.128753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:13.129426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:13.224548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:13.239954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:13.241944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:13.244011 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-954cc8bb-6b18-40c3-8c19-f38b2df4f8ed tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 200 len: 1366 microversion: 2.47 time: 0.134460 Sep 10 10:58:13.245284 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3194/4042] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:58:13 2022] GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:58:13.431854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fd2b0d76-26ec-46d6-b5db-b6078022c101 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:13.432752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fd2b0d76-26ec-46d6-b5db-b6078022c101 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:13.441251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd2b0d76-26ec-46d6-b5db-b6078022c101 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:13.441811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd2b0d76-26ec-46d6-b5db-b6078022c101 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:13.442263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd2b0d76-26ec-46d6-b5db-b6078022c101 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:13.443467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd2b0d76-26ec-46d6-b5db-b6078022c101 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:13.444162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd2b0d76-26ec-46d6-b5db-b6078022c101 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:13.445057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd2b0d76-26ec-46d6-b5db-b6078022c101 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:14.270178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:14.271475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:14.293026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:14.294444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:14.295073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:14.297299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:14.303987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:14.304490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:14.435666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fd2b0d76-26ec-46d6-b5db-b6078022c101 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:14.456293 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fd2b0d76-26ec-46d6-b5db-b6078022c101 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 1.022616 Sep 10 10:58:14.457623 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 849/4043] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:13 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:14.515726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:14.520485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:14.533604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:14.535914 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbb51b15-cea5-4d7c-bad0-1edf19bb8b47 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 200 len: 1366 microversion: 2.47 time: 0.269779 Sep 10 10:58:14.536821 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3195/4044] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:58:14 2022] GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:58:15.481803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-64b4e71e-eaf0-432d-be40-c77c9a668170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:15.482644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-64b4e71e-eaf0-432d-be40-c77c9a668170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:15.501803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64b4e71e-eaf0-432d-be40-c77c9a668170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:15.502146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64b4e71e-eaf0-432d-be40-c77c9a668170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:15.503000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64b4e71e-eaf0-432d-be40-c77c9a668170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:15.503831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64b4e71e-eaf0-432d-be40-c77c9a668170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:15.504299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64b4e71e-eaf0-432d-be40-c77c9a668170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:15.504812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64b4e71e-eaf0-432d-be40-c77c9a668170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:15.566117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:15.567098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:15.584799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:15.585503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:15.586635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:15.587668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:15.588500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:15.589036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:15.806605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:15.822924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:15.832013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:15.838900 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e9ee2a01-9597-41d2-b723-d7db568dd92b tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 200 len: 1366 microversion: 2.47 time: 0.276815 Sep 10 10:58:15.854390 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3196/4045] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:58:15 2022] GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:58:15.926506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-64b4e71e-eaf0-432d-be40-c77c9a668170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:15.940928 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-64b4e71e-eaf0-432d-be40-c77c9a668170 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.464700 Sep 10 10:58:15.954622 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 850/4046] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:15 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:16.869439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:16.870209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:16.895155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:16.899097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:16.899878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:16.904025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:16.905848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:16.909255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:16.971067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-967b97e8-93a4-419b-bbd7-8ab91af20f01 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:16.971866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-967b97e8-93a4-419b-bbd7-8ab91af20f01 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:16.994865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-967b97e8-93a4-419b-bbd7-8ab91af20f01 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:16.997329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-967b97e8-93a4-419b-bbd7-8ab91af20f01 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:16.999551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-967b97e8-93a4-419b-bbd7-8ab91af20f01 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:17.002005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-967b97e8-93a4-419b-bbd7-8ab91af20f01 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:17.004726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-967b97e8-93a4-419b-bbd7-8ab91af20f01 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:17.005301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-967b97e8-93a4-419b-bbd7-8ab91af20f01 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:17.069757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:17.072257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:17.073062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:17.075680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lazy-loading 'fault' on Instance uuid 86271890-bee9-4867-9384-64dd79be593b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:58:17.153985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:17.193222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:17.248014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:17.256143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b962052234884e8ab01b819c1e982376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8235178d765c4488ba6a258375c8b2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:17.264936 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79956776-7583-48cf-acb8-384cdeb0e424 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 200 len: 1371 microversion: 2.47 time: 0.399391 Sep 10 10:58:17.266987 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3197/4047] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:58:16 2022] GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 1371 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:58:17.386459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-967b97e8-93a4-419b-bbd7-8ab91af20f01 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:17.400222 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-967b97e8-93a4-419b-bbd7-8ab91af20f01 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1532 microversion: 2.1 time: 0.433858 Sep 10 10:58:17.402885 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 851/4048] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:16 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1532 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:17.833757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3647f58b-4df4-45d7-8019-735a1d88c79c tempest-ListImagesTestJSON-123609893 tempest-ListImagesTestJSON-123609893-project] Calling method '.version_select at 0x7efcad401f70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:17.899278 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3647f58b-4df4-45d7-8019-735a1d88c79c tempest-ListImagesTestJSON-123609893 tempest-ListImagesTestJSON-123609893-project] 10.222.0.20 "GET /compute/v2.1/images/df822980-bfab-4f6c-b4bc-2e31dca2c2a5" status: 200 len: 784 microversion: 2.1 time: 0.266470 Sep 10 10:58:17.899944 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3198/4049] 10.222.0.20 () {58 vars in 1233 bytes} [Sat Sep 10 10:58:17 2022] GET /compute/v2.1/images/df822980-bfab-4f6c-b4bc-2e31dca2c2a5 => generated 784 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:58:17.917584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b36a23e5-e85f-4cb6-8baa-f49ae21f891a tempest-ListImagesTestJSON-123609893 tempest-ListImagesTestJSON-123609893-project] Calling method '.version_select at 0x7efcaf0f0160>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:17.930648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:18.024696 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b36a23e5-e85f-4cb6-8baa-f49ae21f891a tempest-ListImagesTestJSON-123609893 tempest-ListImagesTestJSON-123609893-project] 10.222.0.20 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.112632 Sep 10 10:58:18.033387 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 852/4050] 10.222.0.20 () {58 vars in 1122 bytes} [Sat Sep 10 10:58:17 2022] GET /compute/v2.1/images => generated 445 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:58:18.038375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7129eaaa-55f1-4bae-9936-c3c28e54a173 tempest-ListImagesTestJSON-123609893 tempest-ListImagesTestJSON-123609893-project] Calling method '.version_select at 0x7efcad3f3af0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:18.109180 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7129eaaa-55f1-4bae-9936-c3c28e54a173 tempest-ListImagesTestJSON-123609893 tempest-ListImagesTestJSON-123609893-project] 10.222.0.20 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.065583 Sep 10 10:58:18.117977 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3199/4051] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 10:58:18 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:58:18.302195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:18.303060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] [instance: 86271890-bee9-4867-9384-64dd79be593b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:18.326776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:18.330415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:18.333650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:18.339554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:18.342196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:18.344037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:18.400749 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] HTTP exception thrown: Instance 86271890-bee9-4867-9384-64dd79be593b could not be found. Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Request method failure captured: Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b HTTP/1.1 Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG2-64d0a14UhIoR9c_ctmubTqcOcvNpcLatswq6PCtdfZvC76WNdufDTiHzGbkkqkvlOX6XJZFW5W5hplgkzXsUaVT7YzshrP3DNSlCjesbFWdjxT1LLBHzIPKoTm9d4TqqeqBpKiO3RdzB5IhDl06P9MhIKWmgjuhQDlJVuFnopL4 Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Openstack-Nova-Api-Version: 2.47 Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8235178d765c4488ba6a258375c8b2ab Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersAaction247Test-913624000 Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8235178d765c4488ba6a258375c8b2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8235178d765c4488ba6a258375c8b2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8235178d765c4488ba6a258375c8b2ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8235178d765c4488ba6a258375c8b2ab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersAaction247Test-913624000 Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8235178d765c4488ba6a258375c8b2ab Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersAaction247Test-913624000 Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersAaction247Test-913624000-project Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b962052234884e8ab01b819c1e982376 Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersAaction247Test-913624000-project Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 86271890-bee9-4867-9384-64dd79be593b could not be found. Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '86271890-bee9-4867-9384-64dd79be593b'} Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86271890-bee9-4867-9384-64dd79be593b could not be found. Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86271890-bee9-4867-9384-64dd79be593b could not be found. Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:18.414830 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:18.423793 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:18.423793 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:18.423793 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:18.423793 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:58:18.423793 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:58:18.423793 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86271890-bee9-4867-9384-64dd79be593b could not be found. Sep 10 10:58:18.423793 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:18.423793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] Returning 404 to user: Instance 86271890-bee9-4867-9384-64dd79be593b could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:18.423793 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-31a4df9a-4f17-4249-a9b4-2cbe2e2d3427 tempest-ServersAaction247Test-913624000 tempest-ServersAaction247Test-913624000-project] 10.222.0.20 "GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b" status: 404 len: 111 microversion: 2.47 time: 0.122784 Sep 10 10:58:18.423793 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 853/4052] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:58:18 2022] GET /compute/v2.1/servers/86271890-bee9-4867-9384-64dd79be593b => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:58:18.428427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c8d299d-88c1-4e7b-98e1-632567efa51c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:18.429198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c8d299d-88c1-4e7b-98e1-632567efa51c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:18.439723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c8d299d-88c1-4e7b-98e1-632567efa51c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:18.440457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c8d299d-88c1-4e7b-98e1-632567efa51c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:18.440840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c8d299d-88c1-4e7b-98e1-632567efa51c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:18.441606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c8d299d-88c1-4e7b-98e1-632567efa51c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:18.442070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c8d299d-88c1-4e7b-98e1-632567efa51c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:18.443312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c8d299d-88c1-4e7b-98e1-632567efa51c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:18.944471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c8d299d-88c1-4e7b-98e1-632567efa51c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:18.956441 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c8d299d-88c1-4e7b-98e1-632567efa51c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1532 microversion: 2.1 time: 0.532399 Sep 10 10:58:18.957047 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3200/4053] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:18 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1532 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:19.987969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-46674c8c-7c6d-49fb-85ac-0dfbb2f70db1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:19.988963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-46674c8c-7c6d-49fb-85ac-0dfbb2f70db1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:20.005811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46674c8c-7c6d-49fb-85ac-0dfbb2f70db1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:20.009693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46674c8c-7c6d-49fb-85ac-0dfbb2f70db1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:20.010609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46674c8c-7c6d-49fb-85ac-0dfbb2f70db1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:20.013648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46674c8c-7c6d-49fb-85ac-0dfbb2f70db1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:20.014321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46674c8c-7c6d-49fb-85ac-0dfbb2f70db1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:20.016327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46674c8c-7c6d-49fb-85ac-0dfbb2f70db1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:21.602040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-46674c8c-7c6d-49fb-85ac-0dfbb2f70db1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:21.610983 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-46674c8c-7c6d-49fb-85ac-0dfbb2f70db1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 1.627976 Sep 10 10:58:21.620789 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 854/4054] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:19 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:21.747044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9b9affd4-ad40-493a-9882-aecdcf4fc4fe req-f55f903b-491d-44aa-bec6-d039b26dc296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1fff5af-b5bc-4a39-a5a3-81c17a2b397b", "name": "network-vif-plugged", "status": "completed", "tag": "fdf28f35-cdeb-4bbe-a940-e39781700167"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:21.786714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b9affd4-ad40-493a-9882-aecdcf4fc4fe req-f55f903b-491d-44aa-bec6-d039b26dc296 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:21.787198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b9affd4-ad40-493a-9882-aecdcf4fc4fe req-f55f903b-491d-44aa-bec6-d039b26dc296 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:21.787637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b9affd4-ad40-493a-9882-aecdcf4fc4fe req-f55f903b-491d-44aa-bec6-d039b26dc296 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:21.859699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9b9affd4-ad40-493a-9882-aecdcf4fc4fe req-f55f903b-491d-44aa-bec6-d039b26dc296 service nova] Creating event network-vif-plugged:fdf28f35-cdeb-4bbe-a940-e39781700167 for instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b on n-h2-856894-1 Sep 10 10:58:21.892402 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9b9affd4-ad40-493a-9882-aecdcf4fc4fe req-f55f903b-491d-44aa-bec6-d039b26dc296 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147948 Sep 10 10:58:21.898378 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3201/4055] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:58:22.649318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69416124-bb97-4b0e-8191-fb2c563885f1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:22.661189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69416124-bb97-4b0e-8191-fb2c563885f1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:22.691477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69416124-bb97-4b0e-8191-fb2c563885f1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:22.697432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69416124-bb97-4b0e-8191-fb2c563885f1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:22.700937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69416124-bb97-4b0e-8191-fb2c563885f1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:22.702105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69416124-bb97-4b0e-8191-fb2c563885f1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:22.706068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69416124-bb97-4b0e-8191-fb2c563885f1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:22.716570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69416124-bb97-4b0e-8191-fb2c563885f1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:22.963152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-24f90d71-00a6-4c5f-a6a2-da88a2d19a2e tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Action: 'create', calling method: .version_select at 0x7efcb2c7de50>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLghIS5w/+vmBeikNGoeUItesUdo50kMchlXpukALSGpUdtqWn8MZLygvAOxIh3KCUGauetiU8u0dH+hQxSh/Rn6JVRt7hZuReHmj38NPknf+3vHR4UmFI2KWXrDWz1fpA=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-24f90d71-00a6-4c5f-a6a2-da88a2d19a2e tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Request method failure captured: Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 257 Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG3OdO5vsiR7w9k2lbcL_EusA51E7r6gqpOJRBabBwyw_rvkezjZxs9d5rCpp7CqPB2eAGa1OoKw1lwmJJBs67rk7BJxiI71X-eYHn3Gz3MO7TD04Kbf3FTUOBwZyjLz2fjVFJk7wQ1cp7YyvAbbk4IPBQWT3IBSOBiMufLfVpxsLuQ Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01298588ebd34127bc4de36cdaecccee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLghIS5w/+vmBeikNGoeUItesUdo50kMchlXpukALSGpUdtqWn8MZLygvAOxIh3KCUGauetiU8u0dH+hQxSh/Rn6JVRt7hZuReHmj38NPknf+3vHR4UmFI2KWXrDWz1fpA=="}} Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLghIS5w/+vmBeikNGoeUItesUdo50kMchlXpukALSGpUdtqWn8MZLygvAOxIh3KCUGauetiU8u0dH+hQxSh/Rn6JVRt7hZuReHmj38NPknf+3vHR4UmFI2KWXrDWz1fpA=='}}} Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 10 10:58:22.970201 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 10:58:22.974728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.012813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-24f90d71-00a6-4c5f-a6a2-da88a2d19a2e tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:23.013731 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-24f90d71-00a6-4c5f-a6a2-da88a2d19a2e tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.823676 Sep 10 10:58:23.020694 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 855/4056] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:58:22 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 831 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:58:23.026768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f0718fd9-e2ac-4472-bc8d-96a9388e2b6d tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Action: 'create', calling method: .version_select at 0x7efcae5c7f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-88461310", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:23.059064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-f0718fd9-e2ac-4472-bc8d-96a9388e2b6d tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Getting quotas for project 01298588ebd34127bc4de36cdaecccee. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:23.082941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-f0718fd9-e2ac-4472-bc8d-96a9388e2b6d tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Getting quotas for user d51e26fd50d3413abb13e0865151ff9d and project 01298588ebd34127bc4de36cdaecccee. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:23.107756 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-f0718fd9-e2ac-4472-bc8d-96a9388e2b6d tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f0718fd9-e2ac-4472-bc8d-96a9388e2b6d tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Request method failure captured: Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 2165 Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG3OdO5vsiR7w9k2lbcL_EusA51E7r6gqpOJRBabBwyw_rvkezjZxs9d5rCpp7CqPB2eAGa1OoKw1lwmJJBs67rk7BJxiI71X-eYHn3Gz3MO7TD04Kbf3FTUOBwZyjLz2fjVFJk7wQ1cp7YyvAbbk4IPBQWT3IBSOBiMufLfVpxsLuQ Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01298588ebd34127bc4de36cdaecccee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-88461310", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:58:23.133931 n-d-856894-1 devstack@n-api.service[128787]: exception: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-88461310', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:23.137377 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.140754 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.143549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f0718fd9-e2ac-4472-bc8d-96a9388e2b6d tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:23.144812 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f0718fd9-e2ac-4472-bc8d-96a9388e2b6d tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.122797 Sep 10 10:58:23.145799 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 856/4057] 10.222.0.20 () {60 vars in 1160 bytes} [Sat Sep 10 10:58:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:58:23.160884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5f851e64-7769-4be1-8b5a-82294279e7c3 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Action: 'create', calling method: .version_select at 0x7efcaec3ed30>, body: {"keypair": {"name": "tempest-keypair-572004501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNRFXGX51bncMwuIQ8PfOzBozVWvjj2rqM0ryYUbjLMpSDl6bVVPBkQ06jYHdLpzjhqssF5r9t8MuY0wG5m9foPfMqmYoglZ7dnqWzlXM6HEu31vGsaP2G79qldBH4whQ=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:23.174584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-69416124-bb97-4b0e-8191-fb2c563885f1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:23.186865 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69416124-bb97-4b0e-8191-fb2c563885f1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.543646 Sep 10 10:58:23.188277 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3202/4058] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:22 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:23.197618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-5f851e64-7769-4be1-8b5a-82294279e7c3 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Getting quotas for project 01298588ebd34127bc4de36cdaecccee. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:23.219238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-5f851e64-7769-4be1-8b5a-82294279e7c3 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Getting quotas for user d51e26fd50d3413abb13e0865151ff9d and project 01298588ebd34127bc4de36cdaecccee. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:23.283630 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5f851e64-7769-4be1-8b5a-82294279e7c3 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127002 Sep 10 10:58:23.284746 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 857/4059] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:58:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:58:23.301470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1394a77b-e0ee-4c5f-af45-51fa78a9b141 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Action: 'create', calling method: .version_select at 0x7efcad3e09d0>, body: {"keypair": {"name": "tempest-keypair-572004501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX96N6tmnsYDWjafLcDP2w4yDL1TFkKtxio2g5GOJvhH1wbWXXtZMb7fTqLahp1zs8OPrFP8ZgeM7ydgQ+CqVSn/GnFqUWufbaDCtY3C+9/PdkWblvPExVvAcaVCGn4bg=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:23.342919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1394a77b-e0ee-4c5f-af45-51fa78a9b141 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Getting quotas for project 01298588ebd34127bc4de36cdaecccee. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:23.374136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-1394a77b-e0ee-4c5f-af45-51fa78a9b141 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Getting quotas for user d51e26fd50d3413abb13e0865151ff9d and project 01298588ebd34127bc4de36cdaecccee. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:23.458157 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-1394a77b-e0ee-4c5f-af45-51fa78a9b141 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] HTTP exception thrown: Key pair 'tempest-keypair-572004501' already exists. Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1394a77b-e0ee-4c5f-af45-51fa78a9b141 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Request method failure captured: Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 272 Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG3OdO5vsiR7w9k2lbcL_EusA51E7r6gqpOJRBabBwyw_rvkezjZxs9d5rCpp7CqPB2eAGa1OoKw1lwmJJBs67rk7BJxiI71X-eYHn3Gz3MO7TD04Kbf3FTUOBwZyjLz2fjVFJk7wQ1cp7YyvAbbk4IPBQWT3IBSOBiMufLfVpxsLuQ Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01298588ebd34127bc4de36cdaecccee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: {"keypair": {"name": "tempest-keypair-572004501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX96N6tmnsYDWjafLcDP2w4yDL1TFkKtxio2g5GOJvhH1wbWXXtZMb7fTqLahp1zs8OPrFP8ZgeM7ydgQ+CqVSn/GnFqUWufbaDCtY3C+9/PdkWblvPExVvAcaVCGn4bg=="}} Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: exception: Key pair 'tempest-keypair-572004501' already exists. Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-572004501', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX96N6tmnsYDWjafLcDP2w4yDL1TFkKtxio2g5GOJvhH1wbWXXtZMb7fTqLahp1zs8OPrFP8ZgeM7ydgQ+CqVSn/GnFqUWufbaDCtY3C+9/PdkWblvPExVvAcaVCGn4bg=='}}} Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result.read() Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'd51e26fd50d3413abb13e0865151ff9d-tempest-keypair-572004501' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 10 10:58:23.467605 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi session.flush() Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result.read() Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 10:58:23.472648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'd51e26fd50d3413abb13e0865151ff9d-tempest-keypair-572004501' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 10, 10, 58, 23, 444255), 'updated_at': None, 'name': 'tempest-keypair-572004501', 'user_id': 'd51e26fd50d3413abb13e0865151ff9d', 'fingerprint': '49:cb:5a:2c:58:bc:6a:06:5b:b7:c4:1f:47:8e:56:f4', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX96N6tmnsYDWjafLcDP2w4yDL1TFkKtxio2g5GOJvhH1wbWXXtZMb7fTqLahp1zs8OPrFP8ZgeM7ydgQ+CqVSn/GnFqUWufbaDCtY3C+9/PdkWblvPExVvAcaVCGn4bg==', 'type': 'ssh'}] Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi keypair.create() Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._create() Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-572004501' already exists. Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 10 10:58:23.477937 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-572004501' already exists. Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-572004501' already exists. Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.483180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1394a77b-e0ee-4c5f-af45-51fa78a9b141 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Returning 409 to user: Key pair 'tempest-keypair-572004501' already exists. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:23.484655 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1394a77b-e0ee-4c5f-af45-51fa78a9b141 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.185866 Sep 10 10:58:23.491633 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3203/4060] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:58:23 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:58:23.498650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e2a446aa-821e-4b55-b4ac-9ef41ea66c02 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Calling method '.version_select at 0x7efcaf0f0160>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:23.574558 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e2a446aa-821e-4b55-b4ac-9ef41ea66c02 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-572004501" status: 202 len: 0 microversion: 2.1 time: 0.079966 Sep 10 10:58:23.589275 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 858/4061] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Sep 10 10:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-572004501 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:58:23.599232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7223686-41d6-4f9c-b932-87e5c32fd17c tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Action: 'create', calling method: .version_select at 0x7efcb2c37040>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoej3urBjlrljMiDmGamT8QD4MC7qd0Y21dmE8//DNEWY9SKxWr/nR6+uS0Gn9iZ1pZmKEICBMPma4FR4ApwjtpKF63+K+A1cl9EtRdJf5LAY/0zgrBcmHZkgfXQcocqQ=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7223686-41d6-4f9c-b932-87e5c32fd17c tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Request method failure captured: Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 247 Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG3OdO5vsiR7w9k2lbcL_EusA51E7r6gqpOJRBabBwyw_rvkezjZxs9d5rCpp7CqPB2eAGa1OoKw1lwmJJBs67rk7BJxiI71X-eYHn3Gz3MO7TD04Kbf3FTUOBwZyjLz2fjVFJk7wQ1cp7YyvAbbk4IPBQWT3IBSOBiMufLfVpxsLuQ Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01298588ebd34127bc4de36cdaecccee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoej3urBjlrljMiDmGamT8QD4MC7qd0Y21dmE8//DNEWY9SKxWr/nR6+uS0Gn9iZ1pZmKEICBMPma4FR4ApwjtpKF63+K+A1cl9EtRdJf5LAY/0zgrBcmHZkgfXQcocqQ=="}} Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoej3urBjlrljMiDmGamT8QD4MC7qd0Y21dmE8//DNEWY9SKxWr/nR6+uS0Gn9iZ1pZmKEICBMPma4FR4ApwjtpKF63+K+A1cl9EtRdJf5LAY/0zgrBcmHZkgfXQcocqQ=='}}} Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi '' Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:58:23.610840 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 10:58:23.615368 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.616378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7223686-41d6-4f9c-b932-87e5c32fd17c tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:23.620148 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7223686-41d6-4f9c-b932-87e5c32fd17c tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.026175 Sep 10 10:58:23.625835 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3204/4062] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:58:23 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:58:23.633491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d9710a67-28ae-40b6-86c3-5f0040fb190b tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Action: 'create', calling method: .version_select at 0x7efcaeb985e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-183234203", "public_key": " "}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:23.658057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-d9710a67-28ae-40b6-86c3-5f0040fb190b tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Getting quotas for project 01298588ebd34127bc4de36cdaecccee. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:23.673568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-d9710a67-28ae-40b6-86c3-5f0040fb190b tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Getting quotas for user d51e26fd50d3413abb13e0865151ff9d and project 01298588ebd34127bc4de36cdaecccee. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:23.708756 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-d9710a67-28ae-40b6-86c3-5f0040fb190b tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d9710a67-28ae-40b6-86c3-5f0040fb190b tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Request method failure captured: Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 94 Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG3OdO5vsiR7w9k2lbcL_EusA51E7r6gqpOJRBabBwyw_rvkezjZxs9d5rCpp7CqPB2eAGa1OoKw1lwmJJBs67rk7BJxiI71X-eYHn3Gz3MO7TD04Kbf3FTUOBwZyjLz2fjVFJk7wQ1cp7YyvAbbk4IPBQWT3IBSOBiMufLfVpxsLuQ Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01298588ebd34127bc4de36cdaecccee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-183234203", "public_key": " "}} Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: exception: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-183234203', 'public_key': ' '}}} Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.711022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.716547 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.728026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d9710a67-28ae-40b6-86c3-5f0040fb190b tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:23.729390 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d9710a67-28ae-40b6-86c3-5f0040fb190b tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.101993 Sep 10 10:58:23.730727 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 859/4063] 10.222.0.20 () {60 vars in 1158 bytes} [Sat Sep 10 10:58:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:58:23.742023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-196beaaa-d1f7-47f8-b8f0-c3bc767f3691 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Action: 'create', calling method: .version_select at 0x7efcb2bfce50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEoGJ9JpS1rxjckJ95RXTm/z/+BAEjrBHeFTNlLJuyNhEDhLb7F6UupSwHUF6cUDNUjVGUlVWB6Jf7E7BE/leglI8ZWM5DnEuinKXaIogckuic40DlVZ0py0Sf4TnkTtQ=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-196beaaa-d1f7-47f8-b8f0-c3bc767f3691 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Request method failure captured: Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 507 Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG3OdO5vsiR7w9k2lbcL_EusA51E7r6gqpOJRBabBwyw_rvkezjZxs9d5rCpp7CqPB2eAGa1OoKw1lwmJJBs67rk7BJxiI71X-eYHn3Gz3MO7TD04Kbf3FTUOBwZyjLz2fjVFJk7wQ1cp7YyvAbbk4IPBQWT3IBSOBiMufLfVpxsLuQ Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01298588ebd34127bc4de36cdaecccee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEoGJ9JpS1rxjckJ95RXTm/z/+BAEjrBHeFTNlLJuyNhEDhLb7F6UupSwHUF6cUDNUjVGUlVWB6Jf7E7BE/leglI8ZWM5DnEuinKXaIogckuic40DlVZ0py0Sf4TnkTtQ=="}} Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEoGJ9JpS1rxjckJ95RXTm/z/+BAEjrBHeFTNlLJuyNhEDhLb7F6UupSwHUF6cUDNUjVGUlVWB6Jf7E7BE/leglI8ZWM5DnEuinKXaIogckuic40DlVZ0py0Sf4TnkTtQ=='}}} Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise error Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 10 10:58:23.746727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-196beaaa-d1f7-47f8-b8f0-c3bc767f3691 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:23.751028 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-196beaaa-d1f7-47f8-b8f0-c3bc767f3691 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010129 Sep 10 10:58:23.757695 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3205/4064] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:58:23 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:58:23.762640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-51948ce9-bea2-40a2-8c0f-822b764f2251 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Action: 'create', calling method: .version_select at 0x7efcae5c7d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-659503875", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:23.798519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-51948ce9-bea2-40a2-8c0f-822b764f2251 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Getting quotas for project 01298588ebd34127bc4de36cdaecccee. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:23.815061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-51948ce9-bea2-40a2-8c0f-822b764f2251 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Getting quotas for user d51e26fd50d3413abb13e0865151ff9d and project 01298588ebd34127bc4de36cdaecccee. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:23.868724 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-51948ce9-bea2-40a2-8c0f-822b764f2251 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-51948ce9-bea2-40a2-8c0f-822b764f2251 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Request method failure captured: Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 117 Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG3OdO5vsiR7w9k2lbcL_EusA51E7r6gqpOJRBabBwyw_rvkezjZxs9d5rCpp7CqPB2eAGa1OoKw1lwmJJBs67rk7BJxiI71X-eYHn3Gz3MO7TD04Kbf3FTUOBwZyjLz2fjVFJk7wQ1cp7YyvAbbk4IPBQWT3IBSOBiMufLfVpxsLuQ Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01298588ebd34127bc4de36cdaecccee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-659503875", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: exception: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-659503875', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 10 10:58:23.873698 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 10 10:58:23.880040 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.888632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-51948ce9-bea2-40a2-8c0f-822b764f2251 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:23.888632 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-51948ce9-bea2-40a2-8c0f-822b764f2251 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.128982 Sep 10 10:58:23.889598 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 860/4065] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 10:58:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 10:58:23.898034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc28fd84-961c-4020-b5ee-a8d605881148 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Calling method '.version_select at 0x7efcad47e160>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:23.923678 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-dc28fd84-961c-4020-b5ee-a8d605881148 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-762279541 not found for user d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc28fd84-961c-4020-b5ee-a8d605881148 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Request method failure captured: Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-762279541 HTTP/1.1 Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG3OdO5vsiR7w9k2lbcL_EusA51E7r6gqpOJRBabBwyw_rvkezjZxs9d5rCpp7CqPB2eAGa1OoKw1lwmJJBs67rk7BJxiI71X-eYHn3Gz3MO7TD04Kbf3FTUOBwZyjLz2fjVFJk7wQ1cp7YyvAbbk4IPBQWT3IBSOBiMufLfVpxsLuQ Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01298588ebd34127bc4de36cdaecccee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01298588ebd34127bc4de36cdaecccee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 01298588ebd34127bc4de36cdaecccee Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1374320870 Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1374320870-project Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: exception: Keypair tempest-keypair-non-existent-762279541 not found for user d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'tempest-keypair-non-existent-762279541'} Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-762279541 not found for user d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.925538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-762279541 not found for user d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-762279541 not found for user d51e26fd50d3413abb13e0865151ff9d Sep 10 10:58:23.931112 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:23.938495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc28fd84-961c-4020-b5ee-a8d605881148 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] Returning 404 to user: Keypair tempest-keypair-non-existent-762279541 not found for user d51e26fd50d3413abb13e0865151ff9d {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:23.939543 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dc28fd84-961c-4020-b5ee-a8d605881148 tempest-KeyPairsNegativeTestJSON-1374320870 tempest-KeyPairsNegativeTestJSON-1374320870-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-762279541" status: 404 len: 144 microversion: 2.1 time: 0.045950 Sep 10 10:58:23.954715 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3206/4066] 10.222.0.20 () {58 vars in 1257 bytes} [Sat Sep 10 10:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-762279541 => generated 144 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:58:24.216237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-47aab2dd-22e5-4c37-949b-a1fa332e1434 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:24.216861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-47aab2dd-22e5-4c37-949b-a1fa332e1434 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:24.234031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aab2dd-22e5-4c37-949b-a1fa332e1434 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:24.234812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aab2dd-22e5-4c37-949b-a1fa332e1434 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:24.236979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aab2dd-22e5-4c37-949b-a1fa332e1434 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:24.237935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aab2dd-22e5-4c37-949b-a1fa332e1434 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:24.240145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aab2dd-22e5-4c37-949b-a1fa332e1434 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:24.240765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aab2dd-22e5-4c37-949b-a1fa332e1434 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:24.642385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-47aab2dd-22e5-4c37-949b-a1fa332e1434 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:24.657277 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-47aab2dd-22e5-4c37-949b-a1fa332e1434 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.446565 Sep 10 10:58:24.664874 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 861/4067] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:24 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:25.692095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-225d8ea5-5210-476e-89cb-0f8794969f23 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:25.692845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-225d8ea5-5210-476e-89cb-0f8794969f23 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:25.715755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-225d8ea5-5210-476e-89cb-0f8794969f23 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:25.716264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-225d8ea5-5210-476e-89cb-0f8794969f23 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:25.716691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-225d8ea5-5210-476e-89cb-0f8794969f23 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:25.732638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-225d8ea5-5210-476e-89cb-0f8794969f23 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:25.735448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-225d8ea5-5210-476e-89cb-0f8794969f23 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:25.735921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-225d8ea5-5210-476e-89cb-0f8794969f23 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:26.299356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-225d8ea5-5210-476e-89cb-0f8794969f23 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:26.317749 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-225d8ea5-5210-476e-89cb-0f8794969f23 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.629131 Sep 10 10:58:26.319659 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3207/4068] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:25 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:27.345806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f319a76-09db-46b3-acea-988fe99f6aad tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:27.347014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7f319a76-09db-46b3-acea-988fe99f6aad tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:27.355083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f319a76-09db-46b3-acea-988fe99f6aad tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:27.355845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f319a76-09db-46b3-acea-988fe99f6aad tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:27.361627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f319a76-09db-46b3-acea-988fe99f6aad tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:27.362779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f319a76-09db-46b3-acea-988fe99f6aad tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:27.363428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f319a76-09db-46b3-acea-988fe99f6aad tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:27.364174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f319a76-09db-46b3-acea-988fe99f6aad tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:28.089790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7f319a76-09db-46b3-acea-988fe99f6aad tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:28.103278 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7f319a76-09db-46b3-acea-988fe99f6aad tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.762928 Sep 10 10:58:28.123252 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 862/4069] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:27 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:28.196725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4bd0821b-4cd6-4523-afec-67c0f9feea5d tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Action: 'create', calling method: .version_select at 0x7efcad3ef700>, body: {"keypair": {"name": "tempest-keypair-985744167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj6Xkk83BhRxIctF6j9qLohln/64x6Kae4jqBnYXam9wtlFo3hPc12dvZ/MGm0QgSSeMus/83MNHcYftS5r/jnTWKG5JxDVccgp35s1Z6TPYvl+EKu+bHUI/kTARnxmDw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:28.218695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:28.245637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4bd0821b-4cd6-4523-afec-67c0f9feea5d tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:28.264244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4bd0821b-4cd6-4523-afec-67c0f9feea5d tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for user d97bb33422aa4823a2b79ae9077089e9 and project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:28.325299 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4bd0821b-4cd6-4523-afec-67c0f9feea5d tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.407501 Sep 10 10:58:28.326673 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3208/4070] 10.222.0.20 () {62 vars in 1199 bytes} [Sat Sep 10 10:58:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 410 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 10:58:28.339810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2ab55562-a781-483d-b12c-3ddeac2b02de tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcb2cbd5e0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:28.380368 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2ab55562-a781-483d-b12c-3ddeac2b02de tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-985744167" status: 200 len: 512 microversion: 2.2 time: 0.043626 Sep 10 10:58:28.385013 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 863/4071] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Sep 10 10:58:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-985744167 => generated 512 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:58:28.394851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6a26f60-c24f-4b04-a0e5-abffded74166 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad3d10d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:28.461277 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6a26f60-c24f-4b04-a0e5-abffded74166 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-985744167" status: 204 len: 0 microversion: 2.2 time: 0.070435 Sep 10 10:58:28.477451 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3209/4072] 10.222.0.20 () {60 vars in 1258 bytes} [Sat Sep 10 10:58:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-985744167 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:58:28.493780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ec3a0a8e-cc83-466a-8779-3d84720bd7af tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Action: 'create', calling method: .version_select at 0x7efcb2c0f700>, body: {"keypair": {"name": "tempest-keypair-71168391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMpLtgzZqHSi0e2nX2pqCDqXmhNfVUrvIGu8G7ua7M5W43YMLbfJRuu+bpo7Sws+koHKp3YYqiEnfhJWeS+xeFQEjYtNwa5OpRpOWFs4fAhLE4Wvr9/6+ssYftcWVELQQ=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:28.530104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:28.551569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-ec3a0a8e-cc83-466a-8779-3d84720bd7af tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:28.566037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-ec3a0a8e-cc83-466a-8779-3d84720bd7af tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for user d97bb33422aa4823a2b79ae9077089e9 and project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:28.628283 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ec3a0a8e-cc83-466a-8779-3d84720bd7af tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.141217 Sep 10 10:58:28.629581 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 864/4073] 10.222.0.20 () {62 vars in 1199 bytes} [Sat Sep 10 10:58:28 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 10:58:28.641031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b7710fe-3128-4454-97c0-7fe394528d9a tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad401040>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:28.687720 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b7710fe-3128-4454-97c0-7fe394528d9a tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-71168391" status: 204 len: 0 microversion: 2.2 time: 0.048176 Sep 10 10:58:28.697125 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3210/4074] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Sep 10 10:58:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-71168391 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:58:28.712123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1974ab02-9ad2-443e-b6ab-2c3000b30e3c tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Action: 'create', calling method: .version_select at 0x7efcb2c21700>, body: {"keypair": {"name": "tempest-keypair-22733296", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:28.757581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-1974ab02-9ad2-443e-b6ab-2c3000b30e3c tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:28.770940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-1974ab02-9ad2-443e-b6ab-2c3000b30e3c tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for user d97bb33422aa4823a2b79ae9077089e9 and project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:28.837646 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1974ab02-9ad2-443e-b6ab-2c3000b30e3c tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 587 microversion: 2.2 time: 0.135198 Sep 10 10:58:28.846030 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 865/4075] 10.222.0.20 () {62 vars in 1199 bytes} [Sat Sep 10 10:58:28 2022] POST /compute/v2.1/os-keypairs => generated 587 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 10:58:28.849485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b31dbee1-276f-457f-9b12-f4dd934091d7 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad3ea940>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:28.914231 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b31dbee1-276f-457f-9b12-f4dd934091d7 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-22733296" status: 204 len: 0 microversion: 2.2 time: 0.068050 Sep 10 10:58:28.914844 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3211/4076] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Sep 10 10:58:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-22733296 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:58:28.928888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6d122bf2-3ffb-497e-b67c-339c2f281d63 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Action: 'create', calling method: .version_select at 0x7efcb2c2c8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-765501707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvwnqOhH6acG56JbZsN8tJHE5ugBMTuctmx0gm7xhCo6MO3vHq13WINSigua5fl4LXxMgUNn+c73KgfiW7mSC4unUmx3w3GjLhxzcOpADdBk4gH40QMNGDiu/fjJpagsA=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:28.971918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-6d122bf2-3ffb-497e-b67c-339c2f281d63 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:28.995262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-6d122bf2-3ffb-497e-b67c-339c2f281d63 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for user d97bb33422aa4823a2b79ae9077089e9 and project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:29.060433 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6d122bf2-3ffb-497e-b67c-339c2f281d63 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.137285 Sep 10 10:58:29.061377 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 866/4077] 10.222.0.20 () {62 vars in 1199 bytes} [Sat Sep 10 10:58:28 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 10:58:29.076199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76409314-6772-438b-8bb4-853531411359 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Action: 'create', calling method: .version_select at 0x7efcad3eadc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1281330202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKld8rMaOJ0LE+NSACGhzs7joMpcNspKh+nvUBdkmpSFW0O4HDVKHJCYZm1Wa9Wz1gpqjo1WcLkkxNIIuMpkdU1lCL+AnDMBxjny4/GCPKsPkAz/I/yArYt5XBHvbLo0g=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:29.127904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-76409314-6772-438b-8bb4-853531411359 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:29.131737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-efad9def-1705-4501-a9b4-3845493caa40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:29.132392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-efad9def-1705-4501-a9b4-3845493caa40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:29.142854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-76409314-6772-438b-8bb4-853531411359 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for user d97bb33422aa4823a2b79ae9077089e9 and project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:29.144190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efad9def-1705-4501-a9b4-3845493caa40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:29.144715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efad9def-1705-4501-a9b4-3845493caa40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:29.145188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efad9def-1705-4501-a9b4-3845493caa40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:29.145913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efad9def-1705-4501-a9b4-3845493caa40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:29.146372 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efad9def-1705-4501-a9b4-3845493caa40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:29.154567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efad9def-1705-4501-a9b4-3845493caa40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:29.215140 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76409314-6772-438b-8bb4-853531411359 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.143984 Sep 10 10:58:29.225588 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3212/4078] 10.222.0.20 () {62 vars in 1199 bytes} [Sat Sep 10 10:58:29 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 10:58:29.242120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10f15cf4-d88a-4427-9f51-ae9b7230a568 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Action: 'create', calling method: .version_select at 0x7efcad3dc4c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-778686829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbdBA+r9wM/tQhEsJhMi3xDJo+oLwiPQIbVZKWFpGoU1SmgALVphyLc9rf8nAPmxfZEz3VvE+1Oaw8fCQReN25/HEHIIeCV/9lDSUBj0lm8ex0Uquz7GXAfaUbfFvhefg=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:29.282235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-10f15cf4-d88a-4427-9f51-ae9b7230a568 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:29.317909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-10f15cf4-d88a-4427-9f51-ae9b7230a568 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for user d97bb33422aa4823a2b79ae9077089e9 and project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:29.397010 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10f15cf4-d88a-4427-9f51-ae9b7230a568 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.158750 Sep 10 10:58:29.398002 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3213/4079] 10.222.0.20 () {62 vars in 1199 bytes} [Sat Sep 10 10:58:29 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 10 10:58:29.411980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c979737-1a9b-497e-a55f-8821212c769d tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad3ef310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:29.417707 n-d-856894-1 devstack@n-api.service[128788]: WARNING oslo_db.sqlalchemy.utils [None req-9c979737-1a9b-497e-a55f-8821212c769d tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 10:58:29.429605 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c979737-1a9b-497e-a55f-8821212c769d tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.021973 Sep 10 10:58:29.437622 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3214/4080] 10.222.0.20 () {60 vars in 1177 bytes} [Sat Sep 10 10:58:29 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:29.449163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3a41c53-cf5a-4c57-b4a9-a2a79883a595 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad3dcee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:29.500685 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3a41c53-cf5a-4c57-b4a9-a2a79883a595 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-778686829" status: 204 len: 0 microversion: 2.2 time: 0.056003 Sep 10 10:58:29.504440 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3215/4081] 10.222.0.20 () {60 vars in 1318 bytes} [Sat Sep 10 10:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-778686829 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:58:29.513863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8180cb4-1b9f-416b-813c-a2055d614a96 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad404b80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:29.570374 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8180cb4-1b9f-416b-813c-a2055d614a96 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1281330202" status: 204 len: 0 microversion: 2.2 time: 0.060930 Sep 10 10:58:29.579326 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3216/4082] 10.222.0.20 () {60 vars in 1321 bytes} [Sat Sep 10 10:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1281330202 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:58:29.596436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f9e5594-1bee-4083-9d6e-e8227e98afd5 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad4058b0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:29.669424 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f9e5594-1bee-4083-9d6e-e8227e98afd5 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-765501707" status: 204 len: 0 microversion: 2.2 time: 0.084799 Sep 10 10:58:29.670641 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3217/4083] 10.222.0.20 () {60 vars in 1318 bytes} [Sat Sep 10 10:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-765501707 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:58:29.684208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-113f8b66-17c9-4c4b-a23d-baaaaf04ac2e tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Action: 'create', calling method: .version_select at 0x7efcad404e50>, body: {"keypair": {"name": "tempest-keypair-2111345457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZ3siX7qdY80FU81MezWZyiImPD9rc2j0tMSYesahZllJ86Xrxzur+2oqBrGLNjtq0kmUIs3TtAemNT+VqTgq3RcPpQxRvhF44fK0CLIy4QqggREGLted29+Zu6UuQUTg=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:29.756052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-113f8b66-17c9-4c4b-a23d-baaaaf04ac2e tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:29.787685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-113f8b66-17c9-4c4b-a23d-baaaaf04ac2e tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for user d97bb33422aa4823a2b79ae9077089e9 and project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:29.844630 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-113f8b66-17c9-4c4b-a23d-baaaaf04ac2e tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.165405 Sep 10 10:58:29.845287 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3218/4084] 10.222.0.20 () {62 vars in 1199 bytes} [Sat Sep 10 10:58:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 10 10:58:29.856298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2693d0b9-85f0-4a26-8384-f49dd2cf862c tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad401b80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:29.872638 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2693d0b9-85f0-4a26-8384-f49dd2cf862c tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-2111345457" status: 200 len: 513 microversion: 2.2 time: 0.020283 Sep 10 10:58:29.879876 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3219/4085] 10.222.0.20 () {60 vars in 1258 bytes} [Sat Sep 10 10:58:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2111345457 => generated 513 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:58:29.888717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33ed216c-4feb-4c6f-8c7d-48f36cf96719 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad3d1d30>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:29.893107 n-d-856894-1 devstack@n-api.service[128788]: WARNING oslo_db.sqlalchemy.utils [None req-33ed216c-4feb-4c6f-8c7d-48f36cf96719 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 10:58:29.912187 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-33ed216c-4feb-4c6f-8c7d-48f36cf96719 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.027159 Sep 10 10:58:29.914116 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3220/4086] 10.222.0.20 () {60 vars in 1177 bytes} [Sat Sep 10 10:58:29 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:58:29.925211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5a4b475-cac9-45ae-8b64-bad7188c50c8 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad3f35e0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:29.962383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-efad9def-1705-4501-a9b4-3845493caa40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:29.964233 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e5a4b475-cac9-45ae-8b64-bad7188c50c8 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111345457" status: 204 len: 0 microversion: 2.2 time: 0.042819 Sep 10 10:58:29.965279 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3221/4087] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Sep 10 10:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111345457 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:58:29.972837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:29.977388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86e69e42-c3c1-4f8f-9a4e-8213c461400b tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Action: 'create', calling method: .version_select at 0x7efcad405940>, body: {"keypair": {"name": "tempest-keypair-782511015", "type": "x509"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:29.979644 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-efad9def-1705-4501-a9b4-3845493caa40 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.853036 Sep 10 10:58:29.994768 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 867/4088] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:29 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:30.017499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-86e69e42-c3c1-4f8f-9a4e-8213c461400b tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:30.026302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-86e69e42-c3c1-4f8f-9a4e-8213c461400b tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for user d97bb33422aa4823a2b79ae9077089e9 and project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:30.057448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.processutils [None req-86e69e42-c3c1-4f8f-9a4e-8213c461400b tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp6j4v_huv/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp6j4v_huv/temp.key -subj /CN=d97bb33422aa4823a2b79ae9077089e9 -extensions v3_req_client {{(pid=128788) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 10 10:58:30.310283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.processutils [None req-86e69e42-c3c1-4f8f-9a4e-8213c461400b tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp6j4v_huv/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp6j4v_huv/temp.key -subj /CN=d97bb33422aa4823a2b79ae9077089e9 -extensions v3_req_client" returned: 0 in 0.251s {{(pid=128788) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 10 10:58:30.311818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.processutils [None req-86e69e42-c3c1-4f8f-9a4e-8213c461400b tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp6j4v_huv/temp.key -password pass: {{(pid=128788) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 10 10:58:30.385015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.processutils [None req-86e69e42-c3c1-4f8f-9a4e-8213c461400b tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp6j4v_huv/temp.key -password pass:" returned: 0 in 0.071s {{(pid=128788) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 10 10:58:30.537137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-86e69e42-c3c1-4f8f-9a4e-8213c461400b tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:30.556064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-86e69e42-c3c1-4f8f-9a4e-8213c461400b tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Getting quotas for user d97bb33422aa4823a2b79ae9077089e9 and project 0fd97d681219402aaa72998bcf8439b8. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:30.560775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:30.610742 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86e69e42-c3c1-4f8f-9a4e-8213c461400b tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.638673 Sep 10 10:58:30.617865 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3222/4089] 10.222.0.20 () {62 vars in 1198 bytes} [Sat Sep 10 10:58:29 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 641 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:58:30.623182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5f369f7e-9a1f-49aa-84c4-2b24101f7023 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcb2c220d0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:30.657799 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5f369f7e-9a1f-49aa-84c4-2b24101f7023 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-782511015" status: 200 len: 1533 microversion: 2.2 time: 0.038392 Sep 10 10:58:30.669490 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 868/4090] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Sep 10 10:58:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-782511015 => generated 1533 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:30.690173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a31f9a48-7263-4a09-b4f2-fc836d752b79 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcad4055e0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:30.694801 n-d-856894-1 devstack@n-api.service[128788]: WARNING oslo_db.sqlalchemy.utils [None req-a31f9a48-7263-4a09-b4f2-fc836d752b79 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 10:58:30.726479 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a31f9a48-7263-4a09-b4f2-fc836d752b79 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.044948 Sep 10 10:58:30.742673 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3223/4091] 10.222.0.20 () {60 vars in 1177 bytes} [Sat Sep 10 10:58:30 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:30.764935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-331f7a8f-4d17-4038-8de3-30fec89e18e4 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] Calling method '.version_select at 0x7efcb2bf21f0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:30.885999 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-331f7a8f-4d17-4038-8de3-30fec89e18e4 tempest-KeyPairsV22TestJSON-1699978017 tempest-KeyPairsV22TestJSON-1699978017-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-782511015" status: 204 len: 0 microversion: 2.2 time: 0.132196 Sep 10 10:58:30.886928 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 869/4092] 10.222.0.20 () {60 vars in 1258 bytes} [Sat Sep 10 10:58:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-782511015 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:58:31.011404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be3ea5a9-baa2-4569-807f-128c2f93f3da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:31.012257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be3ea5a9-baa2-4569-807f-128c2f93f3da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:31.033509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be3ea5a9-baa2-4569-807f-128c2f93f3da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:31.041554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be3ea5a9-baa2-4569-807f-128c2f93f3da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:31.042713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be3ea5a9-baa2-4569-807f-128c2f93f3da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:31.043656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be3ea5a9-baa2-4569-807f-128c2f93f3da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:31.044048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be3ea5a9-baa2-4569-807f-128c2f93f3da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:31.048666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be3ea5a9-baa2-4569-807f-128c2f93f3da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:31.067608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:32.538262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be3ea5a9-baa2-4569-807f-128c2f93f3da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:32.552513 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be3ea5a9-baa2-4569-807f-128c2f93f3da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 1.550206 Sep 10 10:58:32.557623 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3224/4093] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:31 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:33.590277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-728f3a47-9637-468c-800c-cdcf64150600 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:33.590974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-728f3a47-9637-468c-800c-cdcf64150600 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:33.611356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-728f3a47-9637-468c-800c-cdcf64150600 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:33.616874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-728f3a47-9637-468c-800c-cdcf64150600 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:33.619556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-728f3a47-9637-468c-800c-cdcf64150600 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:33.623345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-728f3a47-9637-468c-800c-cdcf64150600 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:33.627033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-728f3a47-9637-468c-800c-cdcf64150600 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:33.627832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-728f3a47-9637-468c-800c-cdcf64150600 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:34.633127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-728f3a47-9637-468c-800c-cdcf64150600 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:34.653329 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-728f3a47-9637-468c-800c-cdcf64150600 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 1.077157 Sep 10 10:58:34.662131 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 870/4094] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:33 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:35.687889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-138975a1-95c4-4a15-9323-ad622681355c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:35.689291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-138975a1-95c4-4a15-9323-ad622681355c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:35.711622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-138975a1-95c4-4a15-9323-ad622681355c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:35.713493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-138975a1-95c4-4a15-9323-ad622681355c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:35.720534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-138975a1-95c4-4a15-9323-ad622681355c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:35.721331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-138975a1-95c4-4a15-9323-ad622681355c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:35.721801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-138975a1-95c4-4a15-9323-ad622681355c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:35.722401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-138975a1-95c4-4a15-9323-ad622681355c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:36.421878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-138975a1-95c4-4a15-9323-ad622681355c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:36.441833 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-138975a1-95c4-4a15-9323-ad622681355c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.754914 Sep 10 10:58:36.446933 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3225/4095] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:35 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:37.473750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f0906171-ec71-4270-a7c6-a40f0f5ec247 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:37.474439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f0906171-ec71-4270-a7c6-a40f0f5ec247 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:37.495710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0906171-ec71-4270-a7c6-a40f0f5ec247 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:37.496385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0906171-ec71-4270-a7c6-a40f0f5ec247 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:37.497049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0906171-ec71-4270-a7c6-a40f0f5ec247 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:37.507182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0906171-ec71-4270-a7c6-a40f0f5ec247 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:37.507924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0906171-ec71-4270-a7c6-a40f0f5ec247 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:37.508370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0906171-ec71-4270-a7c6-a40f0f5ec247 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:37.930390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-415880408", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "b0619000-5798-4efa-a6ed-868e4d24643a"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:38.047613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f0906171-ec71-4270-a7c6-a40f0f5ec247 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:38.066836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] validate_networks() for [('b0619000-5798-4efa-a6ed-868e4d24643a', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:58:38.070776 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f0906171-ec71-4270-a7c6-a40f0f5ec247 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.600865 Sep 10 10:58:38.073141 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 871/4096] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:37 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:39.102592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fe59de9d-8c15-4e73-aef7-c4e11251b253 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:39.103848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fe59de9d-8c15-4e73-aef7-c4e11251b253 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:39.107833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=28 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:39.123104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe59de9d-8c15-4e73-aef7-c4e11251b253 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:39.123873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe59de9d-8c15-4e73-aef7-c4e11251b253 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:39.124482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe59de9d-8c15-4e73-aef7-c4e11251b253 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:39.125436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe59de9d-8c15-4e73-aef7-c4e11251b253 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:39.128119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe59de9d-8c15-4e73-aef7-c4e11251b253 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:39.128748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe59de9d-8c15-4e73-aef7-c4e11251b253 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:39.488995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe59de9d-8c15-4e73-aef7-c4e11251b253 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:39.504674 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fe59de9d-8c15-4e73-aef7-c4e11251b253 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.406248 Sep 10 10:58:39.513875 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 872/4097] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:39 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:39.601828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:58:39.602827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:58:39.603500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:58:39.604417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:58:39.605660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:58:39.627433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:39.628783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:39.629481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:39.630475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:39.631989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:39.635108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:39.692236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Getting quotas for project 51009c948a88463b8e0185161e17efba. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:58:39.732632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Getting quotas for user 3a70bea9892f49539d90040e7a063ec4 and project 51009c948a88463b8e0185161e17efba. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:58:39.763487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:58:39.766485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:58:39.928444 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-830e647b-8cd8-4633-abd3-68f79a64a6e5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.438407 Sep 10 10:58:39.934527 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3226/4098] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:58:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 10:58:39.944766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-20b277ca-28ec-4f68-92e1-c2ae168dec53 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:39.945970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-20b277ca-28ec-4f68-92e1-c2ae168dec53 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:40.276216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-20b277ca-28ec-4f68-92e1-c2ae168dec53 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:40.284521 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-20b277ca-28ec-4f68-92e1-c2ae168dec53 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1215 microversion: 2.1 time: 0.343857 Sep 10 10:58:40.287637 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 873/4099] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:39 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1215 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:40.542972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cef835a0-0ce6-48fa-a571-f8db526887df tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:40.543743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cef835a0-0ce6-48fa-a571-f8db526887df tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:40.561530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef835a0-0ce6-48fa-a571-f8db526887df tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:40.568429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef835a0-0ce6-48fa-a571-f8db526887df tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:40.575149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef835a0-0ce6-48fa-a571-f8db526887df tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:40.576417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef835a0-0ce6-48fa-a571-f8db526887df tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:40.577174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef835a0-0ce6-48fa-a571-f8db526887df tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:40.579733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cef835a0-0ce6-48fa-a571-f8db526887df tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:41.313096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2b156895-a1a1-47f3-9401-d31114e86bf3 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:41.314376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2b156895-a1a1-47f3-9401-d31114e86bf3 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:41.337452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b156895-a1a1-47f3-9401-d31114e86bf3 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:41.345495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b156895-a1a1-47f3-9401-d31114e86bf3 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:41.348912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b156895-a1a1-47f3-9401-d31114e86bf3 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:41.357968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b156895-a1a1-47f3-9401-d31114e86bf3 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:41.361510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b156895-a1a1-47f3-9401-d31114e86bf3 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:41.371277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b156895-a1a1-47f3-9401-d31114e86bf3 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:41.545406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2b156895-a1a1-47f3-9401-d31114e86bf3 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:41.561927 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2b156895-a1a1-47f3-9401-d31114e86bf3 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1211 microversion: 2.1 time: 0.252543 Sep 10 10:58:41.578862 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 874/4100] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:41 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1211 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:41.766091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cef835a0-0ce6-48fa-a571-f8db526887df tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:41.788013 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cef835a0-0ce6-48fa-a571-f8db526887df tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 1.245280 Sep 10 10:58:41.789762 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3227/4101] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:40 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:42.590270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-63c7d234-be86-47a6-9f23-b44a9d817f5a tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:42.591031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-63c7d234-be86-47a6-9f23-b44a9d817f5a tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:42.613819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63c7d234-be86-47a6-9f23-b44a9d817f5a tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:42.617752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63c7d234-be86-47a6-9f23-b44a9d817f5a tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:42.618323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63c7d234-be86-47a6-9f23-b44a9d817f5a tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:42.623818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63c7d234-be86-47a6-9f23-b44a9d817f5a tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:42.624998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63c7d234-be86-47a6-9f23-b44a9d817f5a tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:42.626723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63c7d234-be86-47a6-9f23-b44a9d817f5a tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:42.813131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd92f578-7fed-42ca-8c9b-6785239b875f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:42.814440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd92f578-7fed-42ca-8c9b-6785239b875f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:42.828386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd92f578-7fed-42ca-8c9b-6785239b875f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:42.829337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd92f578-7fed-42ca-8c9b-6785239b875f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:42.830047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd92f578-7fed-42ca-8c9b-6785239b875f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:42.831026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd92f578-7fed-42ca-8c9b-6785239b875f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:42.831735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd92f578-7fed-42ca-8c9b-6785239b875f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:42.833701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bd92f578-7fed-42ca-8c9b-6785239b875f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:43.008826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-63c7d234-be86-47a6-9f23-b44a9d817f5a tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:43.021767 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-63c7d234-be86-47a6-9f23-b44a9d817f5a tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1285 microversion: 2.1 time: 0.432489 Sep 10 10:58:43.037097 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 875/4102] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:42 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1285 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:43.238900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bd92f578-7fed-42ca-8c9b-6785239b875f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:43.249369 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd92f578-7fed-42ca-8c9b-6785239b875f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.440238 Sep 10 10:58:43.254741 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3228/4103] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:42 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:44.050135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-19b9592f-66b1-40cd-bbfb-a64bda4038d1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:44.052227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-19b9592f-66b1-40cd-bbfb-a64bda4038d1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:44.067086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19b9592f-66b1-40cd-bbfb-a64bda4038d1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:44.067585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19b9592f-66b1-40cd-bbfb-a64bda4038d1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:44.068024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19b9592f-66b1-40cd-bbfb-a64bda4038d1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:44.068738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19b9592f-66b1-40cd-bbfb-a64bda4038d1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:44.090998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19b9592f-66b1-40cd-bbfb-a64bda4038d1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:44.093873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19b9592f-66b1-40cd-bbfb-a64bda4038d1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:44.280409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-516ad60a-476b-4855-be65-d9e9475b905c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:44.281674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-516ad60a-476b-4855-be65-d9e9475b905c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:44.312865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516ad60a-476b-4855-be65-d9e9475b905c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:44.315456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516ad60a-476b-4855-be65-d9e9475b905c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:44.318804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516ad60a-476b-4855-be65-d9e9475b905c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:44.320260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516ad60a-476b-4855-be65-d9e9475b905c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:44.322116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516ad60a-476b-4855-be65-d9e9475b905c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:44.326781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-516ad60a-476b-4855-be65-d9e9475b905c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:44.712678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-19b9592f-66b1-40cd-bbfb-a64bda4038d1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:44.732843 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-19b9592f-66b1-40cd-bbfb-a64bda4038d1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1273 microversion: 2.1 time: 0.686838 Sep 10 10:58:44.759966 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 876/4104] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:44 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1273 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:45.768256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ab8bbd1c-1bf5-4c8a-8147-ee8048902e45 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:45.770173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ab8bbd1c-1bf5-4c8a-8147-ee8048902e45 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:45.806973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab8bbd1c-1bf5-4c8a-8147-ee8048902e45 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:45.809405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab8bbd1c-1bf5-4c8a-8147-ee8048902e45 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:45.811542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab8bbd1c-1bf5-4c8a-8147-ee8048902e45 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:45.814859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab8bbd1c-1bf5-4c8a-8147-ee8048902e45 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:45.822272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab8bbd1c-1bf5-4c8a-8147-ee8048902e45 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:45.825254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab8bbd1c-1bf5-4c8a-8147-ee8048902e45 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:46.261527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-516ad60a-476b-4855-be65-d9e9475b905c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:46.270057 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-516ad60a-476b-4855-be65-d9e9475b905c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 1.993706 Sep 10 10:58:46.278158 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3229/4105] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:44 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:46.871325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab8bbd1c-1bf5-4c8a-8147-ee8048902e45 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:46.880084 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ab8bbd1c-1bf5-4c8a-8147-ee8048902e45 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1315 microversion: 2.1 time: 1.116879 Sep 10 10:58:46.891801 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 877/4106] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:45 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:47.294906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ef51dc1-65ff-4ec1-afaf-35f37f772698 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:47.296139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8ef51dc1-65ff-4ec1-afaf-35f37f772698 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:47.308583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ef51dc1-65ff-4ec1-afaf-35f37f772698 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:47.309377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ef51dc1-65ff-4ec1-afaf-35f37f772698 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:47.310018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ef51dc1-65ff-4ec1-afaf-35f37f772698 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:47.314230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ef51dc1-65ff-4ec1-afaf-35f37f772698 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:47.315073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ef51dc1-65ff-4ec1-afaf-35f37f772698 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:47.315850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ef51dc1-65ff-4ec1-afaf-35f37f772698 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:47.852167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8ef51dc1-65ff-4ec1-afaf-35f37f772698 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:47.862510 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ef51dc1-65ff-4ec1-afaf-35f37f772698 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.572113 Sep 10 10:58:47.866687 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3230/4107] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:47 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:47.917340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-78d1147a-8b1d-47eb-996c-87c3c7356868 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:47.917957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-78d1147a-8b1d-47eb-996c-87c3c7356868 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:47.930284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78d1147a-8b1d-47eb-996c-87c3c7356868 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:47.932763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78d1147a-8b1d-47eb-996c-87c3c7356868 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:47.936674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78d1147a-8b1d-47eb-996c-87c3c7356868 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:47.937952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78d1147a-8b1d-47eb-996c-87c3c7356868 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:47.938614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78d1147a-8b1d-47eb-996c-87c3c7356868 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:47.939221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78d1147a-8b1d-47eb-996c-87c3c7356868 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:48.892537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d974a603-be47-4bdf-9b88-454fe6364191 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:48.893102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d974a603-be47-4bdf-9b88-454fe6364191 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:48.903087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d974a603-be47-4bdf-9b88-454fe6364191 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:48.903604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d974a603-be47-4bdf-9b88-454fe6364191 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:48.904047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d974a603-be47-4bdf-9b88-454fe6364191 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:48.915151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d974a603-be47-4bdf-9b88-454fe6364191 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:48.916295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d974a603-be47-4bdf-9b88-454fe6364191 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:48.916771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d974a603-be47-4bdf-9b88-454fe6364191 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:49.231671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78d1147a-8b1d-47eb-996c-87c3c7356868 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:49.231671 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-78d1147a-8b1d-47eb-996c-87c3c7356868 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1315 microversion: 2.1 time: 1.240937 Sep 10 10:58:49.231671 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 878/4108] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:47 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1315 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:49.644517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d974a603-be47-4bdf-9b88-454fe6364191 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:49.654953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:49.660393 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d974a603-be47-4bdf-9b88-454fe6364191 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.773148 Sep 10 10:58:49.691496 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3231/4109] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:48 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:50.002544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-5efb298a-ef51-44d4-9835-011d293428fd req-ec80dda0-630b-4ab9-b2d3-697b235c7a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5", "tag": "a0a753a6-3549-4491-804b-3c73b6279e7e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:50.064192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5efb298a-ef51-44d4-9835-011d293428fd req-ec80dda0-630b-4ab9-b2d3-697b235c7a41 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:50.064687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5efb298a-ef51-44d4-9835-011d293428fd req-ec80dda0-630b-4ab9-b2d3-697b235c7a41 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:50.065139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5efb298a-ef51-44d4-9835-011d293428fd req-ec80dda0-630b-4ab9-b2d3-697b235c7a41 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:50.095524 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-5efb298a-ef51-44d4-9835-011d293428fd req-ec80dda0-630b-4ab9-b2d3-697b235c7a41 service nova] Creating event network-changed:a0a753a6-3549-4491-804b-3c73b6279e7e for instance cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 on n-h2-856894-1 Sep 10 10:58:50.108509 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-5efb298a-ef51-44d4-9835-011d293428fd req-ec80dda0-630b-4ab9-b2d3-697b235c7a41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111770 Sep 10 10:58:50.122189 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 879/4110] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:58:50.187169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-67a9a5c1-3209-4a71-82fe-d8e77cab8e22 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:50.192816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-67a9a5c1-3209-4a71-82fe-d8e77cab8e22 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:50.203954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=34 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:50.207684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a9a5c1-3209-4a71-82fe-d8e77cab8e22 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:50.208507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a9a5c1-3209-4a71-82fe-d8e77cab8e22 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:50.209236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a9a5c1-3209-4a71-82fe-d8e77cab8e22 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:50.211094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a9a5c1-3209-4a71-82fe-d8e77cab8e22 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:50.211904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a9a5c1-3209-4a71-82fe-d8e77cab8e22 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:50.212529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-67a9a5c1-3209-4a71-82fe-d8e77cab8e22 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:50.697916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:58:50.715926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a8fd35e6-bff7-449a-8559-d2e9a6df35b1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:50.716798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a8fd35e6-bff7-449a-8559-d2e9a6df35b1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:50.747818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8fd35e6-bff7-449a-8559-d2e9a6df35b1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:50.749628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8fd35e6-bff7-449a-8559-d2e9a6df35b1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:50.750250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8fd35e6-bff7-449a-8559-d2e9a6df35b1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:50.751199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8fd35e6-bff7-449a-8559-d2e9a6df35b1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:50.751889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8fd35e6-bff7-449a-8559-d2e9a6df35b1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:50.752486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8fd35e6-bff7-449a-8559-d2e9a6df35b1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:51.329798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-67a9a5c1-3209-4a71-82fe-d8e77cab8e22 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:51.347186 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-67a9a5c1-3209-4a71-82fe-d8e77cab8e22 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1315 microversion: 2.1 time: 1.168454 Sep 10 10:58:51.347974 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3232/4111] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:50 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1315 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:51.771748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a8fd35e6-bff7-449a-8559-d2e9a6df35b1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:51.794663 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a8fd35e6-bff7-449a-8559-d2e9a6df35b1 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 1.098309 Sep 10 10:58:51.795865 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 880/4112] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:50 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:52.376666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23042934-4919-4796-9ec6-9a6207ac0a83 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:52.377508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23042934-4919-4796-9ec6-9a6207ac0a83 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:52.392501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23042934-4919-4796-9ec6-9a6207ac0a83 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:52.403679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23042934-4919-4796-9ec6-9a6207ac0a83 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:52.404379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23042934-4919-4796-9ec6-9a6207ac0a83 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:52.406102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23042934-4919-4796-9ec6-9a6207ac0a83 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:52.414839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23042934-4919-4796-9ec6-9a6207ac0a83 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:52.417745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23042934-4919-4796-9ec6-9a6207ac0a83 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:52.823700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-13826bcc-b6d7-4eda-8ef4-d4ae485021b9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:52.824461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-13826bcc-b6d7-4eda-8ef4-d4ae485021b9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:52.838912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13826bcc-b6d7-4eda-8ef4-d4ae485021b9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:52.848464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13826bcc-b6d7-4eda-8ef4-d4ae485021b9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:52.859468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13826bcc-b6d7-4eda-8ef4-d4ae485021b9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:52.875415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13826bcc-b6d7-4eda-8ef4-d4ae485021b9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:52.876355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13826bcc-b6d7-4eda-8ef4-d4ae485021b9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:52.894891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13826bcc-b6d7-4eda-8ef4-d4ae485021b9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:52.999475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23042934-4919-4796-9ec6-9a6207ac0a83 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:53.023675 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23042934-4919-4796-9ec6-9a6207ac0a83 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1315 microversion: 2.1 time: 0.651762 Sep 10 10:58:53.045524 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3233/4113] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:52 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:53.520202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-13826bcc-b6d7-4eda-8ef4-d4ae485021b9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:53.529703 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-13826bcc-b6d7-4eda-8ef4-d4ae485021b9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.710589 Sep 10 10:58:53.569941 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 881/4114] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:52 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:53.906991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7f9cee48-1e62-4518-872c-1724a0b3afcf tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Calling method '.version_select at 0x7efcad47e280>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:53.984900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-7f9cee48-1e62-4518-872c-1724a0b3afcf tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 18a07b61-bff3-432b-bae0-8ec8b7fb7480 does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:58:53.985593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-7f9cee48-1e62-4518-872c-1724a0b3afcf tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Neutron security group 18a07b61-bff3-432b-bae0-8ec8b7fb7480 not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:58:53.986181 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-7f9cee48-1e62-4518-872c-1724a0b3afcf tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] HTTP exception thrown: Security group 18a07b61-bff3-432b-bae0-8ec8b7fb7480 does not exist Sep 10 10:58:53.986181 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-ecb0333b-f30a-4385-9e30-9889b61122e3'] Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7f9cee48-1e62-4518-872c-1724a0b3afcf tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Request method failure captured: Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/18a07b61-bff3-432b-bae0-8ec8b7fb7480 HTTP/1.1 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG3tM_iETWRZF0KdexoIM0oRnqHonlbEHruVVi95ebTc6g-883Fuq7JbNwwr_6Fmw02YkVOwvNnntA5SSB_fFOI2mNp7gu2HP2DxPs6AzrcRooMzi96Qs8M4PnJAu0ahWtGbLnshkpVV-VQPPXOsZ1OV0YxSRGCzspsrxjLRAAv9Gso Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 393b778b42f7479dac04c72a2447e610 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/393b778b42f7479dac04c72a2447e610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/393b778b42f7479dac04c72a2447e610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/393b778b42f7479dac04c72a2447e610"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_393b778b42f7479dac04c72a2447e610", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 393b778b42f7479dac04c72a2447e610 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsNegativeTestJSON-1585921263-project Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 6577fac1caef4bd8a39b403573457974 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263-project Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 18a07b61-bff3-432b-bae0-8ec8b7fb7480 does not exist Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-ecb0333b-f30a-4385-9e30-9889b61122e3'] Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '18a07b61-bff3-432b-bae0-8ec8b7fb7480'} Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:58:53.991439 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 18a07b61-bff3-432b-bae0-8ec8b7fb7480 does not exist Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecb0333b-f30a-4385-9e30-9889b61122e3'] Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 18a07b61-bff3-432b-bae0-8ec8b7fb7480 does not exist Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecb0333b-f30a-4385-9e30-9889b61122e3'] Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 18a07b61-bff3-432b-bae0-8ec8b7fb7480 does not exist Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecb0333b-f30a-4385-9e30-9889b61122e3'] Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 18a07b61-bff3-432b-bae0-8ec8b7fb7480 does not exist Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecb0333b-f30a-4385-9e30-9889b61122e3'] Sep 10 10:58:53.996736 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:54.002756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7f9cee48-1e62-4518-872c-1724a0b3afcf tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Returning 404 to user: Security group 18a07b61-bff3-432b-bae0-8ec8b7fb7480 does not exist Sep 10 10:58:54.002756 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-ecb0333b-f30a-4385-9e30-9889b61122e3'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:54.002756 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7f9cee48-1e62-4518-872c-1724a0b3afcf tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/18a07b61-bff3-432b-bae0-8ec8b7fb7480" status: 404 len: 194 microversion: 2.1 time: 0.234382 Sep 10 10:58:54.002756 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3234/4115] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:58:53 2022] DELETE /compute/v2.1/os-security-groups/18a07b61-bff3-432b-bae0-8ec8b7fb7480 => generated 194 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:58:54.012465 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-16c83c16-3aa7-4de0-8692-89a8622335e4 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004208 Sep 10 10:58:54.014005 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 882/4116] 10.222.0.20 () {58 vars in 1164 bytes} [Sat Sep 10 10:58:54 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 10:58:54.034129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bdbd23ff-5e61-4b7e-94fe-cb752bca01ad tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Calling method '.version_select at 0x7efcad405ee0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:54.059481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0ef1c7e2-7913-4318-9114-4e41254d8c95 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:54.060297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0ef1c7e2-7913-4318-9114-4e41254d8c95 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:54.070588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ef1c7e2-7913-4318-9114-4e41254d8c95 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:54.105166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ef1c7e2-7913-4318-9114-4e41254d8c95 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:54.106395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ef1c7e2-7913-4318-9114-4e41254d8c95 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:54.109512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ef1c7e2-7913-4318-9114-4e41254d8c95 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:54.113622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ef1c7e2-7913-4318-9114-4e41254d8c95 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:54.114868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ef1c7e2-7913-4318-9114-4e41254d8c95 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:54.906443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0ef1c7e2-7913-4318-9114-4e41254d8c95 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:54.917657 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0ef1c7e2-7913-4318-9114-4e41254d8c95 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1315 microversion: 2.1 time: 0.864751 Sep 10 10:58:54.918268 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 883/4117] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:54 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1315 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:54.962704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4ec5d676-835a-4412-8d68-c7e4ea292cbb tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:54.964484 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bdbd23ff-5e61-4b7e-94fe-cb752bca01ad tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.942486 Sep 10 10:58:54.973883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4ec5d676-835a-4412-8d68-c7e4ea292cbb tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:54.974163 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3235/4118] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 10:58:54 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:58:54.981151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ec5d676-835a-4412-8d68-c7e4ea292cbb tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:54.983571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ec5d676-835a-4412-8d68-c7e4ea292cbb tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:54.984059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ec5d676-835a-4412-8d68-c7e4ea292cbb tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:54.984835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ec5d676-835a-4412-8d68-c7e4ea292cbb tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:54.994884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ec5d676-835a-4412-8d68-c7e4ea292cbb tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:54.995680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ec5d676-835a-4412-8d68-c7e4ea292cbb tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:55.035710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad55b7c2-497d-4dd1-baf0-9323ec4f0390 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Calling method '.version_select at 0x7efcad401f70>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:55.412889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4ec5d676-835a-4412-8d68-c7e4ea292cbb tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:55.426353 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4ec5d676-835a-4412-8d68-c7e4ea292cbb tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1527 microversion: 2.1 time: 0.473717 Sep 10 10:58:55.429255 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 884/4119] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:54 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1527 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:55.445371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-ad55b7c2-497d-4dd1-baf0-9323ec4f0390 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:58:55.446107 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-ad55b7c2-497d-4dd1-baf0-9323ec4f0390 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 10 10:58:55.446107 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-cecbe4af-60c1-41a6-822c-b29317395744'] Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad55b7c2-497d-4dd1-baf0-9323ec4f0390 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Request method failure captured: Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/os-security-groups/b7a1b9b8-4174-42b5-a282-6e1874bc9372 HTTP/1.1 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG3tM_iETWRZF0KdexoIM0oRnqHonlbEHruVVi95ebTc6g-883Fuq7JbNwwr_6Fmw02YkVOwvNnntA5SSB_fFOI2mNp7gu2HP2DxPs6AzrcRooMzi96Qs8M4PnJAu0ahWtGbLnshkpVV-VQPPXOsZ1OV0YxSRGCzspsrxjLRAAv9Gso Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 393b778b42f7479dac04c72a2447e610 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/393b778b42f7479dac04c72a2447e610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/393b778b42f7479dac04c72a2447e610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/393b778b42f7479dac04c72a2447e610"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_393b778b42f7479dac04c72a2447e610", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 393b778b42f7479dac04c72a2447e610 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsNegativeTestJSON-1585921263-project Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 6577fac1caef4bd8a39b403573457974 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263-project Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: exception: Insufficient rights for removing default security group. Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-cecbe4af-60c1-41a6-822c-b29317395744'] Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'b7a1b9b8-4174-42b5-a282-6e1874bc9372'} Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:58:55.448005 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cecbe4af-60c1-41a6-822c-b29317395744'] Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cecbe4af-60c1-41a6-822c-b29317395744'] Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cecbe4af-60c1-41a6-822c-b29317395744'] Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cecbe4af-60c1-41a6-822c-b29317395744'] Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad55b7c2-497d-4dd1-baf0-9323ec4f0390 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-cecbe4af-60c1-41a6-822c-b29317395744'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:55.452252 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad55b7c2-497d-4dd1-baf0-9323ec4f0390 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b7a1b9b8-4174-42b5-a282-6e1874bc9372" status: 400 len: 182 microversion: 2.1 time: 0.456711 Sep 10 10:58:55.457103 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3236/4120] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 10:58:54 2022] DELETE /compute/v2.1/os-security-groups/b7a1b9b8-4174-42b5-a282-6e1874bc9372 => generated 182 bytes in 480 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 10:58:55.462685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4a63e070-2433-4b60-a74e-5f69af6afbb2 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Calling method '.version_select at 0x7efcaf3074c0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:55.519434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG neutronclient.v2_0.client [None req-4a63e070-2433-4b60-a74e-5f69af6afbb2 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8d8a038-fb66-4d89-83ac-55190fe0594f does not exist", "detail": ""}} {{(pid=128787) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:58:55.520561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.security_group_api [None req-4a63e070-2433-4b60-a74e-5f69af6afbb2 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Neutron security group d8d8a038-fb66-4d89-83ac-55190fe0594f not found {{(pid=128787) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:58:55.521362 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-4a63e070-2433-4b60-a74e-5f69af6afbb2 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] HTTP exception thrown: Security group d8d8a038-fb66-4d89-83ac-55190fe0594f does not exist Sep 10 10:58:55.521362 n-d-856894-1 devstack@n-api.service[128787]: Neutron server returns request_ids: ['req-1e96e28c-b7a0-474e-9c8b-903dab318fad'] Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4a63e070-2433-4b60-a74e-5f69af6afbb2 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Request method failure captured: Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/os-security-groups/d8d8a038-fb66-4d89-83ac-55190fe0594f HTTP/1.1 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG3tM_iETWRZF0KdexoIM0oRnqHonlbEHruVVi95ebTc6g-883Fuq7JbNwwr_6Fmw02YkVOwvNnntA5SSB_fFOI2mNp7gu2HP2DxPs6AzrcRooMzi96Qs8M4PnJAu0ahWtGbLnshkpVV-VQPPXOsZ1OV0YxSRGCzspsrxjLRAAv9Gso Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 393b778b42f7479dac04c72a2447e610 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/393b778b42f7479dac04c72a2447e610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/393b778b42f7479dac04c72a2447e610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/393b778b42f7479dac04c72a2447e610"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_393b778b42f7479dac04c72a2447e610", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 393b778b42f7479dac04c72a2447e610 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-SecurityGroupsNegativeTestJSON-1585921263-project Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 6577fac1caef4bd8a39b403573457974 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263-project Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: exception: Security group d8d8a038-fb66-4d89-83ac-55190fe0594f does not exist Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: Neutron server returns request_ids: ['req-1e96e28c-b7a0-474e-9c8b-903dab318fad'] Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'd8d8a038-fb66-4d89-83ac-55190fe0594f'} Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:58:55.524960 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8d8a038-fb66-4d89-83ac-55190fe0594f does not exist Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e96e28c-b7a0-474e-9c8b-903dab318fad'] Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8d8a038-fb66-4d89-83ac-55190fe0594f does not exist Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e96e28c-b7a0-474e-9c8b-903dab318fad'] Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8d8a038-fb66-4d89-83ac-55190fe0594f does not exist Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e96e28c-b7a0-474e-9c8b-903dab318fad'] Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8d8a038-fb66-4d89-83ac-55190fe0594f does not exist Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e96e28c-b7a0-474e-9c8b-903dab318fad'] Sep 10 10:58:55.529716 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.535510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4a63e070-2433-4b60-a74e-5f69af6afbb2 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Returning 404 to user: Security group d8d8a038-fb66-4d89-83ac-55190fe0594f does not exist Sep 10 10:58:55.535510 n-d-856894-1 devstack@n-api.service[128787]: Neutron server returns request_ids: ['req-1e96e28c-b7a0-474e-9c8b-903dab318fad'] {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:55.537812 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4a63e070-2433-4b60-a74e-5f69af6afbb2 tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/d8d8a038-fb66-4d89-83ac-55190fe0594f" status: 404 len: 194 microversion: 2.1 time: 0.079822 Sep 10 10:58:55.540621 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 885/4121] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 10:58:55 2022] GET /compute/v2.1/os-security-groups/d8d8a038-fb66-4d89-83ac-55190fe0594f => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:58:55.551151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1496e5b9-3da5-4b79-8f87-3951e4240e4f tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Action: 'update', calling method: .version_select at 0x7efcad3b5430>, body: {"security_group": {"name": "tempest-sg-86276425", "description": "tempest-description-1828473130"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:55.607230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG neutronclient.v2_0.client [None req-1496e5b9-3da5-4b79-8f87-3951e4240e4f tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0bf38a49-d4e9-4460-a510-b48ac3a8525a does not exist", "detail": ""}} {{(pid=128788) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 10:58:55.607847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.security_group_api [None req-1496e5b9-3da5-4b79-8f87-3951e4240e4f tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Neutron security group 0bf38a49-d4e9-4460-a510-b48ac3a8525a not found {{(pid=128788) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 10:58:55.608375 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-1496e5b9-3da5-4b79-8f87-3951e4240e4f tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] HTTP exception thrown: Security group 0bf38a49-d4e9-4460-a510-b48ac3a8525a does not exist Sep 10 10:58:55.608375 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-acfce7d3-1bc4-468a-aec9-4a2285e8e3b5'] Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1496e5b9-3da5-4b79-8f87-3951e4240e4f tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Request method failure captured: Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: request: PUT /compute/v2.1/os-security-groups/0bf38a49-d4e9-4460-a510-b48ac3a8525a HTTP/1.1 Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 100 Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG3tM_iETWRZF0KdexoIM0oRnqHonlbEHruVVi95ebTc6g-883Fuq7JbNwwr_6Fmw02YkVOwvNnntA5SSB_fFOI2mNp7gu2HP2DxPs6AzrcRooMzi96Qs8M4PnJAu0ahWtGbLnshkpVV-VQPPXOsZ1OV0YxSRGCzspsrxjLRAAv9Gso Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 393b778b42f7479dac04c72a2447e610 Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/393b778b42f7479dac04c72a2447e610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/393b778b42f7479dac04c72a2447e610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/393b778b42f7479dac04c72a2447e610"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_393b778b42f7479dac04c72a2447e610", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 393b778b42f7479dac04c72a2447e610 Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263 Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-SecurityGroupsNegativeTestJSON-1585921263-project Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 6577fac1caef4bd8a39b403573457974 Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1585921263-project Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: {"security_group": {"name": "tempest-sg-86276425", "description": "tempest-description-1828473130"}} Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: exception: Security group 0bf38a49-d4e9-4460-a510-b48ac3a8525a does not exist Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-acfce7d3-1bc4-468a-aec9-4a2285e8e3b5'] Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '0bf38a49-d4e9-4460-a510-b48ac3a8525a', 'body': {'security_group': {'name': 'tempest-sg-86276425', 'description': 'tempest-description-1828473130'}}} Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 10:58:55.611303 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0bf38a49-d4e9-4460-a510-b48ac3a8525a does not exist Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acfce7d3-1bc4-468a-aec9-4a2285e8e3b5'] Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0bf38a49-d4e9-4460-a510-b48ac3a8525a does not exist Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acfce7d3-1bc4-468a-aec9-4a2285e8e3b5'] Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0bf38a49-d4e9-4460-a510-b48ac3a8525a does not exist Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acfce7d3-1bc4-468a-aec9-4a2285e8e3b5'] Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0bf38a49-d4e9-4460-a510-b48ac3a8525a does not exist Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acfce7d3-1bc4-468a-aec9-4a2285e8e3b5'] Sep 10 10:58:55.616125 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:58:55.620569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1496e5b9-3da5-4b79-8f87-3951e4240e4f tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] Returning 404 to user: Security group 0bf38a49-d4e9-4460-a510-b48ac3a8525a does not exist Sep 10 10:58:55.620569 n-d-856894-1 devstack@n-api.service[128788]: Neutron server returns request_ids: ['req-acfce7d3-1bc4-468a-aec9-4a2285e8e3b5'] {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:58:55.623214 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1496e5b9-3da5-4b79-8f87-3951e4240e4f tempest-SecurityGroupsNegativeTestJSON-1585921263 tempest-SecurityGroupsNegativeTestJSON-1585921263-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/0bf38a49-d4e9-4460-a510-b48ac3a8525a" status: 404 len: 194 microversion: 2.1 time: 0.076947 Sep 10 10:58:55.629400 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3237/4122] 10.222.0.20 () {60 vars in 1290 bytes} [Sat Sep 10 10:58:55 2022] PUT /compute/v2.1/os-security-groups/0bf38a49-d4e9-4460-a510-b48ac3a8525a => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:58:55.944082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-86a91723-20f5-40ac-9c8a-3969bd7c7d08 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:55.944707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-86a91723-20f5-40ac-9c8a-3969bd7c7d08 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:55.953986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86a91723-20f5-40ac-9c8a-3969bd7c7d08 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:55.954487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86a91723-20f5-40ac-9c8a-3969bd7c7d08 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:55.954937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86a91723-20f5-40ac-9c8a-3969bd7c7d08 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:55.955647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86a91723-20f5-40ac-9c8a-3969bd7c7d08 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:55.956105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86a91723-20f5-40ac-9c8a-3969bd7c7d08 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:55.956528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86a91723-20f5-40ac-9c8a-3969bd7c7d08 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:56.452867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-144aef32-1e14-45d3-9114-2536f4e54a71 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:56.453745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-144aef32-1e14-45d3-9114-2536f4e54a71 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:56.471277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144aef32-1e14-45d3-9114-2536f4e54a71 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:56.477906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144aef32-1e14-45d3-9114-2536f4e54a71 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:56.478573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144aef32-1e14-45d3-9114-2536f4e54a71 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:56.480686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144aef32-1e14-45d3-9114-2536f4e54a71 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:56.495447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144aef32-1e14-45d3-9114-2536f4e54a71 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:56.497507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-144aef32-1e14-45d3-9114-2536f4e54a71 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:56.568046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-86a91723-20f5-40ac-9c8a-3969bd7c7d08 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:56.584962 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-86a91723-20f5-40ac-9c8a-3969bd7c7d08 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1315 microversion: 2.1 time: 0.647012 Sep 10 10:58:56.593690 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 886/4123] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:55 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:56.974566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-144aef32-1e14-45d3-9114-2536f4e54a71 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:57.005866 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-144aef32-1e14-45d3-9114-2536f4e54a71 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1509 microversion: 2.1 time: 0.545804 Sep 10 10:58:57.007051 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3238/4124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:56 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1509 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:58:57.624700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0f0ae637-b6ac-4a76-a441-42dd8d8b69e1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:57.625373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0f0ae637-b6ac-4a76-a441-42dd8d8b69e1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:57.637762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f0ae637-b6ac-4a76-a441-42dd8d8b69e1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:57.639355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f0ae637-b6ac-4a76-a441-42dd8d8b69e1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:57.640743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f0ae637-b6ac-4a76-a441-42dd8d8b69e1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:57.642597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f0ae637-b6ac-4a76-a441-42dd8d8b69e1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:57.644417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f0ae637-b6ac-4a76-a441-42dd8d8b69e1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:57.645044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f0ae637-b6ac-4a76-a441-42dd8d8b69e1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:57.851525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0f0ae637-b6ac-4a76-a441-42dd8d8b69e1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:57.864761 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0f0ae637-b6ac-4a76-a441-42dd8d8b69e1 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1315 microversion: 2.1 time: 0.245720 Sep 10 10:58:57.866844 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 887/4125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:57 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:57.912187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6cb8f97b-9558-4ac7-9ed9-28f40d26c0ef req-b3ab649c-f9ef-4a39-a70c-5354fa6e2f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1fff5af-b5bc-4a39-a5a3-81c17a2b397b", "name": "network-vif-unplugged", "status": "completed", "tag": "fdf28f35-cdeb-4bbe-a940-e39781700167"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:58:57.930571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6cb8f97b-9558-4ac7-9ed9-28f40d26c0ef req-b3ab649c-f9ef-4a39-a70c-5354fa6e2f89 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:57.931843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6cb8f97b-9558-4ac7-9ed9-28f40d26c0ef req-b3ab649c-f9ef-4a39-a70c-5354fa6e2f89 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:57.932489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6cb8f97b-9558-4ac7-9ed9-28f40d26c0ef req-b3ab649c-f9ef-4a39-a70c-5354fa6e2f89 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:57.977304 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6cb8f97b-9558-4ac7-9ed9-28f40d26c0ef req-b3ab649c-f9ef-4a39-a70c-5354fa6e2f89 service nova] Creating event network-vif-unplugged:fdf28f35-cdeb-4bbe-a940-e39781700167 for instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b on n-h2-856894-1 Sep 10 10:58:57.992438 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6cb8f97b-9558-4ac7-9ed9-28f40d26c0ef req-b3ab649c-f9ef-4a39-a70c-5354fa6e2f89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086986 Sep 10 10:58:57.994261 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3239/4126] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:58:58.031935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b70bca73-60f5-4f91-9791-2c47abd860ed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:58.033537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b70bca73-60f5-4f91-9791-2c47abd860ed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:58.051428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b70bca73-60f5-4f91-9791-2c47abd860ed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:58.052678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b70bca73-60f5-4f91-9791-2c47abd860ed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:58.053346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b70bca73-60f5-4f91-9791-2c47abd860ed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:58.054767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b70bca73-60f5-4f91-9791-2c47abd860ed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:58.055239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b70bca73-60f5-4f91-9791-2c47abd860ed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:58.055666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b70bca73-60f5-4f91-9791-2c47abd860ed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:58.890499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d50d09b4-cc6f-4c40-9681-e1cc4a2cce31 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:58:58.891256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d50d09b4-cc6f-4c40-9681-e1cc4a2cce31 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:58:58.912755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d50d09b4-cc6f-4c40-9681-e1cc4a2cce31 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:58.914534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d50d09b4-cc6f-4c40-9681-e1cc4a2cce31 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:58.917109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d50d09b4-cc6f-4c40-9681-e1cc4a2cce31 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:58.919901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d50d09b4-cc6f-4c40-9681-e1cc4a2cce31 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:58:58.921437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d50d09b4-cc6f-4c40-9681-e1cc4a2cce31 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:58:58.922845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d50d09b4-cc6f-4c40-9681-e1cc4a2cce31 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:58:59.401948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d50d09b4-cc6f-4c40-9681-e1cc4a2cce31 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:59.415496 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d50d09b4-cc6f-4c40-9681-e1cc4a2cce31 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1315 microversion: 2.1 time: 0.530458 Sep 10 10:58:59.437160 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3240/4127] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:58 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:58:59.488564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b70bca73-60f5-4f91-9791-2c47abd860ed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:58:59.523074 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b70bca73-60f5-4f91-9791-2c47abd860ed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1509 microversion: 2.1 time: 1.491809 Sep 10 10:58:59.524392 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 888/4128] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:58:58 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1509 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:00.021936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b89cb6f7-d70e-49cd-b7f3-170c5670447a req-4eab76c8-17ce-48dd-a7db-1ef5ddda24f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5", "name": "network-vif-plugged", "status": "completed", "tag": "a0a753a6-3549-4491-804b-3c73b6279e7e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:00.041476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b89cb6f7-d70e-49cd-b7f3-170c5670447a req-4eab76c8-17ce-48dd-a7db-1ef5ddda24f2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:00.041963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b89cb6f7-d70e-49cd-b7f3-170c5670447a req-4eab76c8-17ce-48dd-a7db-1ef5ddda24f2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:00.042398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b89cb6f7-d70e-49cd-b7f3-170c5670447a req-4eab76c8-17ce-48dd-a7db-1ef5ddda24f2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:00.063446 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b89cb6f7-d70e-49cd-b7f3-170c5670447a req-4eab76c8-17ce-48dd-a7db-1ef5ddda24f2 service nova] Creating event network-vif-plugged:a0a753a6-3549-4491-804b-3c73b6279e7e for instance cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 on n-h2-856894-1 Sep 10 10:59:00.073278 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b89cb6f7-d70e-49cd-b7f3-170c5670447a req-4eab76c8-17ce-48dd-a7db-1ef5ddda24f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052217 Sep 10 10:59:00.077048 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3241/4129] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:59:00.464898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-938f295d-143e-4693-8a90-c5c4ffe79023 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:00.465717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-938f295d-143e-4693-8a90-c5c4ffe79023 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:00.479499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:00.494280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-938f295d-143e-4693-8a90-c5c4ffe79023 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:00.495524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-938f295d-143e-4693-8a90-c5c4ffe79023 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:00.496698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-938f295d-143e-4693-8a90-c5c4ffe79023 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:00.497655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-938f295d-143e-4693-8a90-c5c4ffe79023 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:00.498304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-938f295d-143e-4693-8a90-c5c4ffe79023 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:00.498925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-938f295d-143e-4693-8a90-c5c4ffe79023 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:00.550662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-706ea61f-7825-4e32-a3f5-50a9d890aaaf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:00.552109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-706ea61f-7825-4e32-a3f5-50a9d890aaaf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:00.564718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706ea61f-7825-4e32-a3f5-50a9d890aaaf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:00.581179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706ea61f-7825-4e32-a3f5-50a9d890aaaf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:00.582172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706ea61f-7825-4e32-a3f5-50a9d890aaaf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:00.588244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706ea61f-7825-4e32-a3f5-50a9d890aaaf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:00.589740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706ea61f-7825-4e32-a3f5-50a9d890aaaf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:00.591023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-706ea61f-7825-4e32-a3f5-50a9d890aaaf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:00.890505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-938f295d-143e-4693-8a90-c5c4ffe79023 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:00.894423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:00.908397 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-938f295d-143e-4693-8a90-c5c4ffe79023 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1315 microversion: 2.1 time: 0.447637 Sep 10 10:59:00.910617 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 889/4130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:00 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:01.000903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-706ea61f-7825-4e32-a3f5-50a9d890aaaf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:01.012645 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-706ea61f-7825-4e32-a3f5-50a9d890aaaf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1452 microversion: 2.1 time: 0.466391 Sep 10 10:59:01.015416 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3242/4131] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:00 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1452 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:01.039982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cd72bef4-1639-4cb4-bd2e-cb1090efb6da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:01.042462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cd72bef4-1639-4cb4-bd2e-cb1090efb6da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:01.080277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd72bef4-1639-4cb4-bd2e-cb1090efb6da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:01.082866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd72bef4-1639-4cb4-bd2e-cb1090efb6da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:01.083421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd72bef4-1639-4cb4-bd2e-cb1090efb6da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:01.085244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd72bef4-1639-4cb4-bd2e-cb1090efb6da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:01.088384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd72bef4-1639-4cb4-bd2e-cb1090efb6da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:01.090456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd72bef4-1639-4cb4-bd2e-cb1090efb6da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:01.734473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cd72bef4-1639-4cb4-bd2e-cb1090efb6da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:01.751930 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cd72bef4-1639-4cb4-bd2e-cb1090efb6da tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1452 microversion: 2.1 time: 0.717405 Sep 10 10:59:01.753391 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 890/4132] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:01 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1452 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:59:01.817897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:01.819664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:01.834478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:01.839578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:01.840367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:01.841253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:01.842208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:01.842880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:01.843520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:01.848461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=78 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:01.935083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e0a72ab-6414-4454-8cf0-1a63e23e2e23 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:01.935810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3e0a72ab-6414-4454-8cf0-1a63e23e2e23 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:01.943110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e0a72ab-6414-4454-8cf0-1a63e23e2e23 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:01.947504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lazy-loading 'flavor' on Instance uuid f1fff5af-b5bc-4a39-a5a3-81c17a2b397b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:59:01.948294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e0a72ab-6414-4454-8cf0-1a63e23e2e23 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:01.948958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e0a72ab-6414-4454-8cf0-1a63e23e2e23 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:01.949929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e0a72ab-6414-4454-8cf0-1a63e23e2e23 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:01.950595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e0a72ab-6414-4454-8cf0-1a63e23e2e23 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:01.951228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e0a72ab-6414-4454-8cf0-1a63e23e2e23 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:01.974509 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Cannot 'shelve' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state shelved_offloaded Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action HTTP/1.1 Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 14 Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: {"shelve": {}} Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'shelve' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state shelved_offloaded Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f1fff5af-b5bc-4a39-a5a3-81c17a2b397b', 'body': {'shelve': {}}} Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:59:01.977302 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state shelved_offloaded Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state shelved_offloaded Sep 10 10:59:01.983016 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:01.985962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 409 to user: Cannot 'shelve' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state shelved_offloaded {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:59:01.989214 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-502d310f-8265-4767-bf5c-f30b4715de90 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 409 len: 155 microversion: 2.1 time: 0.175375 Sep 10 10:59:01.990431 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3243/4133] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:59:01 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 155 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 10:59:02.000300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9df8ed9d-2b16-462b-a47b-956b6ed88f36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:02.001196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9df8ed9d-2b16-462b-a47b-956b6ed88f36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:02.010857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9df8ed9d-2b16-462b-a47b-956b6ed88f36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:02.011916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9df8ed9d-2b16-462b-a47b-956b6ed88f36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:02.012624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9df8ed9d-2b16-462b-a47b-956b6ed88f36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:02.013771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9df8ed9d-2b16-462b-a47b-956b6ed88f36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:02.014724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9df8ed9d-2b16-462b-a47b-956b6ed88f36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:02.015630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9df8ed9d-2b16-462b-a47b-956b6ed88f36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:02.091204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9df8ed9d-2b16-462b-a47b-956b6ed88f36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128788) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 10:59:02.235389 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9df8ed9d-2b16-462b-a47b-956b6ed88f36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 202 len: 0 microversion: 2.1 time: 0.240080 Sep 10 10:59:02.236345 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3244/4134] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:59:01 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:59:02.249635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-978f3cac-ad26-4838-9c30-4160147ed5fa tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:02.251809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-978f3cac-ad26-4838-9c30-4160147ed5fa tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:02.271051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-978f3cac-ad26-4838-9c30-4160147ed5fa tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:02.271051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-978f3cac-ad26-4838-9c30-4160147ed5fa tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:02.271051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-978f3cac-ad26-4838-9c30-4160147ed5fa tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:02.271488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-978f3cac-ad26-4838-9c30-4160147ed5fa tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:02.271632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-978f3cac-ad26-4838-9c30-4160147ed5fa tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:02.276151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-978f3cac-ad26-4838-9c30-4160147ed5fa tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:02.692955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3e0a72ab-6414-4454-8cf0-1a63e23e2e23 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:02.715192 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3e0a72ab-6414-4454-8cf0-1a63e23e2e23 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1504 microversion: 2.1 time: 0.783467 Sep 10 10:59:02.715800 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 891/4135] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:01 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1504 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:59:02.753712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-913fa6b2-50ea-4f75-89dd-eecf9f7988c4 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:02.755291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-913fa6b2-50ea-4f75-89dd-eecf9f7988c4 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:02.783568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-913fa6b2-50ea-4f75-89dd-eecf9f7988c4 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:02.787142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-913fa6b2-50ea-4f75-89dd-eecf9f7988c4 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:02.787656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-913fa6b2-50ea-4f75-89dd-eecf9f7988c4 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:02.788405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-913fa6b2-50ea-4f75-89dd-eecf9f7988c4 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:02.788862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-913fa6b2-50ea-4f75-89dd-eecf9f7988c4 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:02.789313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-913fa6b2-50ea-4f75-89dd-eecf9f7988c4 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:02.864169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-978f3cac-ad26-4838-9c30-4160147ed5fa tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:02.873133 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-978f3cac-ad26-4838-9c30-4160147ed5fa tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1460 microversion: 2.1 time: 0.632620 Sep 10 10:59:02.903672 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3245/4136] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:02 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1460 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:03.065705 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-913fa6b2-50ea-4f75-89dd-eecf9f7988c4 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.331153 Sep 10 10:59:03.068487 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 892/4137] 10.222.0.20 () {58 vars in 1296 bytes} [Sat Sep 10 10:59:02 2022] DELETE /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5/os-server-password => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 10:59:03.086813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be5123cb-05fc-4c21-82df-a658fedb0544 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:03.088882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be5123cb-05fc-4c21-82df-a658fedb0544 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:03.106341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be5123cb-05fc-4c21-82df-a658fedb0544 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:03.108056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be5123cb-05fc-4c21-82df-a658fedb0544 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:03.109473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be5123cb-05fc-4c21-82df-a658fedb0544 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:03.110474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be5123cb-05fc-4c21-82df-a658fedb0544 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:03.111749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be5123cb-05fc-4c21-82df-a658fedb0544 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:03.126306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be5123cb-05fc-4c21-82df-a658fedb0544 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:03.929432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b76b1c8f-d2c2-480b-af83-bd98782aeeb9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:03.933586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b76b1c8f-d2c2-480b-af83-bd98782aeeb9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:03.951458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b76b1c8f-d2c2-480b-af83-bd98782aeeb9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:03.974526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b76b1c8f-d2c2-480b-af83-bd98782aeeb9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:03.983673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b76b1c8f-d2c2-480b-af83-bd98782aeeb9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:03.990168 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be5123cb-05fc-4c21-82df-a658fedb0544 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.912522 Sep 10 10:59:03.990168 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3246/4138] 10.222.0.20 () {58 vars in 1293 bytes} [Sat Sep 10 10:59:03 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5/os-server-password => generated 16 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 10:59:03.990758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b76b1c8f-d2c2-480b-af83-bd98782aeeb9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:03.990758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b76b1c8f-d2c2-480b-af83-bd98782aeeb9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:03.990758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b76b1c8f-d2c2-480b-af83-bd98782aeeb9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:04.037547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa910ff5-8acd-4ab1-8e5b-8575494282b5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:04.038457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa910ff5-8acd-4ab1-8e5b-8575494282b5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:04.067003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa910ff5-8acd-4ab1-8e5b-8575494282b5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:04.067504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa910ff5-8acd-4ab1-8e5b-8575494282b5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:04.067945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa910ff5-8acd-4ab1-8e5b-8575494282b5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:04.068647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa910ff5-8acd-4ab1-8e5b-8575494282b5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:04.073582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa910ff5-8acd-4ab1-8e5b-8575494282b5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:04.073955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa910ff5-8acd-4ab1-8e5b-8575494282b5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:04.160154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa910ff5-8acd-4ab1-8e5b-8575494282b5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:59:04.342944 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fa910ff5-8acd-4ab1-8e5b-8575494282b5 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 204 len: 0 microversion: 2.1 time: 0.348303 Sep 10 10:59:04.344824 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3247/4139] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 10:59:03 2022] DELETE /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 10:59:04.357457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e7e068c-5bf4-4127-b4ca-e3ec84c133f2 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:04.362033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e7e068c-5bf4-4127-b4ca-e3ec84c133f2 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:04.372399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e7e068c-5bf4-4127-b4ca-e3ec84c133f2 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:04.385656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e7e068c-5bf4-4127-b4ca-e3ec84c133f2 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:04.386518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e7e068c-5bf4-4127-b4ca-e3ec84c133f2 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:04.387471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e7e068c-5bf4-4127-b4ca-e3ec84c133f2 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:04.388119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e7e068c-5bf4-4127-b4ca-e3ec84c133f2 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:04.389047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e7e068c-5bf4-4127-b4ca-e3ec84c133f2 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:04.569335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b76b1c8f-d2c2-480b-af83-bd98782aeeb9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:04.582001 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b76b1c8f-d2c2-480b-af83-bd98782aeeb9 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1460 microversion: 2.1 time: 0.657009 Sep 10 10:59:04.591265 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 893/4140] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:03 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1460 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:04.760221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e7e068c-5bf4-4127-b4ca-e3ec84c133f2 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:04.770589 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e7e068c-5bf4-4127-b4ca-e3ec84c133f2 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1510 microversion: 2.1 time: 0.419828 Sep 10 10:59:04.803973 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3248/4141] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:04 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:05.619438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9bd04bdc-98c2-4a3e-bfd8-46e1a460f47e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:05.623047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9bd04bdc-98c2-4a3e-bfd8-46e1a460f47e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:05.653102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9bd04bdc-98c2-4a3e-bfd8-46e1a460f47e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:05.653622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9bd04bdc-98c2-4a3e-bfd8-46e1a460f47e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:05.654062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9bd04bdc-98c2-4a3e-bfd8-46e1a460f47e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:05.657711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9bd04bdc-98c2-4a3e-bfd8-46e1a460f47e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:05.658170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9bd04bdc-98c2-4a3e-bfd8-46e1a460f47e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:05.658783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9bd04bdc-98c2-4a3e-bfd8-46e1a460f47e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:05.820661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c1d2e6d-aa9c-4781-9e87-7c46788d1e7e tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:05.821372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c1d2e6d-aa9c-4781-9e87-7c46788d1e7e tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:05.842755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c1d2e6d-aa9c-4781-9e87-7c46788d1e7e tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:05.843122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c1d2e6d-aa9c-4781-9e87-7c46788d1e7e tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:05.843568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c1d2e6d-aa9c-4781-9e87-7c46788d1e7e tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:05.847569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c1d2e6d-aa9c-4781-9e87-7c46788d1e7e tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:05.851299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c1d2e6d-aa9c-4781-9e87-7c46788d1e7e tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:05.852093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c1d2e6d-aa9c-4781-9e87-7c46788d1e7e tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:06.218557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9bd04bdc-98c2-4a3e-bfd8-46e1a460f47e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:06.265901 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9bd04bdc-98c2-4a3e-bfd8-46e1a460f47e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1462 microversion: 2.1 time: 0.643231 Sep 10 10:59:06.267213 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 894/4142] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:05 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1462 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:06.456229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c1d2e6d-aa9c-4781-9e87-7c46788d1e7e tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:06.465787 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c1d2e6d-aa9c-4781-9e87-7c46788d1e7e tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1510 microversion: 2.1 time: 0.651231 Sep 10 10:59:06.474881 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3249/4143] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:05 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1510 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:07.294090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cb6958a6-13a6-453d-9406-296c8f304835 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:07.295749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cb6958a6-13a6-453d-9406-296c8f304835 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:07.305183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb6958a6-13a6-453d-9406-296c8f304835 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:07.307341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb6958a6-13a6-453d-9406-296c8f304835 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:07.307789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb6958a6-13a6-453d-9406-296c8f304835 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:07.309053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb6958a6-13a6-453d-9406-296c8f304835 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:07.309053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb6958a6-13a6-453d-9406-296c8f304835 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:07.309592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb6958a6-13a6-453d-9406-296c8f304835 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:07.500956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73882f04-0bf9-4c89-b88c-bb42d5b55672 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:07.502664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73882f04-0bf9-4c89-b88c-bb42d5b55672 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:07.513468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73882f04-0bf9-4c89-b88c-bb42d5b55672 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:07.514870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73882f04-0bf9-4c89-b88c-bb42d5b55672 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:07.515604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73882f04-0bf9-4c89-b88c-bb42d5b55672 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:07.516694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73882f04-0bf9-4c89-b88c-bb42d5b55672 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:07.517914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73882f04-0bf9-4c89-b88c-bb42d5b55672 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:07.518545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73882f04-0bf9-4c89-b88c-bb42d5b55672 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:07.939114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73882f04-0bf9-4c89-b88c-bb42d5b55672 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:07.985988 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73882f04-0bf9-4c89-b88c-bb42d5b55672 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1468 microversion: 2.1 time: 0.490491 Sep 10 10:59:07.990300 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3250/4144] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:07 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1468 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:59:08.007760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cb6958a6-13a6-453d-9406-296c8f304835 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:08.060979 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cb6958a6-13a6-453d-9406-296c8f304835 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 0.772483 Sep 10 10:59:08.062344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-90b51eca-d264-4bf0-a053-34ca824b2acb req-55b6089b-ec42-4e0e-ab50-a41936865d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5", "name": "network-vif-deleted", "tag": "a0a753a6-3549-4491-804b-3c73b6279e7e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:08.072070 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 895/4145] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:07 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:08.083942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-90b51eca-d264-4bf0-a053-34ca824b2acb req-55b6089b-ec42-4e0e-ab50-a41936865d74 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:08.084985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-90b51eca-d264-4bf0-a053-34ca824b2acb req-55b6089b-ec42-4e0e-ab50-a41936865d74 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:08.085455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-90b51eca-d264-4bf0-a053-34ca824b2acb req-55b6089b-ec42-4e0e-ab50-a41936865d74 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:08.106486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-90b51eca-d264-4bf0-a053-34ca824b2acb req-55b6089b-ec42-4e0e-ab50-a41936865d74 service nova] Creating event network-vif-deleted:a0a753a6-3549-4491-804b-3c73b6279e7e for instance cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 on n-h2-856894-1 Sep 10 10:59:08.125805 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-90b51eca-d264-4bf0-a053-34ca824b2acb req-55b6089b-ec42-4e0e-ab50-a41936865d74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073728 Sep 10 10:59:08.126958 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3251/4146] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:59:09.011571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:09.013100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:09.023141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:09.024224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:09.025340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:09.026477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:09.027256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:09.028170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:09.096968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b71b98f4-5177-49d6-a29f-49d96e5b91ba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:09.102782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b71b98f4-5177-49d6-a29f-49d96e5b91ba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:09.111246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b71b98f4-5177-49d6-a29f-49d96e5b91ba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:09.115359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b71b98f4-5177-49d6-a29f-49d96e5b91ba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:09.116743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b71b98f4-5177-49d6-a29f-49d96e5b91ba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:09.117918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b71b98f4-5177-49d6-a29f-49d96e5b91ba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:09.119089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b71b98f4-5177-49d6-a29f-49d96e5b91ba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:09.119790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b71b98f4-5177-49d6-a29f-49d96e5b91ba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:09.134082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:09.134642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:09.135089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:09.147192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lazy-loading 'fault' on Instance uuid cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:59:09.546507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a70bea9892f49539d90040e7a063ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51009c948a88463b8e0185161e17efba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:09.556144 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a76cfeb9-00f6-401f-a7af-9705111ef9ac tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 200 len: 1305 microversion: 2.1 time: 0.548854 Sep 10 10:59:09.572766 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 896/4147] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:09 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 1305 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:09.759382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b71b98f4-5177-49d6-a29f-49d96e5b91ba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:09.773323 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b71b98f4-5177-49d6-a29f-49d96e5b91ba tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 0.681324 Sep 10 10:59:09.783248 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3252/4148] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:09 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:10.600783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:10.601551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] [instance: cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:10.611217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:10.616867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:10.617628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:10.618599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:10.619544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:10.620192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:10.658047 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] HTTP exception thrown: Instance cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 could not be found. Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Request method failure captured: Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 HTTP/1.1 Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG3dvEnSqgszTzYn18vv1DkDx3B1hFBM_fhSopZ0bh6VBLDxGYrFuduX2xfh4I2QZtzpkuOJl7JNNRxPU74QEHvg9UisyGew4lqTXdHjRbm-cCX1dAxT7S-5eIV_zJeL2nqOK4Jn32btCu7fjrXZX7OG6kXJqoMX3giXom8I9VP-vE0 Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 51009c948a88463b8e0185161e17efba Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerPasswordTestJSON-759000378 Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/51009c948a88463b8e0185161e17efba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/51009c948a88463b8e0185161e17efba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/51009c948a88463b8e0185161e17efba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_51009c948a88463b8e0185161e17efba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerPasswordTestJSON-759000378 Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 51009c948a88463b8e0185161e17efba Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerPasswordTestJSON-759000378 Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerPasswordTestJSON-759000378-project Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 3a70bea9892f49539d90040e7a063ec4 Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerPasswordTestJSON-759000378-project Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 could not be found. Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5'} Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 could not be found. Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 could not be found. Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:59:10.666891 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:59:10.672175 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:10.672175 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:59:10.672175 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:59:10.672175 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:59:10.672175 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:59:10.672175 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 could not be found. Sep 10 10:59:10.672175 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:59:10.674201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] Returning 404 to user: Instance cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:59:10.675289 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f8725ced-32c2-4266-9d06-8ac7f666c359 tempest-ServerPasswordTestJSON-759000378 tempest-ServerPasswordTestJSON-759000378-project] 10.222.0.20 "GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5" status: 404 len: 111 microversion: 2.1 time: 0.079323 Sep 10 10:59:10.676370 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 897/4149] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:10 2022] GET /compute/v2.1/servers/cc4f0e80-efc2-4bd3-8e97-bdcaa6954fd5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 10:59:10.812993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-20bd9524-9f15-4ac5-957d-595077b5c20c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:10.813881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-20bd9524-9f15-4ac5-957d-595077b5c20c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:10.840583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20bd9524-9f15-4ac5-957d-595077b5c20c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:10.842736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20bd9524-9f15-4ac5-957d-595077b5c20c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:10.843490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20bd9524-9f15-4ac5-957d-595077b5c20c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:10.846112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20bd9524-9f15-4ac5-957d-595077b5c20c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:10.847457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20bd9524-9f15-4ac5-957d-595077b5c20c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:10.855809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20bd9524-9f15-4ac5-957d-595077b5c20c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:12.112936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20bd9524-9f15-4ac5-957d-595077b5c20c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:12.122910 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-20bd9524-9f15-4ac5-957d-595077b5c20c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 1.315896 Sep 10 10:59:12.123501 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3253/4150] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:10 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:13.152749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-21ce05ac-9de4-4475-af1e-74d4efd8ca26 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:13.153570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-21ce05ac-9de4-4475-af1e-74d4efd8ca26 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:13.172499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21ce05ac-9de4-4475-af1e-74d4efd8ca26 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:13.179116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21ce05ac-9de4-4475-af1e-74d4efd8ca26 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:13.180261 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21ce05ac-9de4-4475-af1e-74d4efd8ca26 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:13.181542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21ce05ac-9de4-4475-af1e-74d4efd8ca26 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:13.182952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21ce05ac-9de4-4475-af1e-74d4efd8ca26 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:13.183401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21ce05ac-9de4-4475-af1e-74d4efd8ca26 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:13.589277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-21ce05ac-9de4-4475-af1e-74d4efd8ca26 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:13.603837 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-21ce05ac-9de4-4475-af1e-74d4efd8ca26 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 0.456490 Sep 10 10:59:13.609114 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 898/4151] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:13 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:14.629942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8fc91520-eedf-4c35-bdd0-5c6902093bdf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:14.630647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8fc91520-eedf-4c35-bdd0-5c6902093bdf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:14.650828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fc91520-eedf-4c35-bdd0-5c6902093bdf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:14.653517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fc91520-eedf-4c35-bdd0-5c6902093bdf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:14.653971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fc91520-eedf-4c35-bdd0-5c6902093bdf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:14.658617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fc91520-eedf-4c35-bdd0-5c6902093bdf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:14.659194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fc91520-eedf-4c35-bdd0-5c6902093bdf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:14.660705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fc91520-eedf-4c35-bdd0-5c6902093bdf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:15.619741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8fc91520-eedf-4c35-bdd0-5c6902093bdf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:15.637167 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8fc91520-eedf-4c35-bdd0-5c6902093bdf tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 1.005354 Sep 10 10:59:15.638770 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3254/4152] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:14 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:16.667524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d5d203d7-7273-4a0a-bb7b-b9c19c4152db tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:16.668933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d5d203d7-7273-4a0a-bb7b-b9c19c4152db tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:16.702048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5d203d7-7273-4a0a-bb7b-b9c19c4152db tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:16.702911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5d203d7-7273-4a0a-bb7b-b9c19c4152db tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:16.706808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5d203d7-7273-4a0a-bb7b-b9c19c4152db tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:16.707884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5d203d7-7273-4a0a-bb7b-b9c19c4152db tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:16.708723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5d203d7-7273-4a0a-bb7b-b9c19c4152db tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:16.710122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5d203d7-7273-4a0a-bb7b-b9c19c4152db tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:17.164968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d5d203d7-7273-4a0a-bb7b-b9c19c4152db tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:17.178559 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d5d203d7-7273-4a0a-bb7b-b9c19c4152db tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 0.511469 Sep 10 10:59:17.182493 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 899/4153] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:16 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:18.205142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-00ae01ee-46bd-49c1-a811-8240b9ef6976 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:18.205763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-00ae01ee-46bd-49c1-a811-8240b9ef6976 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:18.224851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00ae01ee-46bd-49c1-a811-8240b9ef6976 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:18.225378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00ae01ee-46bd-49c1-a811-8240b9ef6976 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:18.225824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00ae01ee-46bd-49c1-a811-8240b9ef6976 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:18.226552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00ae01ee-46bd-49c1-a811-8240b9ef6976 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:18.227015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00ae01ee-46bd-49c1-a811-8240b9ef6976 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:18.227453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00ae01ee-46bd-49c1-a811-8240b9ef6976 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:18.835585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-00ae01ee-46bd-49c1-a811-8240b9ef6976 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:18.853816 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-00ae01ee-46bd-49c1-a811-8240b9ef6976 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 0.651236 Sep 10 10:59:18.854507 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3255/4154] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:18 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:19.883938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-89376f71-de0c-4cd4-8562-842b9a04c696 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:19.884751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-89376f71-de0c-4cd4-8562-842b9a04c696 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:19.901717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89376f71-de0c-4cd4-8562-842b9a04c696 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:19.909310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89376f71-de0c-4cd4-8562-842b9a04c696 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:19.910096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89376f71-de0c-4cd4-8562-842b9a04c696 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:19.916269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89376f71-de0c-4cd4-8562-842b9a04c696 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:19.919533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89376f71-de0c-4cd4-8562-842b9a04c696 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:19.920152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89376f71-de0c-4cd4-8562-842b9a04c696 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:22.255189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-89376f71-de0c-4cd4-8562-842b9a04c696 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:22.274202 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-89376f71-de0c-4cd4-8562-842b9a04c696 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 2.394949 Sep 10 10:59:22.274818 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 900/4155] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:19 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:23.305573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8625e77a-cdd1-4583-a905-94c96f165fd0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:23.306038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8625e77a-cdd1-4583-a905-94c96f165fd0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:23.329443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8625e77a-cdd1-4583-a905-94c96f165fd0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:23.330138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8625e77a-cdd1-4583-a905-94c96f165fd0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:23.332839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8625e77a-cdd1-4583-a905-94c96f165fd0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:23.343014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8625e77a-cdd1-4583-a905-94c96f165fd0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:23.345765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8625e77a-cdd1-4583-a905-94c96f165fd0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:23.348308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8625e77a-cdd1-4583-a905-94c96f165fd0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:24.119358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8625e77a-cdd1-4583-a905-94c96f165fd0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:24.129524 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8625e77a-cdd1-4583-a905-94c96f165fd0 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 0.831662 Sep 10 10:59:24.147034 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3256/4156] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:23 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:25.153601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-327a0af7-b4f7-4d47-87e7-a26eea7e775a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:25.154389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-327a0af7-b4f7-4d47-87e7-a26eea7e775a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:25.181387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-327a0af7-b4f7-4d47-87e7-a26eea7e775a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:25.182265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-327a0af7-b4f7-4d47-87e7-a26eea7e775a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:25.182955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-327a0af7-b4f7-4d47-87e7-a26eea7e775a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:25.184076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-327a0af7-b4f7-4d47-87e7-a26eea7e775a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:25.184776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-327a0af7-b4f7-4d47-87e7-a26eea7e775a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:25.185479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-327a0af7-b4f7-4d47-87e7-a26eea7e775a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:25.773124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-327a0af7-b4f7-4d47-87e7-a26eea7e775a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:25.787247 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-327a0af7-b4f7-4d47-87e7-a26eea7e775a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 0.632970 Sep 10 10:59:25.790941 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 901/4157] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:25 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:25.970685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d34d26c4-d4d8-4270-bc25-7a9010efa81b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:25.971326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d34d26c4-d4d8-4270-bc25-7a9010efa81b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:25.980655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d34d26c4-d4d8-4270-bc25-7a9010efa81b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:25.981325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d34d26c4-d4d8-4270-bc25-7a9010efa81b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:25.981883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d34d26c4-d4d8-4270-bc25-7a9010efa81b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:25.984116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d34d26c4-d4d8-4270-bc25-7a9010efa81b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:25.984712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d34d26c4-d4d8-4270-bc25-7a9010efa81b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:25.986563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d34d26c4-d4d8-4270-bc25-7a9010efa81b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:26.052229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d34d26c4-d4d8-4270-bc25-7a9010efa81b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 10:59:26.102545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:26.232799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d34d26c4-d4d8-4270-bc25-7a9010efa81b tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 204 len: 0 microversion: 2.32 time: 0.700184 Sep 10 10:59:26.233835 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3257/4158] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 10:59:25 2022] DELETE /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 10:59:26.245092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:26.246701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:26.256810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:26.257734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:26.260005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:26.260973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:26.261819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:26.262498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:26.814899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d3a50ae9-817f-4f02-9239-968b8773353e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:26.815990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d3a50ae9-817f-4f02-9239-968b8773353e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:26.832014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3a50ae9-817f-4f02-9239-968b8773353e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:26.834949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3a50ae9-817f-4f02-9239-968b8773353e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:26.837017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3a50ae9-817f-4f02-9239-968b8773353e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:26.838511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3a50ae9-817f-4f02-9239-968b8773353e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:26.841487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3a50ae9-817f-4f02-9239-968b8773353e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:26.843345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3a50ae9-817f-4f02-9239-968b8773353e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:26.953539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:26.967012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:26.983357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:26.987613 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0e2f8b81-ef53-4d19-9ea2-b7360c0d66ae tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2956 microversion: 2.32 time: 0.749028 Sep 10 10:59:26.990822 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 902/4159] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:26 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2956 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:27.350561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d3a50ae9-817f-4f02-9239-968b8773353e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:27.359243 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d3a50ae9-817f-4f02-9239-968b8773353e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 0.548949 Sep 10 10:59:27.362193 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3258/4160] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:26 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:59:28.018237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:28.018849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:28.033164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:28.037667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:28.038336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:28.039235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:28.039856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:28.040447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:28.392353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21e939c8-ab3b-4fdc-ac24-be7811822830 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:28.392976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21e939c8-ab3b-4fdc-ac24-be7811822830 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:28.402182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e939c8-ab3b-4fdc-ac24-be7811822830 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:28.402680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e939c8-ab3b-4fdc-ac24-be7811822830 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:28.403122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e939c8-ab3b-4fdc-ac24-be7811822830 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:28.403828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e939c8-ab3b-4fdc-ac24-be7811822830 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:28.404286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e939c8-ab3b-4fdc-ac24-be7811822830 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:28.404713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e939c8-ab3b-4fdc-ac24-be7811822830 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:28.487841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:28.499860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:28.503254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:28.504849 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c59e9773-b398-48ca-8322-7b294d624e8d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2956 microversion: 2.32 time: 0.490459 Sep 10 10:59:28.522666 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 903/4161] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:28 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2956 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:59:28.731881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21e939c8-ab3b-4fdc-ac24-be7811822830 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:28.740264 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21e939c8-ab3b-4fdc-ac24-be7811822830 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 0.352045 Sep 10 10:59:28.750450 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3259/4162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:28 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:29.536293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:29.537789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:29.563285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:29.564259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:29.564259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:29.565140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:29.565780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:29.566358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:29.778189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-848b206c-fc9f-4c85-be0f-74f92834b79b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:29.778756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-848b206c-fc9f-4c85-be0f-74f92834b79b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:29.793649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848b206c-fc9f-4c85-be0f-74f92834b79b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:29.794178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848b206c-fc9f-4c85-be0f-74f92834b79b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:29.796121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848b206c-fc9f-4c85-be0f-74f92834b79b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:29.797387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848b206c-fc9f-4c85-be0f-74f92834b79b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:29.799087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848b206c-fc9f-4c85-be0f-74f92834b79b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:29.800068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848b206c-fc9f-4c85-be0f-74f92834b79b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:30.289753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:30.304067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:30.306750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:30.311160 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-762b2adc-2eb5-461a-b29e-865863b8cf17 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2956 microversion: 2.32 time: 0.779164 Sep 10 10:59:30.325094 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 904/4163] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:29 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2956 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:30.954758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-848b206c-fc9f-4c85-be0f-74f92834b79b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:30.968976 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-848b206c-fc9f-4c85-be0f-74f92834b79b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 1.195065 Sep 10 10:59:30.997292 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3260/4164] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:29 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:31.343419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:31.344637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:31.358155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=34 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:31.360911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:31.361453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:31.374832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:31.375752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:31.376233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:31.376868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:31.390827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:32.006189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-00d31eae-ec8f-43de-990e-b6a3b41ebf5f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:32.006603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-00d31eae-ec8f-43de-990e-b6a3b41ebf5f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:32.020906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:32.028007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00d31eae-ec8f-43de-990e-b6a3b41ebf5f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:32.028574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00d31eae-ec8f-43de-990e-b6a3b41ebf5f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:32.029103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00d31eae-ec8f-43de-990e-b6a3b41ebf5f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:32.029783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00d31eae-ec8f-43de-990e-b6a3b41ebf5f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:32.031818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00d31eae-ec8f-43de-990e-b6a3b41ebf5f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:32.034069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00d31eae-ec8f-43de-990e-b6a3b41ebf5f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:32.575554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:32.586111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:32.597116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:32.598659 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fab5d11e-6aba-4038-9f52-2cc28f252795 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2956 microversion: 2.32 time: 1.260031 Sep 10 10:59:32.601762 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 905/4165] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:31 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2956 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:32.608557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-8001f2c4-bde1-4091-98c7-5ba2a4b41479 req-bbfe9ed1-972e-4d45-9448-72568635b5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1fff5af-b5bc-4a39-a5a3-81c17a2b397b", "name": "network-vif-plugged", "status": "completed", "tag": "fdf28f35-cdeb-4bbe-a940-e39781700167"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:32.639546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8001f2c4-bde1-4091-98c7-5ba2a4b41479 req-bbfe9ed1-972e-4d45-9448-72568635b5ba service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:32.640273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8001f2c4-bde1-4091-98c7-5ba2a4b41479 req-bbfe9ed1-972e-4d45-9448-72568635b5ba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:32.640896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8001f2c4-bde1-4091-98c7-5ba2a4b41479 req-bbfe9ed1-972e-4d45-9448-72568635b5ba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:32.677735 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-8001f2c4-bde1-4091-98c7-5ba2a4b41479 req-bbfe9ed1-972e-4d45-9448-72568635b5ba service nova] Creating event network-vif-plugged:fdf28f35-cdeb-4bbe-a940-e39781700167 for instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b on n-h2-856894-1 Sep 10 10:59:32.684034 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-8001f2c4-bde1-4091-98c7-5ba2a4b41479 req-bbfe9ed1-972e-4d45-9448-72568635b5ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080453 Sep 10 10:59:32.684833 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 906/4166] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:59:32.868294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-00d31eae-ec8f-43de-990e-b6a3b41ebf5f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:32.885385 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-00d31eae-ec8f-43de-990e-b6a3b41ebf5f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 0.882308 Sep 10 10:59:32.886774 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3261/4167] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:31 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:33.635048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:33.635992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:33.651528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:33.652152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:33.655283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:33.656498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:33.657782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:33.659850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:33.916321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-45fb2b43-c83b-4a25-ae34-8d18ffd24b36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:33.917584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-45fb2b43-c83b-4a25-ae34-8d18ffd24b36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:33.933773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45fb2b43-c83b-4a25-ae34-8d18ffd24b36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:33.934462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45fb2b43-c83b-4a25-ae34-8d18ffd24b36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:33.937277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45fb2b43-c83b-4a25-ae34-8d18ffd24b36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:33.939477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45fb2b43-c83b-4a25-ae34-8d18ffd24b36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:33.940128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45fb2b43-c83b-4a25-ae34-8d18ffd24b36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:33.946630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45fb2b43-c83b-4a25-ae34-8d18ffd24b36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:34.761254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:34.780242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:34.782026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:34.783311 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-78e6db75-1381-4f38-a38b-0f3ad082cfef tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2935 microversion: 2.32 time: 1.153734 Sep 10 10:59:34.797423 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 907/4168] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:33 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2935 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:34.830406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-aa3db0c0-92dd-44e7-bddf-859b7d77cfa5 req-32e99e4b-f6bd-437c-858c-24e7d714b5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-unplugged", "status": "completed", "tag": "0e5561b7-d18e-4cc7-baa7-94dad55f2c42"}, {"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-unplugged", "status": "completed", "tag": "c47b0e0e-8474-4e97-a4ca-67dcd2219a5f"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:34.849004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-aa3db0c0-92dd-44e7-bddf-859b7d77cfa5 req-32e99e4b-f6bd-437c-858c-24e7d714b5cc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:34.850056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-aa3db0c0-92dd-44e7-bddf-859b7d77cfa5 req-32e99e4b-f6bd-437c-858c-24e7d714b5cc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:34.850492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-aa3db0c0-92dd-44e7-bddf-859b7d77cfa5 req-32e99e4b-f6bd-437c-858c-24e7d714b5cc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:34.902764 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-aa3db0c0-92dd-44e7-bddf-859b7d77cfa5 req-32e99e4b-f6bd-437c-858c-24e7d714b5cc service nova] Creating event network-vif-unplugged:0e5561b7-d18e-4cc7-baa7-94dad55f2c42 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:59:34.903289 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-aa3db0c0-92dd-44e7-bddf-859b7d77cfa5 req-32e99e4b-f6bd-437c-858c-24e7d714b5cc service nova] Creating event network-vif-unplugged:c47b0e0e-8474-4e97-a4ca-67dcd2219a5f for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:59:34.919998 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-aa3db0c0-92dd-44e7-bddf-859b7d77cfa5 req-32e99e4b-f6bd-437c-858c-24e7d714b5cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.093414 Sep 10 10:59:34.921361 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 908/4169] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:59:35.147511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-45fb2b43-c83b-4a25-ae34-8d18ffd24b36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:35.159628 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-45fb2b43-c83b-4a25-ae34-8d18ffd24b36 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 1.251071 Sep 10 10:59:35.162253 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3262/4170] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:33 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:59:35.820214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:35.820937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:35.835158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:35.835660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:35.836365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:35.836805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:35.837295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:35.837728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:36.184302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35a22bb5-6cd6-4765-8dcf-3f006e2a6aa8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:36.184925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-35a22bb5-6cd6-4765-8dcf-3f006e2a6aa8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:36.202618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a22bb5-6cd6-4765-8dcf-3f006e2a6aa8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:36.203491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a22bb5-6cd6-4765-8dcf-3f006e2a6aa8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:36.204125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a22bb5-6cd6-4765-8dcf-3f006e2a6aa8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:36.205030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a22bb5-6cd6-4765-8dcf-3f006e2a6aa8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:36.205939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a22bb5-6cd6-4765-8dcf-3f006e2a6aa8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:36.206547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a22bb5-6cd6-4765-8dcf-3f006e2a6aa8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:37.232852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-35a22bb5-6cd6-4765-8dcf-3f006e2a6aa8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:37.250321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-35a22bb5-6cd6-4765-8dcf-3f006e2a6aa8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1518 microversion: 2.1 time: 1.067525 Sep 10 10:59:37.252319 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3263/4171] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:36 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1518 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:59:37.262403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2f9b3970-b7d2-4add-bb4e-a944ffd8cc9e req-cc5687e6-6719-4821-b517-c579eeb25232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-unplugged", "status": "completed", "tag": "875f226e-ca50-4e2c-adf6-17cf98c280d2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:37.300780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2f9b3970-b7d2-4add-bb4e-a944ffd8cc9e req-cc5687e6-6719-4821-b517-c579eeb25232 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:37.306952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2f9b3970-b7d2-4add-bb4e-a944ffd8cc9e req-cc5687e6-6719-4821-b517-c579eeb25232 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:37.310444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2f9b3970-b7d2-4add-bb4e-a944ffd8cc9e req-cc5687e6-6719-4821-b517-c579eeb25232 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:37.344252 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2f9b3970-b7d2-4add-bb4e-a944ffd8cc9e req-cc5687e6-6719-4821-b517-c579eeb25232 service nova] Creating event network-vif-unplugged:875f226e-ca50-4e2c-adf6-17cf98c280d2 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:59:37.362793 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2f9b3970-b7d2-4add-bb4e-a944ffd8cc9e req-cc5687e6-6719-4821-b517-c579eeb25232 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105727 Sep 10 10:59:37.364419 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3264/4172] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:59:37.386820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:37.404697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:37.407298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:37.408743 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6308a350-0aa5-4089-b45b-df66c8a35db9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2935 microversion: 2.32 time: 1.593502 Sep 10 10:59:37.425096 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 909/4173] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:35 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2935 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:38.279150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3eb2fcd6-e469-4f6a-bc2f-1069682871f8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:38.280809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3eb2fcd6-e469-4f6a-bc2f-1069682871f8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:38.291004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb2fcd6-e469-4f6a-bc2f-1069682871f8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:38.291902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb2fcd6-e469-4f6a-bc2f-1069682871f8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:38.292772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb2fcd6-e469-4f6a-bc2f-1069682871f8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:38.295786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb2fcd6-e469-4f6a-bc2f-1069682871f8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:38.296944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb2fcd6-e469-4f6a-bc2f-1069682871f8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:38.298330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb2fcd6-e469-4f6a-bc2f-1069682871f8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:38.444722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:38.445476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:38.459125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:38.466381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:38.467117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:38.468855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:38.477797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:38.478621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:39.721928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3eb2fcd6-e469-4f6a-bc2f-1069682871f8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:39.737435 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3eb2fcd6-e469-4f6a-bc2f-1069682871f8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.463329 Sep 10 10:59:39.754783 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3265/4174] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:38 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:39.871407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:39.896768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:39.909581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:39.925516 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2170c415-356b-4dd8-bf66-38879101bf1e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2914 microversion: 2.32 time: 1.477614 Sep 10 10:59:39.926398 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 910/4175] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:38 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2914 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:39.957287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-335a83ac-c46a-4005-b205-c955ea3ecddc req-26b4799c-9ecf-420e-a0dc-8d2bfdf41521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-unplugged", "status": "completed", "tag": "afc48537-d094-475a-90d1-6025c8a4d182"}, {"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-unplugged", "status": "completed", "tag": "db6226c6-d5ed-4db3-92af-4e1534088960"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:40.015498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-335a83ac-c46a-4005-b205-c955ea3ecddc req-26b4799c-9ecf-420e-a0dc-8d2bfdf41521 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:40.015994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-335a83ac-c46a-4005-b205-c955ea3ecddc req-26b4799c-9ecf-420e-a0dc-8d2bfdf41521 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:40.016439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-335a83ac-c46a-4005-b205-c955ea3ecddc req-26b4799c-9ecf-420e-a0dc-8d2bfdf41521 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:40.049494 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-335a83ac-c46a-4005-b205-c955ea3ecddc req-26b4799c-9ecf-420e-a0dc-8d2bfdf41521 service nova] Creating event network-vif-unplugged:afc48537-d094-475a-90d1-6025c8a4d182 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:59:40.052113 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-335a83ac-c46a-4005-b205-c955ea3ecddc req-26b4799c-9ecf-420e-a0dc-8d2bfdf41521 service nova] Creating event network-vif-unplugged:db6226c6-d5ed-4db3-92af-4e1534088960 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:59:40.066295 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-335a83ac-c46a-4005-b205-c955ea3ecddc req-26b4799c-9ecf-420e-a0dc-8d2bfdf41521 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.138180 Sep 10 10:59:40.068042 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 911/4176] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:59:40.082137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d1647b25-819e-4930-8ee4-f4f95ff45350 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:40.093476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d1647b25-819e-4930-8ee4-f4f95ff45350 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:40.110898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1647b25-819e-4930-8ee4-f4f95ff45350 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:40.111419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1647b25-819e-4930-8ee4-f4f95ff45350 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:40.111867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1647b25-819e-4930-8ee4-f4f95ff45350 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:40.112590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1647b25-819e-4930-8ee4-f4f95ff45350 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:40.113054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1647b25-819e-4930-8ee4-f4f95ff45350 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:40.113990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-453386880", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:40.121898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1647b25-819e-4930-8ee4-f4f95ff45350 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:40.220304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] validate_networks() for [('55ac737f-42e8-4b4d-9b8b-51b8d4906804', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:59:40.838170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d1647b25-819e-4930-8ee4-f4f95ff45350 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:40.850640 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d1647b25-819e-4930-8ee4-f4f95ff45350 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.777801 Sep 10 10:59:40.851259 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 912/4177] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:40 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:41.050181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-09fa36f1-4ecf-40f7-b915-9b29f134890d req-3b4f42b7-a8e6-4bb9-9da3-ff351d81e90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-deleted", "tag": "875f226e-ca50-4e2c-adf6-17cf98c280d2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:41.063403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-09fa36f1-4ecf-40f7-b915-9b29f134890d req-3b4f42b7-a8e6-4bb9-9da3-ff351d81e90a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:41.064199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-09fa36f1-4ecf-40f7-b915-9b29f134890d req-3b4f42b7-a8e6-4bb9-9da3-ff351d81e90a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:41.064789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-09fa36f1-4ecf-40f7-b915-9b29f134890d req-3b4f42b7-a8e6-4bb9-9da3-ff351d81e90a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:41.081155 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-09fa36f1-4ecf-40f7-b915-9b29f134890d req-3b4f42b7-a8e6-4bb9-9da3-ff351d81e90a service nova] Creating event network-vif-deleted:875f226e-ca50-4e2c-adf6-17cf98c280d2 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:59:41.093194 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-09fa36f1-4ecf-40f7-b915-9b29f134890d req-3b4f42b7-a8e6-4bb9-9da3-ff351d81e90a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215418 Sep 10 10:59:41.094325 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 913/4178] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:59:41.101589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5bb0a827-0a31-4199-97b5-2da8c89f8bd3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:41.102773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5bb0a827-0a31-4199-97b5-2da8c89f8bd3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:41.114073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bb0a827-0a31-4199-97b5-2da8c89f8bd3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:41.116765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bb0a827-0a31-4199-97b5-2da8c89f8bd3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:41.118566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bb0a827-0a31-4199-97b5-2da8c89f8bd3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:41.119672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bb0a827-0a31-4199-97b5-2da8c89f8bd3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:41.135868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bb0a827-0a31-4199-97b5-2da8c89f8bd3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:41.137104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bb0a827-0a31-4199-97b5-2da8c89f8bd3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:42.226155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5bb0a827-0a31-4199-97b5-2da8c89f8bd3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:42.236344 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5bb0a827-0a31-4199-97b5-2da8c89f8bd3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.140657 Sep 10 10:59:42.264322 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 914/4179] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:41 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:42.274720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:42.279518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:42.300992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:42.301845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:42.302555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:42.303475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:42.304132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:42.304776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:42.457383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:59:42.464101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:59:42.465187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:59:42.465795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:59:42.466404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:59:42.478379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:42.479134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:42.479754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:42.480933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:42.481577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:42.485030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:42.544625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Getting quotas for project d32d84b971cc464e907a05339f82e252. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:59:42.551761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Getting quotas for user 6462f07210a7449a8b72d5d51ed1c349 and project d32d84b971cc464e907a05339f82e252. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:59:42.584887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:59:42.587588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:59:42.714597 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-55190d62-94b4-4a06-81a5-4b8d9c2763a5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.949662 Sep 10 10:59:42.715733 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3266/4180] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:59:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 2960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:59:42.731782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-531b0619-c0aa-4edc-ade7-7abf932bd5fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:42.760394 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-531b0619-c0aa-4edc-ade7-7abf932bd5fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance da683f6d-5bae-4743-92db-e52f7028b2a5 has no mapping to a cell. Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-531b0619-c0aa-4edc-ade7-7abf932bd5fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/da683f6d-5bae-4743-92db-e52f7028b2a5/action HTTP/1.1 Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 15 Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: {"os-stop": {}} Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance da683f6d-5bae-4743-92db-e52f7028b2a5 has no mapping to a cell. Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'da683f6d-5bae-4743-92db-e52f7028b2a5', 'body': {'os-stop': {}}} Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance da683f6d-5bae-4743-92db-e52f7028b2a5 has no mapping to a cell. Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:59:42.778104 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da683f6d-5bae-4743-92db-e52f7028b2a5 has no mapping to a cell. Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da683f6d-5bae-4743-92db-e52f7028b2a5 has no mapping to a cell. Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-531b0619-c0aa-4edc-ade7-7abf932bd5fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance da683f6d-5bae-4743-92db-e52f7028b2a5 has no mapping to a cell. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-531b0619-c0aa-4edc-ade7-7abf932bd5fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/da683f6d-5bae-4743-92db-e52f7028b2a5/action" status: 404 len: 117 microversion: 2.1 time: 0.062887 Sep 10 10:59:42.787839 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3267/4181] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:59:42 2022] POST /compute/v2.1/servers/da683f6d-5bae-4743-92db-e52f7028b2a5/action => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:59:42.789857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d5b5cbc-8de5-45a5-a2f0-23b10d9d4524 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:42.798442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d5b5cbc-8de5-45a5-a2f0-23b10d9d4524 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:43.391983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6d5b5cbc-8de5-45a5-a2f0-23b10d9d4524 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:43.409601 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6d5b5cbc-8de5-45a5-a2f0-23b10d9d4524 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1213 microversion: 2.1 time: 0.621948 Sep 10 10:59:43.425185 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3268/4182] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:42 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1213 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:43.430228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15c3c566-8a75-492a-b335-be33594bde86 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:43.435359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15c3c566-8a75-492a-b335-be33594bde86 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:43.470456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c3c566-8a75-492a-b335-be33594bde86 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:43.471050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c3c566-8a75-492a-b335-be33594bde86 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:43.472939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c3c566-8a75-492a-b335-be33594bde86 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:43.475582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c3c566-8a75-492a-b335-be33594bde86 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:43.478374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c3c566-8a75-492a-b335-be33594bde86 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:43.479705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c3c566-8a75-492a-b335-be33594bde86 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:43.700267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:43.716977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:43.720433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:43.725209 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-829d5d1d-9dfa-4214-81e1-848c5cde0c94 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2753 microversion: 2.32 time: 1.458832 Sep 10 10:59:43.726744 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 915/4183] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:42 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2753 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:43.763306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-91fdca0c-ab12-49de-92ba-ea4ae0451277 req-839b74c1-00c2-46f4-aade-3c5cc6d088f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-deleted", "tag": "c47b0e0e-8474-4e97-a4ca-67dcd2219a5f"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:43.807291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-91fdca0c-ab12-49de-92ba-ea4ae0451277 req-839b74c1-00c2-46f4-aade-3c5cc6d088f0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:43.821647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-91fdca0c-ab12-49de-92ba-ea4ae0451277 req-839b74c1-00c2-46f4-aade-3c5cc6d088f0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:43.822508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-91fdca0c-ab12-49de-92ba-ea4ae0451277 req-839b74c1-00c2-46f4-aade-3c5cc6d088f0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:43.867435 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-91fdca0c-ab12-49de-92ba-ea4ae0451277 req-839b74c1-00c2-46f4-aade-3c5cc6d088f0 service nova] Creating event network-vif-deleted:c47b0e0e-8474-4e97-a4ca-67dcd2219a5f for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:59:43.878677 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-91fdca0c-ab12-49de-92ba-ea4ae0451277 req-839b74c1-00c2-46f4-aade-3c5cc6d088f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126837 Sep 10 10:59:43.885188 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 916/4184] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:59:44.438454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-66f299ad-7eac-4ceb-b554-50d191425c50 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:44.439159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-66f299ad-7eac-4ceb-b554-50d191425c50 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:44.448900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66f299ad-7eac-4ceb-b554-50d191425c50 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:44.453864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66f299ad-7eac-4ceb-b554-50d191425c50 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:44.461690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66f299ad-7eac-4ceb-b554-50d191425c50 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:44.464331 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66f299ad-7eac-4ceb-b554-50d191425c50 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:44.465010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66f299ad-7eac-4ceb-b554-50d191425c50 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:44.467582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66f299ad-7eac-4ceb-b554-50d191425c50 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:44.738290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-66f299ad-7eac-4ceb-b554-50d191425c50 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:44.756590 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-66f299ad-7eac-4ceb-b554-50d191425c50 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1209 microversion: 2.1 time: 0.322402 Sep 10 10:59:44.759409 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 917/4185] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:44 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1209 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:44.769148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:44.778651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:44.797690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:44.800168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:44.801633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:44.803326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:44.806429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:44.807065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:45.694202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:45.714017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:45.715426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:45.716698 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e7a679f2-bd7a-4b10-813f-e737dfab848c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2593 microversion: 2.32 time: 0.951339 Sep 10 10:59:45.741762 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 918/4186] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:44 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2593 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:45.786961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a1080572-01b4-42e7-88ec-ae4586203f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:45.787510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a1080572-01b4-42e7-88ec-ae4586203f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:45.812421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1080572-01b4-42e7-88ec-ae4586203f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:45.819774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1080572-01b4-42e7-88ec-ae4586203f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:45.820535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1080572-01b4-42e7-88ec-ae4586203f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:45.821556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1080572-01b4-42e7-88ec-ae4586203f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:45.823827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1080572-01b4-42e7-88ec-ae4586203f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:45.824460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1080572-01b4-42e7-88ec-ae4586203f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:46.273387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15c3c566-8a75-492a-b335-be33594bde86 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:46.292199 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15c3c566-8a75-492a-b335-be33594bde86 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 2.862084 Sep 10 10:59:46.292870 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3269/4187] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:43 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 2878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:46.322314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d578018b-26cc-4ceb-a915-f25c4653cc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:46.328149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d578018b-26cc-4ceb-a915-f25c4653cc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:46.350437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d578018b-26cc-4ceb-a915-f25c4653cc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:46.351156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d578018b-26cc-4ceb-a915-f25c4653cc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:46.351768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d578018b-26cc-4ceb-a915-f25c4653cc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:46.352773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d578018b-26cc-4ceb-a915-f25c4653cc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:46.353580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d578018b-26cc-4ceb-a915-f25c4653cc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:46.354179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d578018b-26cc-4ceb-a915-f25c4653cc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:46.407217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a1080572-01b4-42e7-88ec-ae4586203f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:46.424121 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a1080572-01b4-42e7-88ec-ae4586203f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1271 microversion: 2.1 time: 0.638731 Sep 10 10:59:46.425682 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 919/4188] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:45 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1271 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:46.768675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:46.770219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:46.778895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:46.779912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:46.780589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:46.782048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:46.782801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:46.783493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:47.225696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d578018b-26cc-4ceb-a915-f25c4653cc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:47.234053 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d578018b-26cc-4ceb-a915-f25c4653cc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.915514 Sep 10 10:59:47.244363 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3270/4189] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:46 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:47.260103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-782e6a99-b687-44b1-982e-2790f0d8f217 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:47.260675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-782e6a99-b687-44b1-982e-2790f0d8f217 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: 84949d8e-9b9b-42f9-bba2-113ddd4e3c2d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:47.295851 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-782e6a99-b687-44b1-982e-2790f0d8f217 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance 84949d8e-9b9b-42f9-bba2-113ddd4e3c2d could not be found. Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-782e6a99-b687-44b1-982e-2790f0d8f217 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/84949d8e-9b9b-42f9-bba2-113ddd4e3c2d/action HTTP/1.1 Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 15 Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: {"suspend": {}} Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 84949d8e-9b9b-42f9-bba2-113ddd4e3c2d could not be found. Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '84949d8e-9b9b-42f9-bba2-113ddd4e3c2d', 'body': {'suspend': {}}} Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84949d8e-9b9b-42f9-bba2-113ddd4e3c2d could not be found. Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84949d8e-9b9b-42f9-bba2-113ddd4e3c2d could not be found. Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:59:47.302857 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:59:47.308383 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:59:47.308383 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:59:47.308383 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84949d8e-9b9b-42f9-bba2-113ddd4e3c2d could not be found. Sep 10 10:59:47.308383 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 10:59:47.309862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-782e6a99-b687-44b1-982e-2790f0d8f217 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance 84949d8e-9b9b-42f9-bba2-113ddd4e3c2d could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:59:47.312047 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-782e6a99-b687-44b1-982e-2790f0d8f217 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/84949d8e-9b9b-42f9-bba2-113ddd4e3c2d/action" status: 404 len: 111 microversion: 2.1 time: 0.056929 Sep 10 10:59:47.316750 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3271/4190] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:59:47 2022] POST /compute/v2.1/servers/84949d8e-9b9b-42f9-bba2-113ddd4e3c2d/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 10:59:47.324435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1df69272-2e08-4bd6-97fe-2a13139c1f6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:47.330544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1df69272-2e08-4bd6-97fe-2a13139c1f6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:47.365790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1df69272-2e08-4bd6-97fe-2a13139c1f6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:47.366296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1df69272-2e08-4bd6-97fe-2a13139c1f6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:47.366741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1df69272-2e08-4bd6-97fe-2a13139c1f6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:47.367474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1df69272-2e08-4bd6-97fe-2a13139c1f6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:47.367967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1df69272-2e08-4bd6-97fe-2a13139c1f6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:47.368358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1df69272-2e08-4bd6-97fe-2a13139c1f6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:48.549736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:48.559075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1df69272-2e08-4bd6-97fe-2a13139c1f6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:48.582013 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1df69272-2e08-4bd6-97fe-2a13139c1f6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.255687 Sep 10 10:59:48.597748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:48.598602 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3272/4191] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:47 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:59:48.598752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:48.598752 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-42ea08a1-54f7-443b-bdda-627690ea5072 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2593 microversion: 2.32 time: 1.825593 Sep 10 10:59:48.610736 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 920/4192] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:46 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2593 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:48.612938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-baedf326-c1d9-4d1c-9120-e8b573ac2eaa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:48.616820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-baedf326-c1d9-4d1c-9120-e8b573ac2eaa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:48.623301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8aa6622f-1cd7-4ec6-ad1c-9fa2105bd342 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:48.625368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8aa6622f-1cd7-4ec6-ad1c-9fa2105bd342 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:48.628706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baedf326-c1d9-4d1c-9120-e8b573ac2eaa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:48.629309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baedf326-c1d9-4d1c-9120-e8b573ac2eaa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:48.629756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baedf326-c1d9-4d1c-9120-e8b573ac2eaa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:48.632396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baedf326-c1d9-4d1c-9120-e8b573ac2eaa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:48.632887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baedf326-c1d9-4d1c-9120-e8b573ac2eaa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:48.633325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8aa6622f-1cd7-4ec6-ad1c-9fa2105bd342 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:48.633466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baedf326-c1d9-4d1c-9120-e8b573ac2eaa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:48.633995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8aa6622f-1cd7-4ec6-ad1c-9fa2105bd342 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:48.634699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8aa6622f-1cd7-4ec6-ad1c-9fa2105bd342 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:48.635626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8aa6622f-1cd7-4ec6-ad1c-9fa2105bd342 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:48.639256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8aa6622f-1cd7-4ec6-ad1c-9fa2105bd342 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:48.640046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8aa6622f-1cd7-4ec6-ad1c-9fa2105bd342 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:48.963714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-baedf326-c1d9-4d1c-9120-e8b573ac2eaa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:48.978301 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-baedf326-c1d9-4d1c-9120-e8b573ac2eaa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1271 microversion: 2.1 time: 0.391624 Sep 10 10:59:48.994203 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3273/4193] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:48 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1271 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:49.624925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8aa6622f-1cd7-4ec6-ad1c-9fa2105bd342 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:49.634184 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8aa6622f-1cd7-4ec6-ad1c-9fa2105bd342 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.022110 Sep 10 10:59:49.634925 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 921/4194] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:48 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:49.649555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:49.650306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:49.662960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2a17a5ce-211d-465b-90d9-eb982ba95766 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:49.663861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2a17a5ce-211d-465b-90d9-eb982ba95766 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:49.681631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:49.683236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a17a5ce-211d-465b-90d9-eb982ba95766 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:49.684108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a17a5ce-211d-465b-90d9-eb982ba95766 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:49.684580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:49.685005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a17a5ce-211d-465b-90d9-eb982ba95766 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:49.686603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a17a5ce-211d-465b-90d9-eb982ba95766 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:49.687234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a17a5ce-211d-465b-90d9-eb982ba95766 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:49.687814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a17a5ce-211d-465b-90d9-eb982ba95766 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:49.695088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:49.697803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:49.699322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:49.702654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:49.750294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-2a17a5ce-211d-465b-90d9-eb982ba95766 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lazy-loading 'flavor' on Instance uuid f1fff5af-b5bc-4a39-a5a3-81c17a2b397b {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:59:49.940803 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2a17a5ce-211d-465b-90d9-eb982ba95766 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 202 len: 0 microversion: 2.1 time: 0.282448 Sep 10 10:59:49.943565 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 922/4195] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:59:49 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 10:59:49.964622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8e7a418c-22fd-4a45-8f4d-b98198413c73 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:49.967837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8e7a418c-22fd-4a45-8f4d-b98198413c73 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:49.998529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e7a418c-22fd-4a45-8f4d-b98198413c73 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:49.999029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e7a418c-22fd-4a45-8f4d-b98198413c73 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:49.999469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e7a418c-22fd-4a45-8f4d-b98198413c73 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:50.008397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e7a418c-22fd-4a45-8f4d-b98198413c73 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:50.013353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e7a418c-22fd-4a45-8f4d-b98198413c73 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:50.014206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e7a418c-22fd-4a45-8f4d-b98198413c73 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:50.054485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:51.229108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8e7a418c-22fd-4a45-8f4d-b98198413c73 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:51.241680 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8e7a418c-22fd-4a45-8f4d-b98198413c73 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1513 microversion: 2.1 time: 1.291257 Sep 10 10:59:51.254745 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 923/4196] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:49 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1513 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:59:51.271368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b60ddc6b-b8e6-4088-83f6-56b9cd411ce1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:51.272502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b60ddc6b-b8e6-4088-83f6-56b9cd411ce1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:51.290314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b60ddc6b-b8e6-4088-83f6-56b9cd411ce1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:51.291004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b60ddc6b-b8e6-4088-83f6-56b9cd411ce1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:51.292022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b60ddc6b-b8e6-4088-83f6-56b9cd411ce1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:51.294894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b60ddc6b-b8e6-4088-83f6-56b9cd411ce1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:51.296368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b60ddc6b-b8e6-4088-83f6-56b9cd411ce1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:51.299099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b60ddc6b-b8e6-4088-83f6-56b9cd411ce1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:51.357436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:51.374120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:51.383791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:51.385455 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a886d1d-e4b1-4269-b968-ed7caec38f6f tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2546 microversion: 2.32 time: 1.760664 Sep 10 10:59:51.386214 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3274/4197] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:49 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2546 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:51.898140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5b3582f0-b2d9-4c91-825e-bb6743fd94df req-e1152dd9-703b-4005-85ec-b179ba4a3fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-deleted", "tag": "db6226c6-d5ed-4db3-92af-4e1534088960"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:51.934736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b3582f0-b2d9-4c91-825e-bb6743fd94df req-e1152dd9-703b-4005-85ec-b179ba4a3fa3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:51.939731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b3582f0-b2d9-4c91-825e-bb6743fd94df req-e1152dd9-703b-4005-85ec-b179ba4a3fa3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:51.940407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b3582f0-b2d9-4c91-825e-bb6743fd94df req-e1152dd9-703b-4005-85ec-b179ba4a3fa3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:51.969563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b60ddc6b-b8e6-4088-83f6-56b9cd411ce1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:51.983658 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5b3582f0-b2d9-4c91-825e-bb6743fd94df req-e1152dd9-703b-4005-85ec-b179ba4a3fa3 service nova] Creating event network-vif-deleted:db6226c6-d5ed-4db3-92af-4e1534088960 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:59:51.984717 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b60ddc6b-b8e6-4088-83f6-56b9cd411ce1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1313 microversion: 2.1 time: 0.728255 Sep 10 10:59:51.989363 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 924/4198] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:51 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1313 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:52.013446 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5b3582f0-b2d9-4c91-825e-bb6743fd94df req-e1152dd9-703b-4005-85ec-b179ba4a3fa3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118445 Sep 10 10:59:52.015504 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3275/4199] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 10:59:52.275300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ebb64a4f-9c38-4020-9b65-3b99bee3685d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:52.276689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ebb64a4f-9c38-4020-9b65-3b99bee3685d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:52.291271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ebb64a4f-9c38-4020-9b65-3b99bee3685d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:52.292628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ebb64a4f-9c38-4020-9b65-3b99bee3685d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:52.293710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ebb64a4f-9c38-4020-9b65-3b99bee3685d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:52.296421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ebb64a4f-9c38-4020-9b65-3b99bee3685d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:52.297995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ebb64a4f-9c38-4020-9b65-3b99bee3685d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:52.298681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ebb64a4f-9c38-4020-9b65-3b99bee3685d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:52.423633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:52.424352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:52.450956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:52.453733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:52.454457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:52.456340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:52.458416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:52.460954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:52.523456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:53.203005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:53.213461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:53.223822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:53.227275 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b4e6e54e-f5e9-4137-882c-259114d1a349 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2258 microversion: 2.32 time: 0.806403 Sep 10 10:59:53.228877 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3276/4200] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:52 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2258 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:59:53.246860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9cedb2dd-2289-4973-a284-a092a523ed13 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:53.248346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9cedb2dd-2289-4973-a284-a092a523ed13 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:53.260996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cedb2dd-2289-4973-a284-a092a523ed13 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:53.261529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cedb2dd-2289-4973-a284-a092a523ed13 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:53.261983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cedb2dd-2289-4973-a284-a092a523ed13 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:53.262677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cedb2dd-2289-4973-a284-a092a523ed13 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:53.263135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cedb2dd-2289-4973-a284-a092a523ed13 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:53.263562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9cedb2dd-2289-4973-a284-a092a523ed13 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:53.396605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:53.752905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ebb64a4f-9c38-4020-9b65-3b99bee3685d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:53.772278 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ebb64a4f-9c38-4020-9b65-3b99bee3685d tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1496 microversion: 2.1 time: 1.505964 Sep 10 10:59:53.772880 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 925/4201] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:52 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1496 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:53.802357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:53.803223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:53.814278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:53.821049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:53.821959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:53.822942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:53.824735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:53.826998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:53.914626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lazy-loading 'flavor' on Instance uuid f1fff5af-b5bc-4a39-a5a3-81c17a2b397b {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 10:59:53.943449 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Cannot 'suspend' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state suspended Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action HTTP/1.1 Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 15 Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: {"suspend": {}} Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: exception: Cannot 'suspend' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state suspended Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f1fff5af-b5bc-4a39-a5a3-81c17a2b397b', 'body': {'suspend': {}}} Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b in vm_state suspended. Cannot suspend while the instance is in this state. Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 10 10:59:53.974003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state suspended Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state suspended Sep 10 10:59:53.979625 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 10:59:53.984561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 409 to user: Cannot 'suspend' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state suspended {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 10:59:53.985875 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ce48a6b-68f7-4d2e-b958-ff4eb18e8590 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 409 len: 148 microversion: 2.1 time: 0.189434 Sep 10 10:59:53.995320 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 926/4202] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:59:53 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 148 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 10:59:54.008220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cc487bbd-811d-4f90-9eae-2c0adb7c56c7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:54.009178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cc487bbd-811d-4f90-9eae-2c0adb7c56c7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:54.022505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc487bbd-811d-4f90-9eae-2c0adb7c56c7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:54.064047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc487bbd-811d-4f90-9eae-2c0adb7c56c7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:54.066957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc487bbd-811d-4f90-9eae-2c0adb7c56c7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:54.078215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc487bbd-811d-4f90-9eae-2c0adb7c56c7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:54.080027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc487bbd-811d-4f90-9eae-2c0adb7c56c7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:54.082745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9cedb2dd-2289-4973-a284-a092a523ed13 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:54.085159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc487bbd-811d-4f90-9eae-2c0adb7c56c7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:54.106948 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9cedb2dd-2289-4973-a284-a092a523ed13 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1313 microversion: 2.1 time: 0.876440 Sep 10 10:59:54.107890 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3277/4203] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:53 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1313 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:54.256296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:54.258875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:54.269417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:54.272842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:54.274132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:54.275607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:54.278558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:54.280783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:54.326244 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cc487bbd-811d-4f90-9eae-2c0adb7c56c7 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 202 len: 0 microversion: 2.1 time: 0.329028 Sep 10 10:59:54.337700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 10:59:54.344285 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 927/4204] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 10:59:53 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 10:59:54.386674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e2f2fe6-253f-47fe-b051-33e3fa28bc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:54.387446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1e2f2fe6-253f-47fe-b051-33e3fa28bc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:54.424350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e2f2fe6-253f-47fe-b051-33e3fa28bc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:54.424875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e2f2fe6-253f-47fe-b051-33e3fa28bc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:54.425342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e2f2fe6-253f-47fe-b051-33e3fa28bc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:54.426056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e2f2fe6-253f-47fe-b051-33e3fa28bc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:54.447043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e2f2fe6-253f-47fe-b051-33e3fa28bc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:54.447513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e2f2fe6-253f-47fe-b051-33e3fa28bc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:55.374886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:55.400629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:55.407589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:55.412454 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e75f2066-f580-4549-884d-1c3397232e58 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2211 microversion: 2.32 time: 1.161096 Sep 10 10:59:55.418580 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3278/4205] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:54 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2211 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:59:55.440889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-38b50fdc-56bc-4998-89d7-b8173e45e613 req-603af403-2ea6-4437-a5f9-879cd44fa689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-deleted", "tag": "afc48537-d094-475a-90d1-6025c8a4d182"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:55.474160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-38b50fdc-56bc-4998-89d7-b8173e45e613 req-603af403-2ea6-4437-a5f9-879cd44fa689 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:55.475628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-38b50fdc-56bc-4998-89d7-b8173e45e613 req-603af403-2ea6-4437-a5f9-879cd44fa689 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:55.476486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-38b50fdc-56bc-4998-89d7-b8173e45e613 req-603af403-2ea6-4437-a5f9-879cd44fa689 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:55.534446 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-38b50fdc-56bc-4998-89d7-b8173e45e613 req-603af403-2ea6-4437-a5f9-879cd44fa689 service nova] Creating event network-vif-deleted:afc48537-d094-475a-90d1-6025c8a4d182 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 10:59:55.535936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1e2f2fe6-253f-47fe-b051-33e3fa28bc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:55.544102 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1e2f2fe6-253f-47fe-b051-33e3fa28bc44 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1502 microversion: 2.1 time: 1.198377 Sep 10 10:59:55.548824 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-38b50fdc-56bc-4998-89d7-b8173e45e613 req-603af403-2ea6-4437-a5f9-879cd44fa689 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123327 Sep 10 10:59:55.549568 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3279/4206] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:59:55.549925 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 928/4207] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:54 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1502 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:55.563682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43ff57cc-9694-4cf4-b160-52d2fa552bb2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:55.569402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-43ff57cc-9694-4cf4-b160-52d2fa552bb2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:55.582144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43ff57cc-9694-4cf4-b160-52d2fa552bb2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:55.584224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43ff57cc-9694-4cf4-b160-52d2fa552bb2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:55.586009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43ff57cc-9694-4cf4-b160-52d2fa552bb2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:55.588651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43ff57cc-9694-4cf4-b160-52d2fa552bb2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:55.592457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43ff57cc-9694-4cf4-b160-52d2fa552bb2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:55.593288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43ff57cc-9694-4cf4-b160-52d2fa552bb2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:56.446671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:56.447701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:56.462961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:56.469950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:56.471060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:56.472370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:56.473117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:56.477447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:56.921865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-43ff57cc-9694-4cf4-b160-52d2fa552bb2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:56.940213 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43ff57cc-9694-4cf4-b160-52d2fa552bb2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1313 microversion: 2.1 time: 1.386597 Sep 10 10:59:56.940870 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3280/4208] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:55 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1313 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:56.966707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b73fbd77-c23e-4865-98f8-1fabd8b27107 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:56.967596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b73fbd77-c23e-4865-98f8-1fabd8b27107 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:56.975229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b73fbd77-c23e-4865-98f8-1fabd8b27107 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:56.976615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b73fbd77-c23e-4865-98f8-1fabd8b27107 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:56.977507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b73fbd77-c23e-4865-98f8-1fabd8b27107 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:56.978404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b73fbd77-c23e-4865-98f8-1fabd8b27107 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:56.979153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b73fbd77-c23e-4865-98f8-1fabd8b27107 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:56.979750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b73fbd77-c23e-4865-98f8-1fabd8b27107 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:57.130267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:57.166122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:57.173638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:57.180262 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ccf896f1-edcc-488f-b8f1-217d528dfd52 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 2054 microversion: 2.32 time: 0.733836 Sep 10 10:59:57.181218 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 929/4209] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:56 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 2054 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 10:59:57.210543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-105512469", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:57.357041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] validate_networks() for None {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 10:59:57.681051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b73fbd77-c23e-4865-98f8-1fabd8b27107 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:57.689683 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b73fbd77-c23e-4865-98f8-1fabd8b27107 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1502 microversion: 2.1 time: 0.733866 Sep 10 10:59:57.695469 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3281/4210] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:56 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1502 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:57.706586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-dfff29da-711e-4f8a-a7d4-3eee99d69cc8 req-b053924e-ba9c-4ab5-b33a-d971750c8a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1ec97f-3e6c-403e-a398-61c0869e5de7", "tag": "dc1f3c24-c69a-4e8e-8e2c-1939935d7450"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 10:59:57.824090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dfff29da-711e-4f8a-a7d4-3eee99d69cc8 req-b053924e-ba9c-4ab5-b33a-d971750c8a29 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:57.824598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dfff29da-711e-4f8a-a7d4-3eee99d69cc8 req-b053924e-ba9c-4ab5-b33a-d971750c8a29 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:57.825037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dfff29da-711e-4f8a-a7d4-3eee99d69cc8 req-b053924e-ba9c-4ab5-b33a-d971750c8a29 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:57.876784 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-dfff29da-711e-4f8a-a7d4-3eee99d69cc8 req-b053924e-ba9c-4ab5-b33a-d971750c8a29 service nova] Creating event network-changed:dc1f3c24-c69a-4e8e-8e2c-1939935d7450 for instance 4e1ec97f-3e6c-403e-a398-61c0869e5de7 on n-h2-856894-1 Sep 10 10:59:57.882300 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-dfff29da-711e-4f8a-a7d4-3eee99d69cc8 req-b053924e-ba9c-4ab5-b33a-d971750c8a29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185348 Sep 10 10:59:57.883723 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3282/4211] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 10:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 10:59:57.970329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-adcf0aeb-35a2-4d66-9dd5-6c4a2a3459f3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:57.971065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-adcf0aeb-35a2-4d66-9dd5-6c4a2a3459f3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:57.990069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adcf0aeb-35a2-4d66-9dd5-6c4a2a3459f3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:57.995807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adcf0aeb-35a2-4d66-9dd5-6c4a2a3459f3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:57.996281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adcf0aeb-35a2-4d66-9dd5-6c4a2a3459f3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:57.998082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adcf0aeb-35a2-4d66-9dd5-6c4a2a3459f3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:57.998574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adcf0aeb-35a2-4d66-9dd5-6c4a2a3459f3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:57.999009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-adcf0aeb-35a2-4d66-9dd5-6c4a2a3459f3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:58.380562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 10:59:58.381212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 10:59:58.381701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 10:59:58.382540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 10:59:58.383037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 10:59:58.415347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-adcf0aeb-35a2-4d66-9dd5-6c4a2a3459f3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:58.417056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:58.421262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:58.421716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:58.428892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:58.429653 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-adcf0aeb-35a2-4d66-9dd5-6c4a2a3459f3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1313 microversion: 2.1 time: 0.463327 Sep 10 10:59:58.430059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:58.430761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:58.446764 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3283/4212] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:57 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:58.463250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:58.468288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:58.483749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:58.484269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:58.484729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:58.490466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:58.491013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:58.491567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:58.500431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Getting quotas for project acd55e44bdc940d5bb6a06c790930cff. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 10:59:58.530791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Getting quotas for user bbc6a08f4f654a80b23b70123aa918ab and project acd55e44bdc940d5bb6a06c790930cff. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 10:59:58.603830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 10:59:58.632210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 10:59:58.636078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:58.662745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:58.664898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:58.666407 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9e1c51a2-18ae-4361-8c00-26aa8a4a3fcd tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.217402 Sep 10 10:59:58.667175 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3284/4213] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 10:59:58 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 10:59:58.720794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41ea0c4a-e317-4786-9447-1157a6117a48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:58.722000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-41ea0c4a-e317-4786-9447-1157a6117a48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:58.729792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ea0c4a-e317-4786-9447-1157a6117a48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:58.734035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ea0c4a-e317-4786-9447-1157a6117a48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:58.734767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ea0c4a-e317-4786-9447-1157a6117a48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:58.737654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ea0c4a-e317-4786-9447-1157a6117a48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:58.738394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ea0c4a-e317-4786-9447-1157a6117a48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:58.743161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41ea0c4a-e317-4786-9447-1157a6117a48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:58.831913 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-da957d76-d12b-436a-bec0-8166ca36b189 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646395 Sep 10 10:59:58.832651 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 930/4214] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 10:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 10:59:58.864419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c4814067-ef56-4380-8e88-108d095748f7 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:58.865252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c4814067-ef56-4380-8e88-108d095748f7 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:59.108635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c4814067-ef56-4380-8e88-108d095748f7 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:59.151324 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c4814067-ef56-4380-8e88-108d095748f7 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1214 microversion: 2.1 time: 0.310581 Sep 10 10:59:59.152658 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 931/4215] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:58 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 10:59:59.462530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-41ea0c4a-e317-4786-9447-1157a6117a48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 10:59:59.467379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9298976b-9c84-4b9f-9c6a-d70ad6c5f657 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:59.470555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9298976b-9c84-4b9f-9c6a-d70ad6c5f657 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:59.503264 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41ea0c4a-e317-4786-9447-1157a6117a48 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.784544 Sep 10 10:59:59.506451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9298976b-9c84-4b9f-9c6a-d70ad6c5f657 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:59.506720 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3285/4216] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:58 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 10:59:59.508032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9298976b-9c84-4b9f-9c6a-d70ad6c5f657 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:59.509640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9298976b-9c84-4b9f-9c6a-d70ad6c5f657 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:59.513904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9298976b-9c84-4b9f-9c6a-d70ad6c5f657 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:59.514736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9298976b-9c84-4b9f-9c6a-d70ad6c5f657 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:59.515181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9298976b-9c84-4b9f-9c6a-d70ad6c5f657 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:59.537247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a7a4c7b6-a339-46d7-af37-f2035e811239 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 10:59:59.538163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a7a4c7b6-a339-46d7-af37-f2035e811239 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 10:59:59.551885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7a4c7b6-a339-46d7-af37-f2035e811239 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:59.552686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7a4c7b6-a339-46d7-af37-f2035e811239 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:59.553676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7a4c7b6-a339-46d7-af37-f2035e811239 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 10:59:59.554567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7a4c7b6-a339-46d7-af37-f2035e811239 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 10:59:59.555200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7a4c7b6-a339-46d7-af37-f2035e811239 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 10:59:59.555959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a7a4c7b6-a339-46d7-af37-f2035e811239 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:01.178477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9298976b-9c84-4b9f-9c6a-d70ad6c5f657 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:01.190201 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9298976b-9c84-4b9f-9c6a-d70ad6c5f657 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1313 microversion: 2.1 time: 1.737947 Sep 10 11:00:01.193458 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 932/4217] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:59 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1313 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:01.211067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:01.216247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:01.244988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:01.254049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:01.255198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:01.255988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:01.256466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:01.256904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:01.292131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a7a4c7b6-a339-46d7-af37-f2035e811239 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:01.333332 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a7a4c7b6-a339-46d7-af37-f2035e811239 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.800291 Sep 10 11:00:01.353035 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3286/4218] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 10:59:59 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:01.361491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f2af890-676d-430e-91dc-d97eb65cfa6c tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:01.363090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f2af890-676d-430e-91dc-d97eb65cfa6c tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:01.372759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f2af890-676d-430e-91dc-d97eb65cfa6c tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:01.373625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f2af890-676d-430e-91dc-d97eb65cfa6c tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:01.374265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f2af890-676d-430e-91dc-d97eb65cfa6c tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:01.382472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f2af890-676d-430e-91dc-d97eb65cfa6c tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:01.385531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f2af890-676d-430e-91dc-d97eb65cfa6c tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:01.386614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f2af890-676d-430e-91dc-d97eb65cfa6c tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:01.622329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:01.643560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:01.646243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:01.647649 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-72bb1de4-0e71-4a46-ae73-d57b3ea93db7 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.451082 Sep 10 11:00:01.648767 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 933/4219] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:01 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:01.665473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-b12f955a-e4a5-4f36-9fe0-4ae735dc8c23 req-2b5d5bd7-4da9-48a7-b01d-04c72747a9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a641a1a1-b437-4c58-bf5d-70366328d939", "name": "network-vif-deleted", "tag": "0e5561b7-d18e-4cc7-baa7-94dad55f2c42"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:01.694169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:01.697149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b12f955a-e4a5-4f36-9fe0-4ae735dc8c23 req-2b5d5bd7-4da9-48a7-b01d-04c72747a9c8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:01.697823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b12f955a-e4a5-4f36-9fe0-4ae735dc8c23 req-2b5d5bd7-4da9-48a7-b01d-04c72747a9c8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:01.698410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b12f955a-e4a5-4f36-9fe0-4ae735dc8c23 req-2b5d5bd7-4da9-48a7-b01d-04c72747a9c8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:01.715029 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-b12f955a-e4a5-4f36-9fe0-4ae735dc8c23 req-2b5d5bd7-4da9-48a7-b01d-04c72747a9c8 service nova] Creating event network-vif-deleted:0e5561b7-d18e-4cc7-baa7-94dad55f2c42 for instance a641a1a1-b437-4c58-bf5d-70366328d939 on n-h2-856894-1 Sep 10 11:00:01.720609 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-b12f955a-e4a5-4f36-9fe0-4ae735dc8c23 req-2b5d5bd7-4da9-48a7-b01d-04c72747a9c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070386 Sep 10 11:00:01.722058 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 934/4220] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:01.727907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6895f3cc-d5b2-4e00-90ec-7ad1018369fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:01.729014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6895f3cc-d5b2-4e00-90ec-7ad1018369fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: 31abcc67-04d1-44e6-b5bd-eab612924cce] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:01.735256 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-6895f3cc-d5b2-4e00-90ec-7ad1018369fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance 31abcc67-04d1-44e6-b5bd-eab612924cce could not be found. Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6895f3cc-d5b2-4e00-90ec-7ad1018369fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/31abcc67-04d1-44e6-b5bd-eab612924cce/action HTTP/1.1 Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 15 Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: {"unpause": {}} Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 31abcc67-04d1-44e6-b5bd-eab612924cce could not be found. Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '31abcc67-04d1-44e6-b5bd-eab612924cce', 'body': {'unpause': {}}} Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31abcc67-04d1-44e6-b5bd-eab612924cce could not be found. Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31abcc67-04d1-44e6-b5bd-eab612924cce could not be found. Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:01.737096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:01.740825 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:01.740825 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:01.740825 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31abcc67-04d1-44e6-b5bd-eab612924cce could not be found. Sep 10 11:00:01.740825 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:01.741738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6895f3cc-d5b2-4e00-90ec-7ad1018369fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance 31abcc67-04d1-44e6-b5bd-eab612924cce could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:01.742736 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6895f3cc-d5b2-4e00-90ec-7ad1018369fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/31abcc67-04d1-44e6-b5bd-eab612924cce/action" status: 404 len: 111 microversion: 2.1 time: 0.019152 Sep 10 11:00:01.743476 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 935/4221] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:00:01 2022] POST /compute/v2.1/servers/31abcc67-04d1-44e6-b5bd-eab612924cce/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:00:01.751731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-88480604-df7a-4859-862d-9d062237ea69 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:01.754112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-88480604-df7a-4859-862d-9d062237ea69 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:01.768091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88480604-df7a-4859-862d-9d062237ea69 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:01.771539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88480604-df7a-4859-862d-9d062237ea69 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:01.773860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88480604-df7a-4859-862d-9d062237ea69 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:01.776911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88480604-df7a-4859-862d-9d062237ea69 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:01.778243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88480604-df7a-4859-862d-9d062237ea69 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:01.779561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88480604-df7a-4859-862d-9d062237ea69 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:01.830516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f2af890-676d-430e-91dc-d97eb65cfa6c tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:01.858494 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f2af890-676d-430e-91dc-d97eb65cfa6c tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1284 microversion: 2.1 time: 0.499257 Sep 10 11:00:01.859562 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3287/4222] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:01 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1284 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:02.232690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-273376ff-f96a-4c1b-bc88-b61b6a293b3f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:02.234230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-273376ff-f96a-4c1b-bc88-b61b6a293b3f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:02.257317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:02.282262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-273376ff-f96a-4c1b-bc88-b61b6a293b3f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:02.282772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-273376ff-f96a-4c1b-bc88-b61b6a293b3f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:02.283218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-273376ff-f96a-4c1b-bc88-b61b6a293b3f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:02.290915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-273376ff-f96a-4c1b-bc88-b61b6a293b3f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:02.293484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-273376ff-f96a-4c1b-bc88-b61b6a293b3f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:02.295186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-273376ff-f96a-4c1b-bc88-b61b6a293b3f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:02.966620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-88480604-df7a-4859-862d-9d062237ea69 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:02.985554 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-88480604-df7a-4859-862d-9d062237ea69 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.233119 Sep 10 11:00:02.986495 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 936/4223] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:01 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:02.994933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:02.995786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:03.011840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:03.013309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:03.014541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:03.016105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:03.017577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:03.018838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:03.194010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:03.206843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:03.209290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:03.210759 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4303b3b8-7b90-4493-8ab4-e3ad66da8644 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.222716 Sep 10 11:00:03.225554 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 937/4224] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:02 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:03.236553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-39c7c1a9-0104-4221-8029-b997c0c530e5 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:03.237383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-39c7c1a9-0104-4221-8029-b997c0c530e5 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:03.251964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c7c1a9-0104-4221-8029-b997c0c530e5 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:03.255735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c7c1a9-0104-4221-8029-b997c0c530e5 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:03.256390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c7c1a9-0104-4221-8029-b997c0c530e5 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:03.257331 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c7c1a9-0104-4221-8029-b997c0c530e5 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:03.257946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c7c1a9-0104-4221-8029-b997c0c530e5 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:03.260440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c7c1a9-0104-4221-8029-b997c0c530e5 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:03.274392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-273376ff-f96a-4c1b-bc88-b61b6a293b3f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:03.296974 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-273376ff-f96a-4c1b-bc88-b61b6a293b3f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1313 microversion: 2.1 time: 1.078772 Sep 10 11:00:03.307534 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3288/4225] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:02 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1313 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:03.325716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1ddba32a-0296-42ab-9825-4ce3cd0b6f17 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:03.325716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1ddba32a-0296-42ab-9825-4ce3cd0b6f17 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:03.351302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ddba32a-0296-42ab-9825-4ce3cd0b6f17 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:03.351935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ddba32a-0296-42ab-9825-4ce3cd0b6f17 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:03.352394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ddba32a-0296-42ab-9825-4ce3cd0b6f17 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:03.353190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ddba32a-0296-42ab-9825-4ce3cd0b6f17 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:03.353656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ddba32a-0296-42ab-9825-4ce3cd0b6f17 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:03.356622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1ddba32a-0296-42ab-9825-4ce3cd0b6f17 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:03.595755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-39c7c1a9-0104-4221-8029-b997c0c530e5 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:03.607580 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-39c7c1a9-0104-4221-8029-b997c0c530e5 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1272 microversion: 2.1 time: 0.380540 Sep 10 11:00:03.609228 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 938/4226] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:03 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:04.246667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:04.248267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:04.251109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1ddba32a-0296-42ab-9825-4ce3cd0b6f17 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:04.259698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:04.261361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1ddba32a-0296-42ab-9825-4ce3cd0b6f17 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.950685 Sep 10 11:00:04.261831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:04.264109 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3289/4227] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:03 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:04.265738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:04.266576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:04.267056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:04.267537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:04.288801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:04.289800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:04.310855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:04.311534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:04.315569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:04.318380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:04.322609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:04.339553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:04.427794 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Cannot 'unpause' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action HTTP/1.1 Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 15 Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: {"unpause": {}} Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: exception: Cannot 'unpause' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f1fff5af-b5bc-4a39-a5a3-81c17a2b397b', 'body': {'unpause': {}}} Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b in vm_state active. Cannot unpause while the instance is in this state. Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:04.430182 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:04.434456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:04.434456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:04.434456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:04.434456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 11:00:04.434456 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:04.434456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 409 to user: Cannot 'unpause' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:04.434456 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4cb0c47e-82bd-41d4-888d-5393c7ae5e59 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 409 len: 145 microversion: 2.1 time: 0.148430 Sep 10 11:00:04.434456 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3290/4228] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:00:04 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 145 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:00:04.442397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:04.450817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ecd75078-7b1c-4aca-ba94-a83f698bb889 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:04.451713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ecd75078-7b1c-4aca-ba94-a83f698bb889 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:04.456051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:04.458403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:04.460749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecd75078-7b1c-4aca-ba94-a83f698bb889 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:04.460962 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-80780b6d-75d2-450c-9497-a1b794f03bee tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.222075 Sep 10 11:00:04.473106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecd75078-7b1c-4aca-ba94-a83f698bb889 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:04.473106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecd75078-7b1c-4aca-ba94-a83f698bb889 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:04.473106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecd75078-7b1c-4aca-ba94-a83f698bb889 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:04.473106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecd75078-7b1c-4aca-ba94-a83f698bb889 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:04.473106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecd75078-7b1c-4aca-ba94-a83f698bb889 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:04.482345 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 939/4229] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:04 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:04.490925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-cd254d69-5656-4c15-946b-1d34caf726b1 req-1891be71-2f9d-491a-8e59-87b21ad7aa7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ec97f-3e6c-403e-a398-61c0869e5de7", "name": "network-vif-plugged", "status": "completed", "tag": "dc1f3c24-c69a-4e8e-8e2c-1939935d7450"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:04.522181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cd254d69-5656-4c15-946b-1d34caf726b1 req-1891be71-2f9d-491a-8e59-87b21ad7aa7a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:04.525129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cd254d69-5656-4c15-946b-1d34caf726b1 req-1891be71-2f9d-491a-8e59-87b21ad7aa7a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:04.525875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cd254d69-5656-4c15-946b-1d34caf726b1 req-1891be71-2f9d-491a-8e59-87b21ad7aa7a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:04.552940 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-cd254d69-5656-4c15-946b-1d34caf726b1 req-1891be71-2f9d-491a-8e59-87b21ad7aa7a service nova] Creating event network-vif-plugged:dc1f3c24-c69a-4e8e-8e2c-1939935d7450 for instance 4e1ec97f-3e6c-403e-a398-61c0869e5de7 on n-h2-856894-1 Sep 10 11:00:04.566772 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-cd254d69-5656-4c15-946b-1d34caf726b1 req-1891be71-2f9d-491a-8e59-87b21ad7aa7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079959 Sep 10 11:00:04.570858 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 940/4230] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:04.576649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b756fbb8-377f-433c-9f54-e789c45cdfed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:04.585180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b756fbb8-377f-433c-9f54-e789c45cdfed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:04.605663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b756fbb8-377f-433c-9f54-e789c45cdfed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:04.606532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b756fbb8-377f-433c-9f54-e789c45cdfed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:04.607262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b756fbb8-377f-433c-9f54-e789c45cdfed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:04.608221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b756fbb8-377f-433c-9f54-e789c45cdfed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:04.608885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b756fbb8-377f-433c-9f54-e789c45cdfed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:04.609562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b756fbb8-377f-433c-9f54-e789c45cdfed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:05.554545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ecd75078-7b1c-4aca-ba94-a83f698bb889 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:05.567941 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ecd75078-7b1c-4aca-ba94-a83f698bb889 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1313 microversion: 2.1 time: 1.133806 Sep 10 11:00:05.581106 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3291/4231] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:04 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1313 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:05.581106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a289f19c-6c9c-4512-b601-2f0d734aa3ac tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:05.581106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a289f19c-6c9c-4512-b601-2f0d734aa3ac tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:05.595365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289f19c-6c9c-4512-b601-2f0d734aa3ac tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:05.595871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289f19c-6c9c-4512-b601-2f0d734aa3ac tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:05.596312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289f19c-6c9c-4512-b601-2f0d734aa3ac tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:05.597034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289f19c-6c9c-4512-b601-2f0d734aa3ac tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:05.597532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289f19c-6c9c-4512-b601-2f0d734aa3ac tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:05.597960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a289f19c-6c9c-4512-b601-2f0d734aa3ac tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:05.736074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b756fbb8-377f-433c-9f54-e789c45cdfed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:05.758404 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b756fbb8-377f-433c-9f54-e789c45cdfed tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.185988 Sep 10 11:00:05.759012 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 941/4232] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:04 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:05.784775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:05.786712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:05.794504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:05.795207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:05.795930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:05.796876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:05.799313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:05.799971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:05.974494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a289f19c-6c9c-4512-b601-2f0d734aa3ac tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:05.985986 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a289f19c-6c9c-4512-b601-2f0d734aa3ac tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1272 microversion: 2.1 time: 0.415920 Sep 10 11:00:06.001832 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3292/4233] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:05 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1272 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:06.012749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8304ffe1-beed-409d-8623-ef4b760ba589 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:06.013471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8304ffe1-beed-409d-8623-ef4b760ba589 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:06.031976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8304ffe1-beed-409d-8623-ef4b760ba589 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:06.034330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8304ffe1-beed-409d-8623-ef4b760ba589 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:06.037463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8304ffe1-beed-409d-8623-ef4b760ba589 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:06.038765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8304ffe1-beed-409d-8623-ef4b760ba589 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:06.039431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8304ffe1-beed-409d-8623-ef4b760ba589 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:06.041781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8304ffe1-beed-409d-8623-ef4b760ba589 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:06.352834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:06.379310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:06.381226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:06.386178 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-287882df-001b-402d-a792-5a8f67fd8684 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.609825 Sep 10 11:00:06.415065 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 942/4234] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:05 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:06.597708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-01932aec-c864-4ff2-b4f8-21ce9766ee0c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:06.598498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-01932aec-c864-4ff2-b4f8-21ce9766ee0c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:06.609671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01932aec-c864-4ff2-b4f8-21ce9766ee0c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:06.611523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01932aec-c864-4ff2-b4f8-21ce9766ee0c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:06.617527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01932aec-c864-4ff2-b4f8-21ce9766ee0c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:06.618620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01932aec-c864-4ff2-b4f8-21ce9766ee0c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:06.619098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01932aec-c864-4ff2-b4f8-21ce9766ee0c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:06.619530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01932aec-c864-4ff2-b4f8-21ce9766ee0c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:06.622637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:07.073908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8304ffe1-beed-409d-8623-ef4b760ba589 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:07.085585 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8304ffe1-beed-409d-8623-ef4b760ba589 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.082524 Sep 10 11:00:07.087040 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3293/4235] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:06 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:07.091828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-611ec0df-8290-49b5-a320-d5d088546c71 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:07.092698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-611ec0df-8290-49b5-a320-d5d088546c71 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:07.100629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-611ec0df-8290-49b5-a320-d5d088546c71 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:07.101359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-611ec0df-8290-49b5-a320-d5d088546c71 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:07.102287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-611ec0df-8290-49b5-a320-d5d088546c71 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:07.106692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-611ec0df-8290-49b5-a320-d5d088546c71 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:07.107412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-611ec0df-8290-49b5-a320-d5d088546c71 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:07.108316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-611ec0df-8290-49b5-a320-d5d088546c71 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:07.409885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-01932aec-c864-4ff2-b4f8-21ce9766ee0c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:07.425561 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-01932aec-c864-4ff2-b4f8-21ce9766ee0c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1498 microversion: 2.1 time: 0.834378 Sep 10 11:00:07.427231 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 943/4236] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:06 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1498 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:07.432699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b207c5b-f40c-4018-9e4e-574d4add7be8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:07.433547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0b207c5b-f40c-4018-9e4e-574d4add7be8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: 00cbb71b-9ca0-4b25-96ff-546a0a1b13f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:07.442819 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-0b207c5b-f40c-4018-9e4e-574d4add7be8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance 00cbb71b-9ca0-4b25-96ff-546a0a1b13f8 could not be found. Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b207c5b-f40c-4018-9e4e-574d4add7be8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/00cbb71b-9ca0-4b25-96ff-546a0a1b13f8/action HTTP/1.1 Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 18 Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: {"unshelve": null} Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 00cbb71b-9ca0-4b25-96ff-546a0a1b13f8 could not be found. Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '00cbb71b-9ca0-4b25-96ff-546a0a1b13f8', 'body': {'unshelve': None}} Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00cbb71b-9ca0-4b25-96ff-546a0a1b13f8 could not be found. Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00cbb71b-9ca0-4b25-96ff-546a0a1b13f8 could not be found. Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:07.444905 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:07.448022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:07.448022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:07.448022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:07.448022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:07.448022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:07.448022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:07.448022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00cbb71b-9ca0-4b25-96ff-546a0a1b13f8 could not be found. Sep 10 11:00:07.448022 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:07.450133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b207c5b-f40c-4018-9e4e-574d4add7be8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance 00cbb71b-9ca0-4b25-96ff-546a0a1b13f8 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:07.451406 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0b207c5b-f40c-4018-9e4e-574d4add7be8 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/00cbb71b-9ca0-4b25-96ff-546a0a1b13f8/action" status: 404 len: 111 microversion: 2.1 time: 0.022977 Sep 10 11:00:07.452780 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 944/4237] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:00:07 2022] POST /compute/v2.1/servers/00cbb71b-9ca0-4b25-96ff-546a0a1b13f8/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:00:07.458854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:07.459718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:07.468652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:07.470215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:07.475941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:07.476941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:07.478074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:07.478740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:07.634803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-611ec0df-8290-49b5-a320-d5d088546c71 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:07.650161 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-611ec0df-8290-49b5-a320-d5d088546c71 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1314 microversion: 2.1 time: 0.561555 Sep 10 11:00:07.651953 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3294/4238] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:07 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:07.661302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02c8d422-f959-4f47-8ffb-d724c27df21d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:07.665037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02c8d422-f959-4f47-8ffb-d724c27df21d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:07.682562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02c8d422-f959-4f47-8ffb-d724c27df21d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:07.683430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02c8d422-f959-4f47-8ffb-d724c27df21d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:07.684090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02c8d422-f959-4f47-8ffb-d724c27df21d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:07.685419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:07.685833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02c8d422-f959-4f47-8ffb-d724c27df21d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:07.686997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02c8d422-f959-4f47-8ffb-d724c27df21d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:07.687640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02c8d422-f959-4f47-8ffb-d724c27df21d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:07.721490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:07.724642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:07.726849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-02c8d422-f959-4f47-8ffb-d724c27df21d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lazy-loading 'flavor' on Instance uuid 4e1ec97f-3e6c-403e-a398-61c0869e5de7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:00:07.731744 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7510aef7-51e0-402d-81a6-4973d0895aa0 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.277591 Sep 10 11:00:07.732328 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 945/4239] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:07 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:07.743504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4f9242cf-27f7-4640-83f1-b6b6c5cb9883 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:07.745690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4f9242cf-27f7-4640-83f1-b6b6c5cb9883 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:07.764970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f9242cf-27f7-4640-83f1-b6b6c5cb9883 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:07.766410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f9242cf-27f7-4640-83f1-b6b6c5cb9883 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:07.771545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f9242cf-27f7-4640-83f1-b6b6c5cb9883 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:07.774383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f9242cf-27f7-4640-83f1-b6b6c5cb9883 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:07.775009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f9242cf-27f7-4640-83f1-b6b6c5cb9883 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:07.776323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f9242cf-27f7-4640-83f1-b6b6c5cb9883 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:07.790969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:07.890604 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02c8d422-f959-4f47-8ffb-d724c27df21d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "POST /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7/action" status: 200 len: 32 microversion: 2.1 time: 0.236198 Sep 10 11:00:07.892205 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3295/4240] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:00:07 2022] POST /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:00:07.911503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b070ef19-0d32-4099-af68-5aca5acc8e32 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:07.913096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b070ef19-0d32-4099-af68-5aca5acc8e32 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:07.929674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b070ef19-0d32-4099-af68-5aca5acc8e32 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:07.930729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b070ef19-0d32-4099-af68-5aca5acc8e32 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:07.932304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b070ef19-0d32-4099-af68-5aca5acc8e32 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:07.935345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b070ef19-0d32-4099-af68-5aca5acc8e32 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:07.936073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b070ef19-0d32-4099-af68-5aca5acc8e32 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:07.937307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b070ef19-0d32-4099-af68-5aca5acc8e32 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:08.452063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:08.540805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4f9242cf-27f7-4640-83f1-b6b6c5cb9883 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:08.550050 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4f9242cf-27f7-4640-83f1-b6b6c5cb9883 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.815003 Sep 10 11:00:08.553549 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 946/4241] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:07 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:08.575741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-25a98bc3-519b-460e-a582-7f5340c1b962 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:08.577509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-25a98bc3-519b-460e-a582-7f5340c1b962 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:08.584946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25a98bc3-519b-460e-a582-7f5340c1b962 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:08.586177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25a98bc3-519b-460e-a582-7f5340c1b962 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:08.586849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25a98bc3-519b-460e-a582-7f5340c1b962 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:08.587953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25a98bc3-519b-460e-a582-7f5340c1b962 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:08.588617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25a98bc3-519b-460e-a582-7f5340c1b962 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:08.589279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25a98bc3-519b-460e-a582-7f5340c1b962 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:08.601929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b070ef19-0d32-4099-af68-5aca5acc8e32 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:08.617519 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b070ef19-0d32-4099-af68-5aca5acc8e32 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.709425 Sep 10 11:00:08.618181 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3296/4242] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:07 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:08.677757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e449660d-c449-4546-8d81-46e7b07f7731 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:08.678378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e449660d-c449-4546-8d81-46e7b07f7731 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:08.689765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e449660d-c449-4546-8d81-46e7b07f7731 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:08.690825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e449660d-c449-4546-8d81-46e7b07f7731 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:08.692006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e449660d-c449-4546-8d81-46e7b07f7731 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:08.694329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e449660d-c449-4546-8d81-46e7b07f7731 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:08.694821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e449660d-c449-4546-8d81-46e7b07f7731 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:08.695261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e449660d-c449-4546-8d81-46e7b07f7731 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:09.121535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:09.633469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-25a98bc3-519b-460e-a582-7f5340c1b962 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:09.646193 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-25a98bc3-519b-460e-a582-7f5340c1b962 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 1.074511 Sep 10 11:00:09.648493 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 947/4243] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:08 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:09.662961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:09.665420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:09.682379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:09.684380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:09.686402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:09.687325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:09.689496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:09.690270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:09.709503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e449660d-c449-4546-8d81-46e7b07f7731 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:09.723933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e449660d-c449-4546-8d81-46e7b07f7731 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1314 microversion: 2.1 time: 1.050156 Sep 10 11:00:09.724547 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3297/4244] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:08 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:09.736097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ed01bf7-7ec8-4b7b-b5bd-bf3ea27acd8f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:09.736910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ed01bf7-7ec8-4b7b-b5bd-bf3ea27acd8f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:09.744286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ed01bf7-7ec8-4b7b-b5bd-bf3ea27acd8f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:09.744787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ed01bf7-7ec8-4b7b-b5bd-bf3ea27acd8f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:09.745279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ed01bf7-7ec8-4b7b-b5bd-bf3ea27acd8f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:09.745987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ed01bf7-7ec8-4b7b-b5bd-bf3ea27acd8f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:09.746450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ed01bf7-7ec8-4b7b-b5bd-bf3ea27acd8f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:09.747375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ed01bf7-7ec8-4b7b-b5bd-bf3ea27acd8f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:09.839152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:09.854332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:09.858003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:09.865178 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9d55e9db-21a4-4547-bc4d-80b937ad1a77 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.212270 Sep 10 11:00:09.867073 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 948/4245] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:09 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:09.875798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:09.876623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:09.891974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:09.897164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:09.898593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:09.901947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:09.902445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:09.902884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:10.105669 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Cannot 'unshelve' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action HTTP/1.1 Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 18 Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: {"unshelve": null} Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: exception: Cannot 'unshelve' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f1fff5af-b5bc-4a39-a5a3-81c17a2b397b', 'body': {'unshelve': None}} Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b in vm_state active. Cannot unshelve while the instance is in this state. Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 11:00:10.111556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active Sep 10 11:00:10.114987 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:10.116572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 409 to user: Cannot 'unshelve' instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b while it is in vm_state active {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:10.123288 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-776207c3-eb27-4766-a69a-b32f51c91db4 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action" status: 409 len: 146 microversion: 2.1 time: 0.250678 Sep 10 11:00:10.124559 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 949/4246] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:00:09 2022] POST /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b/action => generated 146 bytes in 257 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:00:10.133052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-093ab55e-04bb-4157-bc6f-260b28208b9a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:10.133979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-093ab55e-04bb-4157-bc6f-260b28208b9a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:10.140560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-093ab55e-04bb-4157-bc6f-260b28208b9a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:10.141341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-093ab55e-04bb-4157-bc6f-260b28208b9a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:10.141947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-093ab55e-04bb-4157-bc6f-260b28208b9a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:10.142910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-093ab55e-04bb-4157-bc6f-260b28208b9a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:10.143530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-093ab55e-04bb-4157-bc6f-260b28208b9a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:10.144103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-093ab55e-04bb-4157-bc6f-260b28208b9a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:10.270471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5ed01bf7-7ec8-4b7b-b5bd-bf3ea27acd8f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:10.287493 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ed01bf7-7ec8-4b7b-b5bd-bf3ea27acd8f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.561686 Sep 10 11:00:10.292791 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3298/4247] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:09 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:10.475405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-093ab55e-04bb-4157-bc6f-260b28208b9a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:10.486120 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-093ab55e-04bb-4157-bc6f-260b28208b9a tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.357213 Sep 10 11:00:10.490149 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 950/4248] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:10 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:10.517963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1a9d730-e27a-4678-aac4-071e5f136793 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:10.518588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1a9d730-e27a-4678-aac4-071e5f136793 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:10.530263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a9d730-e27a-4678-aac4-071e5f136793 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:10.533807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a9d730-e27a-4678-aac4-071e5f136793 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:10.535217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a9d730-e27a-4678-aac4-071e5f136793 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:10.538442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a9d730-e27a-4678-aac4-071e5f136793 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:10.539650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a9d730-e27a-4678-aac4-071e5f136793 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:10.541919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1a9d730-e27a-4678-aac4-071e5f136793 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:10.748370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2235ef25-7e0f-44b4-84c4-4927a718499e tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:10.749190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2235ef25-7e0f-44b4-84c4-4927a718499e tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:10.759098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2235ef25-7e0f-44b4-84c4-4927a718499e tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:10.760566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2235ef25-7e0f-44b4-84c4-4927a718499e tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:10.761787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2235ef25-7e0f-44b4-84c4-4927a718499e tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:10.763345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2235ef25-7e0f-44b4-84c4-4927a718499e tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:10.767784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2235ef25-7e0f-44b4-84c4-4927a718499e tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:10.768511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2235ef25-7e0f-44b4-84c4-4927a718499e tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:11.028391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c1a9d730-e27a-4678-aac4-071e5f136793 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:11.038923 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1a9d730-e27a-4678-aac4-071e5f136793 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.524680 Sep 10 11:00:11.053582 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3299/4249] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:10 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:11.063427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-33ed557c-1a0e-46b8-a4a3-b7719d84b8bd req-c7ce4a83-a921-43bd-ba41-833e1576c747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa48174-eb78-4e03-b111-633422f9a832", "tag": "f349d74b-48c8-421b-af7e-35826bf55ccf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:11.075040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-33ed557c-1a0e-46b8-a4a3-b7719d84b8bd req-c7ce4a83-a921-43bd-ba41-833e1576c747 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:11.075807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-33ed557c-1a0e-46b8-a4a3-b7719d84b8bd req-c7ce4a83-a921-43bd-ba41-833e1576c747 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:11.076417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-33ed557c-1a0e-46b8-a4a3-b7719d84b8bd req-c7ce4a83-a921-43bd-ba41-833e1576c747 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:11.090940 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-33ed557c-1a0e-46b8-a4a3-b7719d84b8bd req-c7ce4a83-a921-43bd-ba41-833e1576c747 service nova] Creating event network-changed:f349d74b-48c8-421b-af7e-35826bf55ccf for instance 9fa48174-eb78-4e03-b111-633422f9a832 on n-h2-856894-1 Sep 10 11:00:11.101428 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-33ed557c-1a0e-46b8-a4a3-b7719d84b8bd req-c7ce4a83-a921-43bd-ba41-833e1576c747 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041559 Sep 10 11:00:11.102413 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3300/4250] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:11.108267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:11.109250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:11.116285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:11.116931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:11.117539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:11.118364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:11.119064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:11.119711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:11.212245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2235ef25-7e0f-44b4-84c4-4927a718499e tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:11.228636 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2235ef25-7e0f-44b4-84c4-4927a718499e tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1314 microversion: 2.1 time: 0.483327 Sep 10 11:00:11.229864 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 951/4251] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:10 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:11.236467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1f19696c-a78b-4ea9-823f-f704207a62ef tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1981017570_updated"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:11.240378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1f19696c-a78b-4ea9-823f-f704207a62ef tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: 80fed3cf-4b45-4d84-bc74-c1d1a337c8f9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:11.252237 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-1f19696c-a78b-4ea9-823f-f704207a62ef tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance 80fed3cf-4b45-4d84-bc74-c1d1a337c8f9 could not be found. Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1f19696c-a78b-4ea9-823f-f704207a62ef tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: request: PUT /compute/v2.1/servers/80fed3cf-4b45-4d84-bc74-c1d1a337c8f9 HTTP/1.1 Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 81 Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1981017570_updated"}} Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 80fed3cf-4b45-4d84-bc74-c1d1a337c8f9 could not be found. Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '80fed3cf-4b45-4d84-bc74-c1d1a337c8f9', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1981017570_updated'}}} Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80fed3cf-4b45-4d84-bc74-c1d1a337c8f9 could not be found. Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 10 11:00:11.257284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80fed3cf-4b45-4d84-bc74-c1d1a337c8f9 could not be found. Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80fed3cf-4b45-4d84-bc74-c1d1a337c8f9 could not be found. Sep 10 11:00:11.265003 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:11.266992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:11.268939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1f19696c-a78b-4ea9-823f-f704207a62ef tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance 80fed3cf-4b45-4d84-bc74-c1d1a337c8f9 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:11.269143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:11.271055 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1f19696c-a78b-4ea9-823f-f704207a62ef tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "PUT /compute/v2.1/servers/80fed3cf-4b45-4d84-bc74-c1d1a337c8f9" status: 404 len: 111 microversion: 2.1 time: 0.038707 Sep 10 11:00:11.271507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:11.273065 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f91a6aa2-b1d6-4d42-b7af-b7d7e25fc33d tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.169584 Sep 10 11:00:11.274104 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3301/4252] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:11 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:11.275692 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 952/4253] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Sep 10 11:00:11 2022] PUT /compute/v2.1/servers/80fed3cf-4b45-4d84-bc74-c1d1a337c8f9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:00:11.287776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ffb7b0ee-e1ee-4fe6-ad11-96d3a7ae3d83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:11.289451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ffb7b0ee-e1ee-4fe6-ad11-96d3a7ae3d83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:11.296598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffb7b0ee-e1ee-4fe6-ad11-96d3a7ae3d83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:11.297475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffb7b0ee-e1ee-4fe6-ad11-96d3a7ae3d83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:11.298333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffb7b0ee-e1ee-4fe6-ad11-96d3a7ae3d83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:11.300466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffb7b0ee-e1ee-4fe6-ad11-96d3a7ae3d83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:11.301745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffb7b0ee-e1ee-4fe6-ad11-96d3a7ae3d83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:11.302195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffb7b0ee-e1ee-4fe6-ad11-96d3a7ae3d83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:11.317536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-783f782d-2a06-4ba1-bafd-9ea3fe8a7ef0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:11.319785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-783f782d-2a06-4ba1-bafd-9ea3fe8a7ef0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:11.328027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-783f782d-2a06-4ba1-bafd-9ea3fe8a7ef0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:11.329894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-783f782d-2a06-4ba1-bafd-9ea3fe8a7ef0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:11.331374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-783f782d-2a06-4ba1-bafd-9ea3fe8a7ef0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:11.332979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-783f782d-2a06-4ba1-bafd-9ea3fe8a7ef0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:11.333750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-783f782d-2a06-4ba1-bafd-9ea3fe8a7ef0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:11.334378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-783f782d-2a06-4ba1-bafd-9ea3fe8a7ef0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:11.796105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffb7b0ee-e1ee-4fe6-ad11-96d3a7ae3d83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:11.807312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ffb7b0ee-e1ee-4fe6-ad11-96d3a7ae3d83 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.530446 Sep 10 11:00:11.808581 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3302/4254] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:11 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:11.835656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f32b9f36-5a9f-4b5a-b4bc-53d32714a13f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:11.836542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f32b9f36-5a9f-4b5a-b4bc-53d32714a13f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:11.846145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f32b9f36-5a9f-4b5a-b4bc-53d32714a13f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:11.846899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f32b9f36-5a9f-4b5a-b4bc-53d32714a13f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:11.847507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f32b9f36-5a9f-4b5a-b4bc-53d32714a13f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:11.848949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f32b9f36-5a9f-4b5a-b4bc-53d32714a13f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:11.852489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-783f782d-2a06-4ba1-bafd-9ea3fe8a7ef0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:11.862590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f32b9f36-5a9f-4b5a-b4bc-53d32714a13f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:11.863103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f32b9f36-5a9f-4b5a-b4bc-53d32714a13f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:11.867431 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-783f782d-2a06-4ba1-bafd-9ea3fe8a7ef0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.556323 Sep 10 11:00:11.868392 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 953/4255] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:11 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:12.117270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f32b9f36-5a9f-4b5a-b4bc-53d32714a13f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:12.128140 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f32b9f36-5a9f-4b5a-b4bc-53d32714a13f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.299112 Sep 10 11:00:12.130332 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3303/4256] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:11 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:12.153844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-29d3adc6-148e-47c5-9cc6-263d398831fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-29d3adc6-148e-47c5-9cc6-263d398831fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: request: PUT /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b HTTP/1.1 Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 280 Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f1fff5af-b5bc-4a39-a5a3-81c17a2b397b', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:12.158465 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-29d3adc6-148e-47c5-9cc6-263d398831fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-29d3adc6-148e-47c5-9cc6-263d398831fe tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "PUT /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 400 len: 619 microversion: 2.1 time: 0.011512 Sep 10 11:00:12.161702 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 954/4257] 10.222.0.20 () {60 vars in 1257 bytes} [Sat Sep 10 11:00:12 2022] PUT /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:00:12.168829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3bf1d443-4331-4596-b186-3b528954c3d6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:12.169484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3bf1d443-4331-4596-b186-3b528954c3d6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:12.177998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bf1d443-4331-4596-b186-3b528954c3d6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:12.178997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bf1d443-4331-4596-b186-3b528954c3d6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:12.179897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bf1d443-4331-4596-b186-3b528954c3d6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:12.181059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bf1d443-4331-4596-b186-3b528954c3d6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:12.184439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bf1d443-4331-4596-b186-3b528954c3d6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:12.185400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bf1d443-4331-4596-b186-3b528954c3d6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:12.256403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-afdf4f68-a574-40b9-9f97-dcc2dd712f2a tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:12.257089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-afdf4f68-a574-40b9-9f97-dcc2dd712f2a tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:12.270709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afdf4f68-a574-40b9-9f97-dcc2dd712f2a tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:12.273848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afdf4f68-a574-40b9-9f97-dcc2dd712f2a tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:12.274678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afdf4f68-a574-40b9-9f97-dcc2dd712f2a tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:12.275762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afdf4f68-a574-40b9-9f97-dcc2dd712f2a tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:12.276443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afdf4f68-a574-40b9-9f97-dcc2dd712f2a tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:12.277112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afdf4f68-a574-40b9-9f97-dcc2dd712f2a tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:12.796555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-afdf4f68-a574-40b9-9f97-dcc2dd712f2a tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:12.808724 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-afdf4f68-a574-40b9-9f97-dcc2dd712f2a tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1314 microversion: 2.1 time: 0.556684 Sep 10 11:00:12.809589 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 955/4258] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:12 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:12.814484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:12.815100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:12.823622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:12.824131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:12.824569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:12.825315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:12.825783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:12.826217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:12.868308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3bf1d443-4331-4596-b186-3b528954c3d6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:12.877624 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3bf1d443-4331-4596-b186-3b528954c3d6 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.712539 Sep 10 11:00:12.878581 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3304/4259] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:12 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:12.890471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b9cdef3-82a5-4383-9eca-efc93a6ecf9a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:12.891594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b9cdef3-82a5-4383-9eca-efc93a6ecf9a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:12.902161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9cdef3-82a5-4383-9eca-efc93a6ecf9a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:12.902674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9cdef3-82a5-4383-9eca-efc93a6ecf9a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:12.903748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9cdef3-82a5-4383-9eca-efc93a6ecf9a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:12.904632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9cdef3-82a5-4383-9eca-efc93a6ecf9a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:12.905203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9cdef3-82a5-4383-9eca-efc93a6ecf9a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:12.905651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b9cdef3-82a5-4383-9eca-efc93a6ecf9a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:12.935251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:12.948709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:12.950354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:12.951614 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-250e4f51-98c3-4cfb-9464-cf0110a88e14 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.140898 Sep 10 11:00:12.952496 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 956/4260] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:12 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:12.959711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-022273ed-a329-4878-9a60-588244ae0a9c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:12.960337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-022273ed-a329-4878-9a60-588244ae0a9c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:12.974522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-022273ed-a329-4878-9a60-588244ae0a9c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:12.975019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-022273ed-a329-4878-9a60-588244ae0a9c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:12.975460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-022273ed-a329-4878-9a60-588244ae0a9c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:12.976181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-022273ed-a329-4878-9a60-588244ae0a9c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:12.976636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-022273ed-a329-4878-9a60-588244ae0a9c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:12.977951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-022273ed-a329-4878-9a60-588244ae0a9c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:13.359237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-022273ed-a329-4878-9a60-588244ae0a9c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:13.370763 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-022273ed-a329-4878-9a60-588244ae0a9c tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.416858 Sep 10 11:00:13.372474 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 957/4261] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:12 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:13.397210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-611f3a7c-cbef-4099-9ad6-4a5300eeff6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:13.405471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2b9cdef3-82a5-4383-9eca-efc93a6ecf9a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-611f3a7c-cbef-4099-9ad6-4a5300eeff6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: request: PUT /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b HTTP/1.1 Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 24 Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: {"server": {"name": ""}} Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f1fff5af-b5bc-4a39-a5a3-81c17a2b397b', 'body': {'server': {'name': ''}}} Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi '' Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:00:13.415700 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-611f3a7c-cbef-4099-9ad6-4a5300eeff6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:13.418976 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-611f3a7c-cbef-4099-9ad6-4a5300eeff6f tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "PUT /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 400 len: 108 microversion: 2.1 time: 0.027477 Sep 10 11:00:13.419582 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b9cdef3-82a5-4383-9eca-efc93a6ecf9a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.532455 Sep 10 11:00:13.434669 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 958/4263] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Sep 10 11:00:13 2022] PUT /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 108 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 11:00:13.437793 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3305/4263] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:12 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:13.443143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b5a83cc-9b32-4450-a69e-d76e52f93cd5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:13.445052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0b5a83cc-9b32-4450-a69e-d76e52f93cd5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:13.452856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5a83cc-9b32-4450-a69e-d76e52f93cd5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:13.453389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5a83cc-9b32-4450-a69e-d76e52f93cd5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:13.454706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5a83cc-9b32-4450-a69e-d76e52f93cd5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:13.455618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5a83cc-9b32-4450-a69e-d76e52f93cd5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:13.456089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5a83cc-9b32-4450-a69e-d76e52f93cd5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:13.456538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5a83cc-9b32-4450-a69e-d76e52f93cd5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:13.834872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e98ed40-6409-47f0-bf7f-fbdf1c1a86ee tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:13.836089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e98ed40-6409-47f0-bf7f-fbdf1c1a86ee tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:13.848007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e98ed40-6409-47f0-bf7f-fbdf1c1a86ee tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:13.849162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e98ed40-6409-47f0-bf7f-fbdf1c1a86ee tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:13.850610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e98ed40-6409-47f0-bf7f-fbdf1c1a86ee tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:13.852927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e98ed40-6409-47f0-bf7f-fbdf1c1a86ee tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:13.855481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e98ed40-6409-47f0-bf7f-fbdf1c1a86ee tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:13.857014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e98ed40-6409-47f0-bf7f-fbdf1c1a86ee tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:13.875335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0b5a83cc-9b32-4450-a69e-d76e52f93cd5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:13.886408 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0b5a83cc-9b32-4450-a69e-d76e52f93cd5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1505 microversion: 2.1 time: 0.447351 Sep 10 11:00:13.889458 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 959/4264] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:13 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:13.982367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:13.983273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:14.001729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:14.002219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:14.002689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:14.003562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:14.004893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:14.005370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:14.261360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:14.284084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:14.287156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:14.288442 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b4c54590-5be8-4b90-9cbb-2a0f24bdd058 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.312724 Sep 10 11:00:14.304097 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 960/4265] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:13 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:00:14.368953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e98ed40-6409-47f0-bf7f-fbdf1c1a86ee tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:14.379781 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e98ed40-6409-47f0-bf7f-fbdf1c1a86ee tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1314 microversion: 2.1 time: 0.549757 Sep 10 11:00:14.383336 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3306/4266] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:13 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:14.446106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7ee6a528-655e-4ddf-96ed-5847db3ac344 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:14.447116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7ee6a528-655e-4ddf-96ed-5847db3ac344 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:14.464783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee6a528-655e-4ddf-96ed-5847db3ac344 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:14.465233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee6a528-655e-4ddf-96ed-5847db3ac344 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:14.465680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee6a528-655e-4ddf-96ed-5847db3ac344 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:14.466392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee6a528-655e-4ddf-96ed-5847db3ac344 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:14.466846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee6a528-655e-4ddf-96ed-5847db3ac344 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:14.467270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee6a528-655e-4ddf-96ed-5847db3ac344 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:14.875460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7ee6a528-655e-4ddf-96ed-5847db3ac344 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:14.920921 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7ee6a528-655e-4ddf-96ed-5847db3ac344 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.480462 Sep 10 11:00:14.923722 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 961/4267] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:14 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:15.331136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:15.331853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:15.350050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:15.350919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:15.351571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:15.352505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:15.353244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:15.353908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:15.411533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e19ea63-e523-48d0-a67e-eca55c6c7a21 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:15.412788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4e19ea63-e523-48d0-a67e-eca55c6c7a21 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:15.425534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e19ea63-e523-48d0-a67e-eca55c6c7a21 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:15.428029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e19ea63-e523-48d0-a67e-eca55c6c7a21 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:15.428805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e19ea63-e523-48d0-a67e-eca55c6c7a21 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:15.429884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e19ea63-e523-48d0-a67e-eca55c6c7a21 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:15.432852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e19ea63-e523-48d0-a67e-eca55c6c7a21 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:15.436732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e19ea63-e523-48d0-a67e-eca55c6c7a21 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:15.466209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:15.481844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:15.483319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:15.488489 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a1de3f28-774b-45a4-b487-d52768ab093c tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.161162 Sep 10 11:00:15.489145 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3307/4268] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:15 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:15.696718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4e19ea63-e523-48d0-a67e-eca55c6c7a21 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:15.710905 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4e19ea63-e523-48d0-a67e-eca55c6c7a21 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1314 microversion: 2.1 time: 0.304946 Sep 10 11:00:15.713581 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 962/4269] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:15 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:15.944322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-46af4640-bfad-4738-a1cd-437ed156db18 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:15.945152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-46af4640-bfad-4738-a1cd-437ed156db18 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:15.960714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46af4640-bfad-4738-a1cd-437ed156db18 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:15.963197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46af4640-bfad-4738-a1cd-437ed156db18 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:15.963937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46af4640-bfad-4738-a1cd-437ed156db18 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:15.987106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46af4640-bfad-4738-a1cd-437ed156db18 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:15.987842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46af4640-bfad-4738-a1cd-437ed156db18 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:15.988405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46af4640-bfad-4738-a1cd-437ed156db18 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:16.022537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-10733d84-9ca4-47da-afa2-a526cd21c81e req-f47a1057-bbb7-47e1-abb2-751a6e1eeafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa48174-eb78-4e03-b111-633422f9a832", "name": "network-vif-plugged", "status": "completed", "tag": "f349d74b-48c8-421b-af7e-35826bf55ccf"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:16.035145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-10733d84-9ca4-47da-afa2-a526cd21c81e req-f47a1057-bbb7-47e1-abb2-751a6e1eeafd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:16.036204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-10733d84-9ca4-47da-afa2-a526cd21c81e req-f47a1057-bbb7-47e1-abb2-751a6e1eeafd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:16.036639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-10733d84-9ca4-47da-afa2-a526cd21c81e req-f47a1057-bbb7-47e1-abb2-751a6e1eeafd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:16.057105 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-10733d84-9ca4-47da-afa2-a526cd21c81e req-f47a1057-bbb7-47e1-abb2-751a6e1eeafd service nova] Creating event network-vif-plugged:f349d74b-48c8-421b-af7e-35826bf55ccf for instance 9fa48174-eb78-4e03-b111-633422f9a832 on n-h2-856894-1 Sep 10 11:00:16.077341 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-10733d84-9ca4-47da-afa2-a526cd21c81e req-f47a1057-bbb7-47e1-abb2-751a6e1eeafd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343258 Sep 10 11:00:16.080878 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3308/4270] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:16.364145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-46af4640-bfad-4738-a1cd-437ed156db18 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:16.372799 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-46af4640-bfad-4738-a1cd-437ed156db18 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.432859 Sep 10 11:00:16.373941 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 963/4271] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:15 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:16.522355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:16.523670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:16.536696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:16.537227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:16.537677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:16.543043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:16.543541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:16.543994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:16.684811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:16.702191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:16.705058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:16.712910 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-147bb6b7-30dc-4cd5-8c55-2d7dca1722fb tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.195585 Sep 10 11:00:16.713553 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3309/4272] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:16 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:16.740612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a60e3b82-02b9-4af9-accf-9a5f6fceb0ea tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:16.741272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a60e3b82-02b9-4af9-accf-9a5f6fceb0ea tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:16.751830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a60e3b82-02b9-4af9-accf-9a5f6fceb0ea tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:16.752523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a60e3b82-02b9-4af9-accf-9a5f6fceb0ea tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:16.753169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a60e3b82-02b9-4af9-accf-9a5f6fceb0ea tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:16.754049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a60e3b82-02b9-4af9-accf-9a5f6fceb0ea tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:16.754704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a60e3b82-02b9-4af9-accf-9a5f6fceb0ea tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:16.755273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a60e3b82-02b9-4af9-accf-9a5f6fceb0ea tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:16.778270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:17.376831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a60e3b82-02b9-4af9-accf-9a5f6fceb0ea tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:17.391166 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a60e3b82-02b9-4af9-accf-9a5f6fceb0ea tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1314 microversion: 2.1 time: 0.654806 Sep 10 11:00:17.396917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3fa8659d-6b5d-4b4e-8c54-aba49fa4dc61 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:17.397563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3fa8659d-6b5d-4b4e-8c54-aba49fa4dc61 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:17.413116 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 964/4273] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:16 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:17.415900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa8659d-6b5d-4b4e-8c54-aba49fa4dc61 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:17.416410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa8659d-6b5d-4b4e-8c54-aba49fa4dc61 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:17.416854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa8659d-6b5d-4b4e-8c54-aba49fa4dc61 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:17.418109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa8659d-6b5d-4b4e-8c54-aba49fa4dc61 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:17.418109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa8659d-6b5d-4b4e-8c54-aba49fa4dc61 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:17.418471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa8659d-6b5d-4b4e-8c54-aba49fa4dc61 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:17.744321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:17.745608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:17.760257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:17.763740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:17.764365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:17.766452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:17.767086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:17.772904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:17.916872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3fa8659d-6b5d-4b4e-8c54-aba49fa4dc61 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:17.928065 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3fa8659d-6b5d-4b4e-8c54-aba49fa4dc61 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.533674 Sep 10 11:00:17.934004 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3310/4274] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:17 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:17.967522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:17.988379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:17.989951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:17.991207 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8e84262a-bcb3-45e4-88ff-ab6ae106aa86 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.250775 Sep 10 11:00:18.001421 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 965/4275] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:17 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:00:18.428733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35bd6695-b90b-4be1-9691-74df87ab187d tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:18.429910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-35bd6695-b90b-4be1-9691-74df87ab187d tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:18.439359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35bd6695-b90b-4be1-9691-74df87ab187d tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:18.444329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35bd6695-b90b-4be1-9691-74df87ab187d tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:18.445896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35bd6695-b90b-4be1-9691-74df87ab187d tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:18.446753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35bd6695-b90b-4be1-9691-74df87ab187d tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:18.449058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35bd6695-b90b-4be1-9691-74df87ab187d tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:18.450324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35bd6695-b90b-4be1-9691-74df87ab187d tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:18.809343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-35bd6695-b90b-4be1-9691-74df87ab187d tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:18.819042 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-35bd6695-b90b-4be1-9691-74df87ab187d tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1464 microversion: 2.1 time: 0.394951 Sep 10 11:00:18.821890 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3311/4276] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:18 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1464 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:18.956349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7bad1a77-049a-454a-9c77-6c66f082c0a2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:18.957787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7bad1a77-049a-454a-9c77-6c66f082c0a2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:18.985535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bad1a77-049a-454a-9c77-6c66f082c0a2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:18.986395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bad1a77-049a-454a-9c77-6c66f082c0a2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:18.987006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bad1a77-049a-454a-9c77-6c66f082c0a2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:18.988012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bad1a77-049a-454a-9c77-6c66f082c0a2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:18.988661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bad1a77-049a-454a-9c77-6c66f082c0a2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:18.989284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bad1a77-049a-454a-9c77-6c66f082c0a2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:19.023488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:19.025137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:19.038345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:19.038858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:19.039309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:19.040021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:19.042460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:19.044442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:19.083005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:19.234642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:19.245657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:19.256831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:19.258793 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c9c92471-e589-45a9-af03-95dae5c0e154 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.238939 Sep 10 11:00:19.263237 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3312/4277] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:19 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:19.479615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7bad1a77-049a-454a-9c77-6c66f082c0a2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:19.494092 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7bad1a77-049a-454a-9c77-6c66f082c0a2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.541491 Sep 10 11:00:19.505139 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 966/4278] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:18 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:20.295712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:20.296532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:20.310489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:20.311502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:20.313380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:20.314344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:20.315048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:20.315702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:20.486748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:20.505960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:20.516001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:20.517485 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d06b074-20d5-4dbf-aec5-b76e58b57c2e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.230443 Sep 10 11:00:20.519532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-91d0288b-7b41-497f-8b6f-84bca29b2f89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:20.520887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-91d0288b-7b41-497f-8b6f-84bca29b2f89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:20.521253 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3313/4279] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:20 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:00:20.531642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91d0288b-7b41-497f-8b6f-84bca29b2f89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:20.539483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91d0288b-7b41-497f-8b6f-84bca29b2f89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:20.540334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91d0288b-7b41-497f-8b6f-84bca29b2f89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:20.541421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91d0288b-7b41-497f-8b6f-84bca29b2f89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:20.542141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91d0288b-7b41-497f-8b6f-84bca29b2f89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:20.542800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91d0288b-7b41-497f-8b6f-84bca29b2f89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:20.788984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-91d0288b-7b41-497f-8b6f-84bca29b2f89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:20.800413 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-91d0288b-7b41-497f-8b6f-84bca29b2f89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.285411 Sep 10 11:00:20.801760 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 967/4280] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:20 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:20.904798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:20.905347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:20.918867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:20.919378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:20.922426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:20.927801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:20.928663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:20.929297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:20.953406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8cc18d77-81f7-4fd2-99f7-fc2043192ed0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:20.954126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8cc18d77-81f7-4fd2-99f7-fc2043192ed0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:20.969376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc18d77-81f7-4fd2-99f7-fc2043192ed0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:20.970103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc18d77-81f7-4fd2-99f7-fc2043192ed0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:20.972365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc18d77-81f7-4fd2-99f7-fc2043192ed0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:20.974133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc18d77-81f7-4fd2-99f7-fc2043192ed0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:20.978651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc18d77-81f7-4fd2-99f7-fc2043192ed0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:20.979300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8cc18d77-81f7-4fd2-99f7-fc2043192ed0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:20.985596 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b HTTP/1.1 Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd66fe4eb-5aa7-4bad-8612-0322c812178b'} Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:00:20.987438 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:20.991183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:20.996606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-476899be-4b2a-483f-a2dd-819e800dbfb3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 404 len: 111 microversion: 2.1 time: 0.095504 Sep 10 11:00:20.998933 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3314/4281] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:00:20 2022] DELETE /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:00:21.019512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:21.020684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: d66fe4eb-5aa7-4bad-8612-0322c812178b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:21.036639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.037164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.037607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.038318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.038774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.064534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8cc18d77-81f7-4fd2-99f7-fc2043192ed0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:00:21.065371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.115149 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b HTTP/1.1 Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd66fe4eb-5aa7-4bad-8612-0322c812178b'} Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:21.116683 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:21.120174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:21.120174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:21.120174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:21.120174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:21.120174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:21.120174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. Sep 10 11:00:21.120174 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:21.120174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance d66fe4eb-5aa7-4bad-8612-0322c812178b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:21.120174 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7523480-e5bf-4913-96e1-6a287f7f1911 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b" status: 404 len: 111 microversion: 2.1 time: 0.115032 Sep 10 11:00:21.129927 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3315/4282] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:21 2022] GET /compute/v2.1/servers/d66fe4eb-5aa7-4bad-8612-0322c812178b => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:00:21.144436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d92ad81-114d-45be-b742-7109e896e08b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:21.145770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d92ad81-114d-45be-b742-7109e896e08b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:21.157640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d92ad81-114d-45be-b742-7109e896e08b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.158146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d92ad81-114d-45be-b742-7109e896e08b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.158590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d92ad81-114d-45be-b742-7109e896e08b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.159306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d92ad81-114d-45be-b742-7109e896e08b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.159765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d92ad81-114d-45be-b742-7109e896e08b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.160223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d92ad81-114d-45be-b742-7109e896e08b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.236626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d92ad81-114d-45be-b742-7109e896e08b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:00:21.286815 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8cc18d77-81f7-4fd2-99f7-fc2043192ed0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 204 len: 0 microversion: 2.1 time: 0.336550 Sep 10 11:00:21.288051 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 968/4283] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:00:20 2022] DELETE /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:00:21.300423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ed6e5765-a3d8-47a0-ac14-c257634525e0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:21.301962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ed6e5765-a3d8-47a0-ac14-c257634525e0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:21.337944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed6e5765-a3d8-47a0-ac14-c257634525e0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.339226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed6e5765-a3d8-47a0-ac14-c257634525e0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.341326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed6e5765-a3d8-47a0-ac14-c257634525e0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.349993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed6e5765-a3d8-47a0-ac14-c257634525e0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.351231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed6e5765-a3d8-47a0-ac14-c257634525e0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.355963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed6e5765-a3d8-47a0-ac14-c257634525e0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.479292 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d92ad81-114d-45be-b742-7109e896e08b tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 204 len: 0 microversion: 2.1 time: 0.347896 Sep 10 11:00:21.480509 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3316/4284] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:00:21 2022] DELETE /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:00:21.490113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6811c62a-955e-4771-bc52-1d763bb246e3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:21.491110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6811c62a-955e-4771-bc52-1d763bb246e3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:21.497947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811c62a-955e-4771-bc52-1d763bb246e3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.498714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811c62a-955e-4771-bc52-1d763bb246e3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.499302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811c62a-955e-4771-bc52-1d763bb246e3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.500174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811c62a-955e-4771-bc52-1d763bb246e3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.500816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811c62a-955e-4771-bc52-1d763bb246e3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.501457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6811c62a-955e-4771-bc52-1d763bb246e3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.840105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6811c62a-955e-4771-bc52-1d763bb246e3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:21.854482 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6811c62a-955e-4771-bc52-1d763bb246e3 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.369032 Sep 10 11:00:21.855307 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3317/4285] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:21 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:21.867325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:21.868224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:21.887614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.888707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.889386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.899178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ed6e5765-a3d8-47a0-ac14-c257634525e0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:21.907087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.907603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.908070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.917910 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ed6e5765-a3d8-47a0-ac14-c257634525e0 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1470 microversion: 2.1 time: 0.624752 Sep 10 11:00:21.919225 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 969/4286] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:21 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1470 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:21.924621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b5647c2d-5399-4b5b-9af0-4fdeb27c8d89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:21.937503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b5647c2d-5399-4b5b-9af0-4fdeb27c8d89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:21.944886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5647c2d-5399-4b5b-9af0-4fdeb27c8d89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.945793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5647c2d-5399-4b5b-9af0-4fdeb27c8d89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.946420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5647c2d-5399-4b5b-9af0-4fdeb27c8d89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:21.947492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5647c2d-5399-4b5b-9af0-4fdeb27c8d89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:21.948223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5647c2d-5399-4b5b-9af0-4fdeb27c8d89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:21.951406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5647c2d-5399-4b5b-9af0-4fdeb27c8d89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:22.154547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:22.173246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:22.195791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:22.200975 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1fe5b5eb-340d-4f1c-a241-ac7b6e24ae06 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.344550 Sep 10 11:00:22.201794 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3318/4287] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:21 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:22.316288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b5647c2d-5399-4b5b-9af0-4fdeb27c8d89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:22.333824 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b5647c2d-5399-4b5b-9af0-4fdeb27c8d89 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.410851 Sep 10 11:00:22.335077 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 970/4288] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:21 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:22.883463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbc9f01b-a089-4dd7-9746-b0aa5191662e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:22.884676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fbc9f01b-a089-4dd7-9746-b0aa5191662e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:22.895986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc9f01b-a089-4dd7-9746-b0aa5191662e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:22.899531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc9f01b-a089-4dd7-9746-b0aa5191662e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:22.900901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc9f01b-a089-4dd7-9746-b0aa5191662e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:22.903787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc9f01b-a089-4dd7-9746-b0aa5191662e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:22.904455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc9f01b-a089-4dd7-9746-b0aa5191662e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:22.905590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbc9f01b-a089-4dd7-9746-b0aa5191662e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:22.954104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b1cb847c-0c6a-4090-957e-65d1b575ecd2 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:22.967129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b1cb847c-0c6a-4090-957e-65d1b575ecd2 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:22.998472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1cb847c-0c6a-4090-957e-65d1b575ecd2 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:22.999945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1cb847c-0c6a-4090-957e-65d1b575ecd2 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:23.001852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1cb847c-0c6a-4090-957e-65d1b575ecd2 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:23.003833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1cb847c-0c6a-4090-957e-65d1b575ecd2 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:23.005452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1cb847c-0c6a-4090-957e-65d1b575ecd2 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:23.006076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1cb847c-0c6a-4090-957e-65d1b575ecd2 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:23.690674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbc9f01b-a089-4dd7-9746-b0aa5191662e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:23.703713 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbc9f01b-a089-4dd7-9746-b0aa5191662e tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.825005 Sep 10 11:00:23.708763 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3319/4289] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:22 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:23.716299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:23.717526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:23.724889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1cb847c-0c6a-4090-957e-65d1b575ecd2 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:23.728002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:23.728647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:23.730603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:23.731514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:23.732036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:23.732540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:23.736017 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b1cb847c-0c6a-4090-957e-65d1b575ecd2 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1470 microversion: 2.1 time: 0.786665 Sep 10 11:00:23.739273 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 971/4290] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:22 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1470 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:23.746343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-457a5e97-dd10-4c6b-90f5-b26ca6e377b2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:23.747204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-457a5e97-dd10-4c6b-90f5-b26ca6e377b2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:23.755395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457a5e97-dd10-4c6b-90f5-b26ca6e377b2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:23.756171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457a5e97-dd10-4c6b-90f5-b26ca6e377b2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:23.756828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457a5e97-dd10-4c6b-90f5-b26ca6e377b2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:23.757777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457a5e97-dd10-4c6b-90f5-b26ca6e377b2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:23.758911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457a5e97-dd10-4c6b-90f5-b26ca6e377b2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:23.759537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457a5e97-dd10-4c6b-90f5-b26ca6e377b2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:23.881415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:23.891463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:23.892926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:23.894169 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95563dbf-4967-4db7-a62d-dc3fd41068f9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1605 microversion: 2.32 time: 0.183323 Sep 10 11:00:23.894821 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3320/4291] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:23 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:24.074197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-457a5e97-dd10-4c6b-90f5-b26ca6e377b2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:24.085952 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-457a5e97-dd10-4c6b-90f5-b26ca6e377b2 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.345295 Sep 10 11:00:24.087447 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 972/4292] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:23 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:24.728963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c87eda10-b731-4234-8125-02cf066f2a82 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:24.730328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c87eda10-b731-4234-8125-02cf066f2a82 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:24.744599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c87eda10-b731-4234-8125-02cf066f2a82 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:24.745682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c87eda10-b731-4234-8125-02cf066f2a82 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:24.747785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c87eda10-b731-4234-8125-02cf066f2a82 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:24.749623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c87eda10-b731-4234-8125-02cf066f2a82 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:24.750969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c87eda10-b731-4234-8125-02cf066f2a82 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:24.765111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-717cb688-2ac5-4884-9726-7fc816cb6d44 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:24.765775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-717cb688-2ac5-4884-9726-7fc816cb6d44 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:24.774635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c87eda10-b731-4234-8125-02cf066f2a82 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:24.792653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717cb688-2ac5-4884-9726-7fc816cb6d44 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:24.798800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717cb688-2ac5-4884-9726-7fc816cb6d44 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:24.802394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717cb688-2ac5-4884-9726-7fc816cb6d44 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:24.803322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717cb688-2ac5-4884-9726-7fc816cb6d44 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:24.807687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717cb688-2ac5-4884-9726-7fc816cb6d44 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:24.811345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-717cb688-2ac5-4884-9726-7fc816cb6d44 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:25.314627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-717cb688-2ac5-4884-9726-7fc816cb6d44 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc6a08f4f654a80b23b70123aa918ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd55e44bdc940d5bb6a06c790930cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:25.323495 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-717cb688-2ac5-4884-9726-7fc816cb6d44 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 200 len: 1470 microversion: 2.1 time: 0.562833 Sep 10 11:00:25.345548 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 973/4293] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:24 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 1470 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:25.351387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:25.357841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:25.368584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:25.369619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:25.370297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:25.372519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:25.377842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:25.378607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:25.388101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c87eda10-b731-4234-8125-02cf066f2a82 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:25.398320 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c87eda10-b731-4234-8125-02cf066f2a82 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1511 microversion: 2.1 time: 0.673538 Sep 10 11:00:25.414261 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3321/4294] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:24 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1511 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:25.419369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0d1be3d-0acb-41e7-8ad1-d83b8543201a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:25.423346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0d1be3d-0acb-41e7-8ad1-d83b8543201a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:25.444935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d1be3d-0acb-41e7-8ad1-d83b8543201a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:25.445812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d1be3d-0acb-41e7-8ad1-d83b8543201a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:25.446610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d1be3d-0acb-41e7-8ad1-d83b8543201a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:25.453798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d1be3d-0acb-41e7-8ad1-d83b8543201a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:25.454859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d1be3d-0acb-41e7-8ad1-d83b8543201a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:25.455635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a0d1be3d-0acb-41e7-8ad1-d83b8543201a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:25.507345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:25.508243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:25.508951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:25.509710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lazy-loading 'fault' on Instance uuid a641a1a1-b437-4c58-bf5d-70366328d939 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:00:25.658266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:25.670451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:25.674496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbdeb113a53948238295920304efc98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141bb28f6f6d46f5a25f1054965680d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:25.685908 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fe2fbb07-e74e-46f7-b51c-92b8ccd62f3a tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 200 len: 1372 microversion: 2.32 time: 0.339080 Sep 10 11:00:25.693370 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 974/4295] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:25 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:25.712396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-483aea7f-bc66-4fe3-93a3-0cc773c28be9 req-acd59bb1-00a2-4c2c-b303-cf106c638aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa48174-eb78-4e03-b111-633422f9a832", "name": "network-vif-deleted", "tag": "f349d74b-48c8-421b-af7e-35826bf55ccf"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:25.734375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-483aea7f-bc66-4fe3-93a3-0cc773c28be9 req-acd59bb1-00a2-4c2c-b303-cf106c638aa2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:25.735037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-483aea7f-bc66-4fe3-93a3-0cc773c28be9 req-acd59bb1-00a2-4c2c-b303-cf106c638aa2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:25.735686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-483aea7f-bc66-4fe3-93a3-0cc773c28be9 req-acd59bb1-00a2-4c2c-b303-cf106c638aa2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:25.751390 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-483aea7f-bc66-4fe3-93a3-0cc773c28be9 req-acd59bb1-00a2-4c2c-b303-cf106c638aa2 service nova] Creating event network-vif-deleted:f349d74b-48c8-421b-af7e-35826bf55ccf for instance 9fa48174-eb78-4e03-b111-633422f9a832 on n-h2-856894-1 Sep 10 11:00:25.756778 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-483aea7f-bc66-4fe3-93a3-0cc773c28be9 req-acd59bb1-00a2-4c2c-b303-cf106c638aa2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060837 Sep 10 11:00:25.757979 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 975/4296] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:25.952592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a0d1be3d-0acb-41e7-8ad1-d83b8543201a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:25.964457 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a0d1be3d-0acb-41e7-8ad1-d83b8543201a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.548741 Sep 10 11:00:25.966099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3322/4297] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:25 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:26.362264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:26.363393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] [instance: 9fa48174-eb78-4e03-b111-633422f9a832] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:26.374833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:26.377663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:26.380296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:26.381232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:26.381808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:26.394052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:26.447821 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] HTTP exception thrown: Instance 9fa48174-eb78-4e03-b111-633422f9a832 could not be found. Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Request method failure captured: Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 HTTP/1.1 Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG4p6fZXdO50RwO3da9x6ErzIG0iJHoCALAfh57Pv1AZJtpbDRaDC-qi_Jan_W2k6jcThaMXSYbzPb0gFPAbWKeAyjgfy2KV0rnD7ga4L8j6WNLeQRsKxreIdcoaIOiqV_FmO1sK8URhxKi_D-xL8pzsdlrc1zm-ll8-LsKuc8Fr9ak Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: acd55e44bdc940d5bb6a06c790930cff Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-VolumesNegativeTest-154793421 Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/acd55e44bdc940d5bb6a06c790930cff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/acd55e44bdc940d5bb6a06c790930cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/acd55e44bdc940d5bb6a06c790930cff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_acd55e44bdc940d5bb6a06c790930cff", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-VolumesNegativeTest-154793421 Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: acd55e44bdc940d5bb6a06c790930cff Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-VolumesNegativeTest-154793421 Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-VolumesNegativeTest-154793421-project Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: bbc6a08f4f654a80b23b70123aa918ab Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-VolumesNegativeTest-154793421-project Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 9fa48174-eb78-4e03-b111-633422f9a832 could not be found. Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '9fa48174-eb78-4e03-b111-633422f9a832'} Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa48174-eb78-4e03-b111-633422f9a832 could not be found. Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa48174-eb78-4e03-b111-633422f9a832 could not be found. Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:26.450884 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:26.454704 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:26.454704 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:26.454704 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:26.454704 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:26.454704 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:26.454704 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa48174-eb78-4e03-b111-633422f9a832 could not be found. Sep 10 11:00:26.454704 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:26.455187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:26.455187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:26.460237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] Returning 404 to user: Instance 9fa48174-eb78-4e03-b111-633422f9a832 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:26.461731 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b564b331-5c75-4b1a-a02e-304f35bb8f26 tempest-VolumesNegativeTest-154793421 tempest-VolumesNegativeTest-154793421-project] 10.222.0.20 "GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832" status: 404 len: 111 microversion: 2.1 time: 0.104961 Sep 10 11:00:26.464294 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 976/4298] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:26 2022] GET /compute/v2.1/servers/9fa48174-eb78-4e03-b111-633422f9a832 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:00:26.473444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:26.473948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:26.475594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:26.478042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:26.478900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:26.481714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:26.516440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:26.517206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:26.517798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:26.518408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lazy-loading 'fault' on Instance uuid f1fff5af-b5bc-4a39-a5a3-81c17a2b397b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:00:26.602985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608cf43f926c48fa9bd302ecc6ef79d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f51916719346ba88aa44e3cae5bb9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:26.614467 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90b16ea8-86cf-46c7-95e4-e965a56376f5 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 200 len: 1305 microversion: 2.1 time: 0.175641 Sep 10 11:00:26.616201 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3323/4299] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:26 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 1305 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:26.722293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:26.722960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:26.733858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:26.734422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:26.734879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:26.735928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:26.736401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:26.736980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:26.788118 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] HTTP exception thrown: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Request method failure captured: Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 HTTP/1.1 Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHGx9oSuDbOoAx9L1o0svpPRN_qGTvj8gMKtX8w6K1F57a0eevzT2PKRRPXCCN0CsgqWXm-tOdiZIUjHffGkP0mmE7zE46iKUW8vdYxoOCM2a-k4btkwHtwuWQvy5YSJXhN0c5BswEawDZmKjL1X3zl1y0nzE8eKuWzw0o6JRsw84gDo Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Openstack-Nova-Api-Version: 2.32 Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 141bb28f6f6d46f5a25f1054965680d5 Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TaggedBootDevicesTest-328035336 Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141bb28f6f6d46f5a25f1054965680d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/141bb28f6f6d46f5a25f1054965680d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141bb28f6f6d46f5a25f1054965680d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_141bb28f6f6d46f5a25f1054965680d5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TaggedBootDevicesTest-328035336 Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 141bb28f6f6d46f5a25f1054965680d5 Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TaggedBootDevicesTest-328035336 Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TaggedBootDevicesTest-328035336-project Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: bbdeb113a53948238295920304efc98c Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TaggedBootDevicesTest-328035336-project Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'a641a1a1-b437-4c58-bf5d-70366328d939'} Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:26.790554 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:26.793927 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:26.793927 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:26.793927 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:26.793927 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:26.793927 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:26.793927 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:26.793927 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:00:26.793927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Returning 404 to user: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:26.793927 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-07d54e5c-6e48-4a71-a174-319b1689d7e9 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 404 len: 111 microversion: 2.32 time: 0.073884 Sep 10 11:00:26.808455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fdc2c202-953f-4ddd-b407-7148986903f5 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '.version_select at 0x7efcb2df03a0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:26.808657 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 977/4300] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:26 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:00:26.851429 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fdc2c202-953f-4ddd-b407-7148986903f5 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027599784" status: 204 len: 0 microversion: 2.32 time: 0.053710 Sep 10 11:00:26.873747 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3324/4301] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 11:00:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027599784 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:00:26.989358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0f999e7b-d51b-45fa-9c85-8d23e64e1dcb tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:26.989988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0f999e7b-d51b-45fa-9c85-8d23e64e1dcb tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:27.008971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f999e7b-d51b-45fa-9c85-8d23e64e1dcb tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:27.009527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f999e7b-d51b-45fa-9c85-8d23e64e1dcb tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:27.009981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f999e7b-d51b-45fa-9c85-8d23e64e1dcb tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:27.010720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f999e7b-d51b-45fa-9c85-8d23e64e1dcb tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:27.011182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f999e7b-d51b-45fa-9c85-8d23e64e1dcb tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:27.020189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f999e7b-d51b-45fa-9c85-8d23e64e1dcb tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:27.389006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0f999e7b-d51b-45fa-9c85-8d23e64e1dcb tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:27.401292 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0f999e7b-d51b-45fa-9c85-8d23e64e1dcb tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.413747 Sep 10 11:00:27.401974 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 978/4302] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:26 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:27.649229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:27.650845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] [instance: f1fff5af-b5bc-4a39-a5a3-81c17a2b397b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:27.666305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:27.666857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:27.669467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:27.670793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:27.674023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:27.674657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:27.712297 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] HTTP exception thrown: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b could not be found. Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Request method failure captured: Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b HTTP/1.1 Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG039MqGiQhgmbhdJZ2ZB8EQ5NuYHyeJoJwpgpzsmNFBIM7Q8-_uG8Dz9fCwKT_S8puKJQ8b88wC91YqWdZr7hwWCQzdtHJDyByBzKW1XYOTXWuTIrBgwbiHuVc7-Z62kzHLGx1sRgJnDBKCaFdywMj8KSs9Rp552Qkk_iNAExfSXmg Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/37f51916719346ba88aa44e3cae5bb9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_37f51916719346ba88aa44e3cae5bb9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 37f51916719346ba88aa44e3cae5bb9e Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-157422242 Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 608cf43f926c48fa9bd302ecc6ef79d3 Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-157422242-project Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b could not be found. Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f1fff5af-b5bc-4a39-a5a3-81c17a2b397b'} Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b could not be found. Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b could not be found. Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:27.714042 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:27.717967 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:27.717967 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:27.717967 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:27.717967 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:27.717967 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:27.717967 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b could not be found. Sep 10 11:00:27.717967 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:27.717967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] Returning 404 to user: Instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:27.717967 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-974f3ff3-8209-4fc1-be32-187da8c15663 tempest-ServersNegativeTestJSON-157422242 tempest-ServersNegativeTestJSON-157422242-project] 10.222.0.20 "GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b" status: 404 len: 111 microversion: 2.1 time: 0.080723 Sep 10 11:00:27.717967 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3325/4303] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:27 2022] GET /compute/v2.1/servers/f1fff5af-b5bc-4a39-a5a3-81c17a2b397b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:00:27.807850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-ff69d536-a914-4e7e-be62-84fd5c490726 req-c343d94b-f3ea-4e07-83be-c63af62558d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1fff5af-b5bc-4a39-a5a3-81c17a2b397b", "name": "network-vif-deleted", "tag": "fdf28f35-cdeb-4bbe-a940-e39781700167"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:27.833660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ff69d536-a914-4e7e-be62-84fd5c490726 req-c343d94b-f3ea-4e07-83be-c63af62558d3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:27.835256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ff69d536-a914-4e7e-be62-84fd5c490726 req-c343d94b-f3ea-4e07-83be-c63af62558d3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:27.838739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ff69d536-a914-4e7e-be62-84fd5c490726 req-c343d94b-f3ea-4e07-83be-c63af62558d3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:27.864406 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-ff69d536-a914-4e7e-be62-84fd5c490726 req-c343d94b-f3ea-4e07-83be-c63af62558d3 service nova] Creating event network-vif-deleted:fdf28f35-cdeb-4bbe-a940-e39781700167 for instance f1fff5af-b5bc-4a39-a5a3-81c17a2b397b on n-h2-856894-1 Sep 10 11:00:27.877498 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-ff69d536-a914-4e7e-be62-84fd5c490726 req-c343d94b-f3ea-4e07-83be-c63af62558d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073442 Sep 10 11:00:27.880816 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 979/4304] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:28.426332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8cb6c52-66c2-4c2c-8ace-e53623260f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:28.427300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e8cb6c52-66c2-4c2c-8ace-e53623260f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:28.443100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8cb6c52-66c2-4c2c-8ace-e53623260f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:28.444019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8cb6c52-66c2-4c2c-8ace-e53623260f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:28.445247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8cb6c52-66c2-4c2c-8ace-e53623260f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:28.446295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8cb6c52-66c2-4c2c-8ace-e53623260f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:28.448132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8cb6c52-66c2-4c2c-8ace-e53623260f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:28.449635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8cb6c52-66c2-4c2c-8ace-e53623260f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:28.970620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e8cb6c52-66c2-4c2c-8ace-e53623260f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:28.986498 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8cb6c52-66c2-4c2c-8ace-e53623260f4f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.565096 Sep 10 11:00:28.997170 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3326/4305] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:28 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:30.016237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7fc0c1ca-066f-49a6-b918-91a921293257 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:30.017756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7fc0c1ca-066f-49a6-b918-91a921293257 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:30.055705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fc0c1ca-066f-49a6-b918-91a921293257 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:30.056206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fc0c1ca-066f-49a6-b918-91a921293257 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:30.056654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fc0c1ca-066f-49a6-b918-91a921293257 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:30.057441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fc0c1ca-066f-49a6-b918-91a921293257 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:30.067281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fc0c1ca-066f-49a6-b918-91a921293257 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:30.067744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fc0c1ca-066f-49a6-b918-91a921293257 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:31.150347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7fc0c1ca-066f-49a6-b918-91a921293257 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:31.175243 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7fc0c1ca-066f-49a6-b918-91a921293257 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 1.163661 Sep 10 11:00:31.184991 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 980/4306] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:30 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:32.206592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-846ae0f2-ac91-4d6a-844f-3921e7c09f5f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:32.207890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-846ae0f2-ac91-4d6a-844f-3921e7c09f5f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:32.220949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846ae0f2-ac91-4d6a-844f-3921e7c09f5f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:32.225832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846ae0f2-ac91-4d6a-844f-3921e7c09f5f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:32.227389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846ae0f2-ac91-4d6a-844f-3921e7c09f5f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:32.228300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846ae0f2-ac91-4d6a-844f-3921e7c09f5f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:32.228807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846ae0f2-ac91-4d6a-844f-3921e7c09f5f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:32.232523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-846ae0f2-ac91-4d6a-844f-3921e7c09f5f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:32.721699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-846ae0f2-ac91-4d6a-844f-3921e7c09f5f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:32.740606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-846ae0f2-ac91-4d6a-844f-3921e7c09f5f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.539028 Sep 10 11:00:32.741519 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3327/4307] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:32 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:33.766241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-da89071e-fc4c-45fe-9d4b-9c1f03b69f2b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:33.770442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-da89071e-fc4c-45fe-9d4b-9c1f03b69f2b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:33.774401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:33.796970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da89071e-fc4c-45fe-9d4b-9c1f03b69f2b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:33.797681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da89071e-fc4c-45fe-9d4b-9c1f03b69f2b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:33.799511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da89071e-fc4c-45fe-9d4b-9c1f03b69f2b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:33.887022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da89071e-fc4c-45fe-9d4b-9c1f03b69f2b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:33.887022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da89071e-fc4c-45fe-9d4b-9c1f03b69f2b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:33.887022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da89071e-fc4c-45fe-9d4b-9c1f03b69f2b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:33.959320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:34.667147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-da89071e-fc4c-45fe-9d4b-9c1f03b69f2b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:34.699052 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-da89071e-fc4c-45fe-9d4b-9c1f03b69f2b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.936719 Sep 10 11:00:34.705949 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 981/4308] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:33 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:35.731848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb7abbe1-9f64-4355-ac4e-5b6c800c24c3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:35.733505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb7abbe1-9f64-4355-ac4e-5b6c800c24c3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:35.747322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:35.753867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb7abbe1-9f64-4355-ac4e-5b6c800c24c3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:35.754888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb7abbe1-9f64-4355-ac4e-5b6c800c24c3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:35.763149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb7abbe1-9f64-4355-ac4e-5b6c800c24c3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:35.764467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb7abbe1-9f64-4355-ac4e-5b6c800c24c3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:35.770100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb7abbe1-9f64-4355-ac4e-5b6c800c24c3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:35.772286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb7abbe1-9f64-4355-ac4e-5b6c800c24c3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:37.555304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb7abbe1-9f64-4355-ac4e-5b6c800c24c3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:37.569470 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb7abbe1-9f64-4355-ac4e-5b6c800c24c3 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 1.845947 Sep 10 11:00:37.570306 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3328/4309] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:35 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:38.604132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3cc40b93-3979-492f-b3f6-2785a8c3b783 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:38.605744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3cc40b93-3979-492f-b3f6-2785a8c3b783 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:38.634626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cc40b93-3979-492f-b3f6-2785a8c3b783 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:38.638685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cc40b93-3979-492f-b3f6-2785a8c3b783 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:38.639301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cc40b93-3979-492f-b3f6-2785a8c3b783 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:38.642436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cc40b93-3979-492f-b3f6-2785a8c3b783 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:38.643309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cc40b93-3979-492f-b3f6-2785a8c3b783 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:38.644933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cc40b93-3979-492f-b3f6-2785a8c3b783 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:38.682407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:38.683009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:38.710315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:38.712092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:38.714084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:38.716869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:38.723894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:38.726871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:38.773806 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] HTTP exception thrown: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Request method failure captured: Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 HTTP/1.1 Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGx9oSuDbOoAx9L1o0svpPRN_qGTvj8gMKtX8w6K1F57a0eevzT2PKRRPXCCN0CsgqWXm-tOdiZIUjHffGkP0mmE7zE46iKUW8vdYxoOCM2a-k4btkwHtwuWQvy5YSJXhN0c5BswEawDZmKjL1X3zl1y0nzE8eKuWzw0o6JRsw84gDo Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.32 Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 141bb28f6f6d46f5a25f1054965680d5 Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TaggedBootDevicesTest-328035336 Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141bb28f6f6d46f5a25f1054965680d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/141bb28f6f6d46f5a25f1054965680d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141bb28f6f6d46f5a25f1054965680d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_141bb28f6f6d46f5a25f1054965680d5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TaggedBootDevicesTest-328035336 Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 141bb28f6f6d46f5a25f1054965680d5 Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TaggedBootDevicesTest-328035336 Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TaggedBootDevicesTest-328035336-project Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: bbdeb113a53948238295920304efc98c Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TaggedBootDevicesTest-328035336-project Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'a641a1a1-b437-4c58-bf5d-70366328d939'} Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:00:38.775779 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Returning 404 to user: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:38.780248 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e5d8efab-a3dc-4235-bd13-da60f331016e tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 404 len: 111 microversion: 2.32 time: 0.099149 Sep 10 11:00:38.784120 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3329/4310] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 11:00:38 2022] DELETE /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:00:38.798725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:38.799753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] [instance: a641a1a1-b437-4c58-bf5d-70366328d939] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:38.814355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:38.817747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:38.818511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:38.821190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:38.822979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:38.825631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:38.868726 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] HTTP exception thrown: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Request method failure captured: Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 HTTP/1.1 Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHGx9oSuDbOoAx9L1o0svpPRN_qGTvj8gMKtX8w6K1F57a0eevzT2PKRRPXCCN0CsgqWXm-tOdiZIUjHffGkP0mmE7zE46iKUW8vdYxoOCM2a-k4btkwHtwuWQvy5YSJXhN0c5BswEawDZmKjL1X3zl1y0nzE8eKuWzw0o6JRsw84gDo Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.32 Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 141bb28f6f6d46f5a25f1054965680d5 Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TaggedBootDevicesTest-328035336 Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141bb28f6f6d46f5a25f1054965680d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/141bb28f6f6d46f5a25f1054965680d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/141bb28f6f6d46f5a25f1054965680d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_141bb28f6f6d46f5a25f1054965680d5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TaggedBootDevicesTest-328035336 Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 141bb28f6f6d46f5a25f1054965680d5 Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TaggedBootDevicesTest-328035336 Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TaggedBootDevicesTest-328035336-project Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: bbdeb113a53948238295920304efc98c Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TaggedBootDevicesTest-328035336-project Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'a641a1a1-b437-4c58-bf5d-70366328d939'} Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:00:38.874518 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:38.879811 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:00:38.879811 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:00:38.879811 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:00:38.879811 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:00:38.879811 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:00:38.879811 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. Sep 10 11:00:38.879811 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:00:38.879811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] Returning 404 to user: Instance a641a1a1-b437-4c58-bf5d-70366328d939 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:00:38.879811 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-32800834-b485-4a65-8159-7d01bd07de11 tempest-TaggedBootDevicesTest-328035336 tempest-TaggedBootDevicesTest-328035336-project] 10.222.0.20 "GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939" status: 404 len: 111 microversion: 2.32 time: 0.090948 Sep 10 11:00:38.879811 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3330/4311] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:38 2022] GET /compute/v2.1/servers/a641a1a1-b437-4c58-bf5d-70366328d939 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:00:39.125283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3cc40b93-3979-492f-b3f6-2785a8c3b783 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:39.139656 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3cc40b93-3979-492f-b3f6-2785a8c3b783 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1504 microversion: 2.1 time: 0.546725 Sep 10 11:00:39.140255 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 982/4312] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:38 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:40.166423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e48c6208-c555-4696-a47d-0b36a4411ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:40.167806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e48c6208-c555-4696-a47d-0b36a4411ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:40.189648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e48c6208-c555-4696-a47d-0b36a4411ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:40.205968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e48c6208-c555-4696-a47d-0b36a4411ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:40.209959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e48c6208-c555-4696-a47d-0b36a4411ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:40.214843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e48c6208-c555-4696-a47d-0b36a4411ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:40.218707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e48c6208-c555-4696-a47d-0b36a4411ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:40.219602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e48c6208-c555-4696-a47d-0b36a4411ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:40.297240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:41.045789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e48c6208-c555-4696-a47d-0b36a4411ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:41.062560 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e48c6208-c555-4696-a47d-0b36a4411ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1484 microversion: 2.1 time: 0.900231 Sep 10 11:00:41.080978 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3331/4313] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:40 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1484 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:41.102212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4ef089c0-89fa-4588-91fb-bd53ebe5d2eb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Action: 'create', calling method: .version_select at 0x7efcae5c70d0>, body: {"keypair": {"name": "tempest-keypair-1016289860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmq78rOYUh5jH6xwFEahazv4K7DieQ6ZJ+fS0B/JKasxuNXYHdZNZLSm8tUgaHdj11yRlJ2Bzi6+qC5lsoREKfYAPQEnnWERMtC78TtWnqvnPpV/ebZsvIdAZMcl7MSfg=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:41.175265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-4ef089c0-89fa-4588-91fb-bd53ebe5d2eb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Getting quotas for project db66fde0ffaa42a4b9afdf1a30767435. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:00:41.183716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-4ef089c0-89fa-4588-91fb-bd53ebe5d2eb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Getting quotas for user 78b0d5a4b2e64ab2a7d92e2a13af9069 and project db66fde0ffaa42a4b9afdf1a30767435. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:00:41.218929 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4ef089c0-89fa-4588-91fb-bd53ebe5d2eb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.121031 Sep 10 11:00:41.221878 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 983/4314] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Sep 10 11:00:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:00:41.425655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1854602061", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:41.559029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] validate_networks() for [('55ac737f-42e8-4b4d-9b8b-51b8d4906804', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:00:42.382494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:00:42.383121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:00:42.383635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:00:42.384915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:00:42.385268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:00:42.400779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:42.401338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:42.401959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:42.404467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:42.405184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:42.406243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:42.453574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Getting quotas for project d32d84b971cc464e907a05339f82e252. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:00:42.480059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Getting quotas for user 6462f07210a7449a8b72d5d51ed1c349 and project d32d84b971cc464e907a05339f82e252. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:00:42.509921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:00:42.516086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:00:42.631800 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95189264-9a5d-4fd0-b704-61092dd8f866 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.210882 Sep 10 11:00:42.637142 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3332/4315] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:00:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:00:42.664492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e4048535-9d74-4a62-817c-9c5196451da0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:42.667516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e4048535-9d74-4a62-817c-9c5196451da0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:42.840575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e4048535-9d74-4a62-817c-9c5196451da0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:42.861507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e4048535-9d74-4a62-817c-9c5196451da0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1214 microversion: 2.1 time: 0.209367 Sep 10 11:00:42.863386 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3333/4316] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:42 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:42.984858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-914ebf8d-bce2-4165-b204-f8c1a55d023a tempest-QuotasTestJSON-961998377 tempest-QuotasTestJSON-961998377-project] Calling method '.version_select at 0x7efcae5c7700>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:43.121972 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-914ebf8d-bce2-4165-b204-f8c1a55d023a tempest-QuotasTestJSON-961998377 tempest-QuotasTestJSON-961998377-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/ca8b9ca23b584d2bbb64e6f21a970349/defaults" status: 200 len: 371 microversion: 2.1 time: 0.492309 Sep 10 11:00:43.122589 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 984/4317] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 11:00:42 2022] GET /compute/v2.1/os-quota-sets/ca8b9ca23b584d2bbb64e6f21a970349/defaults => generated 371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:43.135273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bf968eff-d348-42cd-a013-0aa24301e259 tempest-QuotasTestJSON-961998377 tempest-QuotasTestJSON-961998377-project] Calling method '.version_select at 0x7efcad4010d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:43.286384 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bf968eff-d348-42cd-a013-0aa24301e259 tempest-QuotasTestJSON-961998377 tempest-QuotasTestJSON-961998377-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/ca8b9ca23b584d2bbb64e6f21a970349" status: 200 len: 371 microversion: 2.1 time: 0.153826 Sep 10 11:00:43.289010 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3334/4318] 10.222.0.20 () {58 vars in 1242 bytes} [Sat Sep 10 11:00:43 2022] GET /compute/v2.1/os-quota-sets/ca8b9ca23b584d2bbb64e6f21a970349 => generated 371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:00:43.309587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-119d34db-7a06-4a62-8468-960ade0eec33 tempest-QuotasTestJSON-961998377 tempest-QuotasTestJSON-961998377-project] Calling method '.version_select at 0x7efcade89ca0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:43.415905 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-119d34db-7a06-4a62-8468-960ade0eec33 tempest-QuotasTestJSON-961998377 tempest-QuotasTestJSON-961998377-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/ca8b9ca23b584d2bbb64e6f21a970349/defaults" status: 200 len: 371 microversion: 2.1 time: 0.116424 Sep 10 11:00:43.416506 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 985/4319] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 11:00:43 2022] GET /compute/v2.1/os-quota-sets/ca8b9ca23b584d2bbb64e6f21a970349/defaults => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:43.432583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b70748d-5c06-4a3b-82ac-f008c5ae249f tempest-QuotasTestJSON-961998377 tempest-QuotasTestJSON-961998377-project] Calling method '.version_select at 0x7efcae81adc0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:43.542672 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b70748d-5c06-4a3b-82ac-f008c5ae249f tempest-QuotasTestJSON-961998377 tempest-QuotasTestJSON-961998377-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/ca8b9ca23b584d2bbb64e6f21a970349" status: 200 len: 371 microversion: 2.1 time: 0.114697 Sep 10 11:00:43.544074 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3335/4320] 10.222.0.20 () {58 vars in 1242 bytes} [Sat Sep 10 11:00:43 2022] GET /compute/v2.1/os-quota-sets/ca8b9ca23b584d2bbb64e6f21a970349 => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:43.559863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f77e4cee-8717-4242-88ce-70d7acf682a1 tempest-QuotasTestJSON-961998377 tempest-QuotasTestJSON-961998377-project] Calling method '.version_select at 0x7efcae5c7940>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:43.763359 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f77e4cee-8717-4242-88ce-70d7acf682a1 tempest-QuotasTestJSON-961998377 tempest-QuotasTestJSON-961998377-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/ca8b9ca23b584d2bbb64e6f21a970349?user_id=04f6913f8db341c6a32b9f0087405eb1" status: 200 len: 371 microversion: 2.1 time: 0.208974 Sep 10 11:00:43.773733 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 986/4321] 10.222.0.20 () {58 vars in 1323 bytes} [Sat Sep 10 11:00:43 2022] GET /compute/v2.1/os-quota-sets/ca8b9ca23b584d2bbb64e6f21a970349?user_id=04f6913f8db341c6a32b9f0087405eb1 => generated 371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:43.886475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80d0b713-922a-4449-8e7b-cad1c9fb3f85 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:43.887262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80d0b713-922a-4449-8e7b-cad1c9fb3f85 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:43.905287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0b713-922a-4449-8e7b-cad1c9fb3f85 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:43.910742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0b713-922a-4449-8e7b-cad1c9fb3f85 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:43.912953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0b713-922a-4449-8e7b-cad1c9fb3f85 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:43.913788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0b713-922a-4449-8e7b-cad1c9fb3f85 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:43.916215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0b713-922a-4449-8e7b-cad1c9fb3f85 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:43.916736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80d0b713-922a-4449-8e7b-cad1c9fb3f85 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:44.059582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80d0b713-922a-4449-8e7b-cad1c9fb3f85 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:44.076948 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80d0b713-922a-4449-8e7b-cad1c9fb3f85 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1218 microversion: 2.1 time: 0.193124 Sep 10 11:00:44.079210 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3336/4322] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:43 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1218 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:45.105851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f39715e9-25bd-41af-b054-ecda3f6198f5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:45.107249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f39715e9-25bd-41af-b054-ecda3f6198f5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:45.119960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39715e9-25bd-41af-b054-ecda3f6198f5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:45.122013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39715e9-25bd-41af-b054-ecda3f6198f5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:45.123695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39715e9-25bd-41af-b054-ecda3f6198f5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:45.127257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39715e9-25bd-41af-b054-ecda3f6198f5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:45.127932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39715e9-25bd-41af-b054-ecda3f6198f5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:45.129226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39715e9-25bd-41af-b054-ecda3f6198f5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:45.332305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f39715e9-25bd-41af-b054-ecda3f6198f5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:45.352331 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f39715e9-25bd-41af-b054-ecda3f6198f5 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1284 microversion: 2.1 time: 0.250438 Sep 10 11:00:45.355414 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 987/4323] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:45 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:46.207846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-563239808", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1a6f417a-3572-4a4c-94ce-97f0025a5a61"}, {"port": "9197c705-e5c1-4ffa-bb14-2abe9061e2f5", "tag": "port-1"}, {"port": "dd6bd1fd-3270-45c6-9883-d9fe196e44d2", "tag": "port-2"}, {"uuid": "88e8657f-57df-4ded-a28c-c07cf1fe2133", "tag": "net-1"}, {"uuid": "88e8657f-57df-4ded-a28c-c07cf1fe2133"}, {"uuid": "8c5d67cd-5b02-46dc-a225-22321ef59291", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8c5d67cd-5b02-46dc-a225-22321ef59291", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c0dc334a-7491-4a24-972e-1d1597821a1d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "bba64f82-81cf-4559-92ca-c05b1f9646b4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "8aa25733-9af7-448b-b254-d0fe91f29858", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--251253793"}], "key_name": "tempest-keypair-1016289860", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:46.390362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7eaef6af-22d4-40b3-8fbe-d027289a7e16 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:46.391177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7eaef6af-22d4-40b3-8fbe-d027289a7e16 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:46.411627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7eaef6af-22d4-40b3-8fbe-d027289a7e16 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:46.413155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7eaef6af-22d4-40b3-8fbe-d027289a7e16 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:46.413866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7eaef6af-22d4-40b3-8fbe-d027289a7e16 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:46.415914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7eaef6af-22d4-40b3-8fbe-d027289a7e16 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:46.420063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7eaef6af-22d4-40b3-8fbe-d027289a7e16 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:46.420416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7eaef6af-22d4-40b3-8fbe-d027289a7e16 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:47.170315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] validate_networks() for [('1a6f417a-3572-4a4c-94ce-97f0025a5a61', None, None, None, None, None), (None, None, '9197c705-e5c1-4ffa-bb14-2abe9061e2f5', None, None, None), (None, None, 'dd6bd1fd-3270-45c6-9883-d9fe196e44d2', None, None, None), ('88e8657f-57df-4ded-a28c-c07cf1fe2133', None, None, None, None, None), ('88e8657f-57df-4ded-a28c-c07cf1fe2133', None, None, None, None, None), ('8c5d67cd-5b02-46dc-a225-22321ef59291', '10.2.2.100', None, None, None, None), ('8c5d67cd-5b02-46dc-a225-22321ef59291', '10.2.2.200', None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:00:47.339803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7eaef6af-22d4-40b3-8fbe-d027289a7e16 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:47.366024 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7eaef6af-22d4-40b3-8fbe-d027289a7e16 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1314 microversion: 2.1 time: 0.985983 Sep 10 11:00:47.371703 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 988/4324] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:46 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:48.401028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2fb41acd-2927-47a9-a635-cc9c8a306c11 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:48.405091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2fb41acd-2927-47a9-a635-cc9c8a306c11 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:48.436989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb41acd-2927-47a9-a635-cc9c8a306c11 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:48.439462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb41acd-2927-47a9-a635-cc9c8a306c11 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:48.440789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb41acd-2927-47a9-a635-cc9c8a306c11 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:48.442547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb41acd-2927-47a9-a635-cc9c8a306c11 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:48.443733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb41acd-2927-47a9-a635-cc9c8a306c11 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:48.445557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb41acd-2927-47a9-a635-cc9c8a306c11 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:49.066612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2fb41acd-2927-47a9-a635-cc9c8a306c11 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:49.082764 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2fb41acd-2927-47a9-a635-cc9c8a306c11 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1314 microversion: 2.1 time: 0.688177 Sep 10 11:00:49.083392 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 989/4325] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:48 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:50.108600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cbb3edbb-778a-4a04-87a2-851f6e43b7c8 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:50.109547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cbb3edbb-778a-4a04-87a2-851f6e43b7c8 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:50.117717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cbb3edbb-778a-4a04-87a2-851f6e43b7c8 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:50.118629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cbb3edbb-778a-4a04-87a2-851f6e43b7c8 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:50.119550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cbb3edbb-778a-4a04-87a2-851f6e43b7c8 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:50.120617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cbb3edbb-778a-4a04-87a2-851f6e43b7c8 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:50.122097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cbb3edbb-778a-4a04-87a2-851f6e43b7c8 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:50.122731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cbb3edbb-778a-4a04-87a2-851f6e43b7c8 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:51.455818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cbb3edbb-778a-4a04-87a2-851f6e43b7c8 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:51.475794 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cbb3edbb-778a-4a04-87a2-851f6e43b7c8 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1314 microversion: 2.1 time: 1.370426 Sep 10 11:00:51.478217 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 990/4326] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:50 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1314 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:51.655242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-e8717e69-f732-42cc-b78a-340e9383c795 req-f77b010d-a75f-4477-8048-f9d86ee783fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d06412-ccbe-40b4-881e-667b29b1341d", "tag": "5461ef4a-fce5-4941-a202-b0c2a1bfa655"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:51.670937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e8717e69-f732-42cc-b78a-340e9383c795 req-f77b010d-a75f-4477-8048-f9d86ee783fd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:51.671609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e8717e69-f732-42cc-b78a-340e9383c795 req-f77b010d-a75f-4477-8048-f9d86ee783fd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:51.673149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e8717e69-f732-42cc-b78a-340e9383c795 req-f77b010d-a75f-4477-8048-f9d86ee783fd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:51.687758 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-e8717e69-f732-42cc-b78a-340e9383c795 req-f77b010d-a75f-4477-8048-f9d86ee783fd service nova] Creating event network-changed:5461ef4a-fce5-4941-a202-b0c2a1bfa655 for instance 46d06412-ccbe-40b4-881e-667b29b1341d on n-h2-856894-1 Sep 10 11:00:51.696053 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-e8717e69-f732-42cc-b78a-340e9383c795 req-f77b010d-a75f-4477-8048-f9d86ee783fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046248 Sep 10 11:00:51.697324 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 991/4327] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:00:52.436455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:52.502939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-341a605c-4f95-4d10-8595-4cad66fe2927 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:52.504723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-341a605c-4f95-4d10-8595-4cad66fe2927 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:52.516656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-341a605c-4f95-4d10-8595-4cad66fe2927 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:52.518634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-341a605c-4f95-4d10-8595-4cad66fe2927 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:52.521614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-341a605c-4f95-4d10-8595-4cad66fe2927 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:52.522670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-341a605c-4f95-4d10-8595-4cad66fe2927 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:52.526940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-341a605c-4f95-4d10-8595-4cad66fe2927 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:52.527585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-341a605c-4f95-4d10-8595-4cad66fe2927 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:53.220685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-341a605c-4f95-4d10-8595-4cad66fe2927 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:53.234863 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-341a605c-4f95-4d10-8595-4cad66fe2927 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1314 microversion: 2.1 time: 0.737258 Sep 10 11:00:53.235469 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 992/4328] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:52 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:53.533004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:54.071307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=11 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:54.261962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-653a37af-a1bb-4e28-a9fb-dcf57d5e8bb0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:54.262590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-653a37af-a1bb-4e28-a9fb-dcf57d5e8bb0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:54.265726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:00:54.281828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-653a37af-a1bb-4e28-a9fb-dcf57d5e8bb0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:54.282345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-653a37af-a1bb-4e28-a9fb-dcf57d5e8bb0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:54.282800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-653a37af-a1bb-4e28-a9fb-dcf57d5e8bb0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:54.283529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-653a37af-a1bb-4e28-a9fb-dcf57d5e8bb0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:54.283992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-653a37af-a1bb-4e28-a9fb-dcf57d5e8bb0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:54.284966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-653a37af-a1bb-4e28-a9fb-dcf57d5e8bb0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:55.221229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-653a37af-a1bb-4e28-a9fb-dcf57d5e8bb0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:55.230741 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-653a37af-a1bb-4e28-a9fb-dcf57d5e8bb0 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1314 microversion: 2.1 time: 0.972623 Sep 10 11:00:55.231754 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 993/4329] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:54 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:56.255434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e1706bb-4f9b-41c9-89f8-564e4a98e42e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:56.257433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3e1706bb-4f9b-41c9-89f8-564e4a98e42e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:56.275502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e1706bb-4f9b-41c9-89f8-564e4a98e42e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:56.276173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e1706bb-4f9b-41c9-89f8-564e4a98e42e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:56.276698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e1706bb-4f9b-41c9-89f8-564e4a98e42e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:56.277566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e1706bb-4f9b-41c9-89f8-564e4a98e42e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:56.278442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e1706bb-4f9b-41c9-89f8-564e4a98e42e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:56.279049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e1706bb-4f9b-41c9-89f8-564e4a98e42e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:57.030191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3e1706bb-4f9b-41c9-89f8-564e4a98e42e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:57.047258 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3e1706bb-4f9b-41c9-89f8-564e4a98e42e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1314 microversion: 2.1 time: 0.796177 Sep 10 11:00:57.048645 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 994/4330] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:56 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:00:57.228948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:00:57.229482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:00:57.230018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:00:57.230763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:00:57.231289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:00:57.255270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:57.255883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:57.256589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:57.257646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:57.259884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:57.262256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:57.300832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Getting quotas for project db66fde0ffaa42a4b9afdf1a30767435. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:00:57.307476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Getting quotas for user 78b0d5a4b2e64ab2a7d92e2a13af9069 and project db66fde0ffaa42a4b9afdf1a30767435. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:00:57.522572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:00:57.527921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c0dc334a-7491-4a24-972e-1d1597821a1d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='bba64f82-81cf-4559-92ca-c05b1f9646b4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8aa25733-9af7-448b-b254-d0fe91f29858',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:00:57.818662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-0da7cf87-9f01-40ef-b385-55b81c37393b req-cc0d48e4-516f-47aa-bf8c-48e33294b2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d06412-ccbe-40b4-881e-667b29b1341d", "name": "network-vif-plugged", "status": "completed", "tag": "5461ef4a-fce5-4941-a202-b0c2a1bfa655"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:00:57.840164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0da7cf87-9f01-40ef-b385-55b81c37393b req-cc0d48e4-516f-47aa-bf8c-48e33294b2a4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:57.841111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0da7cf87-9f01-40ef-b385-55b81c37393b req-cc0d48e4-516f-47aa-bf8c-48e33294b2a4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:57.845756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0da7cf87-9f01-40ef-b385-55b81c37393b req-cc0d48e4-516f-47aa-bf8c-48e33294b2a4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:57.870451 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-0da7cf87-9f01-40ef-b385-55b81c37393b req-cc0d48e4-516f-47aa-bf8c-48e33294b2a4 service nova] Creating event network-vif-plugged:5461ef4a-fce5-4941-a202-b0c2a1bfa655 for instance 46d06412-ccbe-40b4-881e-667b29b1341d on n-h2-856894-1 Sep 10 11:00:57.919565 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-0da7cf87-9f01-40ef-b385-55b81c37393b req-cc0d48e4-516f-47aa-bf8c-48e33294b2a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092329 Sep 10 11:00:57.923461 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 995/4331] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:00:58.072210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d4377060-86ad-49be-a53a-e2d1067a3ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:58.073127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d4377060-86ad-49be-a53a-e2d1067a3ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:58.097899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4377060-86ad-49be-a53a-e2d1067a3ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:58.098421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4377060-86ad-49be-a53a-e2d1067a3ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:58.118052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4377060-86ad-49be-a53a-e2d1067a3ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:58.118929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4377060-86ad-49be-a53a-e2d1067a3ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:58.119433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4377060-86ad-49be-a53a-e2d1067a3ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:58.119878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4377060-86ad-49be-a53a-e2d1067a3ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:58.345277 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef4dcab5-63f3-4e6a-99ff-f7e9ece8e247 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 12.143528 Sep 10 11:00:58.349661 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3337/4332] 10.222.0.20 () {62 vars in 1189 bytes} [Sat Sep 10 11:00:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 12149 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:00:58.369186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cfab177-0349-41ce-b3d0-42c88ec25b35 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:58.375164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4cfab177-0349-41ce-b3d0-42c88ec25b35 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:58.593484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d4377060-86ad-49be-a53a-e2d1067a3ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:58.610229 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d4377060-86ad-49be-a53a-e2d1067a3ea6 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1314 microversion: 2.1 time: 0.542423 Sep 10 11:00:58.631222 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 996/4333] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:58 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:00:58.679558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cfab177-0349-41ce-b3d0-42c88ec25b35 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:58.689096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cfab177-0349-41ce-b3d0-42c88ec25b35 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:58.694877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cfab177-0349-41ce-b3d0-42c88ec25b35 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:00:58.705134 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4cfab177-0349-41ce-b3d0-42c88ec25b35 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1285 microversion: 2.42 time: 0.348154 Sep 10 11:00:58.705980 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3338/4334] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:58 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1285 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:00:59.640398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dab9b77c-86cf-40ac-8f2f-5ce7ec128462 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:59.641230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dab9b77c-86cf-40ac-8f2f-5ce7ec128462 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:00:59.663306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab9b77c-86cf-40ac-8f2f-5ce7ec128462 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:59.677092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab9b77c-86cf-40ac-8f2f-5ce7ec128462 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:59.678881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab9b77c-86cf-40ac-8f2f-5ce7ec128462 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:59.679687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab9b77c-86cf-40ac-8f2f-5ce7ec128462 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:00:59.680238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab9b77c-86cf-40ac-8f2f-5ce7ec128462 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:00:59.684575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dab9b77c-86cf-40ac-8f2f-5ce7ec128462 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:00:59.736664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f0fb895d-574b-49a3-8073-df30e21b4588 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:00:59.738026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f0fb895d-574b-49a3-8073-df30e21b4588 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:00.069792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f0fb895d-574b-49a3-8073-df30e21b4588 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:00.082603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f0fb895d-574b-49a3-8073-df30e21b4588 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:00.084661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f0fb895d-574b-49a3-8073-df30e21b4588 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:00.092574 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f0fb895d-574b-49a3-8073-df30e21b4588 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1285 microversion: 2.42 time: 0.360565 Sep 10 11:01:00.093658 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3339/4335] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:00:59 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1285 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:00.576655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dab9b77c-86cf-40ac-8f2f-5ce7ec128462 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:00.590420 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dab9b77c-86cf-40ac-8f2f-5ce7ec128462 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1314 microversion: 2.1 time: 0.954912 Sep 10 11:01:00.601294 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 997/4336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:00:59 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:01.124761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:01.126227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:01.146066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:01.146778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:01.149037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:01.150114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:01.152839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:01.154577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:01.536099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:01.553667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:01.559555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:01.569374 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30e559ad-1865-41f6-952e-f9ae784250d5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1593 microversion: 2.42 time: 0.449410 Sep 10 11:01:01.581932 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3340/4337] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:01 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1593 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:01.627485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a3a0339d-271c-408f-836e-fb589ce33453 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:01.628925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a3a0339d-271c-408f-836e-fb589ce33453 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:01.649122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3a0339d-271c-408f-836e-fb589ce33453 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:01.649642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3a0339d-271c-408f-836e-fb589ce33453 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:01.650100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3a0339d-271c-408f-836e-fb589ce33453 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:01.653956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3a0339d-271c-408f-836e-fb589ce33453 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:01.654500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3a0339d-271c-408f-836e-fb589ce33453 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:01.654953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3a0339d-271c-408f-836e-fb589ce33453 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:02.259207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a3a0339d-271c-408f-836e-fb589ce33453 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:02.270040 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a3a0339d-271c-408f-836e-fb589ce33453 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1500 microversion: 2.1 time: 0.647780 Sep 10 11:01:02.271376 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 998/4338] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:01 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1500 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:02.298698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-685d6160-b791-4c38-99dc-61d4d26379f4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:02.302321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-685d6160-b791-4c38-99dc-61d4d26379f4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:02.309367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-685d6160-b791-4c38-99dc-61d4d26379f4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:02.310032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-685d6160-b791-4c38-99dc-61d4d26379f4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:02.310627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-685d6160-b791-4c38-99dc-61d4d26379f4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:02.312119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-685d6160-b791-4c38-99dc-61d4d26379f4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:02.312733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-685d6160-b791-4c38-99dc-61d4d26379f4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:02.313347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-685d6160-b791-4c38-99dc-61d4d26379f4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:02.354201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-685d6160-b791-4c38-99dc-61d4d26379f4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lazy-loading 'flavor' on Instance uuid 46d06412-ccbe-40b4-881e-667b29b1341d {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:02.520004 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-685d6160-b791-4c38-99dc-61d4d26379f4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "POST /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d/action" status: 200 len: 32 microversion: 2.1 time: 0.226055 Sep 10 11:01:02.521217 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3341/4339] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:01:02 2022] POST /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d/action => generated 32 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:01:02.530957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4b5411cc-447d-4587-b9f0-15eeb4518253 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:02.542209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4b5411cc-447d-4587-b9f0-15eeb4518253 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:02.559151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5411cc-447d-4587-b9f0-15eeb4518253 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:02.562470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5411cc-447d-4587-b9f0-15eeb4518253 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:02.563121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5411cc-447d-4587-b9f0-15eeb4518253 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:02.564018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5411cc-447d-4587-b9f0-15eeb4518253 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:02.566880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5411cc-447d-4587-b9f0-15eeb4518253 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:02.567494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5411cc-447d-4587-b9f0-15eeb4518253 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:02.598892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:02.599844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:02.616970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:02.621847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:02.622325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:02.623097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:02.630386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:02.630892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:03.078384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:03.090012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:03.092326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:03.093921 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c05d8958-a1ea-4b63-9b5d-e1623f8899be tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1593 microversion: 2.42 time: 0.500058 Sep 10 11:01:03.095046 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3342/4340] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:02 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1593 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:03.417708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4b5411cc-447d-4587-b9f0-15eeb4518253 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:03.443072 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4b5411cc-447d-4587-b9f0-15eeb4518253 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.915502 Sep 10 11:01:03.445946 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 999/4341] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:02 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:04.125521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:04.126203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:04.140799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:04.153948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:04.154657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:04.155603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:04.156241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:04.157122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:04.324055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:04.345270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:04.348450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:04.349747 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d5a8767-cd0b-4390-872f-8290fe929e6c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1593 microversion: 2.42 time: 0.229821 Sep 10 11:01:04.350341 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3343/4342] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:04 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1593 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:04.473363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b433ce10-d863-45d8-ba56-6c8b663967d1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:04.474699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b433ce10-d863-45d8-ba56-6c8b663967d1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:04.490702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:04.502396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b433ce10-d863-45d8-ba56-6c8b663967d1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:04.504201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b433ce10-d863-45d8-ba56-6c8b663967d1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:04.520956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b433ce10-d863-45d8-ba56-6c8b663967d1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:04.520956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b433ce10-d863-45d8-ba56-6c8b663967d1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:04.520956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b433ce10-d863-45d8-ba56-6c8b663967d1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:04.520956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b433ce10-d863-45d8-ba56-6c8b663967d1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:04.579092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=80 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:04.633474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a573ae9a-1048-41f4-ab97-8f3e9ed4bd54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Action: 'create', calling method: .version_select at 0x7efcad404280>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-343833404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVEkVxkcXgzRrxhurRUh09+AeswT0YPYPBl3ezoISoh790VmaRkOqLt6emNsolA5tuhDE/IQPeqSqqj8bNHjRZ35D7e9q46+W62PZVAPRkBAjAPDFN8RFP/0msYFKaXhg=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:04.704635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a573ae9a-1048-41f4-ab97-8f3e9ed4bd54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Getting quotas for project 2b1bbb56aa2f44f3b5a50f0cbecfd160. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:01:04.729571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a573ae9a-1048-41f4-ab97-8f3e9ed4bd54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Getting quotas for user 077d4f0b50b749698c9878b007070a95 and project 2b1bbb56aa2f44f3b5a50f0cbecfd160. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:01:04.847463 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a573ae9a-1048-41f4-ab97-8f3e9ed4bd54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.218107 Sep 10 11:01:04.848234 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3344/4343] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:01:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:05.220276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b433ce10-d863-45d8-ba56-6c8b663967d1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:05.240883 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b433ce10-d863-45d8-ba56-6c8b663967d1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.772946 Sep 10 11:01:05.243401 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1000/4344] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:04 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:05.382366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:05.382990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:05.396855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:05.397721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:05.398437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:05.399429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:05.403541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:05.404406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:05.608339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0480837a-cabc-4223-aa7c-056ea32ba6af tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'create', calling method: .version_select at 0x7efcade90af0>, body: {"keypair": {"name": "tempest-keypair-1925231058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuXVix8W5mFhsjbonTd1WNwPa59ahIAQAa0e5fQXnPwe8WUpfDp/iFATlxvJouTeZNuFNoofN4/7fyrY7dYU4ag7X8o6GiyPwzoV8icqJ11QYjHc9FaqkJivttGAIwbTw=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:05.650263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0480837a-cabc-4223-aa7c-056ea32ba6af tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Getting quotas for project 803a48d9302b4d52b80bf4b49fac53ba. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:01:05.663983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0480837a-cabc-4223-aa7c-056ea32ba6af tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Getting quotas for user 7a58544226204f62807e56bb34c7d5d8 and project 803a48d9302b4d52b80bf4b49fac53ba. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:01:05.731356 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0480837a-cabc-4223-aa7c-056ea32ba6af tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.302716 Sep 10 11:01:05.734294 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1001/4345] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:01:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:01:06.208136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:06.253992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:06.258294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:06.260959 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f26ca40-6ada-43cd-9c6e-6d3fb622886e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1660 microversion: 2.42 time: 0.883998 Sep 10 11:01:06.270631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9822757f-27e2-43ca-822e-240f2d0b6596 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:06.271681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9822757f-27e2-43ca-822e-240f2d0b6596 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:06.277588 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3345/4346] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:05 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1660 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:06.288145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9822757f-27e2-43ca-822e-240f2d0b6596 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:06.288874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9822757f-27e2-43ca-822e-240f2d0b6596 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:06.289670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9822757f-27e2-43ca-822e-240f2d0b6596 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:06.290728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9822757f-27e2-43ca-822e-240f2d0b6596 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:06.291797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9822757f-27e2-43ca-822e-240f2d0b6596 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:06.294002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9822757f-27e2-43ca-822e-240f2d0b6596 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:07.306516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:07.307729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:07.312509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:07.326243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:07.330405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:07.331754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:07.332388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:07.338446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:07.339219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:07.339815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:07.680422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9822757f-27e2-43ca-822e-240f2d0b6596 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:07.699473 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9822757f-27e2-43ca-822e-240f2d0b6596 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 1.435735 Sep 10 11:01:07.700071 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1002/4347] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:06 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:07.755761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:07.776722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:07.780516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:07.786051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1ee7e06-2ed1-4d01-a812-480e753f762d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1706 microversion: 2.42 time: 0.483546 Sep 10 11:01:07.787311 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3346/4348] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:07 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1706 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:08.728138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-196c1872-341c-4f9c-9392-6be9d4714c2a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:08.728755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-196c1872-341c-4f9c-9392-6be9d4714c2a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:08.739546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-196c1872-341c-4f9c-9392-6be9d4714c2a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:08.740115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-196c1872-341c-4f9c-9392-6be9d4714c2a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:08.740585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-196c1872-341c-4f9c-9392-6be9d4714c2a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:08.747557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-196c1872-341c-4f9c-9392-6be9d4714c2a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:08.748337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-196c1872-341c-4f9c-9392-6be9d4714c2a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:08.750060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-196c1872-341c-4f9c-9392-6be9d4714c2a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:08.820892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:08.822098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:08.835862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:08.836604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:08.838189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:08.839287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:08.839941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:08.840582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:09.432222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:09.450732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:09.456059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:09.459768 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-39e61c1d-cc5a-46d8-bda8-24e72753b212 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1752 microversion: 2.42 time: 0.647627 Sep 10 11:01:09.477291 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3347/4349] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:08 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1752 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:09.509320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-196c1872-341c-4f9c-9392-6be9d4714c2a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:09.517742 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-196c1872-341c-4f9c-9392-6be9d4714c2a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.793455 Sep 10 11:01:09.523098 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1003/4350] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:08 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:10.344011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1437619700", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98fa1449-9822-4804-b24d-42a2b19af563"}], "security_groups": [{"name": "tempest-securitygroup--885477878"}], "key_name": "tempest-keypair-1925231058", "user_data": "}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:10.494985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:10.496310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:10.511924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:10.512884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:10.519179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:10.519968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:10.520624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:10.521093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:11.048532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] validate_networks() for [('98fa1449-9822-4804-b24d-42a2b19af563', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:01:11.424125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:11.442900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:11.449590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:11.453828 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ed7dc44a-576f-437e-a481-d84cfd332066 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1752 microversion: 2.42 time: 0.965941 Sep 10 11:01:11.457548 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1004/4351] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:10 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1752 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:11.469843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-72a01788-2747-4953-afc7-436be048c76f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:11.470702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-72a01788-2747-4953-afc7-436be048c76f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:11.487517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72a01788-2747-4953-afc7-436be048c76f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:11.488381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72a01788-2747-4953-afc7-436be048c76f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:11.489093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72a01788-2747-4953-afc7-436be048c76f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:11.490043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72a01788-2747-4953-afc7-436be048c76f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:11.490735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72a01788-2747-4953-afc7-436be048c76f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:11.491411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-72a01788-2747-4953-afc7-436be048c76f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:12.348059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-72a01788-2747-4953-afc7-436be048c76f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:12.358353 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-72a01788-2747-4953-afc7-436be048c76f tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.899428 Sep 10 11:01:12.369630 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1005/4352] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:11 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:12.484737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:12.485706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:12.497505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:12.498231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:12.498893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:12.499816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:12.503857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:12.504563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:13.178933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:13.225344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:13.233170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:13.235767 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7c645ac2-af68-4d53-80be-0f0dd8ded05a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1798 microversion: 2.42 time: 0.755477 Sep 10 11:01:13.238658 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1006/4353] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:12 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1798 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:13.244853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-815952741", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f864d76e-384d-4040-9d1f-9e803c43b6b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-343833404", "security_groups": [{"name": "tempest-secgroup-smoke-1249458899"}], "networks": [{"uuid": "59ad35e9-72e8-409e-8e95-e551f5e7ed37"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:13.658310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] validate_networks() for [('59ad35e9-72e8-409e-8e95-e551f5e7ed37', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:01:14.250124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:01:14.251395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:01:14.252146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:01:14.252873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:01:14.253977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:01:14.267906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:14.274975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:14.275751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:14.276824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:14.280301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:14.280977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:14.308846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Getting quotas for project 803a48d9302b4d52b80bf4b49fac53ba. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:01:14.316029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Getting quotas for user 7a58544226204f62807e56bb34c7d5d8 and project 803a48d9302b4d52b80bf4b49fac53ba. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:01:14.346207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:01:14.351352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:01:14.417604 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0569b9f0-49a0-40c1-8414-4bf0773da907 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.077995 Sep 10 11:01:14.426555 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3348/4354] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:01:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 4087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:01:14.433139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1f77f27-2ba6-4777-a02c-8eaaf656d2e4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:14.434560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1f77f27-2ba6-4777-a02c-8eaaf656d2e4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:14.443469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1f77f27-2ba6-4777-a02c-8eaaf656d2e4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:14.444508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1f77f27-2ba6-4777-a02c-8eaaf656d2e4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:14.445320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1f77f27-2ba6-4777-a02c-8eaaf656d2e4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:14.447206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1f77f27-2ba6-4777-a02c-8eaaf656d2e4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:14.448290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1f77f27-2ba6-4777-a02c-8eaaf656d2e4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:14.449103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1f77f27-2ba6-4777-a02c-8eaaf656d2e4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:15.104380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b1f77f27-2ba6-4777-a02c-8eaaf656d2e4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:15.118094 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1f77f27-2ba6-4777-a02c-8eaaf656d2e4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.690045 Sep 10 11:01:15.134573 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3349/4355] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:14 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:15.143434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:15.145055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:15.152658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:15.153434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:15.154701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:15.155636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:15.156316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:15.157394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:15.701560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:15.758009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:15.771231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:15.777538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:15.779084 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3eba3599-aa8c-4f0e-b1e6-109c466ecc42 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1798 microversion: 2.42 time: 0.642686 Sep 10 11:01:15.801278 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3350/4356] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:15 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1798 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:15.829581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a02ca179-0e95-4923-9f73-ec3a8dfe9c66 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:15.830224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a02ca179-0e95-4923-9f73-ec3a8dfe9c66 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:15.839786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a02ca179-0e95-4923-9f73-ec3a8dfe9c66 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:15.840295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a02ca179-0e95-4923-9f73-ec3a8dfe9c66 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:15.840736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a02ca179-0e95-4923-9f73-ec3a8dfe9c66 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:15.843091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a02ca179-0e95-4923-9f73-ec3a8dfe9c66 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:15.843584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a02ca179-0e95-4923-9f73-ec3a8dfe9c66 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:15.844023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a02ca179-0e95-4923-9f73-ec3a8dfe9c66 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:15.962920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:01:15.963380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:01:15.964410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:01:15.965140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:01:15.965744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:01:15.979111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:15.979855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:15.980367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:15.981130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:15.981705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:15.982283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:16.018975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Getting quotas for project 2b1bbb56aa2f44f3b5a50f0cbecfd160. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:01:16.029598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Getting quotas for user 077d4f0b50b749698c9878b007070a95 and project 2b1bbb56aa2f44f3b5a50f0cbecfd160. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:01:16.039370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a02ca179-0e95-4923-9f73-ec3a8dfe9c66 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:16.063636 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a02ca179-0e95-4923-9f73-ec3a8dfe9c66 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1290 microversion: 2.1 time: 0.247408 Sep 10 11:01:16.066629 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3351/4357] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:15 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1290 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:16.148542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6358fcb9-5fe2-45fd-bd6b-d59ab8092164 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:16.149412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6358fcb9-5fe2-45fd-bd6b-d59ab8092164 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:16.152122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:01:16.156267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f864d76e-384d-4040-9d1f-9e803c43b6b5',volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:01:16.159918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6358fcb9-5fe2-45fd-bd6b-d59ab8092164 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:16.162029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6358fcb9-5fe2-45fd-bd6b-d59ab8092164 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:16.164767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6358fcb9-5fe2-45fd-bd6b-d59ab8092164 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:16.166090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6358fcb9-5fe2-45fd-bd6b-d59ab8092164 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:16.167815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6358fcb9-5fe2-45fd-bd6b-d59ab8092164 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:16.169331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6358fcb9-5fe2-45fd-bd6b-d59ab8092164 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:16.446434 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c89602f0-e227-4533-8a2a-159d92973567 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.205953 Sep 10 11:01:16.447116 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1007/4358] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:01:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 3207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:01:16.468317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-79c95dac-3a32-4650-91df-5187be6db30e tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:16.469036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-79c95dac-3a32-4650-91df-5187be6db30e tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:16.721650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-79c95dac-3a32-4650-91df-5187be6db30e tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:16.731120 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-79c95dac-3a32-4650-91df-5187be6db30e tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1097 microversion: 2.1 time: 0.271263 Sep 10 11:01:16.735322 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1008/4359] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:16 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1097 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:16.811627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:16.812344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:16.825952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:16.832586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:16.833243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:16.834631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:16.834631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:16.835073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:16.886236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6358fcb9-5fe2-45fd-bd6b-d59ab8092164 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:16.897286 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6358fcb9-5fe2-45fd-bd6b-d59ab8092164 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.753983 Sep 10 11:01:16.900164 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3352/4360] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:16 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:17.090774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-134a3da2-dee5-4191-9340-a997a8bc2634 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:17.091665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-134a3da2-dee5-4191-9340-a997a8bc2634 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:17.106171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-134a3da2-dee5-4191-9340-a997a8bc2634 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:17.106982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-134a3da2-dee5-4191-9340-a997a8bc2634 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:17.107595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-134a3da2-dee5-4191-9340-a997a8bc2634 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:17.108629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-134a3da2-dee5-4191-9340-a997a8bc2634 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:17.109262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-134a3da2-dee5-4191-9340-a997a8bc2634 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:17.109851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-134a3da2-dee5-4191-9340-a997a8bc2634 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:17.274783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-134a3da2-dee5-4191-9340-a997a8bc2634 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:17.289973 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-134a3da2-dee5-4191-9340-a997a8bc2634 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1296 microversion: 2.1 time: 0.202633 Sep 10 11:01:17.294194 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3353/4361] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:17 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1296 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:17.416513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:17.433450 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:17.435515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:17.438941 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5be34621-cf5c-40c8-bea4-ad1d17cbf3a5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1844 microversion: 2.42 time: 0.633019 Sep 10 11:01:17.441025 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1009/4362] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:16 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1844 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:17.763919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0122af8b-da79-463b-86e4-97c64c353225 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:17.764672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0122af8b-da79-463b-86e4-97c64c353225 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:17.782674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0122af8b-da79-463b-86e4-97c64c353225 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:17.788003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0122af8b-da79-463b-86e4-97c64c353225 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:17.790874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0122af8b-da79-463b-86e4-97c64c353225 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:17.791820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0122af8b-da79-463b-86e4-97c64c353225 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:17.793979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0122af8b-da79-463b-86e4-97c64c353225 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:17.794663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0122af8b-da79-463b-86e4-97c64c353225 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:17.925061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-483a9976-eea6-4c8c-a1c2-e9845d5d467a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:17.926693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-483a9976-eea6-4c8c-a1c2-e9845d5d467a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:17.935920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-483a9976-eea6-4c8c-a1c2-e9845d5d467a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:17.936869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-483a9976-eea6-4c8c-a1c2-e9845d5d467a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:17.938349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-483a9976-eea6-4c8c-a1c2-e9845d5d467a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:17.939542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-483a9976-eea6-4c8c-a1c2-e9845d5d467a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:17.941841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-483a9976-eea6-4c8c-a1c2-e9845d5d467a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:17.943351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-483a9976-eea6-4c8c-a1c2-e9845d5d467a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:17.943686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0122af8b-da79-463b-86e4-97c64c353225 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:17.963530 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0122af8b-da79-463b-86e4-97c64c353225 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1195 microversion: 2.1 time: 0.211458 Sep 10 11:01:17.970397 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3354/4363] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:17 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1195 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:18.323225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d5f1f1b9-bc91-4164-a23e-c2793da0fcb6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:18.324110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d5f1f1b9-bc91-4164-a23e-c2793da0fcb6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:18.338243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5f1f1b9-bc91-4164-a23e-c2793da0fcb6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:18.341327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5f1f1b9-bc91-4164-a23e-c2793da0fcb6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:18.342205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5f1f1b9-bc91-4164-a23e-c2793da0fcb6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:18.346599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5f1f1b9-bc91-4164-a23e-c2793da0fcb6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:18.347316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5f1f1b9-bc91-4164-a23e-c2793da0fcb6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:18.347968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5f1f1b9-bc91-4164-a23e-c2793da0fcb6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:19.169339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-483a9976-eea6-4c8c-a1c2-e9845d5d467a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:19.182944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d5f1f1b9-bc91-4164-a23e-c2793da0fcb6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:19.186059 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-483a9976-eea6-4c8c-a1c2-e9845d5d467a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 1.266029 Sep 10 11:01:19.187206 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1010/4364] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:17 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:19.187315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:19.193806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:19.195374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:19.198594 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d5f1f1b9-bc91-4164-a23e-c2793da0fcb6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1363 microversion: 2.1 time: 0.883429 Sep 10 11:01:19.204420 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3355/4365] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:18 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1363 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:19.218476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05e6a680-a9ec-4ab9-af05-844b4809bff5 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:19.219738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05e6a680-a9ec-4ab9-af05-844b4809bff5 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:19.224606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:19.226967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:19.227636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:19.228684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:19.229513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:19.230501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:19.248614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6a680-a9ec-4ab9-af05-844b4809bff5 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:19.253681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6a680-a9ec-4ab9-af05-844b4809bff5 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:19.254416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6a680-a9ec-4ab9-af05-844b4809bff5 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:19.255395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6a680-a9ec-4ab9-af05-844b4809bff5 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:19.256385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6a680-a9ec-4ab9-af05-844b4809bff5 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:19.257101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05e6a680-a9ec-4ab9-af05-844b4809bff5 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:19.485195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05e6a680-a9ec-4ab9-af05-844b4809bff5 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:19.497456 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05e6a680-a9ec-4ab9-af05-844b4809bff5 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1213 microversion: 2.1 time: 0.290759 Sep 10 11:01:19.499458 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3356/4366] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:19 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1213 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:19.734264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a5814e77-f889-4b7d-87b0-f803eb14ae7e req-70835ce8-b81a-4a72-a886-c39611302259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98521ad-ebd1-473c-945f-70d80d31c1b7", "tag": "0c6312a0-b8d5-46be-a4cf-b31024eeb9e3"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:19.749805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a5814e77-f889-4b7d-87b0-f803eb14ae7e req-70835ce8-b81a-4a72-a886-c39611302259 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:19.750711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a5814e77-f889-4b7d-87b0-f803eb14ae7e req-70835ce8-b81a-4a72-a886-c39611302259 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:19.751507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a5814e77-f889-4b7d-87b0-f803eb14ae7e req-70835ce8-b81a-4a72-a886-c39611302259 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:19.770783 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a5814e77-f889-4b7d-87b0-f803eb14ae7e req-70835ce8-b81a-4a72-a886-c39611302259 service nova] Creating event network-changed:0c6312a0-b8d5-46be-a4cf-b31024eeb9e3 for instance f98521ad-ebd1-473c-945f-70d80d31c1b7 on n-h2-856894-1 Sep 10 11:01:19.776923 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a5814e77-f889-4b7d-87b0-f803eb14ae7e req-70835ce8-b81a-4a72-a886-c39611302259 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275878 Sep 10 11:01:19.777909 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3357/4367] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:19.785821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0451e9d0-57ff-4cae-9a70-6b350123cebc req-7e0df416-12b6-4e7f-9696-b06df5a7942f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "tag": "210108b0-a7eb-488b-aad7-2977ab966a4c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:19.798753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0451e9d0-57ff-4cae-9a70-6b350123cebc req-7e0df416-12b6-4e7f-9696-b06df5a7942f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:19.800182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0451e9d0-57ff-4cae-9a70-6b350123cebc req-7e0df416-12b6-4e7f-9696-b06df5a7942f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:19.801189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0451e9d0-57ff-4cae-9a70-6b350123cebc req-7e0df416-12b6-4e7f-9696-b06df5a7942f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:19.816230 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0451e9d0-57ff-4cae-9a70-6b350123cebc req-7e0df416-12b6-4e7f-9696-b06df5a7942f service nova] Creating event network-changed:210108b0-a7eb-488b-aad7-2977ab966a4c for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:01:19.823328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0451e9d0-57ff-4cae-9a70-6b350123cebc req-7e0df416-12b6-4e7f-9696-b06df5a7942f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043442 Sep 10 11:01:19.824937 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3358/4368] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:20.100869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:20.115051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:20.117607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:20.119170 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b67f4764-70fd-4669-a01c-6241d5b46a91 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1844 microversion: 2.42 time: 0.930749 Sep 10 11:01:20.120800 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1011/4369] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:19 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1844 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:20.215228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d5e2603e-2587-4e97-a661-8e523813d496 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:20.216507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d5e2603e-2587-4e97-a661-8e523813d496 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:20.223755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5e2603e-2587-4e97-a661-8e523813d496 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:20.224504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5e2603e-2587-4e97-a661-8e523813d496 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:20.225133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5e2603e-2587-4e97-a661-8e523813d496 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:20.226018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5e2603e-2587-4e97-a661-8e523813d496 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:20.226640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5e2603e-2587-4e97-a661-8e523813d496 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:20.227347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d5e2603e-2587-4e97-a661-8e523813d496 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:20.234362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8c7fba15-696e-4a2e-aa82-95661174664b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:20.235594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8c7fba15-696e-4a2e-aa82-95661174664b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:20.244994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7fba15-696e-4a2e-aa82-95661174664b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:20.246969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7fba15-696e-4a2e-aa82-95661174664b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:20.247607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7fba15-696e-4a2e-aa82-95661174664b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:20.254325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7fba15-696e-4a2e-aa82-95661174664b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:20.255002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7fba15-696e-4a2e-aa82-95661174664b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:20.255598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7fba15-696e-4a2e-aa82-95661174664b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:20.638408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d5e2603e-2587-4e97-a661-8e523813d496 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:20.649138 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d5e2603e-2587-4e97-a661-8e523813d496 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.438729 Sep 10 11:01:20.650833 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3359/4370] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:20 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:20.668463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb9a01f2-ee1b-4b12-ba1c-a4c27cac5f54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:20.669432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fb9a01f2-ee1b-4b12-ba1c-a4c27cac5f54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:20.684183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb9a01f2-ee1b-4b12-ba1c-a4c27cac5f54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:20.686905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb9a01f2-ee1b-4b12-ba1c-a4c27cac5f54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:20.687524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb9a01f2-ee1b-4b12-ba1c-a4c27cac5f54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:20.689796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb9a01f2-ee1b-4b12-ba1c-a4c27cac5f54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:20.692571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb9a01f2-ee1b-4b12-ba1c-a4c27cac5f54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:20.693217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb9a01f2-ee1b-4b12-ba1c-a4c27cac5f54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:21.026694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb9a01f2-ee1b-4b12-ba1c-a4c27cac5f54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:21.040826 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb9a01f2-ee1b-4b12-ba1c-a4c27cac5f54 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1213 microversion: 2.1 time: 0.387137 Sep 10 11:01:21.041499 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3360/4371] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:20 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1213 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:21.146422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:21.148111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:21.161278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8c7fba15-696e-4a2e-aa82-95661174664b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:21.162563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:21.163260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:21.164101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:21.164989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:21.171082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:21.171810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:21.173097 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8c7fba15-696e-4a2e-aa82-95661174664b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1363 microversion: 2.1 time: 0.942828 Sep 10 11:01:21.174413 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1012/4372] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:20 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1363 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:21.677244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2f9fefc8-6e56-4425-8086-4c004fbfc315 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:21.678088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2f9fefc8-6e56-4425-8086-4c004fbfc315 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:21.690175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f9fefc8-6e56-4425-8086-4c004fbfc315 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:21.697333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f9fefc8-6e56-4425-8086-4c004fbfc315 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:21.697987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f9fefc8-6e56-4425-8086-4c004fbfc315 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:21.698812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f9fefc8-6e56-4425-8086-4c004fbfc315 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:21.699592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f9fefc8-6e56-4425-8086-4c004fbfc315 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:21.700246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f9fefc8-6e56-4425-8086-4c004fbfc315 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:21.790594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:21.817761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:21.823970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:21.828668 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a79d099f-dffc-416a-ba60-dc54470b2166 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1844 microversion: 2.42 time: 0.685966 Sep 10 11:01:21.831579 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3361/4373] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:21 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1844 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:22.064814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76fcc860-62a8-4d75-9e09-58cc91e638a0 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:22.065584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-76fcc860-62a8-4d75-9e09-58cc91e638a0 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:22.081118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76fcc860-62a8-4d75-9e09-58cc91e638a0 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:22.081745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76fcc860-62a8-4d75-9e09-58cc91e638a0 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:22.082254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76fcc860-62a8-4d75-9e09-58cc91e638a0 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:22.083197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76fcc860-62a8-4d75-9e09-58cc91e638a0 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:22.084647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76fcc860-62a8-4d75-9e09-58cc91e638a0 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:22.085300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76fcc860-62a8-4d75-9e09-58cc91e638a0 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:22.270003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76fcc860-62a8-4d75-9e09-58cc91e638a0 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:22.289057 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76fcc860-62a8-4d75-9e09-58cc91e638a0 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1213 microversion: 2.1 time: 0.228070 Sep 10 11:01:22.294583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2f9fefc8-6e56-4425-8086-4c004fbfc315 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:22.302344 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2f9fefc8-6e56-4425-8086-4c004fbfc315 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.630217 Sep 10 11:01:22.306933 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3362/4374] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:22 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1213 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:22.322434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe581b7f-5757-47f0-bd08-b21006418c9a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:22.323218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fe581b7f-5757-47f0-bd08-b21006418c9a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:22.325835 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1013/4375] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:21 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:22.339643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe581b7f-5757-47f0-bd08-b21006418c9a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:22.340151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe581b7f-5757-47f0-bd08-b21006418c9a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:22.340604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe581b7f-5757-47f0-bd08-b21006418c9a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:22.350151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe581b7f-5757-47f0-bd08-b21006418c9a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:22.350781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe581b7f-5757-47f0-bd08-b21006418c9a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:22.351254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe581b7f-5757-47f0-bd08-b21006418c9a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:22.759749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fe581b7f-5757-47f0-bd08-b21006418c9a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:22.780344 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe581b7f-5757-47f0-bd08-b21006418c9a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1363 microversion: 2.1 time: 0.470489 Sep 10 11:01:22.781407 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3363/4376] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:22 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1363 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:22.866389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:22.867016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:22.874248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:22.875000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:22.875599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:22.876472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:22.878098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:22.878712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:23.318891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-853a13a1-ca05-4ec1-b5cb-4cf59e5aee85 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:23.320022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-853a13a1-ca05-4ec1-b5cb-4cf59e5aee85 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:23.329846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-853a13a1-ca05-4ec1-b5cb-4cf59e5aee85 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:23.331111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-853a13a1-ca05-4ec1-b5cb-4cf59e5aee85 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:23.331745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-853a13a1-ca05-4ec1-b5cb-4cf59e5aee85 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:23.332718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-853a13a1-ca05-4ec1-b5cb-4cf59e5aee85 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:23.333442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-853a13a1-ca05-4ec1-b5cb-4cf59e5aee85 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:23.334034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-853a13a1-ca05-4ec1-b5cb-4cf59e5aee85 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:24.298469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:24.334779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=20 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:24.696387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:24.708910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:24.713777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:24.721644 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-15b3748e-9895-4adf-b5f5-338239c4c020 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1865 microversion: 2.42 time: 1.854840 Sep 10 11:01:24.722805 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1014/4377] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:22 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1865 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:24.732742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-78a3679d-1b7e-4549-8399-81d0c182135b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:24.735307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-78a3679d-1b7e-4549-8399-81d0c182135b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:24.746129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-853a13a1-ca05-4ec1-b5cb-4cf59e5aee85 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:24.751552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a3679d-1b7e-4549-8399-81d0c182135b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:24.754288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a3679d-1b7e-4549-8399-81d0c182135b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:24.754952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a3679d-1b7e-4549-8399-81d0c182135b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:24.757161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a3679d-1b7e-4549-8399-81d0c182135b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:24.757847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a3679d-1b7e-4549-8399-81d0c182135b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:24.760230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a3679d-1b7e-4549-8399-81d0c182135b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:24.762735 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-853a13a1-ca05-4ec1-b5cb-4cf59e5aee85 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1281 microversion: 2.1 time: 1.447227 Sep 10 11:01:24.763353 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3364/4378] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:23 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1281 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:24.792459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-065faa3a-a8ff-4695-9a21-cb96a2ccb9a9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:24.793465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-065faa3a-a8ff-4695-9a21-cb96a2ccb9a9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:24.802719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-065faa3a-a8ff-4695-9a21-cb96a2ccb9a9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:24.805269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-065faa3a-a8ff-4695-9a21-cb96a2ccb9a9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:24.807885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-065faa3a-a8ff-4695-9a21-cb96a2ccb9a9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:24.811964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-065faa3a-a8ff-4695-9a21-cb96a2ccb9a9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:24.812611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-065faa3a-a8ff-4695-9a21-cb96a2ccb9a9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:24.813285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-065faa3a-a8ff-4695-9a21-cb96a2ccb9a9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:25.395118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78a3679d-1b7e-4549-8399-81d0c182135b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:25.409199 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-78a3679d-1b7e-4549-8399-81d0c182135b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.684494 Sep 10 11:01:25.417839 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1015/4379] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:24 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:25.439845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-a4b2e2d9-241c-4fbf-a44e-63ec504b8536 req-ea832dc8-db74-48f7-9443-295d1ed28735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98521ad-ebd1-473c-945f-70d80d31c1b7", "name": "network-vif-plugged", "status": "completed", "tag": "0c6312a0-b8d5-46be-a4cf-b31024eeb9e3"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:25.462584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a4b2e2d9-241c-4fbf-a44e-63ec504b8536 req-ea832dc8-db74-48f7-9443-295d1ed28735 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:25.463409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a4b2e2d9-241c-4fbf-a44e-63ec504b8536 req-ea832dc8-db74-48f7-9443-295d1ed28735 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:25.464060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a4b2e2d9-241c-4fbf-a44e-63ec504b8536 req-ea832dc8-db74-48f7-9443-295d1ed28735 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:25.478842 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-a4b2e2d9-241c-4fbf-a44e-63ec504b8536 req-ea832dc8-db74-48f7-9443-295d1ed28735 service nova] Creating event network-vif-plugged:0c6312a0-b8d5-46be-a4cf-b31024eeb9e3 for instance f98521ad-ebd1-473c-945f-70d80d31c1b7 on n-h2-856894-1 Sep 10 11:01:25.484788 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-a4b2e2d9-241c-4fbf-a44e-63ec504b8536 req-ea832dc8-db74-48f7-9443-295d1ed28735 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053925 Sep 10 11:01:25.485767 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1016/4380] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:25.492510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-cfce21d9-2c92-4226-9b02-6dfcbda9e392 req-afaace9f-d6bf-404f-8271-c092e54cd374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "tag": "9197c705-e5c1-4ffa-bb14-2abe9061e2f5"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:25.506737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cfce21d9-2c92-4226-9b02-6dfcbda9e392 req-afaace9f-d6bf-404f-8271-c092e54cd374 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:25.507524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cfce21d9-2c92-4226-9b02-6dfcbda9e392 req-afaace9f-d6bf-404f-8271-c092e54cd374 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:25.508132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cfce21d9-2c92-4226-9b02-6dfcbda9e392 req-afaace9f-d6bf-404f-8271-c092e54cd374 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:25.525350 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-cfce21d9-2c92-4226-9b02-6dfcbda9e392 req-afaace9f-d6bf-404f-8271-c092e54cd374 service nova] Creating event network-changed:9197c705-e5c1-4ffa-bb14-2abe9061e2f5 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:01:25.533283 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-cfce21d9-2c92-4226-9b02-6dfcbda9e392 req-afaace9f-d6bf-404f-8271-c092e54cd374 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045020 Sep 10 11:01:25.535735 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1017/4381] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:25.751949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:25.754962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:25.767149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:25.767574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:25.768647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:25.773307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:25.776858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:25.777349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:25.928210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-065faa3a-a8ff-4695-9a21-cb96a2ccb9a9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:25.968811 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-065faa3a-a8ff-4695-9a21-cb96a2ccb9a9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1363 microversion: 2.1 time: 1.203830 Sep 10 11:01:25.973767 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3365/4382] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:24 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1363 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:25.982657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eccf722f-2824-40b6-ba4d-7eb780f7435d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:25.999410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:26.016999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eccf722f-2824-40b6-ba4d-7eb780f7435d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:26.024971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccf722f-2824-40b6-ba4d-7eb780f7435d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:26.025812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccf722f-2824-40b6-ba4d-7eb780f7435d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:26.027368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccf722f-2824-40b6-ba4d-7eb780f7435d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:26.028601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccf722f-2824-40b6-ba4d-7eb780f7435d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:26.029467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccf722f-2824-40b6-ba4d-7eb780f7435d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:26.030086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eccf722f-2824-40b6-ba4d-7eb780f7435d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:26.737652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:26.773358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:26.785849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:26.787323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:26.788526 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-240f1646-f68f-4713-9230-b89448f586ad tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1865 microversion: 2.42 time: 1.041435 Sep 10 11:01:26.791145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eccf722f-2824-40b6-ba4d-7eb780f7435d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:26.801936 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1018/4383] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:25 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1865 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:26.811516 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eccf722f-2824-40b6-ba4d-7eb780f7435d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1281 microversion: 2.1 time: 0.832846 Sep 10 11:01:26.812140 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3366/4384] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:25 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1281 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:26.821385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a2a07038-31b3-4b99-a58a-b2d5ba7ebe9c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:26.822068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a2a07038-31b3-4b99-a58a-b2d5ba7ebe9c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:26.833962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a07038-31b3-4b99-a58a-b2d5ba7ebe9c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:26.834505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a07038-31b3-4b99-a58a-b2d5ba7ebe9c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:26.834880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a07038-31b3-4b99-a58a-b2d5ba7ebe9c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:26.835593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a07038-31b3-4b99-a58a-b2d5ba7ebe9c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:26.836051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a07038-31b3-4b99-a58a-b2d5ba7ebe9c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:26.836483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a07038-31b3-4b99-a58a-b2d5ba7ebe9c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:26.996094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff4eb4a6-a678-4b12-9a65-3213b2c2a30e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:26.996728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff4eb4a6-a678-4b12-9a65-3213b2c2a30e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:27.006196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4eb4a6-a678-4b12-9a65-3213b2c2a30e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:27.010074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4eb4a6-a678-4b12-9a65-3213b2c2a30e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:27.010793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4eb4a6-a678-4b12-9a65-3213b2c2a30e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:27.012047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4eb4a6-a678-4b12-9a65-3213b2c2a30e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:27.012721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4eb4a6-a678-4b12-9a65-3213b2c2a30e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:27.013582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff4eb4a6-a678-4b12-9a65-3213b2c2a30e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:27.394344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff4eb4a6-a678-4b12-9a65-3213b2c2a30e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:27.404177 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff4eb4a6-a678-4b12-9a65-3213b2c2a30e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1363 microversion: 2.1 time: 0.412654 Sep 10 11:01:27.404794 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3367/4385] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:26 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1363 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:27.459142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a2a07038-31b3-4b99-a58a-b2d5ba7ebe9c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:27.467876 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a2a07038-31b3-4b99-a58a-b2d5ba7ebe9c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.658816 Sep 10 11:01:27.474489 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1019/4386] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:26 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:27.592351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-230979532", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "9286c905-37d0-4edb-8abf-64fb777b997f"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:27.724691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] validate_networks() for [('9286c905-37d0-4edb-8abf-64fb777b997f', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:01:27.817332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:27.819197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:27.827317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:27.828216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:27.829279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:27.830775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:27.831427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:27.834092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:28.312260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:28.315462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:28.330579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:28.339119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:28.340775 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7b0ccd22-89ee-4a81-b3b0-0ffa227886ba tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1886 microversion: 2.42 time: 0.528845 Sep 10 11:01:28.342537 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1020/4387] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:27 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1886 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:28.365223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e33a698e-c107-4c65-861f-22865c41c5cd tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:28.374403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e33a698e-c107-4c65-861f-22865c41c5cd tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:28.389607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e33a698e-c107-4c65-861f-22865c41c5cd tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:28.390217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e33a698e-c107-4c65-861f-22865c41c5cd tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:28.391247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e33a698e-c107-4c65-861f-22865c41c5cd tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:28.394017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e33a698e-c107-4c65-861f-22865c41c5cd tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:28.394748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e33a698e-c107-4c65-861f-22865c41c5cd tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:28.395798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e33a698e-c107-4c65-861f-22865c41c5cd tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:30.084266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e33a698e-c107-4c65-861f-22865c41c5cd tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:30.100195 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e33a698e-c107-4c65-861f-22865c41c5cd tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1281 microversion: 2.1 time: 1.753242 Sep 10 11:01:30.104552 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1021/4388] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:28 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1281 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:30.121656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-0c1238d5-4c0b-49af-bf49-c7bd5f08d06b req-b5b11b62-e612-4fcc-a765-25a6479c21a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "tag": "dd6bd1fd-3270-45c6-9883-d9fe196e44d2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:30.147703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0c1238d5-4c0b-49af-bf49-c7bd5f08d06b req-b5b11b62-e612-4fcc-a765-25a6479c21a3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:30.149816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0c1238d5-4c0b-49af-bf49-c7bd5f08d06b req-b5b11b62-e612-4fcc-a765-25a6479c21a3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:30.154608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0c1238d5-4c0b-49af-bf49-c7bd5f08d06b req-b5b11b62-e612-4fcc-a765-25a6479c21a3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:30.173722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:01:30.175448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:01:30.176176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:01:30.176874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:01:30.177605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:01:30.186073 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-0c1238d5-4c0b-49af-bf49-c7bd5f08d06b req-b5b11b62-e612-4fcc-a765-25a6479c21a3 service nova] Creating event network-changed:dd6bd1fd-3270-45c6-9883-d9fe196e44d2 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:01:30.198720 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-0c1238d5-4c0b-49af-bf49-c7bd5f08d06b req-b5b11b62-e612-4fcc-a765-25a6479c21a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091611 Sep 10 11:01:30.202234 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1022/4389] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:30.203292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:30.203930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:30.206922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:30.208489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:30.211774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:30.215182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:30.219114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8b9d1a8c-112e-42c9-a5ac-d51129e4dee9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:30.224666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8b9d1a8c-112e-42c9-a5ac-d51129e4dee9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:30.237986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9d1a8c-112e-42c9-a5ac-d51129e4dee9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:30.240550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9d1a8c-112e-42c9-a5ac-d51129e4dee9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:30.242915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9d1a8c-112e-42c9-a5ac-d51129e4dee9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:30.243864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9d1a8c-112e-42c9-a5ac-d51129e4dee9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:30.244503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9d1a8c-112e-42c9-a5ac-d51129e4dee9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:30.247383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9d1a8c-112e-42c9-a5ac-d51129e4dee9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:30.273212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Getting quotas for project 9effaef7c22b495ab77296c19bab7b12. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:01:30.287622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Getting quotas for user 3841a45bf21444f8aa0fcb64fd6aaea3 and project 9effaef7c22b495ab77296c19bab7b12. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:01:30.327571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:01:30.334732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:01:30.444317 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff8c7622-63d8-4e6e-bcbd-7d17624505f9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.038351 Sep 10 11:01:30.445201 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3368/4390] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 11:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3040 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:01:30.460613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-83acc146-5f62-4792-9377-48581f8b7aa7 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:30.464524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-83acc146-5f62-4792-9377-48581f8b7aa7 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:30.502552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83acc146-5f62-4792-9377-48581f8b7aa7 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:30.515839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83acc146-5f62-4792-9377-48581f8b7aa7 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:30.516843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83acc146-5f62-4792-9377-48581f8b7aa7 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:30.519483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83acc146-5f62-4792-9377-48581f8b7aa7 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:30.520115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83acc146-5f62-4792-9377-48581f8b7aa7 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:30.522874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83acc146-5f62-4792-9377-48581f8b7aa7 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:31.330847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-83acc146-5f62-4792-9377-48581f8b7aa7 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:31.348544 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-83acc146-5f62-4792-9377-48581f8b7aa7 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.901310 Sep 10 11:01:31.362119 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3369/4391] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:30 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:31.371384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:31.372281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:31.380237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:31.381007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:31.381616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:31.387868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:31.388522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:31.389260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:31.566619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8b9d1a8c-112e-42c9-a5ac-d51129e4dee9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:31.586448 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8b9d1a8c-112e-42c9-a5ac-d51129e4dee9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1549 microversion: 2.1 time: 1.382682 Sep 10 11:01:31.589357 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1023/4392] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:30 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1549 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:31.599381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:31.606050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:31.638799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:31.639602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:31.640259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:31.641198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:31.651010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:31.651465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:31.943481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:31.958550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:31.960020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:31.961212 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-367dddf2-70ef-4fe2-adca-54bdea0f2596 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1257 microversion: 2.26 time: 0.366282 Sep 10 11:01:31.966605 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1024/4393] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:31 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1257 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:31.977330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-65a18c18-6f68-441d-89fe-5bde663f75b2 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:31.977977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-65a18c18-6f68-441d-89fe-5bde663f75b2 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:31.993484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a18c18-6f68-441d-89fe-5bde663f75b2 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:31.994325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a18c18-6f68-441d-89fe-5bde663f75b2 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:31.995194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a18c18-6f68-441d-89fe-5bde663f75b2 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:31.996095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a18c18-6f68-441d-89fe-5bde663f75b2 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:31.997303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a18c18-6f68-441d-89fe-5bde663f75b2 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:31.999534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a18c18-6f68-441d-89fe-5bde663f75b2 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:32.149014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:32.163415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:32.166534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:32.167774 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d74e0a0-e424-48cf-908d-92e54bb9cb5d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1886 microversion: 2.42 time: 0.804534 Sep 10 11:01:32.168361 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3370/4394] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:31 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1886 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:32.187228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8b7efd7-54f1-4cca-9d38-cecdcd46068e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:32.187747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f8b7efd7-54f1-4cca-9d38-cecdcd46068e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:32.198476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b7efd7-54f1-4cca-9d38-cecdcd46068e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:32.199307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b7efd7-54f1-4cca-9d38-cecdcd46068e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:32.199905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b7efd7-54f1-4cca-9d38-cecdcd46068e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:32.200783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b7efd7-54f1-4cca-9d38-cecdcd46068e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:32.201703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b7efd7-54f1-4cca-9d38-cecdcd46068e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:32.202388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b7efd7-54f1-4cca-9d38-cecdcd46068e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:32.381678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-65a18c18-6f68-441d-89fe-5bde663f75b2 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:32.401545 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8b7efd7-54f1-4cca-9d38-cecdcd46068e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.231964 Sep 10 11:01:32.402913 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3371/4395] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:01:32 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/os-interface => generated 284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:32.415797 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-65a18c18-6f68-441d-89fe-5bde663f75b2 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1269 microversion: 2.1 time: 0.446649 Sep 10 11:01:32.416433 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1025/4396] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:31 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1269 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:32.417387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7625bd5a-0912-4933-8372-d3fd9c8fad58 req-450ca87f-bf62-427e-871c-c00863111e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b52c87-5cab-4f2b-b25f-3f5d12ca063d", "tag": "ac32bd2a-cfc1-46eb-9ede-750a98047328"}, {"name": "network-changed", "server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "tag": "e66f2383-ec13-45eb-a0f1-1d3e117bb57b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:32.431545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bb9c3a48-494a-4d1d-9c7a-4a15a490e651 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:32.432860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bb9c3a48-494a-4d1d-9c7a-4a15a490e651 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:32.438429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7625bd5a-0912-4933-8372-d3fd9c8fad58 req-450ca87f-bf62-427e-871c-c00863111e4e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:32.438945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7625bd5a-0912-4933-8372-d3fd9c8fad58 req-450ca87f-bf62-427e-871c-c00863111e4e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:32.442147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7625bd5a-0912-4933-8372-d3fd9c8fad58 req-450ca87f-bf62-427e-871c-c00863111e4e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:32.464603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb9c3a48-494a-4d1d-9c7a-4a15a490e651 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:32.467596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb9c3a48-494a-4d1d-9c7a-4a15a490e651 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:32.470639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb9c3a48-494a-4d1d-9c7a-4a15a490e651 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:32.474730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb9c3a48-494a-4d1d-9c7a-4a15a490e651 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:32.476099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb9c3a48-494a-4d1d-9c7a-4a15a490e651 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:32.476857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb9c3a48-494a-4d1d-9c7a-4a15a490e651 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:32.480194 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7625bd5a-0912-4933-8372-d3fd9c8fad58 req-450ca87f-bf62-427e-871c-c00863111e4e service nova] Creating event network-changed:ac32bd2a-cfc1-46eb-9ede-750a98047328 for instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d on n-h2-856894-1 Sep 10 11:01:32.481160 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7625bd5a-0912-4933-8372-d3fd9c8fad58 req-450ca87f-bf62-427e-871c-c00863111e4e service nova] Creating event network-changed:e66f2383-ec13-45eb-a0f1-1d3e117bb57b for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:01:32.510721 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7625bd5a-0912-4933-8372-d3fd9c8fad58 req-450ca87f-bf62-427e-871c-c00863111e4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.104443 Sep 10 11:01:32.511569 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3372/4397] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:33.006292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:33.008644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:33.025541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:33.026058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:33.026549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:33.027281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:33.027749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:33.039856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:33.119442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bb9c3a48-494a-4d1d-9c7a-4a15a490e651 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:33.134639 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bb9c3a48-494a-4d1d-9c7a-4a15a490e651 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.711661 Sep 10 11:01:33.135285 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1026/4398] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:32 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:33.197306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:33.199078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:33.212149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:33.213060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:33.213758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:33.215310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:33.216701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:33.217314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:33.262892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:33.289835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:33.291879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:33.294537 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e87a1899-c603-4167-8d4d-47b037e74a25 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1313 microversion: 2.26 time: 0.300825 Sep 10 11:01:33.299778 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3373/4399] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:32 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:33.442692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8de141ba-4d21-4cfc-a4ca-9e102a392f94 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:33.443451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8de141ba-4d21-4cfc-a4ca-9e102a392f94 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:33.458324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de141ba-4d21-4cfc-a4ca-9e102a392f94 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:33.458841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de141ba-4d21-4cfc-a4ca-9e102a392f94 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:33.459292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de141ba-4d21-4cfc-a4ca-9e102a392f94 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:33.460012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de141ba-4d21-4cfc-a4ca-9e102a392f94 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:33.476651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de141ba-4d21-4cfc-a4ca-9e102a392f94 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:33.477284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8de141ba-4d21-4cfc-a4ca-9e102a392f94 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:33.840387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:33.850396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:33.851929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:33.853129 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-30f769dc-1f8c-441a-92b6-ca0bb4eada4d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.659970 Sep 10 11:01:33.855389 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1027/4400] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:33 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:34.174717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cde8c4a1-95fb-4e8a-88c9-eeca01297123 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:34.176571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cde8c4a1-95fb-4e8a-88c9-eeca01297123 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:34.187238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cde8c4a1-95fb-4e8a-88c9-eeca01297123 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:34.188211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cde8c4a1-95fb-4e8a-88c9-eeca01297123 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:34.189126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cde8c4a1-95fb-4e8a-88c9-eeca01297123 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:34.192154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cde8c4a1-95fb-4e8a-88c9-eeca01297123 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:34.194337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cde8c4a1-95fb-4e8a-88c9-eeca01297123 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:34.196147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cde8c4a1-95fb-4e8a-88c9-eeca01297123 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:34.625454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8de141ba-4d21-4cfc-a4ca-9e102a392f94 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:34.639237 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8de141ba-4d21-4cfc-a4ca-9e102a392f94 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1269 microversion: 2.1 time: 1.203735 Sep 10 11:01:34.640344 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3374/4401] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:33 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1269 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:34.667509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:34.669452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:34.684563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:34.685276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:34.686555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:34.687905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:34.688533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:34.690724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:34.729145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:34.856537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:34.857489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cde8c4a1-95fb-4e8a-88c9-eeca01297123 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:34.871817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:34.872315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:34.876391 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cde8c4a1-95fb-4e8a-88c9-eeca01297123 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1486 microversion: 2.1 time: 0.715178 Sep 10 11:01:34.878114 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7792cfd6-afb7-44ff-a178-2321be61630c tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1319 microversion: 2.26 time: 0.231990 Sep 10 11:01:34.879622 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1028/4402] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:34 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1486 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:34.888325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-3bef28ec-3212-4d41-85cd-892f5e6e3528 req-5580340f-e66a-438c-946a-005da14d341c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "tag": "1387031f-4f94-43c5-9a5c-744bd5765477"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:34.889569 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3375/4403] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:34 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:34.907251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:34.913169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3bef28ec-3212-4d41-85cd-892f5e6e3528 req-5580340f-e66a-438c-946a-005da14d341c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:34.915033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3bef28ec-3212-4d41-85cd-892f5e6e3528 req-5580340f-e66a-438c-946a-005da14d341c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:34.916857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3bef28ec-3212-4d41-85cd-892f5e6e3528 req-5580340f-e66a-438c-946a-005da14d341c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:34.923625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:34.924274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:34.948488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:34.949327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:34.949646 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3bef28ec-3212-4d41-85cd-892f5e6e3528 req-5580340f-e66a-438c-946a-005da14d341c service nova] Creating event network-changed:1387031f-4f94-43c5-9a5c-744bd5765477 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:01:34.950162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:34.951160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:34.951646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:34.952117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:34.954569 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-3bef28ec-3212-4d41-85cd-892f5e6e3528 req-5580340f-e66a-438c-946a-005da14d341c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073468 Sep 10 11:01:34.966563 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1029/4404] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:34.979388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-58f85050-9bcd-4672-8bdf-2babae8f1bb1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:34.980023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-58f85050-9bcd-4672-8bdf-2babae8f1bb1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:35.000832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f85050-9bcd-4672-8bdf-2babae8f1bb1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:35.001605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f85050-9bcd-4672-8bdf-2babae8f1bb1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:35.005773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f85050-9bcd-4672-8bdf-2babae8f1bb1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:35.006862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f85050-9bcd-4672-8bdf-2babae8f1bb1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:35.007566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f85050-9bcd-4672-8bdf-2babae8f1bb1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:35.009636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f85050-9bcd-4672-8bdf-2babae8f1bb1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:35.116673 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-58f85050-9bcd-4672-8bdf-2babae8f1bb1 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "POST /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d/action" status: 202 len: 0 microversion: 2.1 time: 0.148215 Sep 10 11:01:35.117751 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1030/4405] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:01:34 2022] POST /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:01:35.128917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6779ab44-6479-42c2-ae3d-8925ac207dfe tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:35.131160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6779ab44-6479-42c2-ae3d-8925ac207dfe tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:35.161500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6779ab44-6479-42c2-ae3d-8925ac207dfe tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:35.164326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6779ab44-6479-42c2-ae3d-8925ac207dfe tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:35.164800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6779ab44-6479-42c2-ae3d-8925ac207dfe tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:35.168353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6779ab44-6479-42c2-ae3d-8925ac207dfe tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:35.168848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6779ab44-6479-42c2-ae3d-8925ac207dfe tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:35.169409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6779ab44-6479-42c2-ae3d-8925ac207dfe tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:35.758058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:35.781415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:35.783605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:35.785122 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-08064b62-6ec3-4e36-b50c-69bcdb6721b0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.894569 Sep 10 11:01:35.786264 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3376/4406] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:34 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:35.802494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b84a40c-fb5b-43b0-a942-3ef16631e947 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:35.803553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1b84a40c-fb5b-43b0-a942-3ef16631e947 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:35.816513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b84a40c-fb5b-43b0-a942-3ef16631e947 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:35.817351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b84a40c-fb5b-43b0-a942-3ef16631e947 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:35.818017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b84a40c-fb5b-43b0-a942-3ef16631e947 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:35.819215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b84a40c-fb5b-43b0-a942-3ef16631e947 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:35.820145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b84a40c-fb5b-43b0-a942-3ef16631e947 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:35.820823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b84a40c-fb5b-43b0-a942-3ef16631e947 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:35.895534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6779ab44-6479-42c2-ae3d-8925ac207dfe tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:35.908869 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6779ab44-6479-42c2-ae3d-8925ac207dfe tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1494 microversion: 2.1 time: 0.787097 Sep 10 11:01:35.910293 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1031/4407] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:35 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1494 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:35.938940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:35.940951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:35.958019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:35.959051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:35.960615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:35.962094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:35.962710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:35.963522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:36.657415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:36.677435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:36.683826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:36.686106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1b84a40c-fb5b-43b0-a942-3ef16631e947 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:36.688875 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f9962901-0e6d-4841-be9a-819b90776944 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 0.752949 Sep 10 11:01:36.692097 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1032/4408] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:35 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:36.717291 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b84a40c-fb5b-43b0-a942-3ef16631e947 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1269 microversion: 2.1 time: 0.929567 Sep 10 11:01:36.718601 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3377/4409] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:35 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1269 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:36.819222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:36.820534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:36.846559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:36.850197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:36.850852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:36.851759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:36.853639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:36.854232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:36.936260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-202d18f3-5e57-4382-8845-2f6d39ec6c6b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:36.937671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-202d18f3-5e57-4382-8845-2f6d39ec6c6b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:36.949143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-202d18f3-5e57-4382-8845-2f6d39ec6c6b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:36.951357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-202d18f3-5e57-4382-8845-2f6d39ec6c6b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:36.952003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-202d18f3-5e57-4382-8845-2f6d39ec6c6b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:36.954540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-202d18f3-5e57-4382-8845-2f6d39ec6c6b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:36.955352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-202d18f3-5e57-4382-8845-2f6d39ec6c6b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:36.956093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-202d18f3-5e57-4382-8845-2f6d39ec6c6b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:37.959952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-202d18f3-5e57-4382-8845-2f6d39ec6c6b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:37.969826 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-202d18f3-5e57-4382-8845-2f6d39ec6c6b tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1494 microversion: 2.1 time: 1.037666 Sep 10 11:01:37.971284 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3378/4410] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:36 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1494 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:37.982338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:37.999960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b52aaf97-c00b-4706-8225-b5fa4404e8ba req-df3cac1e-5d63-4fd1-8221-6a5db1cdfc19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78c52b2-a80e-40b4-85bc-aa292863e314", "tag": "8bcf0e24-04b4-49cd-bcf6-09cc09b2aeab"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:38.012174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:38.018410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:38.024299 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5d941d13-1307-44d3-91b4-f0ffa0a99996 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 1.211620 Sep 10 11:01:38.026547 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1033/4411] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:36 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:38.029451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:38.038164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:38.038502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b52aaf97-c00b-4706-8225-b5fa4404e8ba req-df3cac1e-5d63-4fd1-8221-6a5db1cdfc19 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:38.039165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b52aaf97-c00b-4706-8225-b5fa4404e8ba req-df3cac1e-5d63-4fd1-8221-6a5db1cdfc19 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:38.039718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b52aaf97-c00b-4706-8225-b5fa4404e8ba req-df3cac1e-5d63-4fd1-8221-6a5db1cdfc19 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:38.041840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:38.056385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:38.057107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:38.061337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:38.062251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:38.062841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:38.065026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:38.074776 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b52aaf97-c00b-4706-8225-b5fa4404e8ba req-df3cac1e-5d63-4fd1-8221-6a5db1cdfc19 service nova] Creating event network-changed:8bcf0e24-04b4-49cd-bcf6-09cc09b2aeab for instance e78c52b2-a80e-40b4-85bc-aa292863e314 on n-h2-856894-1 Sep 10 11:01:38.082867 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b52aaf97-c00b-4706-8225-b5fa4404e8ba req-df3cac1e-5d63-4fd1-8221-6a5db1cdfc19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109341 Sep 10 11:01:38.084422 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3379/4412] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:38.096564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dee6e63d-f1ba-4bcd-aa4c-c1e1ce0ad9e1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:38.099056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dee6e63d-f1ba-4bcd-aa4c-c1e1ce0ad9e1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:38.107469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dee6e63d-f1ba-4bcd-aa4c-c1e1ce0ad9e1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:38.108339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dee6e63d-f1ba-4bcd-aa4c-c1e1ce0ad9e1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:38.109012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dee6e63d-f1ba-4bcd-aa4c-c1e1ce0ad9e1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:38.109985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dee6e63d-f1ba-4bcd-aa4c-c1e1ce0ad9e1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:38.110828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dee6e63d-f1ba-4bcd-aa4c-c1e1ce0ad9e1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:38.112065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dee6e63d-f1ba-4bcd-aa4c-c1e1ce0ad9e1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:38.542132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:38.557204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:38.562099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:38.563507 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-db388dc0-fc09-4f7e-9613-456db0f7ea19 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 0.535130 Sep 10 11:01:38.565651 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1034/4413] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:38 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:38.577506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-e432b078-6264-49a3-8aa1-f4c6437a6324 req-cbd63486-e300-47bd-b9db-e837467687df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98521ad-ebd1-473c-945f-70d80d31c1b7", "tag": "0c6312a0-b8d5-46be-a4cf-b31024eeb9e3"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:38.600920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e432b078-6264-49a3-8aa1-f4c6437a6324 req-cbd63486-e300-47bd-b9db-e837467687df service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:38.603015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e432b078-6264-49a3-8aa1-f4c6437a6324 req-cbd63486-e300-47bd-b9db-e837467687df service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:38.604867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e432b078-6264-49a3-8aa1-f4c6437a6324 req-cbd63486-e300-47bd-b9db-e837467687df service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:38.636328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dee6e63d-f1ba-4bcd-aa4c-c1e1ce0ad9e1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:38.636496 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-e432b078-6264-49a3-8aa1-f4c6437a6324 req-cbd63486-e300-47bd-b9db-e837467687df service nova] Creating event network-changed:0c6312a0-b8d5-46be-a4cf-b31024eeb9e3 for instance f98521ad-ebd1-473c-945f-70d80d31c1b7 on n-h2-856894-1 Sep 10 11:01:38.649555 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dee6e63d-f1ba-4bcd-aa4c-c1e1ce0ad9e1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1269 microversion: 2.1 time: 0.561786 Sep 10 11:01:38.652988 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-e432b078-6264-49a3-8aa1-f4c6437a6324 req-cbd63486-e300-47bd-b9db-e837467687df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078833 Sep 10 11:01:38.654334 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1035/4414] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:38.671062 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3380/4415] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:38 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1269 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:38.995425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9e5b747-7714-46e1-be97-bfa3bd0690aa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:38.996718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9e5b747-7714-46e1-be97-bfa3bd0690aa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:39.005376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e5b747-7714-46e1-be97-bfa3bd0690aa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:39.007174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e5b747-7714-46e1-be97-bfa3bd0690aa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:39.012024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e5b747-7714-46e1-be97-bfa3bd0690aa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:39.013011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e5b747-7714-46e1-be97-bfa3bd0690aa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:39.013658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e5b747-7714-46e1-be97-bfa3bd0690aa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:39.014266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9e5b747-7714-46e1-be97-bfa3bd0690aa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:39.059116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:39.059738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:39.068174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:39.068681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:39.069145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:39.069861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:39.070319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:39.070748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:39.471448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:39.516539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:39.520083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9e5b747-7714-46e1-be97-bfa3bd0690aa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:39.530313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:39.530747 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9e5b747-7714-46e1-be97-bfa3bd0690aa tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1494 microversion: 2.1 time: 0.539910 Sep 10 11:01:39.534370 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1036/4416] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:38 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1494 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:39.552903 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66127ac1-a0e7-4903-8222-249418c953e4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.476554 Sep 10 11:01:39.553634 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3381/4417] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:39 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:39.598005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:39.599039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:39.613835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:39.619178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:39.620081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:39.621370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:39.622192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:39.622818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:39.696201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc989df3-112c-4fc4-a9c8-bdb2f67fca34 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:39.696949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fc989df3-112c-4fc4-a9c8-bdb2f67fca34 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:39.707589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc989df3-112c-4fc4-a9c8-bdb2f67fca34 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:39.712022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc989df3-112c-4fc4-a9c8-bdb2f67fca34 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:39.713741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc989df3-112c-4fc4-a9c8-bdb2f67fca34 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:39.717357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc989df3-112c-4fc4-a9c8-bdb2f67fca34 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:39.718302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc989df3-112c-4fc4-a9c8-bdb2f67fca34 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:39.718903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc989df3-112c-4fc4-a9c8-bdb2f67fca34 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:39.980348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:39.989636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:39.996051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:40.000217 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3fd151fa-c448-420d-bfb7-6953e78dc7b5 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 0.406501 Sep 10 11:01:40.002386 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1037/4418] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:39 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:40.006453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fc989df3-112c-4fc4-a9c8-bdb2f67fca34 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:40.018705 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc989df3-112c-4fc4-a9c8-bdb2f67fca34 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1269 microversion: 2.1 time: 0.326399 Sep 10 11:01:40.020378 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3382/4419] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:39 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1269 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:40.558482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-70616491-2235-401d-ae3d-b2b4ca65fd8a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:40.559112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-70616491-2235-401d-ae3d-b2b4ca65fd8a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:40.572257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70616491-2235-401d-ae3d-b2b4ca65fd8a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:40.573536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70616491-2235-401d-ae3d-b2b4ca65fd8a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:40.574247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70616491-2235-401d-ae3d-b2b4ca65fd8a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:40.577636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70616491-2235-401d-ae3d-b2b4ca65fd8a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:40.578344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70616491-2235-401d-ae3d-b2b4ca65fd8a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:40.587997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:40.591170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:40.593593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:40.596206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:40.597022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70616491-2235-401d-ae3d-b2b4ca65fd8a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:40.610011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:40.612255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:40.620184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:40.623633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:40.624458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:40.625402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:40.636439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:41.032234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-70616491-2235-401d-ae3d-b2b4ca65fd8a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:41.044112 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-70616491-2235-401d-ae3d-b2b4ca65fd8a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1500 microversion: 2.1 time: 0.490396 Sep 10 11:01:41.045221 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1038/4420] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:40 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1500 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:41.051768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-3611ac88-d4ed-43d8-8f2a-839f24f8275d req-f53a24b5-8264-49ba-a6d5-1a66a112e508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "tag": "610ac6bc-c492-465a-8b1d-4ee26f478c96"}, {"name": "network-changed", "server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "tag": "37ceaf6b-33c8-4243-bc18-c92310693b11"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:41.066609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3611ac88-d4ed-43d8-8f2a-839f24f8275d req-f53a24b5-8264-49ba-a6d5-1a66a112e508 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:41.067364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3611ac88-d4ed-43d8-8f2a-839f24f8275d req-f53a24b5-8264-49ba-a6d5-1a66a112e508 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:41.068004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3611ac88-d4ed-43d8-8f2a-839f24f8275d req-f53a24b5-8264-49ba-a6d5-1a66a112e508 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:41.073494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:41.082983 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3611ac88-d4ed-43d8-8f2a-839f24f8275d req-f53a24b5-8264-49ba-a6d5-1a66a112e508 service nova] Creating event network-changed:610ac6bc-c492-465a-8b1d-4ee26f478c96 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:01:41.083740 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3611ac88-d4ed-43d8-8f2a-839f24f8275d req-f53a24b5-8264-49ba-a6d5-1a66a112e508 service nova] Creating event network-changed:37ceaf6b-33c8-4243-bc18-c92310693b11 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:01:41.088781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:41.089995 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-3611ac88-d4ed-43d8-8f2a-839f24f8275d req-f53a24b5-8264-49ba-a6d5-1a66a112e508 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043289 Sep 10 11:01:41.090771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:41.090934 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1039/4421] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:41.092282 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50c5b64f-dd11-46f8-9170-4751ab3594e0 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.510929 Sep 10 11:01:41.096834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:41.098296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:41.105833 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3383/4422] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:40 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:41.110826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:41.112080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:41.112704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:41.114503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:41.115206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:41.116160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:41.135081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-006429b6-c13d-4276-a84c-bf34704dc5d7 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:41.135975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-006429b6-c13d-4276-a84c-bf34704dc5d7 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:41.142993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-006429b6-c13d-4276-a84c-bf34704dc5d7 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:41.143384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-006429b6-c13d-4276-a84c-bf34704dc5d7 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:41.143831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-006429b6-c13d-4276-a84c-bf34704dc5d7 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:41.144543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-006429b6-c13d-4276-a84c-bf34704dc5d7 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:41.145835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-006429b6-c13d-4276-a84c-bf34704dc5d7 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:41.146472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-006429b6-c13d-4276-a84c-bf34704dc5d7 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:41.432009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-006429b6-c13d-4276-a84c-bf34704dc5d7 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:41.436051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:41.441760 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-006429b6-c13d-4276-a84c-bf34704dc5d7 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1269 microversion: 2.1 time: 0.334685 Sep 10 11:01:41.444781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:41.446273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:41.447431 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-daa6e776-2467-4543-b09b-252c15df5832 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 0.355251 Sep 10 11:01:41.448182 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1040/4423] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:41 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:41.452767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-54f8e529-bbdf-4f5e-b7a0-355338551258 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:41.453469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-54f8e529-bbdf-4f5e-b7a0-355338551258 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:41.458306 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3384/4424] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:41 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1269 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:41.460040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54f8e529-bbdf-4f5e-b7a0-355338551258 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:41.460524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54f8e529-bbdf-4f5e-b7a0-355338551258 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:41.461132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54f8e529-bbdf-4f5e-b7a0-355338551258 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:41.461977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54f8e529-bbdf-4f5e-b7a0-355338551258 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:41.462431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54f8e529-bbdf-4f5e-b7a0-355338551258 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:41.462854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54f8e529-bbdf-4f5e-b7a0-355338551258 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:41.494737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-54f8e529-bbdf-4f5e-b7a0-355338551258 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:01:41.611716 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-54f8e529-bbdf-4f5e-b7a0-355338551258 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "DELETE /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 204 len: 0 microversion: 2.1 time: 0.160880 Sep 10 11:01:41.613287 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1041/4425] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:01:41 2022] DELETE /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:01:41.626233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e04fd1e1-fffa-4c23-98e5-6a25146bd89d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:41.627281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e04fd1e1-fffa-4c23-98e5-6a25146bd89d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:41.642175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04fd1e1-fffa-4c23-98e5-6a25146bd89d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:41.644645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04fd1e1-fffa-4c23-98e5-6a25146bd89d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:41.645420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04fd1e1-fffa-4c23-98e5-6a25146bd89d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:41.646417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04fd1e1-fffa-4c23-98e5-6a25146bd89d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:41.647107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04fd1e1-fffa-4c23-98e5-6a25146bd89d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:41.648401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e04fd1e1-fffa-4c23-98e5-6a25146bd89d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:42.125527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:42.127719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:42.134313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:42.135143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:42.135652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:42.136434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:42.137259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:42.137945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:42.363338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e04fd1e1-fffa-4c23-98e5-6a25146bd89d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:42.373520 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e04fd1e1-fffa-4c23-98e5-6a25146bd89d tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.755720 Sep 10 11:01:42.381556 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3385/4426] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:41 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:42.468162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-217d650e-1daa-47f5-a25f-ea03e6d3f162 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:42.469865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-217d650e-1daa-47f5-a25f-ea03e6d3f162 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:42.478809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-217d650e-1daa-47f5-a25f-ea03e6d3f162 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:42.479846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-217d650e-1daa-47f5-a25f-ea03e6d3f162 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:42.480507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-217d650e-1daa-47f5-a25f-ea03e6d3f162 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:42.481342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-217d650e-1daa-47f5-a25f-ea03e6d3f162 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:42.482480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-217d650e-1daa-47f5-a25f-ea03e6d3f162 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:42.483125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-217d650e-1daa-47f5-a25f-ea03e6d3f162 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:42.492878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:42.505889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:42.507653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:42.509142 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ccab37a-9df4-4a10-943a-a60d719f217e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.389170 Sep 10 11:01:42.510204 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1042/4427] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:42 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:42.515168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:42.516012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:42.523237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:42.524158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:42.524751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:42.525660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:42.526536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:42.527147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:42.787983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:42.802033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:42.803136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:42.804459 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3d0c341f-21e6-40b8-85fb-32b4f3050ceb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 0.292932 Sep 10 11:01:42.805381 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1043/4428] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:42 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:42.819408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-217d650e-1daa-47f5-a25f-ea03e6d3f162 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:42.829764 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-217d650e-1daa-47f5-a25f-ea03e6d3f162 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1269 microversion: 2.1 time: 0.368360 Sep 10 11:01:42.830398 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3386/4429] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:42 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1269 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:43.398254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-382adcc9-9dd7-4a12-886a-7f511114d0d4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:43.398808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-382adcc9-9dd7-4a12-886a-7f511114d0d4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:43.405007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-382adcc9-9dd7-4a12-886a-7f511114d0d4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:43.405539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-382adcc9-9dd7-4a12-886a-7f511114d0d4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:43.406151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-382adcc9-9dd7-4a12-886a-7f511114d0d4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:43.406856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-382adcc9-9dd7-4a12-886a-7f511114d0d4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:43.407573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-382adcc9-9dd7-4a12-886a-7f511114d0d4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:43.408559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-382adcc9-9dd7-4a12-886a-7f511114d0d4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:43.538235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:43.539254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:43.546333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:43.546921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:43.547433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:43.548205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:43.549348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:43.549844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:43.730755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-382adcc9-9dd7-4a12-886a-7f511114d0d4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:43.738880 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-382adcc9-9dd7-4a12-886a-7f511114d0d4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.344632 Sep 10 11:01:43.739472 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1044/4430] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:43 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:43.832629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:43.833318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:43.843435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:43.851431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:43.851951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:43.852388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:43.864429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:43.865821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:43.866304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:43.868634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:43.873023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:43.874943 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-514d2a01-ce70-4dd5-9427-48b932479b33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.340592 Sep 10 11:01:43.875539 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3387/4431] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:43 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:43.886698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50d40b46-5bb0-4b52-b098-fb9bd691126d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:43.887683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50d40b46-5bb0-4b52-b098-fb9bd691126d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:43.897784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d40b46-5bb0-4b52-b098-fb9bd691126d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:43.902731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d40b46-5bb0-4b52-b098-fb9bd691126d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:43.903545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d40b46-5bb0-4b52-b098-fb9bd691126d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:43.904609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d40b46-5bb0-4b52-b098-fb9bd691126d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:43.905960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d40b46-5bb0-4b52-b098-fb9bd691126d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:43.906609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d40b46-5bb0-4b52-b098-fb9bd691126d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:44.238988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:44.250597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50d40b46-5bb0-4b52-b098-fb9bd691126d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:44.259518 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50d40b46-5bb0-4b52-b098-fb9bd691126d tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1269 microversion: 2.1 time: 0.382905 Sep 10 11:01:44.260677 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3388/4432] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:43 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1269 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:44.265927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8b1ca540-d48c-409d-bf45-25a9e2f307fd req-63f92c08-15bb-4a15-9726-5851bab56b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b52c87-5cab-4f2b-b25f-3f5d12ca063d", "name": "network-vif-plugged", "status": "completed", "tag": "ac32bd2a-cfc1-46eb-9ede-750a98047328"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:44.279117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:44.280790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:44.282481 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b1517e93-1340-4cde-9749-023ab671d949 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 0.454180 Sep 10 11:01:44.283593 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1045/4433] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:43 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:44.288156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8b1ca540-d48c-409d-bf45-25a9e2f307fd req-63f92c08-15bb-4a15-9726-5851bab56b8b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:44.288713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8b1ca540-d48c-409d-bf45-25a9e2f307fd req-63f92c08-15bb-4a15-9726-5851bab56b8b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:44.289358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8b1ca540-d48c-409d-bf45-25a9e2f307fd req-63f92c08-15bb-4a15-9726-5851bab56b8b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:44.319296 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8b1ca540-d48c-409d-bf45-25a9e2f307fd req-63f92c08-15bb-4a15-9726-5851bab56b8b service nova] Creating event network-vif-plugged:ac32bd2a-cfc1-46eb-9ede-750a98047328 for instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d on n-h2-856894-1 Sep 10 11:01:44.326123 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8b1ca540-d48c-409d-bf45-25a9e2f307fd req-63f92c08-15bb-4a15-9726-5851bab56b8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063710 Sep 10 11:01:44.326887 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3389/4434] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:44.763016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6bce68e0-0dd5-4226-b09c-d729649fc827 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:44.763648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6bce68e0-0dd5-4226-b09c-d729649fc827 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:44.774639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bce68e0-0dd5-4226-b09c-d729649fc827 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:44.775139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bce68e0-0dd5-4226-b09c-d729649fc827 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:44.775580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bce68e0-0dd5-4226-b09c-d729649fc827 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:44.780150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bce68e0-0dd5-4226-b09c-d729649fc827 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:44.780827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bce68e0-0dd5-4226-b09c-d729649fc827 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:44.782410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bce68e0-0dd5-4226-b09c-d729649fc827 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:44.917167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:44.918621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:44.929383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:44.930315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:44.930951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:44.931823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:44.932623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:44.935721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:45.704572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6bce68e0-0dd5-4226-b09c-d729649fc827 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:45.714291 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6bce68e0-0dd5-4226-b09c-d729649fc827 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1506 microversion: 2.1 time: 0.955104 Sep 10 11:01:45.715157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:45.735594 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1046/4435] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:44 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1506 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:45.742130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:45.744117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:45.744593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c206708e-85d6-466f-b184-152e06f81311 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:45.746285 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1696c49c-592e-4a21-a6e6-d964a28bf710 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.843591 Sep 10 11:01:45.747819 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3390/4436] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:44 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:45.749004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c206708e-85d6-466f-b184-152e06f81311 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:45.753928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:45.756957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:45.757424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c206708e-85d6-466f-b184-152e06f81311 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:45.758097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c206708e-85d6-466f-b184-152e06f81311 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:45.758688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c206708e-85d6-466f-b184-152e06f81311 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:45.759659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c206708e-85d6-466f-b184-152e06f81311 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:45.760267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c206708e-85d6-466f-b184-152e06f81311 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:45.760859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c206708e-85d6-466f-b184-152e06f81311 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:45.772461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:45.773179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:45.775023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:45.776941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:45.778724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:45.783872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:46.243420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:46.257248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c206708e-85d6-466f-b184-152e06f81311 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:46.262399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:46.263885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:46.265107 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a9f59f0-5dd4-49c8-b8f5-459cafd50105 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 0.516139 Sep 10 11:01:46.266195 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3391/4437] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:45 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:46.278765 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c206708e-85d6-466f-b184-152e06f81311 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1269 microversion: 2.1 time: 0.541136 Sep 10 11:01:46.296225 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1047/4438] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:45 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1269 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:46.469650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7d269e30-8b4c-412b-8c69-948975c58051 req-0fdef628-80ac-4527-9468-1dd0f961fe64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d06412-ccbe-40b4-881e-667b29b1341d", "name": "network-vif-deleted", "tag": "5461ef4a-fce5-4941-a202-b0c2a1bfa655"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:46.487308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7d269e30-8b4c-412b-8c69-948975c58051 req-0fdef628-80ac-4527-9468-1dd0f961fe64 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:46.488389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7d269e30-8b4c-412b-8c69-948975c58051 req-0fdef628-80ac-4527-9468-1dd0f961fe64 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:46.490656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7d269e30-8b4c-412b-8c69-948975c58051 req-0fdef628-80ac-4527-9468-1dd0f961fe64 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:46.509228 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7d269e30-8b4c-412b-8c69-948975c58051 req-0fdef628-80ac-4527-9468-1dd0f961fe64 service nova] Creating event network-vif-deleted:5461ef4a-fce5-4941-a202-b0c2a1bfa655 for instance 46d06412-ccbe-40b4-881e-667b29b1341d on n-h2-856894-1 Sep 10 11:01:46.522809 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7d269e30-8b4c-412b-8c69-948975c58051 req-0fdef628-80ac-4527-9468-1dd0f961fe64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057186 Sep 10 11:01:46.524929 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3392/4439] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:01:46.757494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:46.758866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:46.768025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:46.769103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:46.770071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:46.771301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:46.772013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:46.772911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:46.782589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:46.787109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:46.800698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:46.801174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:46.801626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:46.807022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:46.807889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:46.808777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:46.828586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:46.830024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:46.830947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:46.831621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lazy-loading 'fault' on Instance uuid 46d06412-ccbe-40b4-881e-667b29b1341d {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:47.268665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:47.315258 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9dc836fb-4d9d-4ad7-b09a-a2fc077303ac tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 200 len: 1304 microversion: 2.1 time: 0.574505 Sep 10 11:01:47.320520 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1048/4440] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:46 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 1304 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:47.370477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:47.372083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:47.391687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:47.392231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:47.392665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:47.395454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:47.399180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:47.399673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:47.480645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:47.499631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:47.502555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:47.504630 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38a88a4b-a3ff-4b55-80fd-fb048cdbacab tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.733058 Sep 10 11:01:47.505867 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3393/4441] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:46 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:47.514867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-347a28a6-6442-40e4-a7f0-94aac78f632c tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:47.515871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-347a28a6-6442-40e4-a7f0-94aac78f632c tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:47.524561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-347a28a6-6442-40e4-a7f0-94aac78f632c tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:47.525435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-347a28a6-6442-40e4-a7f0-94aac78f632c tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:47.526359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-347a28a6-6442-40e4-a7f0-94aac78f632c tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:47.527613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-347a28a6-6442-40e4-a7f0-94aac78f632c tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:47.528738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-347a28a6-6442-40e4-a7f0-94aac78f632c tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:47.530053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-347a28a6-6442-40e4-a7f0-94aac78f632c tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:47.542611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:47.710669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:47.726272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:47.728216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:47.729738 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-efa60f46-4f99-4c5a-b563-701ced9e2970 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 0.406853 Sep 10 11:01:47.730551 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1049/4442] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:47 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:47.793469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-347a28a6-6442-40e4-a7f0-94aac78f632c tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:47.804948 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-347a28a6-6442-40e4-a7f0-94aac78f632c tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1458 microversion: 2.1 time: 0.296081 Sep 10 11:01:47.805588 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3394/4443] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:47 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1458 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:47.830211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b0b23bf1-f3f2-4c48-88c9-a9a075c19520 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:47.830830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b0b23bf1-f3f2-4c48-88c9-a9a075c19520 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:47.838107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0b23bf1-f3f2-4c48-88c9-a9a075c19520 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:47.838600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0b23bf1-f3f2-4c48-88c9-a9a075c19520 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:47.839036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0b23bf1-f3f2-4c48-88c9-a9a075c19520 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:47.839955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0b23bf1-f3f2-4c48-88c9-a9a075c19520 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:47.840437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0b23bf1-f3f2-4c48-88c9-a9a075c19520 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:47.840861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0b23bf1-f3f2-4c48-88c9-a9a075c19520 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:48.076853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b0b23bf1-f3f2-4c48-88c9-a9a075c19520 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:48.093921 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b0b23bf1-f3f2-4c48-88c9-a9a075c19520 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1458 microversion: 2.1 time: 0.268270 Sep 10 11:01:48.095036 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1050/4444] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:47 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1458 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:48.340207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:48.341061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 46d06412-ccbe-40b4-881e-667b29b1341d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:48.353917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:48.354429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:48.354875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:48.355596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:48.360248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:48.361477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:48.390132 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] HTTP exception thrown: Instance 46d06412-ccbe-40b4-881e-667b29b1341d could not be found. Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Request method failure captured: Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d HTTP/1.1 Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG4aYwKwnTqvpakXQZE_-zurac3_sBqSaA9HOISMx2q03usjSaNOQ_ocHlwYk4vI4r8lvLwEEWVAEwBYV3spgcPta1ZLI5jgFw4x-8iMBHPkcgERP-qKVcN2PDxFu8X4DMIEvKUQVwoV9dEOr6BPJFo8If5ktW9FU4O2yVpQECV5tcQ Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: d32d84b971cc464e907a05339f82e252 Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerRescueTestJSON-1283488772 Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d32d84b971cc464e907a05339f82e252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d32d84b971cc464e907a05339f82e252"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d32d84b971cc464e907a05339f82e252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d32d84b971cc464e907a05339f82e252", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerRescueTestJSON-1283488772 Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: d32d84b971cc464e907a05339f82e252 Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerRescueTestJSON-1283488772 Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerRescueTestJSON-1283488772-project Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 6462f07210a7449a8b72d5d51ed1c349 Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerRescueTestJSON-1283488772-project Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 46d06412-ccbe-40b4-881e-667b29b1341d could not be found. Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '46d06412-ccbe-40b4-881e-667b29b1341d'} Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d06412-ccbe-40b4-881e-667b29b1341d could not be found. Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d06412-ccbe-40b4-881e-667b29b1341d could not be found. Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:01:48.392123 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:01:48.396510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:01:48.396510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:01:48.396510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:01:48.396510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:01:48.396510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:01:48.396510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d06412-ccbe-40b4-881e-667b29b1341d could not be found. Sep 10 11:01:48.396510 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:01:48.397675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Returning 404 to user: Instance 46d06412-ccbe-40b4-881e-667b29b1341d could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:01:48.399487 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c7fc30f8-e66a-42d3-9a54-c89cd100a91e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d" status: 404 len: 111 microversion: 2.1 time: 0.063346 Sep 10 11:01:48.403918 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3395/4445] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:48 2022] GET /compute/v2.1/servers/46d06412-ccbe-40b4-881e-667b29b1341d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:01:48.409327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c4f1cc5a-50c0-4e8b-a4f9-4d5d1ec0d5a4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:48.409884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c4f1cc5a-50c0-4e8b-a4f9-4d5d1ec0d5a4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:48.416344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4f1cc5a-50c0-4e8b-a4f9-4d5d1ec0d5a4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:48.417116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4f1cc5a-50c0-4e8b-a4f9-4d5d1ec0d5a4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:48.418316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4f1cc5a-50c0-4e8b-a4f9-4d5d1ec0d5a4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:48.419252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4f1cc5a-50c0-4e8b-a4f9-4d5d1ec0d5a4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:48.419907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4f1cc5a-50c0-4e8b-a4f9-4d5d1ec0d5a4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:48.420527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4f1cc5a-50c0-4e8b-a4f9-4d5d1ec0d5a4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:48.453028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c4f1cc5a-50c0-4e8b-a4f9-4d5d1ec0d5a4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:01:48.529134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-333d7eb1-7d3e-4599-b8d3-03fa73268221 req-b5f6a7da-13e6-4c4f-a106-b4393e1e5dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78c52b2-a80e-40b4-85bc-aa292863e314", "name": "network-vif-plugged", "status": "completed", "tag": "8bcf0e24-04b4-49cd-bcf6-09cc09b2aeab"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:48.567710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-333d7eb1-7d3e-4599-b8d3-03fa73268221 req-b5f6a7da-13e6-4c4f-a106-b4393e1e5dbc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:48.568321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-333d7eb1-7d3e-4599-b8d3-03fa73268221 req-b5f6a7da-13e6-4c4f-a106-b4393e1e5dbc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:48.568831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-333d7eb1-7d3e-4599-b8d3-03fa73268221 req-b5f6a7da-13e6-4c4f-a106-b4393e1e5dbc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:48.582630 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c4f1cc5a-50c0-4e8b-a4f9-4d5d1ec0d5a4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 204 len: 0 microversion: 2.1 time: 0.175097 Sep 10 11:01:48.583428 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1051/4446] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:01:48 2022] DELETE /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:01:48.597424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:48.598799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:48.616540 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-333d7eb1-7d3e-4599-b8d3-03fa73268221 req-b5f6a7da-13e6-4c4f-a106-b4393e1e5dbc service nova] Creating event network-vif-plugged:8bcf0e24-04b4-49cd-bcf6-09cc09b2aeab for instance e78c52b2-a80e-40b4-85bc-aa292863e314 on n-h2-856894-1 Sep 10 11:01:48.632268 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-333d7eb1-7d3e-4599-b8d3-03fa73268221 req-b5f6a7da-13e6-4c4f-a106-b4393e1e5dbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105806 Sep 10 11:01:48.640772 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3396/4447] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:01:48.644218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:48.644725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:48.645201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:48.645926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:48.646383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:48.646810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:48.660776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95aa1cc8-8bd7-4c73-906f-cded3c22c88a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:48.661552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95aa1cc8-8bd7-4c73-906f-cded3c22c88a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:48.669886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:48.693946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95aa1cc8-8bd7-4c73-906f-cded3c22c88a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:48.694469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95aa1cc8-8bd7-4c73-906f-cded3c22c88a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:48.694921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95aa1cc8-8bd7-4c73-906f-cded3c22c88a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:48.695647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95aa1cc8-8bd7-4c73-906f-cded3c22c88a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:48.699671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95aa1cc8-8bd7-4c73-906f-cded3c22c88a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:48.702794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95aa1cc8-8bd7-4c73-906f-cded3c22c88a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:49.071950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95aa1cc8-8bd7-4c73-906f-cded3c22c88a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:49.086331 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:49.093539 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95aa1cc8-8bd7-4c73-906f-cded3c22c88a tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1490 microversion: 2.1 time: 0.443760 Sep 10 11:01:49.094229 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3397/4448] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:48 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1490 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:49.099396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:49.105736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:49.116476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:49.119317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:49.120891 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5976c1da-3d9f-4c27-85fe-82ab17e28419 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.536382 Sep 10 11:01:49.121032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:49.121529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:49.121964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:49.122293 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1052/4449] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:48 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:49.123186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:49.123801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:49.124382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:49.322135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:49.335690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:49.337210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:49.338404 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b4f39d1d-165e-4759-93d0-fc1ec9a61afb tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 0.243181 Sep 10 11:01:49.338987 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3398/4450] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:49 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:50.119436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8f0588bc-1af7-4b5a-93a6-9ac995a89e4c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:50.120344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8f0588bc-1af7-4b5a-93a6-9ac995a89e4c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:50.136240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0588bc-1af7-4b5a-93a6-9ac995a89e4c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:50.140399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0588bc-1af7-4b5a-93a6-9ac995a89e4c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:50.144056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0588bc-1af7-4b5a-93a6-9ac995a89e4c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:50.152253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:50.153799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:50.161376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0588bc-1af7-4b5a-93a6-9ac995a89e4c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:50.161878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0588bc-1af7-4b5a-93a6-9ac995a89e4c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:50.162322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0588bc-1af7-4b5a-93a6-9ac995a89e4c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:50.167216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:50.168051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:50.168745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:50.169702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:50.170376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:50.172512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:50.582222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8f0588bc-1af7-4b5a-93a6-9ac995a89e4c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:50.599006 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8f0588bc-1af7-4b5a-93a6-9ac995a89e4c tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1490 microversion: 2.1 time: 0.482654 Sep 10 11:01:50.618969 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1053/4451] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:50 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1490 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:50.624909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:50.625806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:50.635490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:50.638257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:50.639030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:50.639935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:50.640549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:50.641179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:50.760850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:50.772816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:50.789430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:50.799602 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3465ace7-d20a-48a9-a88a-ce8337b2defc tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.652052 Sep 10 11:01:50.800429 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3399/4452] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:50 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:51.278277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:51.290817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:51.298898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:51.300277 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-08ea5262-385c-4b09-8de0-67cfd832d6d9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 0.680007 Sep 10 11:01:51.310570 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1054/4453] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:50 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:51.630254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-854cdee7-3b19-4144-ad2d-8facda294c25 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:51.631365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-854cdee7-3b19-4144-ad2d-8facda294c25 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:51.639504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-854cdee7-3b19-4144-ad2d-8facda294c25 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:51.640285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-854cdee7-3b19-4144-ad2d-8facda294c25 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:51.640919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-854cdee7-3b19-4144-ad2d-8facda294c25 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:51.642743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-854cdee7-3b19-4144-ad2d-8facda294c25 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:51.643523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-854cdee7-3b19-4144-ad2d-8facda294c25 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:51.644122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-854cdee7-3b19-4144-ad2d-8facda294c25 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:51.836829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:51.838039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:51.853776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:51.855548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:51.856391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:51.857894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:51.858700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:51.859347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:52.029932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-854cdee7-3b19-4144-ad2d-8facda294c25 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:52.039666 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-854cdee7-3b19-4144-ad2d-8facda294c25 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1490 microversion: 2.1 time: 0.415035 Sep 10 11:01:52.058254 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3400/4454] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:51 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1490 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:52.138394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3fdb12f1-ed5f-4e7d-8fa7-b3061c44f510 req-0b756da1-9152-44b8-9094-96bca5fc3135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ec97f-3e6c-403e-a398-61c0869e5de7", "name": "network-vif-deleted", "tag": "dc1f3c24-c69a-4e8e-8e2c-1939935d7450"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:52.154732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3fdb12f1-ed5f-4e7d-8fa7-b3061c44f510 req-0b756da1-9152-44b8-9094-96bca5fc3135 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:52.155583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3fdb12f1-ed5f-4e7d-8fa7-b3061c44f510 req-0b756da1-9152-44b8-9094-96bca5fc3135 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:52.156244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3fdb12f1-ed5f-4e7d-8fa7-b3061c44f510 req-0b756da1-9152-44b8-9094-96bca5fc3135 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:52.170663 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3fdb12f1-ed5f-4e7d-8fa7-b3061c44f510 req-0b756da1-9152-44b8-9094-96bca5fc3135 service nova] Creating event network-vif-deleted:dc1f3c24-c69a-4e8e-8e2c-1939935d7450 for instance 4e1ec97f-3e6c-403e-a398-61c0869e5de7 on n-h2-856894-1 Sep 10 11:01:52.176470 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3fdb12f1-ed5f-4e7d-8fa7-b3061c44f510 req-0b756da1-9152-44b8-9094-96bca5fc3135 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044868 Sep 10 11:01:52.177672 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3401/4455] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:01:52.226399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:52.238554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:52.240849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:52.242259 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-320f6106-1ed6-4051-b83c-1b6c58f98d8b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.415393 Sep 10 11:01:52.242991 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1055/4456] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:51 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:52.317275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b125c92e-3b92-452c-88d2-9811c7c4c033 req-c80954b1-387d-4343-bc8b-32c2da4c7047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b52c87-5cab-4f2b-b25f-3f5d12ca063d", "tag": "ac32bd2a-cfc1-46eb-9ede-750a98047328"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:52.328119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:52.328739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:52.338207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:52.339272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:52.341437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b125c92e-3b92-452c-88d2-9811c7c4c033 req-c80954b1-387d-4343-bc8b-32c2da4c7047 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:52.342080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:52.342956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:52.343567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:52.344202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b125c92e-3b92-452c-88d2-9811c7c4c033 req-c80954b1-387d-4343-bc8b-32c2da4c7047 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:52.345359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:52.350906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b125c92e-3b92-452c-88d2-9811c7c4c033 req-c80954b1-387d-4343-bc8b-32c2da4c7047 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:52.383150 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b125c92e-3b92-452c-88d2-9811c7c4c033 req-c80954b1-387d-4343-bc8b-32c2da4c7047 service nova] Creating event network-changed:ac32bd2a-cfc1-46eb-9ede-750a98047328 for instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d on n-h2-856894-1 Sep 10 11:01:52.395132 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b125c92e-3b92-452c-88d2-9811c7c4c033 req-c80954b1-387d-4343-bc8b-32c2da4c7047 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082502 Sep 10 11:01:52.399810 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3402/4457] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:53.069313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:53.070314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:53.091258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:53.091784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:53.093880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:53.095613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:53.099618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:53.100666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:53.192593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:53.193257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:53.195601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:53.195841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lazy-loading 'fault' on Instance uuid 4e1ec97f-3e6c-403e-a398-61c0869e5de7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:53.343097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:53.358995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:53.362003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:53.363269 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7e0370e0-c594-4242-baf4-16cc44142f1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1361 microversion: 2.26 time: 1.039342 Sep 10 11:01:53.365133 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1056/4458] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:52 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1361 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:53.375688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:53.378768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:53.392004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:53.392763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:53.393421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:53.394931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:53.398943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:53.399595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:53.433714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6462f07210a7449a8b72d5d51ed1c349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32d84b971cc464e907a05339f82e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:53.441161 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b258ee0-86d1-4ea8-b627-3b16ea25a3c4 tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 200 len: 1303 microversion: 2.1 time: 0.378684 Sep 10 11:01:53.448378 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3403/4459] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:53 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 1303 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:53.804088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:53.813452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:53.815790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:53.817178 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-def46089-4909-4997-b456-f8ef69b75cdf tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.450376 Sep 10 11:01:53.817895 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1057/4460] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:53 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:54.396142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:54.396885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:54.404660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.405517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.406202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.407428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.408141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.408666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.476749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:54.477768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] [instance: 4e1ec97f-3e6c-403e-a398-61c0869e5de7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:54.486386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.486813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.487254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.487959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.488415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.489900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.511588 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] HTTP exception thrown: Instance 4e1ec97f-3e6c-403e-a398-61c0869e5de7 could not be found. Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Request method failure captured: Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 HTTP/1.1 Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG4aYwKwnTqvpakXQZE_-zurac3_sBqSaA9HOISMx2q03usjSaNOQ_ocHlwYk4vI4r8lvLwEEWVAEwBYV3spgcPta1ZLI5jgFw4x-8iMBHPkcgERP-qKVcN2PDxFu8X4DMIEvKUQVwoV9dEOr6BPJFo8If5ktW9FU4O2yVpQECV5tcQ Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: d32d84b971cc464e907a05339f82e252 Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerRescueTestJSON-1283488772 Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d32d84b971cc464e907a05339f82e252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d32d84b971cc464e907a05339f82e252"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d32d84b971cc464e907a05339f82e252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d32d84b971cc464e907a05339f82e252", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerRescueTestJSON-1283488772 Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: d32d84b971cc464e907a05339f82e252 Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerRescueTestJSON-1283488772 Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerRescueTestJSON-1283488772-project Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 6462f07210a7449a8b72d5d51ed1c349 Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerRescueTestJSON-1283488772-project Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 4e1ec97f-3e6c-403e-a398-61c0869e5de7 could not be found. Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '4e1ec97f-3e6c-403e-a398-61c0869e5de7'} Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1ec97f-3e6c-403e-a398-61c0869e5de7 could not be found. Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1ec97f-3e6c-403e-a398-61c0869e5de7 could not be found. Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:01:54.515113 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:01:54.519096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:01:54.519096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:01:54.519096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:01:54.519096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:01:54.519096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:01:54.519096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1ec97f-3e6c-403e-a398-61c0869e5de7 could not be found. Sep 10 11:01:54.519096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:01:54.519096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] Returning 404 to user: Instance 4e1ec97f-3e6c-403e-a398-61c0869e5de7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:01:54.519096 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-df36b3e8-4423-4139-b434-3d749f94956e tempest-ServerRescueTestJSON-1283488772 tempest-ServerRescueTestJSON-1283488772-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7" status: 404 len: 111 microversion: 2.1 time: 0.044373 Sep 10 11:01:54.519096 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1058/4461] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:01:54 2022] GET /compute/v2.1/servers/4e1ec97f-3e6c-403e-a398-61c0869e5de7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:01:54.721472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:54.731191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:54.732723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:54.733970 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4ebe3d73-32c2-4b48-b9d7-9064e4a51d50 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1545 microversion: 2.26 time: 0.342676 Sep 10 11:01:54.734884 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3404/4462] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:54 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1545 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:54.763373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcae5d2670>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:54.777060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.778105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.778746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.779426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:54.785615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.786254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.786862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.787940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.788549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.789153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.819466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.820200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.820791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.840596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.841376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.842052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.845584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:54.847020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:54.854566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.855348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.856014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.857250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.858144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.858859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.879088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:54.900114 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-af784127-fb77-43e3-ac1b-25b79e368661 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1723692223" status: 201 len: 0 microversion: 2.26 time: 0.141346 Sep 10 11:01:54.900991 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1059/4463] 10.222.0.20 () {62 vars in 1380 bytes} [Sat Sep 10 11:01:54 2022] PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1723692223 => generated 0 bytes in 144 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 10 11:01:54.914177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ec3f4e3d-9397-4da5-ac00-19e04c78b3e9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaeba1550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:54.925728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3f4e3d-9397-4da5-ac00-19e04c78b3e9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.926501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3f4e3d-9397-4da5-ac00-19e04c78b3e9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.927178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3f4e3d-9397-4da5-ac00-19e04c78b3e9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.947791 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ec3f4e3d-9397-4da5-ac00-19e04c78b3e9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1723692223" status: 204 len: 0 microversion: 2.26 time: 0.039005 Sep 10 11:01:54.965154 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1060/4464] 10.222.0.20 () {60 vars in 1361 bytes} [Sat Sep 10 11:01:54 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1723692223 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:01:54.971554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaebbb8b0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:54.980214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.981362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.982053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.983113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:54.992361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.993151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.994051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:54.995615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:54.996655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:54.997480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.038273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.039109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.040099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.065310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:55.115437 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-60816cfe-ba38-480e-828a-500124603797 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 204 len: 0 microversion: 2.26 time: 0.148792 Sep 10 11:01:55.123930 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1061/4465] 10.222.0.20 () {60 vars in 1295 bytes} [Sat Sep 10 11:01:54 2022] DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:01:55.132040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4776953f-2734-4e4c-a3cd-0ec06bf9444a tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaec2c550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:55.152186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4776953f-2734-4e4c-a3cd-0ec06bf9444a tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.152689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4776953f-2734-4e4c-a3cd-0ec06bf9444a tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.153160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4776953f-2734-4e4c-a3cd-0ec06bf9444a tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.178213 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4776953f-2734-4e4c-a3cd-0ec06bf9444a tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 200 len: 12 microversion: 2.26 time: 0.051594 Sep 10 11:01:55.178853 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1062/4466] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Sep 10 11:01:55 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 12 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:55.196490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaebbbe50>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:55.212297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.212958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.213438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.214357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:55.220561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.221453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.221569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.222837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.224043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.224482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.258232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.258952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.259607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.270512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.271143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.271672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.301811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:55.329941 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e4e8c13a-b13a-4485-a3ed-a02fb04f5ba7 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-104660632" status: 201 len: 0 microversion: 2.26 time: 0.144334 Sep 10 11:01:55.333323 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1063/4467] 10.222.0.20 () {62 vars in 1377 bytes} [Sat Sep 10 11:01:55 2022] PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-104660632 => generated 0 bytes in 149 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Sep 10 11:01:55.338753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-041e724e-ad37-49ac-9db8-ab36763d98ad req-7e5d67ef-e53d-4e6e-9ad5-6f450abc8288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b52c87-5cab-4f2b-b25f-3f5d12ca063d", "tag": "ac32bd2a-cfc1-46eb-9ede-750a98047328"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:55.349703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-041e724e-ad37-49ac-9db8-ab36763d98ad req-7e5d67ef-e53d-4e6e-9ad5-6f450abc8288 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.350274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-041e724e-ad37-49ac-9db8-ab36763d98ad req-7e5d67ef-e53d-4e6e-9ad5-6f450abc8288 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.350832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-041e724e-ad37-49ac-9db8-ab36763d98ad req-7e5d67ef-e53d-4e6e-9ad5-6f450abc8288 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.362715 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-041e724e-ad37-49ac-9db8-ab36763d98ad req-7e5d67ef-e53d-4e6e-9ad5-6f450abc8288 service nova] Creating event network-changed:ac32bd2a-cfc1-46eb-9ede-750a98047328 for instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d on n-h2-856894-1 Sep 10 11:01:55.368379 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-041e724e-ad37-49ac-9db8-ab36763d98ad req-7e5d67ef-e53d-4e6e-9ad5-6f450abc8288 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033516 Sep 10 11:01:55.372697 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1064/4468] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:55.389526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e8bafe91-588d-487e-85bb-3f45fd21415a tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaec2c310>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:55.400266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8bafe91-588d-487e-85bb-3f45fd21415a tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.400906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8bafe91-588d-487e-85bb-3f45fd21415a tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.401955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8bafe91-588d-487e-85bb-3f45fd21415a tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.416085 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e8bafe91-588d-487e-85bb-3f45fd21415a tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 200 len: 35 microversion: 2.26 time: 0.041928 Sep 10 11:01:55.422476 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1065/4469] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Sep 10 11:01:55 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 35 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:55.428799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaeb9ca60>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:55.436729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.437475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.437906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.438530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:55.450731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.451758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.452355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.453380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.454161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.455361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.486099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.487254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.487849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.515465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:55.521473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:55.545354 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9059557-1f8f-46cc-b707-a0dc12ac60c6 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-104660632" status: 204 len: 0 microversion: 2.26 time: 0.121277 Sep 10 11:01:55.546525 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1066/4470] 10.222.0.20 () {60 vars in 1361 bytes} [Sat Sep 10 11:01:55 2022] DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-104660632 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:01:55.555484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6331bf88-1548-4eb2-a022-93cdc34d721b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaeb9c700>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:55.564371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6331bf88-1548-4eb2-a022-93cdc34d721b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.564957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6331bf88-1548-4eb2-a022-93cdc34d721b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.565423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6331bf88-1548-4eb2-a022-93cdc34d721b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.578267 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6331bf88-1548-4eb2-a022-93cdc34d721b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 200 len: 12 microversion: 2.26 time: 0.027305 Sep 10 11:01:55.586733 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1067/4471] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Sep 10 11:01:55 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 12 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:55.594249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaebbb3a0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:55.601695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:55.607122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.607122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.607122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.607627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:55.616009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.617133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.617133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.617829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.618458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.619195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.646469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.647142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.647585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.659958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:55.683779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:55.684676 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-126a7b95-363c-48ca-a57b-e6e3831bfc6d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 204 len: 0 microversion: 2.26 time: 0.096715 Sep 10 11:01:55.699452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:55.699659 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1068/4472] 10.222.0.20 () {60 vars in 1295 bytes} [Sat Sep 10 11:01:55 2022] DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:01:55.701477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:55.703072 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-594d8d0d-e657-43cc-8cec-04ddba5dae46 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.862949 Sep 10 11:01:55.717023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaeb915e0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:55.718120 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3405/4473] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:54 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:55.730130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.730618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.731131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.731621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:55.738875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.739367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.739801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.740494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.741021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.741505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.772529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.772981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.773456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.785274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.785770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.786307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.814578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:55.835790 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3f61883f-dfc4-4b75-a20b-0883a0708cb0 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1211627434" status: 201 len: 0 microversion: 2.26 time: 0.134902 Sep 10 11:01:55.840622 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1069/4474] 10.222.0.20 () {62 vars in 1380 bytes} [Sat Sep 10 11:01:55 2022] PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1211627434 => generated 0 bytes in 136 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 10 11:01:55.846452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcae96f9d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:55.856793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.857571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.858353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.858993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:55.865227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.865918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.866505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.867473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.868114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.868733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.901027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.901789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.902392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.919352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.919858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.920303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.951247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:55.968270 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38f97d9a-f985-4342-bd4b-4c2031963d2d tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1897129148" status: 201 len: 0 microversion: 2.26 time: 0.125976 Sep 10 11:01:55.969356 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3406/4475] 10.222.0.20 () {62 vars in 1380 bytes} [Sat Sep 10 11:01:55 2022] PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1897129148 => generated 0 bytes in 128 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 10 11:01:55.979065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaec3ed30>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:55.987851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.988464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.989019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.989636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:55.995636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.996915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.996915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:55.997601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:55.998164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:55.998697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.021685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.022330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.022963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.038970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:56.055432 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-70f365f7-1c45-47cb-83fb-203c8be28ec9 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 204 len: 0 microversion: 2.26 time: 0.080500 Sep 10 11:01:56.057782 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1070/4476] 10.222.0.20 () {60 vars in 1295 bytes} [Sat Sep 10 11:01:55 2022] DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 11:01:56.067336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f82e1646-00b2-4274-8bc9-ab49d1e95e64 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcb2bfc9d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:56.075744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f82e1646-00b2-4274-8bc9-ab49d1e95e64 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.076603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f82e1646-00b2-4274-8bc9-ab49d1e95e64 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.077239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f82e1646-00b2-4274-8bc9-ab49d1e95e64 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.087599 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f82e1646-00b2-4274-8bc9-ab49d1e95e64 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 200 len: 12 microversion: 2.26 time: 0.024823 Sep 10 11:01:56.088243 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3407/4477] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Sep 10 11:01:56 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 12 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:56.099783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaeb911f0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:56.112955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.113598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.114179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.114751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:56.121102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.121727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.122335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.123314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.123930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.124529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.148486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.149185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.149886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.162876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:56.180112 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b07c61d0-ca9d-4543-a809-a6228ed1b50b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 204 len: 0 microversion: 2.26 time: 0.085315 Sep 10 11:01:56.181055 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1071/4478] 10.222.0.20 () {60 vars in 1295 bytes} [Sat Sep 10 11:01:56 2022] DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 11:01:56.191981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcae7e8790>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:56.202867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.203441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.203951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.205039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:56.212400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.212962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.213478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.214190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.214749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.215064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.249974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.250790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.251430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.264246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.264744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.265215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.292232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:56.320171 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d205772c-876f-491a-b5e1-aecd5b0084dc tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1014547101" status: 201 len: 0 microversion: 2.26 time: 0.133215 Sep 10 11:01:56.325643 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3408/4479] 10.222.0.20 () {62 vars in 1380 bytes} [Sat Sep 10 11:01:56 2022] PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1014547101 => generated 0 bytes in 140 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 10 11:01:56.336163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcaebc5700>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:56.347549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.348192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.348642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.349150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:56.355726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.356206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.357099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.357797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.358283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.359021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.403803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.404299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.404744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.427071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.427570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.428103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.488772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:56.542306 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0baae3b9-7097-489b-afc2-6be8f3133044 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1747226856" status: 201 len: 0 microversion: 2.26 time: 0.210429 Sep 10 11:01:56.550580 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1072/4480] 10.222.0.20 () {62 vars in 1380 bytes} [Sat Sep 10 11:01:56 2022] PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags/tempest-tag-1747226856 => generated 0 bytes in 219 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 10 11:01:56.555259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Action: 'update_all', calling method: .version_select at 0x7efcae883430>, body: {"tags": ["tempest-tag-1727094902", "tempest-tag-2088236548"]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:56.593497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.594410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.595971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.596791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:56.608883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.609542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.610064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.611427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.611972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.612480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.667624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.680024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.681913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.702510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:01:56.713090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:56.733104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:56.733940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:56.737261 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c25cc39b-0c09-4636-a624-a36fb1d41def tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 200 len: 62 microversion: 2.26 time: 0.188228 Sep 10 11:01:56.738405 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3409/4481] 10.222.0.20 () {62 vars in 1312 bytes} [Sat Sep 10 11:01:56 2022] PUT /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 62 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:01:56.749599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5155df41-1cd1-42dc-8749-ba7451dcd215 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcae8fc310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:56.751544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.752047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.752490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.753670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.754268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.755885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.772513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5155df41-1cd1-42dc-8749-ba7451dcd215 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.774126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5155df41-1cd1-42dc-8749-ba7451dcd215 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.775409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5155df41-1cd1-42dc-8749-ba7451dcd215 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.794577 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5155df41-1cd1-42dc-8749-ba7451dcd215 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 200 len: 62 microversion: 2.26 time: 0.049142 Sep 10 11:01:56.798590 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3410/4482] 10.222.0.20 () {60 vars in 1292 bytes} [Sat Sep 10 11:01:56 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 62 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:01:56.808761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '.version_select at 0x7efcae8fc040>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:56.818182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.818679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.819125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.819608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:56.828848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.829502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.829953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.830663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.831294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.831878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.867088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.867760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.868359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.889659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lazy-loading 'flavor' on Instance uuid e78c52b2-a80e-40b4-85bc-aa292863e314 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:01:56.920134 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d0c7ed2b-29fc-414d-999a-5d83527e2d37 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags" status: 204 len: 0 microversion: 2.26 time: 0.115156 Sep 10 11:01:56.925271 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3411/4483] 10.222.0.20 () {60 vars in 1295 bytes} [Sat Sep 10 11:01:56 2022] DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314/tags => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:01:56.942919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7f3eff1d-a4aa-45a6-af7b-29d84f947f10 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:56.944428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7f3eff1d-a4aa-45a6-af7b-29d84f947f10 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:56.961033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3eff1d-a4aa-45a6-af7b-29d84f947f10 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.961677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3eff1d-a4aa-45a6-af7b-29d84f947f10 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.962261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3eff1d-a4aa-45a6-af7b-29d84f947f10 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:56.963092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3eff1d-a4aa-45a6-af7b-29d84f947f10 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:56.963618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3eff1d-a4aa-45a6-af7b-29d84f947f10 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:56.964121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3eff1d-a4aa-45a6-af7b-29d84f947f10 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:57.000414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7f3eff1d-a4aa-45a6-af7b-29d84f947f10 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:01:57.102163 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7f3eff1d-a4aa-45a6-af7b-29d84f947f10 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 204 len: 0 microversion: 2.26 time: 0.170696 Sep 10 11:01:57.102855 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3412/4484] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 11:01:56 2022] DELETE /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:01:57.111471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:57.112192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:57.118515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:57.119014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:57.119453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:57.120164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:57.120622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:57.121047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:57.551184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:57.564286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:57.564757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:57.566257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:57.573387 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-52979de3-5219-4de2-8203-e4dbfb9b5c1b tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1551 microversion: 2.26 time: 0.462741 Sep 10 11:01:57.574167 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3413/4485] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:57 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1551 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:01:57.576634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:57.579745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:57.581173 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bb1af079-3908-4404-bac0-48564b8dfa92 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.853123 Sep 10 11:01:57.600502 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1073/4486] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:56 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:57.602780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9b886281-80a3-4ee4-9a4d-afc1ff1d79b7 req-16afff95-d956-428b-be15-4458d7ebd28a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b52c87-5cab-4f2b-b25f-3f5d12ca063d", "tag": "ac32bd2a-cfc1-46eb-9ede-750a98047328"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:01:57.613237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b886281-80a3-4ee4-9a4d-afc1ff1d79b7 req-16afff95-d956-428b-be15-4458d7ebd28a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:57.613726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b886281-80a3-4ee4-9a4d-afc1ff1d79b7 req-16afff95-d956-428b-be15-4458d7ebd28a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:57.614422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b886281-80a3-4ee4-9a4d-afc1ff1d79b7 req-16afff95-d956-428b-be15-4458d7ebd28a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:57.626359 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9b886281-80a3-4ee4-9a4d-afc1ff1d79b7 req-16afff95-d956-428b-be15-4458d7ebd28a service nova] Creating event network-changed:ac32bd2a-cfc1-46eb-9ede-750a98047328 for instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d on n-h2-856894-1 Sep 10 11:01:57.632150 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9b886281-80a3-4ee4-9a4d-afc1ff1d79b7 req-16afff95-d956-428b-be15-4458d7ebd28a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033711 Sep 10 11:01:57.633097 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3414/4487] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:01:58.614055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:58.614694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:01:58.615288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:58.617412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:01:58.644669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:58.646663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:58.649836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:58.650561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:58.653012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:58.653482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:58.653699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:58.654190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:58.654834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:58.658572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:01:58.660100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:01:58.661987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:01:59.737934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:59.752219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:59.759552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:59.760808 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f86bd042-27b3-4fed-9d3e-d4198d113631 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1551 microversion: 2.26 time: 1.159929 Sep 10 11:01:59.773636 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1074/4488] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:58 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1551 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:01:59.904956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:59.927368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:59.929294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:01:59.930734 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c015a0cd-bea6-49e4-901b-7c1e4bfca594 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 1.325315 Sep 10 11:01:59.932089 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3415/4489] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:01:58 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:00.721505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-85f19c79-7d0d-4d95-a590-3d3ded2d4981 req-11faaf0a-7189-4b81-8f93-05018ecbfbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78c52b2-a80e-40b4-85bc-aa292863e314", "name": "network-vif-deleted", "tag": "8bcf0e24-04b4-49cd-bcf6-09cc09b2aeab"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:00.740732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-85f19c79-7d0d-4d95-a590-3d3ded2d4981 req-11faaf0a-7189-4b81-8f93-05018ecbfbb2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:00.743078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-85f19c79-7d0d-4d95-a590-3d3ded2d4981 req-11faaf0a-7189-4b81-8f93-05018ecbfbb2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:00.743702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-85f19c79-7d0d-4d95-a590-3d3ded2d4981 req-11faaf0a-7189-4b81-8f93-05018ecbfbb2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:00.769010 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-85f19c79-7d0d-4d95-a590-3d3ded2d4981 req-11faaf0a-7189-4b81-8f93-05018ecbfbb2 service nova] Creating event network-vif-deleted:8bcf0e24-04b4-49cd-bcf6-09cc09b2aeab for instance e78c52b2-a80e-40b4-85bc-aa292863e314 on n-h2-856894-1 Sep 10 11:02:00.792234 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-85f19c79-7d0d-4d95-a590-3d3ded2d4981 req-11faaf0a-7189-4b81-8f93-05018ecbfbb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074743 Sep 10 11:02:00.793288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:00.793441 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1075/4490] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:00.797231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:00.820290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:00.821207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:00.822212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:00.823196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:00.823856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:00.824492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:00.954874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:00.970338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:00.976766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:00.991902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:00.995553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:00.996056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:00.996467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3841a45bf21444f8aa0fcb64fd6aaea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9effaef7c22b495ab77296c19bab7b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:00.997634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:00.999113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:00.999998 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4653d4ba-863b-4cd1-8895-9935a5f29346 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 200 len: 1346 microversion: 2.26 time: 0.213030 Sep 10 11:02:01.000640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:01.001496 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3416/4491] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:00 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 1346 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:02:01.002655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:01.664342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:01.686767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:01.694563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:01.695806 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4b71de50-9233-43c9-bca3-95f77e27aa5f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.736448 Sep 10 11:02:01.701400 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1076/4492] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:00 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:02.025993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:02.026786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] [instance: e78c52b2-a80e-40b4-85bc-aa292863e314] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:02.034512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:02.035000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:02.035441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:02.036141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:02.036614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:02.037040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:02.051510 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] HTTP exception thrown: Instance e78c52b2-a80e-40b4-85bc-aa292863e314 could not be found. Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Request method failure captured: Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 HTTP/1.1 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG6GSDW3mHOB_RFB3jrQ8RUGboql6IIRBvdnxCFvomBymiufwfMdmDtsS5cWxfk9voJ7laDiUrGQWskZjvhajAwSBWbN9sJs26chAy73mcCCop4w0pmWcMPUAh86Fn69BJr4NwqOBJQ0qxu760jPXm5V4eGvzOwD2zPTQg5O5rVYvlE Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.26 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9effaef7c22b495ab77296c19bab7b12 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerTagsTestJSON-1870964409 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9effaef7c22b495ab77296c19bab7b12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9effaef7c22b495ab77296c19bab7b12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9effaef7c22b495ab77296c19bab7b12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9effaef7c22b495ab77296c19bab7b12", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerTagsTestJSON-1870964409 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9effaef7c22b495ab77296c19bab7b12 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerTagsTestJSON-1870964409 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerTagsTestJSON-1870964409-project Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 3841a45bf21444f8aa0fcb64fd6aaea3 Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerTagsTestJSON-1870964409-project Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance e78c52b2-a80e-40b4-85bc-aa292863e314 could not be found. Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e78c52b2-a80e-40b4-85bc-aa292863e314'} Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78c52b2-a80e-40b4-85bc-aa292863e314 could not be found. Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78c52b2-a80e-40b4-85bc-aa292863e314 could not be found. Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:02:02.053240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:02:02.057209 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:02.057209 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:02:02.057209 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:02:02.057209 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:02:02.057209 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:02:02.057209 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78c52b2-a80e-40b4-85bc-aa292863e314 could not be found. Sep 10 11:02:02.057209 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:02:02.057209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] Returning 404 to user: Instance e78c52b2-a80e-40b4-85bc-aa292863e314 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:02:02.057209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b6b40f0-257b-4052-86eb-b3829d6ca737 tempest-ServerTagsTestJSON-1870964409 tempest-ServerTagsTestJSON-1870964409-project] 10.222.0.20 "GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314" status: 404 len: 111 microversion: 2.26 time: 0.032627 Sep 10 11:02:02.057209 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3417/4493] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:02 2022] GET /compute/v2.1/servers/e78c52b2-a80e-40b4-85bc-aa292863e314 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:02:02.724467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:02.725896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:02.732839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:02.742146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:02.744344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:02.745374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:02.747101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:02.748332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:03.240254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:03.252752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:03.254106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:03.255304 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-033f67de-6d11-415f-bbe1-bdab69861e6e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.535397 Sep 10 11:02:03.285291 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1077/4494] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:02 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:04.226889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b5d875e2-b3f2-4c2d-a143-314d86ff244f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:04.227986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b5d875e2-b3f2-4c2d-a143-314d86ff244f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:04.236766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5d875e2-b3f2-4c2d-a143-314d86ff244f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:04.237736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5d875e2-b3f2-4c2d-a143-314d86ff244f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:04.238406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5d875e2-b3f2-4c2d-a143-314d86ff244f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:04.239264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5d875e2-b3f2-4c2d-a143-314d86ff244f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:04.239874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5d875e2-b3f2-4c2d-a143-314d86ff244f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:04.240460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5d875e2-b3f2-4c2d-a143-314d86ff244f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:04.269424 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b5d875e2-b3f2-4c2d-a143-314d86ff244f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/ips" status: 200 len: 146 microversion: 2.1 time: 0.046633 Sep 10 11:02:04.270332 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3418/4495] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 11:02:04 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:04.284821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:04.286283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:04.293651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:04.294185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:04.294871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:04.295953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:04.296490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:04.297161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:04.653916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:04.666436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:04.668769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:04.671042 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-416b1a43-68fe-4731-ad41-ad59f585a5b9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.390454 Sep 10 11:02:04.672681 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1078/4496] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:04 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:04.831267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b974d085-bf1d-4bca-9637-0e80a66e1c1e tempest-ComputeTenantNetworksTest-861375579 tempest-ComputeTenantNetworksTest-861375579-project] Calling method '.version_select at 0x7efcb2d344c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:05.193156 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b974d085-bf1d-4bca-9637-0e80a66e1c1e tempest-ComputeTenantNetworksTest-861375579 tempest-ComputeTenantNetworksTest-861375579-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.604207 Sep 10 11:02:05.193882 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3419/4497] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 11:02:04 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:02:05.207580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-70e70256-addf-4efc-94c7-30f6ca670453 tempest-ComputeTenantNetworksTest-861375579 tempest-ComputeTenantNetworksTest-861375579-project] Calling method '.version_select at 0x7efcae9be3a0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:05.344310 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-70e70256-addf-4efc-94c7-30f6ca670453 tempest-ComputeTenantNetworksTest-861375579 tempest-ComputeTenantNetworksTest-861375579-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks/ec112aa0-c8ec-4359-9504-3806351ba227" status: 200 len: 139 microversion: 2.1 time: 0.142128 Sep 10 11:02:05.346088 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1079/4498] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Sep 10 11:02:05 2022] GET /compute/v2.1/os-tenant-networks/ec112aa0-c8ec-4359-9504-3806351ba227 => generated 139 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:02:05.709413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:05.710137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:05.717872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:05.718676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:05.719362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:05.720319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:05.720982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:05.721641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:06.286601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:06.319749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:06.329211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:06.338179 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2d963c02-15cc-40ce-ab8b-db3a5c8b537c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.631798 Sep 10 11:02:06.339210 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3420/4499] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:05 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:07.372957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:07.374491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:07.394070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:07.394857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:07.395305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:07.396028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:07.396485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:07.396970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:07.456625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:07.801960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:07.828654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:07.854871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:07.866559 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a26b0ce0-2d5b-4a2e-96fc-7efb6b52b48e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.496987 Sep 10 11:02:07.886243 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1080/4500] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:07 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:08.901554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:08.902581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:08.905906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:08.913797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:08.914383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:08.914851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:08.915617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:08.916124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:08.916560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:09.061189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ec3d87a3-c1c3-422f-b61b-eda93f108df8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddb69305-4d59-4cdb-a01a-474d92e0b970"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:09.064084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ec3d87a3-c1c3-422f-b61b-eda93f108df8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:09.085704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3d87a3-c1c3-422f-b61b-eda93f108df8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:09.086230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3d87a3-c1c3-422f-b61b-eda93f108df8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:09.086847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3d87a3-c1c3-422f-b61b-eda93f108df8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:09.087887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3d87a3-c1c3-422f-b61b-eda93f108df8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:09.088342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3d87a3-c1c3-422f-b61b-eda93f108df8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:09.089178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3d87a3-c1c3-422f-b61b-eda93f108df8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:09.369728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:09.379314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:09.387481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:09.388741 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cee8d499-cb0e-4776-b517-13bbc9909c56 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.491560 Sep 10 11:02:09.391420 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3421/4501] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:08 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:09.441796 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ec3d87a3-c1c3-422f-b61b-eda93f108df8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389366 Sep 10 11:02:09.443315 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1081/4502] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:02:09 2022] POST /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:02:10.420981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:10.423680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:10.433000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:10.434282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:10.434945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:10.436042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:10.437405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:10.438073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:11.028411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:11.041011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:11.043004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:11.044344 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3dfab660-300e-476a-9736-bc4ceb52dea2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.628560 Sep 10 11:02:11.045564 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3422/4503] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:10 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:12.082443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:12.083624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:12.096677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:12.104832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:12.105431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:12.106819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:12.109725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:12.110328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:12.570852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:12.587992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:12.604940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:12.608194 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3956d8bf-37ce-4870-8db1-3ff3e3b3aaee tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.530957 Sep 10 11:02:12.608819 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1082/4504] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:12 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:13.635411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:13.636069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:13.648398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:13.649823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:13.650326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:13.651948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:13.653740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:13.654386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:13.946321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:13.979508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:13.983683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:13.990148 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfae2a8c-6aa5-40cb-9043-169b3b38ac47 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.356868 Sep 10 11:02:13.991892 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3423/4505] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:13 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:15.023546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:15.026138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:15.058904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:15.062215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:15.066421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:15.070709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:15.072090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:15.074649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:15.615520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:15.638856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:15.642475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:15.646904 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1c132283-e727-4fcf-93a1-1ce29e97b32f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.627617 Sep 10 11:02:15.663391 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1083/4506] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:15 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:16.680124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:16.681354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:16.701218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:16.702045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:16.708149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:16.709190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:16.710301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:16.710905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:17.113098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:17.132404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:17.138172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:17.146216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9f1679b6-6fab-4cd8-8b73-7f8efb285527 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.470119 Sep 10 11:02:17.150718 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3424/4507] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:16 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:18.135222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1140520737", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "63c65db1-231a-4e94-b304-7943deb77e20"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:18.180615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:18.181682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:18.196157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:18.203145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:18.204009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:18.205141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:18.206402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:18.209214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:18.246668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] validate_networks() for [('63c65db1-231a-4e94-b304-7943deb77e20', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:02:18.577201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:18.599195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:18.603955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:18.606703 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e282d73-b35f-4bef-b556-0b77bc60f5f9 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.430489 Sep 10 11:02:18.610085 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3425/4508] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:18 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:19.057634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:02:19.058369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:02:19.058948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:02:19.059460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:02:19.060239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:02:19.076843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:19.077838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:19.078479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:19.080199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:19.082298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:19.083457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:19.116544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:02:19.128837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for user 1fd01ead2408487dbe51fd732c209981 and project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:02:19.154939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:02:19.159330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:02:19.253300 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5df96048-e4a3-4756-9917-cbfd598c0e20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.317401 Sep 10 11:02:19.265950 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1084/4509] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:02:19.271665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea90f3a7-d6f0-4483-9d8b-3b6fd4f57932 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:19.273352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea90f3a7-d6f0-4483-9d8b-3b6fd4f57932 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:19.368105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ea90f3a7-d6f0-4483-9d8b-3b6fd4f57932 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:19.381655 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea90f3a7-d6f0-4483-9d8b-3b6fd4f57932 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1193 microversion: 2.1 time: 0.114563 Sep 10 11:02:19.383128 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3426/4510] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:19 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1193 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:19.639970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:19.642427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:19.663082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:19.664958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:19.668112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:19.674331 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:19.676950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:19.678434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:20.175688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:20.202808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:20.210480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:20.213472 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f09fc7a7-e192-4dda-85f6-33472264f4c7 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.578546 Sep 10 11:02:20.232834 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1085/4511] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:19 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:20.414287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed23e4f8-87f5-4f11-875b-2fa835919cbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:20.417579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed23e4f8-87f5-4f11-875b-2fa835919cbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:20.458020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed23e4f8-87f5-4f11-875b-2fa835919cbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:20.458541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed23e4f8-87f5-4f11-875b-2fa835919cbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:20.458999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed23e4f8-87f5-4f11-875b-2fa835919cbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:20.461355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed23e4f8-87f5-4f11-875b-2fa835919cbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:20.461798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed23e4f8-87f5-4f11-875b-2fa835919cbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:20.462580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed23e4f8-87f5-4f11-875b-2fa835919cbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:20.586066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed23e4f8-87f5-4f11-875b-2fa835919cbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:20.599658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:20.622247 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed23e4f8-87f5-4f11-875b-2fa835919cbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1245 microversion: 2.1 time: 0.214616 Sep 10 11:02:20.626166 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3427/4512] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:20 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1245 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:21.247989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:21.249559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:21.263775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:21.264346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:21.264964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:21.265613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:21.266709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:21.275233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:21.654120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56dd2278-ed59-47a3-9582-08c8d1da7fb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:21.654877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56dd2278-ed59-47a3-9582-08c8d1da7fb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:21.669696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:21.695296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:21.701718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56dd2278-ed59-47a3-9582-08c8d1da7fb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:21.702522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56dd2278-ed59-47a3-9582-08c8d1da7fb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:21.702705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:21.704790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56dd2278-ed59-47a3-9582-08c8d1da7fb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:21.707030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56dd2278-ed59-47a3-9582-08c8d1da7fb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:21.707772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56dd2278-ed59-47a3-9582-08c8d1da7fb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:21.708020 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e43ac619-b231-4171-9e34-d609a83d92af tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.465995 Sep 10 11:02:21.709761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56dd2278-ed59-47a3-9582-08c8d1da7fb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:21.710124 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1086/4513] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:21 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:21.948468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56dd2278-ed59-47a3-9582-08c8d1da7fb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:21.961773 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56dd2278-ed59-47a3-9582-08c8d1da7fb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1251 microversion: 2.1 time: 0.309894 Sep 10 11:02:21.977510 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3428/4514] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:21 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1251 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:22.745508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:22.746131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:22.760707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:22.762861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:22.771764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:22.774060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:22.777609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:22.779242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:22.988948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bdbd09d5-e148-4854-a987-fbed66a3aa52 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:22.990319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bdbd09d5-e148-4854-a987-fbed66a3aa52 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:23.040349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbd09d5-e148-4854-a987-fbed66a3aa52 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:23.043887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbd09d5-e148-4854-a987-fbed66a3aa52 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:23.044736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbd09d5-e148-4854-a987-fbed66a3aa52 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:23.048513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbd09d5-e148-4854-a987-fbed66a3aa52 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:23.049216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbd09d5-e148-4854-a987-fbed66a3aa52 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:23.049827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdbd09d5-e148-4854-a987-fbed66a3aa52 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:23.746124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:23.764043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:23.766542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:23.775710 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b12a5da3-aa95-4111-93ec-c8d8ab6c9cbe tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 1.034087 Sep 10 11:02:23.777116 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1087/4515] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:22 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:23.782852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-293d1182-0ac3-4135-bfde-c02dd42e1e5a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:23.802023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-293d1182-0ac3-4135-bfde-c02dd42e1e5a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:23.802804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-293d1182-0ac3-4135-bfde-c02dd42e1e5a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:23.803461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-293d1182-0ac3-4135-bfde-c02dd42e1e5a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:23.895979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-293d1182-0ac3-4135-bfde-c02dd42e1e5a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Going to try to stop instance {{(pid=128787) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 11:02:23.989293 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-293d1182-0ac3-4135-bfde-c02dd42e1e5a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/action" status: 202 len: 0 microversion: 2.1 time: 0.210669 Sep 10 11:02:23.992208 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1088/4516] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:02:23 2022] POST /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:02:24.003421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-80e3355b-57c0-4f82-8cf4-f44d9621a089 req-3163e16c-ae6a-4481-9a33-62b36986d0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-plugged", "status": "completed", "tag": "1387031f-4f94-43c5-9a5c-744bd5765477"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:24.029812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-80e3355b-57c0-4f82-8cf4-f44d9621a089 req-3163e16c-ae6a-4481-9a33-62b36986d0a5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:24.030261 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-80e3355b-57c0-4f82-8cf4-f44d9621a089 req-3163e16c-ae6a-4481-9a33-62b36986d0a5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:24.030705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-80e3355b-57c0-4f82-8cf4-f44d9621a089 req-3163e16c-ae6a-4481-9a33-62b36986d0a5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:24.051107 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-80e3355b-57c0-4f82-8cf4-f44d9621a089 req-3163e16c-ae6a-4481-9a33-62b36986d0a5 service nova] Creating event network-vif-plugged:1387031f-4f94-43c5-9a5c-744bd5765477 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:02:24.075652 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-80e3355b-57c0-4f82-8cf4-f44d9621a089 req-3163e16c-ae6a-4481-9a33-62b36986d0a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080487 Sep 10 11:02:24.089671 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1089/4517] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:24.100113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3bedf256-279a-4ab2-8e3b-4f28c1b8c3f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:24.101343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3bedf256-279a-4ab2-8e3b-4f28c1b8c3f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:24.105173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bdbd09d5-e148-4854-a987-fbed66a3aa52 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:24.109833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bedf256-279a-4ab2-8e3b-4f28c1b8c3f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:24.110864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bedf256-279a-4ab2-8e3b-4f28c1b8c3f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:24.111609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bedf256-279a-4ab2-8e3b-4f28c1b8c3f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:24.112701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bedf256-279a-4ab2-8e3b-4f28c1b8c3f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:24.113514 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bedf256-279a-4ab2-8e3b-4f28c1b8c3f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:24.114353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bedf256-279a-4ab2-8e3b-4f28c1b8c3f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:24.120486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bdbd09d5-e148-4854-a987-fbed66a3aa52 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1293 microversion: 2.1 time: 1.135431 Sep 10 11:02:24.134295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3429/4518] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:22 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1293 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:24.376951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3bedf256-279a-4ab2-8e3b-4f28c1b8c3f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:24.397728 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3bedf256-279a-4ab2-8e3b-4f28c1b8c3f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.305531 Sep 10 11:02:24.399539 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1090/4519] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:24 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:24.603280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3f64cc1a-1d3e-4e04-9b51-b9eb7f1428ab req-208d4961-8edc-4692-b012-50d3eecef9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb9d912a-d970-4b29-88a8-f2f22f879161", "tag": "66742b44-ba72-464d-a74a-d558010b7373"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:24.615426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3f64cc1a-1d3e-4e04-9b51-b9eb7f1428ab req-208d4961-8edc-4692-b012-50d3eecef9bc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:24.616126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3f64cc1a-1d3e-4e04-9b51-b9eb7f1428ab req-208d4961-8edc-4692-b012-50d3eecef9bc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:24.616745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3f64cc1a-1d3e-4e04-9b51-b9eb7f1428ab req-208d4961-8edc-4692-b012-50d3eecef9bc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:24.635349 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3f64cc1a-1d3e-4e04-9b51-b9eb7f1428ab req-208d4961-8edc-4692-b012-50d3eecef9bc service nova] Creating event network-changed:66742b44-ba72-464d-a74a-d558010b7373 for instance fb9d912a-d970-4b29-88a8-f2f22f879161 on n-h2-856894-1 Sep 10 11:02:24.643154 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3f64cc1a-1d3e-4e04-9b51-b9eb7f1428ab req-208d4961-8edc-4692-b012-50d3eecef9bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044379 Sep 10 11:02:24.644470 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3430/4520] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:24.806179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:24.807414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:24.815652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:24.816464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:24.816908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:24.817656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:24.818115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:24.818549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:25.152415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8fe4824e-98ae-4d16-9894-8bde421d52bf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:25.153318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8fe4824e-98ae-4d16-9894-8bde421d52bf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:25.162702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe4824e-98ae-4d16-9894-8bde421d52bf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:25.163503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe4824e-98ae-4d16-9894-8bde421d52bf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:25.164231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe4824e-98ae-4d16-9894-8bde421d52bf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:25.165635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe4824e-98ae-4d16-9894-8bde421d52bf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:25.166753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe4824e-98ae-4d16-9894-8bde421d52bf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:25.167581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fe4824e-98ae-4d16-9894-8bde421d52bf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:25.516042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:25.533864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:25.536375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:25.538966 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-36d3306d-bdd4-4ad7-ab21-32301b12ae76 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.735915 Sep 10 11:02:25.554608 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1091/4521] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:24 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:25.574981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-596569a4-cc82-472d-b1bd-7ce43c6f802a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:25.575314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8fe4824e-98ae-4d16-9894-8bde421d52bf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:25.575647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-596569a4-cc82-472d-b1bd-7ce43c6f802a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:25.582298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-596569a4-cc82-472d-b1bd-7ce43c6f802a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:25.583054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-596569a4-cc82-472d-b1bd-7ce43c6f802a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:25.583712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-596569a4-cc82-472d-b1bd-7ce43c6f802a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:25.584576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-596569a4-cc82-472d-b1bd-7ce43c6f802a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:25.585211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-596569a4-cc82-472d-b1bd-7ce43c6f802a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:25.585786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-596569a4-cc82-472d-b1bd-7ce43c6f802a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:25.587725 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8fe4824e-98ae-4d16-9894-8bde421d52bf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1293 microversion: 2.1 time: 0.439650 Sep 10 11:02:25.600398 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3431/4522] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:25 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1293 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:25.920597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-596569a4-cc82-472d-b1bd-7ce43c6f802a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:25.938470 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-596569a4-cc82-472d-b1bd-7ce43c6f802a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.381575 Sep 10 11:02:25.939672 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1092/4523] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:25 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:26.574936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:26.576184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:26.590337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:26.591090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:26.591927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:26.592985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:26.594364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:26.595410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:26.615791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ce41e735-0bba-4577-b0a1-65aaf0c86e32 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:26.616424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ce41e735-0bba-4577-b0a1-65aaf0c86e32 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:26.620219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:26.630622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce41e735-0bba-4577-b0a1-65aaf0c86e32 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:26.631292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce41e735-0bba-4577-b0a1-65aaf0c86e32 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:26.631755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce41e735-0bba-4577-b0a1-65aaf0c86e32 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:26.632481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce41e735-0bba-4577-b0a1-65aaf0c86e32 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:26.632946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce41e735-0bba-4577-b0a1-65aaf0c86e32 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:26.633406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce41e735-0bba-4577-b0a1-65aaf0c86e32 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:27.015287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:27.021133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ce41e735-0bba-4577-b0a1-65aaf0c86e32 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:27.030153 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ce41e735-0bba-4577-b0a1-65aaf0c86e32 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1293 microversion: 2.1 time: 0.419701 Sep 10 11:02:27.030749 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1093/4524] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:26 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1293 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:27.033669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:27.035562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:27.040547 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e068fd23-acc9-4be6-920b-cc0fe8f38e67 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.469574 Sep 10 11:02:27.042130 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3432/4525] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:26 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:27.046583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-a656273f-5aec-4a57-8edd-1621500d372f req-ca7b7f63-2543-4ae7-8cf1-99898b322e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-plugged", "status": "completed", "tag": "e66f2383-ec13-45eb-a0f1-1d3e117bb57b"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:27.061210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de05e0bb-36c9-4f7c-8a41-711956b246f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:27.061401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a656273f-5aec-4a57-8edd-1621500d372f req-ca7b7f63-2543-4ae7-8cf1-99898b322e11 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:27.061867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a656273f-5aec-4a57-8edd-1621500d372f req-ca7b7f63-2543-4ae7-8cf1-99898b322e11 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:27.062167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de05e0bb-36c9-4f7c-8a41-711956b246f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:27.062320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a656273f-5aec-4a57-8edd-1621500d372f req-ca7b7f63-2543-4ae7-8cf1-99898b322e11 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:27.072422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de05e0bb-36c9-4f7c-8a41-711956b246f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:27.073662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de05e0bb-36c9-4f7c-8a41-711956b246f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:27.076107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de05e0bb-36c9-4f7c-8a41-711956b246f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:27.077509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de05e0bb-36c9-4f7c-8a41-711956b246f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:27.079796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de05e0bb-36c9-4f7c-8a41-711956b246f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:27.081021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de05e0bb-36c9-4f7c-8a41-711956b246f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:27.099877 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-a656273f-5aec-4a57-8edd-1621500d372f req-ca7b7f63-2543-4ae7-8cf1-99898b322e11 service nova] Creating event network-vif-plugged:e66f2383-ec13-45eb-a0f1-1d3e117bb57b for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:02:27.108346 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-a656273f-5aec-4a57-8edd-1621500d372f req-ca7b7f63-2543-4ae7-8cf1-99898b322e11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075974 Sep 10 11:02:27.112119 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1094/4526] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:27.316044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-de05e0bb-36c9-4f7c-8a41-711956b246f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:27.329622 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de05e0bb-36c9-4f7c-8a41-711956b246f0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.285906 Sep 10 11:02:27.349938 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3433/4527] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:27 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:28.055979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0eb3d28e-f734-4dcd-8f02-a39e82c584ca tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:28.056783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0eb3d28e-f734-4dcd-8f02-a39e82c584ca tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:28.064363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0eb3d28e-f734-4dcd-8f02-a39e82c584ca tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:28.065315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0eb3d28e-f734-4dcd-8f02-a39e82c584ca tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:28.065990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0eb3d28e-f734-4dcd-8f02-a39e82c584ca tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:28.067196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0eb3d28e-f734-4dcd-8f02-a39e82c584ca tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:28.068295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0eb3d28e-f734-4dcd-8f02-a39e82c584ca tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:28.068943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0eb3d28e-f734-4dcd-8f02-a39e82c584ca tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:28.071771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:28.072376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:28.088154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:28.088977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:28.089469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:28.090176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:28.090640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:28.091073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:28.399613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0eb3d28e-f734-4dcd-8f02-a39e82c584ca tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:28.412019 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0eb3d28e-f734-4dcd-8f02-a39e82c584ca tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1293 microversion: 2.1 time: 0.361265 Sep 10 11:02:28.412752 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1095/4528] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:28 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1293 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:28.422686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bb27e61f-6ed6-48c8-a289-f343c90f8706 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:28.423811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bb27e61f-6ed6-48c8-a289-f343c90f8706 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:28.432683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb27e61f-6ed6-48c8-a289-f343c90f8706 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:28.433345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb27e61f-6ed6-48c8-a289-f343c90f8706 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:28.433947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb27e61f-6ed6-48c8-a289-f343c90f8706 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:28.435052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb27e61f-6ed6-48c8-a289-f343c90f8706 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:28.435801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb27e61f-6ed6-48c8-a289-f343c90f8706 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:28.436714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb27e61f-6ed6-48c8-a289-f343c90f8706 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:28.447708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:28.464583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:28.466135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:28.478532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:28.480605 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e992cbf-b7e2-467b-b649-4e5f51128c4f tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.412239 Sep 10 11:02:28.481713 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3434/4529] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:28 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:02:28.710983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bb27e61f-6ed6-48c8-a289-f343c90f8706 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:28.723665 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bb27e61f-6ed6-48c8-a289-f343c90f8706 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.308832 Sep 10 11:02:28.735266 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1096/4530] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:28 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:29.134087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6d30ff0a-6339-449f-aaa5-719d0660100a req-45caa7e2-0db7-4d45-a4db-e49e94104fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-plugged", "status": "completed", "tag": "37ceaf6b-33c8-4243-bc18-c92310693b11"}, {"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-plugged", "status": "completed", "tag": "210108b0-a7eb-488b-aad7-2977ab966a4c"}, {"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-plugged", "status": "completed", "tag": "9197c705-e5c1-4ffa-bb14-2abe9061e2f5"}, {"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-plugged", "status": "completed", "tag": "dd6bd1fd-3270-45c6-9883-d9fe196e44d2"}, {"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-plugged", "status": "completed", "tag": "610ac6bc-c492-465a-8b1d-4ee26f478c96"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:29.148364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d30ff0a-6339-449f-aaa5-719d0660100a req-45caa7e2-0db7-4d45-a4db-e49e94104fe1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:29.148856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d30ff0a-6339-449f-aaa5-719d0660100a req-45caa7e2-0db7-4d45-a4db-e49e94104fe1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:29.149419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6d30ff0a-6339-449f-aaa5-719d0660100a req-45caa7e2-0db7-4d45-a4db-e49e94104fe1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:29.166709 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6d30ff0a-6339-449f-aaa5-719d0660100a req-45caa7e2-0db7-4d45-a4db-e49e94104fe1 service nova] Creating event network-vif-plugged:37ceaf6b-33c8-4243-bc18-c92310693b11 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:02:29.167242 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6d30ff0a-6339-449f-aaa5-719d0660100a req-45caa7e2-0db7-4d45-a4db-e49e94104fe1 service nova] Creating event network-vif-plugged:210108b0-a7eb-488b-aad7-2977ab966a4c for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:02:29.168029 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6d30ff0a-6339-449f-aaa5-719d0660100a req-45caa7e2-0db7-4d45-a4db-e49e94104fe1 service nova] Creating event network-vif-plugged:9197c705-e5c1-4ffa-bb14-2abe9061e2f5 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:02:29.168546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6d30ff0a-6339-449f-aaa5-719d0660100a req-45caa7e2-0db7-4d45-a4db-e49e94104fe1 service nova] Creating event network-vif-plugged:dd6bd1fd-3270-45c6-9883-d9fe196e44d2 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:02:29.169056 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6d30ff0a-6339-449f-aaa5-719d0660100a req-45caa7e2-0db7-4d45-a4db-e49e94104fe1 service nova] Creating event network-vif-plugged:610ac6bc-c492-465a-8b1d-4ee26f478c96 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:02:29.175572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6d30ff0a-6339-449f-aaa5-719d0660100a req-45caa7e2-0db7-4d45-a4db-e49e94104fe1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.045773 Sep 10 11:02:29.176808 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3435/4531] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:29.435386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9a8dcaa6-a489-4485-a0b2-d321f715bb07 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:29.435959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9a8dcaa6-a489-4485-a0b2-d321f715bb07 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:29.440230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:29.440926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:29.444500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a8dcaa6-a489-4485-a0b2-d321f715bb07 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:29.444997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a8dcaa6-a489-4485-a0b2-d321f715bb07 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:29.445659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a8dcaa6-a489-4485-a0b2-d321f715bb07 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:29.446531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a8dcaa6-a489-4485-a0b2-d321f715bb07 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:29.447143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a8dcaa6-a489-4485-a0b2-d321f715bb07 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:29.447578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a8dcaa6-a489-4485-a0b2-d321f715bb07 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:29.504568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:29.508800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:29.509543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:29.520273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:29.521213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:29.521903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:29.522791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:29.523248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:29.523835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:29.698323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9a8dcaa6-a489-4485-a0b2-d321f715bb07 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:29.707140 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9a8dcaa6-a489-4485-a0b2-d321f715bb07 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1293 microversion: 2.1 time: 0.275594 Sep 10 11:02:29.708143 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1097/4532] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:29 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1293 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:29.749217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-567f9554-ad0d-4a4d-b36b-cfd9717a3ca9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:29.749867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-567f9554-ad0d-4a4d-b36b-cfd9717a3ca9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:29.756525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-567f9554-ad0d-4a4d-b36b-cfd9717a3ca9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:29.757276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-567f9554-ad0d-4a4d-b36b-cfd9717a3ca9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:29.757751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-567f9554-ad0d-4a4d-b36b-cfd9717a3ca9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:29.758590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-567f9554-ad0d-4a4d-b36b-cfd9717a3ca9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:29.759257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-567f9554-ad0d-4a4d-b36b-cfd9717a3ca9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:29.759574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-567f9554-ad0d-4a4d-b36b-cfd9717a3ca9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:29.766673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:29.779844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:29.781560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:29.783280 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-612dc696-1d41-45a4-be7d-9ab7fc86a041 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.279480 Sep 10 11:02:29.783853 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3436/4533] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:29 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:02:29.941334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-567f9554-ad0d-4a4d-b36b-cfd9717a3ca9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:29.951991 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-567f9554-ad0d-4a4d-b36b-cfd9717a3ca9 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.206800 Sep 10 11:02:29.954185 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1098/4534] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:29 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:30.733058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed0352ef-ad01-4c8a-a602-65b65ba4c756 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:30.733870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed0352ef-ad01-4c8a-a602-65b65ba4c756 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:30.741154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0352ef-ad01-4c8a-a602-65b65ba4c756 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:30.741870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0352ef-ad01-4c8a-a602-65b65ba4c756 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:30.742397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0352ef-ad01-4c8a-a602-65b65ba4c756 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:30.743275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0352ef-ad01-4c8a-a602-65b65ba4c756 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:30.743981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0352ef-ad01-4c8a-a602-65b65ba4c756 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:30.744417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed0352ef-ad01-4c8a-a602-65b65ba4c756 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:30.815309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:30.816933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:30.826234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:30.827681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:30.830382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:30.831961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:30.832919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:30.833716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:31.029276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed0352ef-ad01-4c8a-a602-65b65ba4c756 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:31.038414 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed0352ef-ad01-4c8a-a602-65b65ba4c756 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1293 microversion: 2.1 time: 0.309726 Sep 10 11:02:31.039184 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3437/4535] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:30 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1293 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:31.044853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b5c8cda-e1c9-455e-a618-79c997f3453d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:31.045559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b5c8cda-e1c9-455e-a618-79c997f3453d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:31.052214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b5c8cda-e1c9-455e-a618-79c997f3453d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:31.052910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b5c8cda-e1c9-455e-a618-79c997f3453d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:31.053525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b5c8cda-e1c9-455e-a618-79c997f3453d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:31.054381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b5c8cda-e1c9-455e-a618-79c997f3453d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:31.054994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b5c8cda-e1c9-455e-a618-79c997f3453d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:31.055722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b5c8cda-e1c9-455e-a618-79c997f3453d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:31.091372 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:31.106833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:31.108804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:31.110200 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d2c963d-7de1-4265-948f-74835f317da3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1874 microversion: 2.42 time: 0.299897 Sep 10 11:02:31.111190 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1099/4536] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:30 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1874 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:02:31.198774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-f5f0b9ce-280b-4eb1-8f6c-517e58c85ad3 req-d7c6d18a-8b1e-41b8-a2d4-448b0aa0c78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9d912a-d970-4b29-88a8-f2f22f879161", "name": "network-vif-plugged", "status": "completed", "tag": "66742b44-ba72-464d-a74a-d558010b7373"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:31.210075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f5f0b9ce-280b-4eb1-8f6c-517e58c85ad3 req-d7c6d18a-8b1e-41b8-a2d4-448b0aa0c78c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:31.210554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f5f0b9ce-280b-4eb1-8f6c-517e58c85ad3 req-d7c6d18a-8b1e-41b8-a2d4-448b0aa0c78c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:31.211168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f5f0b9ce-280b-4eb1-8f6c-517e58c85ad3 req-d7c6d18a-8b1e-41b8-a2d4-448b0aa0c78c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:31.230100 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-f5f0b9ce-280b-4eb1-8f6c-517e58c85ad3 req-d7c6d18a-8b1e-41b8-a2d4-448b0aa0c78c service nova] Creating event network-vif-plugged:66742b44-ba72-464d-a74a-d558010b7373 for instance fb9d912a-d970-4b29-88a8-f2f22f879161 on n-h2-856894-1 Sep 10 11:02:31.236603 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-f5f0b9ce-280b-4eb1-8f6c-517e58c85ad3 req-d7c6d18a-8b1e-41b8-a2d4-448b0aa0c78c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041745 Sep 10 11:02:31.237541 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1100/4537] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:02:31.258053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b5c8cda-e1c9-455e-a618-79c997f3453d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:31.304001 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b5c8cda-e1c9-455e-a618-79c997f3453d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.262533 Sep 10 11:02:31.305823 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3438/4538] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:31 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:32.066370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-57c141f4-929c-4e1a-8d28-1327b7794f0d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:32.067172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-57c141f4-929c-4e1a-8d28-1327b7794f0d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:32.074921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c141f4-929c-4e1a-8d28-1327b7794f0d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:32.075401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c141f4-929c-4e1a-8d28-1327b7794f0d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:32.075837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c141f4-929c-4e1a-8d28-1327b7794f0d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:32.076535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c141f4-929c-4e1a-8d28-1327b7794f0d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:32.076984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c141f4-929c-4e1a-8d28-1327b7794f0d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:32.077498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57c141f4-929c-4e1a-8d28-1327b7794f0d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:32.139028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:32.140377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:32.149048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:32.149789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:32.150387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:32.151425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:32.152241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:32.153180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:32.335181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-57c141f4-929c-4e1a-8d28-1327b7794f0d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:32.347530 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-57c141f4-929c-4e1a-8d28-1327b7794f0d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1293 microversion: 2.1 time: 0.287433 Sep 10 11:02:32.357536 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1101/4539] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:32 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1293 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:32.372790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3b6ad06c-b053-4583-aecc-28f1e8fb2a7c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:32.373778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3b6ad06c-b053-4583-aecc-28f1e8fb2a7c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:32.386191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6ad06c-b053-4583-aecc-28f1e8fb2a7c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:32.386951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6ad06c-b053-4583-aecc-28f1e8fb2a7c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:32.387700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6ad06c-b053-4583-aecc-28f1e8fb2a7c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:32.389008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6ad06c-b053-4583-aecc-28f1e8fb2a7c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:32.389818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6ad06c-b053-4583-aecc-28f1e8fb2a7c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:32.391833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6ad06c-b053-4583-aecc-28f1e8fb2a7c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:32.406397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:32.417414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:32.419603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:32.421567 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e566b13a-9697-4498-b859-dc306683d783 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2833 microversion: 2.42 time: 0.286502 Sep 10 11:02:32.422892 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3439/4540] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:02:32 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2833 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:32.467286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-47af3435-cac3-41ce-8174-7d6d64d7529d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:32.467779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-47af3435-cac3-41ce-8174-7d6d64d7529d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:32.474774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47af3435-cac3-41ce-8174-7d6d64d7529d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:32.475908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47af3435-cac3-41ce-8174-7d6d64d7529d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:32.476631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47af3435-cac3-41ce-8174-7d6d64d7529d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:32.477357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47af3435-cac3-41ce-8174-7d6d64d7529d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:32.478399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47af3435-cac3-41ce-8174-7d6d64d7529d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:32.479173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-47af3435-cac3-41ce-8174-7d6d64d7529d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:32.647467 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-47af3435-cac3-41ce-8174-7d6d64d7529d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.184198 Sep 10 11:02:32.648134 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3440/4541] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Sep 10 11:02:32 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025/os-interface => generated 1832 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:02:32.665613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3b6ad06c-b053-4583-aecc-28f1e8fb2a7c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:32.681533 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3b6ad06c-b053-4583-aecc-28f1e8fb2a7c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.321779 Sep 10 11:02:32.683715 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1102/4542] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:32 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:33.380743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7295ace5-263e-4e96-b6b9-b331a0a48163 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:33.386785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7295ace5-263e-4e96-b6b9-b331a0a48163 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:33.393888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295ace5-263e-4e96-b6b9-b331a0a48163 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:33.394937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295ace5-263e-4e96-b6b9-b331a0a48163 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:33.395660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295ace5-263e-4e96-b6b9-b331a0a48163 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:33.396580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295ace5-263e-4e96-b6b9-b331a0a48163 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:33.397289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295ace5-263e-4e96-b6b9-b331a0a48163 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:33.397979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7295ace5-263e-4e96-b6b9-b331a0a48163 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:33.709271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2b7e72a9-c3e6-4fc3-a5ec-103450dcc558 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:33.709817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2b7e72a9-c3e6-4fc3-a5ec-103450dcc558 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:33.710627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7295ace5-263e-4e96-b6b9-b331a0a48163 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:33.717744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b7e72a9-c3e6-4fc3-a5ec-103450dcc558 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:33.718301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b7e72a9-c3e6-4fc3-a5ec-103450dcc558 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:33.718777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b7e72a9-c3e6-4fc3-a5ec-103450dcc558 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:33.719474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b7e72a9-c3e6-4fc3-a5ec-103450dcc558 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:33.720002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b7e72a9-c3e6-4fc3-a5ec-103450dcc558 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:33.720452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b7e72a9-c3e6-4fc3-a5ec-103450dcc558 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:33.729473 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7295ace5-263e-4e96-b6b9-b331a0a48163 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1474 microversion: 2.1 time: 0.356266 Sep 10 11:02:33.731397 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3441/4543] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:33 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1474 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:33.899204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-351543878", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:33.972954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2b7e72a9-c3e6-4fc3-a5ec-103450dcc558 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:33.986219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] validate_networks() for [('63c65db1-231a-4e94-b304-7943deb77e20', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:02:33.990475 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2b7e72a9-c3e6-4fc3-a5ec-103450dcc558 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.285686 Sep 10 11:02:33.992830 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1103/4544] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:33 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:34.297510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-74878958-2311-47a0-bb2e-0199e972b6b4 req-b6532035-c6fb-4e37-a93e-53b8184f947e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "tag": "210108b0-a7eb-488b-aad7-2977ab966a4c"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:34.320181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-74878958-2311-47a0-bb2e-0199e972b6b4 req-b6532035-c6fb-4e37-a93e-53b8184f947e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:34.320727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-74878958-2311-47a0-bb2e-0199e972b6b4 req-b6532035-c6fb-4e37-a93e-53b8184f947e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:34.321203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-74878958-2311-47a0-bb2e-0199e972b6b4 req-b6532035-c6fb-4e37-a93e-53b8184f947e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:34.349972 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-74878958-2311-47a0-bb2e-0199e972b6b4 req-b6532035-c6fb-4e37-a93e-53b8184f947e service nova] Creating event network-changed:210108b0-a7eb-488b-aad7-2977ab966a4c for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:02:34.360791 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-74878958-2311-47a0-bb2e-0199e972b6b4 req-b6532035-c6fb-4e37-a93e-53b8184f947e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069886 Sep 10 11:02:34.365418 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1104/4545] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:35.034859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4b5bb55c-c7c3-40a7-a4b1-096be592c968 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:35.042225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4b5bb55c-c7c3-40a7-a4b1-096be592c968 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:35.066068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5bb55c-c7c3-40a7-a4b1-096be592c968 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:35.068982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5bb55c-c7c3-40a7-a4b1-096be592c968 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:35.069503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5bb55c-c7c3-40a7-a4b1-096be592c968 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:35.072132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5bb55c-c7c3-40a7-a4b1-096be592c968 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:35.072660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5bb55c-c7c3-40a7-a4b1-096be592c968 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:35.073117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b5bb55c-c7c3-40a7-a4b1-096be592c968 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:35.243695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:02:35.244806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:02:35.245569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:02:35.248128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:02:35.249052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:02:35.262465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:35.263509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:35.264201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:35.266655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:35.268595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:35.271891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:35.337276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:02:35.351871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for user 1fd01ead2408487dbe51fd732c209981 and project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:02:35.377914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:02:35.381410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 2c2c1850-1d14-4a31-ab77-d50ef70c89b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:02:35.444000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6df85077-ec4d-4bad-8783-0846840dbbf1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551061 Sep 10 11:02:35.445054 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3442/4546] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:02:35.454243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4b5bb55c-c7c3-40a7-a4b1-096be592c968 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:35.459739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66313467-95d5-473a-8956-a30ac966f3fc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:35.460517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66313467-95d5-473a-8956-a30ac966f3fc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 2c2c1850-1d14-4a31-ab77-d50ef70c89b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:35.464528 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4b5bb55c-c7c3-40a7-a4b1-096be592c968 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.447538 Sep 10 11:02:35.467593 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1105/4547] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:35 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:35.522677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66313467-95d5-473a-8956-a30ac966f3fc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 2c2c1850-1d14-4a31-ab77-d50ef70c89b3] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:02:35.877485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-24f051e0-b50f-4319-9b36-d20901bd8eeb tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:35.878243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-24f051e0-b50f-4319-9b36-d20901bd8eeb tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:35.892366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24f051e0-b50f-4319-9b36-d20901bd8eeb tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:35.892866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24f051e0-b50f-4319-9b36-d20901bd8eeb tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:35.893337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24f051e0-b50f-4319-9b36-d20901bd8eeb tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:35.894338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24f051e0-b50f-4319-9b36-d20901bd8eeb tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:35.894805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24f051e0-b50f-4319-9b36-d20901bd8eeb tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:35.897815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24f051e0-b50f-4319-9b36-d20901bd8eeb tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:35.941349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-24f051e0-b50f-4319-9b36-d20901bd8eeb tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:02:35.979322 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66313467-95d5-473a-8956-a30ac966f3fc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3" status: 204 len: 0 microversion: 2.1 time: 0.526546 Sep 10 11:02:35.980976 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3443/4548] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:02:35 2022] DELETE /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:02:36.015091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1f1fe6ea-3a1a-41e1-a54a-febecf78fbf8 req-6e388e54-4cf0-4de8-b082-b193b3d95581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b52c87-5cab-4f2b-b25f-3f5d12ca063d", "tag": "ac32bd2a-cfc1-46eb-9ede-750a98047328"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:36.060007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1f1fe6ea-3a1a-41e1-a54a-febecf78fbf8 req-6e388e54-4cf0-4de8-b082-b193b3d95581 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:36.060501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1f1fe6ea-3a1a-41e1-a54a-febecf78fbf8 req-6e388e54-4cf0-4de8-b082-b193b3d95581 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:36.060933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1f1fe6ea-3a1a-41e1-a54a-febecf78fbf8 req-6e388e54-4cf0-4de8-b082-b193b3d95581 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:36.110172 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1f1fe6ea-3a1a-41e1-a54a-febecf78fbf8 req-6e388e54-4cf0-4de8-b082-b193b3d95581 service nova] Creating event network-changed:ac32bd2a-cfc1-46eb-9ede-750a98047328 for instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d on n-h2-856894-1 Sep 10 11:02:36.116180 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1f1fe6ea-3a1a-41e1-a54a-febecf78fbf8 req-6e388e54-4cf0-4de8-b082-b193b3d95581 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133356 Sep 10 11:02:36.117458 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3444/4549] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:36.124239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85865b2e-c9c4-459d-9187-1bf064b283d3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:36.125725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-85865b2e-c9c4-459d-9187-1bf064b283d3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 2c2c1850-1d14-4a31-ab77-d50ef70c89b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:36.133841 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-85865b2e-c9c4-459d-9187-1bf064b283d3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85865b2e-c9c4-459d-9187-1bf064b283d3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3 HTTP/1.1 Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '2c2c1850-1d14-4a31-ab77-d50ef70c89b3'} Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:02:36.135686 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:02:36.142168 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:02:36.142168 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:02:36.142168 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:02:36.142168 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:02:36.143659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85865b2e-c9c4-459d-9187-1bf064b283d3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:02:36.144785 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85865b2e-c9c4-459d-9187-1bf064b283d3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3" status: 404 len: 111 microversion: 2.1 time: 0.026072 Sep 10 11:02:36.145712 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3445/4550] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:36 2022] GET /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:02:36.221587 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-24f051e0-b50f-4319-9b36-d20901bd8eeb tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 204 len: 0 microversion: 2.1 time: 0.348354 Sep 10 11:02:36.225169 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1106/4551] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:02:35 2022] DELETE /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:02:36.234316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a031313-4cbf-467f-8839-15e7396e0b78 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:36.236032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a031313-4cbf-467f-8839-15e7396e0b78 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:36.250205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a031313-4cbf-467f-8839-15e7396e0b78 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:36.250848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a031313-4cbf-467f-8839-15e7396e0b78 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:36.252461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a031313-4cbf-467f-8839-15e7396e0b78 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:36.255793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a031313-4cbf-467f-8839-15e7396e0b78 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:36.257226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a031313-4cbf-467f-8839-15e7396e0b78 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:36.259099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a031313-4cbf-467f-8839-15e7396e0b78 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:36.314467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-623764841", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "63c65db1-231a-4e94-b304-7943deb77e20"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:36.388310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] validate_networks() for [('63c65db1-231a-4e94-b304-7943deb77e20', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:02:36.623425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a031313-4cbf-467f-8839-15e7396e0b78 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:36.634181 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a031313-4cbf-467f-8839-15e7396e0b78 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1583 microversion: 2.1 time: 0.404649 Sep 10 11:02:36.635144 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3446/4552] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:36 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1583 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:36.642170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50ed13fd-f38d-4367-9850-0850c7b3349b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:36.643017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50ed13fd-f38d-4367-9850-0850c7b3349b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:36.662354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ed13fd-f38d-4367-9850-0850c7b3349b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:36.663310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ed13fd-f38d-4367-9850-0850c7b3349b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:36.663969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ed13fd-f38d-4367-9850-0850c7b3349b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:36.664922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ed13fd-f38d-4367-9850-0850c7b3349b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:36.665809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ed13fd-f38d-4367-9850-0850c7b3349b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:36.666506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50ed13fd-f38d-4367-9850-0850c7b3349b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:36.916667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50ed13fd-f38d-4367-9850-0850c7b3349b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:36.927824 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50ed13fd-f38d-4367-9850-0850c7b3349b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.290843 Sep 10 11:02:36.928434 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3447/4553] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:36 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:37.102090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:02:37.102666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:02:37.103500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:02:37.104195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:02:37.104732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:02:37.122187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:37.122878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:37.124402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:37.126530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:37.127268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:37.133717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:37.180471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:02:37.186828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for user 1fd01ead2408487dbe51fd732c209981 and project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:02:37.203539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:02:37.206094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:02:37.279921 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0b498222-057e-40cf-affc-8060241a2cfb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969377 Sep 10 11:02:37.285239 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1107/4554] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:02:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:02:37.292851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8b77e95-d089-47ad-9a15-60d0550c9546 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:37.293530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e8b77e95-d089-47ad-9a15-60d0550c9546 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:37.435749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e8b77e95-d089-47ad-9a15-60d0550c9546 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:37.445711 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8b77e95-d089-47ad-9a15-60d0550c9546 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1220 microversion: 2.1 time: 0.156630 Sep 10 11:02:37.446766 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3448/4555] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:37 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1220 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:37.678835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c75f953d-0790-48cc-b9ae-bf917d54639b tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:37.680039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c75f953d-0790-48cc-b9ae-bf917d54639b tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:37.703864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c75f953d-0790-48cc-b9ae-bf917d54639b tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:37.704374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c75f953d-0790-48cc-b9ae-bf917d54639b tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:37.704836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c75f953d-0790-48cc-b9ae-bf917d54639b tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:37.705927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c75f953d-0790-48cc-b9ae-bf917d54639b tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:37.706611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c75f953d-0790-48cc-b9ae-bf917d54639b tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:37.707472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c75f953d-0790-48cc-b9ae-bf917d54639b tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:37.956650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5cd2c704-a21a-4b8c-994d-d4838fb15d2c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:37.957821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5cd2c704-a21a-4b8c-994d-d4838fb15d2c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:37.970296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd2c704-a21a-4b8c-994d-d4838fb15d2c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:37.971080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd2c704-a21a-4b8c-994d-d4838fb15d2c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:37.972678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd2c704-a21a-4b8c-994d-d4838fb15d2c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:37.973755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd2c704-a21a-4b8c-994d-d4838fb15d2c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:37.974470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd2c704-a21a-4b8c-994d-d4838fb15d2c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:37.975167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd2c704-a21a-4b8c-994d-d4838fb15d2c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:38.231242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c75f953d-0790-48cc-b9ae-bf917d54639b tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:38.241915 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c75f953d-0790-48cc-b9ae-bf917d54639b tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1583 microversion: 2.1 time: 0.577463 Sep 10 11:02:38.242682 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1108/4556] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:37 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1583 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:38.436453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5cd2c704-a21a-4b8c-994d-d4838fb15d2c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:38.447450 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5cd2c704-a21a-4b8c-994d-d4838fb15d2c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1724 microversion: 2.1 time: 0.495436 Sep 10 11:02:38.448533 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3449/4557] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:37 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1724 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:38.470097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-582873af-def5-4eb1-a1b9-39ba6e15e628 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:38.470803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-582873af-def5-4eb1-a1b9-39ba6e15e628 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:38.478442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-582873af-def5-4eb1-a1b9-39ba6e15e628 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:38.480270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-582873af-def5-4eb1-a1b9-39ba6e15e628 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:38.482127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-582873af-def5-4eb1-a1b9-39ba6e15e628 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:38.484671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-582873af-def5-4eb1-a1b9-39ba6e15e628 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:38.485847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-582873af-def5-4eb1-a1b9-39ba6e15e628 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:38.487429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-582873af-def5-4eb1-a1b9-39ba6e15e628 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:38.601901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-582873af-def5-4eb1-a1b9-39ba6e15e628 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:38.617326 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-582873af-def5-4eb1-a1b9-39ba6e15e628 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1272 microversion: 2.1 time: 0.151422 Sep 10 11:02:38.618263 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1109/4558] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:38 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:39.237462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1a1b8b62-e90a-4a1c-8262-43c49d79c31e req-247ddb66-7416-4e82-8712-0a83287d0982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b52c87-5cab-4f2b-b25f-3f5d12ca063d", "name": "network-vif-deleted", "tag": "ac32bd2a-cfc1-46eb-9ede-750a98047328"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:39.250583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:39.259148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1a1b8b62-e90a-4a1c-8262-43c49d79c31e req-247ddb66-7416-4e82-8712-0a83287d0982 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:39.260036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1a1b8b62-e90a-4a1c-8262-43c49d79c31e req-247ddb66-7416-4e82-8712-0a83287d0982 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:39.261090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1a1b8b62-e90a-4a1c-8262-43c49d79c31e req-247ddb66-7416-4e82-8712-0a83287d0982 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:39.267753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-74709155-47d0-4a25-ab48-2d024172ec82 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:39.268948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-74709155-47d0-4a25-ab48-2d024172ec82 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:39.280658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74709155-47d0-4a25-ab48-2d024172ec82 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:39.286102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74709155-47d0-4a25-ab48-2d024172ec82 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:39.286705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74709155-47d0-4a25-ab48-2d024172ec82 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:39.288710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74709155-47d0-4a25-ab48-2d024172ec82 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:39.289542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74709155-47d0-4a25-ab48-2d024172ec82 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:39.290543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74709155-47d0-4a25-ab48-2d024172ec82 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:39.297878 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1a1b8b62-e90a-4a1c-8262-43c49d79c31e req-247ddb66-7416-4e82-8712-0a83287d0982 service nova] Creating event network-vif-deleted:ac32bd2a-cfc1-46eb-9ede-750a98047328 for instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d on n-h2-856894-1 Sep 10 11:02:39.305304 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1a1b8b62-e90a-4a1c-8262-43c49d79c31e req-247ddb66-7416-4e82-8712-0a83287d0982 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074318 Sep 10 11:02:39.306594 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3450/4559] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:39.419316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-74709155-47d0-4a25-ab48-2d024172ec82 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:39.429791 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-74709155-47d0-4a25-ab48-2d024172ec82 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1396 microversion: 2.1 time: 0.166716 Sep 10 11:02:39.440994 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1110/4560] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:39 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1396 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:39.477522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66ca69c7-76ac-4a58-a194-c5d830f2f2eb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:39.479077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66ca69c7-76ac-4a58-a194-c5d830f2f2eb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:39.505750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66ca69c7-76ac-4a58-a194-c5d830f2f2eb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:39.506555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66ca69c7-76ac-4a58-a194-c5d830f2f2eb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:39.507206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66ca69c7-76ac-4a58-a194-c5d830f2f2eb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:39.512243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66ca69c7-76ac-4a58-a194-c5d830f2f2eb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:39.516233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66ca69c7-76ac-4a58-a194-c5d830f2f2eb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:39.516861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66ca69c7-76ac-4a58-a194-c5d830f2f2eb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:39.529496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:39.647113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7c812924-f719-4d38-b025-a0974581e92c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:39.648240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7c812924-f719-4d38-b025-a0974581e92c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:39.657979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c812924-f719-4d38-b025-a0974581e92c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:39.666145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c812924-f719-4d38-b025-a0974581e92c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:39.666610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c812924-f719-4d38-b025-a0974581e92c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:39.667345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c812924-f719-4d38-b025-a0974581e92c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:39.667830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c812924-f719-4d38-b025-a0974581e92c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:39.668231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c812924-f719-4d38-b025-a0974581e92c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:39.837628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7c812924-f719-4d38-b025-a0974581e92c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:39.853289 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7c812924-f719-4d38-b025-a0974581e92c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1278 microversion: 2.1 time: 0.210151 Sep 10 11:02:39.854442 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1111/4561] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:39 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:39.905308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-66ca69c7-76ac-4a58-a194-c5d830f2f2eb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:39.923609 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66ca69c7-76ac-4a58-a194-c5d830f2f2eb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1701 microversion: 2.1 time: 0.454833 Sep 10 11:02:39.925439 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3451/4562] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:39 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1701 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:39.954881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-245ed3ad-3a34-4334-9a80-985e6d6fcb93 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:39.970191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-245ed3ad-3a34-4334-9a80-985e6d6fcb93 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:39.971860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-245ed3ad-3a34-4334-9a80-985e6d6fcb93 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:39.974144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-245ed3ad-3a34-4334-9a80-985e6d6fcb93 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:40.027996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-245ed3ad-3a34-4334-9a80-985e6d6fcb93 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Going to try to start instance {{(pid=128787) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 11:02:40.115536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:40.153054 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-245ed3ad-3a34-4334-9a80-985e6d6fcb93 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/action" status: 202 len: 0 microversion: 2.1 time: 0.202703 Sep 10 11:02:40.154030 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1112/4563] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:02:39 2022] POST /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:02:40.162704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb3f6fe1-edaa-4f62-a860-a8a90431d85a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:40.163333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb3f6fe1-edaa-4f62-a860-a8a90431d85a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:40.177433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb3f6fe1-edaa-4f62-a860-a8a90431d85a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:40.181375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb3f6fe1-edaa-4f62-a860-a8a90431d85a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:40.183494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb3f6fe1-edaa-4f62-a860-a8a90431d85a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:40.185580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb3f6fe1-edaa-4f62-a860-a8a90431d85a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:40.186227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb3f6fe1-edaa-4f62-a860-a8a90431d85a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:40.188093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb3f6fe1-edaa-4f62-a860-a8a90431d85a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:40.465759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-58e713a5-06fa-4ef7-b37d-e74bfb8343b1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:40.466748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-58e713a5-06fa-4ef7-b37d-e74bfb8343b1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:40.488605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58e713a5-06fa-4ef7-b37d-e74bfb8343b1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:40.489129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58e713a5-06fa-4ef7-b37d-e74bfb8343b1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:40.492715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58e713a5-06fa-4ef7-b37d-e74bfb8343b1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:40.495201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58e713a5-06fa-4ef7-b37d-e74bfb8343b1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:40.496283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58e713a5-06fa-4ef7-b37d-e74bfb8343b1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:40.496731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58e713a5-06fa-4ef7-b37d-e74bfb8343b1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:40.702076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-58e713a5-06fa-4ef7-b37d-e74bfb8343b1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:40.714832 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-58e713a5-06fa-4ef7-b37d-e74bfb8343b1 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1228 microversion: 2.1 time: 0.254491 Sep 10 11:02:40.717937 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1113/4564] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:40 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1228 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:40.882132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b0c804e4-2dab-4891-8912-4a29c1fc7d8d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:40.884516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b0c804e4-2dab-4891-8912-4a29c1fc7d8d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:40.892279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0c804e4-2dab-4891-8912-4a29c1fc7d8d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:40.893140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0c804e4-2dab-4891-8912-4a29c1fc7d8d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:40.893795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0c804e4-2dab-4891-8912-4a29c1fc7d8d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:40.895152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0c804e4-2dab-4891-8912-4a29c1fc7d8d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:40.895824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0c804e4-2dab-4891-8912-4a29c1fc7d8d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:40.896489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0c804e4-2dab-4891-8912-4a29c1fc7d8d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:40.920918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb3f6fe1-edaa-4f62-a860-a8a90431d85a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:40.929939 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb3f6fe1-edaa-4f62-a860-a8a90431d85a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1710 microversion: 2.1 time: 0.771136 Sep 10 11:02:40.930537 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3452/4565] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:40 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1710 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:41.283888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b0c804e4-2dab-4891-8912-4a29c1fc7d8d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:41.298162 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b0c804e4-2dab-4891-8912-4a29c1fc7d8d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1320 microversion: 2.1 time: 0.419741 Sep 10 11:02:41.317992 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1114/4566] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:40 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1320 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:41.740927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9e7dc82-75a6-4244-8619-53a09686273f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:41.741596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9e7dc82-75a6-4244-8619-53a09686273f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:41.759741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9e7dc82-75a6-4244-8619-53a09686273f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:41.762111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9e7dc82-75a6-4244-8619-53a09686273f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:41.762111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9e7dc82-75a6-4244-8619-53a09686273f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:41.765189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9e7dc82-75a6-4244-8619-53a09686273f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:41.767438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9e7dc82-75a6-4244-8619-53a09686273f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:41.767862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9e7dc82-75a6-4244-8619-53a09686273f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:41.955557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-828c84bb-b0d7-469f-b2e5-5f30532b7026 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:41.956179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-828c84bb-b0d7-469f-b2e5-5f30532b7026 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:41.974969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-828c84bb-b0d7-469f-b2e5-5f30532b7026 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:41.975478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-828c84bb-b0d7-469f-b2e5-5f30532b7026 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:41.975946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-828c84bb-b0d7-469f-b2e5-5f30532b7026 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:41.976717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-828c84bb-b0d7-469f-b2e5-5f30532b7026 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:41.977317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-828c84bb-b0d7-469f-b2e5-5f30532b7026 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:41.977616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-828c84bb-b0d7-469f-b2e5-5f30532b7026 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:42.170614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9e7dc82-75a6-4244-8619-53a09686273f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:42.182151 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9e7dc82-75a6-4244-8619-53a09686273f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1228 microversion: 2.1 time: 0.447562 Sep 10 11:02:42.182779 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3453/4567] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:41 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1228 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:42.324480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8f0b67d-fb2f-4c27-bbec-606a8656c93a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:42.325385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8f0b67d-fb2f-4c27-bbec-606a8656c93a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:42.337576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8f0b67d-fb2f-4c27-bbec-606a8656c93a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:42.338268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8f0b67d-fb2f-4c27-bbec-606a8656c93a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:42.339553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8f0b67d-fb2f-4c27-bbec-606a8656c93a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:42.347712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8f0b67d-fb2f-4c27-bbec-606a8656c93a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:42.349641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8f0b67d-fb2f-4c27-bbec-606a8656c93a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:42.350170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8f0b67d-fb2f-4c27-bbec-606a8656c93a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:42.430318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-828c84bb-b0d7-469f-b2e5-5f30532b7026 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:42.455829 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-828c84bb-b0d7-469f-b2e5-5f30532b7026 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1710 microversion: 2.1 time: 0.503991 Sep 10 11:02:42.461899 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1115/4568] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:41 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1710 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:42.736947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c8f0b67d-fb2f-4c27-bbec-606a8656c93a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:42.758545 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8f0b67d-fb2f-4c27-bbec-606a8656c93a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1320 microversion: 2.1 time: 0.437742 Sep 10 11:02:42.760114 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3454/4569] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:42 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:42.796006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-de9a1ba1-b1e1-46bb-896a-6a17f079f8fa req-e62c0d69-1da5-4e54-8570-069a5f5956c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc345de-8d35-493d-ab7e-dd97ad4d0275", "tag": "b0446e2a-58f9-4a57-932f-547bfe9d20b2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:42.811857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-de9a1ba1-b1e1-46bb-896a-6a17f079f8fa req-e62c0d69-1da5-4e54-8570-069a5f5956c1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:42.816961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-de9a1ba1-b1e1-46bb-896a-6a17f079f8fa req-e62c0d69-1da5-4e54-8570-069a5f5956c1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:42.817436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-de9a1ba1-b1e1-46bb-896a-6a17f079f8fa req-e62c0d69-1da5-4e54-8570-069a5f5956c1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:42.830983 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-de9a1ba1-b1e1-46bb-896a-6a17f079f8fa req-e62c0d69-1da5-4e54-8570-069a5f5956c1 service nova] Creating event network-changed:b0446e2a-58f9-4a57-932f-547bfe9d20b2 for instance edc345de-8d35-493d-ab7e-dd97ad4d0275 on n-h2-856894-1 Sep 10 11:02:42.836540 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-de9a1ba1-b1e1-46bb-896a-6a17f079f8fa req-e62c0d69-1da5-4e54-8570-069a5f5956c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047345 Sep 10 11:02:42.837858 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1116/4570] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:43.210375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c787f517-7cd3-4173-b45d-8998bdb0a8cc tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:43.211933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c787f517-7cd3-4173-b45d-8998bdb0a8cc tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:43.227067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c787f517-7cd3-4173-b45d-8998bdb0a8cc tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:43.228806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c787f517-7cd3-4173-b45d-8998bdb0a8cc tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:43.231069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c787f517-7cd3-4173-b45d-8998bdb0a8cc tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:43.233395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c787f517-7cd3-4173-b45d-8998bdb0a8cc tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:43.233881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c787f517-7cd3-4173-b45d-8998bdb0a8cc tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:43.237133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c787f517-7cd3-4173-b45d-8998bdb0a8cc tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:43.422571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c787f517-7cd3-4173-b45d-8998bdb0a8cc tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:43.435028 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c787f517-7cd3-4173-b45d-8998bdb0a8cc tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1228 microversion: 2.1 time: 0.229728 Sep 10 11:02:43.438593 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3455/4571] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:43 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1228 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:43.492320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d46c3eed-143e-4191-a2e7-bd94cf2e4f1d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:43.494106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d46c3eed-143e-4191-a2e7-bd94cf2e4f1d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:43.504032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d46c3eed-143e-4191-a2e7-bd94cf2e4f1d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:43.505237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d46c3eed-143e-4191-a2e7-bd94cf2e4f1d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:43.505974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d46c3eed-143e-4191-a2e7-bd94cf2e4f1d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:43.506783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d46c3eed-143e-4191-a2e7-bd94cf2e4f1d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:43.507332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d46c3eed-143e-4191-a2e7-bd94cf2e4f1d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:43.507826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d46c3eed-143e-4191-a2e7-bd94cf2e4f1d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:43.764589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d46c3eed-143e-4191-a2e7-bd94cf2e4f1d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:43.775514 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d46c3eed-143e-4191-a2e7-bd94cf2e4f1d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1714 microversion: 2.1 time: 0.291711 Sep 10 11:02:43.799154 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1117/4572] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:43 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1714 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:43.800669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-755b6502-a87e-4aa0-94ae-b567c9b8ad39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:43.801482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-755b6502-a87e-4aa0-94ae-b567c9b8ad39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:43.811673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-755b6502-a87e-4aa0-94ae-b567c9b8ad39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:43.813113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-755b6502-a87e-4aa0-94ae-b567c9b8ad39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:43.813833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-755b6502-a87e-4aa0-94ae-b567c9b8ad39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:43.814753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-755b6502-a87e-4aa0-94ae-b567c9b8ad39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:43.815570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-755b6502-a87e-4aa0-94ae-b567c9b8ad39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:43.816213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-755b6502-a87e-4aa0-94ae-b567c9b8ad39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:44.076768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-755b6502-a87e-4aa0-94ae-b567c9b8ad39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:44.087510 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-755b6502-a87e-4aa0-94ae-b567c9b8ad39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1320 microversion: 2.1 time: 0.296892 Sep 10 11:02:44.112782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3456/4573] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:43 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:44.466294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5aa0056-55d6-4f0c-9bfc-6c0901be0a04 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:44.467163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a5aa0056-55d6-4f0c-9bfc-6c0901be0a04 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:44.475560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa0056-55d6-4f0c-9bfc-6c0901be0a04 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:44.476512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa0056-55d6-4f0c-9bfc-6c0901be0a04 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:44.477250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa0056-55d6-4f0c-9bfc-6c0901be0a04 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:44.479129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa0056-55d6-4f0c-9bfc-6c0901be0a04 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:44.480494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa0056-55d6-4f0c-9bfc-6c0901be0a04 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:44.481240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa0056-55d6-4f0c-9bfc-6c0901be0a04 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:44.588149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a5aa0056-55d6-4f0c-9bfc-6c0901be0a04 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:44.596752 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a5aa0056-55d6-4f0c-9bfc-6c0901be0a04 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1228 microversion: 2.1 time: 0.138008 Sep 10 11:02:44.597680 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1118/4574] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:44 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1228 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:45.121547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43609a49-2d0b-4fbf-b583-44b644120a9c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:45.122802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-43609a49-2d0b-4fbf-b583-44b644120a9c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:45.130970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43609a49-2d0b-4fbf-b583-44b644120a9c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:45.131837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43609a49-2d0b-4fbf-b583-44b644120a9c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:45.132499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43609a49-2d0b-4fbf-b583-44b644120a9c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:45.133793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43609a49-2d0b-4fbf-b583-44b644120a9c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:45.134476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43609a49-2d0b-4fbf-b583-44b644120a9c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:45.135355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43609a49-2d0b-4fbf-b583-44b644120a9c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:45.296272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:45.416177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-43609a49-2d0b-4fbf-b583-44b644120a9c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:45.425546 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43609a49-2d0b-4fbf-b583-44b644120a9c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1320 microversion: 2.1 time: 0.309316 Sep 10 11:02:45.426546 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3457/4575] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:45 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1320 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:45.621585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:45.622337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:45.630002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:45.633885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:45.634521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:45.635442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:45.635905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:45.636330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:45.673325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:45.674126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:45.674751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:45.675412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lazy-loading 'fault' on Instance uuid d4b52c87-5cab-4f2b-b25f-3f5d12ca063d {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:02:45.731105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '077d4f0b50b749698c9878b007070a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1bbb56aa2f44f3b5a50f0cbecfd160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:45.741600 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a276ac3b-f735-4b1d-b34b-77aad5eb383f tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 200 len: 1233 microversion: 2.1 time: 0.123987 Sep 10 11:02:45.744059 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1119/4576] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:45 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 1233 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:46.449936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-888d0ab0-ae33-42fe-8226-2ddf97f75de8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:46.450615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-888d0ab0-ae33-42fe-8226-2ddf97f75de8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:46.460791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-888d0ab0-ae33-42fe-8226-2ddf97f75de8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:46.461600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-888d0ab0-ae33-42fe-8226-2ddf97f75de8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:46.462118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-888d0ab0-ae33-42fe-8226-2ddf97f75de8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:46.463516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-888d0ab0-ae33-42fe-8226-2ddf97f75de8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:46.464056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-888d0ab0-ae33-42fe-8226-2ddf97f75de8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:46.464714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-888d0ab0-ae33-42fe-8226-2ddf97f75de8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:46.633551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-888d0ab0-ae33-42fe-8226-2ddf97f75de8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:46.637167 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-888d0ab0-ae33-42fe-8226-2ddf97f75de8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1320 microversion: 2.1 time: 0.188801 Sep 10 11:02:46.637167 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3458/4577] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:46 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:46.781042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:46.783312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] [instance: d4b52c87-5cab-4f2b-b25f-3f5d12ca063d] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:46.809224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:46.809224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:46.809224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:46.809224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:46.809224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:46.809224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:46.828898 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] HTTP exception thrown: Instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d could not be found. Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Request method failure captured: Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d HTTP/1.1 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG18ytq1Xn7fVvBnPar9dRqRwql95jbSEas7fi02QXZWnnYtbSeifMR9NF-MDvD6hNrZwfNuyu5e3FPeX4W1yWfWH-I2MdpSq68ahcv9_or5Q_uIl72WYsr6ACtizib41OAhNIbW5vyAisQOIX08hoKbtIi3cIXH1nz3yKS74TVErr8 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 2b1bbb56aa2f44f3b5a50f0cbecfd160 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestVolumeBackupRestore-510720605 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2b1bbb56aa2f44f3b5a50f0cbecfd160"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2b1bbb56aa2f44f3b5a50f0cbecfd160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2b1bbb56aa2f44f3b5a50f0cbecfd160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2b1bbb56aa2f44f3b5a50f0cbecfd160", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestVolumeBackupRestore-510720605 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 2b1bbb56aa2f44f3b5a50f0cbecfd160 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestVolumeBackupRestore-510720605 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestVolumeBackupRestore-510720605-project Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 077d4f0b50b749698c9878b007070a95 Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestVolumeBackupRestore-510720605-project Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d could not be found. Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'd4b52c87-5cab-4f2b-b25f-3f5d12ca063d'} Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d could not be found. Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d could not be found. Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:02:46.830650 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:02:46.835316 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:46.835316 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:02:46.835316 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:02:46.835316 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:02:46.835316 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:02:46.835316 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d could not be found. Sep 10 11:02:46.835316 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:02:46.835316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Returning 404 to user: Instance d4b52c87-5cab-4f2b-b25f-3f5d12ca063d could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:02:46.835316 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-132fe4f7-9bfa-422a-8073-c75307d40b74 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d" status: 404 len: 111 microversion: 2.1 time: 0.066825 Sep 10 11:02:46.835316 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1120/4578] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:46 2022] GET /compute/v2.1/servers/d4b52c87-5cab-4f2b-b25f-3f5d12ca063d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:02:47.084186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-adfe95a5-0785-4dbe-80d4-d5166204de75 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] Calling method '.version_select at 0x7efcaebc0e50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:47.113518 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-adfe95a5-0785-4dbe-80d4-d5166204de75 tempest-TestVolumeBackupRestore-510720605 tempest-TestVolumeBackupRestore-510720605-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-343833404" status: 202 len: 0 microversion: 2.1 time: 0.038593 Sep 10 11:02:47.117227 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3459/4579] 10.222.0.20 () {58 vars in 1266 bytes} [Sat Sep 10 11:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-343833404 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:02:47.662233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-863a89da-b086-4635-9678-6dbe65af0c93 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:47.662862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-863a89da-b086-4635-9678-6dbe65af0c93 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:47.676165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:47.677913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:47.698509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-863a89da-b086-4635-9678-6dbe65af0c93 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:47.699244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-863a89da-b086-4635-9678-6dbe65af0c93 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:47.699887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-863a89da-b086-4635-9678-6dbe65af0c93 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:47.700817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-863a89da-b086-4635-9678-6dbe65af0c93 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:47.701709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-863a89da-b086-4635-9678-6dbe65af0c93 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:47.702497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-863a89da-b086-4635-9678-6dbe65af0c93 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:47.934896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-863a89da-b086-4635-9678-6dbe65af0c93 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:47.957589 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-863a89da-b086-4635-9678-6dbe65af0c93 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1320 microversion: 2.1 time: 0.298869 Sep 10 11:02:47.959110 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1121/4580] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:47 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1320 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:48.984298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e4f46b20-1bc1-473a-af25-7a748526db98 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:48.985655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e4f46b20-1bc1-473a-af25-7a748526db98 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:48.991287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=10 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:49.007974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4f46b20-1bc1-473a-af25-7a748526db98 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:49.009660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4f46b20-1bc1-473a-af25-7a748526db98 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:49.010173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4f46b20-1bc1-473a-af25-7a748526db98 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:49.012094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4f46b20-1bc1-473a-af25-7a748526db98 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:49.012850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4f46b20-1bc1-473a-af25-7a748526db98 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:49.016682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4f46b20-1bc1-473a-af25-7a748526db98 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:49.115801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-fe1fe431-cbbd-41ec-9456-7c99accdc63a req-8fa61aa3-5305-4368-8804-b3dc4a6574b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc345de-8d35-493d-ab7e-dd97ad4d0275", "name": "network-vif-plugged", "status": "completed", "tag": "b0446e2a-58f9-4a57-932f-547bfe9d20b2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:49.138000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fe1fe431-cbbd-41ec-9456-7c99accdc63a req-8fa61aa3-5305-4368-8804-b3dc4a6574b0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:49.139448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fe1fe431-cbbd-41ec-9456-7c99accdc63a req-8fa61aa3-5305-4368-8804-b3dc4a6574b0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:49.143202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fe1fe431-cbbd-41ec-9456-7c99accdc63a req-8fa61aa3-5305-4368-8804-b3dc4a6574b0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:49.183269 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-fe1fe431-cbbd-41ec-9456-7c99accdc63a req-8fa61aa3-5305-4368-8804-b3dc4a6574b0 service nova] Creating event network-vif-plugged:b0446e2a-58f9-4a57-932f-547bfe9d20b2 for instance edc345de-8d35-493d-ab7e-dd97ad4d0275 on n-h2-856894-1 Sep 10 11:02:49.201010 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-fe1fe431-cbbd-41ec-9456-7c99accdc63a req-8fa61aa3-5305-4368-8804-b3dc4a6574b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088713 Sep 10 11:02:49.202410 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1122/4581] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:02:49.547018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e4f46b20-1bc1-473a-af25-7a748526db98 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:49.558241 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e4f46b20-1bc1-473a-af25-7a748526db98 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1320 microversion: 2.1 time: 0.579178 Sep 10 11:02:49.578529 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3460/4582] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:48 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1320 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:50.588859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5143462-71a2-4349-aaa4-4382733c2fbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:50.589634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a5143462-71a2-4349-aaa4-4382733c2fbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:50.599500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5143462-71a2-4349-aaa4-4382733c2fbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:50.599985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5143462-71a2-4349-aaa4-4382733c2fbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:50.601546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5143462-71a2-4349-aaa4-4382733c2fbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:50.602570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5143462-71a2-4349-aaa4-4382733c2fbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:50.603378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5143462-71a2-4349-aaa4-4382733c2fbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:50.604237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5143462-71a2-4349-aaa4-4382733c2fbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:50.892653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a5143462-71a2-4349-aaa4-4382733c2fbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:50.900521 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a5143462-71a2-4349-aaa4-4382733c2fbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1320 microversion: 2.1 time: 0.316103 Sep 10 11:02:50.909420 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1123/4583] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:50 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:51.926057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8dc01726-a574-4346-81d1-9a99d696c847 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:51.926760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8dc01726-a574-4346-81d1-9a99d696c847 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:51.937736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dc01726-a574-4346-81d1-9a99d696c847 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:51.938303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dc01726-a574-4346-81d1-9a99d696c847 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:51.938650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dc01726-a574-4346-81d1-9a99d696c847 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:51.945591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dc01726-a574-4346-81d1-9a99d696c847 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:51.946146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dc01726-a574-4346-81d1-9a99d696c847 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:51.946563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8dc01726-a574-4346-81d1-9a99d696c847 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:52.212193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8dc01726-a574-4346-81d1-9a99d696c847 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:52.225041 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8dc01726-a574-4346-81d1-9a99d696c847 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1502 microversion: 2.1 time: 0.303875 Sep 10 11:02:52.226708 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3461/4584] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:51 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:52.253189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-593da0ed-5868-4fcd-b871-89acdbbab745 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:52.254662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-593da0ed-5868-4fcd-b871-89acdbbab745 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:52.264008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593da0ed-5868-4fcd-b871-89acdbbab745 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:52.264738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593da0ed-5868-4fcd-b871-89acdbbab745 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:52.266284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593da0ed-5868-4fcd-b871-89acdbbab745 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:52.267318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593da0ed-5868-4fcd-b871-89acdbbab745 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:52.268123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593da0ed-5868-4fcd-b871-89acdbbab745 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:52.268910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593da0ed-5868-4fcd-b871-89acdbbab745 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:52.519859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-593da0ed-5868-4fcd-b871-89acdbbab745 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:52.532313 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-593da0ed-5868-4fcd-b871-89acdbbab745 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1502 microversion: 2.1 time: 0.284104 Sep 10 11:02:52.539855 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1124/4585] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:52 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1502 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:52.558195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b44d6d7c-45dc-4db3-b723-67bec1c3ada7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:52.558774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b44d6d7c-45dc-4db3-b723-67bec1c3ada7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:52.565549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44d6d7c-45dc-4db3-b723-67bec1c3ada7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:52.566426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44d6d7c-45dc-4db3-b723-67bec1c3ada7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:52.567070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44d6d7c-45dc-4db3-b723-67bec1c3ada7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:52.568119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44d6d7c-45dc-4db3-b723-67bec1c3ada7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:52.568808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44d6d7c-45dc-4db3-b723-67bec1c3ada7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:52.569334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44d6d7c-45dc-4db3-b723-67bec1c3ada7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:52.608365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b44d6d7c-45dc-4db3-b723-67bec1c3ada7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:02:52.759281 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b44d6d7c-45dc-4db3-b723-67bec1c3ada7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 204 len: 0 microversion: 2.1 time: 0.204962 Sep 10 11:02:52.759897 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3462/4586] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:02:52 2022] DELETE /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:02:52.770886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-47aa83c3-397a-4216-ad0d-35b5872fc1da tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:52.771523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-47aa83c3-397a-4216-ad0d-35b5872fc1da tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:52.784733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aa83c3-397a-4216-ad0d-35b5872fc1da tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:52.785259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aa83c3-397a-4216-ad0d-35b5872fc1da tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:52.785702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aa83c3-397a-4216-ad0d-35b5872fc1da tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:52.786416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aa83c3-397a-4216-ad0d-35b5872fc1da tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:52.786872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aa83c3-397a-4216-ad0d-35b5872fc1da tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:52.793161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47aa83c3-397a-4216-ad0d-35b5872fc1da tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:53.005924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-47aa83c3-397a-4216-ad0d-35b5872fc1da tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:53.014306 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-47aa83c3-397a-4216-ad0d-35b5872fc1da tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1508 microversion: 2.1 time: 0.249565 Sep 10 11:02:53.014931 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1125/4587] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:52 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:54.050315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a014ca94-d379-4714-a8b1-b45768e503aa tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:54.050796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a014ca94-d379-4714-a8b1-b45768e503aa tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:54.061364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a014ca94-d379-4714-a8b1-b45768e503aa tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:54.062857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a014ca94-d379-4714-a8b1-b45768e503aa tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:54.063854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a014ca94-d379-4714-a8b1-b45768e503aa tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:54.064789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a014ca94-d379-4714-a8b1-b45768e503aa tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:54.065547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a014ca94-d379-4714-a8b1-b45768e503aa tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:54.066844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a014ca94-d379-4714-a8b1-b45768e503aa tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:54.227895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a014ca94-d379-4714-a8b1-b45768e503aa tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:54.241616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a014ca94-d379-4714-a8b1-b45768e503aa tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1508 microversion: 2.1 time: 0.205739 Sep 10 11:02:54.241616 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3463/4588] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:54 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:55.133023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-a09edde2-fa8f-4d8d-969b-4013fd06a0fd req-6057aa54-198c-4b33-b923-3ca6fddcd207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc345de-8d35-493d-ab7e-dd97ad4d0275", "name": "network-vif-deleted", "tag": "b0446e2a-58f9-4a57-932f-547bfe9d20b2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:55.181542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a09edde2-fa8f-4d8d-969b-4013fd06a0fd req-6057aa54-198c-4b33-b923-3ca6fddcd207 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:55.184857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a09edde2-fa8f-4d8d-969b-4013fd06a0fd req-6057aa54-198c-4b33-b923-3ca6fddcd207 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:55.185542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a09edde2-fa8f-4d8d-969b-4013fd06a0fd req-6057aa54-198c-4b33-b923-3ca6fddcd207 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:55.216662 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-a09edde2-fa8f-4d8d-969b-4013fd06a0fd req-6057aa54-198c-4b33-b923-3ca6fddcd207 service nova] Creating event network-vif-deleted:b0446e2a-58f9-4a57-932f-547bfe9d20b2 for instance edc345de-8d35-493d-ab7e-dd97ad4d0275 on n-h2-856894-1 Sep 10 11:02:55.224497 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-a09edde2-fa8f-4d8d-969b-4013fd06a0fd req-6057aa54-198c-4b33-b923-3ca6fddcd207 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095413 Sep 10 11:02:55.232049 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1126/4589] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:55.266466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:55.267134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:55.288628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:55.289713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:55.290418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:55.291392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:55.292481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:55.293100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:55.401428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:55.401968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:55.404657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:55.405286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lazy-loading 'fault' on Instance uuid edc345de-8d35-493d-ab7e-dd97ad4d0275 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:02:55.492867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:55.503354 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef908c77-df14-45e7-a575-1786aede5de7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 200 len: 1310 microversion: 2.1 time: 0.242992 Sep 10 11:02:55.519851 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3464/4590] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:55 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 1310 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:02:56.528157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:56.529903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:56.541532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:56.542680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:56.543576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:56.544515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:56.558550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:56.559007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:56.576901 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 HTTP/1.1 Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'edc345de-8d35-493d-ab7e-dd97ad4d0275'} Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:02:56.579405 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:02:56.584816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:02:56.584816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:02:56.584816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:02:56.584816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:02:56.584816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:02:56.584816 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:02:56.584816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:02:56.584816 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4070a3b6-0691-4fda-9d93-e3cd847567f5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 404 len: 111 microversion: 2.1 time: 0.058040 Sep 10 11:02:56.584816 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1127/4591] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:56 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:02:56.602710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb51406a-e904-46b7-ae21-c1ec8e7fe6d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'create', calling method: .version_select at 0x7efcae2e68b0>, body: {"keypair": {"name": "tempest-key-2027186660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMvIvqa48H90fMtV8jjhZYUZvUj3b1PXx0nO8JJ3QQP3eb6EEH0TRn50RsuDAm0TtvWb7ga49Fl113qRM4KWd89kVtv9qv+JYD+5vKCPlRwo+LTNf+enVMLgM5GiltD2A=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:56.644260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-bb51406a-e904-46b7-ae21-c1ec8e7fe6d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for project 8409664137af4c74a00590b962f14d64. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:02:56.651218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-bb51406a-e904-46b7-ae21-c1ec8e7fe6d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for user 1fd01ead2408487dbe51fd732c209981 and project 8409664137af4c74a00590b962f14d64. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:02:56.705611 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb51406a-e904-46b7-ae21-c1ec8e7fe6d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.110751 Sep 10 11:02:56.723573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2fd28473-beaf-4b23-83e5-c1d7d15e0268 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '.version_select at 0x7efcaec2cdc0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:56.727651 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3465/4592] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:02:56 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:56.729310 n-d-856894-1 devstack@n-api.service[128787]: WARNING oslo_db.sqlalchemy.utils [None req-2fd28473-beaf-4b23-83e5-c1d7d15e0268 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 11:02:56.736858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:02:56.739665 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2fd28473-beaf-4b23-83e5-c1d7d15e0268 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.022026 Sep 10 11:02:56.745913 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1128/4593] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 11:02:56 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:02:56.909599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1329625359", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "key_name": "tempest-key-2027186660", "networks": [{"uuid": "63c65db1-231a-4e94-b304-7943deb77e20"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:02:56.978217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] validate_networks() for [('63c65db1-231a-4e94-b304-7943deb77e20', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:02:57.453895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:02:57.454558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:02:57.455121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:02:57.455675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:02:57.456282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:02:57.467542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:57.468031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:57.469299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:57.470216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:57.470964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:57.472216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:57.492676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:02:57.499883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for user 1fd01ead2408487dbe51fd732c209981 and project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:02:57.517709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:02:57.520325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:02:57.623873 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b5f94dbf-d937-4ef3-82e6-004d51abb514 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719620 Sep 10 11:02:57.627830 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3466/4594] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:02:57.642310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-56855a94-80d7-464a-b4be-783f3cb10d9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:57.642945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-56855a94-80d7-464a-b4be-783f3cb10d9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:57.830882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-56855a94-80d7-464a-b4be-783f3cb10d9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:57.843290 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-56855a94-80d7-464a-b4be-783f3cb10d9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1229 microversion: 2.1 time: 0.207532 Sep 10 11:02:57.858772 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1129/4595] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:57 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1229 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:02:58.891683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef98b779-37f9-4634-aebb-0ba3c6772ef4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:02:58.898432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef98b779-37f9-4634-aebb-0ba3c6772ef4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:02:58.936966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef98b779-37f9-4634-aebb-0ba3c6772ef4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:58.938613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef98b779-37f9-4634-aebb-0ba3c6772ef4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:58.940889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef98b779-37f9-4634-aebb-0ba3c6772ef4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:58.942061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef98b779-37f9-4634-aebb-0ba3c6772ef4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:02:58.942943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef98b779-37f9-4634-aebb-0ba3c6772ef4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:02:58.944171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef98b779-37f9-4634-aebb-0ba3c6772ef4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:02:59.159527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef98b779-37f9-4634-aebb-0ba3c6772ef4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:02:59.171938 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef98b779-37f9-4634-aebb-0ba3c6772ef4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1281 microversion: 2.1 time: 0.307767 Sep 10 11:02:59.173237 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3467/4596] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:02:58 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1281 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:00.200031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7d66aa9e-9240-42a5-91f2-d2b158e7b051 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:00.200901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7d66aa9e-9240-42a5-91f2-d2b158e7b051 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:00.224445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d66aa9e-9240-42a5-91f2-d2b158e7b051 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:00.226645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d66aa9e-9240-42a5-91f2-d2b158e7b051 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:00.229369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d66aa9e-9240-42a5-91f2-d2b158e7b051 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:00.230402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d66aa9e-9240-42a5-91f2-d2b158e7b051 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:00.231978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d66aa9e-9240-42a5-91f2-d2b158e7b051 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:00.234123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d66aa9e-9240-42a5-91f2-d2b158e7b051 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:00.369929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7d66aa9e-9240-42a5-91f2-d2b158e7b051 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:00.383718 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7d66aa9e-9240-42a5-91f2-d2b158e7b051 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1287 microversion: 2.1 time: 0.187396 Sep 10 11:03:00.385509 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1130/4597] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:00 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1287 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:01.412460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b4c78ea8-68ff-4c6e-bea4-96f9bfa8ef38 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:01.413334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b4c78ea8-68ff-4c6e-bea4-96f9bfa8ef38 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:01.430075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4c78ea8-68ff-4c6e-bea4-96f9bfa8ef38 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:01.430925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4c78ea8-68ff-4c6e-bea4-96f9bfa8ef38 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:01.431709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4c78ea8-68ff-4c6e-bea4-96f9bfa8ef38 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:01.434111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4c78ea8-68ff-4c6e-bea4-96f9bfa8ef38 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:01.434636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4c78ea8-68ff-4c6e-bea4-96f9bfa8ef38 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:01.435902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b4c78ea8-68ff-4c6e-bea4-96f9bfa8ef38 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:01.456826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:01.942847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b4c78ea8-68ff-4c6e-bea4-96f9bfa8ef38 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:01.952427 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b4c78ea8-68ff-4c6e-bea4-96f9bfa8ef38 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1329 microversion: 2.1 time: 0.546865 Sep 10 11:03:01.953809 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3468/4598] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:01 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1329 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:02.978383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-90b40b6e-3f05-423a-982d-aaef6b1ff718 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:02.980444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-90b40b6e-3f05-423a-982d-aaef6b1ff718 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:02.996637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b40b6e-3f05-423a-982d-aaef6b1ff718 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:02.999113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b40b6e-3f05-423a-982d-aaef6b1ff718 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:03.001033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b40b6e-3f05-423a-982d-aaef6b1ff718 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:03.002394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b40b6e-3f05-423a-982d-aaef6b1ff718 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:03.007474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b40b6e-3f05-423a-982d-aaef6b1ff718 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:03.008343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90b40b6e-3f05-423a-982d-aaef6b1ff718 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:03.018770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d4111141-559d-41bb-95a0-0eeb8e2faa60 req-0a2e2299-e98e-4cea-9899-681ae0bf258a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "856c1738-7182-4a08-ab36-a9bd58a64e8c", "tag": "08853a85-8912-410c-880b-359b7a72627c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:03.043712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d4111141-559d-41bb-95a0-0eeb8e2faa60 req-0a2e2299-e98e-4cea-9899-681ae0bf258a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:03.046025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d4111141-559d-41bb-95a0-0eeb8e2faa60 req-0a2e2299-e98e-4cea-9899-681ae0bf258a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:03.048148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d4111141-559d-41bb-95a0-0eeb8e2faa60 req-0a2e2299-e98e-4cea-9899-681ae0bf258a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:03.080095 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d4111141-559d-41bb-95a0-0eeb8e2faa60 req-0a2e2299-e98e-4cea-9899-681ae0bf258a service nova] Creating event network-changed:08853a85-8912-410c-880b-359b7a72627c for instance 856c1738-7182-4a08-ab36-a9bd58a64e8c on n-h2-856894-1 Sep 10 11:03:03.091779 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d4111141-559d-41bb-95a0-0eeb8e2faa60 req-0a2e2299-e98e-4cea-9899-681ae0bf258a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079772 Sep 10 11:03:03.094129 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3469/4599] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:03:03.364021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-90b40b6e-3f05-423a-982d-aaef6b1ff718 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:03.376345 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-90b40b6e-3f05-423a-982d-aaef6b1ff718 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1329 microversion: 2.1 time: 0.403363 Sep 10 11:03:03.379230 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1131/4600] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:02 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1329 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:04.406474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5a51651-cc73-48a1-83ac-f88c231f8acc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:04.407186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a5a51651-cc73-48a1-83ac-f88c231f8acc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:04.424484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5a51651-cc73-48a1-83ac-f88c231f8acc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:04.425119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5a51651-cc73-48a1-83ac-f88c231f8acc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:04.425811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5a51651-cc73-48a1-83ac-f88c231f8acc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:04.426800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5a51651-cc73-48a1-83ac-f88c231f8acc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:04.427466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5a51651-cc73-48a1-83ac-f88c231f8acc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:04.428203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5a51651-cc73-48a1-83ac-f88c231f8acc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:04.756999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a5a51651-cc73-48a1-83ac-f88c231f8acc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:04.764260 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a5a51651-cc73-48a1-83ac-f88c231f8acc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1329 microversion: 2.1 time: 0.366178 Sep 10 11:03:04.770113 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1132/4601] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:04 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1329 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:04.812443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] Calling method '.version_select at 0x7efcb2bfc820>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:04.814394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:04.815281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:04.815725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:04.833885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:04.834572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:04.835300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:04.851686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:04.852323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:04.852772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:04.860797 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f4f265d-b4e7-4350-8487-7ec11832261e tempest-PortsAdminExtendedAttrsTestJSON-1953878679 tempest-PortsAdminExtendedAttrsTestJSON-1953878679-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.733819 Sep 10 11:03:04.867762 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3470/4602] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 11:03:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:03:05.812672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-538b7bc7-300d-4c0d-857b-796350627fa8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:05.814349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-538b7bc7-300d-4c0d-857b-796350627fa8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:05.837180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-538b7bc7-300d-4c0d-857b-796350627fa8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:05.840328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-538b7bc7-300d-4c0d-857b-796350627fa8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:05.842268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-538b7bc7-300d-4c0d-857b-796350627fa8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:05.844806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-538b7bc7-300d-4c0d-857b-796350627fa8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:05.845984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-538b7bc7-300d-4c0d-857b-796350627fa8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:05.847170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-538b7bc7-300d-4c0d-857b-796350627fa8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:06.094747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-538b7bc7-300d-4c0d-857b-796350627fa8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:06.103511 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-538b7bc7-300d-4c0d-857b-796350627fa8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1329 microversion: 2.1 time: 0.303635 Sep 10 11:03:06.106342 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1133/4603] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:05 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1329 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:07.051983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b451e791-5ef1-47a6-9fb2-99aa160e6953 req-c30598f5-9380-452a-b685-b74d59ec9565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "856c1738-7182-4a08-ab36-a9bd58a64e8c", "name": "network-vif-plugged", "status": "completed", "tag": "08853a85-8912-410c-880b-359b7a72627c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:07.082601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b451e791-5ef1-47a6-9fb2-99aa160e6953 req-c30598f5-9380-452a-b685-b74d59ec9565 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:07.083205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b451e791-5ef1-47a6-9fb2-99aa160e6953 req-c30598f5-9380-452a-b685-b74d59ec9565 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:07.083817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b451e791-5ef1-47a6-9fb2-99aa160e6953 req-c30598f5-9380-452a-b685-b74d59ec9565 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:07.106351 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b451e791-5ef1-47a6-9fb2-99aa160e6953 req-c30598f5-9380-452a-b685-b74d59ec9565 service nova] Creating event network-vif-plugged:08853a85-8912-410c-880b-359b7a72627c for instance 856c1738-7182-4a08-ab36-a9bd58a64e8c on n-h2-856894-1 Sep 10 11:03:07.123730 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b451e791-5ef1-47a6-9fb2-99aa160e6953 req-c30598f5-9380-452a-b685-b74d59ec9565 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079034 Sep 10 11:03:07.124828 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3471/4604] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:03:07.129359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e46c9210-f9bb-4863-9c29-50f61e033c7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:07.130081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e46c9210-f9bb-4863-9c29-50f61e033c7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:07.142043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e46c9210-f9bb-4863-9c29-50f61e033c7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:07.142824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e46c9210-f9bb-4863-9c29-50f61e033c7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:07.143524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e46c9210-f9bb-4863-9c29-50f61e033c7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:07.144442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e46c9210-f9bb-4863-9c29-50f61e033c7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:07.145126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e46c9210-f9bb-4863-9c29-50f61e033c7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:07.145783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e46c9210-f9bb-4863-9c29-50f61e033c7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:07.176124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:07.836763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:07.890492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e46c9210-f9bb-4863-9c29-50f61e033c7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:07.903260 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e46c9210-f9bb-4863-9c29-50f61e033c7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1329 microversion: 2.1 time: 0.778950 Sep 10 11:03:07.904290 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1134/4605] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:07 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1329 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:08.929099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b3e1c97-4afc-44dd-b8f1-0589a31a0fe9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:08.930690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1b3e1c97-4afc-44dd-b8f1-0589a31a0fe9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:08.950346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:08.955111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=10 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:08.978176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b3e1c97-4afc-44dd-b8f1-0589a31a0fe9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:08.982344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b3e1c97-4afc-44dd-b8f1-0589a31a0fe9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:08.984856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b3e1c97-4afc-44dd-b8f1-0589a31a0fe9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:08.986258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b3e1c97-4afc-44dd-b8f1-0589a31a0fe9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:08.988625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b3e1c97-4afc-44dd-b8f1-0589a31a0fe9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:09.005059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b3e1c97-4afc-44dd-b8f1-0589a31a0fe9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:09.472373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1b3e1c97-4afc-44dd-b8f1-0589a31a0fe9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:09.483966 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b3e1c97-4afc-44dd-b8f1-0589a31a0fe9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1329 microversion: 2.1 time: 0.559411 Sep 10 11:03:09.488392 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3472/4606] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:08 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1329 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:10.511948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4388905-3060-418f-aaa3-bae9bc697b24 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:10.513524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b4388905-3060-418f-aaa3-bae9bc697b24 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:10.529485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4388905-3060-418f-aaa3-bae9bc697b24 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:10.530950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4388905-3060-418f-aaa3-bae9bc697b24 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:10.531634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4388905-3060-418f-aaa3-bae9bc697b24 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:10.533050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4388905-3060-418f-aaa3-bae9bc697b24 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:10.534105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4388905-3060-418f-aaa3-bae9bc697b24 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:10.536926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4388905-3060-418f-aaa3-bae9bc697b24 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:10.869494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b4388905-3060-418f-aaa3-bae9bc697b24 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:10.883989 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b4388905-3060-418f-aaa3-bae9bc697b24 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1510 microversion: 2.1 time: 0.377841 Sep 10 11:03:10.884611 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1135/4607] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:10 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1510 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:10.914778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6eb12970-8ba2-438d-a0e1-7822d3cc2022 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:10.915512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6eb12970-8ba2-438d-a0e1-7822d3cc2022 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:10.926788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:10.931049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb12970-8ba2-438d-a0e1-7822d3cc2022 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:10.931580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb12970-8ba2-438d-a0e1-7822d3cc2022 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:10.934390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb12970-8ba2-438d-a0e1-7822d3cc2022 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:10.935201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb12970-8ba2-438d-a0e1-7822d3cc2022 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:10.935647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb12970-8ba2-438d-a0e1-7822d3cc2022 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:10.939583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb12970-8ba2-438d-a0e1-7822d3cc2022 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:11.253299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6eb12970-8ba2-438d-a0e1-7822d3cc2022 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:11.267866 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6eb12970-8ba2-438d-a0e1-7822d3cc2022 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1510 microversion: 2.1 time: 0.357820 Sep 10 11:03:11.272281 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3473/4608] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:10 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1510 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:11.295247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-43f7b5a8-ffac-4f50-b780-b996bc39c036 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:11.296654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-43f7b5a8-ffac-4f50-b780-b996bc39c036 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:11.309505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43f7b5a8-ffac-4f50-b780-b996bc39c036 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:11.310381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43f7b5a8-ffac-4f50-b780-b996bc39c036 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:11.311072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43f7b5a8-ffac-4f50-b780-b996bc39c036 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:11.312968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43f7b5a8-ffac-4f50-b780-b996bc39c036 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:11.313685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43f7b5a8-ffac-4f50-b780-b996bc39c036 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:11.314406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43f7b5a8-ffac-4f50-b780-b996bc39c036 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:11.346706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-43f7b5a8-ffac-4f50-b780-b996bc39c036 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:03:11.538227 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-43f7b5a8-ffac-4f50-b780-b996bc39c036 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 204 len: 0 microversion: 2.1 time: 0.245939 Sep 10 11:03:11.540715 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1136/4609] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:03:11 2022] DELETE /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:03:11.551561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1d6d85f2-0493-4e6d-9c63-a16f1857cc1e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:11.552485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1d6d85f2-0493-4e6d-9c63-a16f1857cc1e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:11.563980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d6d85f2-0493-4e6d-9c63-a16f1857cc1e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:11.567030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d6d85f2-0493-4e6d-9c63-a16f1857cc1e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:11.568038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d6d85f2-0493-4e6d-9c63-a16f1857cc1e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:11.568996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d6d85f2-0493-4e6d-9c63-a16f1857cc1e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:11.570005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d6d85f2-0493-4e6d-9c63-a16f1857cc1e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:11.571585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1d6d85f2-0493-4e6d-9c63-a16f1857cc1e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:11.750658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1d6d85f2-0493-4e6d-9c63-a16f1857cc1e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:11.790993 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1d6d85f2-0493-4e6d-9c63-a16f1857cc1e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1516 microversion: 2.1 time: 0.244794 Sep 10 11:03:11.802650 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3474/4610] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:11 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:12.817896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9a0a8998-9514-4452-9960-8260331a0eb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:12.818627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9a0a8998-9514-4452-9960-8260331a0eb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:12.834332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0a8998-9514-4452-9960-8260331a0eb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:12.834904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0a8998-9514-4452-9960-8260331a0eb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:12.835345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0a8998-9514-4452-9960-8260331a0eb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:12.839194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0a8998-9514-4452-9960-8260331a0eb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:12.849603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0a8998-9514-4452-9960-8260331a0eb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:12.851359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0a8998-9514-4452-9960-8260331a0eb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:14.208660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9a0a8998-9514-4452-9960-8260331a0eb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:14.251171 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9a0a8998-9514-4452-9960-8260331a0eb2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1516 microversion: 2.1 time: 1.437695 Sep 10 11:03:14.253979 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1137/4611] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:12 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1516 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:14.856205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-533ed30e-8b5f-4967-921a-0cb8ec1618c0 req-acff48fa-59a3-4f8d-96da-d2633e1f81f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "856c1738-7182-4a08-ab36-a9bd58a64e8c", "name": "network-vif-deleted", "tag": "08853a85-8912-410c-880b-359b7a72627c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:14.928651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-533ed30e-8b5f-4967-921a-0cb8ec1618c0 req-acff48fa-59a3-4f8d-96da-d2633e1f81f4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:14.929740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-533ed30e-8b5f-4967-921a-0cb8ec1618c0 req-acff48fa-59a3-4f8d-96da-d2633e1f81f4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:14.930485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-533ed30e-8b5f-4967-921a-0cb8ec1618c0 req-acff48fa-59a3-4f8d-96da-d2633e1f81f4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:14.948633 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-533ed30e-8b5f-4967-921a-0cb8ec1618c0 req-acff48fa-59a3-4f8d-96da-d2633e1f81f4 service nova] Creating event network-vif-deleted:08853a85-8912-410c-880b-359b7a72627c for instance 856c1738-7182-4a08-ab36-a9bd58a64e8c on n-h2-856894-1 Sep 10 11:03:14.956176 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-533ed30e-8b5f-4967-921a-0cb8ec1618c0 req-acff48fa-59a3-4f8d-96da-d2633e1f81f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104057 Sep 10 11:03:14.957038 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3475/4612] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:03:15.277703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:15.280021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:15.297833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:15.298624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:15.299219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:15.300570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:15.301252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:15.301831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:15.341999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:15.343318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:15.344075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:15.344688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lazy-loading 'fault' on Instance uuid 856c1738-7182-4a08-ab36-a9bd58a64e8c {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:03:15.847023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:15.862318 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-732cdd3b-ed14-46c4-8aa7-9311a0de5659 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 200 len: 1319 microversion: 2.1 time: 0.588678 Sep 10 11:03:15.864304 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1138/4613] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:15 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:16.906985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:16.908296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:16.919796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:16.926272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:16.929755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:16.931114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:16.932043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:16.932773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:16.953140 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c HTTP/1.1 Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '856c1738-7182-4a08-ab36-a9bd58a64e8c'} Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:03:16.957000 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:03:16.962635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:03:16.962635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:03:16.962635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:03:16.962635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:03:16.962635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:03:16.962635 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:03:16.964818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:03:16.966042 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f9e403f0-fdf5-4f4f-879e-beed87587859 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 404 len: 111 microversion: 2.1 time: 0.074041 Sep 10 11:03:16.980570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3002c630-a3e5-45ed-9b7b-6320567d62de tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '.version_select at 0x7efcaeb4aaf0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:16.986234 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3476/4614] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:16 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:03:17.011970 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3002c630-a3e5-45ed-9b7b-6320567d62de tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-key-2027186660" status: 202 len: 0 microversion: 2.1 time: 0.034905 Sep 10 11:03:17.025449 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1139/4615] 10.222.0.20 () {58 vars in 1209 bytes} [Sat Sep 10 11:03:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2027186660 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:03:17.289209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1855955951", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "63c65db1-231a-4e94-b304-7943deb77e20"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:17.384767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] validate_networks() for [('63c65db1-231a-4e94-b304-7943deb77e20', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:03:18.126968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:03:18.127586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:03:18.127868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:03:18.128288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:03:18.128721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:03:18.145461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:18.145968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:18.146424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:18.147333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:18.147763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:18.148193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:18.200226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:03:18.207036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for user 1fd01ead2408487dbe51fd732c209981 and project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:03:18.234027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:03:18.236697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:03:18.331337 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ae41329-a0d0-4e1e-9633-70df6cd8364a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047196 Sep 10 11:03:18.332607 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3477/4616] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:03:18.344543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5bdaf19-613a-4dfc-8e96-9886db438df2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:18.345420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a5bdaf19-613a-4dfc-8e96-9886db438df2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:18.480935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a5bdaf19-613a-4dfc-8e96-9886db438df2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:18.494242 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a5bdaf19-613a-4dfc-8e96-9886db438df2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1209 microversion: 2.1 time: 0.154554 Sep 10 11:03:18.494852 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1140/4617] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:18 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1209 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:19.519311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b57c398e-9624-456c-be6d-946832159432 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:19.520672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b57c398e-9624-456c-be6d-946832159432 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:19.532357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57c398e-9624-456c-be6d-946832159432 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:19.533452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57c398e-9624-456c-be6d-946832159432 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:19.534357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57c398e-9624-456c-be6d-946832159432 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:19.535900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57c398e-9624-456c-be6d-946832159432 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:19.546084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57c398e-9624-456c-be6d-946832159432 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:19.548247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b57c398e-9624-456c-be6d-946832159432 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:19.790444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b57c398e-9624-456c-be6d-946832159432 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:19.802454 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b57c398e-9624-456c-be6d-946832159432 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1205 microversion: 2.1 time: 0.289784 Sep 10 11:03:19.804895 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3478/4618] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:19 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1205 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:20.829879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c338a411-afbe-4d73-aa13-c1543ba03668 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:20.831218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c338a411-afbe-4d73-aa13-c1543ba03668 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:20.840064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c338a411-afbe-4d73-aa13-c1543ba03668 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:20.840848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c338a411-afbe-4d73-aa13-c1543ba03668 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:20.841500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c338a411-afbe-4d73-aa13-c1543ba03668 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:20.842377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c338a411-afbe-4d73-aa13-c1543ba03668 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:20.843607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c338a411-afbe-4d73-aa13-c1543ba03668 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:20.844194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c338a411-afbe-4d73-aa13-c1543ba03668 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:20.958585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c338a411-afbe-4d73-aa13-c1543ba03668 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:20.977629 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c338a411-afbe-4d73-aa13-c1543ba03668 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1267 microversion: 2.1 time: 0.152457 Sep 10 11:03:20.979477 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1141/4619] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:20 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:22.002031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cf054f4-69e0-4fc4-af17-42383cfce72d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:22.002660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6cf054f4-69e0-4fc4-af17-42383cfce72d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:22.016867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf054f4-69e0-4fc4-af17-42383cfce72d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:22.017671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf054f4-69e0-4fc4-af17-42383cfce72d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:22.018285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf054f4-69e0-4fc4-af17-42383cfce72d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:22.019234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf054f4-69e0-4fc4-af17-42383cfce72d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:22.019899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf054f4-69e0-4fc4-af17-42383cfce72d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:22.020614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf054f4-69e0-4fc4-af17-42383cfce72d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:22.474632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6cf054f4-69e0-4fc4-af17-42383cfce72d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:22.494367 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cf054f4-69e0-4fc4-af17-42383cfce72d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1309 microversion: 2.1 time: 0.496444 Sep 10 11:03:22.495024 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3479/4620] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:21 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:23.307339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2af36f4f-3dcc-409f-99ce-b7acad774899 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:23.308020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2af36f4f-3dcc-409f-99ce-b7acad774899 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:23.329626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2af36f4f-3dcc-409f-99ce-b7acad774899 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:23.330658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2af36f4f-3dcc-409f-99ce-b7acad774899 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:23.331399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2af36f4f-3dcc-409f-99ce-b7acad774899 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:23.332707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2af36f4f-3dcc-409f-99ce-b7acad774899 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:23.334035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2af36f4f-3dcc-409f-99ce-b7acad774899 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:23.334746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2af36f4f-3dcc-409f-99ce-b7acad774899 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:23.523345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa20957d-1be3-49fd-a8fa-9dec05e48f60 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:23.524887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa20957d-1be3-49fd-a8fa-9dec05e48f60 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:23.538174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa20957d-1be3-49fd-a8fa-9dec05e48f60 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:23.539382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa20957d-1be3-49fd-a8fa-9dec05e48f60 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:23.541339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa20957d-1be3-49fd-a8fa-9dec05e48f60 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:23.546472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa20957d-1be3-49fd-a8fa-9dec05e48f60 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:23.546974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa20957d-1be3-49fd-a8fa-9dec05e48f60 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:23.551388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa20957d-1be3-49fd-a8fa-9dec05e48f60 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:23.634099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-2af36f4f-3dcc-409f-99ce-b7acad774899 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lazy-loading 'services' on Instance uuid f98521ad-ebd1-473c-945f-70d80d31c1b7 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:03:23.965716 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2af36f4f-3dcc-409f-99ce-b7acad774899 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/os-volume_attachments/ddb69305-4d59-4cdb-a01a-474d92e0b970" status: 202 len: 0 microversion: 2.1 time: 0.662432 Sep 10 11:03:23.970295 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1142/4621] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:03:23 2022] DELETE /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/os-volume_attachments/ddb69305-4d59-4cdb-a01a-474d92e0b970 => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:03:24.022197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fa20957d-1be3-49fd-a8fa-9dec05e48f60 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:24.038342 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fa20957d-1be3-49fd-a8fa-9dec05e48f60 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1309 microversion: 2.1 time: 0.520599 Sep 10 11:03:24.039231 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3480/4622] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:23 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1309 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:25.068331 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-65d5fd5b-bde5-49d6-bb23-f20382853ebc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:25.069145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-65d5fd5b-bde5-49d6-bb23-f20382853ebc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:25.082634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65d5fd5b-bde5-49d6-bb23-f20382853ebc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:25.084307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65d5fd5b-bde5-49d6-bb23-f20382853ebc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:25.089711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65d5fd5b-bde5-49d6-bb23-f20382853ebc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:25.090700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65d5fd5b-bde5-49d6-bb23-f20382853ebc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:25.091537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65d5fd5b-bde5-49d6-bb23-f20382853ebc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:25.092174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65d5fd5b-bde5-49d6-bb23-f20382853ebc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:25.119545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e7d82134-aa58-42ea-84cd-e7bce3293781 req-d58c8732-2107-4fef-93b4-aa4c17bc99a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d201bfbd-7948-42d1-9c5e-0d788b7e52db", "tag": "f44f206f-353d-4d2c-b7ab-b82316d60616"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:25.149034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e7d82134-aa58-42ea-84cd-e7bce3293781 req-d58c8732-2107-4fef-93b4-aa4c17bc99a3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:25.153803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e7d82134-aa58-42ea-84cd-e7bce3293781 req-d58c8732-2107-4fef-93b4-aa4c17bc99a3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:25.161728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e7d82134-aa58-42ea-84cd-e7bce3293781 req-d58c8732-2107-4fef-93b4-aa4c17bc99a3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:25.193389 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e7d82134-aa58-42ea-84cd-e7bce3293781 req-d58c8732-2107-4fef-93b4-aa4c17bc99a3 service nova] Creating event network-changed:f44f206f-353d-4d2c-b7ab-b82316d60616 for instance d201bfbd-7948-42d1-9c5e-0d788b7e52db on n-h2-856894-1 Sep 10 11:03:25.220898 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e7d82134-aa58-42ea-84cd-e7bce3293781 req-d58c8732-2107-4fef-93b4-aa4c17bc99a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105105 Sep 10 11:03:25.227613 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3481/4623] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:03:25.643882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-65d5fd5b-bde5-49d6-bb23-f20382853ebc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:25.657329 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-65d5fd5b-bde5-49d6-bb23-f20382853ebc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1309 microversion: 2.1 time: 0.590404 Sep 10 11:03:25.658668 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1143/4624] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:25 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1309 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:26.703737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30f7c9b6-afff-4c83-acb4-df45126d17f4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:26.707342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30f7c9b6-afff-4c83-acb4-df45126d17f4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:26.725981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f7c9b6-afff-4c83-acb4-df45126d17f4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:26.727688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f7c9b6-afff-4c83-acb4-df45126d17f4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:26.740842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f7c9b6-afff-4c83-acb4-df45126d17f4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:26.741654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f7c9b6-afff-4c83-acb4-df45126d17f4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:26.750335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f7c9b6-afff-4c83-acb4-df45126d17f4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:26.751284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30f7c9b6-afff-4c83-acb4-df45126d17f4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:27.059896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:27.062774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:27.072389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:27.073232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:27.074016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:27.074888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:27.075500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:27.076188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:27.118052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-30f7c9b6-afff-4c83-acb4-df45126d17f4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:27.134115 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30f7c9b6-afff-4c83-acb4-df45126d17f4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1309 microversion: 2.1 time: 0.447722 Sep 10 11:03:27.157025 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3482/4625] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:26 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1309 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:27.448294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:27.475446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:27.480882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:27.483468 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ab7a0649-0351-4580-8428-55d60762452e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2950 microversion: 2.42 time: 0.427428 Sep 10 11:03:27.485481 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1144/4626] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:03:27 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2950 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:03:27.544900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4336f7b1-6f4a-4ae3-85a4-7d909b29c5c5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:27.547485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4336f7b1-6f4a-4ae3-85a4-7d909b29c5c5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:27.565655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4336f7b1-6f4a-4ae3-85a4-7d909b29c5c5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:27.566458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4336f7b1-6f4a-4ae3-85a4-7d909b29c5c5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:27.567077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4336f7b1-6f4a-4ae3-85a4-7d909b29c5c5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:27.569055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4336f7b1-6f4a-4ae3-85a4-7d909b29c5c5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:27.570046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4336f7b1-6f4a-4ae3-85a4-7d909b29c5c5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:27.570602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4336f7b1-6f4a-4ae3-85a4-7d909b29c5c5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:28.165340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e8ca2325-4bff-4d1d-a5c7-0a89480e1e4c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:28.166940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e8ca2325-4bff-4d1d-a5c7-0a89480e1e4c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:28.171072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:28.175596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:28.208796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8ca2325-4bff-4d1d-a5c7-0a89480e1e4c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:28.209353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8ca2325-4bff-4d1d-a5c7-0a89480e1e4c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:28.209990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8ca2325-4bff-4d1d-a5c7-0a89480e1e4c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:28.211753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8ca2325-4bff-4d1d-a5c7-0a89480e1e4c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:28.212382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8ca2325-4bff-4d1d-a5c7-0a89480e1e4c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:28.212970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8ca2325-4bff-4d1d-a5c7-0a89480e1e4c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:28.220583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:28.350051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4336f7b1-6f4a-4ae3-85a4-7d909b29c5c5 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.829205 Sep 10 11:03:28.352179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3483/4627] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Sep 10 11:03:27 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025/os-interface => generated 1832 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:03:28.486451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:28.599168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e8ca2325-4bff-4d1d-a5c7-0a89480e1e4c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:28.623077 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e8ca2325-4bff-4d1d-a5c7-0a89480e1e4c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1309 microversion: 2.1 time: 0.461766 Sep 10 11:03:28.626743 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1145/4628] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:28 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1309 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:28.974787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1628308950", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d666783a-a8fb-484c-a7f9-a0b4960e527c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e65712d8-efe4-477c-ab8b-0eb50d70eafc"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:29.068387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] validate_networks() for [('e65712d8-efe4-477c-ab8b-0eb50d70eafc', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:03:29.652200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-92b1e164-23e9-4ac6-bf20-0c1e3e0eb1a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:29.653428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-92b1e164-23e9-4ac6-bf20-0c1e3e0eb1a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:29.684778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92b1e164-23e9-4ac6-bf20-0c1e3e0eb1a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:29.685330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92b1e164-23e9-4ac6-bf20-0c1e3e0eb1a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:29.685774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92b1e164-23e9-4ac6-bf20-0c1e3e0eb1a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:29.686562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92b1e164-23e9-4ac6-bf20-0c1e3e0eb1a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:29.687052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92b1e164-23e9-4ac6-bf20-0c1e3e0eb1a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:29.687489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92b1e164-23e9-4ac6-bf20-0c1e3e0eb1a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:29.982144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:03:29.982620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:03:29.983093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:03:29.983514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:03:29.983934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:03:29.995990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:29.996490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:29.996945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:29.997704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:29.998173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:29.998644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:30.032401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-92b1e164-23e9-4ac6-bf20-0c1e3e0eb1a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:30.054918 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-92b1e164-23e9-4ac6-bf20-0c1e3e0eb1a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1309 microversion: 2.1 time: 0.408188 Sep 10 11:03:30.057754 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1146/4629] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:29 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1309 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:30.079037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:03:30.090286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for user 78004185356641b990a951dc95e6ca0c and project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:03:30.275666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:03:30.277742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d666783a-a8fb-484c-a7f9-a0b4960e527c',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:03:30.572705 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-003699c2-d388-4cc3-8e72-120c163d052a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.599964 Sep 10 11:03:30.577217 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3484/4630] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:03:30.585846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ce959f1e-eb5f-43eb-82f2-431337308125 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:30.586472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ce959f1e-eb5f-43eb-82f2-431337308125 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:30.688147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ce959f1e-eb5f-43eb-82f2-431337308125 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:30.695488 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ce959f1e-eb5f-43eb-82f2-431337308125 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1057 microversion: 2.1 time: 0.114162 Sep 10 11:03:30.696079 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1147/4631] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:30 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1057 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:31.085662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e3e6e08-6245-49a2-8c0d-0b172d1bbdbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:31.097517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e3e6e08-6245-49a2-8c0d-0b172d1bbdbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:31.135655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e3e6e08-6245-49a2-8c0d-0b172d1bbdbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:31.137561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e3e6e08-6245-49a2-8c0d-0b172d1bbdbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:31.138340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e3e6e08-6245-49a2-8c0d-0b172d1bbdbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:31.141622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e3e6e08-6245-49a2-8c0d-0b172d1bbdbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:31.144042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e3e6e08-6245-49a2-8c0d-0b172d1bbdbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:31.144718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e3e6e08-6245-49a2-8c0d-0b172d1bbdbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:31.551878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e3e6e08-6245-49a2-8c0d-0b172d1bbdbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:31.571422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=74 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:31.636008 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e3e6e08-6245-49a2-8c0d-0b172d1bbdbf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1309 microversion: 2.1 time: 0.557227 Sep 10 11:03:31.640487 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3485/4632] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:31 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1309 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:31.720825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8021021d-a980-4641-8ddd-67b97e310e62 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:31.722373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8021021d-a980-4641-8ddd-67b97e310e62 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:31.758757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8021021d-a980-4641-8ddd-67b97e310e62 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:31.763992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8021021d-a980-4641-8ddd-67b97e310e62 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:31.767578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8021021d-a980-4641-8ddd-67b97e310e62 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:31.774849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8021021d-a980-4641-8ddd-67b97e310e62 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:31.775698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8021021d-a980-4641-8ddd-67b97e310e62 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:31.777741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8021021d-a980-4641-8ddd-67b97e310e62 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:32.046786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8021021d-a980-4641-8ddd-67b97e310e62 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:32.058675 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8021021d-a980-4641-8ddd-67b97e310e62 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1099 microversion: 2.1 time: 0.342119 Sep 10 11:03:32.060031 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1148/4633] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:31 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1099 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:32.178345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b57f851-276a-4cb2-af98-56770983d583 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:32.187933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b57f851-276a-4cb2-af98-56770983d583 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:32.188743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b57f851-276a-4cb2-af98-56770983d583 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:32.189646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b57f851-276a-4cb2-af98-56770983d583 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:32.254151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b57f851-276a-4cb2-af98-56770983d583 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Going to try to stop instance {{(pid=128788) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 11:03:32.336635 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b57f851-276a-4cb2-af98-56770983d583 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/action" status: 202 len: 0 microversion: 2.1 time: 0.162052 Sep 10 11:03:32.340706 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3486/4634] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:03:32 2022] POST /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:03:32.349862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8d762a4c-30f4-496c-b0f0-887160796ecb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:32.350474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8d762a4c-30f4-496c-b0f0-887160796ecb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:32.361517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d762a4c-30f4-496c-b0f0-887160796ecb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:32.362015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d762a4c-30f4-496c-b0f0-887160796ecb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:32.362772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d762a4c-30f4-496c-b0f0-887160796ecb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:32.363502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d762a4c-30f4-496c-b0f0-887160796ecb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:32.366415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d762a4c-30f4-496c-b0f0-887160796ecb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:32.367247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d762a4c-30f4-496c-b0f0-887160796ecb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:32.569632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8d762a4c-30f4-496c-b0f0-887160796ecb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:32.579149 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8d762a4c-30f4-496c-b0f0-887160796ecb tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1678 microversion: 2.1 time: 0.234372 Sep 10 11:03:32.594010 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1149/4635] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:32 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:32.689882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26adfe71-3e91-46ed-817e-ac567a618e83 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:32.690975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26adfe71-3e91-46ed-817e-ac567a618e83 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:32.706656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26adfe71-3e91-46ed-817e-ac567a618e83 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:32.707412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26adfe71-3e91-46ed-817e-ac567a618e83 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:32.708069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26adfe71-3e91-46ed-817e-ac567a618e83 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:32.709842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26adfe71-3e91-46ed-817e-ac567a618e83 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:32.712132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26adfe71-3e91-46ed-817e-ac567a618e83 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:32.714010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26adfe71-3e91-46ed-817e-ac567a618e83 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:33.086041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-12a84924-6691-459e-b907-d3c8e50cb6f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:33.086728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-12a84924-6691-459e-b907-d3c8e50cb6f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:33.102757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12a84924-6691-459e-b907-d3c8e50cb6f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:33.103279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12a84924-6691-459e-b907-d3c8e50cb6f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:33.103769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12a84924-6691-459e-b907-d3c8e50cb6f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:33.104504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12a84924-6691-459e-b907-d3c8e50cb6f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:33.109376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12a84924-6691-459e-b907-d3c8e50cb6f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:33.109839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12a84924-6691-459e-b907-d3c8e50cb6f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:33.174188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-26adfe71-3e91-46ed-817e-ac567a618e83 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:33.194284 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26adfe71-3e91-46ed-817e-ac567a618e83 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1309 microversion: 2.1 time: 0.509268 Sep 10 11:03:33.197617 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3487/4636] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:32 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1309 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:33.272519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-12a84924-6691-459e-b907-d3c8e50cb6f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:33.281809 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-12a84924-6691-459e-b907-d3c8e50cb6f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1173 microversion: 2.1 time: 0.199748 Sep 10 11:03:33.285673 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1150/4637] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:33 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1173 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:33.608786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d32c2bb5-d486-474e-bc8f-705934af6e12 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:33.609505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d32c2bb5-d486-474e-bc8f-705934af6e12 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:33.621418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d32c2bb5-d486-474e-bc8f-705934af6e12 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:33.622785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d32c2bb5-d486-474e-bc8f-705934af6e12 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:33.624851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d32c2bb5-d486-474e-bc8f-705934af6e12 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:33.627094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d32c2bb5-d486-474e-bc8f-705934af6e12 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:33.627783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d32c2bb5-d486-474e-bc8f-705934af6e12 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:33.628729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d32c2bb5-d486-474e-bc8f-705934af6e12 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:33.848791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-de0b3196-40bd-46a5-89ea-b683582d7b25 req-6ee33a8d-07e9-4e8f-a891-43f0b6f02568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d201bfbd-7948-42d1-9c5e-0d788b7e52db", "name": "network-vif-plugged", "status": "completed", "tag": "f44f206f-353d-4d2c-b7ab-b82316d60616"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:33.871800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-de0b3196-40bd-46a5-89ea-b683582d7b25 req-6ee33a8d-07e9-4e8f-a891-43f0b6f02568 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:33.878532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-de0b3196-40bd-46a5-89ea-b683582d7b25 req-6ee33a8d-07e9-4e8f-a891-43f0b6f02568 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:33.880208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-de0b3196-40bd-46a5-89ea-b683582d7b25 req-6ee33a8d-07e9-4e8f-a891-43f0b6f02568 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:33.915213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d32c2bb5-d486-474e-bc8f-705934af6e12 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:33.916314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:33.931276 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d32c2bb5-d486-474e-bc8f-705934af6e12 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1678 microversion: 2.1 time: 0.327969 Sep 10 11:03:33.934059 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3488/4638] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:33 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1678 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:33.963918 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-de0b3196-40bd-46a5-89ea-b683582d7b25 req-6ee33a8d-07e9-4e8f-a891-43f0b6f02568 service nova] Creating event network-vif-plugged:f44f206f-353d-4d2c-b7ab-b82316d60616 for instance d201bfbd-7948-42d1-9c5e-0d788b7e52db on n-h2-856894-1 Sep 10 11:03:33.988349 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-de0b3196-40bd-46a5-89ea-b683582d7b25 req-6ee33a8d-07e9-4e8f-a891-43f0b6f02568 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143734 Sep 10 11:03:33.992800 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1151/4639] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:03:34.254487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c9a1b8e-4913-4d03-a4d1-c7e59c5fb479 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:34.256650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c9a1b8e-4913-4d03-a4d1-c7e59c5fb479 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:34.265476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c9a1b8e-4913-4d03-a4d1-c7e59c5fb479 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:34.266898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c9a1b8e-4913-4d03-a4d1-c7e59c5fb479 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:34.267950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c9a1b8e-4913-4d03-a4d1-c7e59c5fb479 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:34.268908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c9a1b8e-4913-4d03-a4d1-c7e59c5fb479 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:34.269613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c9a1b8e-4913-4d03-a4d1-c7e59c5fb479 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:34.270259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c9a1b8e-4913-4d03-a4d1-c7e59c5fb479 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:34.322376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b85ef164-1b33-43a7-9f25-3d134e925066 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:34.341941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b85ef164-1b33-43a7-9f25-3d134e925066 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:34.348593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b85ef164-1b33-43a7-9f25-3d134e925066 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:34.350471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b85ef164-1b33-43a7-9f25-3d134e925066 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:34.351235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b85ef164-1b33-43a7-9f25-3d134e925066 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:34.353412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b85ef164-1b33-43a7-9f25-3d134e925066 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:34.354770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b85ef164-1b33-43a7-9f25-3d134e925066 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:34.355699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b85ef164-1b33-43a7-9f25-3d134e925066 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:34.635601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3c9a1b8e-4913-4d03-a4d1-c7e59c5fb479 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:34.643568 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c9a1b8e-4913-4d03-a4d1-c7e59c5fb479 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1309 microversion: 2.1 time: 0.420109 Sep 10 11:03:34.644162 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3489/4640] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:34 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1309 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:34.807085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b85ef164-1b33-43a7-9f25-3d134e925066 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:34.816975 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b85ef164-1b33-43a7-9f25-3d134e925066 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1215 microversion: 2.1 time: 0.506452 Sep 10 11:03:34.819284 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1152/4641] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:34 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1215 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:34.959970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7930bd6-f97b-4f6d-9efa-91f1e1b3d1a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:34.960972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7930bd6-f97b-4f6d-9efa-91f1e1b3d1a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:34.968215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7930bd6-f97b-4f6d-9efa-91f1e1b3d1a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:34.969447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7930bd6-f97b-4f6d-9efa-91f1e1b3d1a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:34.972854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7930bd6-f97b-4f6d-9efa-91f1e1b3d1a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:34.976883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7930bd6-f97b-4f6d-9efa-91f1e1b3d1a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:34.977487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7930bd6-f97b-4f6d-9efa-91f1e1b3d1a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:34.978939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7930bd6-f97b-4f6d-9efa-91f1e1b3d1a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:35.342899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e7930bd6-f97b-4f6d-9efa-91f1e1b3d1a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:35.356246 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7930bd6-f97b-4f6d-9efa-91f1e1b3d1a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1678 microversion: 2.1 time: 0.395151 Sep 10 11:03:35.357301 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3490/4642] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:34 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1678 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:35.668842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d33caffb-fae9-4e29-bfde-fe7d1d33f57a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:35.669500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d33caffb-fae9-4e29-bfde-fe7d1d33f57a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:35.687957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d33caffb-fae9-4e29-bfde-fe7d1d33f57a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:35.688452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d33caffb-fae9-4e29-bfde-fe7d1d33f57a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:35.688893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d33caffb-fae9-4e29-bfde-fe7d1d33f57a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:35.689648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d33caffb-fae9-4e29-bfde-fe7d1d33f57a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:35.690103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d33caffb-fae9-4e29-bfde-fe7d1d33f57a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:35.690528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d33caffb-fae9-4e29-bfde-fe7d1d33f57a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:35.840403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3dd36c7-5e7e-4c11-8943-210752c65f53 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:35.841086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c3dd36c7-5e7e-4c11-8943-210752c65f53 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:35.852115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3dd36c7-5e7e-4c11-8943-210752c65f53 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:35.852627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3dd36c7-5e7e-4c11-8943-210752c65f53 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:35.853094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3dd36c7-5e7e-4c11-8943-210752c65f53 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:35.853813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3dd36c7-5e7e-4c11-8943-210752c65f53 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:35.854276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3dd36c7-5e7e-4c11-8943-210752c65f53 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:35.854711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3dd36c7-5e7e-4c11-8943-210752c65f53 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:36.416314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d33caffb-fae9-4e29-bfde-fe7d1d33f57a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:36.430411 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d33caffb-fae9-4e29-bfde-fe7d1d33f57a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1490 microversion: 2.1 time: 0.762666 Sep 10 11:03:36.431200 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1153/4643] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:35 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1490 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:36.463633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1cb09560-9a5e-44c6-8863-87bba037f1d5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:36.464495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1cb09560-9a5e-44c6-8863-87bba037f1d5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:36.483366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cb09560-9a5e-44c6-8863-87bba037f1d5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:36.484152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cb09560-9a5e-44c6-8863-87bba037f1d5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:36.484671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cb09560-9a5e-44c6-8863-87bba037f1d5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:36.485494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cb09560-9a5e-44c6-8863-87bba037f1d5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:36.488218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cb09560-9a5e-44c6-8863-87bba037f1d5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:36.488983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cb09560-9a5e-44c6-8863-87bba037f1d5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:36.556396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3dd36c7-5e7e-4c11-8943-210752c65f53 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:36.564624 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3dd36c7-5e7e-4c11-8943-210752c65f53 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1215 microversion: 2.1 time: 0.728066 Sep 10 11:03:36.571015 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3491/4644] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:35 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1215 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:36.667911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1855955951", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "63c65db1-231a-4e94-b304-7943deb77e20"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:36.754469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] validate_networks() for [('63c65db1-231a-4e94-b304-7943deb77e20', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:03:36.788789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1cb09560-9a5e-44c6-8863-87bba037f1d5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:36.800159 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1cb09560-9a5e-44c6-8863-87bba037f1d5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1678 microversion: 2.1 time: 0.364088 Sep 10 11:03:36.803037 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1154/4645] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:36 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1678 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:36.941520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-e31e7c3a-9be2-42d2-aaa7-c0d0a3a31c86 req-629e6122-a295-4cb2-8d3f-f12ab03d926b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58df1af1-ed9a-4a29-9da0-280b1cac022e", "tag": "60d28d3e-7bd3-42c9-9cd6-19c6ff57654f"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:36.963931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e31e7c3a-9be2-42d2-aaa7-c0d0a3a31c86 req-629e6122-a295-4cb2-8d3f-f12ab03d926b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:36.964675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e31e7c3a-9be2-42d2-aaa7-c0d0a3a31c86 req-629e6122-a295-4cb2-8d3f-f12ab03d926b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:36.966125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e31e7c3a-9be2-42d2-aaa7-c0d0a3a31c86 req-629e6122-a295-4cb2-8d3f-f12ab03d926b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:36.996148 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-e31e7c3a-9be2-42d2-aaa7-c0d0a3a31c86 req-629e6122-a295-4cb2-8d3f-f12ab03d926b service nova] Creating event network-changed:60d28d3e-7bd3-42c9-9cd6-19c6ff57654f for instance 58df1af1-ed9a-4a29-9da0-280b1cac022e on n-h2-856894-1 Sep 10 11:03:37.007656 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-e31e7c3a-9be2-42d2-aaa7-c0d0a3a31c86 req-629e6122-a295-4cb2-8d3f-f12ab03d926b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069995 Sep 10 11:03:37.010091 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1155/4646] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:03:37.597014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7a708593-faa7-427d-ae70-576ea8d95e4c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:37.598043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7a708593-faa7-427d-ae70-576ea8d95e4c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:37.602987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:03:37.604886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:03:37.608473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:03:37.611720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:03:37.613269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:03:37.615385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a708593-faa7-427d-ae70-576ea8d95e4c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:37.615896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a708593-faa7-427d-ae70-576ea8d95e4c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:37.616365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a708593-faa7-427d-ae70-576ea8d95e4c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:37.617144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a708593-faa7-427d-ae70-576ea8d95e4c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:37.617581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a708593-faa7-427d-ae70-576ea8d95e4c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:37.618006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7a708593-faa7-427d-ae70-576ea8d95e4c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:37.648799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:37.650297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:37.652153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:37.655768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:37.658305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:37.660133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:37.716249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:03:37.723260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for user 1fd01ead2408487dbe51fd732c209981 and project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:03:37.743523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:03:37.746139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:03:37.834077 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4090c8e8-f46e-45bd-9b5f-b0b9a887c424 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170592 Sep 10 11:03:37.834988 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3492/4647] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:03:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:03:37.847642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f43d35b-4078-4790-9432-2b45d4ed0a1e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:37.848272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f43d35b-4078-4790-9432-2b45d4ed0a1e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:37.872388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f43d35b-4078-4790-9432-2b45d4ed0a1e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:37.875108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f43d35b-4078-4790-9432-2b45d4ed0a1e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:37.875108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f43d35b-4078-4790-9432-2b45d4ed0a1e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:37.875867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f43d35b-4078-4790-9432-2b45d4ed0a1e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:37.877773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f43d35b-4078-4790-9432-2b45d4ed0a1e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:37.878320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f43d35b-4078-4790-9432-2b45d4ed0a1e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:38.318505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7a708593-faa7-427d-ae70-576ea8d95e4c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:38.327176 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7a708593-faa7-427d-ae70-576ea8d95e4c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1215 microversion: 2.1 time: 0.736089 Sep 10 11:03:38.333492 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1156/4648] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:37 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1215 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:38.344197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9b803222-da4f-4c01-aa18-3439a8220c1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:38.345452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9b803222-da4f-4c01-aa18-3439a8220c1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:38.412953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f43d35b-4078-4790-9432-2b45d4ed0a1e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:38.426687 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f43d35b-4078-4790-9432-2b45d4ed0a1e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1678 microversion: 2.1 time: 0.579796 Sep 10 11:03:38.427724 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3493/4649] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:37 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1678 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:38.474152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9b803222-da4f-4c01-aa18-3439a8220c1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:38.491296 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9b803222-da4f-4c01-aa18-3439a8220c1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1209 microversion: 2.1 time: 0.155626 Sep 10 11:03:38.494121 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1157/4650] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:38 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1209 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:39.359319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-120bb243-3bb7-42a4-b46f-544b5b3c8bb7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:39.359943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-120bb243-3bb7-42a4-b46f-544b5b3c8bb7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:39.367433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-120bb243-3bb7-42a4-b46f-544b5b3c8bb7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:39.374922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-120bb243-3bb7-42a4-b46f-544b5b3c8bb7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:39.375726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-120bb243-3bb7-42a4-b46f-544b5b3c8bb7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:39.376631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-120bb243-3bb7-42a4-b46f-544b5b3c8bb7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:39.377291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-120bb243-3bb7-42a4-b46f-544b5b3c8bb7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:39.378128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-120bb243-3bb7-42a4-b46f-544b5b3c8bb7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:39.452841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fe086ee7-5f6b-433b-84cf-2ad19561b475 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:39.453487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fe086ee7-5f6b-433b-84cf-2ad19561b475 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:39.462713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe086ee7-5f6b-433b-84cf-2ad19561b475 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:39.463438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe086ee7-5f6b-433b-84cf-2ad19561b475 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:39.464032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe086ee7-5f6b-433b-84cf-2ad19561b475 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:39.472364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe086ee7-5f6b-433b-84cf-2ad19561b475 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:39.473147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe086ee7-5f6b-433b-84cf-2ad19561b475 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:39.473741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe086ee7-5f6b-433b-84cf-2ad19561b475 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:39.988540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-120bb243-3bb7-42a4-b46f-544b5b3c8bb7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:40.006696 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-120bb243-3bb7-42a4-b46f-544b5b3c8bb7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1215 microversion: 2.1 time: 0.649744 Sep 10 11:03:40.021580 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3494/4651] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:39 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1215 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:40.028192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8cbb33c9-b19a-438e-900e-8f670dba0dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:40.029976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8cbb33c9-b19a-438e-900e-8f670dba0dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:40.036649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cbb33c9-b19a-438e-900e-8f670dba0dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:40.037239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cbb33c9-b19a-438e-900e-8f670dba0dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:40.037873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cbb33c9-b19a-438e-900e-8f670dba0dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:40.038577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cbb33c9-b19a-438e-900e-8f670dba0dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:40.039231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cbb33c9-b19a-438e-900e-8f670dba0dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:40.039824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8cbb33c9-b19a-438e-900e-8f670dba0dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:40.130449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8cbb33c9-b19a-438e-900e-8f670dba0dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:40.148399 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8cbb33c9-b19a-438e-900e-8f670dba0dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1267 microversion: 2.1 time: 0.125386 Sep 10 11:03:40.161096 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3495/4652] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:40 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1267 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:40.264729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe086ee7-5f6b-433b-84cf-2ad19561b475 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:40.272984 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fe086ee7-5f6b-433b-84cf-2ad19561b475 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1678 microversion: 2.1 time: 0.825069 Sep 10 11:03:40.273991 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1158/4653] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:39 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1678 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:41.036103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b43cf8be-1e13-418b-b0c8-6fd63571f57e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:41.036873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b43cf8be-1e13-418b-b0c8-6fd63571f57e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:41.039936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:41.053218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b43cf8be-1e13-418b-b0c8-6fd63571f57e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:41.054483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b43cf8be-1e13-418b-b0c8-6fd63571f57e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:41.055154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b43cf8be-1e13-418b-b0c8-6fd63571f57e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:41.056121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b43cf8be-1e13-418b-b0c8-6fd63571f57e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:41.056810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b43cf8be-1e13-418b-b0c8-6fd63571f57e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:41.057492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b43cf8be-1e13-418b-b0c8-6fd63571f57e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:41.175227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-305677a3-0a0a-4287-abf3-833b22d37f2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:41.175961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-305677a3-0a0a-4287-abf3-833b22d37f2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:41.189030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-305677a3-0a0a-4287-abf3-833b22d37f2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:41.189616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-305677a3-0a0a-4287-abf3-833b22d37f2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:41.190238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-305677a3-0a0a-4287-abf3-833b22d37f2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:41.190945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-305677a3-0a0a-4287-abf3-833b22d37f2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:41.191392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-305677a3-0a0a-4287-abf3-833b22d37f2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:41.194220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-305677a3-0a0a-4287-abf3-833b22d37f2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:41.838993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b43cf8be-1e13-418b-b0c8-6fd63571f57e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:41.853003 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b43cf8be-1e13-418b-b0c8-6fd63571f57e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1203 microversion: 2.1 time: 0.821717 Sep 10 11:03:41.869840 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3496/4654] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:41 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1203 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:41.876961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be0e068b-1a4d-4594-a8f5-6cb862006032 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:41.877579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-305677a3-0a0a-4287-abf3-833b22d37f2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:41.877997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be0e068b-1a4d-4594-a8f5-6cb862006032 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:41.884641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0e068b-1a4d-4594-a8f5-6cb862006032 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:41.885419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0e068b-1a4d-4594-a8f5-6cb862006032 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:41.887156 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-305677a3-0a0a-4287-abf3-833b22d37f2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1309 microversion: 2.1 time: 0.716315 Sep 10 11:03:41.890253 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1159/4655] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:41 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1309 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:41.900566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0e068b-1a4d-4594-a8f5-6cb862006032 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:41.901448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0e068b-1a4d-4594-a8f5-6cb862006032 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:41.901943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0e068b-1a4d-4594-a8f5-6cb862006032 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:41.902397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0e068b-1a4d-4594-a8f5-6cb862006032 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:42.189333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be0e068b-1a4d-4594-a8f5-6cb862006032 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:42.200880 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be0e068b-1a4d-4594-a8f5-6cb862006032 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1678 microversion: 2.1 time: 0.329744 Sep 10 11:03:42.213826 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3497/4656] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:41 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1678 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:42.392516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-da1edee4-b0de-4a30-9d17-b6a4aacf6646 req-5b6a927d-b6a7-4df2-a9b8-67f7ce5bf6ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff106c0-1678-49e4-80cf-4cbd06d7cf59", "tag": "b35734e2-362f-40d9-8fae-a19765c9240d"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:42.411467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-da1edee4-b0de-4a30-9d17-b6a4aacf6646 req-5b6a927d-b6a7-4df2-a9b8-67f7ce5bf6ab service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:42.415711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-da1edee4-b0de-4a30-9d17-b6a4aacf6646 req-5b6a927d-b6a7-4df2-a9b8-67f7ce5bf6ab service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:42.416232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-da1edee4-b0de-4a30-9d17-b6a4aacf6646 req-5b6a927d-b6a7-4df2-a9b8-67f7ce5bf6ab service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:42.442401 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-da1edee4-b0de-4a30-9d17-b6a4aacf6646 req-5b6a927d-b6a7-4df2-a9b8-67f7ce5bf6ab service nova] Creating event network-changed:b35734e2-362f-40d9-8fae-a19765c9240d for instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 on n-h2-856894-1 Sep 10 11:03:42.447764 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-da1edee4-b0de-4a30-9d17-b6a4aacf6646 req-5b6a927d-b6a7-4df2-a9b8-67f7ce5bf6ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058870 Sep 10 11:03:42.448773 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1160/4657] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:03:42.882870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5e572262-98b6-41a9-a055-6ee4d05466e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:42.883498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5e572262-98b6-41a9-a055-6ee4d05466e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:42.892634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e572262-98b6-41a9-a055-6ee4d05466e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:42.893045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e572262-98b6-41a9-a055-6ee4d05466e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:42.897750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e572262-98b6-41a9-a055-6ee4d05466e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:42.899289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e572262-98b6-41a9-a055-6ee4d05466e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:42.900271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e572262-98b6-41a9-a055-6ee4d05466e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:42.901449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e572262-98b6-41a9-a055-6ee4d05466e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:42.922852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-747cec4f-0977-4077-8e8b-c43eea2aa770 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:42.924277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-747cec4f-0977-4077-8e8b-c43eea2aa770 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:42.937173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747cec4f-0977-4077-8e8b-c43eea2aa770 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:42.937679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747cec4f-0977-4077-8e8b-c43eea2aa770 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:42.938107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747cec4f-0977-4077-8e8b-c43eea2aa770 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:42.938817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747cec4f-0977-4077-8e8b-c43eea2aa770 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:42.939272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747cec4f-0977-4077-8e8b-c43eea2aa770 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:42.939698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747cec4f-0977-4077-8e8b-c43eea2aa770 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:43.328873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-747cec4f-0977-4077-8e8b-c43eea2aa770 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:43.334355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e572262-98b6-41a9-a055-6ee4d05466e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:43.350347 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5e572262-98b6-41a9-a055-6ee4d05466e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1203 microversion: 2.1 time: 0.466449 Sep 10 11:03:43.351120 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3498/4658] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:42 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1203 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:43.351357 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-747cec4f-0977-4077-8e8b-c43eea2aa770 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1309 microversion: 2.1 time: 0.432482 Sep 10 11:03:43.353631 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1161/4659] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:42 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1309 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:43.363254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f901a259-9c54-477b-af8e-72460da1af24 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:43.363886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f901a259-9c54-477b-af8e-72460da1af24 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:43.375502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f901a259-9c54-477b-af8e-72460da1af24 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:43.376007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f901a259-9c54-477b-af8e-72460da1af24 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:43.376428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f901a259-9c54-477b-af8e-72460da1af24 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:43.377365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f901a259-9c54-477b-af8e-72460da1af24 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:43.377978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f901a259-9c54-477b-af8e-72460da1af24 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:43.378766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f901a259-9c54-477b-af8e-72460da1af24 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:43.546268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f901a259-9c54-477b-af8e-72460da1af24 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:43.555946 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f901a259-9c54-477b-af8e-72460da1af24 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1655 microversion: 2.1 time: 0.202660 Sep 10 11:03:43.563076 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3499/4660] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:43 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1655 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:43.579641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-68d229a0-6af8-41a9-9454-5126b5a8c15f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:43.587779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68d229a0-6af8-41a9-9454-5126b5a8c15f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:43.588540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68d229a0-6af8-41a9-9454-5126b5a8c15f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:43.589243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68d229a0-6af8-41a9-9454-5126b5a8c15f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:43.619332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-68d229a0-6af8-41a9-9454-5126b5a8c15f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Going to try to start instance {{(pid=128787) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 11:03:43.670715 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-68d229a0-6af8-41a9-9454-5126b5a8c15f tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/action" status: 202 len: 0 microversion: 2.1 time: 0.095202 Sep 10 11:03:43.671843 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1162/4661] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:03:43 2022] POST /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:03:43.680584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b461f479-3f0e-4c2a-80fc-0c73bb72bba8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:43.681518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b461f479-3f0e-4c2a-80fc-0c73bb72bba8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:43.688953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b461f479-3f0e-4c2a-80fc-0c73bb72bba8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:43.689809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b461f479-3f0e-4c2a-80fc-0c73bb72bba8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:43.690450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b461f479-3f0e-4c2a-80fc-0c73bb72bba8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:43.691381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b461f479-3f0e-4c2a-80fc-0c73bb72bba8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:43.692205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b461f479-3f0e-4c2a-80fc-0c73bb72bba8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:43.692788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b461f479-3f0e-4c2a-80fc-0c73bb72bba8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:43.865541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b461f479-3f0e-4c2a-80fc-0c73bb72bba8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:43.875135 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b461f479-3f0e-4c2a-80fc-0c73bb72bba8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1664 microversion: 2.1 time: 0.198684 Sep 10 11:03:43.875771 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3500/4662] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:43 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1664 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:44.378595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1cfd338e-a986-4629-97d8-f87df6c42831 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:44.379309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1cfd338e-a986-4629-97d8-f87df6c42831 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:44.384485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a5adc92-3e55-4a03-baba-434e45450031 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:44.385146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a5adc92-3e55-4a03-baba-434e45450031 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:44.390930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cfd338e-a986-4629-97d8-f87df6c42831 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:44.396255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cfd338e-a986-4629-97d8-f87df6c42831 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:44.397661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cfd338e-a986-4629-97d8-f87df6c42831 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:44.399368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cfd338e-a986-4629-97d8-f87df6c42831 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:44.399838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cfd338e-a986-4629-97d8-f87df6c42831 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:44.400251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1cfd338e-a986-4629-97d8-f87df6c42831 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:44.411337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a5adc92-3e55-4a03-baba-434e45450031 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:44.411839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a5adc92-3e55-4a03-baba-434e45450031 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:44.412317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a5adc92-3e55-4a03-baba-434e45450031 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:44.413044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a5adc92-3e55-4a03-baba-434e45450031 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:44.413530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a5adc92-3e55-4a03-baba-434e45450031 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:44.413960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a5adc92-3e55-4a03-baba-434e45450031 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:44.984206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a5adc92-3e55-4a03-baba-434e45450031 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:44.992534 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a5adc92-3e55-4a03-baba-434e45450031 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1203 microversion: 2.1 time: 0.616541 Sep 10 11:03:44.997040 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3501/4663] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:44 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1203 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:45.010339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c6fbd10-7481-47fe-8dd4-0b28933a5ad7 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:45.010965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6c6fbd10-7481-47fe-8dd4-0b28933a5ad7 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:45.027569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c6fbd10-7481-47fe-8dd4-0b28933a5ad7 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:45.027937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1cfd338e-a986-4629-97d8-f87df6c42831 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:45.028593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c6fbd10-7481-47fe-8dd4-0b28933a5ad7 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:45.029157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c6fbd10-7481-47fe-8dd4-0b28933a5ad7 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:45.030778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c6fbd10-7481-47fe-8dd4-0b28933a5ad7 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:45.031519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c6fbd10-7481-47fe-8dd4-0b28933a5ad7 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:45.032185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c6fbd10-7481-47fe-8dd4-0b28933a5ad7 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:45.037606 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1cfd338e-a986-4629-97d8-f87df6c42831 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1309 microversion: 2.1 time: 0.664675 Sep 10 11:03:45.038204 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1163/4664] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:44 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1309 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:45.039352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:45.285732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6c6fbd10-7481-47fe-8dd4-0b28933a5ad7 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:45.295340 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c6fbd10-7481-47fe-8dd4-0b28933a5ad7 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1664 microversion: 2.1 time: 0.296963 Sep 10 11:03:45.300587 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3502/4665] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:44 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1664 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:46.023135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a83204e6-f8db-4d87-b8ee-3f6e279fac75 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:46.024101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a83204e6-f8db-4d87-b8ee-3f6e279fac75 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:46.035058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a83204e6-f8db-4d87-b8ee-3f6e279fac75 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:46.035688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a83204e6-f8db-4d87-b8ee-3f6e279fac75 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:46.035895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a83204e6-f8db-4d87-b8ee-3f6e279fac75 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:46.036607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a83204e6-f8db-4d87-b8ee-3f6e279fac75 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:46.041594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a83204e6-f8db-4d87-b8ee-3f6e279fac75 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:46.042146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a83204e6-f8db-4d87-b8ee-3f6e279fac75 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:46.064775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e3c9aff-8f84-480a-908e-4cd35cfc6317 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:46.066161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e3c9aff-8f84-480a-908e-4cd35cfc6317 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:46.076510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3c9aff-8f84-480a-908e-4cd35cfc6317 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:46.078266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3c9aff-8f84-480a-908e-4cd35cfc6317 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:46.080106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3c9aff-8f84-480a-908e-4cd35cfc6317 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:46.080862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3c9aff-8f84-480a-908e-4cd35cfc6317 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:46.084367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3c9aff-8f84-480a-908e-4cd35cfc6317 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:46.084830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e3c9aff-8f84-480a-908e-4cd35cfc6317 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:46.288970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a83204e6-f8db-4d87-b8ee-3f6e279fac75 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:46.300685 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a83204e6-f8db-4d87-b8ee-3f6e279fac75 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1203 microversion: 2.1 time: 0.285336 Sep 10 11:03:46.301994 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1164/4666] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:46 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1203 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:46.322599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1b81587f-d918-47b2-a921-2b9fc90b6a9e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:46.323630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1b81587f-d918-47b2-a921-2b9fc90b6a9e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:46.331162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b81587f-d918-47b2-a921-2b9fc90b6a9e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:46.332020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b81587f-d918-47b2-a921-2b9fc90b6a9e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:46.332690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b81587f-d918-47b2-a921-2b9fc90b6a9e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:46.333696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b81587f-d918-47b2-a921-2b9fc90b6a9e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:46.334257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b81587f-d918-47b2-a921-2b9fc90b6a9e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:46.334784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b81587f-d918-47b2-a921-2b9fc90b6a9e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:46.350431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e3c9aff-8f84-480a-908e-4cd35cfc6317 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:46.359042 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e3c9aff-8f84-480a-908e-4cd35cfc6317 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1309 microversion: 2.1 time: 0.299075 Sep 10 11:03:46.371451 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3503/4667] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:46 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1309 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:46.478610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1b81587f-d918-47b2-a921-2b9fc90b6a9e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:46.488175 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1b81587f-d918-47b2-a921-2b9fc90b6a9e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1664 microversion: 2.1 time: 0.168784 Sep 10 11:03:46.488771 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1165/4668] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:46 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:47.325047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69857243-2113-47ac-98fa-29f556b1784d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:47.332858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69857243-2113-47ac-98fa-29f556b1784d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:47.344751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69857243-2113-47ac-98fa-29f556b1784d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:47.344751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69857243-2113-47ac-98fa-29f556b1784d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:47.344751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69857243-2113-47ac-98fa-29f556b1784d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:47.345742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69857243-2113-47ac-98fa-29f556b1784d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:47.346603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69857243-2113-47ac-98fa-29f556b1784d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:47.347039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69857243-2113-47ac-98fa-29f556b1784d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:47.382253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0ee98467-f352-4266-8ef1-8dd7f2eb2a58 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:47.383601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0ee98467-f352-4266-8ef1-8dd7f2eb2a58 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:47.391950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ee98467-f352-4266-8ef1-8dd7f2eb2a58 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:47.392785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ee98467-f352-4266-8ef1-8dd7f2eb2a58 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:47.393570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ee98467-f352-4266-8ef1-8dd7f2eb2a58 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:47.394616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ee98467-f352-4266-8ef1-8dd7f2eb2a58 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:47.395428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ee98467-f352-4266-8ef1-8dd7f2eb2a58 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:47.396002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ee98467-f352-4266-8ef1-8dd7f2eb2a58 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:47.559116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-69857243-2113-47ac-98fa-29f556b1784d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:47.570207 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69857243-2113-47ac-98fa-29f556b1784d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1203 microversion: 2.1 time: 0.249677 Sep 10 11:03:47.570816 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3504/4669] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:47 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1203 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:47.581891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fce0824d-8e23-4401-9994-dc621e52e700 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:47.582441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fce0824d-8e23-4401-9994-dc621e52e700 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:47.598386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fce0824d-8e23-4401-9994-dc621e52e700 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:47.598890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fce0824d-8e23-4401-9994-dc621e52e700 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:47.599333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fce0824d-8e23-4401-9994-dc621e52e700 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:47.600043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fce0824d-8e23-4401-9994-dc621e52e700 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:47.600500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fce0824d-8e23-4401-9994-dc621e52e700 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:47.609963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fce0824d-8e23-4401-9994-dc621e52e700 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:47.637749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0ee98467-f352-4266-8ef1-8dd7f2eb2a58 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:47.645598 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0ee98467-f352-4266-8ef1-8dd7f2eb2a58 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1309 microversion: 2.1 time: 0.267778 Sep 10 11:03:47.647274 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1166/4670] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:47 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1309 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:47.681685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:47.735496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:47.835327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fce0824d-8e23-4401-9994-dc621e52e700 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:47.845998 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fce0824d-8e23-4401-9994-dc621e52e700 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1668 microversion: 2.1 time: 0.273165 Sep 10 11:03:47.847076 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3505/4671] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:47 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1668 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:47.959299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-9d24c5c9-56f6-475f-b112-9dbba247def9 req-da1ae342-9e24-4f54-9bd2-101c217a0788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff106c0-1678-49e4-80cf-4cbd06d7cf59", "name": "network-vif-plugged", "status": "completed", "tag": "b35734e2-362f-40d9-8fae-a19765c9240d"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:47.978996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9d24c5c9-56f6-475f-b112-9dbba247def9 req-da1ae342-9e24-4f54-9bd2-101c217a0788 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:47.982798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9d24c5c9-56f6-475f-b112-9dbba247def9 req-da1ae342-9e24-4f54-9bd2-101c217a0788 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:47.983399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9d24c5c9-56f6-475f-b112-9dbba247def9 req-da1ae342-9e24-4f54-9bd2-101c217a0788 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:48.000443 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-9d24c5c9-56f6-475f-b112-9dbba247def9 req-da1ae342-9e24-4f54-9bd2-101c217a0788 service nova] Creating event network-vif-plugged:b35734e2-362f-40d9-8fae-a19765c9240d for instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 on n-h2-856894-1 Sep 10 11:03:48.008298 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-9d24c5c9-56f6-475f-b112-9dbba247def9 req-da1ae342-9e24-4f54-9bd2-101c217a0788 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052618 Sep 10 11:03:48.009740 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1167/4672] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:03:48.601309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af09cadf-4909-46de-929e-19db63baf3f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:48.601309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-af09cadf-4909-46de-929e-19db63baf3f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:48.605937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af09cadf-4909-46de-929e-19db63baf3f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:48.606631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af09cadf-4909-46de-929e-19db63baf3f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:48.607215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af09cadf-4909-46de-929e-19db63baf3f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:48.608599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af09cadf-4909-46de-929e-19db63baf3f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:48.609229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af09cadf-4909-46de-929e-19db63baf3f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:48.609806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af09cadf-4909-46de-929e-19db63baf3f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:48.675719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-769c52f7-fbe3-4866-b1a9-0d8d0a54dfe0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:48.676988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-769c52f7-fbe3-4866-b1a9-0d8d0a54dfe0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:48.679964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:48.692102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-769c52f7-fbe3-4866-b1a9-0d8d0a54dfe0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:48.692607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-769c52f7-fbe3-4866-b1a9-0d8d0a54dfe0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:48.693205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-769c52f7-fbe3-4866-b1a9-0d8d0a54dfe0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:48.699064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-769c52f7-fbe3-4866-b1a9-0d8d0a54dfe0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:48.699579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-769c52f7-fbe3-4866-b1a9-0d8d0a54dfe0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:48.700026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-769c52f7-fbe3-4866-b1a9-0d8d0a54dfe0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:48.873398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-af09cadf-4909-46de-929e-19db63baf3f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:48.886759 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af09cadf-4909-46de-929e-19db63baf3f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1203 microversion: 2.1 time: 0.291236 Sep 10 11:03:48.888095 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3506/4673] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:48 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1203 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:49.219329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-769c52f7-fbe3-4866-b1a9-0d8d0a54dfe0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:49.228599 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-769c52f7-fbe3-4866-b1a9-0d8d0a54dfe0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1309 microversion: 2.1 time: 0.558176 Sep 10 11:03:49.229675 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1168/4674] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:48 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1309 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:49.913319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d3373aa9-cc8e-465d-9b66-f4fb1f09ee20 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:49.914219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d3373aa9-cc8e-465d-9b66-f4fb1f09ee20 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:49.922588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3373aa9-cc8e-465d-9b66-f4fb1f09ee20 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:49.923180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3373aa9-cc8e-465d-9b66-f4fb1f09ee20 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:49.923681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3373aa9-cc8e-465d-9b66-f4fb1f09ee20 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:49.924458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3373aa9-cc8e-465d-9b66-f4fb1f09ee20 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:49.924912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3373aa9-cc8e-465d-9b66-f4fb1f09ee20 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:49.925440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3373aa9-cc8e-465d-9b66-f4fb1f09ee20 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.036530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-cfe46948-edf6-4edc-999c-23dbc2332c17 req-13472b16-0796-4a0c-b043-bcfb405b4ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58df1af1-ed9a-4a29-9da0-280b1cac022e", "name": "network-vif-plugged", "status": "completed", "tag": "60d28d3e-7bd3-42c9-9cd6-19c6ff57654f"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:50.052050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cfe46948-edf6-4edc-999c-23dbc2332c17 req-13472b16-0796-4a0c-b043-bcfb405b4ff5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.052795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cfe46948-edf6-4edc-999c-23dbc2332c17 req-13472b16-0796-4a0c-b043-bcfb405b4ff5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.053506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cfe46948-edf6-4edc-999c-23dbc2332c17 req-13472b16-0796-4a0c-b043-bcfb405b4ff5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.079375 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-cfe46948-edf6-4edc-999c-23dbc2332c17 req-13472b16-0796-4a0c-b043-bcfb405b4ff5 service nova] Creating event network-vif-plugged:60d28d3e-7bd3-42c9-9cd6-19c6ff57654f for instance 58df1af1-ed9a-4a29-9da0-280b1cac022e on n-h2-856894-1 Sep 10 11:03:50.084446 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-cfe46948-edf6-4edc-999c-23dbc2332c17 req-13472b16-0796-4a0c-b043-bcfb405b4ff5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052240 Sep 10 11:03:50.084994 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1169/4675] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:03:50.125538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d3373aa9-cc8e-465d-9b66-f4fb1f09ee20 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:50.132295 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d3373aa9-cc8e-465d-9b66-f4fb1f09ee20 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1203 microversion: 2.1 time: 0.224670 Sep 10 11:03:50.133588 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3507/4676] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:49 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:50.256320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-65b2f8c0-c609-4a10-93bd-037271ed3566 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:50.258647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-65b2f8c0-c609-4a10-93bd-037271ed3566 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:50.266493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65b2f8c0-c609-4a10-93bd-037271ed3566 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.266981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65b2f8c0-c609-4a10-93bd-037271ed3566 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.268584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65b2f8c0-c609-4a10-93bd-037271ed3566 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.269349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65b2f8c0-c609-4a10-93bd-037271ed3566 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.269802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65b2f8c0-c609-4a10-93bd-037271ed3566 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.270222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65b2f8c0-c609-4a10-93bd-037271ed3566 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.424664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-65b2f8c0-c609-4a10-93bd-037271ed3566 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:50.433298 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-65b2f8c0-c609-4a10-93bd-037271ed3566 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1490 microversion: 2.1 time: 0.184439 Sep 10 11:03:50.433976 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1170/4677] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:50 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1490 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:50.459357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50703c89-703e-4eab-b0d4-98612bb04ac0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:50.460108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50703c89-703e-4eab-b0d4-98612bb04ac0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:50.473321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50703c89-703e-4eab-b0d4-98612bb04ac0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.473321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50703c89-703e-4eab-b0d4-98612bb04ac0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.473321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50703c89-703e-4eab-b0d4-98612bb04ac0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.473321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50703c89-703e-4eab-b0d4-98612bb04ac0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.473321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50703c89-703e-4eab-b0d4-98612bb04ac0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.473321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50703c89-703e-4eab-b0d4-98612bb04ac0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.611294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50703c89-703e-4eab-b0d4-98612bb04ac0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:50.627204 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50703c89-703e-4eab-b0d4-98612bb04ac0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1490 microversion: 2.1 time: 0.172037 Sep 10 11:03:50.627815 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3508/4678] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:50 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1490 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:50.652784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d6478c87-019b-4641-92f7-c52add026ff9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:50.653876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d6478c87-019b-4641-92f7-c52add026ff9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:50.660881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6478c87-019b-4641-92f7-c52add026ff9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.661393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6478c87-019b-4641-92f7-c52add026ff9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.661820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6478c87-019b-4641-92f7-c52add026ff9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.662500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6478c87-019b-4641-92f7-c52add026ff9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.662942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6478c87-019b-4641-92f7-c52add026ff9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.663357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6478c87-019b-4641-92f7-c52add026ff9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.666831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:50.816330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d6478c87-019b-4641-92f7-c52add026ff9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:50.824702 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d6478c87-019b-4641-92f7-c52add026ff9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1490 microversion: 2.1 time: 0.175823 Sep 10 11:03:50.825648 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1171/4679] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:50 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1490 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:50.847824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf670803-ec4a-4854-802e-9b2221b814d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:50.848435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf670803-ec4a-4854-802e-9b2221b814d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:50.854933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf670803-ec4a-4854-802e-9b2221b814d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.855426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf670803-ec4a-4854-802e-9b2221b814d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.855869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf670803-ec4a-4854-802e-9b2221b814d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.856570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf670803-ec4a-4854-802e-9b2221b814d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.857031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf670803-ec4a-4854-802e-9b2221b814d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.858095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf670803-ec4a-4854-802e-9b2221b814d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.885736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf670803-ec4a-4854-802e-9b2221b814d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:03:50.976768 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf670803-ec4a-4854-802e-9b2221b814d4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 204 len: 0 microversion: 2.1 time: 0.132556 Sep 10 11:03:50.980481 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3509/4680] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:03:50 2022] DELETE /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:03:50.986913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b2ffe442-a43d-461e-ad80-1664b3ef3221 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:50.987966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b2ffe442-a43d-461e-ad80-1664b3ef3221 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:50.996212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2ffe442-a43d-461e-ad80-1664b3ef3221 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.996709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2ffe442-a43d-461e-ad80-1664b3ef3221 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.997192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2ffe442-a43d-461e-ad80-1664b3ef3221 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:50.998563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2ffe442-a43d-461e-ad80-1664b3ef3221 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:50.999021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2ffe442-a43d-461e-ad80-1664b3ef3221 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:50.999447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2ffe442-a43d-461e-ad80-1664b3ef3221 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:51.156896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7352e3ac-e15a-4a4d-acbf-ed071e0f05c6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:51.157638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7352e3ac-e15a-4a4d-acbf-ed071e0f05c6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:51.164149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7352e3ac-e15a-4a4d-acbf-ed071e0f05c6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:51.164644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7352e3ac-e15a-4a4d-acbf-ed071e0f05c6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:51.165098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7352e3ac-e15a-4a4d-acbf-ed071e0f05c6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:51.165841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7352e3ac-e15a-4a4d-acbf-ed071e0f05c6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:51.166287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7352e3ac-e15a-4a4d-acbf-ed071e0f05c6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:51.166715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7352e3ac-e15a-4a4d-acbf-ed071e0f05c6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:51.205817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b2ffe442-a43d-461e-ad80-1664b3ef3221 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:51.215228 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b2ffe442-a43d-461e-ad80-1664b3ef3221 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1496 microversion: 2.1 time: 0.232436 Sep 10 11:03:51.216420 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1172/4681] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:50 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1496 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:51.325359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7352e3ac-e15a-4a4d-acbf-ed071e0f05c6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:51.338094 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7352e3ac-e15a-4a4d-acbf-ed071e0f05c6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1203 microversion: 2.1 time: 0.185859 Sep 10 11:03:51.339806 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3510/4682] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:51 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1203 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:52.240742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1da47c0e-f363-49bf-9cfb-3109f3cceae0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:52.241451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1da47c0e-f363-49bf-9cfb-3109f3cceae0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:52.251504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1da47c0e-f363-49bf-9cfb-3109f3cceae0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:52.255736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1da47c0e-f363-49bf-9cfb-3109f3cceae0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:52.256220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1da47c0e-f363-49bf-9cfb-3109f3cceae0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:52.256943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1da47c0e-f363-49bf-9cfb-3109f3cceae0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:52.257431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1da47c0e-f363-49bf-9cfb-3109f3cceae0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:52.261581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1da47c0e-f363-49bf-9cfb-3109f3cceae0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:52.362280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d1494c0c-26c8-472f-ac0a-0f227eca39ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:52.362819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d1494c0c-26c8-472f-ac0a-0f227eca39ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:52.382595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1494c0c-26c8-472f-ac0a-0f227eca39ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:52.389911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1494c0c-26c8-472f-ac0a-0f227eca39ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:52.390381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1494c0c-26c8-472f-ac0a-0f227eca39ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:52.391137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1494c0c-26c8-472f-ac0a-0f227eca39ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:52.391597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1494c0c-26c8-472f-ac0a-0f227eca39ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:52.399539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1494c0c-26c8-472f-ac0a-0f227eca39ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:52.578205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1da47c0e-f363-49bf-9cfb-3109f3cceae0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:52.590961 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1da47c0e-f363-49bf-9cfb-3109f3cceae0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1496 microversion: 2.1 time: 0.355117 Sep 10 11:03:52.606356 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1173/4683] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:52 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1496 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:52.762606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d1494c0c-26c8-472f-ac0a-0f227eca39ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:52.774091 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d1494c0c-26c8-472f-ac0a-0f227eca39ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1390 microversion: 2.1 time: 0.416233 Sep 10 11:03:52.778516 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3511/4684] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:52 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1390 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:52.803504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-64f7195b-6fd5-42ab-833c-3dfb39fb950f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:52.804715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-64f7195b-6fd5-42ab-833c-3dfb39fb950f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:52.814703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64f7195b-6fd5-42ab-833c-3dfb39fb950f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:52.824714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64f7195b-6fd5-42ab-833c-3dfb39fb950f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:52.825399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64f7195b-6fd5-42ab-833c-3dfb39fb950f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:52.826735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64f7195b-6fd5-42ab-833c-3dfb39fb950f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:52.827214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64f7195b-6fd5-42ab-833c-3dfb39fb950f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:52.827650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64f7195b-6fd5-42ab-833c-3dfb39fb950f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:53.303794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-88bbf6da-74c0-4141-bf12-939d2ecc4328 req-35e82f91-6d3b-4f2c-ac51-2c04c964f264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff106c0-1678-49e4-80cf-4cbd06d7cf59", "name": "network-vif-deleted", "tag": "b35734e2-362f-40d9-8fae-a19765c9240d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:53.334024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-64f7195b-6fd5-42ab-833c-3dfb39fb950f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:53.335889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-88bbf6da-74c0-4141-bf12-939d2ecc4328 req-35e82f91-6d3b-4f2c-ac51-2c04c964f264 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:53.338927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-88bbf6da-74c0-4141-bf12-939d2ecc4328 req-35e82f91-6d3b-4f2c-ac51-2c04c964f264 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:53.339594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-88bbf6da-74c0-4141-bf12-939d2ecc4328 req-35e82f91-6d3b-4f2c-ac51-2c04c964f264 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:53.354267 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-64f7195b-6fd5-42ab-833c-3dfb39fb950f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1390 microversion: 2.1 time: 0.556117 Sep 10 11:03:53.358527 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1174/4685] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:52 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1390 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:53.379475 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-88bbf6da-74c0-4141-bf12-939d2ecc4328 req-35e82f91-6d3b-4f2c-ac51-2c04c964f264 service nova] Creating event network-vif-deleted:b35734e2-362f-40d9-8fae-a19765c9240d for instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 on n-h2-856894-1 Sep 10 11:03:53.382946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-71eedef9-6263-44e3-a668-9162e221f9b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:53.384483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-71eedef9-6263-44e3-a668-9162e221f9b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:53.386457 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-88bbf6da-74c0-4141-bf12-939d2ecc4328 req-35e82f91-6d3b-4f2c-ac51-2c04c964f264 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087686 Sep 10 11:03:53.392120 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3512/4686] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:03:53.400068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-71eedef9-6263-44e3-a668-9162e221f9b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:53.400755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-71eedef9-6263-44e3-a668-9162e221f9b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:53.401335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-71eedef9-6263-44e3-a668-9162e221f9b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:53.402366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-71eedef9-6263-44e3-a668-9162e221f9b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:53.403079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-71eedef9-6263-44e3-a668-9162e221f9b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:53.403735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-71eedef9-6263-44e3-a668-9162e221f9b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:53.626310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:53.627766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:53.652452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:53.652959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:53.666773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:53.667641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:53.668223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:53.668671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:53.781389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:53.781856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:53.782298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:53.782764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lazy-loading 'fault' on Instance uuid 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:03:53.788667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-71eedef9-6263-44e3-a668-9162e221f9b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:53.800996 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-71eedef9-6263-44e3-a668-9162e221f9b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1390 microversion: 2.1 time: 0.422500 Sep 10 11:03:53.804969 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1175/4687] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:53 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1390 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:53.838866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e21e836d-2139-4755-b79a-a64845afe344 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:53.843214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e21e836d-2139-4755-b79a-a64845afe344 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:53.858749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e21e836d-2139-4755-b79a-a64845afe344 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:53.859607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e21e836d-2139-4755-b79a-a64845afe344 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:53.860253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e21e836d-2139-4755-b79a-a64845afe344 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:53.861235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e21e836d-2139-4755-b79a-a64845afe344 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:53.862535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e21e836d-2139-4755-b79a-a64845afe344 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:53.863245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e21e836d-2139-4755-b79a-a64845afe344 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:53.891656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e21e836d-2139-4755-b79a-a64845afe344 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:03:53.899779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:53.907694 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d3aab32-d97a-4cbe-832a-872b1e184eec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1299 microversion: 2.1 time: 0.295404 Sep 10 11:03:53.921426 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3513/4688] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:53 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:03:53.989210 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e21e836d-2139-4755-b79a-a64845afe344 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 204 len: 0 microversion: 2.1 time: 0.160887 Sep 10 11:03:53.990947 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1176/4689] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:03:53 2022] DELETE /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:03:53.999240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee2983a4-62f1-4dd3-84c1-089db148f859 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:53.999867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ee2983a4-62f1-4dd3-84c1-089db148f859 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:54.006193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2983a4-62f1-4dd3-84c1-089db148f859 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:54.006908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2983a4-62f1-4dd3-84c1-089db148f859 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:54.007513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2983a4-62f1-4dd3-84c1-089db148f859 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:54.008407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2983a4-62f1-4dd3-84c1-089db148f859 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:54.009048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2983a4-62f1-4dd3-84c1-089db148f859 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:54.009663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee2983a4-62f1-4dd3-84c1-089db148f859 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:54.207239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ee2983a4-62f1-4dd3-84c1-089db148f859 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:54.220216 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ee2983a4-62f1-4dd3-84c1-089db148f859 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1396 microversion: 2.1 time: 0.225197 Sep 10 11:03:54.221480 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3514/4690] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:53 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1396 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:54.937334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:54.938248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:54.946378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:54.947615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:54.948204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:54.949092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:54.950122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:54.950683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:54.987448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:54.987927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:54.988361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:54.988811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lazy-loading 'fault' on Instance uuid 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:03:55.042989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:55.055339 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-68cad57a-69af-4619-a7da-d215393f8cf4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 200 len: 1299 microversion: 2.1 time: 0.123233 Sep 10 11:03:55.065919 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1177/4691] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:54 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:55.244059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e23a4fe-d75f-4263-a995-8f242dc7672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:55.244689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e23a4fe-d75f-4263-a995-8f242dc7672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:55.259613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e23a4fe-d75f-4263-a995-8f242dc7672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:55.260353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e23a4fe-d75f-4263-a995-8f242dc7672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:55.261003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e23a4fe-d75f-4263-a995-8f242dc7672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:55.261947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e23a4fe-d75f-4263-a995-8f242dc7672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:55.265323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e23a4fe-d75f-4263-a995-8f242dc7672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:55.267094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e23a4fe-d75f-4263-a995-8f242dc7672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:55.519845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e23a4fe-d75f-4263-a995-8f242dc7672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:55.532208 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e23a4fe-d75f-4263-a995-8f242dc7672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1396 microversion: 2.1 time: 0.292630 Sep 10 11:03:55.533411 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3515/4692] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:55 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1396 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:56.078962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:56.079581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:56.087631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:56.088107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:56.088552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:56.089316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:56.089783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:56.090220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:56.115691 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 HTTP/1.1 Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '8ff106c0-1678-49e4-80cf-4cbd06d7cf59'} Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:03:56.120659 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:03:56.126807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:03:56.126807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:03:56.126807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:03:56.126807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:03:56.126807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:03:56.126807 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:03:56.126807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:03:56.126807 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-77621f65-d8f6-4538-bfeb-41e470db8f1d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 404 len: 111 microversion: 2.1 time: 0.046975 Sep 10 11:03:56.126807 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1178/4693] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:56 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:03:56.132384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f79115f6-1734-4e28-bb21-f7f76709b7b9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:56.132890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f79115f6-1734-4e28-bb21-f7f76709b7b9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:56.143539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f79115f6-1734-4e28-bb21-f7f76709b7b9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:56.144066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f79115f6-1734-4e28-bb21-f7f76709b7b9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:56.144587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f79115f6-1734-4e28-bb21-f7f76709b7b9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:56.146203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f79115f6-1734-4e28-bb21-f7f76709b7b9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:56.148780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f79115f6-1734-4e28-bb21-f7f76709b7b9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:56.151476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f79115f6-1734-4e28-bb21-f7f76709b7b9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:56.208610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f79115f6-1734-4e28-bb21-f7f76709b7b9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:03:56.255483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:56.332409 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f79115f6-1734-4e28-bb21-f7f76709b7b9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 204 len: 0 microversion: 2.1 time: 0.203268 Sep 10 11:03:56.336263 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3516/4694] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:03:56 2022] DELETE /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:03:56.342405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a313e0d5-c55c-4c86-88bf-36035d4c92d6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:56.343038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a313e0d5-c55c-4c86-88bf-36035d4c92d6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:56.352296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-c55c-4c86-88bf-36035d4c92d6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:56.352842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-c55c-4c86-88bf-36035d4c92d6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:56.353315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-c55c-4c86-88bf-36035d4c92d6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:56.354034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-c55c-4c86-88bf-36035d4c92d6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:56.354493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-c55c-4c86-88bf-36035d4c92d6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:56.354925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-c55c-4c86-88bf-36035d4c92d6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:56.547720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-de1d3111-b567-4c44-a416-9d5a161c5525 req-abdf276f-b851-4311-8d2f-47b1d376dce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58df1af1-ed9a-4a29-9da0-280b1cac022e", "name": "network-vif-deleted", "tag": "60d28d3e-7bd3-42c9-9cd6-19c6ff57654f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:56.558755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-de1d3111-b567-4c44-a416-9d5a161c5525 req-abdf276f-b851-4311-8d2f-47b1d376dce0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:56.559235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-de1d3111-b567-4c44-a416-9d5a161c5525 req-abdf276f-b851-4311-8d2f-47b1d376dce0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:56.559918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-de1d3111-b567-4c44-a416-9d5a161c5525 req-abdf276f-b851-4311-8d2f-47b1d376dce0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:56.573844 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-de1d3111-b567-4c44-a416-9d5a161c5525 req-abdf276f-b851-4311-8d2f-47b1d376dce0 service nova] Creating event network-vif-deleted:60d28d3e-7bd3-42c9-9cd6-19c6ff57654f for instance 58df1af1-ed9a-4a29-9da0-280b1cac022e on n-h2-856894-1 Sep 10 11:03:56.579944 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-de1d3111-b567-4c44-a416-9d5a161c5525 req-abdf276f-b851-4311-8d2f-47b1d376dce0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038090 Sep 10 11:03:56.581059 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3517/4695] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:03:56.588473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d9b848f-a8db-4309-9e88-1a344593fa99 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:56.589390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d9b848f-a8db-4309-9e88-1a344593fa99 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:56.600341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a313e0d5-c55c-4c86-88bf-36035d4c92d6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:56.609143 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a313e0d5-c55c-4c86-88bf-36035d4c92d6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1496 microversion: 2.1 time: 0.271358 Sep 10 11:03:56.610481 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1179/4696] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:56 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1496 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:56.615816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9b848f-a8db-4309-9e88-1a344593fa99 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:56.617196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9b848f-a8db-4309-9e88-1a344593fa99 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:56.617914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9b848f-a8db-4309-9e88-1a344593fa99 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:56.618759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9b848f-a8db-4309-9e88-1a344593fa99 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:56.625826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9b848f-a8db-4309-9e88-1a344593fa99 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:56.627640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d9b848f-a8db-4309-9e88-1a344593fa99 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:56.714922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d9b848f-a8db-4309-9e88-1a344593fa99 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:56.727869 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d9b848f-a8db-4309-9e88-1a344593fa99 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1354 microversion: 2.1 time: 0.145236 Sep 10 11:03:56.729387 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3518/4697] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:56 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:57.636428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ee001a44-dfe9-41cb-bfcf-799d8873cf2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:57.637719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ee001a44-dfe9-41cb-bfcf-799d8873cf2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:57.653427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee001a44-dfe9-41cb-bfcf-799d8873cf2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:57.654753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee001a44-dfe9-41cb-bfcf-799d8873cf2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:57.655265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee001a44-dfe9-41cb-bfcf-799d8873cf2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:57.656455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee001a44-dfe9-41cb-bfcf-799d8873cf2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:57.657006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee001a44-dfe9-41cb-bfcf-799d8873cf2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:57.657509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee001a44-dfe9-41cb-bfcf-799d8873cf2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:57.753892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5fac902a-bb8e-41e5-9a10-26061bd41cd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:57.755079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5fac902a-bb8e-41e5-9a10-26061bd41cd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:57.762662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fac902a-bb8e-41e5-9a10-26061bd41cd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:57.763945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fac902a-bb8e-41e5-9a10-26061bd41cd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:57.764566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fac902a-bb8e-41e5-9a10-26061bd41cd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:57.765450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fac902a-bb8e-41e5-9a10-26061bd41cd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:57.766056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fac902a-bb8e-41e5-9a10-26061bd41cd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:57.766636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5fac902a-bb8e-41e5-9a10-26061bd41cd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:57.890170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5fac902a-bb8e-41e5-9a10-26061bd41cd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:57.916048 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5fac902a-bb8e-41e5-9a10-26061bd41cd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1188 microversion: 2.1 time: 0.165714 Sep 10 11:03:57.932092 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3519/4698] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:57 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1188 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:58.082781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ee001a44-dfe9-41cb-bfcf-799d8873cf2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:58.094328 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ee001a44-dfe9-41cb-bfcf-799d8873cf2a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1496 microversion: 2.1 time: 0.463039 Sep 10 11:03:58.095452 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1180/4699] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:57 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1496 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:58.704967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5b3ede92-6d94-4325-8033-ba7f6722b7ff req-a2a71ff8-e072-48d7-8d35-e218d2b26797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d201bfbd-7948-42d1-9c5e-0d788b7e52db", "name": "network-vif-deleted", "tag": "f44f206f-353d-4d2c-b7ab-b82316d60616"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:03:58.745673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b3ede92-6d94-4325-8033-ba7f6722b7ff req-a2a71ff8-e072-48d7-8d35-e218d2b26797 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:58.746676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b3ede92-6d94-4325-8033-ba7f6722b7ff req-a2a71ff8-e072-48d7-8d35-e218d2b26797 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:58.747306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b3ede92-6d94-4325-8033-ba7f6722b7ff req-a2a71ff8-e072-48d7-8d35-e218d2b26797 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:58.783730 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5b3ede92-6d94-4325-8033-ba7f6722b7ff req-a2a71ff8-e072-48d7-8d35-e218d2b26797 service nova] Creating event network-vif-deleted:f44f206f-353d-4d2c-b7ab-b82316d60616 for instance d201bfbd-7948-42d1-9c5e-0d788b7e52db on n-h2-856894-1 Sep 10 11:03:58.808417 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5b3ede92-6d94-4325-8033-ba7f6722b7ff req-a2a71ff8-e072-48d7-8d35-e218d2b26797 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107520 Sep 10 11:03:58.809367 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3520/4700] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:03:58.943254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-004e4b1a-32b5-4364-9fb2-b5376f594fd3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:58.943898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-004e4b1a-32b5-4364-9fb2-b5376f594fd3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:58.954329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:03:58.963147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004e4b1a-32b5-4364-9fb2-b5376f594fd3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:58.967832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004e4b1a-32b5-4364-9fb2-b5376f594fd3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:58.968403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004e4b1a-32b5-4364-9fb2-b5376f594fd3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:58.969342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004e4b1a-32b5-4364-9fb2-b5376f594fd3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:58.969915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004e4b1a-32b5-4364-9fb2-b5376f594fd3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:58.970353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-004e4b1a-32b5-4364-9fb2-b5376f594fd3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:59.118290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:03:59.119294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:03:59.125155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-004e4b1a-32b5-4364-9fb2-b5376f594fd3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:59.134455 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-004e4b1a-32b5-4364-9fb2-b5376f594fd3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1188 microversion: 2.1 time: 0.195887 Sep 10 11:03:59.139382 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1181/4701] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:58 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1188 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:03:59.145483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:59.146156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:59.148751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:59.150772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:59.151562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:59.154943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:59.243140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:03:59.245449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:03:59.246988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:03:59.250187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lazy-loading 'fault' on Instance uuid d201bfbd-7948-42d1-9c5e-0d788b7e52db {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:03:59.340129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:03:59.354146 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-803df6df-94e0-461d-abc3-71ce89575553 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 200 len: 1299 microversion: 2.1 time: 0.240451 Sep 10 11:03:59.357414 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3521/4702] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:03:59 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 1299 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:00.164094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b55d36e2-9850-4acb-b20e-7db11fb80d1d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:00.165312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b55d36e2-9850-4acb-b20e-7db11fb80d1d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:00.177124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b55d36e2-9850-4acb-b20e-7db11fb80d1d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:00.177758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b55d36e2-9850-4acb-b20e-7db11fb80d1d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:00.181446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b55d36e2-9850-4acb-b20e-7db11fb80d1d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:00.182241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b55d36e2-9850-4acb-b20e-7db11fb80d1d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:00.182715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b55d36e2-9850-4acb-b20e-7db11fb80d1d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:00.183150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b55d36e2-9850-4acb-b20e-7db11fb80d1d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:00.332119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b55d36e2-9850-4acb-b20e-7db11fb80d1d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:00.351888 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b55d36e2-9850-4acb-b20e-7db11fb80d1d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1188 microversion: 2.1 time: 0.191595 Sep 10 11:04:00.352793 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1182/4703] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:00 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1188 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:00.380938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:00.382581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:00.391590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:00.392661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:00.393321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:00.394324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:00.394946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:00.395558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:00.411277 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db HTTP/1.1 Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd201bfbd-7948-42d1-9c5e-0d788b7e52db'} Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:00.413767 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:00.418669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:04:00.418669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:04:00.418669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:04:00.418669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:04:00.418669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:04:00.418669 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:00.420345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:04:00.421470 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2cf98e57-1e7d-4b77-8b10-5da2967e7098 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 404 len: 111 microversion: 2.1 time: 0.044497 Sep 10 11:04:00.426009 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3522/4704] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:00 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:04:00.569688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-308653920", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "63c65db1-231a-4e94-b304-7943deb77e20"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:00.655995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] validate_networks() for [('63c65db1-231a-4e94-b304-7943deb77e20', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:04:01.151835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:04:01.152562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:04:01.153215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:04:01.153599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:04:01.154115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:04:01.167296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:01.167966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:01.168220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:01.168983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:01.169503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:01.169932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:01.189175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:04:01.194548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for user 1fd01ead2408487dbe51fd732c209981 and project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:04:01.216297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:04:01.218968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:04:01.294981 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-96714488-840c-45f9-8ea1-05dc3141323d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728504 Sep 10 11:04:01.295970 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1183/4705] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:04:01.308193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1385c9a-8a98-4423-8597-170604af7038 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:01.309468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1385c9a-8a98-4423-8597-170604af7038 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:01.375107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2c5337f0-622a-4685-9fcb-9e704cea3e8d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:01.375798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2c5337f0-622a-4685-9fcb-9e704cea3e8d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:01.386714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c5337f0-622a-4685-9fcb-9e704cea3e8d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:01.388712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c5337f0-622a-4685-9fcb-9e704cea3e8d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:01.389206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c5337f0-622a-4685-9fcb-9e704cea3e8d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:01.392210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c5337f0-622a-4685-9fcb-9e704cea3e8d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:01.392725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c5337f0-622a-4685-9fcb-9e704cea3e8d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:01.394788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c5337f0-622a-4685-9fcb-9e704cea3e8d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:01.887398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2c5337f0-622a-4685-9fcb-9e704cea3e8d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:01.895776 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2c5337f0-622a-4685-9fcb-9e704cea3e8d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1188 microversion: 2.1 time: 0.525109 Sep 10 11:04:01.901735 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1184/4706] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:01 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1188 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:01.980573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1385c9a-8a98-4423-8597-170604af7038 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:01.990580 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1385c9a-8a98-4423-8597-170604af7038 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1208 microversion: 2.1 time: 0.686793 Sep 10 11:04:01.993118 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3523/4707] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:01 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1208 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:02.928056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b75059f-fc32-40af-8a20-f3ff1a6a6dcb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:02.928892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0b75059f-fc32-40af-8a20-f3ff1a6a6dcb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:02.943570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b75059f-fc32-40af-8a20-f3ff1a6a6dcb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:02.944158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b75059f-fc32-40af-8a20-f3ff1a6a6dcb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:02.944859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b75059f-fc32-40af-8a20-f3ff1a6a6dcb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:02.945807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b75059f-fc32-40af-8a20-f3ff1a6a6dcb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:02.948870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b75059f-fc32-40af-8a20-f3ff1a6a6dcb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:02.949723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b75059f-fc32-40af-8a20-f3ff1a6a6dcb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:03.016248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51b61f42-c889-444a-a1c1-fe11fcebade4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:03.017533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51b61f42-c889-444a-a1c1-fe11fcebade4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:03.034094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b61f42-c889-444a-a1c1-fe11fcebade4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:03.036427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b61f42-c889-444a-a1c1-fe11fcebade4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:03.037060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b61f42-c889-444a-a1c1-fe11fcebade4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:03.040738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b61f42-c889-444a-a1c1-fe11fcebade4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:03.041427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b61f42-c889-444a-a1c1-fe11fcebade4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:03.042037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b61f42-c889-444a-a1c1-fe11fcebade4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:03.230217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-51b61f42-c889-444a-a1c1-fe11fcebade4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:03.240165 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51b61f42-c889-444a-a1c1-fe11fcebade4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1268 microversion: 2.1 time: 0.228598 Sep 10 11:04:03.251281 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3524/4708] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:03 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1268 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:03.269732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0b75059f-fc32-40af-8a20-f3ff1a6a6dcb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:03.279282 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0b75059f-fc32-40af-8a20-f3ff1a6a6dcb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 200 len: 1188 microversion: 2.1 time: 0.355009 Sep 10 11:04:03.280508 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1185/4709] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:02 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 1188 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:04.265598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d3628bc0-c94b-4995-af5f-d4d495eaa271 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:04.267045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d3628bc0-c94b-4995-af5f-d4d495eaa271 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:04.275732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3628bc0-c94b-4995-af5f-d4d495eaa271 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:04.280996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3628bc0-c94b-4995-af5f-d4d495eaa271 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:04.281684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3628bc0-c94b-4995-af5f-d4d495eaa271 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:04.284919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3628bc0-c94b-4995-af5f-d4d495eaa271 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:04.285430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3628bc0-c94b-4995-af5f-d4d495eaa271 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:04.285866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3628bc0-c94b-4995-af5f-d4d495eaa271 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:04.304359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:04.305391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 58df1af1-ed9a-4a29-9da0-280b1cac022e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:04.329110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:04.329874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:04.330447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:04.331351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:04.331988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:04.332425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:04.363545 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance 58df1af1-ed9a-4a29-9da0-280b1cac022e could not be found. Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e HTTP/1.1 Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 58df1af1-ed9a-4a29-9da0-280b1cac022e could not be found. Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '58df1af1-ed9a-4a29-9da0-280b1cac022e'} Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58df1af1-ed9a-4a29-9da0-280b1cac022e could not be found. Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58df1af1-ed9a-4a29-9da0-280b1cac022e could not be found. Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:04:04.366014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:04:04.370096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:04.370096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:04:04.370096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:04:04.370096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:04:04.370096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:04:04.370096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58df1af1-ed9a-4a29-9da0-280b1cac022e could not be found. Sep 10 11:04:04.370096 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:04:04.372293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance 58df1af1-ed9a-4a29-9da0-280b1cac022e could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:04:04.374197 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-87704b9c-b235-4fa4-a2fe-f0c2b80b418a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e" status: 404 len: 111 microversion: 2.1 time: 0.075051 Sep 10 11:04:04.375572 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1186/4710] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:04 2022] GET /compute/v2.1/servers/58df1af1-ed9a-4a29-9da0-280b1cac022e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:04:04.640244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d3628bc0-c94b-4995-af5f-d4d495eaa271 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:04.654021 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d3628bc0-c94b-4995-af5f-d4d495eaa271 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1308 microversion: 2.1 time: 0.392144 Sep 10 11:04:04.659383 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3525/4711] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:04 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:05.353166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-bdefea78-058c-44a2-99d7-050a83f98ef5 req-5036ea9d-0c2f-4ef2-b428-5fa4400840d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6932f6d9-493e-4c31-a5f8-14d70baf8450", "tag": "a8f16390-919e-49ff-a61a-e8eddf746ca2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:05.377019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-bdefea78-058c-44a2-99d7-050a83f98ef5 req-5036ea9d-0c2f-4ef2-b428-5fa4400840d3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:05.377777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-bdefea78-058c-44a2-99d7-050a83f98ef5 req-5036ea9d-0c2f-4ef2-b428-5fa4400840d3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:05.378385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-bdefea78-058c-44a2-99d7-050a83f98ef5 req-5036ea9d-0c2f-4ef2-b428-5fa4400840d3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:05.405567 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-bdefea78-058c-44a2-99d7-050a83f98ef5 req-5036ea9d-0c2f-4ef2-b428-5fa4400840d3 service nova] Creating event network-changed:a8f16390-919e-49ff-a61a-e8eddf746ca2 for instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 on n-h2-856894-1 Sep 10 11:04:05.418847 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-bdefea78-058c-44a2-99d7-050a83f98ef5 req-5036ea9d-0c2f-4ef2-b428-5fa4400840d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069493 Sep 10 11:04:05.420078 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1187/4712] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:05.681127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-104cbb7b-19c4-4caf-bc4f-c2ac900e67c8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:05.682715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-104cbb7b-19c4-4caf-bc4f-c2ac900e67c8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:05.692307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104cbb7b-19c4-4caf-bc4f-c2ac900e67c8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:05.693261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104cbb7b-19c4-4caf-bc4f-c2ac900e67c8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:05.693918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104cbb7b-19c4-4caf-bc4f-c2ac900e67c8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:05.695563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104cbb7b-19c4-4caf-bc4f-c2ac900e67c8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:05.696489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104cbb7b-19c4-4caf-bc4f-c2ac900e67c8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:05.699344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-104cbb7b-19c4-4caf-bc4f-c2ac900e67c8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:05.979151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-104cbb7b-19c4-4caf-bc4f-c2ac900e67c8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:05.991223 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-104cbb7b-19c4-4caf-bc4f-c2ac900e67c8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1308 microversion: 2.1 time: 0.316714 Sep 10 11:04:05.991826 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3526/4713] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:05 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1308 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:07.019807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cec577b2-6eb5-457c-81dd-21d501688025 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:07.020610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cec577b2-6eb5-457c-81dd-21d501688025 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:07.034866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec577b2-6eb5-457c-81dd-21d501688025 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:07.036607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec577b2-6eb5-457c-81dd-21d501688025 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:07.045530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec577b2-6eb5-457c-81dd-21d501688025 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:07.046428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec577b2-6eb5-457c-81dd-21d501688025 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:07.047092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec577b2-6eb5-457c-81dd-21d501688025 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:07.047522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec577b2-6eb5-457c-81dd-21d501688025 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:07.076568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:07.302536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cec577b2-6eb5-457c-81dd-21d501688025 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:07.311101 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cec577b2-6eb5-457c-81dd-21d501688025 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1308 microversion: 2.1 time: 0.295693 Sep 10 11:04:07.314909 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1188/4714] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:07 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:08.349343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-46d090ce-ac3f-4591-8222-819aa5221871 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:08.349974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-46d090ce-ac3f-4591-8222-819aa5221871 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:08.357648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46d090ce-ac3f-4591-8222-819aa5221871 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:08.358352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46d090ce-ac3f-4591-8222-819aa5221871 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:08.358981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46d090ce-ac3f-4591-8222-819aa5221871 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:08.359869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46d090ce-ac3f-4591-8222-819aa5221871 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:08.360420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46d090ce-ac3f-4591-8222-819aa5221871 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:08.360859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46d090ce-ac3f-4591-8222-819aa5221871 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:08.882735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-46d090ce-ac3f-4591-8222-819aa5221871 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:08.893339 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-46d090ce-ac3f-4591-8222-819aa5221871 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1308 microversion: 2.1 time: 0.548223 Sep 10 11:04:08.905102 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3527/4715] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:08 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1308 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:09.920869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0bcd17bd-5bb6-4d85-99b7-704afb7d15f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:09.922251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0bcd17bd-5bb6-4d85-99b7-704afb7d15f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:09.934775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bcd17bd-5bb6-4d85-99b7-704afb7d15f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:09.937818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bcd17bd-5bb6-4d85-99b7-704afb7d15f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:09.938465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bcd17bd-5bb6-4d85-99b7-704afb7d15f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:09.939698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bcd17bd-5bb6-4d85-99b7-704afb7d15f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:09.940798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bcd17bd-5bb6-4d85-99b7-704afb7d15f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:09.941718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bcd17bd-5bb6-4d85-99b7-704afb7d15f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:10.162813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3117210b-8d80-4454-9fa7-34a5ed9300de req-77344b7d-9cab-4958-9e76-fa69fd9ac15c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6932f6d9-493e-4c31-a5f8-14d70baf8450", "name": "network-vif-plugged", "status": "completed", "tag": "a8f16390-919e-49ff-a61a-e8eddf746ca2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:10.182905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3117210b-8d80-4454-9fa7-34a5ed9300de req-77344b7d-9cab-4958-9e76-fa69fd9ac15c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:10.185846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3117210b-8d80-4454-9fa7-34a5ed9300de req-77344b7d-9cab-4958-9e76-fa69fd9ac15c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:10.186379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0bcd17bd-5bb6-4d85-99b7-704afb7d15f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:10.186712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3117210b-8d80-4454-9fa7-34a5ed9300de req-77344b7d-9cab-4958-9e76-fa69fd9ac15c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:10.198813 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0bcd17bd-5bb6-4d85-99b7-704afb7d15f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1308 microversion: 2.1 time: 0.282302 Sep 10 11:04:10.199920 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1189/4716] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:09 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1308 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:10.217937 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3117210b-8d80-4454-9fa7-34a5ed9300de req-77344b7d-9cab-4958-9e76-fa69fd9ac15c service nova] Creating event network-vif-plugged:a8f16390-919e-49ff-a61a-e8eddf746ca2 for instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 on n-h2-856894-1 Sep 10 11:04:10.223955 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3117210b-8d80-4454-9fa7-34a5ed9300de req-77344b7d-9cab-4958-9e76-fa69fd9ac15c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066347 Sep 10 11:04:10.225512 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3528/4717] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:04:11.224047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-04879449-beb3-4370-bd0e-aa61bfac659e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:11.225323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-04879449-beb3-4370-bd0e-aa61bfac659e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:11.229453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:11.230290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:11.236785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04879449-beb3-4370-bd0e-aa61bfac659e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:11.237502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04879449-beb3-4370-bd0e-aa61bfac659e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:11.238216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04879449-beb3-4370-bd0e-aa61bfac659e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:11.238961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04879449-beb3-4370-bd0e-aa61bfac659e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:11.239438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04879449-beb3-4370-bd0e-aa61bfac659e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:11.240088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04879449-beb3-4370-bd0e-aa61bfac659e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:11.395721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-04879449-beb3-4370-bd0e-aa61bfac659e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:11.404706 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-04879449-beb3-4370-bd0e-aa61bfac659e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1308 microversion: 2.1 time: 0.185390 Sep 10 11:04:11.405339 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1190/4718] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:11 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:11.990531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1803502044", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e4694c35-be10-4fc4-b607-179ced0ae9ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e65712d8-efe4-477c-ab8b-0eb50d70eafc"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:12.004946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:12.011120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:12.085146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] validate_networks() for [('e65712d8-efe4-477c-ab8b-0eb50d70eafc', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:04:12.427708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5cd0f55-dfc0-4f95-8861-5c20fdc44ed3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:12.428321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a5cd0f55-dfc0-4f95-8861-5c20fdc44ed3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:12.440606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5cd0f55-dfc0-4f95-8861-5c20fdc44ed3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:12.441124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5cd0f55-dfc0-4f95-8861-5c20fdc44ed3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:12.441583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5cd0f55-dfc0-4f95-8861-5c20fdc44ed3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:12.442278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5cd0f55-dfc0-4f95-8861-5c20fdc44ed3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:12.442731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5cd0f55-dfc0-4f95-8861-5c20fdc44ed3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:12.443155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5cd0f55-dfc0-4f95-8861-5c20fdc44ed3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:12.651348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:04:12.652360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:04:12.652995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:04:12.653624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:04:12.654207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:04:12.670672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:12.674656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:12.676774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:12.679394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:12.680106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:12.682782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:12.722875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:04:12.745294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for user 78004185356641b990a951dc95e6ca0c and project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:04:12.805664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a5cd0f55-dfc0-4f95-8861-5c20fdc44ed3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:12.817496 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a5cd0f55-dfc0-4f95-8861-5c20fdc44ed3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1490 microversion: 2.1 time: 0.392163 Sep 10 11:04:12.819238 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1191/4719] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:12 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1490 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:12.819614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:04:12.821814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4694c35-be10-4fc4-b607-179ced0ae9ee',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:04:12.843653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a75646eb-a5ee-4c7a-a5b4-8d9f14962242 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:12.846183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a75646eb-a5ee-4c7a-a5b4-8d9f14962242 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:12.855522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a75646eb-a5ee-4c7a-a5b4-8d9f14962242 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:12.857350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a75646eb-a5ee-4c7a-a5b4-8d9f14962242 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:12.857964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a75646eb-a5ee-4c7a-a5b4-8d9f14962242 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:12.859363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a75646eb-a5ee-4c7a-a5b4-8d9f14962242 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:12.860041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a75646eb-a5ee-4c7a-a5b4-8d9f14962242 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:12.862026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a75646eb-a5ee-4c7a-a5b4-8d9f14962242 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:12.969325 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a75646eb-a5ee-4c7a-a5b4-8d9f14962242 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "PUT /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1085 microversion: 2.1 time: 0.132219 Sep 10 11:04:12.972779 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1192/4720] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Sep 10 11:04:12 2022] PUT /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1085 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:12.990050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-425e4017-1faa-43bc-9d4d-0160f89b361b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:12.990917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-425e4017-1faa-43bc-9d4d-0160f89b361b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:12.998863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-425e4017-1faa-43bc-9d4d-0160f89b361b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:12.999627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-425e4017-1faa-43bc-9d4d-0160f89b361b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:13.000219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-425e4017-1faa-43bc-9d4d-0160f89b361b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:13.001135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-425e4017-1faa-43bc-9d4d-0160f89b361b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:13.001765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-425e4017-1faa-43bc-9d4d-0160f89b361b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:13.002422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-425e4017-1faa-43bc-9d4d-0160f89b361b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:13.016628 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc17b36f-f32e-4ea7-8afa-34cdbb0d0183 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030120 Sep 10 11:04:13.023219 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3529/4721] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:04:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:04:13.030025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-551ca7f5-cfff-4688-8594-f83450f21161 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:13.030915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-551ca7f5-cfff-4688-8594-f83450f21161 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:13.246549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-551ca7f5-cfff-4688-8594-f83450f21161 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:13.258261 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-551ca7f5-cfff-4688-8594-f83450f21161 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1057 microversion: 2.1 time: 0.232568 Sep 10 11:04:13.259762 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3530/4722] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:13 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1057 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:13.533944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-425e4017-1faa-43bc-9d4d-0160f89b361b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:13.547666 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-425e4017-1faa-43bc-9d4d-0160f89b361b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1511 microversion: 2.1 time: 0.561190 Sep 10 11:04:13.548502 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1193/4723] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:12 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1511 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:13.574152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50c0776b-3aa9-4242-957b-d141745d78d8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:13.575017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50c0776b-3aa9-4242-957b-d141745d78d8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:13.582205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c0776b-3aa9-4242-957b-d141745d78d8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:13.582894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c0776b-3aa9-4242-957b-d141745d78d8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:13.583491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c0776b-3aa9-4242-957b-d141745d78d8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:13.584350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c0776b-3aa9-4242-957b-d141745d78d8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:13.584975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c0776b-3aa9-4242-957b-d141745d78d8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:13.585600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50c0776b-3aa9-4242-957b-d141745d78d8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:13.818834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-50c0776b-3aa9-4242-957b-d141745d78d8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:13.827772 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50c0776b-3aa9-4242-957b-d141745d78d8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1511 microversion: 2.1 time: 0.258162 Sep 10 11:04:13.828362 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3531/4724] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:13 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:13.855738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1318509f-fd6c-4588-8d57-ccad2ef2c5c7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:13.856489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1318509f-fd6c-4588-8d57-ccad2ef2c5c7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:13.870421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1318509f-fd6c-4588-8d57-ccad2ef2c5c7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:13.870924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1318509f-fd6c-4588-8d57-ccad2ef2c5c7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:13.871358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1318509f-fd6c-4588-8d57-ccad2ef2c5c7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:13.872067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1318509f-fd6c-4588-8d57-ccad2ef2c5c7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:13.873064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1318509f-fd6c-4588-8d57-ccad2ef2c5c7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:13.873503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1318509f-fd6c-4588-8d57-ccad2ef2c5c7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:13.923726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1318509f-fd6c-4588-8d57-ccad2ef2c5c7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:04:14.035521 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1318509f-fd6c-4588-8d57-ccad2ef2c5c7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 204 len: 0 microversion: 2.1 time: 0.181857 Sep 10 11:04:14.040676 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1194/4725] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:04:13 2022] DELETE /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:04:14.048512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c617ff0a-a720-430a-8601-9c07ad1c6f20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:14.050152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c617ff0a-a720-430a-8601-9c07ad1c6f20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:14.058718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c617ff0a-a720-430a-8601-9c07ad1c6f20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:14.060515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c617ff0a-a720-430a-8601-9c07ad1c6f20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:14.061231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c617ff0a-a720-430a-8601-9c07ad1c6f20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:14.062278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c617ff0a-a720-430a-8601-9c07ad1c6f20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:14.062854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c617ff0a-a720-430a-8601-9c07ad1c6f20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:14.063483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c617ff0a-a720-430a-8601-9c07ad1c6f20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:14.236249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c617ff0a-a720-430a-8601-9c07ad1c6f20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:14.246973 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c617ff0a-a720-430a-8601-9c07ad1c6f20 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1517 microversion: 2.1 time: 0.204115 Sep 10 11:04:14.248210 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3532/4726] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:14 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1517 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:14.283531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a1ed861d-f195-4e35-aa7f-77d214e8957e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:14.285002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a1ed861d-f195-4e35-aa7f-77d214e8957e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:14.291513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ed861d-f195-4e35-aa7f-77d214e8957e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:14.292082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ed861d-f195-4e35-aa7f-77d214e8957e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:14.292452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ed861d-f195-4e35-aa7f-77d214e8957e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:14.293191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ed861d-f195-4e35-aa7f-77d214e8957e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:14.293887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ed861d-f195-4e35-aa7f-77d214e8957e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:14.294676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ed861d-f195-4e35-aa7f-77d214e8957e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:14.395418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a1ed861d-f195-4e35-aa7f-77d214e8957e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:14.413694 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a1ed861d-f195-4e35-aa7f-77d214e8957e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1155 microversion: 2.1 time: 0.135350 Sep 10 11:04:14.421693 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1195/4727] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:14 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1155 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:15.274518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8be8b544-7c0e-4f02-87c2-a50da2eb1758 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:15.275232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8be8b544-7c0e-4f02-87c2-a50da2eb1758 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:15.282288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8be8b544-7c0e-4f02-87c2-a50da2eb1758 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:15.282855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8be8b544-7c0e-4f02-87c2-a50da2eb1758 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:15.283557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8be8b544-7c0e-4f02-87c2-a50da2eb1758 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:15.284254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8be8b544-7c0e-4f02-87c2-a50da2eb1758 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:15.284710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8be8b544-7c0e-4f02-87c2-a50da2eb1758 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:15.285163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8be8b544-7c0e-4f02-87c2-a50da2eb1758 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:15.419274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8be8b544-7c0e-4f02-87c2-a50da2eb1758 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:15.428018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8be8b544-7c0e-4f02-87c2-a50da2eb1758 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1517 microversion: 2.1 time: 0.157503 Sep 10 11:04:15.428611 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3533/4728] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:15 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:15.441832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9f0cbf1a-cf13-4eb1-b58c-a27b436e2d0b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:15.442541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9f0cbf1a-cf13-4eb1-b58c-a27b436e2d0b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:15.451956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f0cbf1a-cf13-4eb1-b58c-a27b436e2d0b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:15.452425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f0cbf1a-cf13-4eb1-b58c-a27b436e2d0b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:15.452883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f0cbf1a-cf13-4eb1-b58c-a27b436e2d0b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:15.453634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f0cbf1a-cf13-4eb1-b58c-a27b436e2d0b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:15.454085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f0cbf1a-cf13-4eb1-b58c-a27b436e2d0b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:15.454508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f0cbf1a-cf13-4eb1-b58c-a27b436e2d0b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:15.524653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9f0cbf1a-cf13-4eb1-b58c-a27b436e2d0b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:15.536779 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9f0cbf1a-cf13-4eb1-b58c-a27b436e2d0b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1155 microversion: 2.1 time: 0.099965 Sep 10 11:04:15.538036 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1196/4729] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:15 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1155 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:16.452145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eea10494-d4a6-45ad-997e-d5128c28c8f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:16.452670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eea10494-d4a6-45ad-997e-d5128c28c8f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:16.462551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea10494-d4a6-45ad-997e-d5128c28c8f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:16.465500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea10494-d4a6-45ad-997e-d5128c28c8f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:16.465975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea10494-d4a6-45ad-997e-d5128c28c8f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:16.467599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea10494-d4a6-45ad-997e-d5128c28c8f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:16.468324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea10494-d4a6-45ad-997e-d5128c28c8f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:16.472153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eea10494-d4a6-45ad-997e-d5128c28c8f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:16.561150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-51943299-0a37-4b02-ab5a-ae8c439e80db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:16.561778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-51943299-0a37-4b02-ab5a-ae8c439e80db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:16.572121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51943299-0a37-4b02-ab5a-ae8c439e80db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:16.579354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51943299-0a37-4b02-ab5a-ae8c439e80db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:16.582452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51943299-0a37-4b02-ab5a-ae8c439e80db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:16.583547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51943299-0a37-4b02-ab5a-ae8c439e80db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:16.584512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51943299-0a37-4b02-ab5a-ae8c439e80db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:16.585449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51943299-0a37-4b02-ab5a-ae8c439e80db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:16.722937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-51943299-0a37-4b02-ab5a-ae8c439e80db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:16.734428 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-51943299-0a37-4b02-ab5a-ae8c439e80db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1173 microversion: 2.1 time: 0.178351 Sep 10 11:04:16.735030 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1197/4730] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:16 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1173 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:16.950169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eea10494-d4a6-45ad-997e-d5128c28c8f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:16.968182 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eea10494-d4a6-45ad-997e-d5128c28c8f1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1517 microversion: 2.1 time: 0.519885 Sep 10 11:04:16.969789 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3534/4731] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:16 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1517 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:17.422472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-90a3bd22-6e6a-4e39-9735-71cf65d37765 req-3f0a51bb-3b90-4893-a324-5b137d78c7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6932f6d9-493e-4c31-a5f8-14d70baf8450", "name": "network-vif-deleted", "tag": "a8f16390-919e-49ff-a61a-e8eddf746ca2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:17.460934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-90a3bd22-6e6a-4e39-9735-71cf65d37765 req-3f0a51bb-3b90-4893-a324-5b137d78c7e4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:17.461458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-90a3bd22-6e6a-4e39-9735-71cf65d37765 req-3f0a51bb-3b90-4893-a324-5b137d78c7e4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:17.461929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-90a3bd22-6e6a-4e39-9735-71cf65d37765 req-3f0a51bb-3b90-4893-a324-5b137d78c7e4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:17.482902 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-90a3bd22-6e6a-4e39-9735-71cf65d37765 req-3f0a51bb-3b90-4893-a324-5b137d78c7e4 service nova] Creating event network-vif-deleted:a8f16390-919e-49ff-a61a-e8eddf746ca2 for instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 on n-h2-856894-1 Sep 10 11:04:17.487882 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-90a3bd22-6e6a-4e39-9735-71cf65d37765 req-3f0a51bb-3b90-4893-a324-5b137d78c7e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076899 Sep 10 11:04:17.488803 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1198/4732] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:17.761728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b59f3c80-ff0c-4c84-9942-712b801f4119 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:17.765191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b59f3c80-ff0c-4c84-9942-712b801f4119 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:17.781842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b59f3c80-ff0c-4c84-9942-712b801f4119 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:17.785441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b59f3c80-ff0c-4c84-9942-712b801f4119 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:17.786751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b59f3c80-ff0c-4c84-9942-712b801f4119 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:17.787599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b59f3c80-ff0c-4c84-9942-712b801f4119 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:17.790927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b59f3c80-ff0c-4c84-9942-712b801f4119 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:17.791590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b59f3c80-ff0c-4c84-9942-712b801f4119 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:17.993014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:17.993756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:18.005460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:18.009985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:18.010654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:18.011454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:18.011984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:18.012479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:18.056498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:18.057374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:18.058006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:18.058678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lazy-loading 'fault' on Instance uuid 6932f6d9-493e-4c31-a5f8-14d70baf8450 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:04:18.171074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:18.179560 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-081b271e-66b0-4a84-8cc7-73ee4d46c555 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 200 len: 1319 microversion: 2.1 time: 0.191334 Sep 10 11:04:18.185992 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1199/4733] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:17 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:18.511502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b59f3c80-ff0c-4c84-9942-712b801f4119 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:18.528353 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b59f3c80-ff0c-4c84-9942-712b801f4119 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1215 microversion: 2.1 time: 0.771394 Sep 10 11:04:18.530982 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3535/4734] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:17 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1215 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:19.214199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:19.214826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:19.225630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:19.226143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:19.226567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:19.227279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:19.227857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:19.228324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:19.248378 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 HTTP/1.1 Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '6932f6d9-493e-4c31-a5f8-14d70baf8450'} Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:04:19.251090 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:19.265935 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:04:19.265935 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:04:19.265935 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:04:19.265935 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:04:19.265935 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:04:19.265935 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:04:19.265935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:04:19.265935 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4850fe90-25c9-4538-b4a7-239f7caca039 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 404 len: 111 microversion: 2.1 time: 0.044115 Sep 10 11:04:19.265935 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1200/4735] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:19 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:04:19.432041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1162802234", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "63c65db1-231a-4e94-b304-7943deb77e20"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:19.508745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] validate_networks() for [('63c65db1-231a-4e94-b304-7943deb77e20', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:04:19.541710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7c8a66c6-0648-42d5-8a32-9ba2a3255cb6 req-5af21daa-3511-4915-a2d4-684505cb7799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f19fff31-52b8-4c4d-82b4-8c84c3aea296", "tag": "359845cd-9a36-43ad-b3e7-388bf1ce5679"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:19.556874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7c8a66c6-0648-42d5-8a32-9ba2a3255cb6 req-5af21daa-3511-4915-a2d4-684505cb7799 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:19.559237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7c8a66c6-0648-42d5-8a32-9ba2a3255cb6 req-5af21daa-3511-4915-a2d4-684505cb7799 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:19.559861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7c8a66c6-0648-42d5-8a32-9ba2a3255cb6 req-5af21daa-3511-4915-a2d4-684505cb7799 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:19.583368 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7c8a66c6-0648-42d5-8a32-9ba2a3255cb6 req-5af21daa-3511-4915-a2d4-684505cb7799 service nova] Creating event network-changed:359845cd-9a36-43ad-b3e7-388bf1ce5679 for instance f19fff31-52b8-4c4d-82b4-8c84c3aea296 on n-h2-856894-1 Sep 10 11:04:19.603431 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-7c8a66c6-0648-42d5-8a32-9ba2a3255cb6 req-5af21daa-3511-4915-a2d4-684505cb7799 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064588 Sep 10 11:04:19.604368 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1201/4736] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:04:19.619931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b2f97780-43dd-41e2-971a-1877ac0466bb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:19.621300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b2f97780-43dd-41e2-971a-1877ac0466bb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:19.641441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2f97780-43dd-41e2-971a-1877ac0466bb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:19.641972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2f97780-43dd-41e2-971a-1877ac0466bb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:19.642422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2f97780-43dd-41e2-971a-1877ac0466bb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:19.644007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2f97780-43dd-41e2-971a-1877ac0466bb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:19.644475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2f97780-43dd-41e2-971a-1877ac0466bb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:19.644905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2f97780-43dd-41e2-971a-1877ac0466bb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:20.108459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b2f97780-43dd-41e2-971a-1877ac0466bb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:20.116498 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b2f97780-43dd-41e2-971a-1877ac0466bb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1215 microversion: 2.1 time: 0.510941 Sep 10 11:04:20.117201 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1202/4737] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:19 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1215 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:20.914701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:04:20.915220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:04:20.915923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:04:20.916678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:04:20.917310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:04:20.933157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:20.935944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:20.936711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:20.937665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:20.940170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:20.940800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:20.998230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:04:21.006360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Getting quotas for user 1fd01ead2408487dbe51fd732c209981 and project 8409664137af4c74a00590b962f14d64. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:04:21.021804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:04:21.025207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:04:21.092966 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-096e26d8-185e-42b1-be1a-0b3bdb9cc7f8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.665770 Sep 10 11:04:21.094376 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3536/4738] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:04:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:04:21.105596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-55c9511c-ecbe-4878-9680-b4ec2dc29f9d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:21.106834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-55c9511c-ecbe-4878-9680-b4ec2dc29f9d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:21.148016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-093faeac-8a34-4392-b9cf-c98c0e0acf2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:21.149334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-093faeac-8a34-4392-b9cf-c98c0e0acf2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:21.164540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093faeac-8a34-4392-b9cf-c98c0e0acf2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:21.165182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093faeac-8a34-4392-b9cf-c98c0e0acf2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:21.165643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093faeac-8a34-4392-b9cf-c98c0e0acf2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:21.167373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093faeac-8a34-4392-b9cf-c98c0e0acf2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:21.167855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093faeac-8a34-4392-b9cf-c98c0e0acf2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:21.170405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-093faeac-8a34-4392-b9cf-c98c0e0acf2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:21.220467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-55c9511c-ecbe-4878-9680-b4ec2dc29f9d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:21.231590 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-55c9511c-ecbe-4878-9680-b4ec2dc29f9d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1209 microversion: 2.1 time: 0.128217 Sep 10 11:04:21.234599 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1203/4739] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:21 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1209 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:21.516726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-093faeac-8a34-4392-b9cf-c98c0e0acf2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:21.539695 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-093faeac-8a34-4392-b9cf-c98c0e0acf2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1215 microversion: 2.1 time: 0.397745 Sep 10 11:04:21.555891 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3537/4740] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:21 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1215 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:22.259693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a3edc4aa-0399-4243-af3f-dca3fa999548 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:22.274185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a3edc4aa-0399-4243-af3f-dca3fa999548 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:22.293298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3edc4aa-0399-4243-af3f-dca3fa999548 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:22.294856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3edc4aa-0399-4243-af3f-dca3fa999548 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:22.297681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3edc4aa-0399-4243-af3f-dca3fa999548 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:22.298774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3edc4aa-0399-4243-af3f-dca3fa999548 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:22.300541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3edc4aa-0399-4243-af3f-dca3fa999548 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:22.301902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3edc4aa-0399-4243-af3f-dca3fa999548 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:22.398441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a3edc4aa-0399-4243-af3f-dca3fa999548 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:22.410319 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a3edc4aa-0399-4243-af3f-dca3fa999548 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1261 microversion: 2.1 time: 0.157209 Sep 10 11:04:22.411226 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1204/4741] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:22 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:22.564903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d4649f8-c291-4cf6-bf68-908eadf25e30 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:22.566902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d4649f8-c291-4cf6-bf68-908eadf25e30 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:22.577441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d4649f8-c291-4cf6-bf68-908eadf25e30 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:22.578250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d4649f8-c291-4cf6-bf68-908eadf25e30 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:22.578881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d4649f8-c291-4cf6-bf68-908eadf25e30 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:22.579795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d4649f8-c291-4cf6-bf68-908eadf25e30 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:22.580439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d4649f8-c291-4cf6-bf68-908eadf25e30 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:22.581037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d4649f8-c291-4cf6-bf68-908eadf25e30 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:22.585886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:22.853002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d4649f8-c291-4cf6-bf68-908eadf25e30 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:22.900611 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d4649f8-c291-4cf6-bf68-908eadf25e30 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1215 microversion: 2.1 time: 0.340804 Sep 10 11:04:22.907240 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3538/4742] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:22 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1215 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:23.157334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6d9d0582-12d4-4dd8-9647-5dfd96fd648e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:23.160234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6d9d0582-12d4-4dd8-9647-5dfd96fd648e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:23.168116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9d0582-12d4-4dd8-9647-5dfd96fd648e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:23.168776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9d0582-12d4-4dd8-9647-5dfd96fd648e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:23.169058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9d0582-12d4-4dd8-9647-5dfd96fd648e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:23.170794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9d0582-12d4-4dd8-9647-5dfd96fd648e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:23.171336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9d0582-12d4-4dd8-9647-5dfd96fd648e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:23.171730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d9d0582-12d4-4dd8-9647-5dfd96fd648e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:23.196870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:23.208667 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6d9d0582-12d4-4dd8-9647-5dfd96fd648e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056392 Sep 10 11:04:23.215250 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1205/4743] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:04:23 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:04:23.304610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be340e36-f045-46ab-bea4-ff2200a4111a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:23.305131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be340e36-f045-46ab-bea4-ff2200a4111a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:23.313564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be340e36-f045-46ab-bea4-ff2200a4111a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:23.319401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be340e36-f045-46ab-bea4-ff2200a4111a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:23.320123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be340e36-f045-46ab-bea4-ff2200a4111a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:23.321046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be340e36-f045-46ab-bea4-ff2200a4111a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:23.321746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be340e36-f045-46ab-bea4-ff2200a4111a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:23.322366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be340e36-f045-46ab-bea4-ff2200a4111a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:23.375535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be340e36-f045-46ab-bea4-ff2200a4111a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:04:23.434311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-68dc5e87-7169-4b36-88bc-ed27a6c2051d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:23.435675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-68dc5e87-7169-4b36-88bc-ed27a6c2051d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:23.448346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dc5e87-7169-4b36-88bc-ed27a6c2051d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:23.449021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dc5e87-7169-4b36-88bc-ed27a6c2051d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:23.449537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dc5e87-7169-4b36-88bc-ed27a6c2051d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:23.450452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dc5e87-7169-4b36-88bc-ed27a6c2051d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:23.452672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dc5e87-7169-4b36-88bc-ed27a6c2051d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:23.455517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68dc5e87-7169-4b36-88bc-ed27a6c2051d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:23.475926 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be340e36-f045-46ab-bea4-ff2200a4111a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 204 len: 0 microversion: 2.1 time: 0.174770 Sep 10 11:04:23.480117 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3539/4744] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:04:23 2022] DELETE /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:04:23.486445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71c26e7f-70a1-4ffb-97f8-1154d14f609d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:23.487172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-71c26e7f-70a1-4ffb-97f8-1154d14f609d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:23.496330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c26e7f-70a1-4ffb-97f8-1154d14f609d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:23.496330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c26e7f-70a1-4ffb-97f8-1154d14f609d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:23.496330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c26e7f-70a1-4ffb-97f8-1154d14f609d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:23.496957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c26e7f-70a1-4ffb-97f8-1154d14f609d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:23.498056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c26e7f-70a1-4ffb-97f8-1154d14f609d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:23.499171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71c26e7f-70a1-4ffb-97f8-1154d14f609d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:23.615912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-68dc5e87-7169-4b36-88bc-ed27a6c2051d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:23.627382 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-68dc5e87-7169-4b36-88bc-ed27a6c2051d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1267 microversion: 2.1 time: 0.196931 Sep 10 11:04:23.629676 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1206/4745] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:23 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:23.768680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-71c26e7f-70a1-4ffb-97f8-1154d14f609d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:23.790783 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71c26e7f-70a1-4ffb-97f8-1154d14f609d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1674 microversion: 2.1 time: 0.308731 Sep 10 11:04:23.792287 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3540/4746] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:23 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1674 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:23.934365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-61acd551-b753-4dbe-9e93-26d50466bfc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:23.935827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-61acd551-b753-4dbe-9e93-26d50466bfc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:23.953103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61acd551-b753-4dbe-9e93-26d50466bfc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:23.954568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61acd551-b753-4dbe-9e93-26d50466bfc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:23.956556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61acd551-b753-4dbe-9e93-26d50466bfc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:23.958065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61acd551-b753-4dbe-9e93-26d50466bfc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:23.961356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61acd551-b753-4dbe-9e93-26d50466bfc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:23.961920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61acd551-b753-4dbe-9e93-26d50466bfc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:24.167747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-61acd551-b753-4dbe-9e93-26d50466bfc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:24.176672 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-61acd551-b753-4dbe-9e93-26d50466bfc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1203 microversion: 2.1 time: 0.246899 Sep 10 11:04:24.195681 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1207/4747] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:23 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1203 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:24.650878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f40e85f0-aa9c-41f1-a957-487f3c5b3e44 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:24.651576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f40e85f0-aa9c-41f1-a957-487f3c5b3e44 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:24.659237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f40e85f0-aa9c-41f1-a957-487f3c5b3e44 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:24.659733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f40e85f0-aa9c-41f1-a957-487f3c5b3e44 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:24.660174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f40e85f0-aa9c-41f1-a957-487f3c5b3e44 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:24.660876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f40e85f0-aa9c-41f1-a957-487f3c5b3e44 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:24.661372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f40e85f0-aa9c-41f1-a957-487f3c5b3e44 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:24.661806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f40e85f0-aa9c-41f1-a957-487f3c5b3e44 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:24.816063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f40e85f0-aa9c-41f1-a957-487f3c5b3e44 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:24.820351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b516b687-3d6e-4ad6-b068-582507e5fec6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:24.820975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b516b687-3d6e-4ad6-b068-582507e5fec6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:24.826462 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f40e85f0-aa9c-41f1-a957-487f3c5b3e44 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1309 microversion: 2.1 time: 0.180043 Sep 10 11:04:24.827164 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3541/4748] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:24 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1309 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:24.832678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b516b687-3d6e-4ad6-b068-582507e5fec6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:24.833206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b516b687-3d6e-4ad6-b068-582507e5fec6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:24.833649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b516b687-3d6e-4ad6-b068-582507e5fec6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:24.834489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b516b687-3d6e-4ad6-b068-582507e5fec6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:24.834949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b516b687-3d6e-4ad6-b068-582507e5fec6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:24.835374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b516b687-3d6e-4ad6-b068-582507e5fec6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:25.013668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b516b687-3d6e-4ad6-b068-582507e5fec6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:25.023950 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b516b687-3d6e-4ad6-b068-582507e5fec6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1674 microversion: 2.1 time: 0.208884 Sep 10 11:04:25.025061 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1208/4749] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:24 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1674 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:25.202845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b7b90f9-ab1a-4491-8c77-f2f3c9d36c7c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:25.204021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b7b90f9-ab1a-4491-8c77-f2f3c9d36c7c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:25.210479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7b90f9-ab1a-4491-8c77-f2f3c9d36c7c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:25.211222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7b90f9-ab1a-4491-8c77-f2f3c9d36c7c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:25.211980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7b90f9-ab1a-4491-8c77-f2f3c9d36c7c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:25.212868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7b90f9-ab1a-4491-8c77-f2f3c9d36c7c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:25.213536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7b90f9-ab1a-4491-8c77-f2f3c9d36c7c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:25.214477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7b90f9-ab1a-4491-8c77-f2f3c9d36c7c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:25.537887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b7b90f9-ab1a-4491-8c77-f2f3c9d36c7c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:25.555419 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b7b90f9-ab1a-4491-8c77-f2f3c9d36c7c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1203 microversion: 2.1 time: 0.352090 Sep 10 11:04:25.556362 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3542/4750] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:25 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1203 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:25.851714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7792191d-5854-457b-aca4-83d5f3d8787c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:25.854934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7792191d-5854-457b-aca4-83d5f3d8787c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:25.865946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7792191d-5854-457b-aca4-83d5f3d8787c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:25.866889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7792191d-5854-457b-aca4-83d5f3d8787c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:25.867528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7792191d-5854-457b-aca4-83d5f3d8787c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:25.868599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7792191d-5854-457b-aca4-83d5f3d8787c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:25.869325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7792191d-5854-457b-aca4-83d5f3d8787c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:25.870420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7792191d-5854-457b-aca4-83d5f3d8787c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:26.055565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-04fdbfd0-e049-45ac-8ba9-113bfd5a2a90 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:26.056937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-04fdbfd0-e049-45ac-8ba9-113bfd5a2a90 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:26.065703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04fdbfd0-e049-45ac-8ba9-113bfd5a2a90 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:26.066600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04fdbfd0-e049-45ac-8ba9-113bfd5a2a90 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:26.067301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04fdbfd0-e049-45ac-8ba9-113bfd5a2a90 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:26.068121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04fdbfd0-e049-45ac-8ba9-113bfd5a2a90 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:26.068805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04fdbfd0-e049-45ac-8ba9-113bfd5a2a90 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:26.069514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04fdbfd0-e049-45ac-8ba9-113bfd5a2a90 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:26.283607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7792191d-5854-457b-aca4-83d5f3d8787c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:26.308224 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7792191d-5854-457b-aca4-83d5f3d8787c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1309 microversion: 2.1 time: 0.460347 Sep 10 11:04:26.308958 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1209/4751] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:25 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1309 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:26.490882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-04fdbfd0-e049-45ac-8ba9-113bfd5a2a90 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:26.501103 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-04fdbfd0-e049-45ac-8ba9-113bfd5a2a90 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1674 microversion: 2.1 time: 0.449831 Sep 10 11:04:26.502275 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3543/4752] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:26 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1674 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:26.584243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-01c961c0-940a-4de7-93a2-8916b8eb3c29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:26.584701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-01c961c0-940a-4de7-93a2-8916b8eb3c29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:26.596041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01c961c0-940a-4de7-93a2-8916b8eb3c29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:26.596256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01c961c0-940a-4de7-93a2-8916b8eb3c29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:26.602658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01c961c0-940a-4de7-93a2-8916b8eb3c29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:26.603553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01c961c0-940a-4de7-93a2-8916b8eb3c29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:26.610262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01c961c0-940a-4de7-93a2-8916b8eb3c29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:26.610727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01c961c0-940a-4de7-93a2-8916b8eb3c29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:27.336016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f46363a9-fbfa-4401-9f3f-9ba3e92a6cd5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:27.337427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f46363a9-fbfa-4401-9f3f-9ba3e92a6cd5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:27.360265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f46363a9-fbfa-4401-9f3f-9ba3e92a6cd5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:27.360799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f46363a9-fbfa-4401-9f3f-9ba3e92a6cd5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:27.363037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f46363a9-fbfa-4401-9f3f-9ba3e92a6cd5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:27.365887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f46363a9-fbfa-4401-9f3f-9ba3e92a6cd5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:27.366383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f46363a9-fbfa-4401-9f3f-9ba3e92a6cd5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:27.367489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f46363a9-fbfa-4401-9f3f-9ba3e92a6cd5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:27.476070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-01c961c0-940a-4de7-93a2-8916b8eb3c29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:27.485678 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-01c961c0-940a-4de7-93a2-8916b8eb3c29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1203 microversion: 2.1 time: 0.906697 Sep 10 11:04:27.486433 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1210/4753] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:26 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1203 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:27.527967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6ac618fd-fd34-4502-be8d-215370fce22c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:27.529566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6ac618fd-fd34-4502-be8d-215370fce22c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:27.536164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ac618fd-fd34-4502-be8d-215370fce22c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:27.536749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ac618fd-fd34-4502-be8d-215370fce22c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:27.537308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ac618fd-fd34-4502-be8d-215370fce22c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:27.538101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ac618fd-fd34-4502-be8d-215370fce22c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:27.538642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ac618fd-fd34-4502-be8d-215370fce22c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:27.539910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ac618fd-fd34-4502-be8d-215370fce22c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:28.059309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f46363a9-fbfa-4401-9f3f-9ba3e92a6cd5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:28.091557 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f46363a9-fbfa-4401-9f3f-9ba3e92a6cd5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1309 microversion: 2.1 time: 0.756318 Sep 10 11:04:28.105267 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3544/4754] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:27 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1309 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:28.192509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6ac618fd-fd34-4502-be8d-215370fce22c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:28.209272 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6ac618fd-fd34-4502-be8d-215370fce22c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1674 microversion: 2.1 time: 0.682437 Sep 10 11:04:28.209932 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1211/4755] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:27 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1674 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:28.514609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ca2debfb-65d3-4a68-a59f-bf6bdbb11236 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:28.517839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ca2debfb-65d3-4a68-a59f-bf6bdbb11236 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:28.531013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca2debfb-65d3-4a68-a59f-bf6bdbb11236 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:28.531767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca2debfb-65d3-4a68-a59f-bf6bdbb11236 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:28.532375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca2debfb-65d3-4a68-a59f-bf6bdbb11236 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:28.533313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca2debfb-65d3-4a68-a59f-bf6bdbb11236 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:28.534619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca2debfb-65d3-4a68-a59f-bf6bdbb11236 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:28.535216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca2debfb-65d3-4a68-a59f-bf6bdbb11236 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:29.116580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f31785b7-623d-439c-b5c9-4f360cf7748c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:29.117309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f31785b7-623d-439c-b5c9-4f360cf7748c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:29.124598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:29.127502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f31785b7-623d-439c-b5c9-4f360cf7748c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:29.128186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f31785b7-623d-439c-b5c9-4f360cf7748c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:29.128622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f31785b7-623d-439c-b5c9-4f360cf7748c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:29.129702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f31785b7-623d-439c-b5c9-4f360cf7748c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:29.130160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f31785b7-623d-439c-b5c9-4f360cf7748c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:29.130635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f31785b7-623d-439c-b5c9-4f360cf7748c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:29.480183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ca2debfb-65d3-4a68-a59f-bf6bdbb11236 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:29.489833 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ca2debfb-65d3-4a68-a59f-bf6bdbb11236 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1203 microversion: 2.1 time: 0.981339 Sep 10 11:04:29.511129 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3545/4756] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:28 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1203 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:29.516205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15676ba6-e571-4731-a8f8-6aa9fae72fc8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:29.516802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15676ba6-e571-4731-a8f8-6aa9fae72fc8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:29.539277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15676ba6-e571-4731-a8f8-6aa9fae72fc8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:29.540110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15676ba6-e571-4731-a8f8-6aa9fae72fc8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:29.540742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15676ba6-e571-4731-a8f8-6aa9fae72fc8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:29.541972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15676ba6-e571-4731-a8f8-6aa9fae72fc8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:29.542439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15676ba6-e571-4731-a8f8-6aa9fae72fc8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:29.542878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15676ba6-e571-4731-a8f8-6aa9fae72fc8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:29.768817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15676ba6-e571-4731-a8f8-6aa9fae72fc8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:29.777424 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15676ba6-e571-4731-a8f8-6aa9fae72fc8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1607 microversion: 2.1 time: 0.265042 Sep 10 11:04:29.778309 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3546/4757] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:29 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1607 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:29.781285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f31785b7-623d-439c-b5c9-4f360cf7748c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:29.789777 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f31785b7-623d-439c-b5c9-4f360cf7748c tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1309 microversion: 2.1 time: 0.677676 Sep 10 11:04:29.790455 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1212/4758] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:29 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1309 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:29.990466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9d2960ca-3c4b-4456-a29c-0b0e07e79977 req-f77070ca-a23f-4ccf-8631-14cceef51375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c53df17-1104-4c20-b184-7807456e91fb", "tag": "e8764eca-1194-460a-b84c-f4bd69979006"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:30.037304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d2960ca-3c4b-4456-a29c-0b0e07e79977 req-f77070ca-a23f-4ccf-8631-14cceef51375 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:30.038142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d2960ca-3c4b-4456-a29c-0b0e07e79977 req-f77070ca-a23f-4ccf-8631-14cceef51375 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:30.040022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9d2960ca-3c4b-4456-a29c-0b0e07e79977 req-f77070ca-a23f-4ccf-8631-14cceef51375 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:30.065025 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9d2960ca-3c4b-4456-a29c-0b0e07e79977 req-f77070ca-a23f-4ccf-8631-14cceef51375 service nova] Creating event network-changed:e8764eca-1194-460a-b84c-f4bd69979006 for instance 5c53df17-1104-4c20-b184-7807456e91fb on n-h2-856894-1 Sep 10 11:04:30.070804 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9d2960ca-3c4b-4456-a29c-0b0e07e79977 req-f77070ca-a23f-4ccf-8631-14cceef51375 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085490 Sep 10 11:04:30.071831 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3547/4759] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:30.437451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-e0b4e2b8-72b2-4f09-84d5-1e91305bbce5 req-b9fa8356-0efb-4953-8327-7678471c9fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19fff31-52b8-4c4d-82b4-8c84c3aea296", "name": "network-vif-plugged", "status": "completed", "tag": "359845cd-9a36-43ad-b3e7-388bf1ce5679"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:30.458710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e0b4e2b8-72b2-4f09-84d5-1e91305bbce5 req-b9fa8356-0efb-4953-8327-7678471c9fd8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:30.459731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e0b4e2b8-72b2-4f09-84d5-1e91305bbce5 req-b9fa8356-0efb-4953-8327-7678471c9fd8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:30.460794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e0b4e2b8-72b2-4f09-84d5-1e91305bbce5 req-b9fa8356-0efb-4953-8327-7678471c9fd8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:30.475170 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-e0b4e2b8-72b2-4f09-84d5-1e91305bbce5 req-b9fa8356-0efb-4953-8327-7678471c9fd8 service nova] Creating event network-vif-plugged:359845cd-9a36-43ad-b3e7-388bf1ce5679 for instance f19fff31-52b8-4c4d-82b4-8c84c3aea296 on n-h2-856894-1 Sep 10 11:04:30.484597 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-e0b4e2b8-72b2-4f09-84d5-1e91305bbce5 req-b9fa8356-0efb-4953-8327-7678471c9fd8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050970 Sep 10 11:04:30.486766 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1213/4760] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:04:30.529298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a7c6fbb-845a-4ac9-95b3-ab22b7a39a83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:30.531097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1a7c6fbb-845a-4ac9-95b3-ab22b7a39a83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:30.554617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a7c6fbb-845a-4ac9-95b3-ab22b7a39a83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:30.555226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a7c6fbb-845a-4ac9-95b3-ab22b7a39a83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:30.555930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a7c6fbb-845a-4ac9-95b3-ab22b7a39a83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:30.556973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a7c6fbb-845a-4ac9-95b3-ab22b7a39a83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:30.557555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a7c6fbb-845a-4ac9-95b3-ab22b7a39a83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:30.558062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a7c6fbb-845a-4ac9-95b3-ab22b7a39a83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:30.821785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6d0cf100-428f-451e-aba4-0322905019c3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:30.822716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6d0cf100-428f-451e-aba4-0322905019c3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:30.832166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d0cf100-428f-451e-aba4-0322905019c3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:30.832809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d0cf100-428f-451e-aba4-0322905019c3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:30.833422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d0cf100-428f-451e-aba4-0322905019c3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:30.834414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d0cf100-428f-451e-aba4-0322905019c3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:30.844391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d0cf100-428f-451e-aba4-0322905019c3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:30.845314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d0cf100-428f-451e-aba4-0322905019c3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:30.960731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:31.014032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=14 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:31.225140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:31.390092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1a7c6fbb-845a-4ac9-95b3-ab22b7a39a83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:31.407650 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a7c6fbb-845a-4ac9-95b3-ab22b7a39a83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1203 microversion: 2.1 time: 0.889297 Sep 10 11:04:31.408906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3548/4761] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:30 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1203 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:31.432149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:31.432965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:31.440363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:31.441092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:31.441711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:31.442575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:31.443189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:31.443790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:31.486088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:31.488629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:31.489739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:31.490225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lazy-loading 'fault' on Instance uuid f98521ad-ebd1-473c-945f-70d80d31c1b7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:04:31.595822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6d0cf100-428f-451e-aba4-0322905019c3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:31.610078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:31.624057 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6d0cf100-428f-451e-aba4-0322905019c3 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1309 microversion: 2.1 time: 0.806741 Sep 10 11:04:31.624709 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1214/4762] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:30 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1309 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:31.625481 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7911a53-b579-4c19-baa4-8184c8453f7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 200 len: 1328 microversion: 2.1 time: 0.200108 Sep 10 11:04:31.627847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3549/4763] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:31 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 1328 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:32.133570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-69e8273e-d5d8-4b7b-bd53-8a2b4e8df0ba req-776414c5-8ce9-4f1f-a360-0d525d2ff926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98521ad-ebd1-473c-945f-70d80d31c1b7", "name": "network-vif-deleted", "tag": "0c6312a0-b8d5-46be-a4cf-b31024eeb9e3"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:32.148272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-69e8273e-d5d8-4b7b-bd53-8a2b4e8df0ba req-776414c5-8ce9-4f1f-a360-0d525d2ff926 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:32.149182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-69e8273e-d5d8-4b7b-bd53-8a2b4e8df0ba req-776414c5-8ce9-4f1f-a360-0d525d2ff926 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:32.149851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-69e8273e-d5d8-4b7b-bd53-8a2b4e8df0ba req-776414c5-8ce9-4f1f-a360-0d525d2ff926 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:32.164654 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-69e8273e-d5d8-4b7b-bd53-8a2b4e8df0ba req-776414c5-8ce9-4f1f-a360-0d525d2ff926 service nova] Creating event network-vif-deleted:0c6312a0-b8d5-46be-a4cf-b31024eeb9e3 for instance f98521ad-ebd1-473c-945f-70d80d31c1b7 on n-h2-856894-1 Sep 10 11:04:32.172255 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-69e8273e-d5d8-4b7b-bd53-8a2b4e8df0ba req-776414c5-8ce9-4f1f-a360-0d525d2ff926 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045748 Sep 10 11:04:32.173474 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1215/4764] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:32.435999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f95926ae-3ad4-431c-bc8b-afcd3eee63ae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:32.436784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f95926ae-3ad4-431c-bc8b-afcd3eee63ae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:32.446819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95926ae-3ad4-431c-bc8b-afcd3eee63ae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:32.446819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95926ae-3ad4-431c-bc8b-afcd3eee63ae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:32.446819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95926ae-3ad4-431c-bc8b-afcd3eee63ae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:32.451362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95926ae-3ad4-431c-bc8b-afcd3eee63ae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:32.452392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95926ae-3ad4-431c-bc8b-afcd3eee63ae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:32.452392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f95926ae-3ad4-431c-bc8b-afcd3eee63ae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:32.648213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-db3474d6-91bb-4755-afbd-722d297ed9a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:32.648922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-db3474d6-91bb-4755-afbd-722d297ed9a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:32.668166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f95926ae-3ad4-431c-bc8b-afcd3eee63ae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:32.668689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db3474d6-91bb-4755-afbd-722d297ed9a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:32.668804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db3474d6-91bb-4755-afbd-722d297ed9a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:32.669815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db3474d6-91bb-4755-afbd-722d297ed9a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:32.670536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db3474d6-91bb-4755-afbd-722d297ed9a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:32.670992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db3474d6-91bb-4755-afbd-722d297ed9a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:32.671421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db3474d6-91bb-4755-afbd-722d297ed9a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:32.678819 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f95926ae-3ad4-431c-bc8b-afcd3eee63ae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1203 microversion: 2.1 time: 0.247209 Sep 10 11:04:32.680200 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3550/4765] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:32 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1203 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:32.685364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:32.686173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:32.707919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:32.708787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:32.710376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:32.711622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:32.713425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:32.714104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:32.737293 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] HTTP exception thrown: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Request method failure captured: Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 HTTP/1.1 Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG5xr4xEZSbwqvKsosR-Wb4IhcH19qfMZka_BIhEoN55s7E2J-PE0L10Q81wGR5FqpuBz4qgA8TdMwRw3ev6mwmabC4SGljmHxpcYVp4fSTOJq2D3chJA0_NH0MvZpbcazsOSh3iRJAlwhnp_0PNMTAVYDQbDRSK9FlQ0Z2oraJjX5E Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_803a48d9302b4d52b80bf4b49fac53ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 7a58544226204f62807e56bb34c7d5d8 Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f98521ad-ebd1-473c-945f-70d80d31c1b7'} Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:04:32.739865 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:32.745155 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:32.745155 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:04:32.745155 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:04:32.745155 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:04:32.745155 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:04:32.745155 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:04:32.745155 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:32.747781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Returning 404 to user: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:04:32.749449 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e44e5d80-e034-4989-b89a-3ac28425e45a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 404 len: 111 microversion: 2.1 time: 0.068002 Sep 10 11:04:32.750192 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3551/4766] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:32 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:04:32.760857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6cca3c6-3228-4f94-b60b-8dd2ac2f54a5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '.version_select at 0x7efcaeb77c10>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:32.788748 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6cca3c6-3228-4f94-b60b-8dd2ac2f54a5 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925231058" status: 202 len: 0 microversion: 2.1 time: 0.032610 Sep 10 11:04:32.790155 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3552/4767] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 11:04:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925231058 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:04:32.925856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-db3474d6-91bb-4755-afbd-722d297ed9a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:32.938483 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-db3474d6-91bb-4755-afbd-722d297ed9a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1309 microversion: 2.1 time: 0.292260 Sep 10 11:04:32.940148 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1216/4768] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:32 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:33.709152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-839e56c5-85d1-477d-88db-654ff19ffb63 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:33.710044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-839e56c5-85d1-477d-88db-654ff19ffb63 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:33.727445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-839e56c5-85d1-477d-88db-654ff19ffb63 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:33.728098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-839e56c5-85d1-477d-88db-654ff19ffb63 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:33.733682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-839e56c5-85d1-477d-88db-654ff19ffb63 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:33.734613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-839e56c5-85d1-477d-88db-654ff19ffb63 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:33.735208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-839e56c5-85d1-477d-88db-654ff19ffb63 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:33.735937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-839e56c5-85d1-477d-88db-654ff19ffb63 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:33.966859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-48e092bf-a935-4724-9b64-f5f053cc0e13 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:33.967510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-48e092bf-a935-4724-9b64-f5f053cc0e13 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:33.998040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e092bf-a935-4724-9b64-f5f053cc0e13 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:33.998567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e092bf-a935-4724-9b64-f5f053cc0e13 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:33.999015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e092bf-a935-4724-9b64-f5f053cc0e13 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:34.008549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e092bf-a935-4724-9b64-f5f053cc0e13 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:34.009470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e092bf-a935-4724-9b64-f5f053cc0e13 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:34.013184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e092bf-a935-4724-9b64-f5f053cc0e13 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:34.242695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-839e56c5-85d1-477d-88db-654ff19ffb63 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:34.252084 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-839e56c5-85d1-477d-88db-654ff19ffb63 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1390 microversion: 2.1 time: 0.548852 Sep 10 11:04:34.253289 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3553/4769] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:33 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1390 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:34.288726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-43d6b318-bb2f-4d3c-beea-5c58305b8986 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:34.289371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-43d6b318-bb2f-4d3c-beea-5c58305b8986 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:34.296342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d6b318-bb2f-4d3c-beea-5c58305b8986 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:34.297353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d6b318-bb2f-4d3c-beea-5c58305b8986 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:34.297955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d6b318-bb2f-4d3c-beea-5c58305b8986 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:34.298831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d6b318-bb2f-4d3c-beea-5c58305b8986 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:34.300469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d6b318-bb2f-4d3c-beea-5c58305b8986 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:34.305894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-43d6b318-bb2f-4d3c-beea-5c58305b8986 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:35.073463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-43d6b318-bb2f-4d3c-beea-5c58305b8986 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:35.088008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-48e092bf-a935-4724-9b64-f5f053cc0e13 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:35.091853 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-43d6b318-bb2f-4d3c-beea-5c58305b8986 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1390 microversion: 2.1 time: 0.819187 Sep 10 11:04:35.103544 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-48e092bf-a935-4724-9b64-f5f053cc0e13 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1309 microversion: 2.1 time: 1.140551 Sep 10 11:04:35.105468 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3554/4770] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:34 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1390 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:35.105695 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1217/4771] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:33 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1309 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:35.116328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a1135c68-3443-4e75-9220-a558f10515a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'create', calling method: .version_select at 0x7efcae3dce50>, body: {"keypair": {"name": "tempest-keypair-1451752615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6ghrxaF1PTz1kw1AAXRaTs8JVKwlwmMRvXf2M0AaM3WMw1GaYialYFOjHwKid+EAnvHiX7F8o3IBZ8K6aQzCl6nmqtU3psZiQFvoyLvgHqs6NNGNnYkd11E4YwcckeNw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:35.123937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5fc164e8-97d3-4e57-9b47-b0a2100dd209 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:35.125506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5fc164e8-97d3-4e57-9b47-b0a2100dd209 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:35.142344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5fc164e8-97d3-4e57-9b47-b0a2100dd209 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:35.143385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5fc164e8-97d3-4e57-9b47-b0a2100dd209 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:35.144050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5fc164e8-97d3-4e57-9b47-b0a2100dd209 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:35.145926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5fc164e8-97d3-4e57-9b47-b0a2100dd209 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:35.147892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5fc164e8-97d3-4e57-9b47-b0a2100dd209 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:35.148963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5fc164e8-97d3-4e57-9b47-b0a2100dd209 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:35.152366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a1135c68-3443-4e75-9220-a558f10515a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Getting quotas for project 803a48d9302b4d52b80bf4b49fac53ba. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:04:35.165416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a1135c68-3443-4e75-9220-a558f10515a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Getting quotas for user 7a58544226204f62807e56bb34c7d5d8 and project 803a48d9302b4d52b80bf4b49fac53ba. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:04:35.193613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:35.215178 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a1135c68-3443-4e75-9220-a558f10515a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108537 Sep 10 11:04:35.217683 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3555/4772] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:04:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:35.487932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5fc164e8-97d3-4e57-9b47-b0a2100dd209 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:35.498705 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5fc164e8-97d3-4e57-9b47-b0a2100dd209 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1390 microversion: 2.1 time: 0.384124 Sep 10 11:04:35.499307 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1218/4773] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:35 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1390 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:35.526378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7b61da9-8e0f-4f39-89b9-c75599f76d2f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:35.526619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7b61da9-8e0f-4f39-89b9-c75599f76d2f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:35.550439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7b61da9-8e0f-4f39-89b9-c75599f76d2f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:35.550955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7b61da9-8e0f-4f39-89b9-c75599f76d2f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:35.551392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7b61da9-8e0f-4f39-89b9-c75599f76d2f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:35.555821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7b61da9-8e0f-4f39-89b9-c75599f76d2f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:35.558352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7b61da9-8e0f-4f39-89b9-c75599f76d2f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:35.558937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7b61da9-8e0f-4f39-89b9-c75599f76d2f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:35.572609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:35.636007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7b61da9-8e0f-4f39-89b9-c75599f76d2f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:04:35.775766 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7b61da9-8e0f-4f39-89b9-c75599f76d2f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 204 len: 0 microversion: 2.1 time: 0.254110 Sep 10 11:04:35.776538 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3556/4774] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:04:35 2022] DELETE /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:04:35.790060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7d830922-b854-4f39-86d1-db935c4dbda4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:35.791157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7d830922-b854-4f39-86d1-db935c4dbda4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:35.808527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d830922-b854-4f39-86d1-db935c4dbda4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:35.809028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d830922-b854-4f39-86d1-db935c4dbda4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:35.813775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d830922-b854-4f39-86d1-db935c4dbda4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:35.814381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d830922-b854-4f39-86d1-db935c4dbda4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:35.814844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d830922-b854-4f39-86d1-db935c4dbda4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:35.821872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d830922-b854-4f39-86d1-db935c4dbda4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:35.987909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7d830922-b854-4f39-86d1-db935c4dbda4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:35.998631 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7d830922-b854-4f39-86d1-db935c4dbda4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1396 microversion: 2.1 time: 0.217100 Sep 10 11:04:35.999665 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1219/4775] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:35 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1396 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:36.133581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f7698b2-0d25-4498-bbb8-477976beb0f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:36.134309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f7698b2-0d25-4498-bbb8-477976beb0f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:36.142888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f7698b2-0d25-4498-bbb8-477976beb0f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:36.143392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f7698b2-0d25-4498-bbb8-477976beb0f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:36.143830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f7698b2-0d25-4498-bbb8-477976beb0f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:36.144535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f7698b2-0d25-4498-bbb8-477976beb0f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:36.145002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f7698b2-0d25-4498-bbb8-477976beb0f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:36.145546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f7698b2-0d25-4498-bbb8-477976beb0f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:36.368912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f7698b2-0d25-4498-bbb8-477976beb0f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:36.384103 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f7698b2-0d25-4498-bbb8-477976beb0f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1309 microversion: 2.1 time: 0.254637 Sep 10 11:04:36.385611 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3557/4776] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:36 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1309 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:36.548920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-fe878046-6792-4b17-baff-462f09299d28 req-5392200b-dfac-49f5-bfa9-5dfd020ade8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c53df17-1104-4c20-b184-7807456e91fb", "name": "network-vif-plugged", "status": "completed", "tag": "e8764eca-1194-460a-b84c-f4bd69979006"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:36.573963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fe878046-6792-4b17-baff-462f09299d28 req-5392200b-dfac-49f5-bfa9-5dfd020ade8f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:36.574452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fe878046-6792-4b17-baff-462f09299d28 req-5392200b-dfac-49f5-bfa9-5dfd020ade8f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:36.578305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-fe878046-6792-4b17-baff-462f09299d28 req-5392200b-dfac-49f5-bfa9-5dfd020ade8f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:36.602609 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-fe878046-6792-4b17-baff-462f09299d28 req-5392200b-dfac-49f5-bfa9-5dfd020ade8f service nova] Creating event network-vif-plugged:e8764eca-1194-460a-b84c-f4bd69979006 for instance 5c53df17-1104-4c20-b184-7807456e91fb on n-h2-856894-1 Sep 10 11:04:36.608841 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-fe878046-6792-4b17-baff-462f09299d28 req-5392200b-dfac-49f5-bfa9-5dfd020ade8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064831 Sep 10 11:04:36.610551 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1220/4777] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:37.023443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e58b800-c06a-4c87-aa22-ae7dc6b65e64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:37.024078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e58b800-c06a-4c87-aa22-ae7dc6b65e64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:37.032800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e58b800-c06a-4c87-aa22-ae7dc6b65e64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:37.033925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e58b800-c06a-4c87-aa22-ae7dc6b65e64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:37.034596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e58b800-c06a-4c87-aa22-ae7dc6b65e64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:37.035514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e58b800-c06a-4c87-aa22-ae7dc6b65e64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:37.036171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e58b800-c06a-4c87-aa22-ae7dc6b65e64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:37.036795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e58b800-c06a-4c87-aa22-ae7dc6b65e64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:37.339734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e58b800-c06a-4c87-aa22-ae7dc6b65e64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:37.355218 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e58b800-c06a-4c87-aa22-ae7dc6b65e64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1396 microversion: 2.1 time: 0.336420 Sep 10 11:04:37.369549 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3558/4778] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:37 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1396 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:37.409264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0bf6d837-f258-42d7-aad4-07a9dd715f39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:37.410421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0bf6d837-f258-42d7-aad4-07a9dd715f39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:37.417729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bf6d837-f258-42d7-aad4-07a9dd715f39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:37.418848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bf6d837-f258-42d7-aad4-07a9dd715f39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:37.420051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bf6d837-f258-42d7-aad4-07a9dd715f39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:37.421025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bf6d837-f258-42d7-aad4-07a9dd715f39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:37.421754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bf6d837-f258-42d7-aad4-07a9dd715f39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:37.422402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bf6d837-f258-42d7-aad4-07a9dd715f39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:37.700990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0bf6d837-f258-42d7-aad4-07a9dd715f39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:37.709130 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0bf6d837-f258-42d7-aad4-07a9dd715f39 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1309 microversion: 2.1 time: 0.304419 Sep 10 11:04:37.712818 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1221/4779] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:37 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1309 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:37.749478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1074746308", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98fa1449-9822-4804-b24d-42a2b19af563"}], "security_groups": [{"name": "tempest-securitygroup--440492909"}], "key_name": "tempest-keypair-1451752615", "user_data": "}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:37.912717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] validate_networks() for [('98fa1449-9822-4804-b24d-42a2b19af563', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:04:38.092319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a6cb1ceb-c8f8-4557-861e-7e0d5c5d429e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Action: 'create', calling method: .version_select at 0x7efcade1ea60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-172263200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWZ290ME5bBvZgy8Ie9er4O8/Mat9z2EV8EBsiG9VZOf6OYGj75/OnBEqCCi1bNOw6f+iTls0zDS61hlmdMcahbqMiW3hMcB7a1gdAvVS6MrB8q6rJjEdUT/QNIJsPLAw=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:38.123268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-a6cb1ceb-c8f8-4557-861e-7e0d5c5d429e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:04:38.131754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-a6cb1ceb-c8f8-4557-861e-7e0d5c5d429e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for user 5075387b0b14438ab9164683b752b867 and project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:04:38.161134 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a6cb1ceb-c8f8-4557-861e-7e0d5c5d429e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.073057 Sep 10 11:04:38.164220 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1222/4780] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:04:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:04:38.382750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2cfaf943-20f7-4720-bbbd-6043bcc71a69 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:38.383379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2cfaf943-20f7-4720-bbbd-6043bcc71a69 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:38.395556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cfaf943-20f7-4720-bbbd-6043bcc71a69 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:38.396060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cfaf943-20f7-4720-bbbd-6043bcc71a69 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:38.396568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cfaf943-20f7-4720-bbbd-6043bcc71a69 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:38.397313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cfaf943-20f7-4720-bbbd-6043bcc71a69 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:38.397772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cfaf943-20f7-4720-bbbd-6043bcc71a69 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:38.398197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cfaf943-20f7-4720-bbbd-6043bcc71a69 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:38.625991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2cfaf943-20f7-4720-bbbd-6043bcc71a69 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:38.634930 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2cfaf943-20f7-4720-bbbd-6043bcc71a69 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1354 microversion: 2.1 time: 0.256200 Sep 10 11:04:38.642072 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1223/4781] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:38 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1354 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:38.669722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-2126e54a-2a03-4086-90d9-83aaf80cba50 req-333b8e97-c6af-47f8-bf3c-dd7242626b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19fff31-52b8-4c4d-82b4-8c84c3aea296", "name": "network-vif-deleted", "tag": "359845cd-9a36-43ad-b3e7-388bf1ce5679"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:38.691028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2126e54a-2a03-4086-90d9-83aaf80cba50 req-333b8e97-c6af-47f8-bf3c-dd7242626b82 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:38.694998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2126e54a-2a03-4086-90d9-83aaf80cba50 req-333b8e97-c6af-47f8-bf3c-dd7242626b82 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:38.695672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2126e54a-2a03-4086-90d9-83aaf80cba50 req-333b8e97-c6af-47f8-bf3c-dd7242626b82 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:38.715583 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-2126e54a-2a03-4086-90d9-83aaf80cba50 req-333b8e97-c6af-47f8-bf3c-dd7242626b82 service nova] Creating event network-vif-deleted:359845cd-9a36-43ad-b3e7-388bf1ce5679 for instance f19fff31-52b8-4c4d-82b4-8c84c3aea296 on n-h2-856894-1 Sep 10 11:04:38.720662 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-2126e54a-2a03-4086-90d9-83aaf80cba50 req-333b8e97-c6af-47f8-bf3c-dd7242626b82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077020 Sep 10 11:04:38.721949 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1224/4782] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:38.740360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-45a00b24-3621-4865-ba5b-7e466668b017 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:38.749751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-45a00b24-3621-4865-ba5b-7e466668b017 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:38.759207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a00b24-3621-4865-ba5b-7e466668b017 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:38.762873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a00b24-3621-4865-ba5b-7e466668b017 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:38.766116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a00b24-3621-4865-ba5b-7e466668b017 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:38.768356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a00b24-3621-4865-ba5b-7e466668b017 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:38.770481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a00b24-3621-4865-ba5b-7e466668b017 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:38.771237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a00b24-3621-4865-ba5b-7e466668b017 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:38.952827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:04:38.953475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:04:38.953786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:04:38.954205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:04:38.954876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:04:38.979349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:38.980253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:38.981014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:38.982815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:38.983517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:38.984272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:39.006786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Getting quotas for project 803a48d9302b4d52b80bf4b49fac53ba. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:04:39.013618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Getting quotas for user 7a58544226204f62807e56bb34c7d5d8 and project 803a48d9302b4d52b80bf4b49fac53ba. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:04:39.029948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:04:39.032701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:04:39.098872 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-16938f9f-d04f-4356-a0a5-0d15090c5608 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.355389 Sep 10 11:04:39.100230 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3559/4783] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:04:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:04:39.113984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b2e815fb-7fd9-4e9b-b340-4f63ca3b79e1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:39.118853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b2e815fb-7fd9-4e9b-b340-4f63ca3b79e1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:39.169975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-45a00b24-3621-4865-ba5b-7e466668b017 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:39.176373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:39.184543 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-45a00b24-3621-4865-ba5b-7e466668b017 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1490 microversion: 2.1 time: 0.445153 Sep 10 11:04:39.197688 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1225/4784] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:38 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1490 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:39.211375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bb734499-e476-4423-aa9d-07a39c7a2850 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2012556196"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:39.221205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bb734499-e476-4423-aa9d-07a39c7a2850 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:39.235113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb734499-e476-4423-aa9d-07a39c7a2850 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:39.235625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb734499-e476-4423-aa9d-07a39c7a2850 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:39.236068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb734499-e476-4423-aa9d-07a39c7a2850 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:39.236777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb734499-e476-4423-aa9d-07a39c7a2850 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:39.238736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb734499-e476-4423-aa9d-07a39c7a2850 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:39.239197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb734499-e476-4423-aa9d-07a39c7a2850 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:39.250949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b2e815fb-7fd9-4e9b-b340-4f63ca3b79e1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:39.258883 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b2e815fb-7fd9-4e9b-b340-4f63ca3b79e1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1238 microversion: 2.1 time: 0.150083 Sep 10 11:04:39.261382 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3560/4785] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:39 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1238 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:39.395114 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bb734499-e476-4423-aa9d-07a39c7a2850 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "PUT /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1075 microversion: 2.1 time: 0.187789 Sep 10 11:04:39.413847 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1226/4786] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Sep 10 11:04:39 2022] PUT /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1075 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:39.419497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b72c614-2669-42e3-bfe4-2d900b491df0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:39.421000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b72c614-2669-42e3-bfe4-2d900b491df0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:39.430603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b72c614-2669-42e3-bfe4-2d900b491df0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:39.432980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b72c614-2669-42e3-bfe4-2d900b491df0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:39.433624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b72c614-2669-42e3-bfe4-2d900b491df0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:39.434546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b72c614-2669-42e3-bfe4-2d900b491df0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:39.440573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b72c614-2669-42e3-bfe4-2d900b491df0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:39.441293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b72c614-2669-42e3-bfe4-2d900b491df0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:39.666643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-11193231-b649-4044-af9b-74b39a52d178 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:39.666643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-11193231-b649-4044-af9b-74b39a52d178 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:39.678999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11193231-b649-4044-af9b-74b39a52d178 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:39.679799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11193231-b649-4044-af9b-74b39a52d178 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:39.681311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11193231-b649-4044-af9b-74b39a52d178 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:39.684105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11193231-b649-4044-af9b-74b39a52d178 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:39.684670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11193231-b649-4044-af9b-74b39a52d178 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:39.685135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-11193231-b649-4044-af9b-74b39a52d178 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:39.810524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0b72c614-2669-42e3-bfe4-2d900b491df0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:39.828819 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b72c614-2669-42e3-bfe4-2d900b491df0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1501 microversion: 2.1 time: 0.413630 Sep 10 11:04:39.832113 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3561/4787] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:39 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1501 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:39.851127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-11193231-b649-4044-af9b-74b39a52d178 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:39.864387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35797599-113e-4710-9acb-4651a273aa7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:39.866698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-35797599-113e-4710-9acb-4651a273aa7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:39.878605 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-11193231-b649-4044-af9b-74b39a52d178 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1188 microversion: 2.1 time: 0.218200 Sep 10 11:04:39.882824 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1227/4788] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:39 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1188 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:39.885329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35797599-113e-4710-9acb-4651a273aa7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:39.886086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35797599-113e-4710-9acb-4651a273aa7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:39.886765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35797599-113e-4710-9acb-4651a273aa7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:39.887821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35797599-113e-4710-9acb-4651a273aa7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:39.889217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35797599-113e-4710-9acb-4651a273aa7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:39.889883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35797599-113e-4710-9acb-4651a273aa7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:40.197015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-35797599-113e-4710-9acb-4651a273aa7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:40.220152 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-35797599-113e-4710-9acb-4651a273aa7b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1501 microversion: 2.1 time: 0.365249 Sep 10 11:04:40.226132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3562/4789] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:39 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1501 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:40.247657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3bf9d4c9-d9fb-42cd-93e9-8c81eabc69f9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:40.256088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bf9d4c9-d9fb-42cd-93e9-8c81eabc69f9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:40.257237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bf9d4c9-d9fb-42cd-93e9-8c81eabc69f9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:40.258137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bf9d4c9-d9fb-42cd-93e9-8c81eabc69f9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:40.286540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-33396729-3f04-4b9c-9d52-56e31c20e493 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:40.287494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-33396729-3f04-4b9c-9d52-56e31c20e493 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:40.300981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33396729-3f04-4b9c-9d52-56e31c20e493 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:40.302617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33396729-3f04-4b9c-9d52-56e31c20e493 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:40.303311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33396729-3f04-4b9c-9d52-56e31c20e493 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:40.306881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33396729-3f04-4b9c-9d52-56e31c20e493 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:40.308831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33396729-3f04-4b9c-9d52-56e31c20e493 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:40.310212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-33396729-3f04-4b9c-9d52-56e31c20e493 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:40.332179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3bf9d4c9-d9fb-42cd-93e9-8c81eabc69f9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Going to try to stop instance {{(pid=128787) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 11:04:40.454848 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3bf9d4c9-d9fb-42cd-93e9-8c81eabc69f9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "POST /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb/action" status: 202 len: 0 microversion: 2.1 time: 0.211595 Sep 10 11:04:40.459625 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1228/4790] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:04:40 2022] POST /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:04:40.465112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a3941596-05f2-41ff-b8ef-90a956da457d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:40.465991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a3941596-05f2-41ff-b8ef-90a956da457d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:40.481836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3941596-05f2-41ff-b8ef-90a956da457d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:40.485699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3941596-05f2-41ff-b8ef-90a956da457d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:40.486312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3941596-05f2-41ff-b8ef-90a956da457d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:40.487116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3941596-05f2-41ff-b8ef-90a956da457d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:40.487652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3941596-05f2-41ff-b8ef-90a956da457d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:40.488221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3941596-05f2-41ff-b8ef-90a956da457d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:40.523921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-33396729-3f04-4b9c-9d52-56e31c20e493 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:40.571470 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-33396729-3f04-4b9c-9d52-56e31c20e493 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1234 microversion: 2.1 time: 0.289281 Sep 10 11:04:40.588820 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3563/4791] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:40 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1234 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:40.886721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a3941596-05f2-41ff-b8ef-90a956da457d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:40.910176 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a3941596-05f2-41ff-b8ef-90a956da457d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.449371 Sep 10 11:04:40.910472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fed3e24f-ae4c-4746-9b1c-e5c051f455bf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:40.911096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fed3e24f-ae4c-4746-9b1c-e5c051f455bf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:40.911883 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1229/4792] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:40 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:40.932790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed3e24f-ae4c-4746-9b1c-e5c051f455bf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:40.933339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed3e24f-ae4c-4746-9b1c-e5c051f455bf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:40.933948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed3e24f-ae4c-4746-9b1c-e5c051f455bf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:40.934867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed3e24f-ae4c-4746-9b1c-e5c051f455bf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:40.935482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed3e24f-ae4c-4746-9b1c-e5c051f455bf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:40.936137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed3e24f-ae4c-4746-9b1c-e5c051f455bf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:41.014020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fed3e24f-ae4c-4746-9b1c-e5c051f455bf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:41.023886 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fed3e24f-ae4c-4746-9b1c-e5c051f455bf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1188 microversion: 2.1 time: 0.117388 Sep 10 11:04:41.038476 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3564/4793] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:40 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1188 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:41.089472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1888111759", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "f13736f9-7bf0-440a-a09e-f324dcbe4356"}], "key_name": "tempest-TestNetworkBasicOps-172263200", "security_groups": [{"name": "tempest-secgroup-smoke-1051686949"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:41.284398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] validate_networks() for [('f13736f9-7bf0-440a-a09e-f324dcbe4356', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:04:41.617519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66379acc-ce99-4d83-9047-099caf7d230e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:41.624104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66379acc-ce99-4d83-9047-099caf7d230e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:41.645210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66379acc-ce99-4d83-9047-099caf7d230e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:41.645936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66379acc-ce99-4d83-9047-099caf7d230e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:41.646480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66379acc-ce99-4d83-9047-099caf7d230e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:41.648145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66379acc-ce99-4d83-9047-099caf7d230e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:41.649524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66379acc-ce99-4d83-9047-099caf7d230e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:41.650098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66379acc-ce99-4d83-9047-099caf7d230e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:41.774415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-66379acc-ce99-4d83-9047-099caf7d230e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:41.790088 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66379acc-ce99-4d83-9047-099caf7d230e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1296 microversion: 2.1 time: 0.184087 Sep 10 11:04:41.806297 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3565/4794] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:41 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1296 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:41.938607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-891f97d4-cece-4f5f-94eb-16711335a9cb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:41.939590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-891f97d4-cece-4f5f-94eb-16711335a9cb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:41.960968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-891f97d4-cece-4f5f-94eb-16711335a9cb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:41.962393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-891f97d4-cece-4f5f-94eb-16711335a9cb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:41.964171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-891f97d4-cece-4f5f-94eb-16711335a9cb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:41.968839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-891f97d4-cece-4f5f-94eb-16711335a9cb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:41.970036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-891f97d4-cece-4f5f-94eb-16711335a9cb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:41.972542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-891f97d4-cece-4f5f-94eb-16711335a9cb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:42.380613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:04:42.382976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:04:42.383498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:04:42.383889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:04:42.384992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:04:42.397663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:42.398163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:42.398855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:42.399900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:42.401199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:42.402124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:42.435425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-891f97d4-cece-4f5f-94eb-16711335a9cb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:42.451522 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-891f97d4-cece-4f5f-94eb-16711335a9cb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.517309 Sep 10 11:04:42.457036 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3566/4795] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:41 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:42.460645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:04:42.472560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7f39918d-68ba-417e-896d-f7a6fc9eac02 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:42.475343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7f39918d-68ba-417e-896d-f7a6fc9eac02 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:42.482570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f39918d-68ba-417e-896d-f7a6fc9eac02 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:42.483918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f39918d-68ba-417e-896d-f7a6fc9eac02 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:42.484663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f39918d-68ba-417e-896d-f7a6fc9eac02 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:42.485812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f39918d-68ba-417e-896d-f7a6fc9eac02 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:42.486430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f39918d-68ba-417e-896d-f7a6fc9eac02 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:42.487012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f39918d-68ba-417e-896d-f7a6fc9eac02 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:42.492194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for user 5075387b0b14438ab9164683b752b867 and project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:04:42.521345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:04:42.529148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:04:42.619889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7f39918d-68ba-417e-896d-f7a6fc9eac02 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:42.626490 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f835bd1f-c911-46e7-94dc-be86203d1218 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.538260 Sep 10 11:04:42.630816 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1230/4796] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:04:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:04:42.641032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bd4a1dbc-97e1-4962-8d19-451a399b6ca4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:42.645745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bd4a1dbc-97e1-4962-8d19-451a399b6ca4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:42.650840 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7f39918d-68ba-417e-896d-f7a6fc9eac02 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1188 microversion: 2.1 time: 0.191729 Sep 10 11:04:42.683376 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3567/4797] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:42 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1188 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:42.728481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bd4a1dbc-97e1-4962-8d19-451a399b6ca4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:42.738379 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bd4a1dbc-97e1-4962-8d19-451a399b6ca4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1248 microversion: 2.1 time: 0.102132 Sep 10 11:04:42.738970 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1231/4798] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:42 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1248 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:42.817259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ce4f5e5a-f8b6-4312-9f25-06aa08a85817 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:42.818139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ce4f5e5a-f8b6-4312-9f25-06aa08a85817 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:42.848555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce4f5e5a-f8b6-4312-9f25-06aa08a85817 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:42.850022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce4f5e5a-f8b6-4312-9f25-06aa08a85817 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:42.851506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce4f5e5a-f8b6-4312-9f25-06aa08a85817 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:42.853046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce4f5e5a-f8b6-4312-9f25-06aa08a85817 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:42.855313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce4f5e5a-f8b6-4312-9f25-06aa08a85817 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:42.857361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce4f5e5a-f8b6-4312-9f25-06aa08a85817 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:43.220563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ce4f5e5a-f8b6-4312-9f25-06aa08a85817 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:43.233623 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ce4f5e5a-f8b6-4312-9f25-06aa08a85817 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1363 microversion: 2.1 time: 0.422111 Sep 10 11:04:43.234615 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3568/4799] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:42 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:43.482330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9794532b-ba09-4b50-8e24-27fc43650dae tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:43.482965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9794532b-ba09-4b50-8e24-27fc43650dae tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:43.492936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9794532b-ba09-4b50-8e24-27fc43650dae tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:43.501894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9794532b-ba09-4b50-8e24-27fc43650dae tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:43.502672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9794532b-ba09-4b50-8e24-27fc43650dae tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:43.503683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9794532b-ba09-4b50-8e24-27fc43650dae tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:43.504355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9794532b-ba09-4b50-8e24-27fc43650dae tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:43.505184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9794532b-ba09-4b50-8e24-27fc43650dae tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:43.695410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2f46869f-2848-4c9e-96ec-717c7ae45bcc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:43.696137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2f46869f-2848-4c9e-96ec-717c7ae45bcc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:43.710631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f46869f-2848-4c9e-96ec-717c7ae45bcc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:43.711144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f46869f-2848-4c9e-96ec-717c7ae45bcc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:43.711619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f46869f-2848-4c9e-96ec-717c7ae45bcc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:43.712552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f46869f-2848-4c9e-96ec-717c7ae45bcc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:43.713190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f46869f-2848-4c9e-96ec-717c7ae45bcc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:43.713701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2f46869f-2848-4c9e-96ec-717c7ae45bcc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:43.873740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2f46869f-2848-4c9e-96ec-717c7ae45bcc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:43.884080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9794532b-ba09-4b50-8e24-27fc43650dae tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:43.911549 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2f46869f-2848-4c9e-96ec-717c7ae45bcc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1188 microversion: 2.1 time: 0.220244 Sep 10 11:04:43.912279 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9794532b-ba09-4b50-8e24-27fc43650dae tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.431740 Sep 10 11:04:43.914796 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1232/4800] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:43 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:43.915466 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3569/4801] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:43 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1188 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:43.920984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1b3632ae-69c2-47c2-8d2a-39da4202ae9e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:43.921915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1b3632ae-69c2-47c2-8d2a-39da4202ae9e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:43.937930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b3632ae-69c2-47c2-8d2a-39da4202ae9e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:43.939080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b3632ae-69c2-47c2-8d2a-39da4202ae9e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:43.939414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b3632ae-69c2-47c2-8d2a-39da4202ae9e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:43.944744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b3632ae-69c2-47c2-8d2a-39da4202ae9e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:43.945477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b3632ae-69c2-47c2-8d2a-39da4202ae9e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:43.945937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b3632ae-69c2-47c2-8d2a-39da4202ae9e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:44.051240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1b3632ae-69c2-47c2-8d2a-39da4202ae9e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:44.066111 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1b3632ae-69c2-47c2-8d2a-39da4202ae9e tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1300 microversion: 2.1 time: 0.149529 Sep 10 11:04:44.067018 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1233/4802] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:43 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1300 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:44.264444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-14ea0218-8a02-4622-a784-9373307db944 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:44.266249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-14ea0218-8a02-4622-a784-9373307db944 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:44.273409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14ea0218-8a02-4622-a784-9373307db944 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:44.274219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14ea0218-8a02-4622-a784-9373307db944 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:44.274869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14ea0218-8a02-4622-a784-9373307db944 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:44.275869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14ea0218-8a02-4622-a784-9373307db944 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:44.276605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14ea0218-8a02-4622-a784-9373307db944 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:44.277275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14ea0218-8a02-4622-a784-9373307db944 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:44.391791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7c49a5af-bf01-4ece-ba08-4f546bc19b19 req-55641bf7-73f6-4004-80bc-989f8c5e1dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5019e0-ebb1-496e-b0a1-329420d2ff70", "tag": "66dca372-21b2-42cd-a9d8-c656c3df691e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:44.407636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7c49a5af-bf01-4ece-ba08-4f546bc19b19 req-55641bf7-73f6-4004-80bc-989f8c5e1dad service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:44.408444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7c49a5af-bf01-4ece-ba08-4f546bc19b19 req-55641bf7-73f6-4004-80bc-989f8c5e1dad service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:44.409718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7c49a5af-bf01-4ece-ba08-4f546bc19b19 req-55641bf7-73f6-4004-80bc-989f8c5e1dad service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:44.423466 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7c49a5af-bf01-4ece-ba08-4f546bc19b19 req-55641bf7-73f6-4004-80bc-989f8c5e1dad service nova] Creating event network-changed:66dca372-21b2-42cd-a9d8-c656c3df691e for instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 on n-h2-856894-1 Sep 10 11:04:44.436269 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7c49a5af-bf01-4ece-ba08-4f546bc19b19 req-55641bf7-73f6-4004-80bc-989f8c5e1dad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261563 Sep 10 11:04:44.437856 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3570/4803] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:04:44.730363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-14ea0218-8a02-4622-a784-9373307db944 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:44.741300 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-14ea0218-8a02-4622-a784-9373307db944 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1363 microversion: 2.1 time: 0.483445 Sep 10 11:04:44.755660 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1234/4804] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:44 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1363 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:44.942577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:44.943200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:44.947783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-58cdb20e-2085-4e63-8ece-8ec5e0c01855 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:44.948594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-58cdb20e-2085-4e63-8ece-8ec5e0c01855 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:44.950804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:44.951304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:44.951739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:44.952454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:44.952885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:44.957606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:44.970578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58cdb20e-2085-4e63-8ece-8ec5e0c01855 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:44.974568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58cdb20e-2085-4e63-8ece-8ec5e0c01855 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:44.975229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58cdb20e-2085-4e63-8ece-8ec5e0c01855 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:44.977117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58cdb20e-2085-4e63-8ece-8ec5e0c01855 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:44.979474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58cdb20e-2085-4e63-8ece-8ec5e0c01855 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:44.980184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-58cdb20e-2085-4e63-8ece-8ec5e0c01855 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:45.029512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:45.030000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:45.030436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:45.030886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lazy-loading 'fault' on Instance uuid f19fff31-52b8-4c4d-82b4-8c84c3aea296 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:04:45.134464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:45.143420 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-daf33eb3-f8ff-4c22-b3f1-8dd51441305e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1193 microversion: 2.1 time: 0.204905 Sep 10 11:04:45.144110 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1235/4805] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:44 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1193 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:45.149057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c539e6be-964a-493a-a27f-394e2fca6adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:45.150531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c539e6be-964a-493a-a27f-394e2fca6adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:45.157663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c539e6be-964a-493a-a27f-394e2fca6adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:45.159564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c539e6be-964a-493a-a27f-394e2fca6adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:45.160249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c539e6be-964a-493a-a27f-394e2fca6adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:45.161833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c539e6be-964a-493a-a27f-394e2fca6adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:45.162465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c539e6be-964a-493a-a27f-394e2fca6adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:45.162900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c539e6be-964a-493a-a27f-394e2fca6adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:45.271854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c539e6be-964a-493a-a27f-394e2fca6adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:45.280770 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c539e6be-964a-493a-a27f-394e2fca6adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1306 microversion: 2.1 time: 0.135392 Sep 10 11:04:45.281627 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1236/4806] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:45 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1306 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:45.316044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-58cdb20e-2085-4e63-8ece-8ec5e0c01855 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:45.329592 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-58cdb20e-2085-4e63-8ece-8ec5e0c01855 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.391052 Sep 10 11:04:45.334162 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3571/4807] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:44 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:45.768335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f1226623-51f2-43b8-a26b-2de4e5905c14 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:45.769770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f1226623-51f2-43b8-a26b-2de4e5905c14 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:45.777357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1226623-51f2-43b8-a26b-2de4e5905c14 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:45.778051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1226623-51f2-43b8-a26b-2de4e5905c14 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:45.779121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1226623-51f2-43b8-a26b-2de4e5905c14 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:45.780271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1226623-51f2-43b8-a26b-2de4e5905c14 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:45.780583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1226623-51f2-43b8-a26b-2de4e5905c14 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:45.781158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1226623-51f2-43b8-a26b-2de4e5905c14 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:45.938546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f1226623-51f2-43b8-a26b-2de4e5905c14 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:45.947312 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f1226623-51f2-43b8-a26b-2de4e5905c14 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1363 microversion: 2.1 time: 0.183016 Sep 10 11:04:45.948639 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1237/4808] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:45 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:46.168433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:46.169167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:46.176175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:46.176679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:46.177152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:46.177874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:46.178339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:46.178778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:46.212303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:46.212802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:46.213352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:46.213818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lazy-loading 'fault' on Instance uuid f19fff31-52b8-4c4d-82b4-8c84c3aea296 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:04:46.257280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:46.265570 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b8a3d5c1-fbd0-42ba-a593-d9b463fc6ddd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 200 len: 1193 microversion: 2.1 time: 0.101372 Sep 10 11:04:46.266180 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3572/4809] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:46 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 1193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:46.305430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-443ac573-fade-49fe-8b0f-5f7b297019a0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:46.306042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-443ac573-fade-49fe-8b0f-5f7b297019a0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:46.313236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-443ac573-fade-49fe-8b0f-5f7b297019a0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:46.313740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-443ac573-fade-49fe-8b0f-5f7b297019a0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:46.314181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-443ac573-fade-49fe-8b0f-5f7b297019a0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:46.314892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-443ac573-fade-49fe-8b0f-5f7b297019a0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:46.315348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-443ac573-fade-49fe-8b0f-5f7b297019a0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:46.316041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-443ac573-fade-49fe-8b0f-5f7b297019a0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:46.358760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15ef7212-350f-4812-8c38-697c371b52a2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:46.360299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15ef7212-350f-4812-8c38-697c371b52a2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:46.367818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ef7212-350f-4812-8c38-697c371b52a2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:46.368607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ef7212-350f-4812-8c38-697c371b52a2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:46.369861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ef7212-350f-4812-8c38-697c371b52a2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:46.371187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ef7212-350f-4812-8c38-697c371b52a2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:46.371654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ef7212-350f-4812-8c38-697c371b52a2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:46.373107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15ef7212-350f-4812-8c38-697c371b52a2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:46.398144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:46.766434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-443ac573-fade-49fe-8b0f-5f7b297019a0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:46.776288 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-443ac573-fade-49fe-8b0f-5f7b297019a0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1374 microversion: 2.1 time: 0.474752 Sep 10 11:04:46.778493 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1238/4810] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:46 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1374 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:46.790024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15ef7212-350f-4812-8c38-697c371b52a2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:46.799708 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15ef7212-350f-4812-8c38-697c371b52a2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.445348 Sep 10 11:04:46.800532 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3573/4811] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:46 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:46.972406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-21f3ed57-08bd-46c6-889c-6e42e12ea9f8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:46.973040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-21f3ed57-08bd-46c6-889c-6e42e12ea9f8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:46.980478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21f3ed57-08bd-46c6-889c-6e42e12ea9f8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:46.980968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21f3ed57-08bd-46c6-889c-6e42e12ea9f8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:46.981496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21f3ed57-08bd-46c6-889c-6e42e12ea9f8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:46.982182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21f3ed57-08bd-46c6-889c-6e42e12ea9f8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:46.982794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21f3ed57-08bd-46c6-889c-6e42e12ea9f8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:46.983357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-21f3ed57-08bd-46c6-889c-6e42e12ea9f8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:47.288755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:47.289413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: f19fff31-52b8-4c4d-82b4-8c84c3aea296] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:47.296944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:47.297470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:47.298280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:47.299310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:47.299930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:47.300708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-21f3ed57-08bd-46c6-889c-6e42e12ea9f8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:47.309202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:47.313905 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-21f3ed57-08bd-46c6-889c-6e42e12ea9f8 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1363 microversion: 2.1 time: 0.345298 Sep 10 11:04:47.315486 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1239/4812] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:46 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:47.334019 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance f19fff31-52b8-4c4d-82b4-8c84c3aea296 could not be found. Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 HTTP/1.1 Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f19fff31-52b8-4c4d-82b4-8c84c3aea296 could not be found. Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f19fff31-52b8-4c4d-82b4-8c84c3aea296'} Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f19fff31-52b8-4c4d-82b4-8c84c3aea296 could not be found. Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f19fff31-52b8-4c4d-82b4-8c84c3aea296 could not be found. Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:04:47.336320 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:47.341989 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:04:47.341989 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:04:47.341989 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:04:47.341989 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:04:47.341989 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:04:47.341989 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f19fff31-52b8-4c4d-82b4-8c84c3aea296 could not be found. Sep 10 11:04:47.341989 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:04:47.341989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance f19fff31-52b8-4c4d-82b4-8c84c3aea296 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:04:47.341989 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2f58504-df7c-49c4-b3e3-15c53b7b99d3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296" status: 404 len: 111 microversion: 2.1 time: 0.053326 Sep 10 11:04:47.341989 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3574/4813] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:47 2022] GET /compute/v2.1/servers/f19fff31-52b8-4c4d-82b4-8c84c3aea296 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:04:47.800527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f1d1512e-2df0-4884-b246-f07d70c0c2fb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:47.801166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f1d1512e-2df0-4884-b246-f07d70c0c2fb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:47.809142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1d1512e-2df0-4884-b246-f07d70c0c2fb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:47.810475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1d1512e-2df0-4884-b246-f07d70c0c2fb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:47.811121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1d1512e-2df0-4884-b246-f07d70c0c2fb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:47.812027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1d1512e-2df0-4884-b246-f07d70c0c2fb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:47.812866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1d1512e-2df0-4884-b246-f07d70c0c2fb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:47.813906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1d1512e-2df0-4884-b246-f07d70c0c2fb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:47.824430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ce2b3ca2-11ce-42fe-b5de-eb3b89766e9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:47.825474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ce2b3ca2-11ce-42fe-b5de-eb3b89766e9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:47.834978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce2b3ca2-11ce-42fe-b5de-eb3b89766e9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:47.835492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce2b3ca2-11ce-42fe-b5de-eb3b89766e9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:47.837274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce2b3ca2-11ce-42fe-b5de-eb3b89766e9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:47.839143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce2b3ca2-11ce-42fe-b5de-eb3b89766e9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:47.839690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce2b3ca2-11ce-42fe-b5de-eb3b89766e9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:47.840038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce2b3ca2-11ce-42fe-b5de-eb3b89766e9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:48.397060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f1d1512e-2df0-4884-b246-f07d70c0c2fb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:48.404416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ce2b3ca2-11ce-42fe-b5de-eb3b89766e9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:48.418563 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f1d1512e-2df0-4884-b246-f07d70c0c2fb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1374 microversion: 2.1 time: 0.621984 Sep 10 11:04:48.419176 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ce2b3ca2-11ce-42fe-b5de-eb3b89766e9a tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.599620 Sep 10 11:04:48.420279 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1240/4814] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:47 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1374 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:48.425215 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3575/4815] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:47 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:48.436833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10c910b1-f8e5-4b26-98cf-066d97d859a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:48.444328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-10c910b1-f8e5-4b26-98cf-066d97d859a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:48.457327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-b6015a8e-d673-410b-81d2-d5f342e40db2 req-b49c5308-80cb-4dec-8246-d41a86ed2bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db03fda0-55e2-4bab-bb30-f704b3a930b2", "tag": "a04899eb-f835-489e-b8de-8f40cae405bb"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:48.459778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10c910b1-f8e5-4b26-98cf-066d97d859a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:48.460530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10c910b1-f8e5-4b26-98cf-066d97d859a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:48.461663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10c910b1-f8e5-4b26-98cf-066d97d859a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:48.462893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10c910b1-f8e5-4b26-98cf-066d97d859a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:48.465393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10c910b1-f8e5-4b26-98cf-066d97d859a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:48.465920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10c910b1-f8e5-4b26-98cf-066d97d859a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:48.469792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b6015a8e-d673-410b-81d2-d5f342e40db2 req-b49c5308-80cb-4dec-8246-d41a86ed2bdb service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:48.473192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b6015a8e-d673-410b-81d2-d5f342e40db2 req-b49c5308-80cb-4dec-8246-d41a86ed2bdb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:48.473964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b6015a8e-d673-410b-81d2-d5f342e40db2 req-b49c5308-80cb-4dec-8246-d41a86ed2bdb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:48.494115 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-b6015a8e-d673-410b-81d2-d5f342e40db2 req-b49c5308-80cb-4dec-8246-d41a86ed2bdb service nova] Creating event network-changed:a04899eb-f835-489e-b8de-8f40cae405bb for instance db03fda0-55e2-4bab-bb30-f704b3a930b2 on n-h2-856894-1 Sep 10 11:04:48.517363 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-b6015a8e-d673-410b-81d2-d5f342e40db2 req-b49c5308-80cb-4dec-8246-d41a86ed2bdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095031 Sep 10 11:04:48.521867 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1241/4816] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:48.814113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-10c910b1-f8e5-4b26-98cf-066d97d859a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:48.825936 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10c910b1-f8e5-4b26-98cf-066d97d859a0 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1363 microversion: 2.1 time: 0.398617 Sep 10 11:04:48.827484 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3576/4817] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:48 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1363 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:49.447227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a168b9e4-d2c2-42be-864a-851f270b32f4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:49.453556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a0c15ca-62fd-4808-992f-33c7cff92841 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:49.454804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a0c15ca-62fd-4808-992f-33c7cff92841 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:49.456865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a168b9e4-d2c2-42be-864a-851f270b32f4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:49.461935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:49.462639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:49.469535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a168b9e4-d2c2-42be-864a-851f270b32f4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:49.470032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a168b9e4-d2c2-42be-864a-851f270b32f4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:49.470473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a168b9e4-d2c2-42be-864a-851f270b32f4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:49.471173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a168b9e4-d2c2-42be-864a-851f270b32f4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:49.471627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a168b9e4-d2c2-42be-864a-851f270b32f4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:49.472049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a168b9e4-d2c2-42be-864a-851f270b32f4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:49.477154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c15ca-62fd-4808-992f-33c7cff92841 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:49.477651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c15ca-62fd-4808-992f-33c7cff92841 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:49.478095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c15ca-62fd-4808-992f-33c7cff92841 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:49.478831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c15ca-62fd-4808-992f-33c7cff92841 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:49.479288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c15ca-62fd-4808-992f-33c7cff92841 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:49.479715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a0c15ca-62fd-4808-992f-33c7cff92841 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:49.812094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a0c15ca-62fd-4808-992f-33c7cff92841 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:49.820259 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a0c15ca-62fd-4808-992f-33c7cff92841 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.371393 Sep 10 11:04:49.821062 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3577/4818] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:49 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:49.841982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a168b9e4-d2c2-42be-864a-851f270b32f4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:49.844748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:49.851987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97037490-5485-496e-9ed2-dd9f63bf0a7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:49.852612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-97037490-5485-496e-9ed2-dd9f63bf0a7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:49.864151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97037490-5485-496e-9ed2-dd9f63bf0a7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:49.864652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97037490-5485-496e-9ed2-dd9f63bf0a7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:49.865107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97037490-5485-496e-9ed2-dd9f63bf0a7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:49.865818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97037490-5485-496e-9ed2-dd9f63bf0a7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:49.866305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97037490-5485-496e-9ed2-dd9f63bf0a7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:49.866735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97037490-5485-496e-9ed2-dd9f63bf0a7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:49.871591 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a168b9e4-d2c2-42be-864a-851f270b32f4 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1374 microversion: 2.1 time: 0.431364 Sep 10 11:04:49.872458 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1242/4819] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:49 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1374 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:50.082602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-97037490-5485-496e-9ed2-dd9f63bf0a7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:50.090700 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-97037490-5485-496e-9ed2-dd9f63bf0a7d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1363 microversion: 2.1 time: 0.244326 Sep 10 11:04:50.091582 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3578/4820] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:49 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:50.544588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7ae6c101-4227-48f7-9e03-4bed5277f014 req-2f876941-1918-4200-a094-3a5a9d7a5039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5019e0-ebb1-496e-b0a1-329420d2ff70", "name": "network-vif-plugged", "status": "completed", "tag": "66dca372-21b2-42cd-a9d8-c656c3df691e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:50.557063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7ae6c101-4227-48f7-9e03-4bed5277f014 req-2f876941-1918-4200-a094-3a5a9d7a5039 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:50.557881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7ae6c101-4227-48f7-9e03-4bed5277f014 req-2f876941-1918-4200-a094-3a5a9d7a5039 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:50.558498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7ae6c101-4227-48f7-9e03-4bed5277f014 req-2f876941-1918-4200-a094-3a5a9d7a5039 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:50.573847 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7ae6c101-4227-48f7-9e03-4bed5277f014 req-2f876941-1918-4200-a094-3a5a9d7a5039 service nova] Creating event network-vif-plugged:66dca372-21b2-42cd-a9d8-c656c3df691e for instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 on n-h2-856894-1 Sep 10 11:04:50.579785 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-7ae6c101-4227-48f7-9e03-4bed5277f014 req-2f876941-1918-4200-a094-3a5a9d7a5039 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039521 Sep 10 11:04:50.580692 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1243/4821] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:04:50.845152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe5bdf78-8879-4d9a-ae44-038a63b0eb09 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:50.845815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fe5bdf78-8879-4d9a-ae44-038a63b0eb09 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:50.860992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe5bdf78-8879-4d9a-ae44-038a63b0eb09 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:50.862101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe5bdf78-8879-4d9a-ae44-038a63b0eb09 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:50.867987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe5bdf78-8879-4d9a-ae44-038a63b0eb09 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:50.868972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe5bdf78-8879-4d9a-ae44-038a63b0eb09 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:50.874110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe5bdf78-8879-4d9a-ae44-038a63b0eb09 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:50.874733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe5bdf78-8879-4d9a-ae44-038a63b0eb09 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:50.897864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7136b91e-b7a5-40a7-a136-9140afd6f2c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:50.899209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7136b91e-b7a5-40a7-a136-9140afd6f2c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:50.907494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7136b91e-b7a5-40a7-a136-9140afd6f2c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:50.908266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7136b91e-b7a5-40a7-a136-9140afd6f2c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:50.909504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7136b91e-b7a5-40a7-a136-9140afd6f2c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:50.910578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7136b91e-b7a5-40a7-a136-9140afd6f2c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:50.911249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7136b91e-b7a5-40a7-a136-9140afd6f2c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:50.912486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7136b91e-b7a5-40a7-a136-9140afd6f2c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:51.320978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fe5bdf78-8879-4d9a-ae44-038a63b0eb09 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:51.327935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7136b91e-b7a5-40a7-a136-9140afd6f2c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:51.336720 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7136b91e-b7a5-40a7-a136-9140afd6f2c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1374 microversion: 2.1 time: 0.445038 Sep 10 11:04:51.349114 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe5bdf78-8879-4d9a-ae44-038a63b0eb09 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.497919 Sep 10 11:04:51.349877 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1244/4822] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:50 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1374 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:51.354530 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3579/4823] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:50 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:51.359881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4154531a-4c05-4294-b667-3d178b0212dc tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:51.360778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4154531a-4c05-4294-b667-3d178b0212dc tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:51.366907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4154531a-4c05-4294-b667-3d178b0212dc tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:51.367395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4154531a-4c05-4294-b667-3d178b0212dc tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:51.367833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4154531a-4c05-4294-b667-3d178b0212dc tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:51.368526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4154531a-4c05-4294-b667-3d178b0212dc tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:51.368970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4154531a-4c05-4294-b667-3d178b0212dc tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:51.369572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4154531a-4c05-4294-b667-3d178b0212dc tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:51.555244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4154531a-4c05-4294-b667-3d178b0212dc tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:51.564302 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4154531a-4c05-4294-b667-3d178b0212dc tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1363 microversion: 2.1 time: 0.212981 Sep 10 11:04:51.577785 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1245/4824] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:51 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:52.362718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be0c970a-f63f-4c99-b9ac-0b7d91d09429 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:52.364296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be0c970a-f63f-4c99-b9ac-0b7d91d09429 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:52.367304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ddd5ff5f-7509-4ea5-9c82-474b82ab77c2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:52.368067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ddd5ff5f-7509-4ea5-9c82-474b82ab77c2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:52.376174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddd5ff5f-7509-4ea5-9c82-474b82ab77c2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:52.376499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0c970a-f63f-4c99-b9ac-0b7d91d09429 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:52.377210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddd5ff5f-7509-4ea5-9c82-474b82ab77c2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:52.377376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0c970a-f63f-4c99-b9ac-0b7d91d09429 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:52.378059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddd5ff5f-7509-4ea5-9c82-474b82ab77c2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:52.378323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0c970a-f63f-4c99-b9ac-0b7d91d09429 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:52.379338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddd5ff5f-7509-4ea5-9c82-474b82ab77c2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:52.379499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0c970a-f63f-4c99-b9ac-0b7d91d09429 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:52.380340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddd5ff5f-7509-4ea5-9c82-474b82ab77c2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:52.380837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0c970a-f63f-4c99-b9ac-0b7d91d09429 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:52.381643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ddd5ff5f-7509-4ea5-9c82-474b82ab77c2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:52.381759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be0c970a-f63f-4c99-b9ac-0b7d91d09429 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:52.426760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:52.733566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=12 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:52.809845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be0c970a-f63f-4c99-b9ac-0b7d91d09429 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:52.815313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ddd5ff5f-7509-4ea5-9c82-474b82ab77c2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:52.822795 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be0c970a-f63f-4c99-b9ac-0b7d91d09429 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.465544 Sep 10 11:04:52.823721 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3580/4825] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:52 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:52.825242 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ddd5ff5f-7509-4ea5-9c82-474b82ab77c2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1374 microversion: 2.1 time: 0.466341 Sep 10 11:04:52.835846 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1246/4826] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:52 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1374 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:52.845700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-01defdf4-a57f-4b00-a54a-d15dd3cc9c75 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:52.847408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-01defdf4-a57f-4b00-a54a-d15dd3cc9c75 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:52.853579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01defdf4-a57f-4b00-a54a-d15dd3cc9c75 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:52.854256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01defdf4-a57f-4b00-a54a-d15dd3cc9c75 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:52.855122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01defdf4-a57f-4b00-a54a-d15dd3cc9c75 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:52.856145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01defdf4-a57f-4b00-a54a-d15dd3cc9c75 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:52.857495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01defdf4-a57f-4b00-a54a-d15dd3cc9c75 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:52.858068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01defdf4-a57f-4b00-a54a-d15dd3cc9c75 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:53.144442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-01defdf4-a57f-4b00-a54a-d15dd3cc9c75 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:53.152697 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-01defdf4-a57f-4b00-a54a-d15dd3cc9c75 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1549 microversion: 2.1 time: 0.327583 Sep 10 11:04:53.153994 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3581/4827] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:52 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1549 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:53.176767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e7911adc-8da6-4369-8689-60134212c3ef tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:53.177424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e7911adc-8da6-4369-8689-60134212c3ef tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:53.180528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:04:53.184451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7911adc-8da6-4369-8689-60134212c3ef tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:53.185251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7911adc-8da6-4369-8689-60134212c3ef tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:53.185887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7911adc-8da6-4369-8689-60134212c3ef tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:53.186822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7911adc-8da6-4369-8689-60134212c3ef tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:53.187438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7911adc-8da6-4369-8689-60134212c3ef tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:53.187864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7911adc-8da6-4369-8689-60134212c3ef tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:53.315475 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e7911adc-8da6-4369-8689-60134212c3ef tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142569 Sep 10 11:04:53.316135 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1247/4828] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:04:53 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:53.854664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9f71aa48-0335-439c-8163-a85f75cb0624 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:53.859532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4a327fc-dd06-4bfc-b8aa-24dc41f91915 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:53.860859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d4a327fc-dd06-4bfc-b8aa-24dc41f91915 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:53.861804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9f71aa48-0335-439c-8163-a85f75cb0624 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:53.879110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f71aa48-0335-439c-8163-a85f75cb0624 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:53.879577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f71aa48-0335-439c-8163-a85f75cb0624 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:53.880019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f71aa48-0335-439c-8163-a85f75cb0624 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:53.880730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f71aa48-0335-439c-8163-a85f75cb0624 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:53.881451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a327fc-dd06-4bfc-b8aa-24dc41f91915 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:53.882220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a327fc-dd06-4bfc-b8aa-24dc41f91915 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:53.882686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a327fc-dd06-4bfc-b8aa-24dc41f91915 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:53.883674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a327fc-dd06-4bfc-b8aa-24dc41f91915 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:53.884328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a327fc-dd06-4bfc-b8aa-24dc41f91915 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:53.886758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f71aa48-0335-439c-8163-a85f75cb0624 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:53.888223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a327fc-dd06-4bfc-b8aa-24dc41f91915 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:53.889144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f71aa48-0335-439c-8163-a85f75cb0624 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:54.211808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4a327fc-dd06-4bfc-b8aa-24dc41f91915 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:54.230291 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4a327fc-dd06-4bfc-b8aa-24dc41f91915 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.386347 Sep 10 11:04:54.243469 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3582/4829] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:53 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:54.260491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9f71aa48-0335-439c-8163-a85f75cb0624 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:54.280817 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9f71aa48-0335-439c-8163-a85f75cb0624 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1374 microversion: 2.1 time: 0.431259 Sep 10 11:04:54.281783 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1248/4830] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:53 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1374 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:54.376374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5690be4a-6c20-4799-b684-8849c9ff596d req-e60f592c-dd84-47a3-b76e-fbc0d924d33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db03fda0-55e2-4bab-bb30-f704b3a930b2", "name": "network-vif-plugged", "status": "completed", "tag": "a04899eb-f835-489e-b8de-8f40cae405bb"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:54.397508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5690be4a-6c20-4799-b684-8849c9ff596d req-e60f592c-dd84-47a3-b76e-fbc0d924d33c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:54.400972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5690be4a-6c20-4799-b684-8849c9ff596d req-e60f592c-dd84-47a3-b76e-fbc0d924d33c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:54.401926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5690be4a-6c20-4799-b684-8849c9ff596d req-e60f592c-dd84-47a3-b76e-fbc0d924d33c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:54.430135 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5690be4a-6c20-4799-b684-8849c9ff596d req-e60f592c-dd84-47a3-b76e-fbc0d924d33c service nova] Creating event network-vif-plugged:a04899eb-f835-489e-b8de-8f40cae405bb for instance db03fda0-55e2-4bab-bb30-f704b3a930b2 on n-h2-856894-1 Sep 10 11:04:54.446335 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5690be4a-6c20-4799-b684-8849c9ff596d req-e60f592c-dd84-47a3-b76e-fbc0d924d33c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070193 Sep 10 11:04:54.504677 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3583/4831] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:54.506957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-1ff194b5-8c00-4675-9013-edb9a00b5050 req-0f548075-fdd2-4045-afa0-b64f93336347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5019e0-ebb1-496e-b0a1-329420d2ff70", "tag": "66dca372-21b2-42cd-a9d8-c656c3df691e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:54.532204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1ff194b5-8c00-4675-9013-edb9a00b5050 req-0f548075-fdd2-4045-afa0-b64f93336347 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:54.533293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1ff194b5-8c00-4675-9013-edb9a00b5050 req-0f548075-fdd2-4045-afa0-b64f93336347 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:54.534231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1ff194b5-8c00-4675-9013-edb9a00b5050 req-0f548075-fdd2-4045-afa0-b64f93336347 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:54.549159 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-1ff194b5-8c00-4675-9013-edb9a00b5050 req-0f548075-fdd2-4045-afa0-b64f93336347 service nova] Creating event network-changed:66dca372-21b2-42cd-a9d8-c656c3df691e for instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 on n-h2-856894-1 Sep 10 11:04:54.555959 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-1ff194b5-8c00-4675-9013-edb9a00b5050 req-0f548075-fdd2-4045-afa0-b64f93336347 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059313 Sep 10 11:04:54.561033 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1249/4832] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:04:55.258861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb4198fc-45b3-4410-bd15-3ddbad31f4a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:55.261006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cb4198fc-45b3-4410-bd15-3ddbad31f4a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:55.273958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb4198fc-45b3-4410-bd15-3ddbad31f4a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:55.274807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb4198fc-45b3-4410-bd15-3ddbad31f4a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:55.275429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb4198fc-45b3-4410-bd15-3ddbad31f4a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:55.276308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb4198fc-45b3-4410-bd15-3ddbad31f4a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:55.276941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb4198fc-45b3-4410-bd15-3ddbad31f4a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:55.277917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb4198fc-45b3-4410-bd15-3ddbad31f4a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:55.304228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-53659b3c-4c18-48c2-9e56-131ef6940248 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:55.304940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-53659b3c-4c18-48c2-9e56-131ef6940248 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:55.319368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53659b3c-4c18-48c2-9e56-131ef6940248 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:55.320717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53659b3c-4c18-48c2-9e56-131ef6940248 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:55.321959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53659b3c-4c18-48c2-9e56-131ef6940248 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:55.323570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53659b3c-4c18-48c2-9e56-131ef6940248 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:55.324036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53659b3c-4c18-48c2-9e56-131ef6940248 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:55.324474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53659b3c-4c18-48c2-9e56-131ef6940248 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:55.680232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-53659b3c-4c18-48c2-9e56-131ef6940248 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:55.688933 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-53659b3c-4c18-48c2-9e56-131ef6940248 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1374 microversion: 2.1 time: 0.388814 Sep 10 11:04:55.704151 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1250/4833] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:55 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1374 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:55.716857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cb4198fc-45b3-4410-bd15-3ddbad31f4a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:55.731410 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb4198fc-45b3-4410-bd15-3ddbad31f4a6 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.477333 Sep 10 11:04:55.732632 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3584/4834] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:55 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:56.724641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-218b54af-4f3c-4eaa-b30c-26922bf9ff44 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:56.725898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-218b54af-4f3c-4eaa-b30c-26922bf9ff44 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:56.740536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-218b54af-4f3c-4eaa-b30c-26922bf9ff44 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:56.741115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-218b54af-4f3c-4eaa-b30c-26922bf9ff44 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:56.741629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-218b54af-4f3c-4eaa-b30c-26922bf9ff44 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:56.742349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-218b54af-4f3c-4eaa-b30c-26922bf9ff44 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:56.742815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-218b54af-4f3c-4eaa-b30c-26922bf9ff44 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:56.743247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-218b54af-4f3c-4eaa-b30c-26922bf9ff44 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:56.758511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65e46bbb-e613-4ab1-8dec-86cd4d8f86b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:56.759835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65e46bbb-e613-4ab1-8dec-86cd4d8f86b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:56.768531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e46bbb-e613-4ab1-8dec-86cd4d8f86b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:56.769959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e46bbb-e613-4ab1-8dec-86cd4d8f86b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:56.770519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e46bbb-e613-4ab1-8dec-86cd4d8f86b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:56.771411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e46bbb-e613-4ab1-8dec-86cd4d8f86b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:56.772337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e46bbb-e613-4ab1-8dec-86cd4d8f86b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:56.773308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e46bbb-e613-4ab1-8dec-86cd4d8f86b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:57.010201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-218b54af-4f3c-4eaa-b30c-26922bf9ff44 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:57.015868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-65e46bbb-e613-4ab1-8dec-86cd4d8f86b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:57.020222 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-218b54af-4f3c-4eaa-b30c-26922bf9ff44 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1546 microversion: 2.1 time: 0.310016 Sep 10 11:04:57.020807 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1251/4835] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:56 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1546 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:57.025179 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65e46bbb-e613-4ab1-8dec-86cd4d8f86b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.270685 Sep 10 11:04:57.026040 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3585/4836] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:56 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:04:57.043993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e743e25c-3e7c-45fb-8e93-383cd30e92e6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:57.044870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e743e25c-3e7c-45fb-8e93-383cd30e92e6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:57.054126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e743e25c-3e7c-45fb-8e93-383cd30e92e6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:57.054865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e743e25c-3e7c-45fb-8e93-383cd30e92e6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:57.055312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e743e25c-3e7c-45fb-8e93-383cd30e92e6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:57.056025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e743e25c-3e7c-45fb-8e93-383cd30e92e6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:57.056483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e743e25c-3e7c-45fb-8e93-383cd30e92e6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:57.056917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e743e25c-3e7c-45fb-8e93-383cd30e92e6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:57.203030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e743e25c-3e7c-45fb-8e93-383cd30e92e6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:57.216862 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e743e25c-3e7c-45fb-8e93-383cd30e92e6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1546 microversion: 2.1 time: 0.177133 Sep 10 11:04:57.219044 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1252/4837] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:57 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1546 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:58.062319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5eb7a1bc-d899-450a-85f9-4e63e563a542 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:58.063175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5eb7a1bc-d899-450a-85f9-4e63e563a542 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:58.070693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5eb7a1bc-d899-450a-85f9-4e63e563a542 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:58.071436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5eb7a1bc-d899-450a-85f9-4e63e563a542 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:58.071938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5eb7a1bc-d899-450a-85f9-4e63e563a542 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:58.072640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5eb7a1bc-d899-450a-85f9-4e63e563a542 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:58.073114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5eb7a1bc-d899-450a-85f9-4e63e563a542 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:58.073732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5eb7a1bc-d899-450a-85f9-4e63e563a542 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:58.624865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5eb7a1bc-d899-450a-85f9-4e63e563a542 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:58.642630 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5eb7a1bc-d899-450a-85f9-4e63e563a542 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.582443 Sep 10 11:04:58.662880 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3586/4838] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:58 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:04:59.667712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cc716d95-7469-4118-8f55-aa41f4158e46 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:04:59.669132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cc716d95-7469-4118-8f55-aa41f4158e46 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:04:59.677820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc716d95-7469-4118-8f55-aa41f4158e46 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:59.678554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc716d95-7469-4118-8f55-aa41f4158e46 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:59.679161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc716d95-7469-4118-8f55-aa41f4158e46 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:59.680541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c3998195-e7f1-4fc1-95ff-73140d6c2642 req-b0768c50-2dc7-4c8c-bf47-457e129c337a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db03fda0-55e2-4bab-bb30-f704b3a930b2", "tag": "a04899eb-f835-489e-b8de-8f40cae405bb"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:04:59.681844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc716d95-7469-4118-8f55-aa41f4158e46 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:59.682468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc716d95-7469-4118-8f55-aa41f4158e46 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:59.694029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc716d95-7469-4118-8f55-aa41f4158e46 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:59.716158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c3998195-e7f1-4fc1-95ff-73140d6c2642 req-b0768c50-2dc7-4c8c-bf47-457e129c337a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:04:59.718194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c3998195-e7f1-4fc1-95ff-73140d6c2642 req-b0768c50-2dc7-4c8c-bf47-457e129c337a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:04:59.722074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c3998195-e7f1-4fc1-95ff-73140d6c2642 req-b0768c50-2dc7-4c8c-bf47-457e129c337a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:04:59.753189 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c3998195-e7f1-4fc1-95ff-73140d6c2642 req-b0768c50-2dc7-4c8c-bf47-457e129c337a service nova] Creating event network-changed:a04899eb-f835-489e-b8de-8f40cae405bb for instance db03fda0-55e2-4bab-bb30-f704b3a930b2 on n-h2-856894-1 Sep 10 11:04:59.767189 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c3998195-e7f1-4fc1-95ff-73140d6c2642 req-b0768c50-2dc7-4c8c-bf47-457e129c337a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090719 Sep 10 11:04:59.769954 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3587/4839] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:04:59.959089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cc716d95-7469-4118-8f55-aa41f4158e46 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:04:59.968620 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cc716d95-7469-4118-8f55-aa41f4158e46 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.304506 Sep 10 11:04:59.973388 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1253/4840] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:04:59 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:00.997792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-689f0fe1-29ee-4853-a7d3-46b8c9e6b296 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:00.998519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-689f0fe1-29ee-4853-a7d3-46b8c9e6b296 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:01.007578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-689f0fe1-29ee-4853-a7d3-46b8c9e6b296 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:01.008071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-689f0fe1-29ee-4853-a7d3-46b8c9e6b296 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:01.008518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-689f0fe1-29ee-4853-a7d3-46b8c9e6b296 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:01.009266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-689f0fe1-29ee-4853-a7d3-46b8c9e6b296 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:01.009719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-689f0fe1-29ee-4853-a7d3-46b8c9e6b296 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:01.010436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-689f0fe1-29ee-4853-a7d3-46b8c9e6b296 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:01.182180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-689f0fe1-29ee-4853-a7d3-46b8c9e6b296 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:01.191612 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-689f0fe1-29ee-4853-a7d3-46b8c9e6b296 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.199032 Sep 10 11:05:01.194300 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3588/4841] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:00 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:02.219008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9a0c164b-1cf2-4e00-99f8-80ca880984bc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:02.219692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9a0c164b-1cf2-4e00-99f8-80ca880984bc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:02.227454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0c164b-1cf2-4e00-99f8-80ca880984bc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:02.228207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0c164b-1cf2-4e00-99f8-80ca880984bc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:02.228871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0c164b-1cf2-4e00-99f8-80ca880984bc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:02.229660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0c164b-1cf2-4e00-99f8-80ca880984bc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:02.230171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0c164b-1cf2-4e00-99f8-80ca880984bc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:02.230836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a0c164b-1cf2-4e00-99f8-80ca880984bc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:02.509887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9a0c164b-1cf2-4e00-99f8-80ca880984bc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:02.519296 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9a0c164b-1cf2-4e00-99f8-80ca880984bc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.304922 Sep 10 11:05:02.537123 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1254/4842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:02 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:03.547403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-17b5fe2d-50c9-41e1-b16d-196eea425c3b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:03.548014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-17b5fe2d-50c9-41e1-b16d-196eea425c3b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:03.557134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b5fe2d-50c9-41e1-b16d-196eea425c3b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:03.557904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b5fe2d-50c9-41e1-b16d-196eea425c3b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:03.558348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b5fe2d-50c9-41e1-b16d-196eea425c3b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:03.559698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b5fe2d-50c9-41e1-b16d-196eea425c3b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:03.560199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b5fe2d-50c9-41e1-b16d-196eea425c3b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:03.560632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17b5fe2d-50c9-41e1-b16d-196eea425c3b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:03.807699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-17b5fe2d-50c9-41e1-b16d-196eea425c3b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:03.823885 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-17b5fe2d-50c9-41e1-b16d-196eea425c3b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.280912 Sep 10 11:05:03.824840 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3589/4843] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:03 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:04.851551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a888508c-c79c-469c-aba5-409972594dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:04.853383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a888508c-c79c-469c-aba5-409972594dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:04.861197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a888508c-c79c-469c-aba5-409972594dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:04.861960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a888508c-c79c-469c-aba5-409972594dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:04.862573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a888508c-c79c-469c-aba5-409972594dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:04.863507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a888508c-c79c-469c-aba5-409972594dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:04.863966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a888508c-c79c-469c-aba5-409972594dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:04.864580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a888508c-c79c-469c-aba5-409972594dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:05.434989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a888508c-c79c-469c-aba5-409972594dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:05.455605 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a888508c-c79c-469c-aba5-409972594dbc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.612112 Sep 10 11:05:05.456330 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1255/4844] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:04 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:06.479029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8c253ed5-76f7-4dc4-8cbd-3ac6ce2575b7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:06.479832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8c253ed5-76f7-4dc4-8cbd-3ac6ce2575b7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:06.483313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:06.489337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c253ed5-76f7-4dc4-8cbd-3ac6ce2575b7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:06.489841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c253ed5-76f7-4dc4-8cbd-3ac6ce2575b7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:06.490287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c253ed5-76f7-4dc4-8cbd-3ac6ce2575b7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:06.490991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c253ed5-76f7-4dc4-8cbd-3ac6ce2575b7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:06.491622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c253ed5-76f7-4dc4-8cbd-3ac6ce2575b7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:06.492057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8c253ed5-76f7-4dc4-8cbd-3ac6ce2575b7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:06.720224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8c253ed5-76f7-4dc4-8cbd-3ac6ce2575b7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:06.730175 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8c253ed5-76f7-4dc4-8cbd-3ac6ce2575b7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.254993 Sep 10 11:05:06.731195 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3590/4845] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:06 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:07.752865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3d87389a-97d3-42f9-9407-cdcf29933041 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:07.753781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3d87389a-97d3-42f9-9407-cdcf29933041 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:07.761425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d87389a-97d3-42f9-9407-cdcf29933041 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:07.762153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d87389a-97d3-42f9-9407-cdcf29933041 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:07.762695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d87389a-97d3-42f9-9407-cdcf29933041 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:07.763695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d87389a-97d3-42f9-9407-cdcf29933041 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:07.764464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d87389a-97d3-42f9-9407-cdcf29933041 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:07.765193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3d87389a-97d3-42f9-9407-cdcf29933041 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:08.015082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3d87389a-97d3-42f9-9407-cdcf29933041 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:08.023385 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3d87389a-97d3-42f9-9407-cdcf29933041 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.274419 Sep 10 11:05:08.024297 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1256/4846] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:07 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:09.048609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c475a4d-16db-408a-8a3e-1aaf20250776 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:09.049531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c475a4d-16db-408a-8a3e-1aaf20250776 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:09.057353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c475a4d-16db-408a-8a3e-1aaf20250776 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:09.058185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c475a4d-16db-408a-8a3e-1aaf20250776 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:09.059472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c475a4d-16db-408a-8a3e-1aaf20250776 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:09.060901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c475a4d-16db-408a-8a3e-1aaf20250776 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:09.061558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c475a4d-16db-408a-8a3e-1aaf20250776 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:09.062618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c475a4d-16db-408a-8a3e-1aaf20250776 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:09.286456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c475a4d-16db-408a-8a3e-1aaf20250776 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:09.288776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:09.296652 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c475a4d-16db-408a-8a3e-1aaf20250776 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.252098 Sep 10 11:05:09.297418 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3591/4847] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:09 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:10.320446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4f1b5e60-8c4e-4fb9-a486-fe5854e9ba67 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:10.321095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4f1b5e60-8c4e-4fb9-a486-fe5854e9ba67 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:10.327923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e60-8c4e-4fb9-a486-fe5854e9ba67 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:10.328356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e60-8c4e-4fb9-a486-fe5854e9ba67 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:10.328802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e60-8c4e-4fb9-a486-fe5854e9ba67 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:10.329527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e60-8c4e-4fb9-a486-fe5854e9ba67 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:10.329993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e60-8c4e-4fb9-a486-fe5854e9ba67 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:10.330421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f1b5e60-8c4e-4fb9-a486-fe5854e9ba67 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:10.540986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4f1b5e60-8c4e-4fb9-a486-fe5854e9ba67 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:10.549317 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4f1b5e60-8c4e-4fb9-a486-fe5854e9ba67 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1511 microversion: 2.1 time: 0.232709 Sep 10 11:05:10.550092 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1257/4848] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:10 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:11.572778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e149575e-4f54-4701-811e-09cc7fe90edc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:11.573426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e149575e-4f54-4701-811e-09cc7fe90edc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:11.599145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e149575e-4f54-4701-811e-09cc7fe90edc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:11.599812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e149575e-4f54-4701-811e-09cc7fe90edc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:11.600270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e149575e-4f54-4701-811e-09cc7fe90edc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:11.601205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e149575e-4f54-4701-811e-09cc7fe90edc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:11.604291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e149575e-4f54-4701-811e-09cc7fe90edc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:11.604764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e149575e-4f54-4701-811e-09cc7fe90edc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:11.769895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e149575e-4f54-4701-811e-09cc7fe90edc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:11.779313 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e149575e-4f54-4701-811e-09cc7fe90edc tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1488 microversion: 2.1 time: 0.210549 Sep 10 11:05:11.779937 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3592/4849] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:11 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1488 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:05:11.803303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-851e9d22-92b6-491a-8417-02461dbf4bd2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1234170618"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:11.806543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-851e9d22-92b6-491a-8417-02461dbf4bd2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:11.814221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-851e9d22-92b6-491a-8417-02461dbf4bd2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:11.815004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-851e9d22-92b6-491a-8417-02461dbf4bd2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:11.815603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-851e9d22-92b6-491a-8417-02461dbf4bd2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:11.816674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-851e9d22-92b6-491a-8417-02461dbf4bd2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:11.817326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-851e9d22-92b6-491a-8417-02461dbf4bd2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:11.818101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-851e9d22-92b6-491a-8417-02461dbf4bd2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:11.889784 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-851e9d22-92b6-491a-8417-02461dbf4bd2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "PUT /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1061 microversion: 2.1 time: 0.090555 Sep 10 11:05:11.890956 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1258/4850] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Sep 10 11:05:11 2022] PUT /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1061 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:11.911030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-219003eb-0686-497e-ad59-3903d1ca567b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:11.911849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-219003eb-0686-497e-ad59-3903d1ca567b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:11.919766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219003eb-0686-497e-ad59-3903d1ca567b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:11.920565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219003eb-0686-497e-ad59-3903d1ca567b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:11.921107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219003eb-0686-497e-ad59-3903d1ca567b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:11.921802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219003eb-0686-497e-ad59-3903d1ca567b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:11.922293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219003eb-0686-497e-ad59-3903d1ca567b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:11.922719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-219003eb-0686-497e-ad59-3903d1ca567b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:12.098845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-219003eb-0686-497e-ad59-3903d1ca567b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:12.107456 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-219003eb-0686-497e-ad59-3903d1ca567b tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1488 microversion: 2.1 time: 0.200891 Sep 10 11:05:12.108042 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3593/4851] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:11 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1488 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:12.130372 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2ee9b58b-bee1-43b4-8610-ae0cc946a442 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:12.130994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2ee9b58b-bee1-43b4-8610-ae0cc946a442 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:12.137760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ee9b58b-bee1-43b4-8610-ae0cc946a442 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:12.138255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ee9b58b-bee1-43b4-8610-ae0cc946a442 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:12.138693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ee9b58b-bee1-43b4-8610-ae0cc946a442 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:12.139541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ee9b58b-bee1-43b4-8610-ae0cc946a442 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:12.140137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ee9b58b-bee1-43b4-8610-ae0cc946a442 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:12.140567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ee9b58b-bee1-43b4-8610-ae0cc946a442 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:12.307155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2ee9b58b-bee1-43b4-8610-ae0cc946a442 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:12.329010 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2ee9b58b-bee1-43b4-8610-ae0cc946a442 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1488 microversion: 2.1 time: 0.202827 Sep 10 11:05:12.348722 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1259/4852] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:12 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1488 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:12.354870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4ae33c91-f3e4-461a-9613-161a88d2b41e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:12.356070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4ae33c91-f3e4-461a-9613-161a88d2b41e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:12.363594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ae33c91-f3e4-461a-9613-161a88d2b41e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:12.364101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ae33c91-f3e4-461a-9613-161a88d2b41e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:12.364679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ae33c91-f3e4-461a-9613-161a88d2b41e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:12.365322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ae33c91-f3e4-461a-9613-161a88d2b41e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:12.365791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ae33c91-f3e4-461a-9613-161a88d2b41e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:12.366249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ae33c91-f3e4-461a-9613-161a88d2b41e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:12.397671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4ae33c91-f3e4-461a-9613-161a88d2b41e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:05:12.501532 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4ae33c91-f3e4-461a-9613-161a88d2b41e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 204 len: 0 microversion: 2.1 time: 0.150323 Sep 10 11:05:12.503077 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3594/4853] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:05:12 2022] DELETE /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:05:12.518272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ec3acae3-9b47-4372-b975-2f85b4b7bb1f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:12.519577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ec3acae3-9b47-4372-b975-2f85b4b7bb1f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:12.538812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3acae3-9b47-4372-b975-2f85b4b7bb1f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:12.544409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3acae3-9b47-4372-b975-2f85b4b7bb1f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:12.545493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3acae3-9b47-4372-b975-2f85b4b7bb1f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:12.546487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3acae3-9b47-4372-b975-2f85b4b7bb1f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:12.547195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3acae3-9b47-4372-b975-2f85b4b7bb1f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:12.547894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec3acae3-9b47-4372-b975-2f85b4b7bb1f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:12.579901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:12.730211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ec3acae3-9b47-4372-b975-2f85b4b7bb1f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:12.739883 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ec3acae3-9b47-4372-b975-2f85b4b7bb1f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1494 microversion: 2.1 time: 0.228909 Sep 10 11:05:12.740486 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1260/4854] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:12 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1494 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:13.411579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1773955788", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a45b4c3e-02f8-4b57-a538-a004b0202fb5", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e65712d8-efe4-477c-ab8b-0eb50d70eafc"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:13.513944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] validate_networks() for [('e65712d8-efe4-477c-ab8b-0eb50d70eafc', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:05:13.765838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-686da463-95f2-4495-95f9-32ff03f6d939 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:13.766525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-686da463-95f2-4495-95f9-32ff03f6d939 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:13.772431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-686da463-95f2-4495-95f9-32ff03f6d939 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:13.772914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-686da463-95f2-4495-95f9-32ff03f6d939 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:13.773384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-686da463-95f2-4495-95f9-32ff03f6d939 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:13.774186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-686da463-95f2-4495-95f9-32ff03f6d939 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:13.774641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-686da463-95f2-4495-95f9-32ff03f6d939 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:13.775064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-686da463-95f2-4495-95f9-32ff03f6d939 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:13.990683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:05:13.991142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:05:13.991646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:05:13.992062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:05:13.992481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:05:14.002198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:14.002680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:14.003319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:14.004338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:14.004800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:14.005256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:14.022785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:05:14.026142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-686da463-95f2-4495-95f9-32ff03f6d939 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:14.036687 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-686da463-95f2-4495-95f9-32ff03f6d939 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1494 microversion: 2.1 time: 0.276621 Sep 10 11:05:14.037480 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1261/4855] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:13 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1494 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:05:14.043837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for user 78004185356641b990a951dc95e6ca0c and project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:05:14.057198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:05:14.060224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a45b4c3e-02f8-4b57-a538-a004b0202fb5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:05:14.139239 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87d66368-d655-44a8-bb9f-53dd1537ec48 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732198 Sep 10 11:05:14.140366 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3595/4856] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:05:14.152034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9dbb1bdb-a884-41a1-8686-519d53d33a98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:14.152943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9dbb1bdb-a884-41a1-8686-519d53d33a98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:14.236734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9dbb1bdb-a884-41a1-8686-519d53d33a98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:14.247176 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9dbb1bdb-a884-41a1-8686-519d53d33a98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1057 microversion: 2.1 time: 0.098518 Sep 10 11:05:14.248167 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1262/4857] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:14 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1057 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:14.560665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4253cd34-248d-4cfc-8531-2c445efa92dd req-cff01aa7-7b03-405a-a3e0-fedf1b709aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c53df17-1104-4c20-b184-7807456e91fb", "name": "network-vif-deleted", "tag": "e8764eca-1194-460a-b84c-f4bd69979006"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:14.598631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4253cd34-248d-4cfc-8531-2c445efa92dd req-cff01aa7-7b03-405a-a3e0-fedf1b709aad service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:14.599886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4253cd34-248d-4cfc-8531-2c445efa92dd req-cff01aa7-7b03-405a-a3e0-fedf1b709aad service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:14.601662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4253cd34-248d-4cfc-8531-2c445efa92dd req-cff01aa7-7b03-405a-a3e0-fedf1b709aad service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:14.634484 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4253cd34-248d-4cfc-8531-2c445efa92dd req-cff01aa7-7b03-405a-a3e0-fedf1b709aad service nova] Creating event network-vif-deleted:e8764eca-1194-460a-b84c-f4bd69979006 for instance 5c53df17-1104-4c20-b184-7807456e91fb on n-h2-856894-1 Sep 10 11:05:14.648979 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4253cd34-248d-4cfc-8531-2c445efa92dd req-cff01aa7-7b03-405a-a3e0-fedf1b709aad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094782 Sep 10 11:05:14.652354 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3596/4858] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:15.074425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:15.074994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:15.082358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:15.082837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:15.083269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:15.083947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:15.084397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:15.084816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:15.115304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:15.115779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:15.116210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:15.116687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lazy-loading 'fault' on Instance uuid 5c53df17-1104-4c20-b184-7807456e91fb {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:05:15.158739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:15.166714 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6bfa14fe-af3d-47e2-9be0-fa37b4a6d03f tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 200 len: 1310 microversion: 2.1 time: 0.096251 Sep 10 11:05:15.167744 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1263/4859] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:15 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:15.276831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c97d0cd8-5067-4fdf-a37a-822591c244c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:15.278293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c97d0cd8-5067-4fdf-a37a-822591c244c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:15.285580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c97d0cd8-5067-4fdf-a37a-822591c244c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:15.286191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c97d0cd8-5067-4fdf-a37a-822591c244c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:15.286751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c97d0cd8-5067-4fdf-a37a-822591c244c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:15.287556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c97d0cd8-5067-4fdf-a37a-822591c244c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:15.288875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c97d0cd8-5067-4fdf-a37a-822591c244c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:15.289568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c97d0cd8-5067-4fdf-a37a-822591c244c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:15.380050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c97d0cd8-5067-4fdf-a37a-822591c244c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:15.388699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c97d0cd8-5067-4fdf-a37a-822591c244c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1109 microversion: 2.1 time: 0.117309 Sep 10 11:05:15.389313 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3597/4860] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:15 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1109 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:16.194065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.196378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.207787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.208511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.211138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.212022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.212752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.213598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.231647 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb HTTP/1.1 Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5c53df17-1104-4c20-b184-7807456e91fb'} Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.234002 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.238529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.238529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.238529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.238529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.238529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.238529 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.240338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.241691 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d424d2c-ea72-429d-abea-d7202ed22829 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 404 len: 111 microversion: 2.1 time: 0.053408 Sep 10 11:05:16.242839 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1264/4861] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:16 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.256879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.257521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.268290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.269290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.270167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.271689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.274497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.275547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.313736 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb HTTP/1.1 Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '5c53df17-1104-4c20-b184-7807456e91fb'} Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.319266 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.324279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.328145 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36dfd5fe-e00f-4b7a-8eca-d1a8f21c838e tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 404 len: 111 microversion: 2.1 time: 0.075845 Sep 10 11:05:16.332152 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3598/4862] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:05:16 2022] DELETE /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.337685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.338536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 5c53df17-1104-4c20-b184-7807456e91fb] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.345657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.346271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.346937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.347741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.348297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.348818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.364608 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb HTTP/1.1 Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5c53df17-1104-4c20-b184-7807456e91fb'} Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.366541 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.371025 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.371025 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.371025 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.371025 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.371025 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. Sep 10 11:05:16.371025 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.374257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 5c53df17-1104-4c20-b184-7807456e91fb could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.375364 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c80ee75e-7dc6-44f7-bf6c-e30b87aac2e4 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb" status: 404 len: 111 microversion: 2.1 time: 0.042150 Sep 10 11:05:16.376477 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1265/4863] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:16 2022] GET /compute/v2.1/servers/5c53df17-1104-4c20-b184-7807456e91fb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.386309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.388091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.397256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.398195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.399048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.400206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.401917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.402795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.414452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dddd78c5-2780-4802-98dc-d37578b7c118 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.415183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dddd78c5-2780-4802-98dc-d37578b7c118 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.428539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dddd78c5-2780-4802-98dc-d37578b7c118 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.429349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dddd78c5-2780-4802-98dc-d37578b7c118 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.430042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dddd78c5-2780-4802-98dc-d37578b7c118 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.430847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dddd78c5-2780-4802-98dc-d37578b7c118 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.431401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dddd78c5-2780-4802-98dc-d37578b7c118 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.431942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dddd78c5-2780-4802-98dc-d37578b7c118 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.447981 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 HTTP/1.1 Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '6932f6d9-493e-4c31-a5f8-14d70baf8450'} Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.450124 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:05:16.454727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.454727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.454727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.454727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.454727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.454727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.454727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.454727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.454727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:05:16.454727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.457331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.458747 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f8f7cf5-58c9-4d8f-bb83-da44f0f72661 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 404 len: 111 microversion: 2.1 time: 0.078177 Sep 10 11:05:16.460007 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3599/4864] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:05:16 2022] DELETE /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.472880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.474047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 6932f6d9-493e-4c31-a5f8-14d70baf8450] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.482174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.482952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.483627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.484705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.485457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.486101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.504407 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 HTTP/1.1 Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '6932f6d9-493e-4c31-a5f8-14d70baf8450'} Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.506297 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.510340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.510340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.510340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.510340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.510340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. Sep 10 11:05:16.510340 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.513023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 6932f6d9-493e-4c31-a5f8-14d70baf8450 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.515069 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1335bc73-c898-4fae-89ff-98e92138b8f7 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450" status: 404 len: 111 microversion: 2.1 time: 0.049515 Sep 10 11:05:16.516162 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3600/4865] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:16 2022] GET /compute/v2.1/servers/6932f6d9-493e-4c31-a5f8-14d70baf8450 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.524892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.526290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.535495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.536605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.537305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.538329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.539011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.539833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.563105 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 HTTP/1.1 Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '8ff106c0-1678-49e4-80cf-4cbd06d7cf59'} Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.566248 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:05:16.570221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.570221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.570221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.570221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.570221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.570221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.570221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.570221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.570221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:05:16.570221 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.587908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.589363 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-89f054fa-85db-42fa-95bd-500329e9bb92 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 404 len: 111 microversion: 2.1 time: 0.069223 Sep 10 11:05:16.591888 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3601/4866] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:05:16 2022] DELETE /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.601222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dddd78c5-2780-4802-98dc-d37578b7c118 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:16.603348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.607224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 8ff106c0-1678-49e4-80cf-4cbd06d7cf59] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.619248 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dddd78c5-2780-4802-98dc-d37578b7c118 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1127 microversion: 2.1 time: 0.208961 Sep 10 11:05:16.619457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.620575 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1266/4867] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:16 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1127 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:16.623383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.624018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.625046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.626219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.626882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.644393 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 HTTP/1.1 Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '8ff106c0-1678-49e4-80cf-4cbd06d7cf59'} Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.646932 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.650997 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.650997 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.650997 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.650997 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.650997 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. Sep 10 11:05:16.650997 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.654721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 8ff106c0-1678-49e4-80cf-4cbd06d7cf59 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.657966 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ee35aed1-8eed-491a-ae69-8021dbc091ec tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59" status: 404 len: 111 microversion: 2.1 time: 0.061433 Sep 10 11:05:16.659455 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3602/4868] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:16 2022] GET /compute/v2.1/servers/8ff106c0-1678-49e4-80cf-4cbd06d7cf59 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.670887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.671620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.680969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.681710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.682339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.683204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.684008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.684588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.703656 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db HTTP/1.1 Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'd201bfbd-7948-42d1-9c5e-0d788b7e52db'} Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.706017 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:05:16.710768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.710768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.710768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.710768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.710768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.710768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.710768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.710768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.710768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:05:16.710768 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.712477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.713572 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2feb2bb4-277c-47c0-bec1-12eba9070976 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 404 len: 111 microversion: 2.1 time: 0.049283 Sep 10 11:05:16.714301 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1267/4869] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:05:16 2022] DELETE /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.724451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.725064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: d201bfbd-7948-42d1-9c5e-0d788b7e52db] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.736711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.737502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.739183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.741004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.741687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.742971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.796044 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db HTTP/1.1 Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd201bfbd-7948-42d1-9c5e-0d788b7e52db'} Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.798041 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.802897 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.802897 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.802897 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.802897 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.802897 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. Sep 10 11:05:16.802897 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.802897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance d201bfbd-7948-42d1-9c5e-0d788b7e52db could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.804126 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b67d5d03-fb61-4c6f-8ff6-e1f97ce0d42d tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db" status: 404 len: 111 microversion: 2.1 time: 0.084588 Sep 10 11:05:16.807735 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3603/4870] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:16 2022] GET /compute/v2.1/servers/d201bfbd-7948-42d1-9c5e-0d788b7e52db => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.815318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.816027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.822859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.823586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.824442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.827299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.828124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.828708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.850757 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c HTTP/1.1 Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '856c1738-7182-4a08-ab36-a9bd58a64e8c'} Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.852508 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:05:16.857706 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.857706 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.857706 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.857706 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.857706 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.857706 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.857706 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.857706 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.857706 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:05:16.857706 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.859673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.860763 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d4069ba1-eb86-47da-9537-5570af5000cf tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 404 len: 111 microversion: 2.1 time: 0.050548 Sep 10 11:05:16.865024 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1268/4871] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:05:16 2022] DELETE /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.870353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.871019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 856c1738-7182-4a08-ab36-a9bd58a64e8c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.878880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.879388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.879832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.889842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.890496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.890953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.913582 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c HTTP/1.1 Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '856c1738-7182-4a08-ab36-a9bd58a64e8c'} Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.915133 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.923319 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.923319 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.923319 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.923319 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.923319 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. Sep 10 11:05:16.923319 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.923319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 856c1738-7182-4a08-ab36-a9bd58a64e8c could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.923319 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fa09e07d-8e3c-42f9-95dc-fcf12c7c15bb tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c" status: 404 len: 111 microversion: 2.1 time: 0.050574 Sep 10 11:05:16.923319 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3604/4872] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:16 2022] GET /compute/v2.1/servers/856c1738-7182-4a08-ab36-a9bd58a64e8c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:05:16.929679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.931330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.938571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.939351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.939999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.940910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.941633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.942276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.969982 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 HTTP/1.1 Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'edc345de-8d35-493d-ab7e-dd97ad4d0275'} Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:16.971553 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fecdc2e5-1ea5-482b-ae94-bcc9292f51a1 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 404 len: 111 microversion: 2.1 time: 0.047339 Sep 10 11:05:16.975509 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1269/4873] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:05:16 2022] DELETE /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:16.982025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:16.982928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: edc345de-8d35-493d-ab7e-dd97ad4d0275] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:16.989640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.990423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.991081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:16.991992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:16.992650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:16.993338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:17.008901 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 HTTP/1.1 Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'edc345de-8d35-493d-ab7e-dd97ad4d0275'} Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.010782 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:17.015662 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:17.015662 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:17.015662 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:17.015662 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:17.015662 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. Sep 10 11:05:17.015662 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.017672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance edc345de-8d35-493d-ab7e-dd97ad4d0275 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:17.018840 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b2618897-f867-4ca1-8a08-18e00f9ca4e2 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275" status: 404 len: 111 microversion: 2.1 time: 0.040675 Sep 10 11:05:17.029816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-42a1bf09-e25a-4dc3-b854-b67db8bb87b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:17.030561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-42a1bf09-e25a-4dc3-b854-b67db8bb87b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 2c2c1850-1d14-4a31-ab77-d50ef70c89b3] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:17.033539 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3605/4874] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:16 2022] GET /compute/v2.1/servers/edc345de-8d35-493d-ab7e-dd97ad4d0275 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:17.038642 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-42a1bf09-e25a-4dc3-b854-b67db8bb87b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-42a1bf09-e25a-4dc3-b854-b67db8bb87b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3 HTTP/1.1 Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '2c2c1850-1d14-4a31-ab77-d50ef70c89b3'} Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:17.042774 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.047568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:17.047568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:17.047568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:17.047568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:17.047568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:17.047568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:05:17.047568 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.050307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-42a1bf09-e25a-4dc3-b854-b67db8bb87b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:17.051182 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-42a1bf09-e25a-4dc3-b854-b67db8bb87b8 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3" status: 404 len: 111 microversion: 2.1 time: 0.026747 Sep 10 11:05:17.051912 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1270/4875] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:05:17 2022] DELETE /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:17.061775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f91aa843-fbf3-4b56-b0e0-8160690190d9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:17.062378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f91aa843-fbf3-4b56-b0e0-8160690190d9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: 2c2c1850-1d14-4a31-ab77-d50ef70c89b3] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:17.069335 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f91aa843-fbf3-4b56-b0e0-8160690190d9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f91aa843-fbf3-4b56-b0e0-8160690190d9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3 HTTP/1.1 Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '2c2c1850-1d14-4a31-ab77-d50ef70c89b3'} Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:17.071269 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:17.077983 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:17.077983 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:17.077983 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. Sep 10 11:05:17.077983 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:05:17.077983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f91aa843-fbf3-4b56-b0e0-8160690190d9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance 2c2c1850-1d14-4a31-ab77-d50ef70c89b3 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:17.077983 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f91aa843-fbf3-4b56-b0e0-8160690190d9 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3" status: 404 len: 111 microversion: 2.1 time: 0.016819 Sep 10 11:05:17.077983 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3606/4876] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:17 2022] GET /compute/v2.1/servers/2c2c1850-1d14-4a31-ab77-d50ef70c89b3 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:17.086870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-24338134-2952-4347-8839-39367d396ed5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:17.087718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-24338134-2952-4347-8839-39367d396ed5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:17.096015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24338134-2952-4347-8839-39367d396ed5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:17.096830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24338134-2952-4347-8839-39367d396ed5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:17.097533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24338134-2952-4347-8839-39367d396ed5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:17.098451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24338134-2952-4347-8839-39367d396ed5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:17.099094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24338134-2952-4347-8839-39367d396ed5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:17.099706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24338134-2952-4347-8839-39367d396ed5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:17.127323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-24338134-2952-4347-8839-39367d396ed5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:05:17.235681 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-24338134-2952-4347-8839-39367d396ed5 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 204 len: 0 microversion: 2.1 time: 0.154654 Sep 10 11:05:17.237334 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1271/4877] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:05:17 2022] DELETE /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:05:17.244916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-badce68a-d734-4d60-90fc-0ce1a8dd54cd tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:17.245619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-badce68a-d734-4d60-90fc-0ce1a8dd54cd tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:17.263093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-badce68a-d734-4d60-90fc-0ce1a8dd54cd tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:17.263806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-badce68a-d734-4d60-90fc-0ce1a8dd54cd tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:17.264009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-badce68a-d734-4d60-90fc-0ce1a8dd54cd tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:17.264712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-badce68a-d734-4d60-90fc-0ce1a8dd54cd tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:17.265205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-badce68a-d734-4d60-90fc-0ce1a8dd54cd tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:17.265638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-badce68a-d734-4d60-90fc-0ce1a8dd54cd tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:17.608756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-badce68a-d734-4d60-90fc-0ce1a8dd54cd tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:17.628626 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-badce68a-d734-4d60-90fc-0ce1a8dd54cd tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1480 microversion: 2.1 time: 0.387420 Sep 10 11:05:17.629917 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3607/4878] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:17 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1480 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:17.653564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-85545542-26c7-4caa-a243-70e8a69dd8af tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:17.654280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-85545542-26c7-4caa-a243-70e8a69dd8af tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:17.661772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85545542-26c7-4caa-a243-70e8a69dd8af tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:17.662811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85545542-26c7-4caa-a243-70e8a69dd8af tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:17.664075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85545542-26c7-4caa-a243-70e8a69dd8af tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:17.665093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85545542-26c7-4caa-a243-70e8a69dd8af tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:17.665859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85545542-26c7-4caa-a243-70e8a69dd8af tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:17.666441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85545542-26c7-4caa-a243-70e8a69dd8af tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:18.020781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-85545542-26c7-4caa-a243-70e8a69dd8af tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:18.029617 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-85545542-26c7-4caa-a243-70e8a69dd8af tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.385494 Sep 10 11:05:18.030827 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1272/4879] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:17 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:18.139855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5b2b94d1-ab11-45d6-a9af-03e9c912b542 req-140a5e11-57d9-4d87-b5bb-7fd1b84e8ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2d47aa-8bd3-4d8a-8fa2-a40267353792", "tag": "44f96b01-f3f7-4275-b72b-6280bc81593f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:18.156608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b2b94d1-ab11-45d6-a9af-03e9c912b542 req-140a5e11-57d9-4d87-b5bb-7fd1b84e8ed8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:18.161340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b2b94d1-ab11-45d6-a9af-03e9c912b542 req-140a5e11-57d9-4d87-b5bb-7fd1b84e8ed8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:18.161883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5b2b94d1-ab11-45d6-a9af-03e9c912b542 req-140a5e11-57d9-4d87-b5bb-7fd1b84e8ed8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:18.175152 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5b2b94d1-ab11-45d6-a9af-03e9c912b542 req-140a5e11-57d9-4d87-b5bb-7fd1b84e8ed8 service nova] Creating event network-changed:44f96b01-f3f7-4275-b72b-6280bc81593f for instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 on n-h2-856894-1 Sep 10 11:05:18.181229 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5b2b94d1-ab11-45d6-a9af-03e9c912b542 req-140a5e11-57d9-4d87-b5bb-7fd1b84e8ed8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045656 Sep 10 11:05:18.182512 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3608/4880] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:18.655843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-76a0f908-8604-4b7f-b6d3-40ba5dc861d0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:18.657394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-76a0f908-8604-4b7f-b6d3-40ba5dc861d0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:18.666469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76a0f908-8604-4b7f-b6d3-40ba5dc861d0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:18.667237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76a0f908-8604-4b7f-b6d3-40ba5dc861d0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:18.668876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76a0f908-8604-4b7f-b6d3-40ba5dc861d0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:18.669892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76a0f908-8604-4b7f-b6d3-40ba5dc861d0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:18.675880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76a0f908-8604-4b7f-b6d3-40ba5dc861d0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:18.676555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76a0f908-8604-4b7f-b6d3-40ba5dc861d0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:19.063697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-20e59ed7-62c3-4118-a99a-fa6d952b1f1e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:19.065206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-20e59ed7-62c3-4118-a99a-fa6d952b1f1e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:19.096944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e59ed7-62c3-4118-a99a-fa6d952b1f1e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:19.098059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e59ed7-62c3-4118-a99a-fa6d952b1f1e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:19.099278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e59ed7-62c3-4118-a99a-fa6d952b1f1e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:19.102752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e59ed7-62c3-4118-a99a-fa6d952b1f1e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:19.103602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e59ed7-62c3-4118-a99a-fa6d952b1f1e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:19.104278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20e59ed7-62c3-4118-a99a-fa6d952b1f1e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:19.213506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-76a0f908-8604-4b7f-b6d3-40ba5dc861d0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:19.232089 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-76a0f908-8604-4b7f-b6d3-40ba5dc861d0 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1480 microversion: 2.1 time: 0.574841 Sep 10 11:05:19.237395 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1273/4881] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:18 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1480 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:19.538840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20e59ed7-62c3-4118-a99a-fa6d952b1f1e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:19.552135 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-20e59ed7-62c3-4118-a99a-fa6d952b1f1e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.496789 Sep 10 11:05:19.557247 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3609/4882] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:19 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:20.267235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-19668c54-9dd1-4217-ae57-5c921bc61dbe tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:20.273139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-19668c54-9dd1-4217-ae57-5c921bc61dbe tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:20.287858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19668c54-9dd1-4217-ae57-5c921bc61dbe tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:20.297777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19668c54-9dd1-4217-ae57-5c921bc61dbe tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:20.310216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19668c54-9dd1-4217-ae57-5c921bc61dbe tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:20.314015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19668c54-9dd1-4217-ae57-5c921bc61dbe tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:20.314773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19668c54-9dd1-4217-ae57-5c921bc61dbe tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:20.316827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19668c54-9dd1-4217-ae57-5c921bc61dbe tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:20.581248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e680737-df73-4133-982a-808dc1e27b4e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:20.581772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e680737-df73-4133-982a-808dc1e27b4e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:20.594959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e680737-df73-4133-982a-808dc1e27b4e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:20.595490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e680737-df73-4133-982a-808dc1e27b4e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:20.595928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e680737-df73-4133-982a-808dc1e27b4e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:20.596654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e680737-df73-4133-982a-808dc1e27b4e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:20.597129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e680737-df73-4133-982a-808dc1e27b4e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:20.601593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e680737-df73-4133-982a-808dc1e27b4e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:20.697415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-19668c54-9dd1-4217-ae57-5c921bc61dbe tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:20.758785 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-19668c54-9dd1-4217-ae57-5c921bc61dbe tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1438 microversion: 2.1 time: 0.495849 Sep 10 11:05:20.767218 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1274/4883] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:20 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1438 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:20.795202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-103cdbee-bbeb-43d6-b3cc-69463fe42d2b req-d42b4049-de3c-4fc8-ac69-93e849e6c30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9d912a-d970-4b29-88a8-f2f22f879161", "name": "network-vif-deleted", "tag": "66742b44-ba72-464d-a74a-d558010b7373"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:20.853096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-103cdbee-bbeb-43d6-b3cc-69463fe42d2b req-d42b4049-de3c-4fc8-ac69-93e849e6c30c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:20.854323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-103cdbee-bbeb-43d6-b3cc-69463fe42d2b req-d42b4049-de3c-4fc8-ac69-93e849e6c30c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:20.859315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-103cdbee-bbeb-43d6-b3cc-69463fe42d2b req-d42b4049-de3c-4fc8-ac69-93e849e6c30c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:20.898507 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-103cdbee-bbeb-43d6-b3cc-69463fe42d2b req-d42b4049-de3c-4fc8-ac69-93e849e6c30c service nova] Creating event network-vif-deleted:66742b44-ba72-464d-a74a-d558010b7373 for instance fb9d912a-d970-4b29-88a8-f2f22f879161 on n-h2-856894-1 Sep 10 11:05:20.904114 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-103cdbee-bbeb-43d6-b3cc-69463fe42d2b req-d42b4049-de3c-4fc8-ac69-93e849e6c30c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130558 Sep 10 11:05:20.905819 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1275/4884] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:21.538915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e680737-df73-4133-982a-808dc1e27b4e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:21.549900 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e680737-df73-4133-982a-808dc1e27b4e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.972744 Sep 10 11:05:21.570842 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3610/4885] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:20 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:21.800985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:21.801766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:21.816253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:21.816742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:21.817381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:21.823350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:21.824170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:21.824798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:21.898040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:21.904938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:21.905736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:21.906398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lazy-loading 'fault' on Instance uuid fb9d912a-d970-4b29-88a8-f2f22f879161 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:05:21.967993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd01ead2408487dbe51fd732c209981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8409664137af4c74a00590b962f14d64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:21.987057 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8f2bdd15-44f2-4559-865c-3e5a2a877997 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 200 len: 1283 microversion: 2.1 time: 0.190655 Sep 10 11:05:22.021225 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1276/4886] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:21 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 1283 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:22.580418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-98c9af15-4e03-4d3b-9418-56c809f02046 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:22.583909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-98c9af15-4e03-4d3b-9418-56c809f02046 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:22.590421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98c9af15-4e03-4d3b-9418-56c809f02046 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:22.591154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98c9af15-4e03-4d3b-9418-56c809f02046 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:22.591752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98c9af15-4e03-4d3b-9418-56c809f02046 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:22.592758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98c9af15-4e03-4d3b-9418-56c809f02046 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:22.593512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98c9af15-4e03-4d3b-9418-56c809f02046 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:22.594271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98c9af15-4e03-4d3b-9418-56c809f02046 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:23.010393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-98c9af15-4e03-4d3b-9418-56c809f02046 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:23.016953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:23.017635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] [instance: fb9d912a-d970-4b29-88a8-f2f22f879161] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:23.023463 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-98c9af15-4e03-4d3b-9418-56c809f02046 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.447426 Sep 10 11:05:23.035661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:23.037381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:23.039656 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3611/4887] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:22 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:23.040453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:23.041669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:23.042295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:23.043087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:23.096656 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] HTTP exception thrown: Instance fb9d912a-d970-4b29-88a8-f2f22f879161 could not be found. Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Request method failure captured: Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 HTTP/1.1 Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG65_YBIw2KrJRLf9bFJ-Cp8B_EFaE1NSCu3ddDxszs1K88GSxEjt4XuJ9JiyVHM6dHThH0E_v28vMUBd9MBSwjrRUbDah29GNqE-R2Xf6PXbUf3LfCP_Q_oNUsDtUX-KoVJUj7WIaHvWCKrit1IMUfnlYJ5rVIF6QGuN4GjBtm6dbw Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8409664137af4c74a00590b962f14d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8409664137af4c74a00590b962f14d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8409664137af4c74a00590b962f14d64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersTestJSON-636723238 Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 8409664137af4c74a00590b962f14d64 Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersTestJSON-636723238 Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersTestJSON-636723238-project Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 1fd01ead2408487dbe51fd732c209981 Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersTestJSON-636723238-project Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance fb9d912a-d970-4b29-88a8-f2f22f879161 could not be found. Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'fb9d912a-d970-4b29-88a8-f2f22f879161'} Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9d912a-d970-4b29-88a8-f2f22f879161 could not be found. Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9d912a-d970-4b29-88a8-f2f22f879161 could not be found. Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:23.105631 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:05:23.112626 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:05:23.112626 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:05:23.112626 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:05:23.112626 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:05:23.112626 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9d912a-d970-4b29-88a8-f2f22f879161 could not be found. Sep 10 11:05:23.112626 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:05:23.114433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] Returning 404 to user: Instance fb9d912a-d970-4b29-88a8-f2f22f879161 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:05:23.115319 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c2dcb895-6238-4a95-a96b-c058b6ff9b06 tempest-ServersTestJSON-636723238 tempest-ServersTestJSON-636723238-project] 10.222.0.20 "GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161" status: 404 len: 111 microversion: 2.1 time: 0.102579 Sep 10 11:05:23.116194 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1277/4888] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:23 2022] GET /compute/v2.1/servers/fb9d912a-d970-4b29-88a8-f2f22f879161 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:05:24.054794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26b9a9ba-5510-4d7f-924c-ea0018993963 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:24.056556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26b9a9ba-5510-4d7f-924c-ea0018993963 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:24.063591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:24.071195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:24.096976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e0c51ff7-1226-4706-87a5-b1333edd56a8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:24.099214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e0c51ff7-1226-4706-87a5-b1333edd56a8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:24.099997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26b9a9ba-5510-4d7f-924c-ea0018993963 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:24.101256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26b9a9ba-5510-4d7f-924c-ea0018993963 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:24.104331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26b9a9ba-5510-4d7f-924c-ea0018993963 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:24.105921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26b9a9ba-5510-4d7f-924c-ea0018993963 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:24.106409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26b9a9ba-5510-4d7f-924c-ea0018993963 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:24.106844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26b9a9ba-5510-4d7f-924c-ea0018993963 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:24.110075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:24.112392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0c51ff7-1226-4706-87a5-b1333edd56a8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:24.113086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0c51ff7-1226-4706-87a5-b1333edd56a8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:24.114446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0c51ff7-1226-4706-87a5-b1333edd56a8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:24.115359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0c51ff7-1226-4706-87a5-b1333edd56a8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:24.115817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0c51ff7-1226-4706-87a5-b1333edd56a8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:24.121469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0c51ff7-1226-4706-87a5-b1333edd56a8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:24.207276 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e0c51ff7-1226-4706-87a5-b1333edd56a8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "POST /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2/action" status: 200 len: 24572 microversion: 2.1 time: 0.113996 Sep 10 11:05:24.211490 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1278/4889] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:05:24 2022] POST /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2/action => generated 24572 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:05:24.442423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-26b9a9ba-5510-4d7f-924c-ea0018993963 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:24.451725 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26b9a9ba-5510-4d7f-924c-ea0018993963 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.404159 Sep 10 11:05:24.465956 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3612/4890] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:24 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:25.477404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8ff7a054-c5d0-4d5a-9b57-3ba9b5b2821c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:25.478836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8ff7a054-c5d0-4d5a-9b57-3ba9b5b2821c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:25.482318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:25.498601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ff7a054-c5d0-4d5a-9b57-3ba9b5b2821c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:25.499388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ff7a054-c5d0-4d5a-9b57-3ba9b5b2821c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:25.500079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ff7a054-c5d0-4d5a-9b57-3ba9b5b2821c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:25.500965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ff7a054-c5d0-4d5a-9b57-3ba9b5b2821c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:25.501459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ff7a054-c5d0-4d5a-9b57-3ba9b5b2821c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:25.501891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ff7a054-c5d0-4d5a-9b57-3ba9b5b2821c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:25.884121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8ff7a054-c5d0-4d5a-9b57-3ba9b5b2821c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:25.894203 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8ff7a054-c5d0-4d5a-9b57-3ba9b5b2821c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.419562 Sep 10 11:05:25.894865 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1279/4891] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:25 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:26.923989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c5724b3-00c7-497f-bdff-96bdd31acd94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:26.924613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c5724b3-00c7-497f-bdff-96bdd31acd94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:26.934835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c5724b3-00c7-497f-bdff-96bdd31acd94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:26.940047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c5724b3-00c7-497f-bdff-96bdd31acd94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:26.940871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c5724b3-00c7-497f-bdff-96bdd31acd94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:26.941812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c5724b3-00c7-497f-bdff-96bdd31acd94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:26.942440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c5724b3-00c7-497f-bdff-96bdd31acd94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:26.943058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c5724b3-00c7-497f-bdff-96bdd31acd94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:27.166531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9c5724b3-00c7-497f-bdff-96bdd31acd94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:27.179155 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c5724b3-00c7-497f-bdff-96bdd31acd94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.258607 Sep 10 11:05:27.197522 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3613/4892] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:26 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:05:28.212793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:28.214330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:28.232604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:28.233200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:28.233723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:28.234869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:28.235533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:28.244137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:28.517617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:28.532079 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.325147 Sep 10 11:05:28.532893 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1280/4893] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:28 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:29.555942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b44f19ec-5d5e-4994-b7e4-2d93fa48d878 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:29.556573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b44f19ec-5d5e-4994-b7e4-2d93fa48d878 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:29.565767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44f19ec-5d5e-4994-b7e4-2d93fa48d878 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:29.566084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44f19ec-5d5e-4994-b7e4-2d93fa48d878 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:29.566527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44f19ec-5d5e-4994-b7e4-2d93fa48d878 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:29.568494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44f19ec-5d5e-4994-b7e4-2d93fa48d878 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:29.568974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44f19ec-5d5e-4994-b7e4-2d93fa48d878 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:29.569445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b44f19ec-5d5e-4994-b7e4-2d93fa48d878 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:29.812621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b44f19ec-5d5e-4994-b7e4-2d93fa48d878 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:29.832702 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b44f19ec-5d5e-4994-b7e4-2d93fa48d878 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.278821 Sep 10 11:05:29.832702 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3614/4894] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:29 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:29.894423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:29.895457 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3029cc3f-7017-4216-a0a4-2fdee0f4ba1a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001403 Sep 10 11:05:29.895824 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1281/4895] 10.222.0.20 () {56 vars in 886 bytes} [Sat Sep 10 11:05:29 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 11:05:30.717605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71a663db-64a9-49b3-b06a-65b201942e6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:30.719039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-71a663db-64a9-49b3-b06a-65b201942e6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:30.726863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71a663db-64a9-49b3-b06a-65b201942e6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:30.727642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71a663db-64a9-49b3-b06a-65b201942e6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:30.728324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71a663db-64a9-49b3-b06a-65b201942e6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:30.729431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71a663db-64a9-49b3-b06a-65b201942e6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:30.730156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71a663db-64a9-49b3-b06a-65b201942e6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:30.730803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71a663db-64a9-49b3-b06a-65b201942e6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:30.735843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:30.765439 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71a663db-64a9-49b3-b06a-65b201942e6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/ips" status: 200 len: 146 microversion: 2.1 time: 0.052545 Sep 10 11:05:30.773576 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3615/4896] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 11:05:30 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/ips => generated 146 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:30.855813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3a0e3d7b-109c-4eb7-86b7-8f8b29479c6e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:30.856354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3a0e3d7b-109c-4eb7-86b7-8f8b29479c6e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:30.874581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e3d7b-109c-4eb7-86b7-8f8b29479c6e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:30.875090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e3d7b-109c-4eb7-86b7-8f8b29479c6e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:30.875533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e3d7b-109c-4eb7-86b7-8f8b29479c6e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:30.876263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e3d7b-109c-4eb7-86b7-8f8b29479c6e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:30.876710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e3d7b-109c-4eb7-86b7-8f8b29479c6e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:30.877160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3a0e3d7b-109c-4eb7-86b7-8f8b29479c6e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:31.498486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3a0e3d7b-109c-4eb7-86b7-8f8b29479c6e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:31.506384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:31.509876 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3a0e3d7b-109c-4eb7-86b7-8f8b29479c6e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.658713 Sep 10 11:05:31.511082 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1282/4897] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:30 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:32.250283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f50eb6b4-0493-4387-a82c-26baed379ac6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e167022f-89f8-4304-b2f7-ef2285903133"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:32.254210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f50eb6b4-0493-4387-a82c-26baed379ac6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:32.265273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f50eb6b4-0493-4387-a82c-26baed379ac6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:32.266096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f50eb6b4-0493-4387-a82c-26baed379ac6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:32.266738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f50eb6b4-0493-4387-a82c-26baed379ac6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:32.267665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f50eb6b4-0493-4387-a82c-26baed379ac6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:32.268791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f50eb6b4-0493-4387-a82c-26baed379ac6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:32.270434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f50eb6b4-0493-4387-a82c-26baed379ac6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:32.534540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-01bd8111-7e29-4447-bf5b-4a9bdcc679f4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:32.535759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-01bd8111-7e29-4447-bf5b-4a9bdcc679f4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:32.547378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01bd8111-7e29-4447-bf5b-4a9bdcc679f4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:32.551453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01bd8111-7e29-4447-bf5b-4a9bdcc679f4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:32.552239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01bd8111-7e29-4447-bf5b-4a9bdcc679f4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:32.555298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01bd8111-7e29-4447-bf5b-4a9bdcc679f4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:32.559524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01bd8111-7e29-4447-bf5b-4a9bdcc679f4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:32.559697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01bd8111-7e29-4447-bf5b-4a9bdcc679f4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:32.663614 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f50eb6b4-0493-4387-a82c-26baed379ac6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418491 Sep 10 11:05:32.664606 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3616/4898] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:05:32 2022] POST /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:32.881748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-01bd8111-7e29-4447-bf5b-4a9bdcc679f4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:32.892316 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-01bd8111-7e29-4447-bf5b-4a9bdcc679f4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.362781 Sep 10 11:05:32.901599 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1283/4899] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:32 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:33.486397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3dd4bce5-7a3a-47f0-8672-29ef3907b2e6 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:33.487823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3dd4bce5-7a3a-47f0-8672-29ef3907b2e6 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:33.495497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd4bce5-7a3a-47f0-8672-29ef3907b2e6 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:33.496703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd4bce5-7a3a-47f0-8672-29ef3907b2e6 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:33.497344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd4bce5-7a3a-47f0-8672-29ef3907b2e6 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:33.498513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd4bce5-7a3a-47f0-8672-29ef3907b2e6 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:33.499133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd4bce5-7a3a-47f0-8672-29ef3907b2e6 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:33.499725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3dd4bce5-7a3a-47f0-8672-29ef3907b2e6 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:33.559868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3dd4bce5-7a3a-47f0-8672-29ef3907b2e6 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:05:33.747196 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3dd4bce5-7a3a-47f0-8672-29ef3907b2e6 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 204 len: 0 microversion: 2.42 time: 0.587679 Sep 10 11:05:33.749112 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3617/4900] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 11:05:33 2022] DELETE /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:05:33.757346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:33.758584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:33.766179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:33.766876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:33.767488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:33.768357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:33.768963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:33.769616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:33.920692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d7ed90d3-64b0-4bf7-bea3-66fd3e5c0be9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:33.922733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d7ed90d3-64b0-4bf7-bea3-66fd3e5c0be9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:33.930386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7ed90d3-64b0-4bf7-bea3-66fd3e5c0be9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:33.931075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7ed90d3-64b0-4bf7-bea3-66fd3e5c0be9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:33.931996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7ed90d3-64b0-4bf7-bea3-66fd3e5c0be9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:33.932932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7ed90d3-64b0-4bf7-bea3-66fd3e5c0be9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:33.933682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7ed90d3-64b0-4bf7-bea3-66fd3e5c0be9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:33.934345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7ed90d3-64b0-4bf7-bea3-66fd3e5c0be9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:34.170997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:34.191510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:34.192974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:34.201932 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-815a2e5f-7e03-4e2b-b661-dbb3eb44fb9e tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2956 microversion: 2.42 time: 0.447204 Sep 10 11:05:34.203013 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1284/4901] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:33 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2956 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:05:34.232997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7ed90d3-64b0-4bf7-bea3-66fd3e5c0be9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:34.242201 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d7ed90d3-64b0-4bf7-bea3-66fd3e5c0be9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.326321 Sep 10 11:05:34.242806 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3618/4902] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:33 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:35.232138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:35.233589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:35.247050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:35.248624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:35.249903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:35.250640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:35.251097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:35.251523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:35.269065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4036444-86f2-4ed9-a29c-756d3363f434 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:35.269996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4036444-86f2-4ed9-a29c-756d3363f434 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:35.285834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4036444-86f2-4ed9-a29c-756d3363f434 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:35.294976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4036444-86f2-4ed9-a29c-756d3363f434 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:35.295533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4036444-86f2-4ed9-a29c-756d3363f434 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:35.296287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4036444-86f2-4ed9-a29c-756d3363f434 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:35.296758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4036444-86f2-4ed9-a29c-756d3363f434 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:35.297217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4036444-86f2-4ed9-a29c-756d3363f434 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:35.694521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4036444-86f2-4ed9-a29c-756d3363f434 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:35.704119 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a4036444-86f2-4ed9-a29c-756d3363f434 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1169 microversion: 2.1 time: 0.439479 Sep 10 11:05:35.705559 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3619/4903] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:35 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1169 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:35.745420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:35.762477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:35.765038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:35.767690 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-510251a3-41dc-4393-8e0f-749c13eeb08b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2956 microversion: 2.42 time: 0.539653 Sep 10 11:05:35.768595 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1285/4904] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:35 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2956 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:05:36.728332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8aa86e01-5ee9-4602-93fa-3e3f2ef1c4c7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:36.735709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8aa86e01-5ee9-4602-93fa-3e3f2ef1c4c7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:36.739314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:36.752519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa86e01-5ee9-4602-93fa-3e3f2ef1c4c7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:36.753045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa86e01-5ee9-4602-93fa-3e3f2ef1c4c7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:36.753515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa86e01-5ee9-4602-93fa-3e3f2ef1c4c7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:36.756186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa86e01-5ee9-4602-93fa-3e3f2ef1c4c7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:36.758998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa86e01-5ee9-4602-93fa-3e3f2ef1c4c7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:36.759465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa86e01-5ee9-4602-93fa-3e3f2ef1c4c7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:36.801466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:36.802733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:36.814573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:36.815323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:36.815916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:36.817268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:36.818045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:36.818774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:37.227827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8aa86e01-5ee9-4602-93fa-3e3f2ef1c4c7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:37.257754 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8aa86e01-5ee9-4602-93fa-3e3f2ef1c4c7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1203 microversion: 2.1 time: 0.533308 Sep 10 11:05:37.261816 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3620/4905] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:36 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1203 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:37.304747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:37.314816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:37.319543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:37.328770 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7914f005-e49a-42d7-910f-ce12856978d2 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2956 microversion: 2.42 time: 0.533184 Sep 10 11:05:37.329628 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1286/4906] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:36 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2956 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:05:38.286567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57ad6ddd-74aa-4aeb-9259-28fd89005631 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:38.287912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57ad6ddd-74aa-4aeb-9259-28fd89005631 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:38.302754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57ad6ddd-74aa-4aeb-9259-28fd89005631 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:38.309247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57ad6ddd-74aa-4aeb-9259-28fd89005631 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:38.310248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57ad6ddd-74aa-4aeb-9259-28fd89005631 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:38.311274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57ad6ddd-74aa-4aeb-9259-28fd89005631 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:38.314350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57ad6ddd-74aa-4aeb-9259-28fd89005631 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:38.315982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57ad6ddd-74aa-4aeb-9259-28fd89005631 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:38.371133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:38.372397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:38.389293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:38.390110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:38.390800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:38.396238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:38.397245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:38.398313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:38.950290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:38.970330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:38.972865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:38.974925 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-78578acf-dbf7-41a6-a318-5f76e4665550 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2956 microversion: 2.42 time: 0.609540 Sep 10 11:05:38.975981 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1287/4907] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:38 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2956 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:05:39.083904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-57ad6ddd-74aa-4aeb-9259-28fd89005631 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:39.094654 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57ad6ddd-74aa-4aeb-9259-28fd89005631 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1203 microversion: 2.1 time: 0.811694 Sep 10 11:05:39.109356 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3621/4908] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:38 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1203 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:40.007081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:40.007705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:40.021786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:40.023994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:40.024440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:40.025186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:40.025646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:40.026074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:40.120190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b7c079a-c744-4e52-a9b5-669770c58585 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:40.121603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b7c079a-c744-4e52-a9b5-669770c58585 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:40.143942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7c079a-c744-4e52-a9b5-669770c58585 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:40.144440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7c079a-c744-4e52-a9b5-669770c58585 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:40.144879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7c079a-c744-4e52-a9b5-669770c58585 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:40.152249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7c079a-c744-4e52-a9b5-669770c58585 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:40.152776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7c079a-c744-4e52-a9b5-669770c58585 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:40.153255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b7c079a-c744-4e52-a9b5-669770c58585 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:40.779566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3b7c079a-c744-4e52-a9b5-669770c58585 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:40.789969 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b7c079a-c744-4e52-a9b5-669770c58585 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1203 microversion: 2.1 time: 0.673832 Sep 10 11:05:40.790578 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3622/4909] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:40 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1203 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:40.956237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:40.975313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:40.977330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:40.978892 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-782f17e5-9af3-4f2c-9210-3c0b9df3dbeb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2935 microversion: 2.42 time: 0.975707 Sep 10 11:05:40.980530 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1288/4910] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:40 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2935 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:05:41.046419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e430c07c-495d-47a7-9053-f88354d77c05 req-c7623060-4d76-42b2-a3a9-3be35455f6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-unplugged", "status": "completed", "tag": "e66f2383-ec13-45eb-a0f1-1d3e117bb57b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:41.072987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e430c07c-495d-47a7-9053-f88354d77c05 req-c7623060-4d76-42b2-a3a9-3be35455f6e8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:41.073837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e430c07c-495d-47a7-9053-f88354d77c05 req-c7623060-4d76-42b2-a3a9-3be35455f6e8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:41.074806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e430c07c-495d-47a7-9053-f88354d77c05 req-c7623060-4d76-42b2-a3a9-3be35455f6e8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:41.108494 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e430c07c-495d-47a7-9053-f88354d77c05 req-c7623060-4d76-42b2-a3a9-3be35455f6e8 service nova] Creating event network-vif-unplugged:e66f2383-ec13-45eb-a0f1-1d3e117bb57b for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:05:41.126030 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e430c07c-495d-47a7-9053-f88354d77c05 req-c7623060-4d76-42b2-a3a9-3be35455f6e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.311742 Sep 10 11:05:41.127798 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3623/4911] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:41.817624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1fae2e43-9cb7-422b-bdce-e3fb54594da6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:41.818905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1fae2e43-9cb7-422b-bdce-e3fb54594da6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:41.825615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc728c1c-70d7-4ddd-a67b-f60e96d84ad8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Action: 'create', calling method: .version_select at 0x7efcad332670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1062787067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXAYfVxqBBVbccngpO9RFC7WPu0s59AfOmWa6sLh3VHQIsUyhi8L5Ia1JNrHhP4SgodIUYwEBT3wETkQyGO32ezqlwcQAbW/B2AO8V/2GO6IloT8Zon0zfhDoYQE21gjw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:41.829396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fae2e43-9cb7-422b-bdce-e3fb54594da6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:41.831484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fae2e43-9cb7-422b-bdce-e3fb54594da6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:41.831857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fae2e43-9cb7-422b-bdce-e3fb54594da6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:41.832611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fae2e43-9cb7-422b-bdce-e3fb54594da6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:41.833047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fae2e43-9cb7-422b-bdce-e3fb54594da6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:41.833494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1fae2e43-9cb7-422b-bdce-e3fb54594da6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:41.859633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fc728c1c-70d7-4ddd-a67b-f60e96d84ad8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:05:41.878800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-fc728c1c-70d7-4ddd-a67b-f60e96d84ad8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for user 5075387b0b14438ab9164683b752b867 and project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:05:41.932485 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc728c1c-70d7-4ddd-a67b-f60e96d84ad8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.112415 Sep 10 11:05:41.943764 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3624/4912] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:05:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:42.010490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:42.012070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:42.021971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:42.022807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:42.023463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:42.024437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:42.025271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:42.025904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:42.399142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1fae2e43-9cb7-422b-bdce-e3fb54594da6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:42.412611 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1fae2e43-9cb7-422b-bdce-e3fb54594da6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1203 microversion: 2.1 time: 0.597492 Sep 10 11:05:42.413906 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1289/4913] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:41 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1203 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:42.848087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:42.878776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:42.881044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:42.884751 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14a27f1b-2bf3-419e-8eef-2545af89309d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2914 microversion: 2.42 time: 0.879245 Sep 10 11:05:42.908032 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3625/4914] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:42 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2914 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:05:43.165782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-3121ebe7-0710-4d03-b7d9-e03a3a034f1b req-2e9377f2-1a12-4a75-a2e2-19179dcf7ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-unplugged", "status": "completed", "tag": "1387031f-4f94-43c5-9a5c-744bd5765477"}, {"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-unplugged", "status": "completed", "tag": "37ceaf6b-33c8-4243-bc18-c92310693b11"}, {"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-unplugged", "status": "completed", "tag": "210108b0-a7eb-488b-aad7-2977ab966a4c"}, {"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-unplugged", "status": "completed", "tag": "610ac6bc-c492-465a-8b1d-4ee26f478c96"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:43.193373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3121ebe7-0710-4d03-b7d9-e03a3a034f1b req-2e9377f2-1a12-4a75-a2e2-19179dcf7ab4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:43.194258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3121ebe7-0710-4d03-b7d9-e03a3a034f1b req-2e9377f2-1a12-4a75-a2e2-19179dcf7ab4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:43.194851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3121ebe7-0710-4d03-b7d9-e03a3a034f1b req-2e9377f2-1a12-4a75-a2e2-19179dcf7ab4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:43.208066 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3121ebe7-0710-4d03-b7d9-e03a3a034f1b req-2e9377f2-1a12-4a75-a2e2-19179dcf7ab4 service nova] Creating event network-vif-unplugged:1387031f-4f94-43c5-9a5c-744bd5765477 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:05:43.209486 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3121ebe7-0710-4d03-b7d9-e03a3a034f1b req-2e9377f2-1a12-4a75-a2e2-19179dcf7ab4 service nova] Creating event network-vif-unplugged:37ceaf6b-33c8-4243-bc18-c92310693b11 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:05:43.210238 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3121ebe7-0710-4d03-b7d9-e03a3a034f1b req-2e9377f2-1a12-4a75-a2e2-19179dcf7ab4 service nova] Creating event network-vif-unplugged:210108b0-a7eb-488b-aad7-2977ab966a4c for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:05:43.211028 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3121ebe7-0710-4d03-b7d9-e03a3a034f1b req-2e9377f2-1a12-4a75-a2e2-19179dcf7ab4 service nova] Creating event network-vif-unplugged:610ac6bc-c492-465a-8b1d-4ee26f478c96 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:05:43.217394 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-3121ebe7-0710-4d03-b7d9-e03a3a034f1b req-2e9377f2-1a12-4a75-a2e2-19179dcf7ab4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.063065 Sep 10 11:05:43.218313 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1290/4915] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:43.437232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d26ae78f-236a-4fd6-9531-c536fcc86541 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:43.438154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d26ae78f-236a-4fd6-9531-c536fcc86541 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:43.446774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d26ae78f-236a-4fd6-9531-c536fcc86541 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:43.447735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d26ae78f-236a-4fd6-9531-c536fcc86541 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:43.450525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d26ae78f-236a-4fd6-9531-c536fcc86541 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:43.452387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d26ae78f-236a-4fd6-9531-c536fcc86541 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:43.456080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d26ae78f-236a-4fd6-9531-c536fcc86541 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:43.456721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d26ae78f-236a-4fd6-9531-c536fcc86541 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:43.494913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1182398283", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "455176bb-5e5f-45ba-9fa7-17e5826ec8af"}], "key_name": "tempest-TestNetworkBasicOps-1062787067", "security_groups": [{"name": "tempest-secgroup-smoke-391214971"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:43.848617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] validate_networks() for [('455176bb-5e5f-45ba-9fa7-17e5826ec8af', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:05:43.862687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d26ae78f-236a-4fd6-9531-c536fcc86541 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:43.877844 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d26ae78f-236a-4fd6-9531-c536fcc86541 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1203 microversion: 2.1 time: 0.445112 Sep 10 11:05:43.878969 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3626/4916] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:43 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1203 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:43.884132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8cf19eac-ad62-42ad-9ff4-c3e959799d39 req-3a5fac48-c7a7-4414-8f76-b206833a2cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-deleted", "tag": "37ceaf6b-33c8-4243-bc18-c92310693b11"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:43.906346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8cf19eac-ad62-42ad-9ff4-c3e959799d39 req-3a5fac48-c7a7-4414-8f76-b206833a2cac service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:43.906842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8cf19eac-ad62-42ad-9ff4-c3e959799d39 req-3a5fac48-c7a7-4414-8f76-b206833a2cac service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:43.907286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8cf19eac-ad62-42ad-9ff4-c3e959799d39 req-3a5fac48-c7a7-4414-8f76-b206833a2cac service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:43.933099 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8cf19eac-ad62-42ad-9ff4-c3e959799d39 req-3a5fac48-c7a7-4414-8f76-b206833a2cac service nova] Creating event network-vif-deleted:37ceaf6b-33c8-4243-bc18-c92310693b11 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:05:43.943765 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8cf19eac-ad62-42ad-9ff4-c3e959799d39 req-3a5fac48-c7a7-4414-8f76-b206833a2cac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063386 Sep 10 11:05:43.945194 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3627/4917] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:43.951679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:43.952631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:43.966234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:43.966868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:43.967331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:43.978509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:43.979326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:43.982427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:44.420271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:44.434860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:44.436449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:44.437806 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3101d546-f109-4ce4-9892-1c9ee07b566a tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2868 microversion: 2.42 time: 0.491327 Sep 10 11:05:44.464668 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3628/4918] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:43 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2868 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:05:44.594636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35a9477d-fc7a-42b8-8778-a9ff76ad1c85 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: .version_select at 0x7efcad340e50>, body: {"keypair": {"name": "tempest-keypair-842355759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqMrHjW4B8TAa4QynfoJlSNYtYlX7JwhNvHH/DhMJZkU2eawJyT3O9pMhUdKVWlLIDmrvt7QFmFuSDi3ipmI9/cDv9faG6TzdZhz0ACRno5sZ/5ZDlBab8pFzPnDJSGtw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:44.626958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-35a9477d-fc7a-42b8-8778-a9ff76ad1c85 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for project b28403f237c84af2a051fa9feb72f60b. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:05:44.637178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-35a9477d-fc7a-42b8-8778-a9ff76ad1c85 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for user c3b1df3721f24d13807ab7f4c4a677f8 and project b28403f237c84af2a051fa9feb72f60b. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:05:44.678719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-35a9477d-fc7a-42b8-8778-a9ff76ad1c85 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209778 Sep 10 11:05:44.689050 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3629/4919] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:05:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:44.903973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ab33d2e-d690-4f24-a8f7-afb1fb2c739f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:44.904789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6ab33d2e-d690-4f24-a8f7-afb1fb2c739f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:44.912508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ab33d2e-d690-4f24-a8f7-afb1fb2c739f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:44.913329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ab33d2e-d690-4f24-a8f7-afb1fb2c739f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:44.913944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ab33d2e-d690-4f24-a8f7-afb1fb2c739f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:44.915250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ab33d2e-d690-4f24-a8f7-afb1fb2c739f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:44.916278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ab33d2e-d690-4f24-a8f7-afb1fb2c739f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:44.916881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ab33d2e-d690-4f24-a8f7-afb1fb2c739f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:45.409454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6ab33d2e-d690-4f24-a8f7-afb1fb2c739f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:45.421861 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ab33d2e-d690-4f24-a8f7-afb1fb2c739f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1203 microversion: 2.1 time: 0.519164 Sep 10 11:05:45.423169 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3630/4920] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:44 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1203 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:45.430917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:05:45.432303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:05:45.433526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:05:45.434104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:05:45.435215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:05:45.453648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:45.455537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:45.456459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:45.457735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:45.458601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:45.459579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:45.472577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:45.473247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:45.489668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:45.490585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:45.491288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:45.492181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:45.492957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:45.494901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:45.525825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:05:45.542333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for user 5075387b0b14438ab9164683b752b867 and project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:05:45.582072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:05:45.586927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:05:45.654569 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-98809b52-0dcb-4ade-b0c5-b6b7db7cffcc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.163748 Sep 10 11:05:45.663954 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1291/4921] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:05:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 2173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:05:45.670228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-34abf04c-dbc5-4f5f-bba8-7cee3db9e9aa tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:45.671205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-34abf04c-dbc5-4f5f-bba8-7cee3db9e9aa tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:45.796897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-34abf04c-dbc5-4f5f-bba8-7cee3db9e9aa tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:45.804770 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-34abf04c-dbc5-4f5f-bba8-7cee3db9e9aa tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1249 microversion: 2.1 time: 0.139252 Sep 10 11:05:45.807229 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1292/4922] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:45 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:45.952588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:45.971543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:45.973253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:45.974988 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-112f1ee9-260b-4dd2-8565-0bc995526003 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2708 microversion: 2.42 time: 0.507330 Sep 10 11:05:45.975125 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3631/4923] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:45 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2708 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:05:45.990606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-35efce8f-85c6-49e4-aa27-874816a2e489 req-97605ac0-a957-4e21-88a6-9e4f375252e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-deleted", "tag": "610ac6bc-c492-465a-8b1d-4ee26f478c96"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:46.013722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-35efce8f-85c6-49e4-aa27-874816a2e489 req-97605ac0-a957-4e21-88a6-9e4f375252e4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:46.014303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-35efce8f-85c6-49e4-aa27-874816a2e489 req-97605ac0-a957-4e21-88a6-9e4f375252e4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:46.015477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-35efce8f-85c6-49e4-aa27-874816a2e489 req-97605ac0-a957-4e21-88a6-9e4f375252e4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:46.034608 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-35efce8f-85c6-49e4-aa27-874816a2e489 req-97605ac0-a957-4e21-88a6-9e4f375252e4 service nova] Creating event network-vif-deleted:610ac6bc-c492-465a-8b1d-4ee26f478c96 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:05:46.046512 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-35efce8f-85c6-49e4-aa27-874816a2e489 req-97605ac0-a957-4e21-88a6-9e4f375252e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059608 Sep 10 11:05:46.048008 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1293/4924] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:46.454271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-733c8c87-dc85-48d0-a2e0-52ae6c414c61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:46.455559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-733c8c87-dc85-48d0-a2e0-52ae6c414c61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:46.467755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-733c8c87-dc85-48d0-a2e0-52ae6c414c61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:46.470968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-733c8c87-dc85-48d0-a2e0-52ae6c414c61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:46.471612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-733c8c87-dc85-48d0-a2e0-52ae6c414c61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:46.472350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-733c8c87-dc85-48d0-a2e0-52ae6c414c61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:46.472827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-733c8c87-dc85-48d0-a2e0-52ae6c414c61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:46.475721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-733c8c87-dc85-48d0-a2e0-52ae6c414c61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:46.520018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:46.833197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-53f801d4-e8ec-4771-8788-d16033d34f57 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:46.835546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-53f801d4-e8ec-4771-8788-d16033d34f57 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:46.848131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53f801d4-e8ec-4771-8788-d16033d34f57 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:46.851002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53f801d4-e8ec-4771-8788-d16033d34f57 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:46.852371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53f801d4-e8ec-4771-8788-d16033d34f57 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:46.853531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53f801d4-e8ec-4771-8788-d16033d34f57 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:46.854230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53f801d4-e8ec-4771-8788-d16033d34f57 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:46.855519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53f801d4-e8ec-4771-8788-d16033d34f57 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:46.916285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-733c8c87-dc85-48d0-a2e0-52ae6c414c61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:46.931255 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-733c8c87-dc85-48d0-a2e0-52ae6c414c61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1203 microversion: 2.1 time: 0.482913 Sep 10 11:05:46.931878 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3632/4925] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:46 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1203 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:47.007865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:47.008483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:47.017849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:47.018592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:47.031243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-53f801d4-e8ec-4771-8788-d16033d34f57 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:47.055506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:47.062795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:47.065862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:47.068352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:47.075598 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-53f801d4-e8ec-4771-8788-d16033d34f57 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1301 microversion: 2.1 time: 0.243837 Sep 10 11:05:47.103787 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1294/4926] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:46 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1301 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:47.246362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-466668260", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e19ca223-58e0-4bb3-8cd0-347d45a52b81"}], "security_groups": [{"name": "tempest-securitygroup--1606924848"}], "key_name": "tempest-keypair-842355759", "user_data": "}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:47.970728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] validate_networks() for [('e19ca223-58e0-4bb3-8cd0-347d45a52b81', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:05:48.153907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:48.174766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:48.178171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:48.180924 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-751ec440-3a02-4dd5-8e2a-466557e7d655 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2459 microversion: 2.42 time: 1.176876 Sep 10 11:05:48.182342 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3633/4927] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:47 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2459 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:05:48.204943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21b70484-6bcc-40de-919c-cca625af5a12 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:48.212361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21b70484-6bcc-40de-919c-cca625af5a12 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:48.227408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21b70484-6bcc-40de-919c-cca625af5a12 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:48.228220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21b70484-6bcc-40de-919c-cca625af5a12 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:48.228839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21b70484-6bcc-40de-919c-cca625af5a12 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:48.232562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21b70484-6bcc-40de-919c-cca625af5a12 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:48.234016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21b70484-6bcc-40de-919c-cca625af5a12 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:48.234679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21b70484-6bcc-40de-919c-cca625af5a12 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:49.023195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21b70484-6bcc-40de-919c-cca625af5a12 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:49.033871 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21b70484-6bcc-40de-919c-cca625af5a12 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1203 microversion: 2.1 time: 0.849704 Sep 10 11:05:49.035088 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3634/4928] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:48 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1203 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:49.040937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-57c42513-0ab7-4ec4-8d88-93686bcd54dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:49.041899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-57c42513-0ab7-4ec4-8d88-93686bcd54dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:49.053813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57c42513-0ab7-4ec4-8d88-93686bcd54dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:49.055460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57c42513-0ab7-4ec4-8d88-93686bcd54dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:49.056140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57c42513-0ab7-4ec4-8d88-93686bcd54dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:49.057174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57c42513-0ab7-4ec4-8d88-93686bcd54dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:49.057742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57c42513-0ab7-4ec4-8d88-93686bcd54dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:49.058305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-57c42513-0ab7-4ec4-8d88-93686bcd54dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:49.221451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-57c42513-0ab7-4ec4-8d88-93686bcd54dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:49.236157 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-57c42513-0ab7-4ec4-8d88-93686bcd54dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1307 microversion: 2.1 time: 0.199290 Sep 10 11:05:49.238565 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3635/4929] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:49 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:49.255145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e95cd5df-5b20-43dd-ab7b-23f570a17ceb req-9154ca08-8b39-4da5-b525-da56d96c84f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-deleted", "tag": "e66f2383-ec13-45eb-a0f1-1d3e117bb57b"}, {"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-deleted", "tag": "1387031f-4f94-43c5-9a5c-744bd5765477"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:49.267447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e95cd5df-5b20-43dd-ab7b-23f570a17ceb req-9154ca08-8b39-4da5-b525-da56d96c84f8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:49.268204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e95cd5df-5b20-43dd-ab7b-23f570a17ceb req-9154ca08-8b39-4da5-b525-da56d96c84f8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:49.268821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e95cd5df-5b20-43dd-ab7b-23f570a17ceb req-9154ca08-8b39-4da5-b525-da56d96c84f8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:49.284679 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e95cd5df-5b20-43dd-ab7b-23f570a17ceb req-9154ca08-8b39-4da5-b525-da56d96c84f8 service nova] Creating event network-vif-deleted:e66f2383-ec13-45eb-a0f1-1d3e117bb57b for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:05:49.286697 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e95cd5df-5b20-43dd-ab7b-23f570a17ceb req-9154ca08-8b39-4da5-b525-da56d96c84f8 service nova] Creating event network-vif-deleted:1387031f-4f94-43c5-9a5c-744bd5765477 for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:05:49.294103 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e95cd5df-5b20-43dd-ab7b-23f570a17ceb req-9154ca08-8b39-4da5-b525-da56d96c84f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053384 Sep 10 11:05:49.295314 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3636/4930] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:49.302543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:49.303473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:49.312798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:49.318147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:49.318788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:49.319748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:49.320383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:49.320973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:49.599030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:05:49.599577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:05:49.605471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:05:49.605471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:05:49.606218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:05:49.644211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:49.644704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:49.645155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:49.646107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:49.646715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:49.647293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:49.686198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for project b28403f237c84af2a051fa9feb72f60b. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:05:49.694528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for user c3b1df3721f24d13807ab7f4c4a677f8 and project b28403f237c84af2a051fa9feb72f60b. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:05:49.722927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:05:49.725904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:05:49.818685 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1c9113f9-8dcf-4590-875e-1778bde4dd94 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.573991 Sep 10 11:05:49.823324 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1295/4931] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:05:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:05:49.846458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9353adfb-44c3-4120-a18d-f267011e6619 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:49.856791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9353adfb-44c3-4120-a18d-f267011e6619 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:49.884298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9353adfb-44c3-4120-a18d-f267011e6619 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:49.884805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9353adfb-44c3-4120-a18d-f267011e6619 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:49.887608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9353adfb-44c3-4120-a18d-f267011e6619 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:49.888552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9353adfb-44c3-4120-a18d-f267011e6619 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:49.889729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9353adfb-44c3-4120-a18d-f267011e6619 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:49.890337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9353adfb-44c3-4120-a18d-f267011e6619 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:49.940420 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9353adfb-44c3-4120-a18d-f267011e6619 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115658 Sep 10 11:05:49.941725 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1296/4932] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:05:49 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:49.946565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-89409705-7b4e-4841-8427-08e028c12fc1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:49.947442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-89409705-7b4e-4841-8427-08e028c12fc1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:50.070277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-89409705-7b4e-4841-8427-08e028c12fc1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:50.080715 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-89409705-7b4e-4841-8427-08e028c12fc1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1240 microversion: 2.1 time: 0.135900 Sep 10 11:05:50.081957 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1297/4933] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:49 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1240 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:50.098127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e5d5361e-471e-4e68-830c-41645916091d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:50.098826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e5d5361e-471e-4e68-830c-41645916091d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:50.116287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5d5361e-471e-4e68-830c-41645916091d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:50.117967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5d5361e-471e-4e68-830c-41645916091d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:50.119413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5d5361e-471e-4e68-830c-41645916091d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:50.121059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5d5361e-471e-4e68-830c-41645916091d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:50.122892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5d5361e-471e-4e68-830c-41645916091d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:50.124091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e5d5361e-471e-4e68-830c-41645916091d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:50.138531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:50.150659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:50.154228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:50.156592 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4bfd861a-3707-43bb-ada9-8988e5383271 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2459 microversion: 2.42 time: 0.859966 Sep 10 11:05:50.157413 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3637/4934] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:49 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2459 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:05:50.188188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b365be7e-49f0-4cce-b03f-502c10d8232c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:50.189449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b365be7e-49f0-4cce-b03f-502c10d8232c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:50.198802 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e5d5361e-471e-4e68-830c-41645916091d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments/e167022f-89f8-4304-b2f7-ef2285903133" status: 200 len: 194 microversion: 2.1 time: 0.113353 Sep 10 11:05:50.199548 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1298/4935] 10.222.0.20 () {58 vars in 1413 bytes} [Sat Sep 10 11:05:50 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments/e167022f-89f8-4304-b2f7-ef2285903133 => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:50.203716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b365be7e-49f0-4cce-b03f-502c10d8232c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:50.206248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b365be7e-49f0-4cce-b03f-502c10d8232c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:50.208878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b365be7e-49f0-4cce-b03f-502c10d8232c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:50.211812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b365be7e-49f0-4cce-b03f-502c10d8232c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:50.215634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b365be7e-49f0-4cce-b03f-502c10d8232c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:50.217730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b365be7e-49f0-4cce-b03f-502c10d8232c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:50.274634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-308987a7-d157-404b-85be-0f515f08c452 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:50.275630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-308987a7-d157-404b-85be-0f515f08c452 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:50.288752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308987a7-d157-404b-85be-0f515f08c452 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:50.289702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308987a7-d157-404b-85be-0f515f08c452 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:50.294242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308987a7-d157-404b-85be-0f515f08c452 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:50.295312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308987a7-d157-404b-85be-0f515f08c452 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:50.301810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308987a7-d157-404b-85be-0f515f08c452 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:50.302615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-308987a7-d157-404b-85be-0f515f08c452 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:51.546445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-308987a7-d157-404b-85be-0f515f08c452 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:51.569064 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-308987a7-d157-404b-85be-0f515f08c452 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1307 microversion: 2.1 time: 1.305751 Sep 10 11:05:51.571374 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1299/4936] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:50 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1307 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:51.581368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d04935ac-b59c-4072-8dd9-5eeef1dc6441 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:51.594988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d04935ac-b59c-4072-8dd9-5eeef1dc6441 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:51.615515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d04935ac-b59c-4072-8dd9-5eeef1dc6441 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:51.630215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d04935ac-b59c-4072-8dd9-5eeef1dc6441 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:51.642741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d04935ac-b59c-4072-8dd9-5eeef1dc6441 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:51.643902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d04935ac-b59c-4072-8dd9-5eeef1dc6441 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:51.645860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d04935ac-b59c-4072-8dd9-5eeef1dc6441 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:51.646573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d04935ac-b59c-4072-8dd9-5eeef1dc6441 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:51.976801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d04935ac-b59c-4072-8dd9-5eeef1dc6441 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:51.994448 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d04935ac-b59c-4072-8dd9-5eeef1dc6441 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1292 microversion: 2.1 time: 0.421199 Sep 10 11:05:51.995580 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1300/4937] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:51 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1292 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:52.014532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:52.018485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:52.034393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:52.035147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:52.035744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:52.036622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:52.037293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:52.049953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:52.138965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b365be7e-49f0-4cce-b03f-502c10d8232c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:52.186727 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b365be7e-49f0-4cce-b03f-502c10d8232c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1203 microversion: 2.1 time: 2.027844 Sep 10 11:05:52.187598 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3638/4938] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:50 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1203 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:52.195455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-eab6092a-7a22-4818-9b9c-f38e14cd2553 req-1cc8adae-b3e2-4eb6-af7f-da3130d69c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2d47aa-8bd3-4d8a-8fa2-a40267353792", "name": "network-vif-plugged", "status": "completed", "tag": "44f96b01-f3f7-4275-b72b-6280bc81593f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:52.239141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-eab6092a-7a22-4818-9b9c-f38e14cd2553 req-1cc8adae-b3e2-4eb6-af7f-da3130d69c8b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:52.243741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-eab6092a-7a22-4818-9b9c-f38e14cd2553 req-1cc8adae-b3e2-4eb6-af7f-da3130d69c8b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:52.262103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-eab6092a-7a22-4818-9b9c-f38e14cd2553 req-1cc8adae-b3e2-4eb6-af7f-da3130d69c8b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:52.330037 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-eab6092a-7a22-4818-9b9c-f38e14cd2553 req-1cc8adae-b3e2-4eb6-af7f-da3130d69c8b service nova] Creating event network-vif-plugged:44f96b01-f3f7-4275-b72b-6280bc81593f for instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 on n-h2-856894-1 Sep 10 11:05:52.343525 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-eab6092a-7a22-4818-9b9c-f38e14cd2553 req-1cc8adae-b3e2-4eb6-af7f-da3130d69c8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153970 Sep 10 11:05:52.345250 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3639/4939] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:52.596390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-873dbdf8-6ce7-40e3-a30c-d7753b8788df tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:52.597491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-873dbdf8-6ce7-40e3-a30c-d7753b8788df tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:52.622769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-873dbdf8-6ce7-40e3-a30c-d7753b8788df tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:52.623290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-873dbdf8-6ce7-40e3-a30c-d7753b8788df tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:52.623747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-873dbdf8-6ce7-40e3-a30c-d7753b8788df tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:52.624471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-873dbdf8-6ce7-40e3-a30c-d7753b8788df tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:52.624936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-873dbdf8-6ce7-40e3-a30c-d7753b8788df tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:52.625391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-873dbdf8-6ce7-40e3-a30c-d7753b8788df tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:52.837346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-873dbdf8-6ce7-40e3-a30c-d7753b8788df tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:52.847320 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-873dbdf8-6ce7-40e3-a30c-d7753b8788df tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1307 microversion: 2.1 time: 0.256483 Sep 10 11:05:52.860643 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3640/4940] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:52 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1307 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:05:52.886643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:52.897475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:52.898925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:52.900269 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d229b8cb-46c9-43b8-a8d8-805dce89a651 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 2231 microversion: 2.42 time: 0.894144 Sep 10 11:05:52.900837 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1301/4941] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:51 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 2231 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:05:53.016756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b7d3e4a6-0de1-4d89-862d-7fe2d528a86a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51db6edb-4ad8-4c9d-af6c-dc382d603a0f"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:53.024532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-44b07d33-7def-4cd1-bc45-6d64dff5386b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:53.025178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-44b07d33-7def-4cd1-bc45-6d64dff5386b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:53.030607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b7d3e4a6-0de1-4d89-862d-7fe2d528a86a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:53.045479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44b07d33-7def-4cd1-bc45-6d64dff5386b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:53.052975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44b07d33-7def-4cd1-bc45-6d64dff5386b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:53.055581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44b07d33-7def-4cd1-bc45-6d64dff5386b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:53.056728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44b07d33-7def-4cd1-bc45-6d64dff5386b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:53.058459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44b07d33-7def-4cd1-bc45-6d64dff5386b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:53.059036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-44b07d33-7def-4cd1-bc45-6d64dff5386b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:53.060462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d3e4a6-0de1-4d89-862d-7fe2d528a86a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:53.061193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d3e4a6-0de1-4d89-862d-7fe2d528a86a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:53.067028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d3e4a6-0de1-4d89-862d-7fe2d528a86a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:53.070241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d3e4a6-0de1-4d89-862d-7fe2d528a86a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:53.070945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d3e4a6-0de1-4d89-862d-7fe2d528a86a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:53.071715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d3e4a6-0de1-4d89-862d-7fe2d528a86a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:53.326658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-44b07d33-7def-4cd1-bc45-6d64dff5386b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:53.336958 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-44b07d33-7def-4cd1-bc45-6d64dff5386b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1298 microversion: 2.1 time: 0.317746 Sep 10 11:05:53.349985 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1302/4942] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:53 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1298 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:05:53.368505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d521224e-1962-4615-8c0f-1bdb839e94c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:53.369182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d521224e-1962-4615-8c0f-1bdb839e94c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:53.382692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d521224e-1962-4615-8c0f-1bdb839e94c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:53.389356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d521224e-1962-4615-8c0f-1bdb839e94c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:53.390395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d521224e-1962-4615-8c0f-1bdb839e94c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:53.391325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d521224e-1962-4615-8c0f-1bdb839e94c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:53.391858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d521224e-1962-4615-8c0f-1bdb839e94c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:53.392349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d521224e-1962-4615-8c0f-1bdb839e94c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:53.703146 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b7d3e4a6-0de1-4d89-862d-7fe2d528a86a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "POST /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692146 Sep 10 11:05:53.703818 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3641/4943] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:05:53 2022] POST /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:53.872647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aca20424-976a-4b7a-a93b-8081f7cf3322 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:53.873391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aca20424-976a-4b7a-a93b-8081f7cf3322 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:53.891844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aca20424-976a-4b7a-a93b-8081f7cf3322 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:53.892604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aca20424-976a-4b7a-a93b-8081f7cf3322 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:53.893346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aca20424-976a-4b7a-a93b-8081f7cf3322 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:53.894230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aca20424-976a-4b7a-a93b-8081f7cf3322 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:53.894975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aca20424-976a-4b7a-a93b-8081f7cf3322 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:53.895572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aca20424-976a-4b7a-a93b-8081f7cf3322 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:54.195167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d521224e-1962-4615-8c0f-1bdb839e94c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:54.211001 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d521224e-1962-4615-8c0f-1bdb839e94c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1203 microversion: 2.1 time: 0.859519 Sep 10 11:05:54.226575 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1303/4944] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:53 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1203 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:54.231759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-2414b47f-0978-432e-b529-1242f57a5660 req-9b7a8a00-f307-4d83-bb94-3303d0c05503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375deed-13ad-4c98-8a80-cbe4d03d2025", "name": "network-vif-deleted", "tag": "210108b0-a7eb-488b-aad7-2977ab966a4c"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:54.264564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:54.271005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2414b47f-0978-432e-b529-1242f57a5660 req-9b7a8a00-f307-4d83-bb94-3303d0c05503 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:54.285995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2414b47f-0978-432e-b529-1242f57a5660 req-9b7a8a00-f307-4d83-bb94-3303d0c05503 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:54.287212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2414b47f-0978-432e-b529-1242f57a5660 req-9b7a8a00-f307-4d83-bb94-3303d0c05503 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:54.293344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:54.306687 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-2414b47f-0978-432e-b529-1242f57a5660 req-9b7a8a00-f307-4d83-bb94-3303d0c05503 service nova] Creating event network-vif-deleted:210108b0-a7eb-488b-aad7-2977ab966a4c for instance c375deed-13ad-4c98-8a80-cbe4d03d2025 on n-h2-856894-1 Sep 10 11:05:54.313721 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-2414b47f-0978-432e-b529-1242f57a5660 req-9b7a8a00-f307-4d83-bb94-3303d0c05503 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085614 Sep 10 11:05:54.315392 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1304/4945] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:54.322364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:54.324437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:54.333614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:54.334362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:54.334984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:54.335856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:54.336519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:54.337143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:54.564444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:54.585457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:54.588310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:54.594569 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f7e8dc77-4786-449b-b118-d815bb5da6ff tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.277836 Sep 10 11:05:54.595171 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1305/4946] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:54 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:05:54.620822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0fb163f9-70e8-4bc4-a327-3c1f484041c4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:54.621751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0fb163f9-70e8-4bc4-a327-3c1f484041c4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:54.628183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fb163f9-70e8-4bc4-a327-3c1f484041c4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:54.628884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fb163f9-70e8-4bc4-a327-3c1f484041c4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:54.629502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fb163f9-70e8-4bc4-a327-3c1f484041c4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:54.630356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fb163f9-70e8-4bc4-a327-3c1f484041c4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:54.630965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fb163f9-70e8-4bc4-a327-3c1f484041c4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:54.631541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0fb163f9-70e8-4bc4-a327-3c1f484041c4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:54.650127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:55.193608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aca20424-976a-4b7a-a93b-8081f7cf3322 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:55.196478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0fb163f9-70e8-4bc4-a327-3c1f484041c4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:55.203159 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aca20424-976a-4b7a-a93b-8081f7cf3322 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1374 microversion: 2.1 time: 1.334741 Sep 10 11:05:55.207154 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0fb163f9-70e8-4bc4-a327-3c1f484041c4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1298 microversion: 2.1 time: 0.596336 Sep 10 11:05:55.207722 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1306/4947] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:54 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1298 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:55.218977 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3642/4948] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:53 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1374 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:05:55.244481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e43b0008-ae3d-4b21-a96c-8ff1576b283c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:55.250062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e43b0008-ae3d-4b21-a96c-8ff1576b283c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:55.261400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43b0008-ae3d-4b21-a96c-8ff1576b283c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:55.261904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43b0008-ae3d-4b21-a96c-8ff1576b283c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:55.262350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43b0008-ae3d-4b21-a96c-8ff1576b283c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:55.263070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43b0008-ae3d-4b21-a96c-8ff1576b283c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:55.263531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43b0008-ae3d-4b21-a96c-8ff1576b283c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:55.263961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43b0008-ae3d-4b21-a96c-8ff1576b283c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:55.624922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:55.625667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:55.643312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:55.643946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:55.644863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:55.645803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:55.646437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:55.647630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:55.712521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e43b0008-ae3d-4b21-a96c-8ff1576b283c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:55.721481 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e43b0008-ae3d-4b21-a96c-8ff1576b283c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1390 microversion: 2.1 time: 0.482105 Sep 10 11:05:55.722427 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1307/4949] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:55 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1390 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:55.747806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-92bd7319-eb57-4a1b-8e34-8b3cdac44b01 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:55.748702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-92bd7319-eb57-4a1b-8e34-8b3cdac44b01 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:55.756726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92bd7319-eb57-4a1b-8e34-8b3cdac44b01 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:55.757484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92bd7319-eb57-4a1b-8e34-8b3cdac44b01 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:55.758089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92bd7319-eb57-4a1b-8e34-8b3cdac44b01 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:55.759043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92bd7319-eb57-4a1b-8e34-8b3cdac44b01 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:55.759665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92bd7319-eb57-4a1b-8e34-8b3cdac44b01 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:55.760253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92bd7319-eb57-4a1b-8e34-8b3cdac44b01 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:55.813314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:55.826829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:55.828564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:55.830719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-966542ad-5e64-4cb8-9f32-b16f78db7874 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.210466 Sep 10 11:05:55.831798 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3643/4950] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:55 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:05:56.190222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-92bd7319-eb57-4a1b-8e34-8b3cdac44b01 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:56.199923 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-92bd7319-eb57-4a1b-8e34-8b3cdac44b01 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1390 microversion: 2.1 time: 0.459179 Sep 10 11:05:56.213285 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1308/4951] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:55 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1390 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:05:56.222097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-047651d2-c6c1-4287-b148-c504e1a91de8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:56.222716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-047651d2-c6c1-4287-b148-c504e1a91de8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:56.230424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-047651d2-c6c1-4287-b148-c504e1a91de8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:56.231148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-047651d2-c6c1-4287-b148-c504e1a91de8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:56.231589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-047651d2-c6c1-4287-b148-c504e1a91de8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:56.232304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-047651d2-c6c1-4287-b148-c504e1a91de8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:56.232761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-047651d2-c6c1-4287-b148-c504e1a91de8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:56.233215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-047651d2-c6c1-4287-b148-c504e1a91de8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:56.251288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-efb29d83-1cab-484c-93c2-c9c30711f251 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:56.252025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-efb29d83-1cab-484c-93c2-c9c30711f251 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:56.267066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efb29d83-1cab-484c-93c2-c9c30711f251 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:56.267650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efb29d83-1cab-484c-93c2-c9c30711f251 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:56.268149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efb29d83-1cab-484c-93c2-c9c30711f251 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:56.268933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efb29d83-1cab-484c-93c2-c9c30711f251 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:56.269471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efb29d83-1cab-484c-93c2-c9c30711f251 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:56.269956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efb29d83-1cab-484c-93c2-c9c30711f251 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:56.660085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-047651d2-c6c1-4287-b148-c504e1a91de8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:56.668535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-efb29d83-1cab-484c-93c2-c9c30711f251 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:56.670556 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-047651d2-c6c1-4287-b148-c504e1a91de8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1390 microversion: 2.1 time: 0.452331 Sep 10 11:05:56.673549 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3644/4952] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:56 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1390 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:56.681674 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-efb29d83-1cab-484c-93c2-c9c30711f251 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1374 microversion: 2.1 time: 0.438104 Sep 10 11:05:56.682275 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1309/4953] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:56 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1374 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:56.702486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-740eac0e-3580-4b39-b3ba-07eb4747657e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:56.703344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-740eac0e-3580-4b39-b3ba-07eb4747657e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:56.737843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740eac0e-3580-4b39-b3ba-07eb4747657e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:56.739492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740eac0e-3580-4b39-b3ba-07eb4747657e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:56.740159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740eac0e-3580-4b39-b3ba-07eb4747657e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:56.742485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740eac0e-3580-4b39-b3ba-07eb4747657e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:56.752372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740eac0e-3580-4b39-b3ba-07eb4747657e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:56.753870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-740eac0e-3580-4b39-b3ba-07eb4747657e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:56.857037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:56.857612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:56.866925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:56.878018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:56.878855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:56.879684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:56.880221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:56.880718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:57.007361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:57.020364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:57.021861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:57.023071 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b42defe2-79d8-41a6-9bba-78907f348a30 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.170058 Sep 10 11:05:57.023640 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1310/4954] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:56 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:05:57.030871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-1ddec1c9-b379-4aa0-b3a1-6ae5d9f359b2 req-780db33e-089c-406b-9fc6-2525a15461cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0ab613-578a-4b00-9c62-e01b1156cc77", "tag": "bbb29236-48b5-4674-b5fc-a2ba7cf9bc43"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:57.041741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1ddec1c9-b379-4aa0-b3a1-6ae5d9f359b2 req-780db33e-089c-406b-9fc6-2525a15461cb service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:57.042350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1ddec1c9-b379-4aa0-b3a1-6ae5d9f359b2 req-780db33e-089c-406b-9fc6-2525a15461cb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:57.042783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1ddec1c9-b379-4aa0-b3a1-6ae5d9f359b2 req-780db33e-089c-406b-9fc6-2525a15461cb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:57.054018 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-1ddec1c9-b379-4aa0-b3a1-6ae5d9f359b2 req-780db33e-089c-406b-9fc6-2525a15461cb service nova] Creating event network-changed:bbb29236-48b5-4674-b5fc-a2ba7cf9bc43 for instance 4b0ab613-578a-4b00-9c62-e01b1156cc77 on n-h2-856894-1 Sep 10 11:05:57.058944 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-1ddec1c9-b379-4aa0-b3a1-6ae5d9f359b2 req-780db33e-089c-406b-9fc6-2525a15461cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031474 Sep 10 11:05:57.059892 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1311/4955] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:57.324877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-740eac0e-3580-4b39-b3ba-07eb4747657e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:57.341308 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-740eac0e-3580-4b39-b3ba-07eb4747657e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1366 microversion: 2.1 time: 0.666018 Sep 10 11:05:57.342822 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3645/4956] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:56 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1366 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:57.704993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f259f51-7821-4e53-8f96-dd0974e7c9ad tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:57.706458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7f259f51-7821-4e53-8f96-dd0974e7c9ad tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:57.713240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f259f51-7821-4e53-8f96-dd0974e7c9ad tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:57.715132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f259f51-7821-4e53-8f96-dd0974e7c9ad tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:57.715926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f259f51-7821-4e53-8f96-dd0974e7c9ad tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:57.717611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f259f51-7821-4e53-8f96-dd0974e7c9ad tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:57.718324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f259f51-7821-4e53-8f96-dd0974e7c9ad tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:57.718958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f259f51-7821-4e53-8f96-dd0974e7c9ad tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:57.957891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7f259f51-7821-4e53-8f96-dd0974e7c9ad tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:57.970734 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7f259f51-7821-4e53-8f96-dd0974e7c9ad tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1374 microversion: 2.1 time: 0.269991 Sep 10 11:05:57.986574 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1312/4957] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:57 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1374 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:58.055195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:58.055971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:58.067102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:58.067934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:58.068217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:58.070974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:58.071683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:58.072731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:58.173809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:58.188676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:58.199586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:58.201103 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f045ed1b-a818-4bff-9b09-6aac6881ab1c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.150768 Sep 10 11:05:58.202229 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3646/4958] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:58 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:05:58.368431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b3ee38dc-2966-4257-b24d-6e23b1b8a629 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:58.373162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b3ee38dc-2966-4257-b24d-6e23b1b8a629 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:58.383825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3ee38dc-2966-4257-b24d-6e23b1b8a629 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:58.384334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3ee38dc-2966-4257-b24d-6e23b1b8a629 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:58.384946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3ee38dc-2966-4257-b24d-6e23b1b8a629 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:58.386675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3ee38dc-2966-4257-b24d-6e23b1b8a629 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:58.387254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3ee38dc-2966-4257-b24d-6e23b1b8a629 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:58.387694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3ee38dc-2966-4257-b24d-6e23b1b8a629 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:58.562891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b3ee38dc-2966-4257-b24d-6e23b1b8a629 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:58.571984 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b3ee38dc-2966-4257-b24d-6e23b1b8a629 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1366 microversion: 2.1 time: 0.207522 Sep 10 11:05:58.586011 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1313/4959] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:58 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:59.002204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3105e650-4b08-4c69-8f3e-1f8ba82f63dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:59.002843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3105e650-4b08-4c69-8f3e-1f8ba82f63dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:59.010147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3105e650-4b08-4c69-8f3e-1f8ba82f63dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.010694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3105e650-4b08-4c69-8f3e-1f8ba82f63dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.011144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3105e650-4b08-4c69-8f3e-1f8ba82f63dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:59.011870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3105e650-4b08-4c69-8f3e-1f8ba82f63dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.012337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3105e650-4b08-4c69-8f3e-1f8ba82f63dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.012781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3105e650-4b08-4c69-8f3e-1f8ba82f63dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:59.227893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:59.228516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:59.235409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.235905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.236342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:59.237048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.237680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.237949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:59.433042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:59.451591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:59.453059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:59.454285 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e98632da-2e2a-47ed-a409-bbf6eab74dd1 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.230411 Sep 10 11:05:59.454863 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1314/4960] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:05:59 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:05:59.465359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-322b7d71-9c29-4bc0-84b5-c00d7d5ab9ac tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:59.465866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-322b7d71-9c29-4bc0-84b5-c00d7d5ab9ac tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:59.484613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-322b7d71-9c29-4bc0-84b5-c00d7d5ab9ac tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.485143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-322b7d71-9c29-4bc0-84b5-c00d7d5ab9ac tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.485588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-322b7d71-9c29-4bc0-84b5-c00d7d5ab9ac tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:59.486304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-322b7d71-9c29-4bc0-84b5-c00d7d5ab9ac tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.486762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-322b7d71-9c29-4bc0-84b5-c00d7d5ab9ac tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.487199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-322b7d71-9c29-4bc0-84b5-c00d7d5ab9ac tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:59.532234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-322b7d71-9c29-4bc0-84b5-c00d7d5ab9ac tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:05:59.662620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:05:59.703167 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-322b7d71-9c29-4bc0-84b5-c00d7d5ab9ac tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 204 len: 0 microversion: 2.1 time: 0.246783 Sep 10 11:05:59.703855 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1315/4961] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:05:59 2022] DELETE /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:05:59.712035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-568d431e-fe0d-4455-9765-b8139b963f71 req-9d33fc97-4903-4520-a9da-546b35c20d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf201661-21b8-4623-b580-b9cafba66341", "tag": "462beb9f-f388-4565-9a86-bfc0c0624af4"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:05:59.736403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-568d431e-fe0d-4455-9765-b8139b963f71 req-9d33fc97-4903-4520-a9da-546b35c20d3e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.736964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-568d431e-fe0d-4455-9765-b8139b963f71 req-9d33fc97-4903-4520-a9da-546b35c20d3e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.737550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-568d431e-fe0d-4455-9765-b8139b963f71 req-9d33fc97-4903-4520-a9da-546b35c20d3e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:59.770868 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-568d431e-fe0d-4455-9765-b8139b963f71 req-9d33fc97-4903-4520-a9da-546b35c20d3e service nova] Creating event network-changed:462beb9f-f388-4565-9a86-bfc0c0624af4 for instance cf201661-21b8-4623-b580-b9cafba66341 on n-h2-856894-1 Sep 10 11:05:59.776406 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-568d431e-fe0d-4455-9765-b8139b963f71 req-9d33fc97-4903-4520-a9da-546b35c20d3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070937 Sep 10 11:05:59.776730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3105e650-4b08-4c69-8f3e-1f8ba82f63dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:05:59.777142 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1316/4962] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:05:59.787927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aeb6ef49-d819-497f-8718-093005ac0eb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:59.788745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-aeb6ef49-d819-497f-8718-093005ac0eb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:59.791432 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3105e650-4b08-4c69-8f3e-1f8ba82f63dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1374 microversion: 2.1 time: 0.790919 Sep 10 11:05:59.794179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3647/4963] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:58 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1374 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:05:59.796878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeb6ef49-d819-497f-8718-093005ac0eb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.797554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeb6ef49-d819-497f-8718-093005ac0eb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.798001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeb6ef49-d819-497f-8718-093005ac0eb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:59.798751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeb6ef49-d819-497f-8718-093005ac0eb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.799213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeb6ef49-d819-497f-8718-093005ac0eb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.799636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeb6ef49-d819-497f-8718-093005ac0eb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:59.804098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c495a72f-95f7-4d7c-aca1-0c007d44aa4f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:05:59.804722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c495a72f-95f7-4d7c-aca1-0c007d44aa4f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:05:59.819651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c495a72f-95f7-4d7c-aca1-0c007d44aa4f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.820147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c495a72f-95f7-4d7c-aca1-0c007d44aa4f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.820585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c495a72f-95f7-4d7c-aca1-0c007d44aa4f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:05:59.821337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c495a72f-95f7-4d7c-aca1-0c007d44aa4f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:05:59.821795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c495a72f-95f7-4d7c-aca1-0c007d44aa4f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:05:59.822221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c495a72f-95f7-4d7c-aca1-0c007d44aa4f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:00.029438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-aeb6ef49-d819-497f-8718-093005ac0eb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:00.041242 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aeb6ef49-d819-497f-8718-093005ac0eb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1366 microversion: 2.1 time: 0.262441 Sep 10 11:06:00.042126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c495a72f-95f7-4d7c-aca1-0c007d44aa4f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:00.042582 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1317/4964] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:59 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:00.056291 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c495a72f-95f7-4d7c-aca1-0c007d44aa4f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1396 microversion: 2.1 time: 0.259178 Sep 10 11:06:00.058824 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3648/4965] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:05:59 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1396 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:00.483890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:00.484880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:00.488069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=16 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:06:00.493561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:00.494297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:00.495043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:00.495796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:00.496456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:00.496940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:00.583769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:00.594681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:00.596712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:00.598210 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f1006b5c-2b24-4fec-9d06-10c43b9e2d26 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.118287 Sep 10 11:06:00.613988 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1318/4966] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:00 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:00.815863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8144c1ef-e27b-49db-8c74-0237248d394c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:00.816500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8144c1ef-e27b-49db-8c74-0237248d394c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:00.824588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8144c1ef-e27b-49db-8c74-0237248d394c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:00.825107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8144c1ef-e27b-49db-8c74-0237248d394c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:00.825552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8144c1ef-e27b-49db-8c74-0237248d394c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:00.826437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8144c1ef-e27b-49db-8c74-0237248d394c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:00.827061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8144c1ef-e27b-49db-8c74-0237248d394c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:00.827656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8144c1ef-e27b-49db-8c74-0237248d394c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:00.830939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:06:01.068622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-457480e5-2583-4814-9237-ccd2d2498b7c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:01.069575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-457480e5-2583-4814-9237-ccd2d2498b7c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:01.082025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457480e5-2583-4814-9237-ccd2d2498b7c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:01.082638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457480e5-2583-4814-9237-ccd2d2498b7c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:01.083210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457480e5-2583-4814-9237-ccd2d2498b7c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:01.084062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457480e5-2583-4814-9237-ccd2d2498b7c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:01.084615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457480e5-2583-4814-9237-ccd2d2498b7c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:01.085167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-457480e5-2583-4814-9237-ccd2d2498b7c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:01.285388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8144c1ef-e27b-49db-8c74-0237248d394c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:01.298268 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8144c1ef-e27b-49db-8c74-0237248d394c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1374 microversion: 2.1 time: 0.486206 Sep 10 11:06:01.299440 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3649/4967] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:00 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1374 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:01.304110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be18e3b0-80a6-42c4-b25e-ffb926b85996 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:01.317969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be18e3b0-80a6-42c4-b25e-ffb926b85996 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:01.324488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be18e3b0-80a6-42c4-b25e-ffb926b85996 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:01.325228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be18e3b0-80a6-42c4-b25e-ffb926b85996 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:01.325859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be18e3b0-80a6-42c4-b25e-ffb926b85996 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:01.326749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be18e3b0-80a6-42c4-b25e-ffb926b85996 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:01.327369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be18e3b0-80a6-42c4-b25e-ffb926b85996 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:01.327959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be18e3b0-80a6-42c4-b25e-ffb926b85996 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:01.648143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-457480e5-2583-4814-9237-ccd2d2498b7c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:01.701752 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-457480e5-2583-4814-9237-ccd2d2498b7c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1366 microversion: 2.1 time: 0.635347 Sep 10 11:06:01.721100 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1319/4968] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:01 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1366 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:06:01.729968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:01.729968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:01.768554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:01.770770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:01.771249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:01.774966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:01.775501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:01.777433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:01.861188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be18e3b0-80a6-42c4-b25e-ffb926b85996 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:01.872163 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be18e3b0-80a6-42c4-b25e-ffb926b85996 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1396 microversion: 2.1 time: 0.571373 Sep 10 11:06:01.875294 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3650/4969] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:01 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1396 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:02.018213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:02.031440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:02.033641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:02.035844 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1eb4f716-806f-4149-8ee2-20d8524df18d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.324454 Sep 10 11:06:02.036957 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1320/4970] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:01 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:02.328073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72160b02-5463-42f5-b112-4b3dfa7f590d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:02.329012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-72160b02-5463-42f5-b112-4b3dfa7f590d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:02.341153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72160b02-5463-42f5-b112-4b3dfa7f590d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:02.342897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72160b02-5463-42f5-b112-4b3dfa7f590d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:02.343606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72160b02-5463-42f5-b112-4b3dfa7f590d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:02.345838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72160b02-5463-42f5-b112-4b3dfa7f590d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:02.350294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72160b02-5463-42f5-b112-4b3dfa7f590d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:02.350983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72160b02-5463-42f5-b112-4b3dfa7f590d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:02.387081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-6df2c772-2c92-45a7-8133-811e77bf98a7 req-2034cab3-2462-4d3b-879d-0d15a6d993be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2d47aa-8bd3-4d8a-8fa2-a40267353792", "name": "network-vif-deleted", "tag": "44f96b01-f3f7-4275-b72b-6280bc81593f"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:06:02.398403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6df2c772-2c92-45a7-8133-811e77bf98a7 req-2034cab3-2462-4d3b-879d-0d15a6d993be service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:02.398894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6df2c772-2c92-45a7-8133-811e77bf98a7 req-2034cab3-2462-4d3b-879d-0d15a6d993be service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:02.400271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6df2c772-2c92-45a7-8133-811e77bf98a7 req-2034cab3-2462-4d3b-879d-0d15a6d993be service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:02.403613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:06:02.418637 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-6df2c772-2c92-45a7-8133-811e77bf98a7 req-2034cab3-2462-4d3b-879d-0d15a6d993be service nova] Creating event network-vif-deleted:44f96b01-f3f7-4275-b72b-6280bc81593f for instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 on n-h2-856894-1 Sep 10 11:06:02.425531 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-6df2c772-2c92-45a7-8133-811e77bf98a7 req-2034cab3-2462-4d3b-879d-0d15a6d993be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044000 Sep 10 11:06:02.439427 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1321/4971] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:06:02.560843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-72160b02-5463-42f5-b112-4b3dfa7f590d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:02.569575 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72160b02-5463-42f5-b112-4b3dfa7f590d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1374 microversion: 2.1 time: 0.246251 Sep 10 11:06:02.571074 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3651/4972] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:02 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1374 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:02.741718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-132ab5a0-2de0-4bfb-8408-22108484d8a4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:02.742983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-132ab5a0-2de0-4bfb-8408-22108484d8a4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:02.754941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132ab5a0-2de0-4bfb-8408-22108484d8a4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:02.755963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132ab5a0-2de0-4bfb-8408-22108484d8a4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:02.756556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132ab5a0-2de0-4bfb-8408-22108484d8a4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:02.758134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132ab5a0-2de0-4bfb-8408-22108484d8a4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:02.759890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132ab5a0-2de0-4bfb-8408-22108484d8a4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:02.760517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-132ab5a0-2de0-4bfb-8408-22108484d8a4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:02.778070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-744d0b5a-b422-4b16-8b99-e395fb0993c4 req-e2fe97b8-e1d5-4687-8b6d-c401ef62d026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0ab613-578a-4b00-9c62-e01b1156cc77", "name": "network-vif-plugged", "status": "completed", "tag": "bbb29236-48b5-4674-b5fc-a2ba7cf9bc43"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:06:02.792887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-744d0b5a-b422-4b16-8b99-e395fb0993c4 req-e2fe97b8-e1d5-4687-8b6d-c401ef62d026 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:02.793598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-744d0b5a-b422-4b16-8b99-e395fb0993c4 req-e2fe97b8-e1d5-4687-8b6d-c401ef62d026 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:02.794201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-744d0b5a-b422-4b16-8b99-e395fb0993c4 req-e2fe97b8-e1d5-4687-8b6d-c401ef62d026 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:02.808468 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-744d0b5a-b422-4b16-8b99-e395fb0993c4 req-e2fe97b8-e1d5-4687-8b6d-c401ef62d026 service nova] Creating event network-vif-plugged:bbb29236-48b5-4674-b5fc-a2ba7cf9bc43 for instance 4b0ab613-578a-4b00-9c62-e01b1156cc77 on n-h2-856894-1 Sep 10 11:06:02.814472 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-744d0b5a-b422-4b16-8b99-e395fb0993c4 req-e2fe97b8-e1d5-4687-8b6d-c401ef62d026 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041586 Sep 10 11:06:02.815570 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3652/4973] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:06:02.902283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f873abe-6a74-4bcc-87f0-a90eecaf4c65 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:02.903144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f873abe-6a74-4bcc-87f0-a90eecaf4c65 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:02.911663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f873abe-6a74-4bcc-87f0-a90eecaf4c65 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:02.912537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f873abe-6a74-4bcc-87f0-a90eecaf4c65 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:02.913555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f873abe-6a74-4bcc-87f0-a90eecaf4c65 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:02.914616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f873abe-6a74-4bcc-87f0-a90eecaf4c65 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:02.915234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f873abe-6a74-4bcc-87f0-a90eecaf4c65 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:02.915816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f873abe-6a74-4bcc-87f0-a90eecaf4c65 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:03.049519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1f873abe-6a74-4bcc-87f0-a90eecaf4c65 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:03.068059 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f873abe-6a74-4bcc-87f0-a90eecaf4c65 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1354 microversion: 2.1 time: 0.172997 Sep 10 11:06:03.068646 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3653/4974] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:02 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:03.073763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:03.080453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:03.093414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:03.098845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:03.099576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:03.100484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:03.101131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:03.102175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:03.252294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-132ab5a0-2de0-4bfb-8408-22108484d8a4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:03.259153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:03.262882 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-132ab5a0-2de0-4bfb-8408-22108484d8a4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1366 microversion: 2.1 time: 0.528266 Sep 10 11:06:03.271116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:03.272814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:03.274214 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4788f219-9580-4173-8ee4-0a10068d4f04 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.204296 Sep 10 11:06:03.275833 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3654/4975] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:03 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:03.279136 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1322/4976] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:02 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:03.601796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-abe920cf-6a97-46b4-9aa2-645bb05582c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:03.603110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-abe920cf-6a97-46b4-9aa2-645bb05582c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:03.611261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abe920cf-6a97-46b4-9aa2-645bb05582c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:03.611786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abe920cf-6a97-46b4-9aa2-645bb05582c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:03.612340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abe920cf-6a97-46b4-9aa2-645bb05582c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:03.613199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abe920cf-6a97-46b4-9aa2-645bb05582c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:03.613756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abe920cf-6a97-46b4-9aa2-645bb05582c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:03.614383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abe920cf-6a97-46b4-9aa2-645bb05582c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:03.863490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-abe920cf-6a97-46b4-9aa2-645bb05582c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:03.886122 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-abe920cf-6a97-46b4-9aa2-645bb05582c0 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1374 microversion: 2.1 time: 0.293840 Sep 10 11:06:03.886970 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3655/4977] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:03 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1374 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:04.094359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-962d1a1a-d529-45fb-b0a8-b1886d6214a0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:04.095161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-962d1a1a-d529-45fb-b0a8-b1886d6214a0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:04.109202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-962d1a1a-d529-45fb-b0a8-b1886d6214a0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:04.109987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-962d1a1a-d529-45fb-b0a8-b1886d6214a0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:04.110575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-962d1a1a-d529-45fb-b0a8-b1886d6214a0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:04.112693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-962d1a1a-d529-45fb-b0a8-b1886d6214a0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:04.114377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-962d1a1a-d529-45fb-b0a8-b1886d6214a0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:04.115111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-962d1a1a-d529-45fb-b0a8-b1886d6214a0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:04.226589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-962d1a1a-d529-45fb-b0a8-b1886d6214a0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:04.237535 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-962d1a1a-d529-45fb-b0a8-b1886d6214a0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1188 microversion: 2.1 time: 0.146744 Sep 10 11:06:04.256155 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1323/4978] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:04 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1188 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:04.289608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e51f2ef9-3514-4411-b2f3-735e5bcff639 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:04.290564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e51f2ef9-3514-4411-b2f3-735e5bcff639 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:04.302003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:04.303033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51f2ef9-3514-4411-b2f3-735e5bcff639 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:04.303619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51f2ef9-3514-4411-b2f3-735e5bcff639 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:04.304159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51f2ef9-3514-4411-b2f3-735e5bcff639 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:04.304787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:04.305626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51f2ef9-3514-4411-b2f3-735e5bcff639 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:04.307749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51f2ef9-3514-4411-b2f3-735e5bcff639 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:04.308271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e51f2ef9-3514-4411-b2f3-735e5bcff639 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:04.316451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:04.318366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:04.319066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:04.326038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:04.326792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:04.327443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:04.494138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:04.504009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:04.515187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:04.516503 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-da676c45-b31e-48ac-9feb-9a00e1faa106 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.218332 Sep 10 11:06:04.534650 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1324/4979] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:04 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:04.698917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e51f2ef9-3514-4411-b2f3-735e5bcff639 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:04.716703 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e51f2ef9-3514-4411-b2f3-735e5bcff639 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1366 microversion: 2.1 time: 0.430946 Sep 10 11:06:04.722995 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3656/4980] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:04 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:04.909922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2c035b94-e9b5-42e7-a628-f70f295002f1 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:04.910542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2c035b94-e9b5-42e7-a628-f70f295002f1 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:04.918338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c035b94-e9b5-42e7-a628-f70f295002f1 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:04.918338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c035b94-e9b5-42e7-a628-f70f295002f1 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:04.918338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c035b94-e9b5-42e7-a628-f70f295002f1 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:04.918985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c035b94-e9b5-42e7-a628-f70f295002f1 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:04.919442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c035b94-e9b5-42e7-a628-f70f295002f1 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:04.919871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2c035b94-e9b5-42e7-a628-f70f295002f1 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:05.128551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2c035b94-e9b5-42e7-a628-f70f295002f1 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:05.140176 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2c035b94-e9b5-42e7-a628-f70f295002f1 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1546 microversion: 2.1 time: 0.233658 Sep 10 11:06:05.167441 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1325/4981] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:04 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1546 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:05.170899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e4ebc0ff-5445-4c9a-966c-5096be0e7047 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:05.171521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e4ebc0ff-5445-4c9a-966c-5096be0e7047 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:05.186039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ebc0ff-5445-4c9a-966c-5096be0e7047 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:05.186815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ebc0ff-5445-4c9a-966c-5096be0e7047 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:05.187253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ebc0ff-5445-4c9a-966c-5096be0e7047 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:05.187960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ebc0ff-5445-4c9a-966c-5096be0e7047 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:05.188415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ebc0ff-5445-4c9a-966c-5096be0e7047 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:05.188837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ebc0ff-5445-4c9a-966c-5096be0e7047 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:05.261818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ace39f22-21a4-49ef-aa72-16f8776e2e1c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:05.262750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ace39f22-21a4-49ef-aa72-16f8776e2e1c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:05.270457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ace39f22-21a4-49ef-aa72-16f8776e2e1c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:05.272086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ace39f22-21a4-49ef-aa72-16f8776e2e1c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:05.272742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ace39f22-21a4-49ef-aa72-16f8776e2e1c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:05.273695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ace39f22-21a4-49ef-aa72-16f8776e2e1c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:05.274331 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ace39f22-21a4-49ef-aa72-16f8776e2e1c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:05.274927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ace39f22-21a4-49ef-aa72-16f8776e2e1c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:05.617238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ace39f22-21a4-49ef-aa72-16f8776e2e1c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:05.625604 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ace39f22-21a4-49ef-aa72-16f8776e2e1c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1188 microversion: 2.1 time: 0.369432 Sep 10 11:06:05.626556 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1326/4982] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:05 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1188 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:06:05.655108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:05.655739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:05.662609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:05.663174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:05.663722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:05.664518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:05.665267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:05.665918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:05.778371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:05.787972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:05.789535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:05.791498 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dccbc480-6abe-45b8-a346-ac80dda82390 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.148189 Sep 10 11:06:05.793229 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1327/4983] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:05 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:05.807637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9a87c57-3cf5-435f-91da-93c8dbd1af23 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:05.809007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9a87c57-3cf5-435f-91da-93c8dbd1af23 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:05.813912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e4ebc0ff-5445-4c9a-966c-5096be0e7047 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:05.817987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a87c57-3cf5-435f-91da-93c8dbd1af23 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:05.818866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a87c57-3cf5-435f-91da-93c8dbd1af23 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:05.819418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a87c57-3cf5-435f-91da-93c8dbd1af23 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:05.820689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a87c57-3cf5-435f-91da-93c8dbd1af23 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:05.820689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a87c57-3cf5-435f-91da-93c8dbd1af23 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:05.821346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a87c57-3cf5-435f-91da-93c8dbd1af23 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:05.825644 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e4ebc0ff-5445-4c9a-966c-5096be0e7047 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1546 microversion: 2.1 time: 0.658639 Sep 10 11:06:05.826977 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3657/4984] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:05 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1546 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:06:06.080903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9a87c57-3cf5-435f-91da-93c8dbd1af23 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:06.089898 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9a87c57-3cf5-435f-91da-93c8dbd1af23 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1366 microversion: 2.1 time: 0.295337 Sep 10 11:06:06.090492 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1328/4985] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:05 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:06.652452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe36a97d-ef1d-448c-a8c2-c153b48e8bae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:06.654618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fe36a97d-ef1d-448c-a8c2-c153b48e8bae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:06.685827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe36a97d-ef1d-448c-a8c2-c153b48e8bae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:06.686503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe36a97d-ef1d-448c-a8c2-c153b48e8bae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:06.687385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe36a97d-ef1d-448c-a8c2-c153b48e8bae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:06.688281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe36a97d-ef1d-448c-a8c2-c153b48e8bae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:06.688883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe36a97d-ef1d-448c-a8c2-c153b48e8bae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:06.689560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe36a97d-ef1d-448c-a8c2-c153b48e8bae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:06.770077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fe36a97d-ef1d-448c-a8c2-c153b48e8bae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:06.782395 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe36a97d-ef1d-448c-a8c2-c153b48e8bae tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1188 microversion: 2.1 time: 0.136064 Sep 10 11:06:06.783807 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3658/4986] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:06 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1188 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:06.819664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:06.821000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:06.831203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:06.832360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:06.833288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:06.834327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:06.834997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:06.836165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:06.939238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:06.952003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:06.953499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:06.961128 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-416c3cd3-bd7a-441e-978c-a4d0c184f2fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.145025 Sep 10 11:06:06.961961 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1329/4987] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:06 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:07.114477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42efd4c6-3bfe-4ad4-9961-72c125c0874a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:07.116142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42efd4c6-3bfe-4ad4-9961-72c125c0874a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:07.148197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:06:07.154800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42efd4c6-3bfe-4ad4-9961-72c125c0874a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:07.156620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42efd4c6-3bfe-4ad4-9961-72c125c0874a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:07.157236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42efd4c6-3bfe-4ad4-9961-72c125c0874a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:07.158069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42efd4c6-3bfe-4ad4-9961-72c125c0874a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:07.159046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42efd4c6-3bfe-4ad4-9961-72c125c0874a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:07.161544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42efd4c6-3bfe-4ad4-9961-72c125c0874a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:07.483617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-42efd4c6-3bfe-4ad4-9961-72c125c0874a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:07.492167 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42efd4c6-3bfe-4ad4-9961-72c125c0874a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1366 microversion: 2.1 time: 0.384174 Sep 10 11:06:07.504807 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3659/4988] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:07 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:07.811072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e6c3a52d-7e0d-4c31-9dd6-0417cc28bb4d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:07.811689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e6c3a52d-7e0d-4c31-9dd6-0417cc28bb4d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:07.826614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6c3a52d-7e0d-4c31-9dd6-0417cc28bb4d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:07.827233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6c3a52d-7e0d-4c31-9dd6-0417cc28bb4d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:07.827233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6c3a52d-7e0d-4c31-9dd6-0417cc28bb4d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:07.827762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6c3a52d-7e0d-4c31-9dd6-0417cc28bb4d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:07.828206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6c3a52d-7e0d-4c31-9dd6-0417cc28bb4d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:07.830919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e6c3a52d-7e0d-4c31-9dd6-0417cc28bb4d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:07.910437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e6c3a52d-7e0d-4c31-9dd6-0417cc28bb4d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:07.921610 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e6c3a52d-7e0d-4c31-9dd6-0417cc28bb4d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1188 microversion: 2.1 time: 0.114882 Sep 10 11:06:07.923723 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1330/4989] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:07 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1188 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:07.987790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:07.988474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:07.999907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:08.001018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:08.002058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:08.003319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:08.004952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:08.005926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:08.087916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:08.100617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:08.103240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:08.105533 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a747ca3-2ccf-4d0d-9a1f-4410d36bea22 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.121406 Sep 10 11:06:08.107205 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3660/4990] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:07 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:08.537402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1c6e545a-35fb-4549-abcb-045ff2444f1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:08.539006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1c6e545a-35fb-4549-abcb-045ff2444f1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:08.547979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c6e545a-35fb-4549-abcb-045ff2444f1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:08.548798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c6e545a-35fb-4549-abcb-045ff2444f1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:08.549478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c6e545a-35fb-4549-abcb-045ff2444f1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:08.550405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c6e545a-35fb-4549-abcb-045ff2444f1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:08.551119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c6e545a-35fb-4549-abcb-045ff2444f1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:08.551757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c6e545a-35fb-4549-abcb-045ff2444f1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:08.786114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1c6e545a-35fb-4549-abcb-045ff2444f1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:08.803317 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1c6e545a-35fb-4549-abcb-045ff2444f1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1366 microversion: 2.1 time: 0.271540 Sep 10 11:06:08.809481 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1331/4991] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:08 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:08.958927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-68505934-b242-4e5d-873c-3fba215ee9a0 req-7254bcce-599b-4c0a-a62a-94e9837c6fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf201661-21b8-4623-b580-b9cafba66341", "name": "network-vif-plugged", "status": "completed", "tag": "462beb9f-f388-4565-9a86-bfc0c0624af4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:06:08.960179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1a61e223-6ff4-4679-b896-43492aaf79ff tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:08.961812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1a61e223-6ff4-4679-b896-43492aaf79ff tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:08.994186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a61e223-6ff4-4679-b896-43492aaf79ff tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:08.995769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a61e223-6ff4-4679-b896-43492aaf79ff tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:08.998600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a61e223-6ff4-4679-b896-43492aaf79ff tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:08.999556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a61e223-6ff4-4679-b896-43492aaf79ff tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:09.003196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a61e223-6ff4-4679-b896-43492aaf79ff tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:09.004969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a61e223-6ff4-4679-b896-43492aaf79ff tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:09.009169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-68505934-b242-4e5d-873c-3fba215ee9a0 req-7254bcce-599b-4c0a-a62a-94e9837c6fab service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:09.009890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-68505934-b242-4e5d-873c-3fba215ee9a0 req-7254bcce-599b-4c0a-a62a-94e9837c6fab service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:09.011361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-68505934-b242-4e5d-873c-3fba215ee9a0 req-7254bcce-599b-4c0a-a62a-94e9837c6fab service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:09.054050 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-68505934-b242-4e5d-873c-3fba215ee9a0 req-7254bcce-599b-4c0a-a62a-94e9837c6fab service nova] Creating event network-vif-plugged:462beb9f-f388-4565-9a86-bfc0c0624af4 for instance cf201661-21b8-4623-b580-b9cafba66341 on n-h2-856894-1 Sep 10 11:06:09.060408 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-68505934-b242-4e5d-873c-3fba215ee9a0 req-7254bcce-599b-4c0a-a62a-94e9837c6fab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117732 Sep 10 11:06:09.062142 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3661/4992] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:06:09.137463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:09.139268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:09.152911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:09.156504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:09.156982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:09.158500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:09.158985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:09.159685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:09.325799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1a61e223-6ff4-4679-b896-43492aaf79ff tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:09.333656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:09.343170 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1a61e223-6ff4-4679-b896-43492aaf79ff tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1188 microversion: 2.1 time: 0.401220 Sep 10 11:06:09.344736 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1332/4993] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:08 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1188 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:09.345864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:09.347757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:09.349394 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c6bba1af-b3ea-43ac-9f01-3e55c18589fb tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.219924 Sep 10 11:06:09.360488 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3662/4994] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:09 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:09.833959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-deffac4a-06a4-42b7-8070-71591acc5c6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:09.834624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-deffac4a-06a4-42b7-8070-71591acc5c6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:09.844316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deffac4a-06a4-42b7-8070-71591acc5c6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:09.845489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deffac4a-06a4-42b7-8070-71591acc5c6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:09.846618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deffac4a-06a4-42b7-8070-71591acc5c6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:09.848178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deffac4a-06a4-42b7-8070-71591acc5c6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:09.849794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deffac4a-06a4-42b7-8070-71591acc5c6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:09.850446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deffac4a-06a4-42b7-8070-71591acc5c6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:10.068299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-deffac4a-06a4-42b7-8070-71591acc5c6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:10.077280 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-deffac4a-06a4-42b7-8070-71591acc5c6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1366 microversion: 2.1 time: 0.248759 Sep 10 11:06:10.078519 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1333/4995] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:09 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:06:10.367742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-28cf7951-1781-4515-b52f-7fb31674e8fc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:10.368577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-28cf7951-1781-4515-b52f-7fb31674e8fc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:10.382034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cf7951-1781-4515-b52f-7fb31674e8fc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:10.382742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:10.382903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cf7951-1781-4515-b52f-7fb31674e8fc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:10.383311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cf7951-1781-4515-b52f-7fb31674e8fc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:10.383995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:10.384553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cf7951-1781-4515-b52f-7fb31674e8fc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:10.385411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cf7951-1781-4515-b52f-7fb31674e8fc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:10.385860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-28cf7951-1781-4515-b52f-7fb31674e8fc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:10.391746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:10.392527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:10.393211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:10.394171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:10.394843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:10.395496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:10.460525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-28cf7951-1781-4515-b52f-7fb31674e8fc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:10.486033 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-28cf7951-1781-4515-b52f-7fb31674e8fc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1188 microversion: 2.1 time: 0.122507 Sep 10 11:06:10.486672 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3663/4996] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:10 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1188 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:10.492291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:10.504190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:10.505806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:10.507228 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6ad8a2f2-6fa0-4129-90de-60a139249e33 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.128577 Sep 10 11:06:10.507968 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1334/4997] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:10 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:06:11.101413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b12138e-68b9-43ee-acf6-ea87130a96e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:11.102044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9b12138e-68b9-43ee-acf6-ea87130a96e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:11.108994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b12138e-68b9-43ee-acf6-ea87130a96e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:11.109840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b12138e-68b9-43ee-acf6-ea87130a96e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:11.110287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b12138e-68b9-43ee-acf6-ea87130a96e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:11.111000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b12138e-68b9-43ee-acf6-ea87130a96e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:11.111459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b12138e-68b9-43ee-acf6-ea87130a96e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:11.111890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b12138e-68b9-43ee-acf6-ea87130a96e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:11.264046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9b12138e-68b9-43ee-acf6-ea87130a96e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:11.272394 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9b12138e-68b9-43ee-acf6-ea87130a96e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1557 microversion: 2.1 time: 0.174921 Sep 10 11:06:11.273100 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3664/4998] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:11 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:11.296761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ef442a53-b59a-4b56-a84e-b8a1bd90e374 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:11.297333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ef442a53-b59a-4b56-a84e-b8a1bd90e374 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:11.304329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef442a53-b59a-4b56-a84e-b8a1bd90e374 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:11.304900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef442a53-b59a-4b56-a84e-b8a1bd90e374 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:11.305477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef442a53-b59a-4b56-a84e-b8a1bd90e374 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:11.306422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef442a53-b59a-4b56-a84e-b8a1bd90e374 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:11.306985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef442a53-b59a-4b56-a84e-b8a1bd90e374 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:11.307481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef442a53-b59a-4b56-a84e-b8a1bd90e374 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:11.389813 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ef442a53-b59a-4b56-a84e-b8a1bd90e374 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097438 Sep 10 11:06:11.391061 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1335/4999] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:06:11 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:06:11.510148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-385bca8f-05e9-4143-a5f1-60e428196e92 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:11.510722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-385bca8f-05e9-4143-a5f1-60e428196e92 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:11.518302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-385bca8f-05e9-4143-a5f1-60e428196e92 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:11.518768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-385bca8f-05e9-4143-a5f1-60e428196e92 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:11.519797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-385bca8f-05e9-4143-a5f1-60e428196e92 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:11.520705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-385bca8f-05e9-4143-a5f1-60e428196e92 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:11.521355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-385bca8f-05e9-4143-a5f1-60e428196e92 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:11.521937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-385bca8f-05e9-4143-a5f1-60e428196e92 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:11.542639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:11.547083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:11.567216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:11.568538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:11.580926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:11.584557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:11.586227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:11.586939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:11.658350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-385bca8f-05e9-4143-a5f1-60e428196e92 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:11.678803 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-385bca8f-05e9-4143-a5f1-60e428196e92 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1188 microversion: 2.1 time: 0.172516 Sep 10 11:06:11.684668 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3665/5000] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:11 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1188 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:11.752181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:11.762500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:11.764748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:11.768336 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6b205b00-1a17-40eb-938c-e84efa4314a4 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.238577 Sep 10 11:06:11.772311 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1336/5001] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:11 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:12.547838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-16fd6f40-0aea-4ee7-a802-959731e4b0a4 req-2decf028-bd68-4e9c-84ba-f6feaea3403f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf201661-21b8-4623-b580-b9cafba66341", "tag": "462beb9f-f388-4565-9a86-bfc0c0624af4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:06:12.559764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-16fd6f40-0aea-4ee7-a802-959731e4b0a4 req-2decf028-bd68-4e9c-84ba-f6feaea3403f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:12.560552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-16fd6f40-0aea-4ee7-a802-959731e4b0a4 req-2decf028-bd68-4e9c-84ba-f6feaea3403f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:12.561252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-16fd6f40-0aea-4ee7-a802-959731e4b0a4 req-2decf028-bd68-4e9c-84ba-f6feaea3403f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:12.574989 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-16fd6f40-0aea-4ee7-a802-959731e4b0a4 req-2decf028-bd68-4e9c-84ba-f6feaea3403f service nova] Creating event network-changed:462beb9f-f388-4565-9a86-bfc0c0624af4 for instance cf201661-21b8-4623-b580-b9cafba66341 on n-h2-856894-1 Sep 10 11:06:12.581413 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-16fd6f40-0aea-4ee7-a802-959731e4b0a4 req-2decf028-bd68-4e9c-84ba-f6feaea3403f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037168 Sep 10 11:06:12.585657 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3666/5002] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:06:12.713031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-39081b37-8cae-4479-90cc-ac23b75ff438 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:12.713701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-39081b37-8cae-4479-90cc-ac23b75ff438 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:12.722551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39081b37-8cae-4479-90cc-ac23b75ff438 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:12.723338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39081b37-8cae-4479-90cc-ac23b75ff438 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:12.723996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39081b37-8cae-4479-90cc-ac23b75ff438 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:12.724938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39081b37-8cae-4479-90cc-ac23b75ff438 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:12.725637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39081b37-8cae-4479-90cc-ac23b75ff438 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:12.726472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39081b37-8cae-4479-90cc-ac23b75ff438 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:12.801665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:12.803582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:12.815255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-39081b37-8cae-4479-90cc-ac23b75ff438 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:12.820126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:12.821627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:12.822511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:12.826582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:12.827392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:12.829309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:12.837263 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-39081b37-8cae-4479-90cc-ac23b75ff438 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1188 microversion: 2.1 time: 0.127965 Sep 10 11:06:12.842858 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1337/5003] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:12 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1188 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:12.938995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:12.945412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:06:12.956668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:12.958777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:12.960613 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-00da460c-3012-4fcb-8647-5dca301d10f3 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.166146 Sep 10 11:06:12.962039 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3667/5004] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:12 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:06:13.865909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:13.866755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:13.883530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:13.885721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:13.887830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:13.888603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:13.889090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:13.889561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:13.947333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:13.954595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:13.955268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:13.955923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lazy-loading 'fault' on Instance uuid ae2d47aa-8bd3-4d8a-8fa2-a40267353792 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:06:13.959296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:06:13.988966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:13.989602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:14.008772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:14.009291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:14.009931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:14.011712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:14.012332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:14.012916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:14.044570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:14.055988 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-358731f8-0ca6-4c7e-9201-cd46bc55e502 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 200 len: 1193 microversion: 2.1 time: 0.193750 Sep 10 11:06:14.057271 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1338/5005] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:13 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 1193 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:14.111083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:14.121914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:14.123801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:14.130114 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e077640-66bc-491a-9b5e-888ef56e0649 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.145607 Sep 10 11:06:14.130895 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3668/5006] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:13 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:15.083417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:15.083969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:15.091803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:15.092295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:15.092874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:15.093628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:15.094062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:15.094481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:15.109899 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 HTTP/1.1 Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'ae2d47aa-8bd3-4d8a-8fa2-a40267353792'} Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:15.111609 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:15.116632 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:15.116632 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:15.116632 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:15.116632 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:15.116632 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:15.116632 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:15.116632 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:15.116632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:15.116632 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9e7cf25b-2d66-4cdf-8df6-82a641fad38c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 404 len: 111 microversion: 2.1 time: 0.033956 Sep 10 11:06:15.120643 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1339/5007] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:15 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:06:15.156295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:15.156912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:15.164523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:15.165284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:15.165916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:15.167448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:15.168086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:15.168512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:15.248481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:15.258549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:15.260163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:15.261430 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d8f6d812-ad67-4125-947b-eadbdc658e9d tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.108986 Sep 10 11:06:15.262019 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3669/5008] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:15 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:15.772491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b3f113c1-537b-46a7-8b76-09fbeb71a557 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:15.774798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b3f113c1-537b-46a7-8b76-09fbeb71a557 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:15.781168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f113c1-537b-46a7-8b76-09fbeb71a557 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:15.781674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f113c1-537b-46a7-8b76-09fbeb71a557 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:15.782100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f113c1-537b-46a7-8b76-09fbeb71a557 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:15.782793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f113c1-537b-46a7-8b76-09fbeb71a557 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:15.783257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f113c1-537b-46a7-8b76-09fbeb71a557 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:15.783671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3f113c1-537b-46a7-8b76-09fbeb71a557 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:15.816047 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b3f113c1-537b-46a7-8b76-09fbeb71a557 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047435 Sep 10 11:06:15.816621 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1340/5009] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:06:15 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:06:15.955983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa955146-d5c6-445b-a636-a89e6adc6ad4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:15.956819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa955146-d5c6-445b-a636-a89e6adc6ad4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:15.964064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa955146-d5c6-445b-a636-a89e6adc6ad4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:15.964571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa955146-d5c6-445b-a636-a89e6adc6ad4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:15.965020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa955146-d5c6-445b-a636-a89e6adc6ad4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:15.965827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa955146-d5c6-445b-a636-a89e6adc6ad4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:15.966233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa955146-d5c6-445b-a636-a89e6adc6ad4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:15.966663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa955146-d5c6-445b-a636-a89e6adc6ad4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:15.999782 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa955146-d5c6-445b-a636-a89e6adc6ad4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments/e167022f-89f8-4304-b2f7-ef2285903133" status: 200 len: 194 microversion: 2.1 time: 0.047952 Sep 10 11:06:16.003248 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3670/5010] 10.222.0.20 () {58 vars in 1413 bytes} [Sat Sep 10 11:06:15 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments/e167022f-89f8-4304-b2f7-ef2285903133 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:06:16.011363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-86bf6106-a4ea-4c86-b1bf-ca85c4d4da6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:16.011862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-86bf6106-a4ea-4c86-b1bf-ca85c4d4da6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:16.018877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86bf6106-a4ea-4c86-b1bf-ca85c4d4da6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:16.019371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86bf6106-a4ea-4c86-b1bf-ca85c4d4da6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:16.019809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86bf6106-a4ea-4c86-b1bf-ca85c4d4da6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:16.020503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86bf6106-a4ea-4c86-b1bf-ca85c4d4da6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:16.020954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86bf6106-a4ea-4c86-b1bf-ca85c4d4da6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:16.021401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86bf6106-a4ea-4c86-b1bf-ca85c4d4da6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:16.109530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-86bf6106-a4ea-4c86-b1bf-ca85c4d4da6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lazy-loading 'services' on Instance uuid aa5019e0-ebb1-496e-b0a1-329420d2ff70 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:06:16.191331 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-86bf6106-a4ea-4c86-b1bf-ca85c4d4da6c tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments/e167022f-89f8-4304-b2f7-ef2285903133" status: 202 len: 0 microversion: 2.1 time: 0.184047 Sep 10 11:06:16.191932 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1341/5011] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:06:16 2022] DELETE /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments/e167022f-89f8-4304-b2f7-ef2285903133 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:06:16.290032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:16.292095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:16.302294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:16.302944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:16.303469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:16.304186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:16.304819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:16.305484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:16.404956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:16.416866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:16.418764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:16.420348 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2063e1f-b905-45ee-882f-371fdfd35805 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.135840 Sep 10 11:06:16.420938 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3671/5012] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:16 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:17.449953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:17.450670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:17.456894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:17.457401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:17.457836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:17.458521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:17.458965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:17.459381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:17.530115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:17.540656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:17.542171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78b0d5a4b2e64ab2a7d92e2a13af9069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db66fde0ffaa42a4b9afdf1a30767435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:17.543660 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-76396a84-4bb2-4f60-8f65-06fa09a95a51 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 200 len: 1604 microversion: 2.42 time: 0.099431 Sep 10 11:06:17.544570 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1342/5013] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:17 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 1604 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:06:18.571116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:18.571874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:18.580082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:18.581666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:18.582442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:18.583286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:18.583910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:18.585409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:18.602559 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] HTTP exception thrown: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Request method failure captured: Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 HTTP/1.1 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG4Pz8NYGJ208j0BfyK7DciaZFYj4hPOGwqEtnQay61w2l6lW21Hh53ZpzfgbAtDtFOFC0Z3a9ScX-WV74Suts1x7Ll85ryWC9GdEXz3G3Iaah8fV6mOzMuj_XhVZ3Vy2uaKTCZOvR4fCMsPllwhXGPhovVUUeoGazCFY_XVGN-3E_U Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.42 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: db66fde0ffaa42a4b9afdf1a30767435 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-699398616 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db66fde0ffaa42a4b9afdf1a30767435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db66fde0ffaa42a4b9afdf1a30767435"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db66fde0ffaa42a4b9afdf1a30767435"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db66fde0ffaa42a4b9afdf1a30767435", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TaggedBootDevicesTest_v242-699398616 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: db66fde0ffaa42a4b9afdf1a30767435 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-699398616 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TaggedBootDevicesTest_v242-699398616-project Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 78b0d5a4b2e64ab2a7d92e2a13af9069 Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TaggedBootDevicesTest_v242-699398616-project Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'c375deed-13ad-4c98-8a80-cbe4d03d2025'} Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:18.604860 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:18.609511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:18.609511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:18.609511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:18.609511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:18.609511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:18.609511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:18.609511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:18.609511 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:18.609511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Returning 404 to user: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:18.609511 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-50d4f2d6-8c5a-469e-8360-f9c1bdb7d70b tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 404 len: 111 microversion: 2.42 time: 0.039298 Sep 10 11:06:18.615583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-548d8fa7-105b-44f4-915c-def3252fda62 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '.version_select at 0x7efcadcecf70>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:18.621930 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3672/5014] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:18 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:06:18.641088 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-548d8fa7-105b-44f4-915c-def3252fda62 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016289860" status: 204 len: 0 microversion: 2.42 time: 0.025636 Sep 10 11:06:18.642094 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1343/5015] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 11:06:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016289860 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 11:06:21.210855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:21.211383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:21.231955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:21.232464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:21.232914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:21.233690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:21.234160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:21.234598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:21.258589 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 HTTP/1.1 Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'ae2d47aa-8bd3-4d8a-8fa2-a40267353792'} Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:21.260764 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:21.265254 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69b1164f-7c4f-4804-ba88-d92b4d8b6bdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 404 len: 111 microversion: 2.1 time: 0.055311 Sep 10 11:06:21.271050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:21.271679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: ae2d47aa-8bd3-4d8a-8fa2-a40267353792] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:21.276891 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3673/5016] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:06:21 2022] DELETE /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:06:21.287339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:21.289674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:21.290747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:21.291754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:21.292378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:21.293034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:21.312370 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 HTTP/1.1 Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'ae2d47aa-8bd3-4d8a-8fa2-a40267353792'} Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:21.314339 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:21.319449 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:21.319449 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:21.319449 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:21.319449 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:21.319449 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:21.319449 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. Sep 10 11:06:21.319449 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:21.321682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance ae2d47aa-8bd3-4d8a-8fa2-a40267353792 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:21.323423 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-910e1114-8dee-4c7b-9517-af44f12f736a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792" status: 404 len: 111 microversion: 2.1 time: 0.056240 Sep 10 11:06:21.324631 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1344/5017] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:21 2022] GET /compute/v2.1/servers/ae2d47aa-8bd3-4d8a-8fa2-a40267353792 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:06:23.952347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:23.953562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:23.960109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:23.960910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:23.961611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:23.962578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:23.963321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:23.963987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:23.980512 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] HTTP exception thrown: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Request method failure captured: Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 HTTP/1.1 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG4Pz8NYGJ208j0BfyK7DciaZFYj4hPOGwqEtnQay61w2l6lW21Hh53ZpzfgbAtDtFOFC0Z3a9ScX-WV74Suts1x7Ll85ryWC9GdEXz3G3Iaah8fV6mOzMuj_XhVZ3Vy2uaKTCZOvR4fCMsPllwhXGPhovVUUeoGazCFY_XVGN-3E_U Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.42 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: db66fde0ffaa42a4b9afdf1a30767435 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-699398616 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db66fde0ffaa42a4b9afdf1a30767435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db66fde0ffaa42a4b9afdf1a30767435"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db66fde0ffaa42a4b9afdf1a30767435"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db66fde0ffaa42a4b9afdf1a30767435", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TaggedBootDevicesTest_v242-699398616 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: db66fde0ffaa42a4b9afdf1a30767435 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-699398616 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TaggedBootDevicesTest_v242-699398616-project Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 78b0d5a4b2e64ab2a7d92e2a13af9069 Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TaggedBootDevicesTest_v242-699398616-project Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'c375deed-13ad-4c98-8a80-cbe4d03d2025'} Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:23.982334 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Returning 404 to user: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a07757e0-d72b-4a9f-887b-0bcd6a428e0c tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 404 len: 111 microversion: 2.42 time: 0.036334 Sep 10 11:06:23.988137 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3674/5018] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 11:06:23 2022] DELETE /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:06:23.994084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:23.995223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] [instance: c375deed-13ad-4c98-8a80-cbe4d03d2025] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:24.001302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:24.001788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:24.002221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:24.002909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:24.003360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:24.003782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:24.017611 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] HTTP exception thrown: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Request method failure captured: Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 HTTP/1.1 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG4Pz8NYGJ208j0BfyK7DciaZFYj4hPOGwqEtnQay61w2l6lW21Hh53ZpzfgbAtDtFOFC0Z3a9ScX-WV74Suts1x7Ll85ryWC9GdEXz3G3Iaah8fV6mOzMuj_XhVZ3Vy2uaKTCZOvR4fCMsPllwhXGPhovVUUeoGazCFY_XVGN-3E_U Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Openstack-Nova-Api-Version: 2.42 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: db66fde0ffaa42a4b9afdf1a30767435 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-699398616 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db66fde0ffaa42a4b9afdf1a30767435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db66fde0ffaa42a4b9afdf1a30767435"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db66fde0ffaa42a4b9afdf1a30767435"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db66fde0ffaa42a4b9afdf1a30767435", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TaggedBootDevicesTest_v242-699398616 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: db66fde0ffaa42a4b9afdf1a30767435 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-699398616 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TaggedBootDevicesTest_v242-699398616-project Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 78b0d5a4b2e64ab2a7d92e2a13af9069 Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TaggedBootDevicesTest_v242-699398616-project Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'c375deed-13ad-4c98-8a80-cbe4d03d2025'} Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:24.019161 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] Returning 404 to user: Instance c375deed-13ad-4c98-8a80-cbe4d03d2025 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7f78c584-c69c-4b4e-a49b-9bb8958d3886 tempest-TaggedBootDevicesTest_v242-699398616 tempest-TaggedBootDevicesTest_v242-699398616-project] 10.222.0.20 "GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025" status: 404 len: 111 microversion: 2.42 time: 0.032050 Sep 10 11:06:24.024355 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1345/5019] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:06:23 2022] GET /compute/v2.1/servers/c375deed-13ad-4c98-8a80-cbe4d03d2025 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:06:24.532309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e24b300-e83b-45b8-818a-22b6bcdb6a7a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:24.533562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e24b300-e83b-45b8-818a-22b6bcdb6a7a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:24.540761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e24b300-e83b-45b8-818a-22b6bcdb6a7a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:24.541599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e24b300-e83b-45b8-818a-22b6bcdb6a7a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:24.542278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e24b300-e83b-45b8-818a-22b6bcdb6a7a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:24.543231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e24b300-e83b-45b8-818a-22b6bcdb6a7a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:24.543995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e24b300-e83b-45b8-818a-22b6bcdb6a7a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:24.544664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e24b300-e83b-45b8-818a-22b6bcdb6a7a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:24.596799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e24b300-e83b-45b8-818a-22b6bcdb6a7a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments/51db6edb-4ad8-4c9d-af6c-dc382d603a0f" status: 200 len: 194 microversion: 2.1 time: 0.069719 Sep 10 11:06:24.597902 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3675/5020] 10.222.0.20 () {58 vars in 1413 bytes} [Sat Sep 10 11:06:24 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments/51db6edb-4ad8-4c9d-af6c-dc382d603a0f => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:06:24.609008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f710912d-9f0f-4bd0-8268-fd97d7273053 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:24.609895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f710912d-9f0f-4bd0-8268-fd97d7273053 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:24.615973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:06:24.618081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f710912d-9f0f-4bd0-8268-fd97d7273053 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:24.618815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f710912d-9f0f-4bd0-8268-fd97d7273053 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:24.619644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f710912d-9f0f-4bd0-8268-fd97d7273053 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:24.620624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f710912d-9f0f-4bd0-8268-fd97d7273053 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:24.621340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f710912d-9f0f-4bd0-8268-fd97d7273053 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:24.621993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f710912d-9f0f-4bd0-8268-fd97d7273053 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:24.767364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-f710912d-9f0f-4bd0-8268-fd97d7273053 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lazy-loading 'services' on Instance uuid aa5019e0-ebb1-496e-b0a1-329420d2ff70 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:06:24.883744 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f710912d-9f0f-4bd0-8268-fd97d7273053 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments/51db6edb-4ad8-4c9d-af6c-dc382d603a0f" status: 202 len: 0 microversion: 2.1 time: 0.277873 Sep 10 11:06:24.884625 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1346/5021] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:06:24 2022] DELETE /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments/51db6edb-4ad8-4c9d-af6c-dc382d603a0f => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:06:31.300385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3b1b562d-7c57-4ac5-96fa-36ad47f4f24a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:31.303277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3b1b562d-7c57-4ac5-96fa-36ad47f4f24a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:31.315070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b1b562d-7c57-4ac5-96fa-36ad47f4f24a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:31.315894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b1b562d-7c57-4ac5-96fa-36ad47f4f24a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:31.316567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b1b562d-7c57-4ac5-96fa-36ad47f4f24a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:31.318498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b1b562d-7c57-4ac5-96fa-36ad47f4f24a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:31.319182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b1b562d-7c57-4ac5-96fa-36ad47f4f24a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:31.319818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3b1b562d-7c57-4ac5-96fa-36ad47f4f24a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:31.361126 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3b1b562d-7c57-4ac5-96fa-36ad47f4f24a tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064722 Sep 10 11:06:31.362634 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3676/5022] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:06:31 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:06:31.516752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7bde75af-9056-4145-8306-bcf7112ea9da tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:31.519128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7bde75af-9056-4145-8306-bcf7112ea9da tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:31.530569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bde75af-9056-4145-8306-bcf7112ea9da tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:31.531087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bde75af-9056-4145-8306-bcf7112ea9da tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:31.531509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bde75af-9056-4145-8306-bcf7112ea9da tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:31.532247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bde75af-9056-4145-8306-bcf7112ea9da tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:31.550072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bde75af-9056-4145-8306-bcf7112ea9da tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:31.550548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bde75af-9056-4145-8306-bcf7112ea9da tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:31.585294 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7bde75af-9056-4145-8306-bcf7112ea9da tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073175 Sep 10 11:06:31.591339 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1347/5023] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:06:31 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:06:31.663784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0fa59cf9-7dcd-49a4-964e-a1c85858083e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:31.664882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0fa59cf9-7dcd-49a4-964e-a1c85858083e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:31.671700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fa59cf9-7dcd-49a4-964e-a1c85858083e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:31.672550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fa59cf9-7dcd-49a4-964e-a1c85858083e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:31.673095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fa59cf9-7dcd-49a4-964e-a1c85858083e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:31.673880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fa59cf9-7dcd-49a4-964e-a1c85858083e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:31.674411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fa59cf9-7dcd-49a4-964e-a1c85858083e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:31.674915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fa59cf9-7dcd-49a4-964e-a1c85858083e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:31.714952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0fa59cf9-7dcd-49a4-964e-a1c85858083e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:06:31.853004 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0fa59cf9-7dcd-49a4-964e-a1c85858083e tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 204 len: 0 microversion: 2.1 time: 0.193195 Sep 10 11:06:31.854957 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3677/5024] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:06:31 2022] DELETE /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:06:31.862936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dc6463d7-5f9d-49a4-a85c-b0f3eaabe0a6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:31.863563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dc6463d7-5f9d-49a4-a85c-b0f3eaabe0a6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:31.872731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc6463d7-5f9d-49a4-a85c-b0f3eaabe0a6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:31.875232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc6463d7-5f9d-49a4-a85c-b0f3eaabe0a6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:31.875699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc6463d7-5f9d-49a4-a85c-b0f3eaabe0a6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:31.876458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc6463d7-5f9d-49a4-a85c-b0f3eaabe0a6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:31.876932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc6463d7-5f9d-49a4-a85c-b0f3eaabe0a6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:31.877771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc6463d7-5f9d-49a4-a85c-b0f3eaabe0a6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:32.073919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dc6463d7-5f9d-49a4-a85c-b0f3eaabe0a6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:32.082243 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dc6463d7-5f9d-49a4-a85c-b0f3eaabe0a6 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1674 microversion: 2.1 time: 0.223108 Sep 10 11:06:32.096438 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1348/5025] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:31 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:33.121736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-186086b6-2933-4532-b82e-888f785bbc2b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:33.122660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-186086b6-2933-4532-b82e-888f785bbc2b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:33.140202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-186086b6-2933-4532-b82e-888f785bbc2b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:33.141683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-186086b6-2933-4532-b82e-888f785bbc2b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:33.144213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-186086b6-2933-4532-b82e-888f785bbc2b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:33.145736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-186086b6-2933-4532-b82e-888f785bbc2b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:33.147016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-186086b6-2933-4532-b82e-888f785bbc2b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:33.149127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-186086b6-2933-4532-b82e-888f785bbc2b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:33.572360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-186086b6-2933-4532-b82e-888f785bbc2b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:33.587241 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-186086b6-2933-4532-b82e-888f785bbc2b tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1674 microversion: 2.1 time: 0.470773 Sep 10 11:06:33.588534 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3678/5026] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:33 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1674 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:34.611981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-90723c12-7948-4349-8223-2d05f58c15ea tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:34.612588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-90723c12-7948-4349-8223-2d05f58c15ea tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:34.632284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90723c12-7948-4349-8223-2d05f58c15ea tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:34.632859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90723c12-7948-4349-8223-2d05f58c15ea tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:34.635771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90723c12-7948-4349-8223-2d05f58c15ea tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:34.637014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90723c12-7948-4349-8223-2d05f58c15ea tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:34.637938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90723c12-7948-4349-8223-2d05f58c15ea tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:34.639087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-90723c12-7948-4349-8223-2d05f58c15ea tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:35.065720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-90723c12-7948-4349-8223-2d05f58c15ea tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:35.084656 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-90723c12-7948-4349-8223-2d05f58c15ea tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1674 microversion: 2.1 time: 0.477532 Sep 10 11:06:35.085287 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1349/5027] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:34 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1674 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:36.112219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-502e5aa6-ea8a-4759-b798-27f03a9d9b42 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:36.113495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-502e5aa6-ea8a-4759-b798-27f03a9d9b42 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:36.120843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502e5aa6-ea8a-4759-b798-27f03a9d9b42 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:36.126726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502e5aa6-ea8a-4759-b798-27f03a9d9b42 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:36.127451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502e5aa6-ea8a-4759-b798-27f03a9d9b42 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:36.128407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502e5aa6-ea8a-4759-b798-27f03a9d9b42 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:36.129270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502e5aa6-ea8a-4759-b798-27f03a9d9b42 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:36.129932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-502e5aa6-ea8a-4759-b798-27f03a9d9b42 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:36.263027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5e2eccb8-5806-40d4-87c9-c0f2b4added6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:36.263799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5e2eccb8-5806-40d4-87c9-c0f2b4added6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:36.281020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2eccb8-5806-40d4-87c9-c0f2b4added6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:36.281911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2eccb8-5806-40d4-87c9-c0f2b4added6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:36.282550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2eccb8-5806-40d4-87c9-c0f2b4added6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:36.283543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2eccb8-5806-40d4-87c9-c0f2b4added6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:36.284189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2eccb8-5806-40d4-87c9-c0f2b4added6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:36.286184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e2eccb8-5806-40d4-87c9-c0f2b4added6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:36.298611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-502e5aa6-ea8a-4759-b798-27f03a9d9b42 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:36.309883 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-502e5aa6-ea8a-4759-b798-27f03a9d9b42 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1607 microversion: 2.1 time: 0.201861 Sep 10 11:06:36.321605 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3679/5028] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:36 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1607 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:36.346593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5e2eccb8-5806-40d4-87c9-c0f2b4added6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:06:36.521656 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5e2eccb8-5806-40d4-87c9-c0f2b4added6 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 204 len: 0 microversion: 2.1 time: 0.268675 Sep 10 11:06:36.526010 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1350/5029] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:06:36 2022] DELETE /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:06:36.536320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-98d0cc31-d5b0-479d-93e9-cff12b44a054 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:36.537892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-98d0cc31-d5b0-479d-93e9-cff12b44a054 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:36.548083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d0cc31-d5b0-479d-93e9-cff12b44a054 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:36.551279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d0cc31-d5b0-479d-93e9-cff12b44a054 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:36.553110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d0cc31-d5b0-479d-93e9-cff12b44a054 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:36.555403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d0cc31-d5b0-479d-93e9-cff12b44a054 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:36.556246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d0cc31-d5b0-479d-93e9-cff12b44a054 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:36.559112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-98d0cc31-d5b0-479d-93e9-cff12b44a054 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:36.589555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-b603938d-aa79-4857-92e7-75ab9df7ee85 req-29863f0f-e3ef-41a7-867f-40aa1119092b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5019e0-ebb1-496e-b0a1-329420d2ff70", "name": "network-vif-deleted", "tag": "66dca372-21b2-42cd-a9d8-c656c3df691e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:06:36.600651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b603938d-aa79-4857-92e7-75ab9df7ee85 req-29863f0f-e3ef-41a7-867f-40aa1119092b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:36.601770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b603938d-aa79-4857-92e7-75ab9df7ee85 req-29863f0f-e3ef-41a7-867f-40aa1119092b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:36.602457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b603938d-aa79-4857-92e7-75ab9df7ee85 req-29863f0f-e3ef-41a7-867f-40aa1119092b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:36.615899 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-b603938d-aa79-4857-92e7-75ab9df7ee85 req-29863f0f-e3ef-41a7-867f-40aa1119092b service nova] Creating event network-vif-deleted:66dca372-21b2-42cd-a9d8-c656c3df691e for instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 on n-h2-856894-1 Sep 10 11:06:36.623131 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-b603938d-aa79-4857-92e7-75ab9df7ee85 req-29863f0f-e3ef-41a7-867f-40aa1119092b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038053 Sep 10 11:06:36.624160 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1351/5030] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:06:36.820365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-98d0cc31-d5b0-479d-93e9-cff12b44a054 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:36.836412 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-98d0cc31-d5b0-479d-93e9-cff12b44a054 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1552 microversion: 2.1 time: 0.305896 Sep 10 11:06:36.837995 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3680/5031] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:36 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1552 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:37.337010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f853e42f-a6db-4001-8bfb-f904e9144fa2 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:37.337773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f853e42f-a6db-4001-8bfb-f904e9144fa2 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:37.347471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f853e42f-a6db-4001-8bfb-f904e9144fa2 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:37.348413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f853e42f-a6db-4001-8bfb-f904e9144fa2 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:37.349313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f853e42f-a6db-4001-8bfb-f904e9144fa2 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:37.351705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f853e42f-a6db-4001-8bfb-f904e9144fa2 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:37.352340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f853e42f-a6db-4001-8bfb-f904e9144fa2 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:37.352970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f853e42f-a6db-4001-8bfb-f904e9144fa2 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:37.444531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f853e42f-a6db-4001-8bfb-f904e9144fa2 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:37.461505 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f853e42f-a6db-4001-8bfb-f904e9144fa2 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1607 microversion: 2.1 time: 0.129903 Sep 10 11:06:37.462114 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1352/5032] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:37 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1607 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:37.860972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be244582-d1c8-4e48-bf47-9689d99d253f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:37.861762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be244582-d1c8-4e48-bf47-9689d99d253f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:37.879413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:06:37.882226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be244582-d1c8-4e48-bf47-9689d99d253f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:37.883170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be244582-d1c8-4e48-bf47-9689d99d253f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:37.883850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be244582-d1c8-4e48-bf47-9689d99d253f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:37.885706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be244582-d1c8-4e48-bf47-9689d99d253f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:37.887152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be244582-d1c8-4e48-bf47-9689d99d253f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:37.889535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be244582-d1c8-4e48-bf47-9689d99d253f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:38.284177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be244582-d1c8-4e48-bf47-9689d99d253f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:38.294829 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be244582-d1c8-4e48-bf47-9689d99d253f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1552 microversion: 2.1 time: 0.438370 Sep 10 11:06:38.296470 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3681/5033] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:37 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1552 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:38.486081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:38.486688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:38.498970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:38.500058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:38.502169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:38.503047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:38.504530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:38.506181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:38.603398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:38.604621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:38.607696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:38.608195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lazy-loading 'fault' on Instance uuid aa5019e0-ebb1-496e-b0a1-329420d2ff70 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:06:38.744200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a58544226204f62807e56bb34c7d5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803a48d9302b4d52b80bf4b49fac53ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:38.753955 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-94e56694-711c-4606-93c1-a6369d41b2c1 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 200 len: 1328 microversion: 2.1 time: 0.272196 Sep 10 11:06:38.755402 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1353/5034] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:38 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 1328 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:39.157013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8c82d03f-2656-4f02-8ad3-82d9bb25323e req-744a52fa-92b5-438d-bb93-b9245ce36a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0ab613-578a-4b00-9c62-e01b1156cc77", "name": "network-vif-deleted", "tag": "bbb29236-48b5-4674-b5fc-a2ba7cf9bc43"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:06:39.176411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8c82d03f-2656-4f02-8ad3-82d9bb25323e req-744a52fa-92b5-438d-bb93-b9245ce36a7b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:39.176895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8c82d03f-2656-4f02-8ad3-82d9bb25323e req-744a52fa-92b5-438d-bb93-b9245ce36a7b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:39.177348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8c82d03f-2656-4f02-8ad3-82d9bb25323e req-744a52fa-92b5-438d-bb93-b9245ce36a7b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:39.205326 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8c82d03f-2656-4f02-8ad3-82d9bb25323e req-744a52fa-92b5-438d-bb93-b9245ce36a7b service nova] Creating event network-vif-deleted:bbb29236-48b5-4674-b5fc-a2ba7cf9bc43 for instance 4b0ab613-578a-4b00-9c62-e01b1156cc77 on n-h2-856894-1 Sep 10 11:06:39.219822 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8c82d03f-2656-4f02-8ad3-82d9bb25323e req-744a52fa-92b5-438d-bb93-b9245ce36a7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066452 Sep 10 11:06:39.221600 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3682/5035] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:06:39.323124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:39.324550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:39.334493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:39.335280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:39.335968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:39.336791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:39.337429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:39.337945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:39.389189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:39.390112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:39.390277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:39.390835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lazy-loading 'fault' on Instance uuid 4b0ab613-578a-4b00-9c62-e01b1156cc77 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:06:39.451159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:39.463711 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-25be38ab-afed-443d-b593-7ee5a730609d tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 200 len: 1339 microversion: 2.1 time: 0.146029 Sep 10 11:06:39.465623 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1354/5036] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:39 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 1339 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:39.779520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:39.780520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:39.793143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:39.793660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:39.794110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:39.794831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:39.795283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:39.797602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:39.829666 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] HTTP exception thrown: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Request method failure captured: Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 HTTP/1.1 Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG5xr4xEZSbwqvKsosR-Wb4IhcH19qfMZka_BIhEoN55s7E2J-PE0L10Q81wGR5FqpuBz4qgA8TdMwRw3ev6mwmabC4SGljmHxpcYVp4fSTOJq2D3chJA0_NH0MvZpbcazsOSh3iRJAlwhnp_0PNMTAVYDQbDRSK9FlQ0Z2oraJjX5E Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_803a48d9302b4d52b80bf4b49fac53ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 7a58544226204f62807e56bb34c7d5d8 Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'aa5019e0-ebb1-496e-b0a1-329420d2ff70'} Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:39.831607 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:39.836700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:39.836700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:39.836700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:39.836700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:39.836700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:39.836700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:39.836700 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:39.839075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Returning 404 to user: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:39.849802 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-48ad6960-5cb7-4b7e-a2ed-fa2e20461aec tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 404 len: 111 microversion: 2.1 time: 0.075473 Sep 10 11:06:39.850641 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3683/5037] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:39 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:06:39.859972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bd1ef65d-bf05-404d-b6aa-8b00b445b8e4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '.version_select at 0x7efcadc94ee0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:39.906892 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bd1ef65d-bf05-404d-b6aa-8b00b445b8e4 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451752615" status: 202 len: 0 microversion: 2.1 time: 0.051172 Sep 10 11:06:39.910552 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1355/5038] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 11:06:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451752615 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:06:40.487730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:40.489013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: 4b0ab613-578a-4b00-9c62-e01b1156cc77] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:40.501625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:40.504316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:40.504934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:40.505856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:40.508729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:40.509923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:40.551656 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] HTTP exception thrown: Instance 4b0ab613-578a-4b00-9c62-e01b1156cc77 could not be found. Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Request method failure captured: Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 HTTP/1.1 Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG849gzEElinsUq6kAchRQxggwjcpykb8dLhQhKJesZPZ0JE8uImB0N-I-8R-YdHs6brdNdnPEzFRMLxl0t45Uv7d8H-4zvplsG97Pt5lPQXQo1Yspo3SwmKXsDlK8M4G_Cyu9UmZ4mZmr6r5zH_WJmJXGoUkLCcfYzyIwWW0wZ8K_o Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: a78b1d49bc8c4c35aa78e48220a3685c Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestNetworkBasicOps-480786429 Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a78b1d49bc8c4c35aa78e48220a3685c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a78b1d49bc8c4c35aa78e48220a3685c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a78b1d49bc8c4c35aa78e48220a3685c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a78b1d49bc8c4c35aa78e48220a3685c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestNetworkBasicOps-480786429 Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: a78b1d49bc8c4c35aa78e48220a3685c Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestNetworkBasicOps-480786429 Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestNetworkBasicOps-480786429-project Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 5075387b0b14438ab9164683b752b867 Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestNetworkBasicOps-480786429-project Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 4b0ab613-578a-4b00-9c62-e01b1156cc77 could not be found. Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '4b0ab613-578a-4b00-9c62-e01b1156cc77'} Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0ab613-578a-4b00-9c62-e01b1156cc77 could not be found. Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0ab613-578a-4b00-9c62-e01b1156cc77 could not be found. Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:40.564954 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:40.570596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:40.570596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:40.570596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:40.570596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:40.570596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:40.570596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0ab613-578a-4b00-9c62-e01b1156cc77 could not be found. Sep 10 11:06:40.570596 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:40.572664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Returning 404 to user: Instance 4b0ab613-578a-4b00-9c62-e01b1156cc77 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:40.573756 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a21634d3-06e6-4f5e-90e4-15156d097b8c tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77" status: 404 len: 111 microversion: 2.1 time: 0.089920 Sep 10 11:06:40.577827 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3684/5039] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:40 2022] GET /compute/v2.1/servers/4b0ab613-578a-4b00-9c62-e01b1156cc77 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:06:41.161041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6512a18d-b521-406c-ba86-1b0033c7b63a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '.version_select at 0x7efcadd78940>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:41.489184 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6512a18d-b521-406c-ba86-1b0033c7b63a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1062787067" status: 202 len: 0 microversion: 2.1 time: 0.332611 Sep 10 11:06:41.490171 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1356/5040] 10.222.0.20 () {58 vars in 1257 bytes} [Sat Sep 10 11:06:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1062787067 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:06:45.533859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4970d54a-3e1b-4d1b-8307-ce0e06bd5efc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:45.534463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4970d54a-3e1b-4d1b-8307-ce0e06bd5efc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:45.543409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4970d54a-3e1b-4d1b-8307-ce0e06bd5efc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:45.543872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4970d54a-3e1b-4d1b-8307-ce0e06bd5efc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:45.544585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4970d54a-3e1b-4d1b-8307-ce0e06bd5efc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:45.545527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4970d54a-3e1b-4d1b-8307-ce0e06bd5efc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:45.546323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4970d54a-3e1b-4d1b-8307-ce0e06bd5efc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:45.561887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4970d54a-3e1b-4d1b-8307-ce0e06bd5efc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:45.567224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:06:45.606681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4970d54a-3e1b-4d1b-8307-ce0e06bd5efc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:06:45.772278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-9720c198-7d12-46ea-b5b2-c74b3eeef8af req-7ac593c3-6880-4242-9d9e-db8345cc89d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db03fda0-55e2-4bab-bb30-f704b3a930b2", "tag": "a04899eb-f835-489e-b8de-8f40cae405bb"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:06:45.797133 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4970d54a-3e1b-4d1b-8307-ce0e06bd5efc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 204 len: 0 microversion: 2.1 time: 0.273075 Sep 10 11:06:45.802033 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3685/5041] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:06:45 2022] DELETE /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:06:45.808864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9720c198-7d12-46ea-b5b2-c74b3eeef8af req-7ac593c3-6880-4242-9d9e-db8345cc89d1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:45.810900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9720c198-7d12-46ea-b5b2-c74b3eeef8af req-7ac593c3-6880-4242-9d9e-db8345cc89d1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:45.814419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bca72ae3-3ecb-4797-ae2f-3b3dc7141b58 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:45.815187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bca72ae3-3ecb-4797-ae2f-3b3dc7141b58 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:45.815530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9720c198-7d12-46ea-b5b2-c74b3eeef8af req-7ac593c3-6880-4242-9d9e-db8345cc89d1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:45.825648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bca72ae3-3ecb-4797-ae2f-3b3dc7141b58 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:45.827774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bca72ae3-3ecb-4797-ae2f-3b3dc7141b58 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:45.828230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bca72ae3-3ecb-4797-ae2f-3b3dc7141b58 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:45.829954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bca72ae3-3ecb-4797-ae2f-3b3dc7141b58 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:45.833758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bca72ae3-3ecb-4797-ae2f-3b3dc7141b58 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:45.834287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bca72ae3-3ecb-4797-ae2f-3b3dc7141b58 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:45.837164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:06:45.854090 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-9720c198-7d12-46ea-b5b2-c74b3eeef8af req-7ac593c3-6880-4242-9d9e-db8345cc89d1 service nova] Creating event network-changed:a04899eb-f835-489e-b8de-8f40cae405bb for instance db03fda0-55e2-4bab-bb30-f704b3a930b2 on n-h2-856894-1 Sep 10 11:06:45.871241 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-9720c198-7d12-46ea-b5b2-c74b3eeef8af req-7ac593c3-6880-4242-9d9e-db8345cc89d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338682 Sep 10 11:06:45.874046 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1357/5042] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:06:46.384585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bca72ae3-3ecb-4797-ae2f-3b3dc7141b58 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:46.399082 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bca72ae3-3ecb-4797-ae2f-3b3dc7141b58 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1671 microversion: 2.1 time: 0.593462 Sep 10 11:06:46.400252 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3686/5043] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:45 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1671 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:47.425932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-56a3f507-6240-4f73-b7d3-c0ec70cc8913 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:47.427235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-56a3f507-6240-4f73-b7d3-c0ec70cc8913 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:47.464436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56a3f507-6240-4f73-b7d3-c0ec70cc8913 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:47.465777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56a3f507-6240-4f73-b7d3-c0ec70cc8913 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:47.466915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56a3f507-6240-4f73-b7d3-c0ec70cc8913 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:47.469035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56a3f507-6240-4f73-b7d3-c0ec70cc8913 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:47.480165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56a3f507-6240-4f73-b7d3-c0ec70cc8913 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:47.481537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56a3f507-6240-4f73-b7d3-c0ec70cc8913 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:48.306737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-56a3f507-6240-4f73-b7d3-c0ec70cc8913 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:48.319717 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-56a3f507-6240-4f73-b7d3-c0ec70cc8913 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1671 microversion: 2.1 time: 0.899083 Sep 10 11:06:48.321942 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1358/5044] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:47 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1671 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:48.797692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e0bfd6a6-d940-4657-a891-d81cd8f4f418 req-1f0118d5-c391-492c-a661-c24fa9c0dfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db03fda0-55e2-4bab-bb30-f704b3a930b2", "name": "network-vif-deleted", "tag": "a04899eb-f835-489e-b8de-8f40cae405bb"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:06:48.822254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e0bfd6a6-d940-4657-a891-d81cd8f4f418 req-1f0118d5-c391-492c-a661-c24fa9c0dfd9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:48.824190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e0bfd6a6-d940-4657-a891-d81cd8f4f418 req-1f0118d5-c391-492c-a661-c24fa9c0dfd9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:48.824737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e0bfd6a6-d940-4657-a891-d81cd8f4f418 req-1f0118d5-c391-492c-a661-c24fa9c0dfd9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:48.852606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e0bfd6a6-d940-4657-a891-d81cd8f4f418 req-1f0118d5-c391-492c-a661-c24fa9c0dfd9 service nova] Creating event network-vif-deleted:a04899eb-f835-489e-b8de-8f40cae405bb for instance db03fda0-55e2-4bab-bb30-f704b3a930b2 on n-h2-856894-1 Sep 10 11:06:48.867260 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e0bfd6a6-d940-4657-a891-d81cd8f4f418 req-1f0118d5-c391-492c-a661-c24fa9c0dfd9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077417 Sep 10 11:06:48.868730 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3687/5045] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:06:48.936700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5d2392ff-3140-442f-8ab1-babd433599c2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:48.937396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5d2392ff-3140-442f-8ab1-babd433599c2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:48.946390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d2392ff-3140-442f-8ab1-babd433599c2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:48.947890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d2392ff-3140-442f-8ab1-babd433599c2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:48.949703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d2392ff-3140-442f-8ab1-babd433599c2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:48.950686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d2392ff-3140-442f-8ab1-babd433599c2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:48.951386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d2392ff-3140-442f-8ab1-babd433599c2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:48.951961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d2392ff-3140-442f-8ab1-babd433599c2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:49.034256 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5d2392ff-3140-442f-8ab1-babd433599c2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/ips" status: 200 len: 151 microversion: 2.1 time: 0.102922 Sep 10 11:06:49.036519 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1359/5046] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 11:06:48 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/ips => generated 151 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:06:49.360176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:49.360957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:49.373003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:49.373937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:49.375696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:49.376601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:49.379858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:49.385456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:49.454363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:49.454901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:49.455372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:49.456020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lazy-loading 'fault' on Instance uuid db03fda0-55e2-4bab-bb30-f704b3a930b2 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:06:49.588770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:06:49.603778 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de07947b-bbd1-493b-8759-2612d5fd7a74 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 200 len: 1489 microversion: 2.1 time: 0.257353 Sep 10 11:06:49.611347 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3688/5047] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:49 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 1489 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:06:50.634780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:50.635984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: db03fda0-55e2-4bab-bb30-f704b3a930b2] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:50.643784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:50.644529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:50.645286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:50.646152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:50.646766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:50.647344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:50.666614 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] HTTP exception thrown: Instance db03fda0-55e2-4bab-bb30-f704b3a930b2 could not be found. Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Request method failure captured: Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 HTTP/1.1 Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG849gzEElinsUq6kAchRQxggwjcpykb8dLhQhKJesZPZ0JE8uImB0N-I-8R-YdHs6brdNdnPEzFRMLxl0t45Uv7d8H-4zvplsG97Pt5lPQXQo1Yspo3SwmKXsDlK8M4G_Cyu9UmZ4mZmr6r5zH_WJmJXGoUkLCcfYzyIwWW0wZ8K_o Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: a78b1d49bc8c4c35aa78e48220a3685c Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestNetworkBasicOps-480786429 Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a78b1d49bc8c4c35aa78e48220a3685c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a78b1d49bc8c4c35aa78e48220a3685c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a78b1d49bc8c4c35aa78e48220a3685c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a78b1d49bc8c4c35aa78e48220a3685c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestNetworkBasicOps-480786429 Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: a78b1d49bc8c4c35aa78e48220a3685c Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestNetworkBasicOps-480786429 Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestNetworkBasicOps-480786429-project Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 5075387b0b14438ab9164683b752b867 Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestNetworkBasicOps-480786429-project Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance db03fda0-55e2-4bab-bb30-f704b3a930b2 could not be found. Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'db03fda0-55e2-4bab-bb30-f704b3a930b2'} Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db03fda0-55e2-4bab-bb30-f704b3a930b2 could not be found. Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db03fda0-55e2-4bab-bb30-f704b3a930b2 could not be found. Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:50.669051 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:50.673780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:50.673780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:50.673780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:50.673780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:50.673780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:50.673780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db03fda0-55e2-4bab-bb30-f704b3a930b2 could not be found. Sep 10 11:06:50.673780 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:50.677114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Returning 404 to user: Instance db03fda0-55e2-4bab-bb30-f704b3a930b2 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:50.677859 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9d59a52a-6c1a-422d-91f1-a935206ea7e8 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2" status: 404 len: 111 microversion: 2.1 time: 0.048381 Sep 10 11:06:50.683001 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1360/5048] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:50 2022] GET /compute/v2.1/servers/db03fda0-55e2-4bab-bb30-f704b3a930b2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:06:51.042896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b4360139-7333-47d2-9330-cf3a12d0bdeb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '.version_select at 0x7efcad340670>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:51.081405 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b4360139-7333-47d2-9330-cf3a12d0bdeb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-172263200" status: 202 len: 0 microversion: 2.1 time: 0.041729 Sep 10 11:06:51.083177 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3689/5049] 10.222.0.20 () {58 vars in 1254 bytes} [Sat Sep 10 11:06:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-172263200 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:06:51.956559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-69e6e9ee-64cb-4062-b2a7-1404360ad038 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08f0edf2-e681-467e-a8aa-1ad864266a28"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:06:51.959612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-69e6e9ee-64cb-4062-b2a7-1404360ad038 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:51.980332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e6e9ee-64cb-4062-b2a7-1404360ad038 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:51.981254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e6e9ee-64cb-4062-b2a7-1404360ad038 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:51.981816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e6e9ee-64cb-4062-b2a7-1404360ad038 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:51.982797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e6e9ee-64cb-4062-b2a7-1404360ad038 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:51.984540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e6e9ee-64cb-4062-b2a7-1404360ad038 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:51.985555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e6e9ee-64cb-4062-b2a7-1404360ad038 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:52.425756 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-69e6e9ee-64cb-4062-b2a7-1404360ad038 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.474491 Sep 10 11:06:52.428496 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1361/5050] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:06:51 2022] POST /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 194 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:06:53.348096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:53.349346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:53.372879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:53.373717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:53.374326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:53.375238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:53.385128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:53.385800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:53.400900 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] HTTP exception thrown: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Request method failure captured: Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 HTTP/1.1 Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG5xr4xEZSbwqvKsosR-Wb4IhcH19qfMZka_BIhEoN55s7E2J-PE0L10Q81wGR5FqpuBz4qgA8TdMwRw3ev6mwmabC4SGljmHxpcYVp4fSTOJq2D3chJA0_NH0MvZpbcazsOSh3iRJAlwhnp_0PNMTAVYDQbDRSK9FlQ0Z2oraJjX5E Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_803a48d9302b4d52b80bf4b49fac53ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 7a58544226204f62807e56bb34c7d5d8 Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'aa5019e0-ebb1-496e-b0a1-329420d2ff70'} Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:53.411206 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Returning 404 to user: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:53.419547 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3128dcb-95ca-4d7a-b838-fe2f44143f39 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 404 len: 111 microversion: 2.1 time: 0.069492 Sep 10 11:06:53.423867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:06:53.424596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: aa5019e0-ebb1-496e-b0a1-329420d2ff70] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:06:53.425436 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3690/5051] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:06:53 2022] DELETE /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:06:53.431986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:53.443155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:53.443947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:53.444729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:06:53.445305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:06:53.445746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:06:53.465283 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] HTTP exception thrown: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Request method failure captured: Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 HTTP/1.1 Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG5xr4xEZSbwqvKsosR-Wb4IhcH19qfMZka_BIhEoN55s7E2J-PE0L10Q81wGR5FqpuBz4qgA8TdMwRw3ev6mwmabC4SGljmHxpcYVp4fSTOJq2D3chJA0_NH0MvZpbcazsOSh3iRJAlwhnp_0PNMTAVYDQbDRSK9FlQ0Z2oraJjX5E Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_803a48d9302b4d52b80bf4b49fac53ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7a58544226204f62807e56bb34c7d5d8 Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'aa5019e0-ebb1-496e-b0a1-329420d2ff70'} Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:06:53.472448 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:53.477520 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:06:53.477520 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:06:53.477520 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:06:53.477520 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:06:53.477520 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:06:53.477520 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. Sep 10 11:06:53.477520 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:06:53.477520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Returning 404 to user: Instance aa5019e0-ebb1-496e-b0a1-329420d2ff70 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:06:53.477520 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7f7620d5-8515-4b08-b81a-f6fed1a58982 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70" status: 404 len: 111 microversion: 2.1 time: 0.055227 Sep 10 11:06:53.481795 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1362/5052] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:06:53 2022] GET /compute/v2.1/servers/aa5019e0-ebb1-496e-b0a1-329420d2ff70 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:06:58.722267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1415861809", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9dd33cb4-aceb-4700-9807-b42f6a5ba624", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e65712d8-efe4-477c-ab8b-0eb50d70eafc"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:06:58.895458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] validate_networks() for [('e65712d8-efe4-477c-ab8b-0eb50d70eafc', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:07:00.096838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:00.097993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:00.131662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:00.135638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:00.136498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:00.137456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:00.138452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:00.139230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:00.139886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:00.166101 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] HTTP exception thrown: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Request method failure captured: Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 HTTP/1.1 Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG5xr4xEZSbwqvKsosR-Wb4IhcH19qfMZka_BIhEoN55s7E2J-PE0L10Q81wGR5FqpuBz4qgA8TdMwRw3ev6mwmabC4SGljmHxpcYVp4fSTOJq2D3chJA0_NH0MvZpbcazsOSh3iRJAlwhnp_0PNMTAVYDQbDRSK9FlQ0Z2oraJjX5E Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_803a48d9302b4d52b80bf4b49fac53ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7a58544226204f62807e56bb34c7d5d8 Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f98521ad-ebd1-473c-945f-70d80d31c1b7'} Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:07:00.173369 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:07:00.177437 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:00.190046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Returning 404 to user: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:00.191320 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-103a5f69-c909-4d44-aa7e-9702ba112266 tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 404 len: 111 microversion: 2.1 time: 0.098410 Sep 10 11:07:00.193230 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1363/5053] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:07:00 2022] DELETE /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:07:00.209858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:00.213519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] [instance: f98521ad-ebd1-473c-945f-70d80d31c1b7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:00.243201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:00.248570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:00.257802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:00.264636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:00.265337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:00.265947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:00.339829 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] HTTP exception thrown: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Request method failure captured: Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 HTTP/1.1 Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG5xr4xEZSbwqvKsosR-Wb4IhcH19qfMZka_BIhEoN55s7E2J-PE0L10Q81wGR5FqpuBz4qgA8TdMwRw3ev6mwmabC4SGljmHxpcYVp4fSTOJq2D3chJA0_NH0MvZpbcazsOSh3iRJAlwhnp_0PNMTAVYDQbDRSK9FlQ0Z2oraJjX5E Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/803a48d9302b4d52b80bf4b49fac53ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_803a48d9302b4d52b80bf4b49fac53ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 803a48d9302b4d52b80bf4b49fac53ba Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1356947723 Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 7a58544226204f62807e56bb34c7d5d8 Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeTestJSON-1356947723-project Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f98521ad-ebd1-473c-945f-70d80d31c1b7'} Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:00.348468 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:00.353404 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:00.353404 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:00.353404 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:00.353404 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:07:00.353404 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:07:00.353404 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. Sep 10 11:07:00.353404 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:00.353404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] Returning 404 to user: Instance f98521ad-ebd1-473c-945f-70d80d31c1b7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:00.353404 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2a6b19a4-7607-4154-bd75-6d2f84c1423d tempest-AttachVolumeTestJSON-1356947723 tempest-AttachVolumeTestJSON-1356947723-project] 10.222.0.20 "GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7" status: 404 len: 111 microversion: 2.1 time: 0.152194 Sep 10 11:07:00.353404 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1364/5054] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:00 2022] GET /compute/v2.1/servers/f98521ad-ebd1-473c-945f-70d80d31c1b7 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:07:01.886918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:07:01.888234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:07:01.891279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:07:01.893991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:07:01.895045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:07:01.917513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:01.920881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:01.922824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:01.923792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:01.925981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:01.926680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:01.957761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:07:01.980282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for user 78004185356641b990a951dc95e6ca0c and project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:07:02.119809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:07:02.122551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9dd33cb4-aceb-4700-9807-b42f6a5ba624',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:07:02.361505 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60f8a697-f72f-45c2-be2c-02da842651fe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.643299 Sep 10 11:07:02.368031 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3691/5055] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:06:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:07:02.373949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4d92f86a-63d1-41eb-9fd5-7db8bc2d56cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:02.375127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4d92f86a-63d1-41eb-9fd5-7db8bc2d56cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:02.650533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4d92f86a-63d1-41eb-9fd5-7db8bc2d56cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:02.657952 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4d92f86a-63d1-41eb-9fd5-7db8bc2d56cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1071 microversion: 2.1 time: 0.287962 Sep 10 11:07:02.658538 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1365/5056] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:02 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1071 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:03.686883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9185257e-e80b-4a12-8bd0-8e24dedd9bc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:03.687510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9185257e-e80b-4a12-8bd0-8e24dedd9bc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:03.699387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9185257e-e80b-4a12-8bd0-8e24dedd9bc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:03.700283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9185257e-e80b-4a12-8bd0-8e24dedd9bc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:03.704397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9185257e-e80b-4a12-8bd0-8e24dedd9bc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:03.705274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9185257e-e80b-4a12-8bd0-8e24dedd9bc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:03.705863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9185257e-e80b-4a12-8bd0-8e24dedd9bc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:03.706481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9185257e-e80b-4a12-8bd0-8e24dedd9bc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:03.828683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9185257e-e80b-4a12-8bd0-8e24dedd9bc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:03.850748 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9185257e-e80b-4a12-8bd0-8e24dedd9bc8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1169 microversion: 2.1 time: 0.168762 Sep 10 11:07:03.851676 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3692/5057] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:03 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:04.879987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a7d4a5ac-32a3-431c-95c5-91db635d97f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:04.881426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a7d4a5ac-32a3-431c-95c5-91db635d97f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:04.902530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7d4a5ac-32a3-431c-95c5-91db635d97f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:04.903821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7d4a5ac-32a3-431c-95c5-91db635d97f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:04.913502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7d4a5ac-32a3-431c-95c5-91db635d97f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:04.914620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7d4a5ac-32a3-431c-95c5-91db635d97f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:04.915864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7d4a5ac-32a3-431c-95c5-91db635d97f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:04.916487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7d4a5ac-32a3-431c-95c5-91db635d97f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:05.126244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a7d4a5ac-32a3-431c-95c5-91db635d97f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:05.142037 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a7d4a5ac-32a3-431c-95c5-91db635d97f0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1187 microversion: 2.1 time: 0.265810 Sep 10 11:07:05.143320 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1366/5058] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:04 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1187 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:06.172629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cc38281c-ab9f-404d-9c25-19932f6c5016 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:06.174233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cc38281c-ab9f-404d-9c25-19932f6c5016 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:06.189921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc38281c-ab9f-404d-9c25-19932f6c5016 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:06.195264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc38281c-ab9f-404d-9c25-19932f6c5016 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:06.198190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc38281c-ab9f-404d-9c25-19932f6c5016 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:06.199235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc38281c-ab9f-404d-9c25-19932f6c5016 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:06.211206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc38281c-ab9f-404d-9c25-19932f6c5016 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:06.219216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc38281c-ab9f-404d-9c25-19932f6c5016 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:06.494988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-2116843677", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "3e9ea352-86d6-4b16-a357-fc536e2a931d"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:06.661229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] validate_networks() for [('3e9ea352-86d6-4b16-a357-fc536e2a931d', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:07:07.216374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cc38281c-ab9f-404d-9c25-19932f6c5016 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:07.226063 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cc38281c-ab9f-404d-9c25-19932f6c5016 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1229 microversion: 2.1 time: 1.057195 Sep 10 11:07:07.231620 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1367/5059] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:06 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1229 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:08.253482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-61b05080-8183-43bc-ab70-c3ccc3737640 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:08.254172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-61b05080-8183-43bc-ab70-c3ccc3737640 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:08.268485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b05080-8183-43bc-ab70-c3ccc3737640 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:08.269002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b05080-8183-43bc-ab70-c3ccc3737640 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:08.269491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b05080-8183-43bc-ab70-c3ccc3737640 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:08.270221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b05080-8183-43bc-ab70-c3ccc3737640 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:08.270693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b05080-8183-43bc-ab70-c3ccc3737640 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:08.271137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-61b05080-8183-43bc-ab70-c3ccc3737640 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:09.181213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-61b05080-8183-43bc-ab70-c3ccc3737640 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:09.189863 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-61b05080-8183-43bc-ab70-c3ccc3737640 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1229 microversion: 2.1 time: 0.940435 Sep 10 11:07:09.190789 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1368/5060] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:08 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1229 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:09.234145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:07:09.235905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:07:09.236593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:07:09.237273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:07:09.237950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:07:09.248490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:09.262051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:09.262796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:09.263440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:09.264382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:09.266060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:09.268264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:09.346389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Getting quotas for project 42e7d4b2c1904bc6b30fdaf28a57a277. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:07:09.358896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Getting quotas for user 3d956ae1b6334614ae7bc4c8a1df669c and project 42e7d4b2c1904bc6b30fdaf28a57a277. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:07:09.423749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:07:09.432629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:07:09.538152 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-83f80594-bd27-4e7e-8175-ef95be921f8a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.507161 Sep 10 11:07:09.538842 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3693/5061] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 11:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3509 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:07:09.551715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b18e968f-c25c-46c8-b7f6-ce7e2930d563 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:09.553524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b18e968f-c25c-46c8-b7f6-ce7e2930d563 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:10.204314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b18e968f-c25c-46c8-b7f6-ce7e2930d563 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:10.214823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc7e5197-47da-4b46-b8c7-778103a391cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:10.215451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc7e5197-47da-4b46-b8c7-778103a391cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:10.222798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b18e968f-c25c-46c8-b7f6-ce7e2930d563 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:10.230656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b18e968f-c25c-46c8-b7f6-ce7e2930d563 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:10.233471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc7e5197-47da-4b46-b8c7-778103a391cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:10.237099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc7e5197-47da-4b46-b8c7-778103a391cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:10.238640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc7e5197-47da-4b46-b8c7-778103a391cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:10.239117 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b18e968f-c25c-46c8-b7f6-ce7e2930d563 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1259 microversion: 2.21 time: 0.691649 Sep 10 11:07:10.239562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc7e5197-47da-4b46-b8c7-778103a391cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:10.240035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc7e5197-47da-4b46-b8c7-778103a391cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:10.240466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc7e5197-47da-4b46-b8c7-778103a391cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:10.241462 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1369/5062] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:09 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1259 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:11.047876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-96442385-427a-4a4e-907f-96d9906748ba req-f78cb9fd-9aec-417c-9bfd-ef8d3e7e3d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "372a7f3b-98aa-471d-8eb2-a739d5816300", "tag": "b8aa0119-058f-4555-b17b-68e33baf5f6c"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:11.079080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-96442385-427a-4a4e-907f-96d9906748ba req-f78cb9fd-9aec-417c-9bfd-ef8d3e7e3d75 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:11.081784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-96442385-427a-4a4e-907f-96d9906748ba req-f78cb9fd-9aec-417c-9bfd-ef8d3e7e3d75 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:11.083519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-96442385-427a-4a4e-907f-96d9906748ba req-f78cb9fd-9aec-417c-9bfd-ef8d3e7e3d75 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:11.113794 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-96442385-427a-4a4e-907f-96d9906748ba req-f78cb9fd-9aec-417c-9bfd-ef8d3e7e3d75 service nova] Creating event network-changed:b8aa0119-058f-4555-b17b-68e33baf5f6c for instance 372a7f3b-98aa-471d-8eb2-a739d5816300 on n-h2-856894-1 Sep 10 11:07:11.115931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc7e5197-47da-4b46-b8c7-778103a391cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:11.125161 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-96442385-427a-4a4e-907f-96d9906748ba req-f78cb9fd-9aec-417c-9bfd-ef8d3e7e3d75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082076 Sep 10 11:07:11.128557 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1370/5063] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:11.133725 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc7e5197-47da-4b46-b8c7-778103a391cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1229 microversion: 2.1 time: 0.919443 Sep 10 11:07:11.138654 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3694/5064] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:10 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1229 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:11.268750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:11.271159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:11.282154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:11.286301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:11.286891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:11.289461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:11.290204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:11.293936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:11.490061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:11.506837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:11.510247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:11.511702 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-541520ba-b55b-4723-a787-4df83011f6c2 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1311 microversion: 2.21 time: 0.249789 Sep 10 11:07:11.512812 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1371/5065] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:11 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:12.174186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65e5e75b-2bb8-4fcf-8d95-e1339fb69336 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:12.175627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65e5e75b-2bb8-4fcf-8d95-e1339fb69336 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:12.190332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e5e75b-2bb8-4fcf-8d95-e1339fb69336 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:12.190830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e5e75b-2bb8-4fcf-8d95-e1339fb69336 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:12.191271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e5e75b-2bb8-4fcf-8d95-e1339fb69336 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:12.191984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e5e75b-2bb8-4fcf-8d95-e1339fb69336 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:12.192441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e5e75b-2bb8-4fcf-8d95-e1339fb69336 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:12.192860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65e5e75b-2bb8-4fcf-8d95-e1339fb69336 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:12.544188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:12.544847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:12.557762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:12.558267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:12.558714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:12.578089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:12.578089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:12.578089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:12.956365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:12.967251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:12.978849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:12.980253 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e90921f8-4a6f-4502-ba64-9643ab770e5f tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1329 microversion: 2.21 time: 0.445525 Sep 10 11:07:12.982004 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1372/5066] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:12 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1329 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:07:12.998555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3cde3fa8-15a0-4733-9e58-4bd63d03e5a3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: .version_select at 0x7efcae6099d0>, body: {"keypair": {"name": "tempest-keypair-1703126854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXVJMNmjMsqsWvt7wX/w6XtZfGVWdB/Z2lUq1tu6rUkL0PKYraN8gZBaG12KC/UFUDjoSsHrCMZHIw3dilnJpUzqqzkYWoQZxhYG+oFcdCb+YD0hD/HchY5xMnTiblPMQ=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:13.052472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3cde3fa8-15a0-4733-9e58-4bd63d03e5a3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for project b28403f237c84af2a051fa9feb72f60b. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:07:13.099921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3cde3fa8-15a0-4733-9e58-4bd63d03e5a3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for user c3b1df3721f24d13807ab7f4c4a677f8 and project b28403f237c84af2a051fa9feb72f60b. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:07:13.168455 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3cde3fa8-15a0-4733-9e58-4bd63d03e5a3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185057 Sep 10 11:07:13.175399 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1373/5067] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:07:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:13.394484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-65e5e75b-2bb8-4fcf-8d95-e1339fb69336 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:13.402753 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65e5e75b-2bb8-4fcf-8d95-e1339fb69336 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1229 microversion: 2.1 time: 1.232833 Sep 10 11:07:13.409354 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3695/5068] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:12 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1229 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:14.012477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:14.013713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:14.045777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:14.047251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:14.048688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:14.049976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:14.053763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:14.057055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:14.353170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9be383b5-14e6-4c40-b821-b32ed14ad652 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Action: 'create', calling method: .version_select at 0x7efcad2b24c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2136408561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXHdB1BwzTbXUoru4+KeNXjdPwDDfhh4DwYxbo7d0HiVaCUdO0yXkn3tub5DM3U7Xpg5YuFO7q02kwqkyweW5mfPOPkJ78AMoTAWWZDPPbV7hJb2U9ukc7HrcMxkfiykA=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:14.381263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-9be383b5-14e6-4c40-b821-b32ed14ad652 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:07:14.388356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-9be383b5-14e6-4c40-b821-b32ed14ad652 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for user 5075387b0b14438ab9164683b752b867 and project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:07:14.454889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:14.471724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:14.476713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:14.482435 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f76668c4-f5fd-4429-b542-a97245ab773a tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1317 microversion: 2.21 time: 0.473615 Sep 10 11:07:14.483470 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9be383b5-14e6-4c40-b821-b32ed14ad652 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.133040 Sep 10 11:07:14.485619 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1374/5069] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:14 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:14.490681 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3696/5070] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:07:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:07:14.499540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-08d9b748-9605-4ae7-b310-940c8af051f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:14.500430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-08d9b748-9605-4ae7-b310-940c8af051f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:14.517132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08d9b748-9605-4ae7-b310-940c8af051f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:14.517761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08d9b748-9605-4ae7-b310-940c8af051f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:14.519232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08d9b748-9605-4ae7-b310-940c8af051f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:14.523185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08d9b748-9605-4ae7-b310-940c8af051f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:14.524605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08d9b748-9605-4ae7-b310-940c8af051f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:14.526633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08d9b748-9605-4ae7-b310-940c8af051f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:15.514209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:15.514832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:15.533967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:15.534726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:15.535599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:15.536629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:15.537289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:15.542454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:16.167366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-08d9b748-9605-4ae7-b310-940c8af051f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:16.176701 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-08d9b748-9605-4ae7-b310-940c8af051f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1229 microversion: 2.1 time: 1.689713 Sep 10 11:07:16.204649 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1375/5071] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:14 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1229 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:16.585350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:16.588550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:16.616329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:16.619904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:16.636523 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88a961d8-3f7a-4e05-8c49-8c52ea34b7e8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1359 microversion: 2.21 time: 1.115981 Sep 10 11:07:16.640555 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3697/5072] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:15 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1359 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:07:17.203175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-295cdea8-8ad5-4a80-b906-c106e164ce44 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:17.205823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-295cdea8-8ad5-4a80-b906-c106e164ce44 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:17.220568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-295cdea8-8ad5-4a80-b906-c106e164ce44 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:17.228160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-295cdea8-8ad5-4a80-b906-c106e164ce44 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:17.228917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-295cdea8-8ad5-4a80-b906-c106e164ce44 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:17.230189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-295cdea8-8ad5-4a80-b906-c106e164ce44 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:17.231619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-295cdea8-8ad5-4a80-b906-c106e164ce44 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:17.234094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-295cdea8-8ad5-4a80-b906-c106e164ce44 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:17.675783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:17.677626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:17.704057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:17.704953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:17.705626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:17.706704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:17.707576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:17.708193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:18.681338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-295cdea8-8ad5-4a80-b906-c106e164ce44 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:18.687124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:18.698439 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-295cdea8-8ad5-4a80-b906-c106e164ce44 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 1.502714 Sep 10 11:07:18.699677 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1376/5073] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:17 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:18.705404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1090003663", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e19ca223-58e0-4bb3-8cd0-347d45a52b81"}], "security_groups": [{"name": "tempest-securitygroup--1147888037"}], "key_name": "tempest-keypair-1703126854", "user_data": "}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:18.937672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] validate_networks() for [('e19ca223-58e0-4bb3-8cd0-347d45a52b81', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:07:19.181188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:19.194998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:19.197736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:19.204849 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bde25c12-b6ae-41f1-ad6a-bafdbf697aa5 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1359 microversion: 2.21 time: 1.540006 Sep 10 11:07:19.206204 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3698/5074] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:17 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1359 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:07:19.213667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-302741367", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "695533d6-6078-46f9-9b7e-f612a076fed7"}], "key_name": "tempest-TestNetworkBasicOps-2136408561", "security_groups": [{"name": "tempest-secgroup-smoke-1602162084"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:19.331981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:19.483045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] validate_networks() for [('695533d6-6078-46f9-9b7e-f612a076fed7', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:07:20.216705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:07:20.217762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:07:20.218251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:07:20.218664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:07:20.219078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:07:20.229552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:20.230042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:20.230475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:20.231235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:20.231694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:20.232117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:20.251440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for project b28403f237c84af2a051fa9feb72f60b. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:07:20.257659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for user c3b1df3721f24d13807ab7f4c4a677f8 and project b28403f237c84af2a051fa9feb72f60b. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:07:20.271348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:07:20.273684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:07:20.325985 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0691786f-5c5c-40ef-94c0-f1bf27186c54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.624802 Sep 10 11:07:20.327175 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1377/5075] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:07:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:07:20.333421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e3ecbbd-7250-47a1-8875-adb3acab90e2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:20.333421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3e3ecbbd-7250-47a1-8875-adb3acab90e2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:20.340975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3ecbbd-7250-47a1-8875-adb3acab90e2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:20.341574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3ecbbd-7250-47a1-8875-adb3acab90e2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:20.341965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3ecbbd-7250-47a1-8875-adb3acab90e2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:20.342680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3ecbbd-7250-47a1-8875-adb3acab90e2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:20.343143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3ecbbd-7250-47a1-8875-adb3acab90e2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:20.343579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e3ecbbd-7250-47a1-8875-adb3acab90e2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:20.588862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:07:20.590051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:07:20.590710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:07:20.591434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:07:20.592086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:07:20.608882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:20.609758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:20.610588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:20.611716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:20.615804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:20.616750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:20.677693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3e3ecbbd-7250-47a1-8875-adb3acab90e2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:20.685117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:07:20.692674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Getting quotas for user 5075387b0b14438ab9164683b752b867 and project a78b1d49bc8c4c35aa78e48220a3685c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:07:20.699533 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3e3ecbbd-7250-47a1-8875-adb3acab90e2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 0.371266 Sep 10 11:07:20.703364 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1378/5076] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:20 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:20.710817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:07:20.715856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:07:20.788744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82c13a28-8b37-4354-94ae-47a51443775b tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.580973 Sep 10 11:07:20.790719 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3699/5077] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:07:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:07:20.795930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:20.797063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:20.804733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:20.806369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:20.807172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:20.808099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:20.808762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:20.809533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:20.994343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-46ef3a79-a91b-443b-8088-53c81ec286c5 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Action: 'create', calling method: .version_select at 0x7efcade7c5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1798010539", "metadata": {"Type": "work"}}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-46ef3a79-a91b-443b-8088-53c81ec286c5 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Request method failure captured: Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 122 Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG_og9sy4zFUb-MiDH9w4IuCt9cx-f74eiSvq3lfar7D_qIgzUSJSbTUJmLq7SPn8sGZ6zwy37op9mewWJF5MycsyWrFax73MAufbmw1xt4lIMKvyrcwJ3KT37eku1zn_7ohydZcNm3XU3RwIdB2Pbzi4RjraEehCgOcsl00z_exLtc Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_341e1ec8b5b84ca6a09ca39bfe45d1e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 37812974b00a4ba5bd4dbf15661b8e57 Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1798010539", "metadata": {"Type": "work"}}} Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1798010539', 'metadata': {'Type': 'work'}}}} Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi '#$%' Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:07:21.005845 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.013746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-46ef3a79-a91b-443b-8088-53c81ec286c5 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:21.015462 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-46ef3a79-a91b-443b-8088-53c81ec286c5 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.308162 Sep 10 11:07:21.019757 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1379/5078] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Sep 10 11:07:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 316 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:07:21.025905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1f976392-9267-4674-a276-c718115c1ace tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:21.040497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1f976392-9267-4674-a276-c718115c1ace tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:21.051995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f976392-9267-4674-a276-c718115c1ace tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:21.052361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f976392-9267-4674-a276-c718115c1ace tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:21.052819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f976392-9267-4674-a276-c718115c1ace tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:21.053575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f976392-9267-4674-a276-c718115c1ace tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:21.054512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f976392-9267-4674-a276-c718115c1ace tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:21.055689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f976392-9267-4674-a276-c718115c1ace tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:21.089391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:21.105822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:21.115339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:21.123916 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef3aea20-1c9e-4927-a00c-374067705fd7 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1359 microversion: 2.21 time: 0.324671 Sep 10 11:07:21.124568 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3700/5079] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:20 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1359 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:21.155487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e77507ac-7f79-4d6b-a9ef-b95467cd2502 req-18a88c4f-36ec-48a6-b9a5-e33300512c70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa", "tag": "4bf58c4b-90bf-450e-bf68-60444eb9c012"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:21.184042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e77507ac-7f79-4d6b-a9ef-b95467cd2502 req-18a88c4f-36ec-48a6-b9a5-e33300512c70 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:21.185534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e77507ac-7f79-4d6b-a9ef-b95467cd2502 req-18a88c4f-36ec-48a6-b9a5-e33300512c70 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:21.188766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e77507ac-7f79-4d6b-a9ef-b95467cd2502 req-18a88c4f-36ec-48a6-b9a5-e33300512c70 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:21.210231 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e77507ac-7f79-4d6b-a9ef-b95467cd2502 req-18a88c4f-36ec-48a6-b9a5-e33300512c70 service nova] Creating event network-changed:4bf58c4b-90bf-450e-bf68-60444eb9c012 for instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa on n-h2-856894-1 Sep 10 11:07:21.218392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1f976392-9267-4674-a276-c718115c1ace tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:21.229585 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e77507ac-7f79-4d6b-a9ef-b95467cd2502 req-18a88c4f-36ec-48a6-b9a5-e33300512c70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083913 Sep 10 11:07:21.231079 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1f976392-9267-4674-a276-c718115c1ace tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1246 microversion: 2.1 time: 0.210169 Sep 10 11:07:21.231655 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1380/5080] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:21 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1246 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:21.232051 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3701/5081] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:21.239801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8be7fee5-3d33-4a12-96df-5ac059cadcf3 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Action: 'create', calling method: .version_select at 0x7efcae609280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1892715921", "metadata": {"Type": "work"}}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:21.250311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-042fb9a8-5830-4867-81ce-27561d67f604 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:21.251251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-042fb9a8-5830-4867-81ce-27561d67f604 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8be7fee5-3d33-4a12-96df-5ac059cadcf3 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Request method failure captured: Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 120 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG_og9sy4zFUb-MiDH9w4IuCt9cx-f74eiSvq3lfar7D_qIgzUSJSbTUJmLq7SPn8sGZ6zwy37op9mewWJF5MycsyWrFax73MAufbmw1xt4lIMKvyrcwJ3KT37eku1zn_7ohydZcNm3XU3RwIdB2Pbzi4RjraEehCgOcsl00z_exLtc Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_341e1ec8b5b84ca6a09ca39bfe45d1e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 37812974b00a4ba5bd4dbf15661b8e57 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1892715921", "metadata": {"Type": "work"}}} Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1892715921', 'metadata': {'Type': 'work'}}}} Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi '0' Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:07:21.256286 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 11:07:21.262517 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.265929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8be7fee5-3d33-4a12-96df-5ac059cadcf3 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:21.271672 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8be7fee5-3d33-4a12-96df-5ac059cadcf3 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.035539 Sep 10 11:07:21.279112 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1381/5082] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Sep 10 11:07:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:07:21.295593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4448b3a3-8887-4571-b2e6-07fd213491e9 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Action: 'create', calling method: .version_select at 0x7efcadd76040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1924348405", "metadata": {"Type": "work"}}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4448b3a3-8887-4571-b2e6-07fd213491e9 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Request method failure captured: Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 119 Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG_og9sy4zFUb-MiDH9w4IuCt9cx-f74eiSvq3lfar7D_qIgzUSJSbTUJmLq7SPn8sGZ6zwy37op9mewWJF5MycsyWrFax73MAufbmw1xt4lIMKvyrcwJ3KT37eku1zn_7ohydZcNm3XU3RwIdB2Pbzi4RjraEehCgOcsl00z_exLtc Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_341e1ec8b5b84ca6a09ca39bfe45d1e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 37812974b00a4ba5bd4dbf15661b8e57 Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1924348405", "metadata": {"Type": "work"}}} Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1924348405', 'metadata': {'Type': 'work'}}}} Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi '' Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:07:21.307005 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4448b3a3-8887-4571-b2e6-07fd213491e9 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:21.312318 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4448b3a3-8887-4571-b2e6-07fd213491e9 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027991 Sep 10 11:07:21.314458 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1382/5083] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Sep 10 11:07:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:07:21.325850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-35e19ba0-7870-4e54-8cde-f62a5f690848 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Calling method '.version_select at 0x7efcb2c0f9d0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:21.374449 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-35e19ba0-7870-4e54-8cde-f62a5f690848 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] HTTP exception thrown: Volume tempest-invalid-1697710836 could not be found. Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-35e19ba0-7870-4e54-8cde-f62a5f690848 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Request method failure captured: Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1697710836 HTTP/1.1 Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG_og9sy4zFUb-MiDH9w4IuCt9cx-f74eiSvq3lfar7D_qIgzUSJSbTUJmLq7SPn8sGZ6zwy37op9mewWJF5MycsyWrFax73MAufbmw1xt4lIMKvyrcwJ3KT37eku1zn_7ohydZcNm3XU3RwIdB2Pbzi4RjraEehCgOcsl00z_exLtc Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_341e1ec8b5b84ca6a09ca39bfe45d1e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 37812974b00a4ba5bd4dbf15661b8e57 Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: exception: Volume tempest-invalid-1697710836 could not be found. Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'tempest-invalid-1697710836'} Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1697710836 could not be found. (HTTP 404) (Request-ID: req-99c5da47-c7f5-4019-b74d-442df1af0b8b) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:07:21.379373 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1697710836 could not be found. Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1697710836 could not be found. Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1697710836 could not be found. Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-35e19ba0-7870-4e54-8cde-f62a5f690848 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Returning 404 to user: Volume tempest-invalid-1697710836 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-35e19ba0-7870-4e54-8cde-f62a5f690848 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1697710836" status: 404 len: 99 microversion: 2.1 time: 0.065276 Sep 10 11:07:21.386707 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1383/5084] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Sep 10 11:07:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1697710836 => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:07:21.396028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-042fb9a8-5830-4867-81ce-27561d67f604 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:21.403516 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6d45216e-88d3-4a5e-9f4d-3413cefa5533 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016194 Sep 10 11:07:21.406795 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-042fb9a8-5830-4867-81ce-27561d67f604 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1248 microversion: 2.1 time: 0.171113 Sep 10 11:07:21.420257 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3702/5085] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:21 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1248 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:21.420708 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1384/5086] 10.222.0.20 () {58 vars in 1140 bytes} [Sat Sep 10 11:07:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 11:07:21.420803 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a96c1ba-0a7f-47b8-a599-b6ec560003e2 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005154 Sep 10 11:07:21.420803 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3703/5087] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Sep 10 11:07:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 11:07:21.459674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d3093ea-4acf-4e38-ae96-00118174257f tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Calling method '.version_select at 0x7efcadd80f70>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:21.520783 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-2d3093ea-4acf-4e38-ae96-00118174257f tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] HTTP exception thrown: Volume 11cf2ac5-7bf1-4c03-a394-67acb1ca2024 could not be found. Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d3093ea-4acf-4e38-ae96-00118174257f tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Request method failure captured: Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/os-volumes/11cf2ac5-7bf1-4c03-a394-67acb1ca2024 HTTP/1.1 Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG_og9sy4zFUb-MiDH9w4IuCt9cx-f74eiSvq3lfar7D_qIgzUSJSbTUJmLq7SPn8sGZ6zwy37op9mewWJF5MycsyWrFax73MAufbmw1xt4lIMKvyrcwJ3KT37eku1zn_7ohydZcNm3XU3RwIdB2Pbzi4RjraEehCgOcsl00z_exLtc Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_341e1ec8b5b84ca6a09ca39bfe45d1e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 37812974b00a4ba5bd4dbf15661b8e57 Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: method: Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: exception: Volume 11cf2ac5-7bf1-4c03-a394-67acb1ca2024 could not be found. Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '11cf2ac5-7bf1-4c03-a394-67acb1ca2024'} Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11cf2ac5-7bf1-4c03-a394-67acb1ca2024 could not be found. (HTTP 404) (Request-ID: req-d5a8527a-fe9d-4453-81fb-a1ecdbde093f) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:07:21.522781 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11cf2ac5-7bf1-4c03-a394-67acb1ca2024 could not be found. Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11cf2ac5-7bf1-4c03-a394-67acb1ca2024 could not be found. Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11cf2ac5-7bf1-4c03-a394-67acb1ca2024 could not be found. Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d3093ea-4acf-4e38-ae96-00118174257f tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Returning 404 to user: Volume 11cf2ac5-7bf1-4c03-a394-67acb1ca2024 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d3093ea-4acf-4e38-ae96-00118174257f tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/11cf2ac5-7bf1-4c03-a394-67acb1ca2024" status: 404 len: 109 microversion: 2.1 time: 0.100764 Sep 10 11:07:21.529177 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1385/5088] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 11:07:21 2022] DELETE /compute/v2.1/os-volumes/11cf2ac5-7bf1-4c03-a394-67acb1ca2024 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:07:21.534923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52122792-b104-474d-8e9f-93070b23c4f8 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Calling method '.version_select at 0x7efcad297430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:21.580738 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-52122792-b104-474d-8e9f-93070b23c4f8 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] HTTP exception thrown: Volume cf06fba8-72ac-4625-bf80-74882602a74d could not be found. Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52122792-b104-474d-8e9f-93070b23c4f8 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Request method failure captured: Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/os-volumes/cf06fba8-72ac-4625-bf80-74882602a74d HTTP/1.1 Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG_og9sy4zFUb-MiDH9w4IuCt9cx-f74eiSvq3lfar7D_qIgzUSJSbTUJmLq7SPn8sGZ6zwy37op9mewWJF5MycsyWrFax73MAufbmw1xt4lIMKvyrcwJ3KT37eku1zn_7ohydZcNm3XU3RwIdB2Pbzi4RjraEehCgOcsl00z_exLtc Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/341e1ec8b5b84ca6a09ca39bfe45d1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_341e1ec8b5b84ca6a09ca39bfe45d1e0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 341e1ec8b5b84ca6a09ca39bfe45d1e0 Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesNegativeTest-1074674174 Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 37812974b00a4ba5bd4dbf15661b8e57 Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesNegativeTest-1074674174-project Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: method: Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: exception: Volume cf06fba8-72ac-4625-bf80-74882602a74d could not be found. Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'cf06fba8-72ac-4625-bf80-74882602a74d'} Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cf06fba8-72ac-4625-bf80-74882602a74d could not be found. (HTTP 404) (Request-ID: req-d8d344be-65e5-41ab-aee1-7b4576f89169) Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:07:21.583255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cf06fba8-72ac-4625-bf80-74882602a74d could not be found. Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cf06fba8-72ac-4625-bf80-74882602a74d could not be found. Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cf06fba8-72ac-4625-bf80-74882602a74d could not be found. Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-52122792-b104-474d-8e9f-93070b23c4f8 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] Returning 404 to user: Volume cf06fba8-72ac-4625-bf80-74882602a74d could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-52122792-b104-474d-8e9f-93070b23c4f8 tempest-VolumesNegativeTest-1074674174 tempest-VolumesNegativeTest-1074674174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cf06fba8-72ac-4625-bf80-74882602a74d" status: 404 len: 109 microversion: 2.1 time: 0.055541 Sep 10 11:07:21.587761 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3704/5089] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Sep 10 11:07:21 2022] GET /compute/v2.1/os-volumes/cf06fba8-72ac-4625-bf80-74882602a74d => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:07:21.726383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-89a07048-a583-4004-aa69-bc2d28c99e89 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:21.727679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-89a07048-a583-4004-aa69-bc2d28c99e89 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:21.736530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89a07048-a583-4004-aa69-bc2d28c99e89 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:21.738015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89a07048-a583-4004-aa69-bc2d28c99e89 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:21.738464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89a07048-a583-4004-aa69-bc2d28c99e89 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:21.739178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89a07048-a583-4004-aa69-bc2d28c99e89 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:21.739660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89a07048-a583-4004-aa69-bc2d28c99e89 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:21.740447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-89a07048-a583-4004-aa69-bc2d28c99e89 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:21.898411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-89a07048-a583-4004-aa69-bc2d28c99e89 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:21.908784 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-89a07048-a583-4004-aa69-bc2d28c99e89 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 0.187044 Sep 10 11:07:21.909401 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1386/5090] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:21 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:22.156177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:22.157548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:22.165241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:22.166059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:22.166727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:22.167716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:22.168399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:22.169088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:22.259134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-536c0fd8-3b9e-4469-ab2f-52833ed20da7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:22.260754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-536c0fd8-3b9e-4469-ab2f-52833ed20da7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:22.270589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-536c0fd8-3b9e-4469-ab2f-52833ed20da7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:22.271439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-536c0fd8-3b9e-4469-ab2f-52833ed20da7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:22.271940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-536c0fd8-3b9e-4469-ab2f-52833ed20da7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:22.272737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-536c0fd8-3b9e-4469-ab2f-52833ed20da7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:22.273729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-536c0fd8-3b9e-4469-ab2f-52833ed20da7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:22.274236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-536c0fd8-3b9e-4469-ab2f-52833ed20da7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:22.371531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-536c0fd8-3b9e-4469-ab2f-52833ed20da7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:22.379936 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-536c0fd8-3b9e-4469-ab2f-52833ed20da7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1238 microversion: 2.1 time: 0.124680 Sep 10 11:07:22.382860 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1387/5091] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:22 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1238 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:22.421472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:22.438038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d810e1b-763c-43ae-bcf3-a74ceb83dfe2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:22.439113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2d810e1b-763c-43ae-bcf3-a74ceb83dfe2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:22.442650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:22.444298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:22.448925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d810e1b-763c-43ae-bcf3-a74ceb83dfe2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:22.449453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d810e1b-763c-43ae-bcf3-a74ceb83dfe2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:22.449895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d810e1b-763c-43ae-bcf3-a74ceb83dfe2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:22.450608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d810e1b-763c-43ae-bcf3-a74ceb83dfe2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:22.451057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d810e1b-763c-43ae-bcf3-a74ceb83dfe2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:22.452045 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d7170fa3-dba8-4cf4-89fe-0be16156222c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1359 microversion: 2.21 time: 0.304742 Sep 10 11:07:22.453338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3705/5092] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:22 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:22.454051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d810e1b-763c-43ae-bcf3-a74ceb83dfe2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:22.557603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d810e1b-763c-43ae-bcf3-a74ceb83dfe2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:22.565430 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d810e1b-763c-43ae-bcf3-a74ceb83dfe2 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1252 microversion: 2.1 time: 0.132984 Sep 10 11:07:22.566016 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1388/5093] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:22 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1252 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:22.932272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5486de79-d8fe-4d9c-86a5-609c230ee09e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:22.932896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5486de79-d8fe-4d9c-86a5-609c230ee09e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:22.939501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5486de79-d8fe-4d9c-86a5-609c230ee09e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:22.939962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5486de79-d8fe-4d9c-86a5-609c230ee09e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:22.940411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5486de79-d8fe-4d9c-86a5-609c230ee09e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:22.941209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5486de79-d8fe-4d9c-86a5-609c230ee09e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:22.941739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5486de79-d8fe-4d9c-86a5-609c230ee09e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:22.942088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5486de79-d8fe-4d9c-86a5-609c230ee09e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:23.188044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5486de79-d8fe-4d9c-86a5-609c230ee09e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:23.196542 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5486de79-d8fe-4d9c-86a5-609c230ee09e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 0.268179 Sep 10 11:07:23.197499 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3706/5094] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:22 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:23.406893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-65a0b807-c12a-4b82-b67c-c004a4fdfb57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:23.408461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-65a0b807-c12a-4b82-b67c-c004a4fdfb57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:23.417579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a0b807-c12a-4b82-b67c-c004a4fdfb57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:23.418929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a0b807-c12a-4b82-b67c-c004a4fdfb57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:23.419559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a0b807-c12a-4b82-b67c-c004a4fdfb57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:23.420521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a0b807-c12a-4b82-b67c-c004a4fdfb57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:23.421876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a0b807-c12a-4b82-b67c-c004a4fdfb57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:23.422695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-65a0b807-c12a-4b82-b67c-c004a4fdfb57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:23.480120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:23.480841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:23.490307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:23.491190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:23.491979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:23.493382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:23.494206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:23.494981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:23.557651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-65a0b807-c12a-4b82-b67c-c004a4fdfb57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:23.571274 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-65a0b807-c12a-4b82-b67c-c004a4fdfb57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1294 microversion: 2.1 time: 0.168835 Sep 10 11:07:23.574424 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1389/5095] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:23 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1294 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:23.591222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-45e4fc10-7db8-4ab7-8add-086966d16f23 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:23.592785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-45e4fc10-7db8-4ab7-8add-086966d16f23 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:23.600888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45e4fc10-7db8-4ab7-8add-086966d16f23 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:23.601386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45e4fc10-7db8-4ab7-8add-086966d16f23 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:23.602610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45e4fc10-7db8-4ab7-8add-086966d16f23 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:23.603509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45e4fc10-7db8-4ab7-8add-086966d16f23 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:23.604134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45e4fc10-7db8-4ab7-8add-086966d16f23 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:23.604895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45e4fc10-7db8-4ab7-8add-086966d16f23 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:23.731410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-45e4fc10-7db8-4ab7-8add-086966d16f23 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:23.744352 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-45e4fc10-7db8-4ab7-8add-086966d16f23 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1244 microversion: 2.1 time: 0.158781 Sep 10 11:07:23.745783 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1390/5096] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:23 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1244 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:23.785808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:23.795560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:23.797109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:23.798301 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6fa95a8d-cf76-4a16-9cd4-060500553a64 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1359 microversion: 2.21 time: 0.323482 Sep 10 11:07:23.798872 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3707/5097] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:23 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1359 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:24.228404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-18fa5461-4aeb-4a02-b904-42ade733b03a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:24.232262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-18fa5461-4aeb-4a02-b904-42ade733b03a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:24.246032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18fa5461-4aeb-4a02-b904-42ade733b03a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:24.246421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18fa5461-4aeb-4a02-b904-42ade733b03a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:24.246863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18fa5461-4aeb-4a02-b904-42ade733b03a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:24.247566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18fa5461-4aeb-4a02-b904-42ade733b03a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:24.248023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18fa5461-4aeb-4a02-b904-42ade733b03a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:24.248451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18fa5461-4aeb-4a02-b904-42ade733b03a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:24.598429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b67ea16a-d28d-4d98-bcc2-1b5a50c15633 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:24.598803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b67ea16a-d28d-4d98-bcc2-1b5a50c15633 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:24.606143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67ea16a-d28d-4d98-bcc2-1b5a50c15633 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:24.607360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67ea16a-d28d-4d98-bcc2-1b5a50c15633 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:24.608028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67ea16a-d28d-4d98-bcc2-1b5a50c15633 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:24.609556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67ea16a-d28d-4d98-bcc2-1b5a50c15633 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:24.610342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67ea16a-d28d-4d98-bcc2-1b5a50c15633 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:24.611057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b67ea16a-d28d-4d98-bcc2-1b5a50c15633 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:24.641212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-18fa5461-4aeb-4a02-b904-42ade733b03a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:24.649735 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-18fa5461-4aeb-4a02-b904-42ade733b03a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 0.431977 Sep 10 11:07:24.650319 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1391/5098] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:24 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:24.710498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b67ea16a-d28d-4d98-bcc2-1b5a50c15633 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:24.719345 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b67ea16a-d28d-4d98-bcc2-1b5a50c15633 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1300 microversion: 2.1 time: 0.125260 Sep 10 11:07:24.719942 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3708/5099] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:24 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:24.768335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8ffeb930-5295-4dd3-a6e1-9926ec165adb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:24.768959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8ffeb930-5295-4dd3-a6e1-9926ec165adb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:24.775864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ffeb930-5295-4dd3-a6e1-9926ec165adb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:24.776064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ffeb930-5295-4dd3-a6e1-9926ec165adb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:24.776506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ffeb930-5295-4dd3-a6e1-9926ec165adb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:24.777265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ffeb930-5295-4dd3-a6e1-9926ec165adb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:24.777905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ffeb930-5295-4dd3-a6e1-9926ec165adb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:24.778301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ffeb930-5295-4dd3-a6e1-9926ec165adb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:24.824296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:24.824909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:24.855969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:24.856471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:24.856931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:24.857740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:24.858198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:24.858620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:24.989664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8ffeb930-5295-4dd3-a6e1-9926ec165adb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:25.002624 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8ffeb930-5295-4dd3-a6e1-9926ec165adb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1300 microversion: 2.1 time: 0.236139 Sep 10 11:07:25.003799 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1392/5100] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:24 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1300 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:25.676904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4276143-f336-4543-9ff4-28445fedee29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:25.677601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b4276143-f336-4543-9ff4-28445fedee29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:25.690149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4276143-f336-4543-9ff4-28445fedee29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:25.691002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4276143-f336-4543-9ff4-28445fedee29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:25.691661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4276143-f336-4543-9ff4-28445fedee29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:25.698640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4276143-f336-4543-9ff4-28445fedee29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:25.699998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4276143-f336-4543-9ff4-28445fedee29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:25.701904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4276143-f336-4543-9ff4-28445fedee29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:25.793941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:25.809440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:25.815156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:25.818120 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74ff8e1b-c9aa-4beb-9cab-c87f5824cd3d tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1359 microversion: 2.21 time: 0.996857 Sep 10 11:07:25.818986 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3709/5101] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:24 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1359 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:07:25.843802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d0bf417a-4eac-4670-a33c-bf225bdcc761 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:25.852543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d0bf417a-4eac-4670-a33c-bf225bdcc761 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:25.867712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0bf417a-4eac-4670-a33c-bf225bdcc761 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:25.868584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0bf417a-4eac-4670-a33c-bf225bdcc761 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:25.869317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0bf417a-4eac-4670-a33c-bf225bdcc761 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:25.870471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0bf417a-4eac-4670-a33c-bf225bdcc761 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:25.871162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0bf417a-4eac-4670-a33c-bf225bdcc761 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:25.871978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d0bf417a-4eac-4670-a33c-bf225bdcc761 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:26.041509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d0bf417a-4eac-4670-a33c-bf225bdcc761 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:26.056288 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d0bf417a-4eac-4670-a33c-bf225bdcc761 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1300 microversion: 2.1 time: 0.235583 Sep 10 11:07:26.057109 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3710/5102] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:25 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1300 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:26.077654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88ef6fc2-4f14-4ecd-9ab9-911819844f11 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:26.078854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88ef6fc2-4f14-4ecd-9ab9-911819844f11 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:26.086450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ef6fc2-4f14-4ecd-9ab9-911819844f11 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:26.087331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ef6fc2-4f14-4ecd-9ab9-911819844f11 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:26.088034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ef6fc2-4f14-4ecd-9ab9-911819844f11 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:26.088911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ef6fc2-4f14-4ecd-9ab9-911819844f11 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:26.089468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ef6fc2-4f14-4ecd-9ab9-911819844f11 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:26.090151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88ef6fc2-4f14-4ecd-9ab9-911819844f11 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:26.241828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b4276143-f336-4543-9ff4-28445fedee29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:26.259942 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b4276143-f336-4543-9ff4-28445fedee29 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 0.588152 Sep 10 11:07:26.266929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88ef6fc2-4f14-4ecd-9ab9-911819844f11 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:26.280533 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1393/5103] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:25 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:26.291864 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88ef6fc2-4f14-4ecd-9ab9-911819844f11 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1306 microversion: 2.1 time: 0.218679 Sep 10 11:07:26.292475 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3711/5104] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:26 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1306 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:26.853490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:26.854292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:26.886274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:26.893205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:26.897932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:26.901344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:26.904485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:26.906158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:27.081825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-46249a96-7f89-415b-bb43-854375eede39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:27.082605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-46249a96-7f89-415b-bb43-854375eede39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:27.101055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46249a96-7f89-415b-bb43-854375eede39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:27.104027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46249a96-7f89-415b-bb43-854375eede39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:27.105985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46249a96-7f89-415b-bb43-854375eede39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:27.109380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46249a96-7f89-415b-bb43-854375eede39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:27.112210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46249a96-7f89-415b-bb43-854375eede39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:27.116582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46249a96-7f89-415b-bb43-854375eede39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:27.450982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:27.490630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:27.498081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:27.508481 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3f3799f4-93a3-413e-a22a-ef7e4c6978ee tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1359 microversion: 2.21 time: 0.657604 Sep 10 11:07:27.509605 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1394/5105] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:26 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1359 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:27.531251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9f342df5-d85b-44df-86d0-3c8c6eb41cbc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:27.531478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-46249a96-7f89-415b-bb43-854375eede39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:27.532502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9f342df5-d85b-44df-86d0-3c8c6eb41cbc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:27.544623 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-46249a96-7f89-415b-bb43-854375eede39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1368 microversion: 2.1 time: 0.468305 Sep 10 11:07:27.545296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f342df5-d85b-44df-86d0-3c8c6eb41cbc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:27.545834 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3712/5106] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:27 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1368 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:27.548156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f342df5-d85b-44df-86d0-3c8c6eb41cbc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:27.548675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f342df5-d85b-44df-86d0-3c8c6eb41cbc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:27.551386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e2b0ddd-48b2-4ead-b6f6-67ed076eee1a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:27.551637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f342df5-d85b-44df-86d0-3c8c6eb41cbc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:27.552126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f342df5-d85b-44df-86d0-3c8c6eb41cbc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:27.552566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f342df5-d85b-44df-86d0-3c8c6eb41cbc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:27.552972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e2b0ddd-48b2-4ead-b6f6-67ed076eee1a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:27.560159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2b0ddd-48b2-4ead-b6f6-67ed076eee1a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:27.560920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2b0ddd-48b2-4ead-b6f6-67ed076eee1a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:27.561610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2b0ddd-48b2-4ead-b6f6-67ed076eee1a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:27.563078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2b0ddd-48b2-4ead-b6f6-67ed076eee1a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:27.563746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2b0ddd-48b2-4ead-b6f6-67ed076eee1a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:27.565090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e2b0ddd-48b2-4ead-b6f6-67ed076eee1a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:28.311619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9f342df5-d85b-44df-86d0-3c8c6eb41cbc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:28.322608 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9f342df5-d85b-44df-86d0-3c8c6eb41cbc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 0.809150 Sep 10 11:07:28.323849 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1395/5107] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:27 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:28.329828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-eed582c8-b8cb-43f3-917d-6a4c8ea343d9 req-58d25056-213a-4364-83aa-a8fb724dcb37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa", "name": "network-vif-plugged", "status": "completed", "tag": "4bf58c4b-90bf-450e-bf68-60444eb9c012"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:28.343321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eed582c8-b8cb-43f3-917d-6a4c8ea343d9 req-58d25056-213a-4364-83aa-a8fb724dcb37 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:28.343722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eed582c8-b8cb-43f3-917d-6a4c8ea343d9 req-58d25056-213a-4364-83aa-a8fb724dcb37 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:28.344477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eed582c8-b8cb-43f3-917d-6a4c8ea343d9 req-58d25056-213a-4364-83aa-a8fb724dcb37 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:28.352750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e2b0ddd-48b2-4ead-b6f6-67ed076eee1a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:28.369746 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e2b0ddd-48b2-4ead-b6f6-67ed076eee1a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1374 microversion: 2.1 time: 0.821233 Sep 10 11:07:28.371910 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3713/5108] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:27 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1374 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:28.374510 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-eed582c8-b8cb-43f3-917d-6a4c8ea343d9 req-58d25056-213a-4364-83aa-a8fb724dcb37 service nova] Creating event network-vif-plugged:4bf58c4b-90bf-450e-bf68-60444eb9c012 for instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa on n-h2-856894-1 Sep 10 11:07:28.392246 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-eed582c8-b8cb-43f3-917d-6a4c8ea343d9 req-58d25056-213a-4364-83aa-a8fb724dcb37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060164 Sep 10 11:07:28.396860 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1396/5109] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:28.535455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:28.536377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:28.545597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:28.546290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:28.546917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:28.547808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:28.548760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:28.549383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:28.569582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ed115eb-c819-4410-af85-77130e932034 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:28.570292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ed115eb-c819-4410-af85-77130e932034 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:28.582552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ed115eb-c819-4410-af85-77130e932034 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:28.583474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ed115eb-c819-4410-af85-77130e932034 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:28.584917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ed115eb-c819-4410-af85-77130e932034 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:28.588169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ed115eb-c819-4410-af85-77130e932034 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:28.588958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ed115eb-c819-4410-af85-77130e932034 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:28.592662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ed115eb-c819-4410-af85-77130e932034 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:29.086255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:29.103022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ed115eb-c819-4410-af85-77130e932034 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:29.137676 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ed115eb-c819-4410-af85-77130e932034 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1368 microversion: 2.1 time: 0.572114 Sep 10 11:07:29.139615 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1397/5110] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:28 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1368 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:29.141837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:29.143649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:29.145057 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3745b9a0-fd14-4f4b-9a35-903e0ffed3d8 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1359 microversion: 2.21 time: 0.614171 Sep 10 11:07:29.146207 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3714/5111] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:28 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1359 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:29.316394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-670ece96-1793-4795-bfce-8a9f0899639a req-494fb9a3-dfcb-4d39-95b0-9eb3ae9ef266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a7ff1d-6a10-433b-810e-83327d6b6aa7", "tag": "44d576eb-9280-4f38-963e-4a571dbf2835"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:29.349528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a811a9d8-3a32-40e1-b228-6a4fcf4a6fb6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:29.350346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a811a9d8-3a32-40e1-b228-6a4fcf4a6fb6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:29.362109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-670ece96-1793-4795-bfce-8a9f0899639a req-494fb9a3-dfcb-4d39-95b0-9eb3ae9ef266 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:29.366231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a811a9d8-3a32-40e1-b228-6a4fcf4a6fb6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:29.366805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a811a9d8-3a32-40e1-b228-6a4fcf4a6fb6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:29.367967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a811a9d8-3a32-40e1-b228-6a4fcf4a6fb6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:29.369539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-670ece96-1793-4795-bfce-8a9f0899639a req-494fb9a3-dfcb-4d39-95b0-9eb3ae9ef266 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:29.370332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a811a9d8-3a32-40e1-b228-6a4fcf4a6fb6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:29.370850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-670ece96-1793-4795-bfce-8a9f0899639a req-494fb9a3-dfcb-4d39-95b0-9eb3ae9ef266 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:29.373467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a811a9d8-3a32-40e1-b228-6a4fcf4a6fb6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:29.374021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a811a9d8-3a32-40e1-b228-6a4fcf4a6fb6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:29.403240 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-670ece96-1793-4795-bfce-8a9f0899639a req-494fb9a3-dfcb-4d39-95b0-9eb3ae9ef266 service nova] Creating event network-changed:44d576eb-9280-4f38-963e-4a571dbf2835 for instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 on n-h2-856894-1 Sep 10 11:07:29.414349 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-670ece96-1793-4795-bfce-8a9f0899639a req-494fb9a3-dfcb-4d39-95b0-9eb3ae9ef266 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101454 Sep 10 11:07:29.416150 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1398/5112] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:07:29.421543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7270024f-2ff9-4b80-9878-b8ffef990c7a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:29.422552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7270024f-2ff9-4b80-9878-b8ffef990c7a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:29.430736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7270024f-2ff9-4b80-9878-b8ffef990c7a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:29.431549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7270024f-2ff9-4b80-9878-b8ffef990c7a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:29.432232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7270024f-2ff9-4b80-9878-b8ffef990c7a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:29.433191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7270024f-2ff9-4b80-9878-b8ffef990c7a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:29.433884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7270024f-2ff9-4b80-9878-b8ffef990c7a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:29.434565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7270024f-2ff9-4b80-9878-b8ffef990c7a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:29.787037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a811a9d8-3a32-40e1-b228-6a4fcf4a6fb6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:29.796984 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a811a9d8-3a32-40e1-b228-6a4fcf4a6fb6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 0.451452 Sep 10 11:07:29.797962 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3715/5113] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:29 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:29.848947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7270024f-2ff9-4b80-9878-b8ffef990c7a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:29.858248 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7270024f-2ff9-4b80-9878-b8ffef990c7a tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1374 microversion: 2.1 time: 0.440611 Sep 10 11:07:29.859160 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1399/5114] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:29 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1374 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:30.167411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f659dce9-cb14-42ae-82ca-f5bccaa1fa04 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:30.175850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:30.176767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:30.178343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f659dce9-cb14-42ae-82ca-f5bccaa1fa04 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:30.196366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:30.200477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:30.203276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:30.203868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f659dce9-cb14-42ae-82ca-f5bccaa1fa04 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:30.205888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:30.207022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f659dce9-cb14-42ae-82ca-f5bccaa1fa04 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:30.207860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:30.208330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:30.208844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f659dce9-cb14-42ae-82ca-f5bccaa1fa04 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:30.214151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f659dce9-cb14-42ae-82ca-f5bccaa1fa04 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:30.214697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f659dce9-cb14-42ae-82ca-f5bccaa1fa04 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:30.215149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f659dce9-cb14-42ae-82ca-f5bccaa1fa04 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:30.219607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:30.242189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:30.276077 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=14 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:30.673002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:31.005690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:31.014447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:31.016235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:31.017740 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6e645a09-03be-4ad3-a6aa-a591ba403d60 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1553 microversion: 2.21 time: 0.848045 Sep 10 11:07:31.018874 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1400/5115] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:30 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1553 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:31.025714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-e1c45f92-8b57-4bbd-9379-31e081942dd5 req-11738ff9-13e1-4a34-81f4-61a056ec8a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372a7f3b-98aa-471d-8eb2-a739d5816300", "name": "network-vif-plugged", "status": "completed", "tag": "b8aa0119-058f-4555-b17b-68e33baf5f6c"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:31.049404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e1c45f92-8b57-4bbd-9379-31e081942dd5 req-11738ff9-13e1-4a34-81f4-61a056ec8a6c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:31.051485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e1c45f92-8b57-4bbd-9379-31e081942dd5 req-11738ff9-13e1-4a34-81f4-61a056ec8a6c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:31.052177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e1c45f92-8b57-4bbd-9379-31e081942dd5 req-11738ff9-13e1-4a34-81f4-61a056ec8a6c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:31.057774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f659dce9-cb14-42ae-82ca-f5bccaa1fa04 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:31.070402 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f659dce9-cb14-42ae-82ca-f5bccaa1fa04 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1368 microversion: 2.1 time: 0.910365 Sep 10 11:07:31.071358 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3716/5116] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:30 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1368 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:31.081487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be519c8b-8081-4487-bf32-9c378035978a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:31.083775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be519c8b-8081-4487-bf32-9c378035978a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:31.090207 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-e1c45f92-8b57-4bbd-9379-31e081942dd5 req-11738ff9-13e1-4a34-81f4-61a056ec8a6c service nova] Creating event network-vif-plugged:b8aa0119-058f-4555-b17b-68e33baf5f6c for instance 372a7f3b-98aa-471d-8eb2-a739d5816300 on n-h2-856894-1 Sep 10 11:07:31.098442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be519c8b-8081-4487-bf32-9c378035978a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:31.098943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be519c8b-8081-4487-bf32-9c378035978a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:31.099384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be519c8b-8081-4487-bf32-9c378035978a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:31.100091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be519c8b-8081-4487-bf32-9c378035978a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:31.100545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be519c8b-8081-4487-bf32-9c378035978a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:31.100968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be519c8b-8081-4487-bf32-9c378035978a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:31.118615 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-e1c45f92-8b57-4bbd-9379-31e081942dd5 req-11738ff9-13e1-4a34-81f4-61a056ec8a6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098136 Sep 10 11:07:31.123203 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1401/5117] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:31.145521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0ca77eab-d9ed-4cb5-b8c4-96e333760aed tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:31.147156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0ca77eab-d9ed-4cb5-b8c4-96e333760aed tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:31.173812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ca77eab-d9ed-4cb5-b8c4-96e333760aed tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:31.174516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ca77eab-d9ed-4cb5-b8c4-96e333760aed tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:31.175885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ca77eab-d9ed-4cb5-b8c4-96e333760aed tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:31.177293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ca77eab-d9ed-4cb5-b8c4-96e333760aed tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:31.186385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ca77eab-d9ed-4cb5-b8c4-96e333760aed tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:31.187082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0ca77eab-d9ed-4cb5-b8c4-96e333760aed tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:31.192044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:31.401855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=24 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:31.630579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be519c8b-8081-4487-bf32-9c378035978a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:31.643997 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be519c8b-8081-4487-bf32-9c378035978a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 0.565558 Sep 10 11:07:31.644861 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3717/5118] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:31 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:31.650720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be066a76-a017-486a-880f-79ecde3c9a41 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:31.651562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be066a76-a017-486a-880f-79ecde3c9a41 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:31.662954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be066a76-a017-486a-880f-79ecde3c9a41 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:31.664467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be066a76-a017-486a-880f-79ecde3c9a41 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:31.665416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be066a76-a017-486a-880f-79ecde3c9a41 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:31.667953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be066a76-a017-486a-880f-79ecde3c9a41 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:31.669392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be066a76-a017-486a-880f-79ecde3c9a41 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:31.670503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be066a76-a017-486a-880f-79ecde3c9a41 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:31.702256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0ca77eab-d9ed-4cb5-b8c4-96e333760aed tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:31.715015 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0ca77eab-d9ed-4cb5-b8c4-96e333760aed tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1374 microversion: 2.1 time: 0.589425 Sep 10 11:07:31.716188 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1402/5119] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:31 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1374 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:31.735331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be066a76-a017-486a-880f-79ecde3c9a41 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:07:31.739324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-56d533f8-c2a7-44b1-98a8-fb6b364506af req-b01ee7ee-f396-4ab1-97bf-6ba199412358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a767d108-b969-487e-baf9-c8f14e5a7746", "tag": "c0a2123b-8ff7-4eaa-b49d-0f7a862da857"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:31.740734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:31.765551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-56d533f8-c2a7-44b1-98a8-fb6b364506af req-b01ee7ee-f396-4ab1-97bf-6ba199412358 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:31.768122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-56d533f8-c2a7-44b1-98a8-fb6b364506af req-b01ee7ee-f396-4ab1-97bf-6ba199412358 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:31.770227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-56d533f8-c2a7-44b1-98a8-fb6b364506af req-b01ee7ee-f396-4ab1-97bf-6ba199412358 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:31.796924 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-56d533f8-c2a7-44b1-98a8-fb6b364506af req-b01ee7ee-f396-4ab1-97bf-6ba199412358 service nova] Creating event network-changed:c0a2123b-8ff7-4eaa-b49d-0f7a862da857 for instance a767d108-b969-487e-baf9-c8f14e5a7746 on n-h2-856894-1 Sep 10 11:07:31.811133 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-56d533f8-c2a7-44b1-98a8-fb6b364506af req-b01ee7ee-f396-4ab1-97bf-6ba199412358 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093469 Sep 10 11:07:31.811863 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1403/5120] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:31.900155 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be066a76-a017-486a-880f-79ecde3c9a41 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 204 len: 0 microversion: 2.21 time: 0.252212 Sep 10 11:07:31.902370 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3718/5121] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 11:07:31 2022] DELETE /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:07:31.911449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:31.912249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:31.922400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:31.923804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:31.924333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:31.925149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:31.925844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:31.926633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:32.096651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74c85a06-0257-4a5b-bd01-cbd2e2f5c96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:32.097567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74c85a06-0257-4a5b-bd01-cbd2e2f5c96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:32.104920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74c85a06-0257-4a5b-bd01-cbd2e2f5c96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:32.105902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74c85a06-0257-4a5b-bd01-cbd2e2f5c96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:32.106587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74c85a06-0257-4a5b-bd01-cbd2e2f5c96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:32.106909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:32.107645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74c85a06-0257-4a5b-bd01-cbd2e2f5c96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:32.108205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74c85a06-0257-4a5b-bd01-cbd2e2f5c96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:32.108731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74c85a06-0257-4a5b-bd01-cbd2e2f5c96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:32.116119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:32.118805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:32.120494 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5a16b849-e32d-4fc6-923d-ccd7b84e0137 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1559 microversion: 2.21 time: 0.213751 Sep 10 11:07:32.121578 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1404/5122] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:31 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:32.263863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74c85a06-0257-4a5b-bd01-cbd2e2f5c96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:32.271956 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74c85a06-0257-4a5b-bd01-cbd2e2f5c96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1368 microversion: 2.1 time: 0.179835 Sep 10 11:07:32.272691 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3719/5123] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:32 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:32.675614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f05218cc-1f17-4eeb-b443-145a7c9461f8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:32.676312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f05218cc-1f17-4eeb-b443-145a7c9461f8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:32.684980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f05218cc-1f17-4eeb-b443-145a7c9461f8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:32.685946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f05218cc-1f17-4eeb-b443-145a7c9461f8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:32.686703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f05218cc-1f17-4eeb-b443-145a7c9461f8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:32.687778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f05218cc-1f17-4eeb-b443-145a7c9461f8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:32.688338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f05218cc-1f17-4eeb-b443-145a7c9461f8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:32.688897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f05218cc-1f17-4eeb-b443-145a7c9461f8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:32.739734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23d03787-d353-4176-a8b6-fa11dd7405eb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:32.740759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23d03787-d353-4176-a8b6-fa11dd7405eb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:32.753126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d03787-d353-4176-a8b6-fa11dd7405eb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:32.753126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d03787-d353-4176-a8b6-fa11dd7405eb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:32.753126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d03787-d353-4176-a8b6-fa11dd7405eb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:32.753126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d03787-d353-4176-a8b6-fa11dd7405eb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:32.753126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d03787-d353-4176-a8b6-fa11dd7405eb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:32.753573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23d03787-d353-4176-a8b6-fa11dd7405eb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:32.941272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f05218cc-1f17-4eeb-b443-145a7c9461f8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:32.959288 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f05218cc-1f17-4eeb-b443-145a7c9461f8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 0.288829 Sep 10 11:07:32.964582 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1405/5124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:32 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:32.983598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23d03787-d353-4176-a8b6-fa11dd7405eb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:32.996181 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23d03787-d353-4176-a8b6-fa11dd7405eb tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1374 microversion: 2.1 time: 0.260180 Sep 10 11:07:32.997260 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3720/5125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:32 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1374 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:33.147413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:33.149480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:33.156398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:33.156893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:33.157379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:33.158384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:33.158846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:33.159279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:33.297318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02738bab-e418-4816-880f-8a9573d5f8cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:33.297975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02738bab-e418-4816-880f-8a9573d5f8cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:33.306720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02738bab-e418-4816-880f-8a9573d5f8cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:33.307211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02738bab-e418-4816-880f-8a9573d5f8cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:33.307660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02738bab-e418-4816-880f-8a9573d5f8cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:33.308367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02738bab-e418-4816-880f-8a9573d5f8cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:33.308903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02738bab-e418-4816-880f-8a9573d5f8cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:33.309355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02738bab-e418-4816-880f-8a9573d5f8cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:33.329228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:33.341664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:33.343786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:33.345798 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-857bc8a9-046b-4bcd-a536-83b15a73404c tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1559 microversion: 2.21 time: 0.202156 Sep 10 11:07:33.361108 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1406/5126] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:33 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:33.481196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02738bab-e418-4816-880f-8a9573d5f8cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:33.489994 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02738bab-e418-4816-880f-8a9573d5f8cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1368 microversion: 2.1 time: 0.197516 Sep 10 11:07:33.490793 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3721/5127] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:33 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:33.986508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fbd7108d-1711-4615-a37f-2c6837e839c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:33.987054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fbd7108d-1711-4615-a37f-2c6837e839c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:33.993850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbd7108d-1711-4615-a37f-2c6837e839c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:33.994346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbd7108d-1711-4615-a37f-2c6837e839c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:33.994782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbd7108d-1711-4615-a37f-2c6837e839c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:33.995613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbd7108d-1711-4615-a37f-2c6837e839c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:33.996326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbd7108d-1711-4615-a37f-2c6837e839c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:33.996854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbd7108d-1711-4615-a37f-2c6837e839c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:34.021780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e67ebd5a-7203-485e-9e92-2f4bd58495dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:34.022900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e67ebd5a-7203-485e-9e92-2f4bd58495dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:34.032417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:34.034847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e67ebd5a-7203-485e-9e92-2f4bd58495dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:34.036182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e67ebd5a-7203-485e-9e92-2f4bd58495dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:34.036859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e67ebd5a-7203-485e-9e92-2f4bd58495dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:34.037686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e67ebd5a-7203-485e-9e92-2f4bd58495dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:34.038258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e67ebd5a-7203-485e-9e92-2f4bd58495dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:34.038764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e67ebd5a-7203-485e-9e92-2f4bd58495dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:34.206431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fbd7108d-1711-4615-a37f-2c6837e839c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:34.223157 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fbd7108d-1711-4615-a37f-2c6837e839c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1217 microversion: 2.1 time: 0.240424 Sep 10 11:07:34.237042 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1407/5128] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:33 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1217 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:34.249873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e67ebd5a-7203-485e-9e92-2f4bd58495dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:34.273443 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e67ebd5a-7203-485e-9e92-2f4bd58495dc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1374 microversion: 2.1 time: 0.250067 Sep 10 11:07:34.275025 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3722/5129] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:34 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1374 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:34.373447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:34.374070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:34.381600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:34.381600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:34.381954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:34.382704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:34.383718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:34.384142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:34.515292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3216fe64-1559-41a1-82a9-f7a8acd4dbb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:34.516443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3216fe64-1559-41a1-82a9-f7a8acd4dbb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:34.525733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3216fe64-1559-41a1-82a9-f7a8acd4dbb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:34.526989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3216fe64-1559-41a1-82a9-f7a8acd4dbb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:34.527621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3216fe64-1559-41a1-82a9-f7a8acd4dbb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:34.528526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3216fe64-1559-41a1-82a9-f7a8acd4dbb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:34.529225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3216fe64-1559-41a1-82a9-f7a8acd4dbb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:34.529816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3216fe64-1559-41a1-82a9-f7a8acd4dbb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:34.554143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:34.566149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:34.568378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:34.569911 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ce59fac8-5148-4da9-b6bc-4e88587c3b11 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1559 microversion: 2.21 time: 0.200299 Sep 10 11:07:34.571270 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1408/5130] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:34 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:34.709303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3216fe64-1559-41a1-82a9-f7a8acd4dbb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:34.719510 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3216fe64-1559-41a1-82a9-f7a8acd4dbb1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1368 microversion: 2.1 time: 0.208245 Sep 10 11:07:34.720278 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3723/5131] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:34 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:35.249465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-27a0a680-f463-4be8-9e9a-87865bddf9ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:35.251383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-27a0a680-f463-4be8-9e9a-87865bddf9ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:35.264474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a0a680-f463-4be8-9e9a-87865bddf9ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:35.264855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a0a680-f463-4be8-9e9a-87865bddf9ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:35.265317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a0a680-f463-4be8-9e9a-87865bddf9ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:35.266027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a0a680-f463-4be8-9e9a-87865bddf9ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:35.266482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a0a680-f463-4be8-9e9a-87865bddf9ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:35.266904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27a0a680-f463-4be8-9e9a-87865bddf9ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:35.300698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23ccac84-0098-4ca7-9c5a-3dbc9c5270ae tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:35.302963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23ccac84-0098-4ca7-9c5a-3dbc9c5270ae tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:35.315469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23ccac84-0098-4ca7-9c5a-3dbc9c5270ae tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:35.319513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23ccac84-0098-4ca7-9c5a-3dbc9c5270ae tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:35.320042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23ccac84-0098-4ca7-9c5a-3dbc9c5270ae tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:35.321030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23ccac84-0098-4ca7-9c5a-3dbc9c5270ae tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:35.323018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23ccac84-0098-4ca7-9c5a-3dbc9c5270ae tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:35.323454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23ccac84-0098-4ca7-9c5a-3dbc9c5270ae tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:35.793300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23ccac84-0098-4ca7-9c5a-3dbc9c5270ae tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:35.802262 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23ccac84-0098-4ca7-9c5a-3dbc9c5270ae tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1374 microversion: 2.1 time: 0.505807 Sep 10 11:07:35.803531 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3724/5132] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:35 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1374 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:35.813735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:35.814682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:35.823402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:35.824172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:35.824800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:35.825717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:35.826644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:35.828133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:35.868213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-27a0a680-f463-4be8-9e9a-87865bddf9ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:35.878619 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-27a0a680-f463-4be8-9e9a-87865bddf9ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1405 microversion: 2.1 time: 0.633204 Sep 10 11:07:35.879994 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1409/5133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:35 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1405 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:35.886456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6e157316-cbfc-4ae1-9763-223274738ed1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:35.887546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6e157316-cbfc-4ae1-9763-223274738ed1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:35.897121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e157316-cbfc-4ae1-9763-223274738ed1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:35.899388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e157316-cbfc-4ae1-9763-223274738ed1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:35.900956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e157316-cbfc-4ae1-9763-223274738ed1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:35.901989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e157316-cbfc-4ae1-9763-223274738ed1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:35.902679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e157316-cbfc-4ae1-9763-223274738ed1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:35.903361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e157316-cbfc-4ae1-9763-223274738ed1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:36.238350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:36.252219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:36.254661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:36.255958 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab58f091-41a8-48ae-9c5f-d09cfc7f5ae6 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1559 microversion: 2.21 time: 0.450830 Sep 10 11:07:36.261778 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3725/5134] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:35 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1559 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:36.266946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-440efbe6-bf8d-4a34-baf5-1b507363f7cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:36.267700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-440efbe6-bf8d-4a34-baf5-1b507363f7cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:36.277235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440efbe6-bf8d-4a34-baf5-1b507363f7cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:36.277742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440efbe6-bf8d-4a34-baf5-1b507363f7cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:36.278188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440efbe6-bf8d-4a34-baf5-1b507363f7cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:36.279041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440efbe6-bf8d-4a34-baf5-1b507363f7cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:36.279679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440efbe6-bf8d-4a34-baf5-1b507363f7cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:36.280039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440efbe6-bf8d-4a34-baf5-1b507363f7cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:36.314183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6e157316-cbfc-4ae1-9763-223274738ed1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:36.323362 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6e157316-cbfc-4ae1-9763-223274738ed1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1368 microversion: 2.1 time: 0.441854 Sep 10 11:07:36.329056 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1410/5135] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:35 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1368 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:36.827284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-77a9bfae-e907-48cd-8c11-1aadccd25044 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:36.827883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-77a9bfae-e907-48cd-8c11-1aadccd25044 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:36.835371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77a9bfae-e907-48cd-8c11-1aadccd25044 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:36.835937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77a9bfae-e907-48cd-8c11-1aadccd25044 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:36.836891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77a9bfae-e907-48cd-8c11-1aadccd25044 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:36.846653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77a9bfae-e907-48cd-8c11-1aadccd25044 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:36.847153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77a9bfae-e907-48cd-8c11-1aadccd25044 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:36.847607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77a9bfae-e907-48cd-8c11-1aadccd25044 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:36.941104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-440efbe6-bf8d-4a34-baf5-1b507363f7cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:36.942643 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-440efbe6-bf8d-4a34-baf5-1b507363f7cd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1405 microversion: 2.1 time: 0.679528 Sep 10 11:07:36.943920 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3726/5136] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:36 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1405 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:36.967357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-114747867"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:36.970106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:36.977309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:36.978034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:36.978675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:36.979386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:36.979850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:36.980338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:37.164171 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.compute.api [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Attempting to quiesce instance before volume snapshot. Sep 10 11:07:37.175774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-77a9bfae-e907-48cd-8c11-1aadccd25044 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:37.187292 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-77a9bfae-e907-48cd-8c11-1aadccd25044 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1374 microversion: 2.1 time: 0.364056 Sep 10 11:07:37.189337 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1411/5137] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:36 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1374 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:37.202630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-8699bc2a-8fcf-486f-89a3-ddcda8a3ea79 req-457ca4ed-b847-43b1-9642-1fb6e13f48c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa", "name": "network-vif-deleted", "tag": "4bf58c4b-90bf-450e-bf68-60444eb9c012"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:37.222528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8699bc2a-8fcf-486f-89a3-ddcda8a3ea79 req-457ca4ed-b847-43b1-9642-1fb6e13f48c6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:37.223326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8699bc2a-8fcf-486f-89a3-ddcda8a3ea79 req-457ca4ed-b847-43b1-9642-1fb6e13f48c6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:37.223924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8699bc2a-8fcf-486f-89a3-ddcda8a3ea79 req-457ca4ed-b847-43b1-9642-1fb6e13f48c6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:37.229440 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.compute.api [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 10 11:07:37.238610 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-8699bc2a-8fcf-486f-89a3-ddcda8a3ea79 req-457ca4ed-b847-43b1-9642-1fb6e13f48c6 service nova] Creating event network-vif-deleted:4bf58c4b-90bf-450e-bf68-60444eb9c012 for instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa on n-h2-856894-1 Sep 10 11:07:37.245841 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-8699bc2a-8fcf-486f-89a3-ddcda8a3ea79 req-457ca4ed-b847-43b1-9642-1fb6e13f48c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048942 Sep 10 11:07:37.247071 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1412/5138] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:37.297979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:37.301209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:37.320487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:37.322024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:37.323876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:37.324791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:37.326737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:37.330214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:37.394819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Creating snapshot from volume 9dd33cb4-aceb-4700-9807-b42f6a5ba624. {{(pid=128788) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 10 11:07:37.467047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:37.483572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:37.485723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d956ae1b6334614ae7bc4c8a1df669c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e7d4b2c1904bc6b30fdaf28a57a277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:37.487181 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-55b90dce-13ae-4769-8a12-1d0a18e996cb tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 200 len: 1344 microversion: 2.21 time: 0.202337 Sep 10 11:07:37.488634 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1413/5139] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:37 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 1344 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:07:37.493755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-01e98cc7-a69d-4070-8232-7361c3952cf4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:37.494690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-01e98cc7-a69d-4070-8232-7361c3952cf4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:37.503937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01e98cc7-a69d-4070-8232-7361c3952cf4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:37.505118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01e98cc7-a69d-4070-8232-7361c3952cf4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:37.505909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01e98cc7-a69d-4070-8232-7361c3952cf4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:37.506994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01e98cc7-a69d-4070-8232-7361c3952cf4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:37.507639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01e98cc7-a69d-4070-8232-7361c3952cf4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:37.509225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01e98cc7-a69d-4070-8232-7361c3952cf4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:37.840766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-01e98cc7-a69d-4070-8232-7361c3952cf4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:37.849775 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-01e98cc7-a69d-4070-8232-7361c3952cf4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1368 microversion: 2.1 time: 0.359773 Sep 10 11:07:37.850383 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1414/5140] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:37 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1368 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:37.868447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-5c6aee52-129a-4c50-937c-12d2f39570bc req-895cd8ad-03bd-4e97-8c40-aeb1e076f354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a767d108-b969-487e-baf9-c8f14e5a7746", "name": "network-vif-plugged", "status": "completed", "tag": "c0a2123b-8ff7-4eaa-b49d-0f7a862da857"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:37.900680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5c6aee52-129a-4c50-937c-12d2f39570bc req-895cd8ad-03bd-4e97-8c40-aeb1e076f354 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:37.901460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5c6aee52-129a-4c50-937c-12d2f39570bc req-895cd8ad-03bd-4e97-8c40-aeb1e076f354 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:37.902068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5c6aee52-129a-4c50-937c-12d2f39570bc req-895cd8ad-03bd-4e97-8c40-aeb1e076f354 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:37.939823 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-5c6aee52-129a-4c50-937c-12d2f39570bc req-895cd8ad-03bd-4e97-8c40-aeb1e076f354 service nova] Creating event network-vif-plugged:c0a2123b-8ff7-4eaa-b49d-0f7a862da857 for instance a767d108-b969-487e-baf9-c8f14e5a7746 on n-h2-856894-1 Sep 10 11:07:37.947308 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-5c6aee52-129a-4c50-937c-12d2f39570bc req-895cd8ad-03bd-4e97-8c40-aeb1e076f354 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095312 Sep 10 11:07:37.949585 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1415/5141] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:38.215709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a15e2e7b-e566-48b2-8fd4-942179066553 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:38.216802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a15e2e7b-e566-48b2-8fd4-942179066553 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:38.229970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a15e2e7b-e566-48b2-8fd4-942179066553 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.230923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a15e2e7b-e566-48b2-8fd4-942179066553 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.231780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a15e2e7b-e566-48b2-8fd4-942179066553 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.232844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a15e2e7b-e566-48b2-8fd4-942179066553 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.233543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a15e2e7b-e566-48b2-8fd4-942179066553 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.234709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a15e2e7b-e566-48b2-8fd4-942179066553 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.505277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a15e2e7b-e566-48b2-8fd4-942179066553 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:38.514789 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a15e2e7b-e566-48b2-8fd4-942179066553 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1374 microversion: 2.1 time: 0.305224 Sep 10 11:07:38.515871 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1416/5142] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:38 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1374 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:38.538041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:38.538788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:38.551161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.552222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.553582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.555447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.556292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.556797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.591321 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] HTTP exception thrown: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Request method failure captured: Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa HTTP/1.1 Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG_ZWqiOMjKSr3yjkrmSwGVtOITg1TF4DXLUTsSyx8hBScQczmNsCL94W9osLEf6fjtgC97cib--0ZppalroZdZDais5rHlxvs4quCydPuxv-VRduTwJvraqi8c-MldygmFFhqN-dasjxyqHVhvC1tJO2vkUG-C_T6QsQUETXztlYbo Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Openstack-Nova-Api-Version: 2.21 Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 42e7d4b2c1904bc6b30fdaf28a57a277 Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-InstanceActionsV221TestJSON-53427031 Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42e7d4b2c1904bc6b30fdaf28a57a277"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/42e7d4b2c1904bc6b30fdaf28a57a277"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42e7d4b2c1904bc6b30fdaf28a57a277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_42e7d4b2c1904bc6b30fdaf28a57a277", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-InstanceActionsV221TestJSON-53427031 Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 42e7d4b2c1904bc6b30fdaf28a57a277 Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-53427031 Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-InstanceActionsV221TestJSON-53427031-project Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 3d956ae1b6334614ae7bc4c8a1df669c Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-InstanceActionsV221TestJSON-53427031-project Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'd7acb1fc-bb0f-471d-8a33-7d07ca6deeaa'} Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.593187 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:38.598507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.598507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:38.598507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:38.598507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:38.598507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:07:38.598507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:07:38.598507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.598507 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.600163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Returning 404 to user: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:38.601029 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ed98195f-ed1d-45a8-add0-4464fe735ee0 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 404 len: 111 microversion: 2.21 time: 0.071669 Sep 10 11:07:38.601872 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1417/5143] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:38 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 10 11:07:38.610667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-767b0adc-167f-43d2-b149-41f0e7b0e543 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '.version_select at 0x7efcadd80280>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:38.611015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-767b0adc-167f-43d2-b149-41f0e7b0e543 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:38.618317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-767b0adc-167f-43d2-b149-41f0e7b0e543 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.618805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-767b0adc-167f-43d2-b149-41f0e7b0e543 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.619239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-767b0adc-167f-43d2-b149-41f0e7b0e543 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.619971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-767b0adc-167f-43d2-b149-41f0e7b0e543 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.620427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-767b0adc-167f-43d2-b149-41f0e7b0e543 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.620842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-767b0adc-167f-43d2-b149-41f0e7b0e543 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.715995 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-767b0adc-167f-43d2-b149-41f0e7b0e543 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.109718 Sep 10 11:07:38.724270 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1418/5144] 10.222.0.20 () {60 vars in 1337 bytes} [Sat Sep 10 11:07:38 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa/os-instance-actions => generated 611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:07:38.733187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:38.733848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:38.742862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.743363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.744079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.744963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.745438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.746061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.766585 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] HTTP exception thrown: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Request method failure captured: Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa HTTP/1.1 Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG_ZWqiOMjKSr3yjkrmSwGVtOITg1TF4DXLUTsSyx8hBScQczmNsCL94W9osLEf6fjtgC97cib--0ZppalroZdZDais5rHlxvs4quCydPuxv-VRduTwJvraqi8c-MldygmFFhqN-dasjxyqHVhvC1tJO2vkUG-C_T6QsQUETXztlYbo Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Openstack-Nova-Api-Version: 2.21 Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 42e7d4b2c1904bc6b30fdaf28a57a277 Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-InstanceActionsV221TestJSON-53427031 Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42e7d4b2c1904bc6b30fdaf28a57a277"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/42e7d4b2c1904bc6b30fdaf28a57a277"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42e7d4b2c1904bc6b30fdaf28a57a277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_42e7d4b2c1904bc6b30fdaf28a57a277", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-InstanceActionsV221TestJSON-53427031 Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 42e7d4b2c1904bc6b30fdaf28a57a277 Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-53427031 Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-InstanceActionsV221TestJSON-53427031-project Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 3d956ae1b6334614ae7bc4c8a1df669c Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-InstanceActionsV221TestJSON-53427031-project Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'd7acb1fc-bb0f-471d-8a33-7d07ca6deeaa'} Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:07:38.781238 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.786778 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.790591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Returning 404 to user: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:38.792892 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d082fb73-1889-4fc1-b9a3-d773e56aee3e tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 404 len: 111 microversion: 2.21 time: 0.064566 Sep 10 11:07:38.796238 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1419/5145] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 11:07:38 2022] DELETE /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:07:38.806374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:38.808947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] [instance: d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:38.824884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.825781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.828136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.829720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.830374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.831041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.849299 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] HTTP exception thrown: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Request method failure captured: Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa HTTP/1.1 Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG_ZWqiOMjKSr3yjkrmSwGVtOITg1TF4DXLUTsSyx8hBScQczmNsCL94W9osLEf6fjtgC97cib--0ZppalroZdZDais5rHlxvs4quCydPuxv-VRduTwJvraqi8c-MldygmFFhqN-dasjxyqHVhvC1tJO2vkUG-C_T6QsQUETXztlYbo Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Openstack-Nova-Api-Version: 2.21 Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 42e7d4b2c1904bc6b30fdaf28a57a277 Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-InstanceActionsV221TestJSON-53427031 Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42e7d4b2c1904bc6b30fdaf28a57a277"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/42e7d4b2c1904bc6b30fdaf28a57a277"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42e7d4b2c1904bc6b30fdaf28a57a277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_42e7d4b2c1904bc6b30fdaf28a57a277", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-InstanceActionsV221TestJSON-53427031 Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 42e7d4b2c1904bc6b30fdaf28a57a277 Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-53427031 Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-InstanceActionsV221TestJSON-53427031-project Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 3d956ae1b6334614ae7bc4c8a1df669c Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-InstanceActionsV221TestJSON-53427031-project Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'd7acb1fc-bb0f-471d-8a33-7d07ca6deeaa'} Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.852228 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:07:38.857548 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.857548 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:07:38.857548 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:07:38.857548 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:07:38.857548 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:07:38.857548 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:07:38.857548 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. Sep 10 11:07:38.857548 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:07:38.858446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] Returning 404 to user: Instance d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:07:38.860248 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ea4cffd4-929e-4b17-bc21-45d6c5c78582 tempest-InstanceActionsV221TestJSON-53427031 tempest-InstanceActionsV221TestJSON-53427031-project] 10.222.0.20 "GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa" status: 404 len: 111 microversion: 2.21 time: 0.059072 Sep 10 11:07:38.862826 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1420/5146] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:07:38 2022] GET /compute/v2.1/servers/d7acb1fc-bb0f-471d-8a33-7d07ca6deeaa => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:07:38.896185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1a9f178a-a24a-4911-945d-a2a522214b54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:38.899766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1a9f178a-a24a-4911-945d-a2a522214b54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:38.917384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a9f178a-a24a-4911-945d-a2a522214b54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.917384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a9f178a-a24a-4911-945d-a2a522214b54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.919652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a9f178a-a24a-4911-945d-a2a522214b54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:38.920593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a9f178a-a24a-4911-945d-a2a522214b54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:38.922399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a9f178a-a24a-4911-945d-a2a522214b54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:38.924084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1a9f178a-a24a-4911-945d-a2a522214b54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:39.236533 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f9d02b0a-9e19-4bb8-8fe3-157ec0cdc7c9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "POST /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300/action" status: 202 len: 0 microversion: 2.1 time: 2.273725 Sep 10 11:07:39.237571 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3727/5147] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:07:36 2022] POST /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300/action => generated 0 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 10 11:07:39.531525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1a9f178a-a24a-4911-945d-a2a522214b54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:39.543417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-152d30bf-2bae-4a2b-99b0-abb827be8547 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:39.544259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-152d30bf-2bae-4a2b-99b0-abb827be8547 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:39.547590 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1a9f178a-a24a-4911-945d-a2a522214b54 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1368 microversion: 2.1 time: 0.670386 Sep 10 11:07:39.553551 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1421/5148] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:38 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1368 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:39.582006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d30bf-2bae-4a2b-99b0-abb827be8547 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:39.583981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d30bf-2bae-4a2b-99b0-abb827be8547 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:39.585704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d30bf-2bae-4a2b-99b0-abb827be8547 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:39.588211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d30bf-2bae-4a2b-99b0-abb827be8547 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:39.593548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d30bf-2bae-4a2b-99b0-abb827be8547 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:39.594962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d30bf-2bae-4a2b-99b0-abb827be8547 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:39.968072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-152d30bf-2bae-4a2b-99b0-abb827be8547 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:39.969862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7af2d643-da1f-43d9-860a-5ac765c3c487 req-1fbbe4bd-304f-4548-a564-bb7cb87e2215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a7ff1d-6a10-433b-810e-83327d6b6aa7", "name": "network-vif-plugged", "status": "completed", "tag": "44d576eb-9280-4f38-963e-4a571dbf2835"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:39.979183 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-152d30bf-2bae-4a2b-99b0-abb827be8547 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1546 microversion: 2.1 time: 0.438407 Sep 10 11:07:39.982024 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3728/5149] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:39 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1546 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:39.995608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7af2d643-da1f-43d9-860a-5ac765c3c487 req-1fbbe4bd-304f-4548-a564-bb7cb87e2215 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:39.996302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7af2d643-da1f-43d9-860a-5ac765c3c487 req-1fbbe4bd-304f-4548-a564-bb7cb87e2215 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:39.996911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7af2d643-da1f-43d9-860a-5ac765c3c487 req-1fbbe4bd-304f-4548-a564-bb7cb87e2215 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:40.007581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c03c4930-1c10-4c68-a9b4-ce887b89a8f9 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:40.009061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c03c4930-1c10-4c68-a9b4-ce887b89a8f9 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:40.021119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c4930-1c10-4c68-a9b4-ce887b89a8f9 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:40.023892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c4930-1c10-4c68-a9b4-ce887b89a8f9 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:40.024536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c4930-1c10-4c68-a9b4-ce887b89a8f9 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:40.025953 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7af2d643-da1f-43d9-860a-5ac765c3c487 req-1fbbe4bd-304f-4548-a564-bb7cb87e2215 service nova] Creating event network-vif-plugged:44d576eb-9280-4f38-963e-4a571dbf2835 for instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 on n-h2-856894-1 Sep 10 11:07:40.026900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c4930-1c10-4c68-a9b4-ce887b89a8f9 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:40.027558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c4930-1c10-4c68-a9b4-ce887b89a8f9 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:40.029248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c03c4930-1c10-4c68-a9b4-ce887b89a8f9 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:40.040412 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-7af2d643-da1f-43d9-860a-5ac765c3c487 req-1fbbe4bd-304f-4548-a564-bb7cb87e2215 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072316 Sep 10 11:07:40.041043 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1422/5150] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:07:40.336444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c03c4930-1c10-4c68-a9b4-ce887b89a8f9 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:40.348591 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c03c4930-1c10-4c68-a9b4-ce887b89a8f9 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1546 microversion: 2.1 time: 0.345604 Sep 10 11:07:40.350347 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3729/5151] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:40 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1546 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:07:40.573894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d576c1fd-52ba-49a3-8a34-47efd1742153 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:40.575737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d576c1fd-52ba-49a3-8a34-47efd1742153 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:40.626885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d576c1fd-52ba-49a3-8a34-47efd1742153 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:40.627426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d576c1fd-52ba-49a3-8a34-47efd1742153 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:40.632402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d576c1fd-52ba-49a3-8a34-47efd1742153 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:40.634587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d576c1fd-52ba-49a3-8a34-47efd1742153 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:40.636684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d576c1fd-52ba-49a3-8a34-47efd1742153 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:40.638839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d576c1fd-52ba-49a3-8a34-47efd1742153 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:40.686551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:40.751420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-293941098", "imageRef": "c868c399-a07d-4aab-ac65-269421a147fc", "flavorRef": "452", "networks": [{"uuid": "e65712d8-efe4-477c-ab8b-0eb50d70eafc"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:40.902606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] validate_networks() for [('e65712d8-efe4-477c-ab8b-0eb50d70eafc', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:07:40.989874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d576c1fd-52ba-49a3-8a34-47efd1742153 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:41.001883 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d576c1fd-52ba-49a3-8a34-47efd1742153 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1368 microversion: 2.1 time: 0.431573 Sep 10 11:07:41.006207 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1423/5152] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:40 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1368 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:41.844819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:07:41.845462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:07:41.846110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:07:41.846676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:07:41.847124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:07:41.857473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:41.857981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:41.858435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:41.859183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:41.859710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:41.860155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:41.880375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:07:41.886941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for user 78004185356641b990a951dc95e6ca0c and project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:07:41.908832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:07:41.912634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1b09676f-7d1e-4ccf-a31c-cffdd31ccda3',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:07:42.029638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1b2d3fd0-6728-42f8-b2b5-415bf0158d4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:42.029638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1b2d3fd0-6728-42f8-b2b5-415bf0158d4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:42.043091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b2d3fd0-6728-42f8-b2b5-415bf0158d4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:42.043596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b2d3fd0-6728-42f8-b2b5-415bf0158d4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:42.045304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b2d3fd0-6728-42f8-b2b5-415bf0158d4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:42.047232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b2d3fd0-6728-42f8-b2b5-415bf0158d4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:42.048483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b2d3fd0-6728-42f8-b2b5-415bf0158d4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:42.055102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1b2d3fd0-6728-42f8-b2b5-415bf0158d4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:42.066206 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d80faab3-3df2-4d92-95ca-21002687493a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.319569 Sep 10 11:07:42.069925 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3730/5153] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:07:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:07:42.084471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e1d5d03e-52db-4c21-b7e6-44ee6ab39ac8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:42.088536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e1d5d03e-52db-4c21-b7e6-44ee6ab39ac8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:42.505517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e1d5d03e-52db-4c21-b7e6-44ee6ab39ac8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:42.515185 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e1d5d03e-52db-4c21-b7e6-44ee6ab39ac8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1229 microversion: 2.1 time: 0.436275 Sep 10 11:07:42.517739 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3731/5154] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:42 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1229 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:42.696475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1b2d3fd0-6728-42f8-b2b5-415bf0158d4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:42.708808 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1b2d3fd0-6728-42f8-b2b5-415bf0158d4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1558 microversion: 2.1 time: 0.686622 Sep 10 11:07:42.710392 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1424/5155] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:42 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1558 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:42.734774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-234941fc-4a44-4bee-b459-c83fe602c3ec tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:42.735622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-234941fc-4a44-4bee-b459-c83fe602c3ec tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:42.749213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-234941fc-4a44-4bee-b459-c83fe602c3ec tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:42.749802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-234941fc-4a44-4bee-b459-c83fe602c3ec tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:42.750268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-234941fc-4a44-4bee-b459-c83fe602c3ec tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:42.751000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-234941fc-4a44-4bee-b459-c83fe602c3ec tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:42.753384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-234941fc-4a44-4bee-b459-c83fe602c3ec tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:42.753954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-234941fc-4a44-4bee-b459-c83fe602c3ec tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:43.283249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-a03a36ba-5b37-4e62-ae57-63d53497039e req-6a182957-b9d8-4844-a17b-d1fcb251a534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a767d108-b969-487e-baf9-c8f14e5a7746", "tag": "c0a2123b-8ff7-4eaa-b49d-0f7a862da857"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:43.308277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a03a36ba-5b37-4e62-ae57-63d53497039e req-6a182957-b9d8-4844-a17b-d1fcb251a534 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:43.308781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a03a36ba-5b37-4e62-ae57-63d53497039e req-6a182957-b9d8-4844-a17b-d1fcb251a534 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:43.309283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a03a36ba-5b37-4e62-ae57-63d53497039e req-6a182957-b9d8-4844-a17b-d1fcb251a534 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:43.359104 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-a03a36ba-5b37-4e62-ae57-63d53497039e req-6a182957-b9d8-4844-a17b-d1fcb251a534 service nova] Creating event network-changed:c0a2123b-8ff7-4eaa-b49d-0f7a862da857 for instance a767d108-b969-487e-baf9-c8f14e5a7746 on n-h2-856894-1 Sep 10 11:07:43.383139 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-a03a36ba-5b37-4e62-ae57-63d53497039e req-6a182957-b9d8-4844-a17b-d1fcb251a534 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112669 Sep 10 11:07:43.389493 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1425/5156] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 10 11:07:43.449555 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-234941fc-4a44-4bee-b459-c83fe602c3ec tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.719019 Sep 10 11:07:43.450562 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3732/5157] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:07:42 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7/os-interface => generated 284 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:43.556259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-66b3fee7-e2ad-4b6c-81f4-04ace62fdbc5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:43.557026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-66b3fee7-e2ad-4b6c-81f4-04ace62fdbc5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:43.569178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66b3fee7-e2ad-4b6c-81f4-04ace62fdbc5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:43.569962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66b3fee7-e2ad-4b6c-81f4-04ace62fdbc5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:43.571772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66b3fee7-e2ad-4b6c-81f4-04ace62fdbc5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:43.573056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66b3fee7-e2ad-4b6c-81f4-04ace62fdbc5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:43.573943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66b3fee7-e2ad-4b6c-81f4-04ace62fdbc5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:43.574542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66b3fee7-e2ad-4b6c-81f4-04ace62fdbc5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:43.914448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-66b3fee7-e2ad-4b6c-81f4-04ace62fdbc5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:43.923255 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-66b3fee7-e2ad-4b6c-81f4-04ace62fdbc5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1281 microversion: 2.1 time: 0.382845 Sep 10 11:07:43.927461 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1426/5158] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:43 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1281 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:44.960065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71d45870-5d99-4640-bbaf-f8ec2fae9ebe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:44.962416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-71d45870-5d99-4640-bbaf-f8ec2fae9ebe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:44.977581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71d45870-5d99-4640-bbaf-f8ec2fae9ebe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:44.978567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71d45870-5d99-4640-bbaf-f8ec2fae9ebe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:44.979437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71d45870-5d99-4640-bbaf-f8ec2fae9ebe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:44.980610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71d45870-5d99-4640-bbaf-f8ec2fae9ebe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:44.981481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71d45870-5d99-4640-bbaf-f8ec2fae9ebe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:44.983279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71d45870-5d99-4640-bbaf-f8ec2fae9ebe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:45.030357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:45.592070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-71d45870-5d99-4640-bbaf-f8ec2fae9ebe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:45.610915 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71d45870-5d99-4640-bbaf-f8ec2fae9ebe tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1299 microversion: 2.1 time: 0.660339 Sep 10 11:07:45.627014 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3733/5159] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:44 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1299 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:45.679160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-eaebf699-4638-4614-8bf7-02b84530fd48 req-4324b9b3-3463-4057-83ba-5f13e383564d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a7ff1d-6a10-433b-810e-83327d6b6aa7", "tag": "44d576eb-9280-4f38-963e-4a571dbf2835"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:45.711760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eaebf699-4638-4614-8bf7-02b84530fd48 req-4324b9b3-3463-4057-83ba-5f13e383564d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:45.714348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eaebf699-4638-4614-8bf7-02b84530fd48 req-4324b9b3-3463-4057-83ba-5f13e383564d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:45.715912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-eaebf699-4638-4614-8bf7-02b84530fd48 req-4324b9b3-3463-4057-83ba-5f13e383564d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:45.769576 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-eaebf699-4638-4614-8bf7-02b84530fd48 req-4324b9b3-3463-4057-83ba-5f13e383564d service nova] Creating event network-changed:44d576eb-9280-4f38-963e-4a571dbf2835 for instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 on n-h2-856894-1 Sep 10 11:07:45.779520 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-eaebf699-4638-4614-8bf7-02b84530fd48 req-4324b9b3-3463-4057-83ba-5f13e383564d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105808 Sep 10 11:07:45.795963 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1427/5160] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:46.653232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-538edb48-4079-45ba-b2cd-42510bee45b4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:46.654901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-538edb48-4079-45ba-b2cd-42510bee45b4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:46.674457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-538edb48-4079-45ba-b2cd-42510bee45b4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:46.675605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-538edb48-4079-45ba-b2cd-42510bee45b4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:46.677324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-538edb48-4079-45ba-b2cd-42510bee45b4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:46.679592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-538edb48-4079-45ba-b2cd-42510bee45b4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:46.682866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-538edb48-4079-45ba-b2cd-42510bee45b4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:46.683740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-538edb48-4079-45ba-b2cd-42510bee45b4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:47.682649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-538edb48-4079-45ba-b2cd-42510bee45b4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:47.695979 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-538edb48-4079-45ba-b2cd-42510bee45b4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 1.046733 Sep 10 11:07:47.697975 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3734/5161] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:46 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:48.727497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-698436d6-38d4-4a09-9509-fcaf76f28246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:48.728374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-698436d6-38d4-4a09-9509-fcaf76f28246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:48.735106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698436d6-38d4-4a09-9509-fcaf76f28246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:48.735999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698436d6-38d4-4a09-9509-fcaf76f28246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:48.736691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698436d6-38d4-4a09-9509-fcaf76f28246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:48.737690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698436d6-38d4-4a09-9509-fcaf76f28246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:48.738395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698436d6-38d4-4a09-9509-fcaf76f28246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:48.739059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-698436d6-38d4-4a09-9509-fcaf76f28246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:49.433532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-698436d6-38d4-4a09-9509-fcaf76f28246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:49.452285 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-698436d6-38d4-4a09-9509-fcaf76f28246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.730522 Sep 10 11:07:49.456760 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1428/5162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:48 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:49.795291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-84391ead-b7d2-4092-9c5a-098785524417 req-964ecf30-ecb9-4f6f-a6fc-93f55c150104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0effa7f-ec16-4c53-88e9-e03c342c299e", "tag": "0f48d1c5-8417-4dc8-ad6c-a9df0153aa83"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:07:49.813816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-84391ead-b7d2-4092-9c5a-098785524417 req-964ecf30-ecb9-4f6f-a6fc-93f55c150104 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:49.816488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-84391ead-b7d2-4092-9c5a-098785524417 req-964ecf30-ecb9-4f6f-a6fc-93f55c150104 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:49.818586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-84391ead-b7d2-4092-9c5a-098785524417 req-964ecf30-ecb9-4f6f-a6fc-93f55c150104 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:49.849973 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-84391ead-b7d2-4092-9c5a-098785524417 req-964ecf30-ecb9-4f6f-a6fc-93f55c150104 service nova] Creating event network-changed:0f48d1c5-8417-4dc8-ad6c-a9df0153aa83 for instance d0effa7f-ec16-4c53-88e9-e03c342c299e on n-h2-856894-1 Sep 10 11:07:49.863014 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-84391ead-b7d2-4092-9c5a-098785524417 req-964ecf30-ecb9-4f6f-a6fc-93f55c150104 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074051 Sep 10 11:07:49.863966 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3735/5163] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:07:50.482809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-350bebf4-dfc5-4e21-975e-fb4fd8ec2499 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:50.483441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-350bebf4-dfc5-4e21-975e-fb4fd8ec2499 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:50.491161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-350bebf4-dfc5-4e21-975e-fb4fd8ec2499 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:50.492470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-350bebf4-dfc5-4e21-975e-fb4fd8ec2499 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:50.493323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-350bebf4-dfc5-4e21-975e-fb4fd8ec2499 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:50.494273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-350bebf4-dfc5-4e21-975e-fb4fd8ec2499 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:50.494983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-350bebf4-dfc5-4e21-975e-fb4fd8ec2499 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:50.495645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-350bebf4-dfc5-4e21-975e-fb4fd8ec2499 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:50.841926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-350bebf4-dfc5-4e21-975e-fb4fd8ec2499 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:50.850522 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-350bebf4-dfc5-4e21-975e-fb4fd8ec2499 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.372128 Sep 10 11:07:50.851881 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1429/5164] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:50 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:51.881050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a054cf2-bbdf-4272-962f-e53ef1e53cc4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:51.881637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a054cf2-bbdf-4272-962f-e53ef1e53cc4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:51.892137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:51.897699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a054cf2-bbdf-4272-962f-e53ef1e53cc4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:51.899123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a054cf2-bbdf-4272-962f-e53ef1e53cc4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:51.899584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a054cf2-bbdf-4272-962f-e53ef1e53cc4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:51.906026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a054cf2-bbdf-4272-962f-e53ef1e53cc4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:51.906881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a054cf2-bbdf-4272-962f-e53ef1e53cc4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:51.907726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a054cf2-bbdf-4272-962f-e53ef1e53cc4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:52.123747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a054cf2-bbdf-4272-962f-e53ef1e53cc4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:52.132878 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a054cf2-bbdf-4272-962f-e53ef1e53cc4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.257889 Sep 10 11:07:52.133978 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3736/5165] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:51 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:53.159454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-47f85b66-91eb-4992-9352-83a99786820c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:53.160177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-47f85b66-91eb-4992-9352-83a99786820c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:53.169733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47f85b66-91eb-4992-9352-83a99786820c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:53.170532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47f85b66-91eb-4992-9352-83a99786820c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:53.171181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47f85b66-91eb-4992-9352-83a99786820c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:53.172221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47f85b66-91eb-4992-9352-83a99786820c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:53.172943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47f85b66-91eb-4992-9352-83a99786820c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:53.173799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47f85b66-91eb-4992-9352-83a99786820c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:53.418688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-47f85b66-91eb-4992-9352-83a99786820c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:53.431367 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-47f85b66-91eb-4992-9352-83a99786820c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.276202 Sep 10 11:07:53.438764 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1430/5166] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:53 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:54.475869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9f8667a5-48b0-4de1-96a2-0a219e27da39 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:54.476881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9f8667a5-48b0-4de1-96a2-0a219e27da39 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:54.479039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:07:54.495846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f8667a5-48b0-4de1-96a2-0a219e27da39 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:54.496815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f8667a5-48b0-4de1-96a2-0a219e27da39 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:54.497804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f8667a5-48b0-4de1-96a2-0a219e27da39 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:54.499666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f8667a5-48b0-4de1-96a2-0a219e27da39 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:54.500143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f8667a5-48b0-4de1-96a2-0a219e27da39 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:54.501451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f8667a5-48b0-4de1-96a2-0a219e27da39 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:54.773712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9f8667a5-48b0-4de1-96a2-0a219e27da39 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:54.800079 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9f8667a5-48b0-4de1-96a2-0a219e27da39 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.328677 Sep 10 11:07:54.812889 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3737/5167] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:54 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:55.843351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-486aafa4-366a-4478-99ac-d88644969d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:55.845114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-486aafa4-366a-4478-99ac-d88644969d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:55.858729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-486aafa4-366a-4478-99ac-d88644969d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:55.860280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-486aafa4-366a-4478-99ac-d88644969d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:55.860956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-486aafa4-366a-4478-99ac-d88644969d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:55.862130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-486aafa4-366a-4478-99ac-d88644969d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:55.862953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-486aafa4-366a-4478-99ac-d88644969d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:55.863705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-486aafa4-366a-4478-99ac-d88644969d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:56.141662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-486aafa4-366a-4478-99ac-d88644969d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:56.157294 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-486aafa4-366a-4478-99ac-d88644969d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.319822 Sep 10 11:07:56.158582 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1431/5168] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:55 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:57.207932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e082a242-3e51-4d82-b965-1c73c9470e35 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:57.212785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e082a242-3e51-4d82-b965-1c73c9470e35 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:57.250544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e082a242-3e51-4d82-b965-1c73c9470e35 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:57.251026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e082a242-3e51-4d82-b965-1c73c9470e35 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:57.254142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e082a242-3e51-4d82-b965-1c73c9470e35 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:57.256844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e082a242-3e51-4d82-b965-1c73c9470e35 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:57.259180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e082a242-3e51-4d82-b965-1c73c9470e35 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:57.259652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e082a242-3e51-4d82-b965-1c73c9470e35 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:57.584062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e082a242-3e51-4d82-b965-1c73c9470e35 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:57.596714 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e082a242-3e51-4d82-b965-1c73c9470e35 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.395572 Sep 10 11:07:57.598923 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3738/5169] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:57 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:07:58.624623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b8704495-8002-4b66-adf8-1e9d4d8e2751 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:07:58.626076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b8704495-8002-4b66-adf8-1e9d4d8e2751 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:07:58.649459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8704495-8002-4b66-adf8-1e9d4d8e2751 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:58.652988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8704495-8002-4b66-adf8-1e9d4d8e2751 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:58.659446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8704495-8002-4b66-adf8-1e9d4d8e2751 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:58.666814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8704495-8002-4b66-adf8-1e9d4d8e2751 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:07:58.671640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8704495-8002-4b66-adf8-1e9d4d8e2751 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:07:58.673203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8704495-8002-4b66-adf8-1e9d4d8e2751 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:07:59.237652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b8704495-8002-4b66-adf8-1e9d4d8e2751 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:07:59.252214 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b8704495-8002-4b66-adf8-1e9d4d8e2751 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.632011 Sep 10 11:07:59.270011 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1432/5170] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:07:58 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:00.277008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dac6d1c7-e308-457d-b017-50e24bcf11d4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:00.277779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dac6d1c7-e308-457d-b017-50e24bcf11d4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:00.291536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dac6d1c7-e308-457d-b017-50e24bcf11d4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:00.295201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dac6d1c7-e308-457d-b017-50e24bcf11d4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:00.298672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dac6d1c7-e308-457d-b017-50e24bcf11d4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:00.299976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dac6d1c7-e308-457d-b017-50e24bcf11d4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:00.300481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dac6d1c7-e308-457d-b017-50e24bcf11d4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:00.301013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dac6d1c7-e308-457d-b017-50e24bcf11d4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:00.576484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dac6d1c7-e308-457d-b017-50e24bcf11d4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:00.589849 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dac6d1c7-e308-457d-b017-50e24bcf11d4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.316889 Sep 10 11:08:00.591564 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3739/5171] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:00 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:00.708104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-292638859", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "ab10f319-1486-42b7-808c-280d0258d80a"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:00.731071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=66 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:00.788982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] validate_networks() for [('ab10f319-1486-42b7-808c-280d0258d80a', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:08:01.309173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:08:01.309813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:08:01.310725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:08:01.311310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:08:01.312226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:08:01.326588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:01.327073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:01.327644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:01.328576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:01.329321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:01.329977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:01.350867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Getting quotas for project 0023c5d33126427f998980ae3d740416. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:08:01.358527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Getting quotas for user 63dc964dc0474d61be32ca9b0f0e9d54 and project 0023c5d33126427f998980ae3d740416. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:08:01.373354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Going to run 2 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:08:01.376260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: b0bb0301-cc8a-4021-8698-f01374cccc3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:08:01.414938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=b0bb0301-cc8a-4021-8698-f01374cccc3c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:08:01.487376 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c92e85b0-54e8-4d3c-b49f-4e80ab8185df tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013994 Sep 10 11:08:01.487961 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1433/5172] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:08:01.501134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-831f27ee-2dac-456e-aa5b-dd4eb0c3f3e5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:01.508480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-831f27ee-2dac-456e-aa5b-dd4eb0c3f3e5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:01.509479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-831f27ee-2dac-456e-aa5b-dd4eb0c3f3e5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Searching by: {'deleted': False, 'project_id': '0023c5d33126427f998980ae3d740416'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:08:01.538626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-831f27ee-2dac-456e-aa5b-dd4eb0c3f3e5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:01.539386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-831f27ee-2dac-456e-aa5b-dd4eb0c3f3e5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:01.540157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-831f27ee-2dac-456e-aa5b-dd4eb0c3f3e5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:01.541604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-831f27ee-2dac-456e-aa5b-dd4eb0c3f3e5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:01.543163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-831f27ee-2dac-456e-aa5b-dd4eb0c3f3e5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:01.543969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-831f27ee-2dac-456e-aa5b-dd4eb0c3f3e5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:01.602979 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-831f27ee-2dac-456e-aa5b-dd4eb0c3f3e5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.106260 Sep 10 11:08:01.604222 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3740/5173] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 11:08:01 2022] GET /compute/v2.1/servers => generated 675 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:01.617645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e1d22333-571b-4cb5-8862-89b095e27bb0 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:01.618805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e1d22333-571b-4cb5-8862-89b095e27bb0 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:01.634778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d014073d-30cf-4a64-acc6-31267651bed8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:01.638302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d014073d-30cf-4a64-acc6-31267651bed8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:01.660862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d014073d-30cf-4a64-acc6-31267651bed8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:01.661841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d014073d-30cf-4a64-acc6-31267651bed8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:01.664576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d014073d-30cf-4a64-acc6-31267651bed8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:01.665863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d014073d-30cf-4a64-acc6-31267651bed8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:01.669103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d014073d-30cf-4a64-acc6-31267651bed8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:01.669746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d014073d-30cf-4a64-acc6-31267651bed8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:01.872483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e1d22333-571b-4cb5-8862-89b095e27bb0 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:01.883491 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e1d22333-571b-4cb5-8862-89b095e27bb0 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1219 microversion: 2.1 time: 0.269167 Sep 10 11:08:01.893847 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1434/5174] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:01 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1219 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:02.295067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d014073d-30cf-4a64-acc6-31267651bed8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:02.316338 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d014073d-30cf-4a64-acc6-31267651bed8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.687401 Sep 10 11:08:02.329096 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3741/5175] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:01 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:02.909528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ba5fa133-d1e1-4a99-b4f3-09d1eea1a850 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:02.910162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ba5fa133-d1e1-4a99-b4f3-09d1eea1a850 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:03.032366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ba5fa133-d1e1-4a99-b4f3-09d1eea1a850 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:03.045961 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ba5fa133-d1e1-4a99-b4f3-09d1eea1a850 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1219 microversion: 2.1 time: 0.139724 Sep 10 11:08:03.048149 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1435/5176] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:02 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:03.343575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c73cbc8a-84b8-4938-9028-ff1cbcefa215 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:03.344281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c73cbc8a-84b8-4938-9028-ff1cbcefa215 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:03.354871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73cbc8a-84b8-4938-9028-ff1cbcefa215 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:03.355684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73cbc8a-84b8-4938-9028-ff1cbcefa215 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:03.356572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73cbc8a-84b8-4938-9028-ff1cbcefa215 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:03.358405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73cbc8a-84b8-4938-9028-ff1cbcefa215 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:03.359125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73cbc8a-84b8-4938-9028-ff1cbcefa215 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:03.360264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c73cbc8a-84b8-4938-9028-ff1cbcefa215 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:03.564003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c73cbc8a-84b8-4938-9028-ff1cbcefa215 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:03.575312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c73cbc8a-84b8-4938-9028-ff1cbcefa215 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.235560 Sep 10 11:08:03.577420 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3742/5177] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:03 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:04.075638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-53382122-5940-4327-949d-ac6d30906998 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:04.077692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-53382122-5940-4327-949d-ac6d30906998 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:04.106951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53382122-5940-4327-949d-ac6d30906998 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:04.115792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53382122-5940-4327-949d-ac6d30906998 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:04.116731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53382122-5940-4327-949d-ac6d30906998 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:04.120712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53382122-5940-4327-949d-ac6d30906998 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:04.128839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53382122-5940-4327-949d-ac6d30906998 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:04.129319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53382122-5940-4327-949d-ac6d30906998 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:04.309279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-53382122-5940-4327-949d-ac6d30906998 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:04.318895 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-53382122-5940-4327-949d-ac6d30906998 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1271 microversion: 2.1 time: 0.248982 Sep 10 11:08:04.347189 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1436/5178] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:04 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:04.600609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-02a715a1-fcb5-46ea-8cdc-c600ccc9df07 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:04.601964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-02a715a1-fcb5-46ea-8cdc-c600ccc9df07 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:04.611906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:04.617229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a715a1-fcb5-46ea-8cdc-c600ccc9df07 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:04.619407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a715a1-fcb5-46ea-8cdc-c600ccc9df07 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:04.621442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a715a1-fcb5-46ea-8cdc-c600ccc9df07 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:04.622415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a715a1-fcb5-46ea-8cdc-c600ccc9df07 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:04.624733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a715a1-fcb5-46ea-8cdc-c600ccc9df07 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:04.625444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-02a715a1-fcb5-46ea-8cdc-c600ccc9df07 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:05.348860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-503fbcd9-c419-4651-b746-09b40c31b828 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:05.350202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-503fbcd9-c419-4651-b746-09b40c31b828 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:05.358064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-503fbcd9-c419-4651-b746-09b40c31b828 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:05.358929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-503fbcd9-c419-4651-b746-09b40c31b828 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:05.359789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-503fbcd9-c419-4651-b746-09b40c31b828 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:05.360765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-503fbcd9-c419-4651-b746-09b40c31b828 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:05.361481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-503fbcd9-c419-4651-b746-09b40c31b828 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:05.362236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-503fbcd9-c419-4651-b746-09b40c31b828 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:05.410191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-02a715a1-fcb5-46ea-8cdc-c600ccc9df07 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:05.434359 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-02a715a1-fcb5-46ea-8cdc-c600ccc9df07 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.835631 Sep 10 11:08:05.441295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3743/5179] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:04 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:05.496816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-503fbcd9-c419-4651-b746-09b40c31b828 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:05.508360 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-503fbcd9-c419-4651-b746-09b40c31b828 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1277 microversion: 2.1 time: 0.165955 Sep 10 11:08:05.511754 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1437/5180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:05 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:06.469861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-09c57b35-1092-463e-8486-e876b14c6c16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:06.470720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-09c57b35-1092-463e-8486-e876b14c6c16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:06.480627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c57b35-1092-463e-8486-e876b14c6c16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:06.481639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c57b35-1092-463e-8486-e876b14c6c16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:06.482544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c57b35-1092-463e-8486-e876b14c6c16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:06.483748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c57b35-1092-463e-8486-e876b14c6c16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:06.484560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c57b35-1092-463e-8486-e876b14c6c16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:06.485269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09c57b35-1092-463e-8486-e876b14c6c16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:06.536595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cf0adbe7-8dd6-432b-8a66-4be64ead2856 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:06.538272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cf0adbe7-8dd6-432b-8a66-4be64ead2856 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:06.546951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf0adbe7-8dd6-432b-8a66-4be64ead2856 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:06.547709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf0adbe7-8dd6-432b-8a66-4be64ead2856 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:06.549126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf0adbe7-8dd6-432b-8a66-4be64ead2856 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:06.550458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf0adbe7-8dd6-432b-8a66-4be64ead2856 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:06.551039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf0adbe7-8dd6-432b-8a66-4be64ead2856 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:06.551806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf0adbe7-8dd6-432b-8a66-4be64ead2856 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:06.764412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cf0adbe7-8dd6-432b-8a66-4be64ead2856 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:06.779374 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cf0adbe7-8dd6-432b-8a66-4be64ead2856 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1277 microversion: 2.1 time: 0.246098 Sep 10 11:08:06.780123 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1438/5181] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:06 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:06.924464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-09c57b35-1092-463e-8486-e876b14c6c16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:06.938476 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-09c57b35-1092-463e-8486-e876b14c6c16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.472943 Sep 10 11:08:06.940666 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3744/5182] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:06 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:07.812454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-50bdcf51-eb82-40f8-bf4c-83589948d0f2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:07.813315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-50bdcf51-eb82-40f8-bf4c-83589948d0f2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:07.834389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50bdcf51-eb82-40f8-bf4c-83589948d0f2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:07.836709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50bdcf51-eb82-40f8-bf4c-83589948d0f2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:07.837508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50bdcf51-eb82-40f8-bf4c-83589948d0f2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:07.840948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50bdcf51-eb82-40f8-bf4c-83589948d0f2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:07.844021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50bdcf51-eb82-40f8-bf4c-83589948d0f2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:07.845886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50bdcf51-eb82-40f8-bf4c-83589948d0f2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:07.966635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05399a9e-7b51-4067-a549-c95e74cb3d61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:07.969654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05399a9e-7b51-4067-a549-c95e74cb3d61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:07.989823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05399a9e-7b51-4067-a549-c95e74cb3d61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:07.992112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05399a9e-7b51-4067-a549-c95e74cb3d61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:07.995523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05399a9e-7b51-4067-a549-c95e74cb3d61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:07.996703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05399a9e-7b51-4067-a549-c95e74cb3d61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:07.999741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05399a9e-7b51-4067-a549-c95e74cb3d61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:08.000223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05399a9e-7b51-4067-a549-c95e74cb3d61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:08.211847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-50bdcf51-eb82-40f8-bf4c-83589948d0f2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:08.227803 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-50bdcf51-eb82-40f8-bf4c-83589948d0f2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1319 microversion: 2.1 time: 0.420617 Sep 10 11:08:08.228820 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1439/5183] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:07 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:08.237998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e068bfe-4ed0-42b9-98f8-080c63ebd4f3 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:08.244593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1e068bfe-4ed0-42b9-98f8-080c63ebd4f3 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:08.254861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e068bfe-4ed0-42b9-98f8-080c63ebd4f3 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:08.256772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e068bfe-4ed0-42b9-98f8-080c63ebd4f3 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:08.259282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e068bfe-4ed0-42b9-98f8-080c63ebd4f3 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:08.260402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e068bfe-4ed0-42b9-98f8-080c63ebd4f3 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:08.261502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e068bfe-4ed0-42b9-98f8-080c63ebd4f3 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:08.264119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e068bfe-4ed0-42b9-98f8-080c63ebd4f3 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:08.355397 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1e068bfe-4ed0-42b9-98f8-080c63ebd4f3 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "POST /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746/action" status: 200 len: 24563 microversion: 2.1 time: 0.124098 Sep 10 11:08:08.357005 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1440/5184] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:08:08 2022] POST /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746/action => generated 24563 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:08:08.371399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-bfec59f6-6fef-4b9c-b529-6a67cdd1d294 req-a2ad88e9-17e5-4205-8c69-d63ea097a059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0bb0301-cc8a-4021-8698-f01374cccc3c", "tag": "faa09232-7597-4d98-82d7-eba609b5a2f8"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:08.387509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-bfec59f6-6fef-4b9c-b529-6a67cdd1d294 req-a2ad88e9-17e5-4205-8c69-d63ea097a059 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:08.388458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-bfec59f6-6fef-4b9c-b529-6a67cdd1d294 req-a2ad88e9-17e5-4205-8c69-d63ea097a059 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:08.389299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-bfec59f6-6fef-4b9c-b529-6a67cdd1d294 req-a2ad88e9-17e5-4205-8c69-d63ea097a059 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:08.406839 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-bfec59f6-6fef-4b9c-b529-6a67cdd1d294 req-a2ad88e9-17e5-4205-8c69-d63ea097a059 service nova] Creating event network-changed:faa09232-7597-4d98-82d7-eba609b5a2f8 for instance b0bb0301-cc8a-4021-8698-f01374cccc3c on n-h2-856894-1 Sep 10 11:08:08.414836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05399a9e-7b51-4067-a549-c95e74cb3d61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:08.423355 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-bfec59f6-6fef-4b9c-b529-6a67cdd1d294 req-a2ad88e9-17e5-4205-8c69-d63ea097a059 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064619 Sep 10 11:08:08.424636 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1441/5185] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:08.425680 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05399a9e-7b51-4067-a549-c95e74cb3d61 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.465511 Sep 10 11:08:08.427198 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3745/5186] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:07 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:09.263601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0368f344-225c-43e2-858d-896794ba9154 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:09.265042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0368f344-225c-43e2-858d-896794ba9154 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:09.279278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368f344-225c-43e2-858d-896794ba9154 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:09.280067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368f344-225c-43e2-858d-896794ba9154 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:09.280695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368f344-225c-43e2-858d-896794ba9154 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:09.281607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368f344-225c-43e2-858d-896794ba9154 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:09.282237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368f344-225c-43e2-858d-896794ba9154 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:09.282826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368f344-225c-43e2-858d-896794ba9154 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:09.456358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-febdbf0e-1685-417e-92cf-265bf740b0f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:09.457051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-febdbf0e-1685-417e-92cf-265bf740b0f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:09.468011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-febdbf0e-1685-417e-92cf-265bf740b0f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:09.468953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-febdbf0e-1685-417e-92cf-265bf740b0f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:09.469695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-febdbf0e-1685-417e-92cf-265bf740b0f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:09.471205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0368f344-225c-43e2-858d-896794ba9154 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:09.472518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-febdbf0e-1685-417e-92cf-265bf740b0f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:09.473507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-febdbf0e-1685-417e-92cf-265bf740b0f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:09.474251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-febdbf0e-1685-417e-92cf-265bf740b0f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:09.482583 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0368f344-225c-43e2-858d-896794ba9154 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1319 microversion: 2.1 time: 0.227018 Sep 10 11:08:09.494204 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1442/5187] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:09 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:09.644742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-febdbf0e-1685-417e-92cf-265bf740b0f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:09.654073 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-febdbf0e-1685-417e-92cf-265bf740b0f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1341 microversion: 2.1 time: 0.201571 Sep 10 11:08:09.669786 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3746/5188] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:09 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:10.485341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-97ac04d2-b63c-44e1-bdb0-1a5cccf29490 req-10596eb8-f0a1-4f33-94d1-07591cc1dedd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8558817-c2c4-4560-b3a7-7c8cf553cf85", "tag": "fe8e4495-749c-4ec8-aab2-ba99445a54f5"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:10.508201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-97ac04d2-b63c-44e1-bdb0-1a5cccf29490 req-10596eb8-f0a1-4f33-94d1-07591cc1dedd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:10.508810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-97ac04d2-b63c-44e1-bdb0-1a5cccf29490 req-10596eb8-f0a1-4f33-94d1-07591cc1dedd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:10.509341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-97ac04d2-b63c-44e1-bdb0-1a5cccf29490 req-10596eb8-f0a1-4f33-94d1-07591cc1dedd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:10.516409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a51e470a-2453-4e7f-bc2b-2f99d161e730 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:10.517687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a51e470a-2453-4e7f-bc2b-2f99d161e730 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:10.527517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51e470a-2453-4e7f-bc2b-2f99d161e730 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:10.528311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51e470a-2453-4e7f-bc2b-2f99d161e730 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:10.529232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51e470a-2453-4e7f-bc2b-2f99d161e730 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:10.530166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51e470a-2453-4e7f-bc2b-2f99d161e730 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:10.531352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51e470a-2453-4e7f-bc2b-2f99d161e730 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:10.531980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a51e470a-2453-4e7f-bc2b-2f99d161e730 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:10.542550 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-97ac04d2-b63c-44e1-bdb0-1a5cccf29490 req-10596eb8-f0a1-4f33-94d1-07591cc1dedd service nova] Creating event network-changed:fe8e4495-749c-4ec8-aab2-ba99445a54f5 for instance e8558817-c2c4-4560-b3a7-7c8cf553cf85 on n-h2-856894-1 Sep 10 11:08:10.552730 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-97ac04d2-b63c-44e1-bdb0-1a5cccf29490 req-10596eb8-f0a1-4f33-94d1-07591cc1dedd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071829 Sep 10 11:08:10.557832 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1443/5189] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:10.680915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3fbfe85e-bec7-474d-b59f-a53842dc6655 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:10.681866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3fbfe85e-bec7-474d-b59f-a53842dc6655 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:10.694103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fbfe85e-bec7-474d-b59f-a53842dc6655 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:10.694389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fbfe85e-bec7-474d-b59f-a53842dc6655 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:10.694905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fbfe85e-bec7-474d-b59f-a53842dc6655 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:10.695770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fbfe85e-bec7-474d-b59f-a53842dc6655 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:10.703708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fbfe85e-bec7-474d-b59f-a53842dc6655 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:10.704394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fbfe85e-bec7-474d-b59f-a53842dc6655 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:10.738167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=92 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:11.339488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:11.440971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a51e470a-2453-4e7f-bc2b-2f99d161e730 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:11.453105 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a51e470a-2453-4e7f-bc2b-2f99d161e730 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1319 microversion: 2.1 time: 0.941957 Sep 10 11:08:11.454040 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3747/5190] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:10 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1319 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:11.514293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3fbfe85e-bec7-474d-b59f-a53842dc6655 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:11.529963 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3fbfe85e-bec7-474d-b59f-a53842dc6655 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1387 microversion: 2.1 time: 0.854315 Sep 10 11:08:11.532678 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1444/5191] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:10 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1387 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:12.478797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c645018-5d51-410d-825d-17ac9b606dd3 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:12.479561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6c645018-5d51-410d-825d-17ac9b606dd3 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:12.482474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:12.488683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c645018-5d51-410d-825d-17ac9b606dd3 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:12.489262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c645018-5d51-410d-825d-17ac9b606dd3 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:12.489999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c645018-5d51-410d-825d-17ac9b606dd3 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:12.490717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c645018-5d51-410d-825d-17ac9b606dd3 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:12.491187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c645018-5d51-410d-825d-17ac9b606dd3 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:12.491636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c645018-5d51-410d-825d-17ac9b606dd3 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:12.555608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-edc2e12b-65c8-41f6-a857-fb12870d22f3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:12.558459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-edc2e12b-65c8-41f6-a857-fb12870d22f3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:12.568355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edc2e12b-65c8-41f6-a857-fb12870d22f3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:12.569030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edc2e12b-65c8-41f6-a857-fb12870d22f3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:12.570176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edc2e12b-65c8-41f6-a857-fb12870d22f3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:12.571063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edc2e12b-65c8-41f6-a857-fb12870d22f3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:12.571700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edc2e12b-65c8-41f6-a857-fb12870d22f3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:12.572126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edc2e12b-65c8-41f6-a857-fb12870d22f3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:12.747912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6c645018-5d51-410d-825d-17ac9b606dd3 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:12.759178 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c645018-5d51-410d-825d-17ac9b606dd3 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1319 microversion: 2.1 time: 0.284136 Sep 10 11:08:12.770224 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3748/5192] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:12 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:12.863568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-edc2e12b-65c8-41f6-a857-fb12870d22f3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:12.879703 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-edc2e12b-65c8-41f6-a857-fb12870d22f3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.328000 Sep 10 11:08:12.889858 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1445/5193] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:12 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:13.784991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ca9a3764-72a3-4c6d-8f68-8bdee1e44106 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:13.786008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ca9a3764-72a3-4c6d-8f68-8bdee1e44106 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:13.793914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9a3764-72a3-4c6d-8f68-8bdee1e44106 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:13.794866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9a3764-72a3-4c6d-8f68-8bdee1e44106 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:13.795570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9a3764-72a3-4c6d-8f68-8bdee1e44106 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:13.796517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9a3764-72a3-4c6d-8f68-8bdee1e44106 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:13.800767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9a3764-72a3-4c6d-8f68-8bdee1e44106 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:13.801294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9a3764-72a3-4c6d-8f68-8bdee1e44106 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:13.907475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-eae35e06-24f8-489f-a05c-6e746db618de tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:13.908211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-eae35e06-24f8-489f-a05c-6e746db618de tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:13.915176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=10 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:13.918564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eae35e06-24f8-489f-a05c-6e746db618de tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:13.919392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eae35e06-24f8-489f-a05c-6e746db618de tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:13.920049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eae35e06-24f8-489f-a05c-6e746db618de tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:13.920987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eae35e06-24f8-489f-a05c-6e746db618de tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:13.921788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eae35e06-24f8-489f-a05c-6e746db618de tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:13.922618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eae35e06-24f8-489f-a05c-6e746db618de tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:13.983854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ca9a3764-72a3-4c6d-8f68-8bdee1e44106 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:14.001333 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ca9a3764-72a3-4c6d-8f68-8bdee1e44106 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1319 microversion: 2.1 time: 0.220317 Sep 10 11:08:14.007083 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3749/5194] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:13 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:14.346115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-eae35e06-24f8-489f-a05c-6e746db618de tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:14.356126 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-eae35e06-24f8-489f-a05c-6e746db618de tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.455827 Sep 10 11:08:14.356721 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1446/5195] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:13 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:15.025157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dd0d9db2-7be8-4b1d-a48d-ed70b130a62a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:15.026427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dd0d9db2-7be8-4b1d-a48d-ed70b130a62a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:15.033505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd0d9db2-7be8-4b1d-a48d-ed70b130a62a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:15.034024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd0d9db2-7be8-4b1d-a48d-ed70b130a62a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:15.034493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd0d9db2-7be8-4b1d-a48d-ed70b130a62a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:15.035209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd0d9db2-7be8-4b1d-a48d-ed70b130a62a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:15.035946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd0d9db2-7be8-4b1d-a48d-ed70b130a62a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:15.036596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dd0d9db2-7be8-4b1d-a48d-ed70b130a62a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:15.057859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=94 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:15.270716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dd0d9db2-7be8-4b1d-a48d-ed70b130a62a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:15.279159 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dd0d9db2-7be8-4b1d-a48d-ed70b130a62a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1319 microversion: 2.1 time: 0.258135 Sep 10 11:08:15.279810 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3750/5196] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:15 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:15.380202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-28d18a6d-d500-4dfa-aa43-196887514e2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:15.394212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-28d18a6d-d500-4dfa-aa43-196887514e2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:15.421567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28d18a6d-d500-4dfa-aa43-196887514e2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:15.422984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28d18a6d-d500-4dfa-aa43-196887514e2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:15.425370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28d18a6d-d500-4dfa-aa43-196887514e2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:15.433294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28d18a6d-d500-4dfa-aa43-196887514e2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:15.434410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28d18a6d-d500-4dfa-aa43-196887514e2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:15.435514 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28d18a6d-d500-4dfa-aa43-196887514e2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:15.772135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-28d18a6d-d500-4dfa-aa43-196887514e2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:15.792100 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-28d18a6d-d500-4dfa-aa43-196887514e2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.415281 Sep 10 11:08:15.794373 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1447/5197] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:15 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:15.842349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-58e8e76d-8cf4-4463-b3a4-d310b9275a8f req-0a592267-cec0-4962-b1d7-793d685efb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bb0301-cc8a-4021-8698-f01374cccc3c", "name": "network-vif-plugged", "status": "completed", "tag": "faa09232-7597-4d98-82d7-eba609b5a2f8"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:15.864828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-58e8e76d-8cf4-4463-b3a4-d310b9275a8f req-0a592267-cec0-4962-b1d7-793d685efb52 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:15.865396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-58e8e76d-8cf4-4463-b3a4-d310b9275a8f req-0a592267-cec0-4962-b1d7-793d685efb52 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:15.865852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-58e8e76d-8cf4-4463-b3a4-d310b9275a8f req-0a592267-cec0-4962-b1d7-793d685efb52 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:15.886697 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-58e8e76d-8cf4-4463-b3a4-d310b9275a8f req-0a592267-cec0-4962-b1d7-793d685efb52 service nova] Creating event network-vif-plugged:faa09232-7597-4d98-82d7-eba609b5a2f8 for instance b0bb0301-cc8a-4021-8698-f01374cccc3c on n-h2-856894-1 Sep 10 11:08:15.894971 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-58e8e76d-8cf4-4463-b3a4-d310b9275a8f req-0a592267-cec0-4962-b1d7-793d685efb52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056435 Sep 10 11:08:15.898169 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3751/5198] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:16.303332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d7ef1b45-1975-40f3-bd2e-4005edf04a86 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:16.304961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d7ef1b45-1975-40f3-bd2e-4005edf04a86 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:16.314768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7ef1b45-1975-40f3-bd2e-4005edf04a86 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:16.315676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7ef1b45-1975-40f3-bd2e-4005edf04a86 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:16.316220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7ef1b45-1975-40f3-bd2e-4005edf04a86 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:16.317102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7ef1b45-1975-40f3-bd2e-4005edf04a86 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:16.318110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7ef1b45-1975-40f3-bd2e-4005edf04a86 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:16.318636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7ef1b45-1975-40f3-bd2e-4005edf04a86 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:16.534480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d7ef1b45-1975-40f3-bd2e-4005edf04a86 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:16.548849 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d7ef1b45-1975-40f3-bd2e-4005edf04a86 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1319 microversion: 2.1 time: 0.249262 Sep 10 11:08:16.550492 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1448/5199] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:16 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:16.818129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-671f2a95-da1f-4457-936e-cc1b9ad1a598 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:16.818860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-671f2a95-da1f-4457-936e-cc1b9ad1a598 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:16.836338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671f2a95-da1f-4457-936e-cc1b9ad1a598 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:16.836866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671f2a95-da1f-4457-936e-cc1b9ad1a598 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:16.838822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671f2a95-da1f-4457-936e-cc1b9ad1a598 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:16.842995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671f2a95-da1f-4457-936e-cc1b9ad1a598 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:16.843691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671f2a95-da1f-4457-936e-cc1b9ad1a598 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:16.844537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-671f2a95-da1f-4457-936e-cc1b9ad1a598 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:17.052747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-671f2a95-da1f-4457-936e-cc1b9ad1a598 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:17.061956 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-671f2a95-da1f-4457-936e-cc1b9ad1a598 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.249164 Sep 10 11:08:17.062562 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3752/5200] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:16 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:17.574307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-47c84811-e224-4372-ac56-6023dbe06067 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:17.576224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-47c84811-e224-4372-ac56-6023dbe06067 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:17.604617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47c84811-e224-4372-ac56-6023dbe06067 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:17.606183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47c84811-e224-4372-ac56-6023dbe06067 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:17.609639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47c84811-e224-4372-ac56-6023dbe06067 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:17.610476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47c84811-e224-4372-ac56-6023dbe06067 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:17.610956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47c84811-e224-4372-ac56-6023dbe06067 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:17.611818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-47c84811-e224-4372-ac56-6023dbe06067 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:17.926488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3d6f97b9-a2b4-4b03-a56c-90ca853ae6bd req-957723f4-a244-4983-988c-5d8a3c74f431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8558817-c2c4-4560-b3a7-7c8cf553cf85", "name": "network-vif-plugged", "status": "completed", "tag": "fe8e4495-749c-4ec8-aab2-ba99445a54f5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:17.950662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d6f97b9-a2b4-4b03-a56c-90ca853ae6bd req-957723f4-a244-4983-988c-5d8a3c74f431 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:17.951160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d6f97b9-a2b4-4b03-a56c-90ca853ae6bd req-957723f4-a244-4983-988c-5d8a3c74f431 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:17.951606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d6f97b9-a2b4-4b03-a56c-90ca853ae6bd req-957723f4-a244-4983-988c-5d8a3c74f431 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:17.968137 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3d6f97b9-a2b4-4b03-a56c-90ca853ae6bd req-957723f4-a244-4983-988c-5d8a3c74f431 service nova] Creating event network-vif-plugged:fe8e4495-749c-4ec8-aab2-ba99445a54f5 for instance e8558817-c2c4-4560-b3a7-7c8cf553cf85 on n-h2-856894-1 Sep 10 11:08:17.992912 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3d6f97b9-a2b4-4b03-a56c-90ca853ae6bd req-957723f4-a244-4983-988c-5d8a3c74f431 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070268 Sep 10 11:08:17.994869 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3753/5201] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:08:18.006394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-47c84811-e224-4372-ac56-6023dbe06067 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:18.026181 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-47c84811-e224-4372-ac56-6023dbe06067 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1319 microversion: 2.1 time: 0.455488 Sep 10 11:08:18.027775 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1449/5202] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:17 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:18.087518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d7edb005-6e20-4d14-b63b-5e6920cf6aec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:18.088354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d7edb005-6e20-4d14-b63b-5e6920cf6aec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:18.098976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7edb005-6e20-4d14-b63b-5e6920cf6aec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:18.100332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7edb005-6e20-4d14-b63b-5e6920cf6aec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:18.103084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7edb005-6e20-4d14-b63b-5e6920cf6aec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:18.105160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7edb005-6e20-4d14-b63b-5e6920cf6aec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:18.105834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7edb005-6e20-4d14-b63b-5e6920cf6aec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:18.107704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7edb005-6e20-4d14-b63b-5e6920cf6aec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:18.664202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7edb005-6e20-4d14-b63b-5e6920cf6aec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:18.695104 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d7edb005-6e20-4d14-b63b-5e6920cf6aec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.611333 Sep 10 11:08:18.709764 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3754/5203] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:18 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:19.053617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2131c759-1cb6-454f-944e-cec26e90ec59 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:19.054861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2131c759-1cb6-454f-944e-cec26e90ec59 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:19.061747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2131c759-1cb6-454f-944e-cec26e90ec59 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:19.062461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2131c759-1cb6-454f-944e-cec26e90ec59 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:19.063076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2131c759-1cb6-454f-944e-cec26e90ec59 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:19.063972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2131c759-1cb6-454f-944e-cec26e90ec59 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:19.064594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2131c759-1cb6-454f-944e-cec26e90ec59 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:19.065219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2131c759-1cb6-454f-944e-cec26e90ec59 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:19.352811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2131c759-1cb6-454f-944e-cec26e90ec59 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:19.366304 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2131c759-1cb6-454f-944e-cec26e90ec59 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1319 microversion: 2.1 time: 0.316929 Sep 10 11:08:19.367510 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1450/5204] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:19 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:19.496042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-369f164c-a5fd-4a56-bb95-b4d0b60fb544 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:19.525414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-369f164c-a5fd-4a56-bb95-b4d0b60fb544 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:19.551219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369f164c-a5fd-4a56-bb95-b4d0b60fb544 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:19.556395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369f164c-a5fd-4a56-bb95-b4d0b60fb544 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:19.557038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369f164c-a5fd-4a56-bb95-b4d0b60fb544 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:19.558053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369f164c-a5fd-4a56-bb95-b4d0b60fb544 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:19.559892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369f164c-a5fd-4a56-bb95-b4d0b60fb544 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:19.560349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-369f164c-a5fd-4a56-bb95-b4d0b60fb544 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:19.644427 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-369f164c-a5fd-4a56-bb95-b4d0b60fb544 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "POST /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746/action" status: 200 len: 32636 microversion: 2.1 time: 0.156323 Sep 10 11:08:19.677137 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3755/5205] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:08:19 2022] POST /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746/action => generated 32636 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:08:19.723648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4a0dd3dc-072d-4c1f-9f58-80e0d125c56a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:19.725011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4a0dd3dc-072d-4c1f-9f58-80e0d125c56a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:19.731911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a0dd3dc-072d-4c1f-9f58-80e0d125c56a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:19.732688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a0dd3dc-072d-4c1f-9f58-80e0d125c56a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:19.733485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a0dd3dc-072d-4c1f-9f58-80e0d125c56a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:19.734380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a0dd3dc-072d-4c1f-9f58-80e0d125c56a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:19.735384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a0dd3dc-072d-4c1f-9f58-80e0d125c56a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:19.735971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a0dd3dc-072d-4c1f-9f58-80e0d125c56a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:19.974071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4a0dd3dc-072d-4c1f-9f58-80e0d125c56a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:19.989611 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4a0dd3dc-072d-4c1f-9f58-80e0d125c56a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.268894 Sep 10 11:08:19.991366 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1451/5206] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:19 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:20.394866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-13775a54-eab0-4562-81ed-74cf47975a5a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:20.395853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-13775a54-eab0-4562-81ed-74cf47975a5a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:20.414289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13775a54-eab0-4562-81ed-74cf47975a5a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:20.415411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13775a54-eab0-4562-81ed-74cf47975a5a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:20.416162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13775a54-eab0-4562-81ed-74cf47975a5a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:20.417411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13775a54-eab0-4562-81ed-74cf47975a5a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:20.418062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13775a54-eab0-4562-81ed-74cf47975a5a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:20.418579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13775a54-eab0-4562-81ed-74cf47975a5a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:20.588229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-13775a54-eab0-4562-81ed-74cf47975a5a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:20.599471 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-13775a54-eab0-4562-81ed-74cf47975a5a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 200 len: 1506 microversion: 2.1 time: 0.208852 Sep 10 11:08:20.601538 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3756/5207] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:20 2022] GET /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:20.623323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3f582f84-855c-4b74-a250-735935782c0b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:20.624316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3f582f84-855c-4b74-a250-735935782c0b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: b0bb0301-cc8a-4021-8698-f01374cccc3c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:20.632143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f582f84-855c-4b74-a250-735935782c0b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:20.632634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f582f84-855c-4b74-a250-735935782c0b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:20.633176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f582f84-855c-4b74-a250-735935782c0b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:20.633819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f582f84-855c-4b74-a250-735935782c0b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:20.634275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f582f84-855c-4b74-a250-735935782c0b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:20.634704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f582f84-855c-4b74-a250-735935782c0b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:20.788529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3f582f84-855c-4b74-a250-735935782c0b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:20.804154 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3f582f84-855c-4b74-a250-735935782c0b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/b0bb0301-cc8a-4021-8698-f01374cccc3c" status: 200 len: 1507 microversion: 2.1 time: 0.184067 Sep 10 11:08:20.804754 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1452/5208] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:20 2022] GET /compute/v2.1/servers/b0bb0301-cc8a-4021-8698-f01374cccc3c => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:20.826302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c897288-1552-4a12-a154-4822895cdbf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:20.826893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c897288-1552-4a12-a154-4822895cdbf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: b0bb0301-cc8a-4021-8698-f01374cccc3c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:20.833920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c897288-1552-4a12-a154-4822895cdbf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:20.834448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c897288-1552-4a12-a154-4822895cdbf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:20.834936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c897288-1552-4a12-a154-4822895cdbf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:20.835677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c897288-1552-4a12-a154-4822895cdbf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:20.836360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c897288-1552-4a12-a154-4822895cdbf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:20.836856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c897288-1552-4a12-a154-4822895cdbf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:20.868162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c897288-1552-4a12-a154-4822895cdbf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: b0bb0301-cc8a-4021-8698-f01374cccc3c] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:08:20.983849 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c897288-1552-4a12-a154-4822895cdbf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b0bb0301-cc8a-4021-8698-f01374cccc3c" status: 204 len: 0 microversion: 2.1 time: 0.161169 Sep 10 11:08:20.985587 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3757/5209] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:08:20 2022] DELETE /compute/v2.1/servers/b0bb0301-cc8a-4021-8698-f01374cccc3c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:08:21.000291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-be817fa0-0c1e-402d-9624-20fc7c57ce8a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:21.004336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-be817fa0-0c1e-402d-9624-20fc7c57ce8a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:21.015302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be817fa0-0c1e-402d-9624-20fc7c57ce8a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.015686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-723c1187-9dea-45e0-846f-5df9d131973e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:21.016570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-723c1187-9dea-45e0-846f-5df9d131973e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:21.017115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be817fa0-0c1e-402d-9624-20fc7c57ce8a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.017753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be817fa0-0c1e-402d-9624-20fc7c57ce8a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.018789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be817fa0-0c1e-402d-9624-20fc7c57ce8a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.019431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be817fa0-0c1e-402d-9624-20fc7c57ce8a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.030815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723c1187-9dea-45e0-846f-5df9d131973e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.031331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723c1187-9dea-45e0-846f-5df9d131973e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.031791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723c1187-9dea-45e0-846f-5df9d131973e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.035101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723c1187-9dea-45e0-846f-5df9d131973e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.035548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-be817fa0-0c1e-402d-9624-20fc7c57ce8a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.038822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723c1187-9dea-45e0-846f-5df9d131973e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.039318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-723c1187-9dea-45e0-846f-5df9d131973e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.082339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-be817fa0-0c1e-402d-9624-20fc7c57ce8a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: e8558817-c2c4-4560-b3a7-7c8cf553cf85] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:08:21.191129 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-be817fa0-0c1e-402d-9624-20fc7c57ce8a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85" status: 204 len: 0 microversion: 2.1 time: 0.200772 Sep 10 11:08:21.193126 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1453/5210] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:08:20 2022] DELETE /compute/v2.1/servers/e8558817-c2c4-4560-b3a7-7c8cf553cf85 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:08:21.268888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e4131b98-d532-4b86-89a7-badb3797f96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:21.270269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e4131b98-d532-4b86-89a7-badb3797f96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:21.284233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4131b98-d532-4b86-89a7-badb3797f96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.284744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4131b98-d532-4b86-89a7-badb3797f96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.285495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4131b98-d532-4b86-89a7-badb3797f96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.286482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4131b98-d532-4b86-89a7-badb3797f96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.287088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4131b98-d532-4b86-89a7-badb3797f96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.287526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4131b98-d532-4b86-89a7-badb3797f96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.340908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-723c1187-9dea-45e0-846f-5df9d131973e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:21.352728 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-723c1187-9dea-45e0-846f-5df9d131973e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.342531 Sep 10 11:08:21.353951 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3758/5211] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:21 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:21.360018 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e4131b98-d532-4b86-89a7-badb3797f96e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7/ips" status: 200 len: 150 microversion: 2.1 time: 0.097159 Sep 10 11:08:21.368399 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1454/5212] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 11:08:21 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7/ips => generated 150 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:21.373489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08f0edf2-e681-467e-a8aa-1ad864266a28"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:21.377506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:21.386761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.387373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.388074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.389553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.390263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.390938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.394145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1853078694", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "ab10f319-1486-42b7-808c-280d0258d80a"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:21.492846 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Invalid volume: volume 08f0edf2-e681-467e-a8aa-1ad864266a28 is already attached to instances: cf201661-21b8-4623-b580-b9cafba66341 Sep 10 11:08:21.493033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] validate_networks() for [('ab10f319-1486-42b7-808c-280d0258d80a', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7/os-volume_attachments HTTP/1.1 Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 74 Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: {"volumeAttachment": {"volumeId": "08f0edf2-e681-467e-a8aa-1ad864266a28"}} Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid volume: volume 08f0edf2-e681-467e-a8aa-1ad864266a28 is already attached to instances: cf201661-21b8-4623-b580-b9cafba66341 Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '96a7ff1d-6a10-433b-810e-83327d6b6aa7', 'body': {'volumeAttachment': {'volumeId': '08f0edf2-e681-467e-a8aa-1ad864266a28'}}} Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 08f0edf2-e681-467e-a8aa-1ad864266a28 is already attached to instances: cf201661-21b8-4623-b580-b9cafba66341 Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:08:21.495677 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 08f0edf2-e681-467e-a8aa-1ad864266a28 is already attached to instances: cf201661-21b8-4623-b580-b9cafba66341 Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 08f0edf2-e681-467e-a8aa-1ad864266a28 is already attached to instances: cf201661-21b8-4623-b580-b9cafba66341 Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:08:21.501647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 400 to user: Invalid volume: volume 08f0edf2-e681-467e-a8aa-1ad864266a28 is already attached to instances: cf201661-21b8-4623-b580-b9cafba66341 {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:08:21.503495 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-605b7057-0e60-401c-aecc-5490a3ffb44f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.131437 Sep 10 11:08:21.504561 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3759/5213] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:08:21 2022] POST /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 11:08:21.513669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6881b8ac-0847-42b8-bbaf-ccec1fa9c768 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:21.514255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6881b8ac-0847-42b8-bbaf-ccec1fa9c768 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:21.520428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6881b8ac-0847-42b8-bbaf-ccec1fa9c768 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.520948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6881b8ac-0847-42b8-bbaf-ccec1fa9c768 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.521431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6881b8ac-0847-42b8-bbaf-ccec1fa9c768 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.522533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6881b8ac-0847-42b8-bbaf-ccec1fa9c768 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.522849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6881b8ac-0847-42b8-bbaf-ccec1fa9c768 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.523295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6881b8ac-0847-42b8-bbaf-ccec1fa9c768 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.563006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6881b8ac-0847-42b8-bbaf-ccec1fa9c768 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:08:21.699170 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6881b8ac-0847-42b8-bbaf-ccec1fa9c768 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 204 len: 0 microversion: 2.1 time: 0.189433 Sep 10 11:08:21.699986 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3760/5214] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:08:21 2022] DELETE /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:08:21.713592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a46440c0-0b41-4e38-9734-9d72acbeb5a7 req-4333f3a6-ad43-4105-b317-8fcac5cb77c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0effa7f-ec16-4c53-88e9-e03c342c299e", "name": "network-vif-plugged", "status": "completed", "tag": "0f48d1c5-8417-4dc8-ad6c-a9df0153aa83"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:21.740453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a46440c0-0b41-4e38-9734-9d72acbeb5a7 req-4333f3a6-ad43-4105-b317-8fcac5cb77c3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.741524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a46440c0-0b41-4e38-9734-9d72acbeb5a7 req-4333f3a6-ad43-4105-b317-8fcac5cb77c3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.741969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a46440c0-0b41-4e38-9734-9d72acbeb5a7 req-4333f3a6-ad43-4105-b317-8fcac5cb77c3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.802671 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a46440c0-0b41-4e38-9734-9d72acbeb5a7 req-4333f3a6-ad43-4105-b317-8fcac5cb77c3 service nova] Creating event network-vif-plugged:0f48d1c5-8417-4dc8-ad6c-a9df0153aa83 for instance d0effa7f-ec16-4c53-88e9-e03c342c299e on n-h2-856894-1 Sep 10 11:08:21.815094 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a46440c0-0b41-4e38-9734-9d72acbeb5a7 req-4333f3a6-ad43-4105-b317-8fcac5cb77c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113638 Sep 10 11:08:21.819795 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3761/5215] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:21.834221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c5c05c37-64a3-4434-99c3-30f25be6d5a0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:21.835926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c5c05c37-64a3-4434-99c3-30f25be6d5a0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:21.855135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c05c37-64a3-4434-99c3-30f25be6d5a0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.856099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c05c37-64a3-4434-99c3-30f25be6d5a0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.857695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c05c37-64a3-4434-99c3-30f25be6d5a0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:21.866870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c05c37-64a3-4434-99c3-30f25be6d5a0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:21.867561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c05c37-64a3-4434-99c3-30f25be6d5a0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:21.868672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5c05c37-64a3-4434-99c3-30f25be6d5a0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:22.221877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5c05c37-64a3-4434-99c3-30f25be6d5a0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:22.233885 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c5c05c37-64a3-4434-99c3-30f25be6d5a0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1683 microversion: 2.1 time: 0.408188 Sep 10 11:08:22.235172 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3762/5216] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:21 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1683 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:22.252867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e9c1e6d-2ee3-4a00-addd-fd19007fbe19 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:22.253694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e9c1e6d-2ee3-4a00-addd-fd19007fbe19 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:22.261310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e9c1e6d-2ee3-4a00-addd-fd19007fbe19 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:22.268702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e9c1e6d-2ee3-4a00-addd-fd19007fbe19 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:22.269224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e9c1e6d-2ee3-4a00-addd-fd19007fbe19 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:22.270128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e9c1e6d-2ee3-4a00-addd-fd19007fbe19 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:22.270745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e9c1e6d-2ee3-4a00-addd-fd19007fbe19 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:22.271251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e9c1e6d-2ee3-4a00-addd-fd19007fbe19 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:22.342384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e9c1e6d-2ee3-4a00-addd-fd19007fbe19 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:08:22.450024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:08:22.450582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:08:22.450970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:08:22.451241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:08:22.452157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:08:22.466545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:22.467493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:22.468311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:22.469509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:22.470242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:22.471019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:22.496065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Getting quotas for project 0023c5d33126427f998980ae3d740416. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:08:22.504555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Getting quotas for user 63dc964dc0474d61be32ca9b0f0e9d54 and project 0023c5d33126427f998980ae3d740416. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:08:22.523078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Going to run 2 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:08:22.527179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: da7a6945-0d6f-4b7f-aa84-bf819e1d968c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:08:22.533611 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e9c1e6d-2ee3-4a00-addd-fd19007fbe19 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 204 len: 0 microversion: 2.1 time: 0.294708 Sep 10 11:08:22.534903 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3763/5217] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:08:22 2022] DELETE /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:08:22.543185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b2ef644a-dd97-4884-a0d0-8c6465a96fe0 req-81f65c46-bc72-48a4-9fc6-6e5b5ede00b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a767d108-b969-487e-baf9-c8f14e5a7746", "tag": "c0a2123b-8ff7-4eaa-b49d-0f7a862da857"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:22.559097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b2ef644a-dd97-4884-a0d0-8c6465a96fe0 req-81f65c46-bc72-48a4-9fc6-6e5b5ede00b8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:22.559702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b2ef644a-dd97-4884-a0d0-8c6465a96fe0 req-81f65c46-bc72-48a4-9fc6-6e5b5ede00b8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:22.560930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b2ef644a-dd97-4884-a0d0-8c6465a96fe0 req-81f65c46-bc72-48a4-9fc6-6e5b5ede00b8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:22.580419 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b2ef644a-dd97-4884-a0d0-8c6465a96fe0 req-81f65c46-bc72-48a4-9fc6-6e5b5ede00b8 service nova] Creating event network-changed:c0a2123b-8ff7-4eaa-b49d-0f7a862da857 for instance a767d108-b969-487e-baf9-c8f14e5a7746 on n-h2-856894-1 Sep 10 11:08:22.587139 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b2ef644a-dd97-4884-a0d0-8c6465a96fe0 req-81f65c46-bc72-48a4-9fc6-6e5b5ede00b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049983 Sep 10 11:08:22.591432 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3764/5218] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:22.592860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=da7a6945-0d6f-4b7f-aa84-bf819e1d968c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:08:22.597994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9f89d8b3-1e83-4582-ab58-6d72b2531ad5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:22.598963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9f89d8b3-1e83-4582-ab58-6d72b2531ad5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:22.610568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f89d8b3-1e83-4582-ab58-6d72b2531ad5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:22.611167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f89d8b3-1e83-4582-ab58-6d72b2531ad5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:22.611927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f89d8b3-1e83-4582-ab58-6d72b2531ad5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:22.612817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f89d8b3-1e83-4582-ab58-6d72b2531ad5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:22.613558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f89d8b3-1e83-4582-ab58-6d72b2531ad5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:22.614163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9f89d8b3-1e83-4582-ab58-6d72b2531ad5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:22.710842 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0c49613a-b928-408f-a0ff-9286becaea4c tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.318918 Sep 10 11:08:22.712195 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1455/5219] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:08:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 1322 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Sep 10 11:08:22.721554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4f16554d-1ab2-4a4a-bc04-b0f1d12f86e7 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:22.722691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4f16554d-1ab2-4a4a-bc04-b0f1d12f86e7 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:22.733367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f16554d-1ab2-4a4a-bc04-b0f1d12f86e7 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:22.735253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f16554d-1ab2-4a4a-bc04-b0f1d12f86e7 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:22.740688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f16554d-1ab2-4a4a-bc04-b0f1d12f86e7 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:22.742494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f16554d-1ab2-4a4a-bc04-b0f1d12f86e7 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:22.744623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f16554d-1ab2-4a4a-bc04-b0f1d12f86e7 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:22.745504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4f16554d-1ab2-4a4a-bc04-b0f1d12f86e7 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:23.195700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:23.282344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4f16554d-1ab2-4a4a-bc04-b0f1d12f86e7 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:23.302470 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4f16554d-1ab2-4a4a-bc04-b0f1d12f86e7 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1671 microversion: 2.1 time: 0.588540 Sep 10 11:08:23.322444 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1456/5220] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:22 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1671 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:23.346010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:23.359740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:23.363595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Searching by: {'deleted': False, 'project_id': '0023c5d33126427f998980ae3d740416'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:08:23.389807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9f89d8b3-1e83-4582-ab58-6d72b2531ad5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:23.400225 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9f89d8b3-1e83-4582-ab58-6d72b2531ad5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.807189 Sep 10 11:08:23.401041 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3765/5221] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:22 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:23.407676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c441587-6742-4ec3-aa9d-4842c9b01c7a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:23.408401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2c441587-6742-4ec3-aa9d-4842c9b01c7a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:23.423367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c441587-6742-4ec3-aa9d-4842c9b01c7a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:23.423615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:23.423906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:23.424196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c441587-6742-4ec3-aa9d-4842c9b01c7a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:23.424684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c441587-6742-4ec3-aa9d-4842c9b01c7a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:23.425220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:23.425449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c441587-6742-4ec3-aa9d-4842c9b01c7a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:23.425952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c441587-6742-4ec3-aa9d-4842c9b01c7a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:23.426624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2c441587-6742-4ec3-aa9d-4842c9b01c7a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:23.427231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:23.431373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:23.431813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:23.497848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:08:23.592838 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-10129b09-5dbe-4437-9e9c-39191e5748bb tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.256263 Sep 10 11:08:23.595459 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1457/5222] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 11:08:23 2022] GET /compute/v2.1/servers => generated 1335 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:23.610790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-432a7544-8033-4b2f-8086-249015532a4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:23.611785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-432a7544-8033-4b2f-8086-249015532a4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:23.745477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-432a7544-8033-4b2f-8086-249015532a4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:23.755985 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-432a7544-8033-4b2f-8086-249015532a4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1218 microversion: 2.1 time: 0.151600 Sep 10 11:08:23.767636 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1458/5223] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:23 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:23.783790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2c441587-6742-4ec3-aa9d-4842c9b01c7a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:23.795330 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c441587-6742-4ec3-aa9d-4842c9b01c7a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1683 microversion: 2.1 time: 0.393071 Sep 10 11:08:23.807098 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3766/5224] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:23 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1683 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:24.340642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-33f739ec-088e-4ae2-9aff-8c200313abef tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:24.341522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-33f739ec-088e-4ae2-9aff-8c200313abef tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:24.344024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:24.353264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f739ec-088e-4ae2-9aff-8c200313abef tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:24.353971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f739ec-088e-4ae2-9aff-8c200313abef tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:24.354482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f739ec-088e-4ae2-9aff-8c200313abef tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:24.355269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f739ec-088e-4ae2-9aff-8c200313abef tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:24.355816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f739ec-088e-4ae2-9aff-8c200313abef tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:24.356314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f739ec-088e-4ae2-9aff-8c200313abef tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:24.429760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4a25f9f-c379-4aa2-b828-c038f8714851 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:24.430424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d4a25f9f-c379-4aa2-b828-c038f8714851 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:24.440166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a25f9f-c379-4aa2-b828-c038f8714851 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:24.440921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a25f9f-c379-4aa2-b828-c038f8714851 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:24.443019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a25f9f-c379-4aa2-b828-c038f8714851 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:24.445167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a25f9f-c379-4aa2-b828-c038f8714851 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:24.446736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a25f9f-c379-4aa2-b828-c038f8714851 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:24.447389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d4a25f9f-c379-4aa2-b828-c038f8714851 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:24.563315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-33f739ec-088e-4ae2-9aff-8c200313abef tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:24.574215 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-33f739ec-088e-4ae2-9aff-8c200313abef tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1671 microversion: 2.1 time: 0.237633 Sep 10 11:08:24.575052 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1459/5225] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:24 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1671 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:24.640041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d4a25f9f-c379-4aa2-b828-c038f8714851 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:24.658259 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4a25f9f-c379-4aa2-b828-c038f8714851 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.233042 Sep 10 11:08:24.669134 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3767/5226] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:24 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:24.788857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5d24a6c4-7f0d-4a8e-9784-39a73195eb02 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:24.789834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5d24a6c4-7f0d-4a8e-9784-39a73195eb02 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:24.809863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d24a6c4-7f0d-4a8e-9784-39a73195eb02 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:24.810371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d24a6c4-7f0d-4a8e-9784-39a73195eb02 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:24.810968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d24a6c4-7f0d-4a8e-9784-39a73195eb02 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:24.811904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d24a6c4-7f0d-4a8e-9784-39a73195eb02 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:24.812373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d24a6c4-7f0d-4a8e-9784-39a73195eb02 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:24.812924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d24a6c4-7f0d-4a8e-9784-39a73195eb02 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:24.845765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-598fb421-9fe6-4ba3-9316-2a92277daf74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:24.846790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-598fb421-9fe6-4ba3-9316-2a92277daf74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:24.854067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-598fb421-9fe6-4ba3-9316-2a92277daf74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:24.854886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-598fb421-9fe6-4ba3-9316-2a92277daf74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:24.855552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-598fb421-9fe6-4ba3-9316-2a92277daf74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:24.856594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-598fb421-9fe6-4ba3-9316-2a92277daf74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:24.857307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-598fb421-9fe6-4ba3-9316-2a92277daf74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:24.858007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-598fb421-9fe6-4ba3-9316-2a92277daf74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:24.898659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5d24a6c4-7f0d-4a8e-9784-39a73195eb02 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:24.915446 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5d24a6c4-7f0d-4a8e-9784-39a73195eb02 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1222 microversion: 2.1 time: 0.131108 Sep 10 11:08:24.916024 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1460/5227] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:24 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:25.039694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-598fb421-9fe6-4ba3-9316-2a92277daf74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:25.048344 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-598fb421-9fe6-4ba3-9316-2a92277daf74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1683 microversion: 2.1 time: 0.208188 Sep 10 11:08:25.049203 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3768/5228] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:24 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:25.600010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2e4c278a-6af1-4a88-a173-96a637ca3bb5 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:25.601300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2e4c278a-6af1-4a88-a173-96a637ca3bb5 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:25.607269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e4c278a-6af1-4a88-a173-96a637ca3bb5 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:25.607759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e4c278a-6af1-4a88-a173-96a637ca3bb5 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:25.608191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e4c278a-6af1-4a88-a173-96a637ca3bb5 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:25.608879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e4c278a-6af1-4a88-a173-96a637ca3bb5 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:25.609356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e4c278a-6af1-4a88-a173-96a637ca3bb5 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:25.609783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e4c278a-6af1-4a88-a173-96a637ca3bb5 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:25.613842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:25.769518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2e4c278a-6af1-4a88-a173-96a637ca3bb5 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:25.778223 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2e4c278a-6af1-4a88-a173-96a637ca3bb5 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1671 microversion: 2.1 time: 0.181966 Sep 10 11:08:25.779124 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1461/5229] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:25 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:25.940140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6aed4877-4a7b-4a1b-9f70-88e4278ff02f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:25.940557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6aed4877-4a7b-4a1b-9f70-88e4278ff02f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:25.948823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aed4877-4a7b-4a1b-9f70-88e4278ff02f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:25.952648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aed4877-4a7b-4a1b-9f70-88e4278ff02f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:25.953344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aed4877-4a7b-4a1b-9f70-88e4278ff02f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:25.954233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aed4877-4a7b-4a1b-9f70-88e4278ff02f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:25.954886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aed4877-4a7b-4a1b-9f70-88e4278ff02f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:25.955477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6aed4877-4a7b-4a1b-9f70-88e4278ff02f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:25.968400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fdbfad80-cd07-4300-8d9a-346614f06158 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:25.969767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fdbfad80-cd07-4300-8d9a-346614f06158 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:25.981298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbfad80-cd07-4300-8d9a-346614f06158 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:25.984067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbfad80-cd07-4300-8d9a-346614f06158 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:25.984696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbfad80-cd07-4300-8d9a-346614f06158 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:25.985807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbfad80-cd07-4300-8d9a-346614f06158 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:25.997092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbfad80-cd07-4300-8d9a-346614f06158 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:25.997676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fdbfad80-cd07-4300-8d9a-346614f06158 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:26.041593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6aed4877-4a7b-4a1b-9f70-88e4278ff02f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:26.056692 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6aed4877-4a7b-4a1b-9f70-88e4278ff02f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1222 microversion: 2.1 time: 0.120399 Sep 10 11:08:26.058060 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1462/5230] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:25 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:26.089470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a4c833fa-4344-4acc-8fd5-7cf26e10ffd5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:26.093987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a4c833fa-4344-4acc-8fd5-7cf26e10ffd5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:26.111683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4c833fa-4344-4acc-8fd5-7cf26e10ffd5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:26.112498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4c833fa-4344-4acc-8fd5-7cf26e10ffd5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:26.113541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4c833fa-4344-4acc-8fd5-7cf26e10ffd5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:26.114408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4c833fa-4344-4acc-8fd5-7cf26e10ffd5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:26.114916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4c833fa-4344-4acc-8fd5-7cf26e10ffd5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:26.115435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4c833fa-4344-4acc-8fd5-7cf26e10ffd5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:26.286958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fdbfad80-cd07-4300-8d9a-346614f06158 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:26.300423 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fdbfad80-cd07-4300-8d9a-346614f06158 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.616909 Sep 10 11:08:26.301850 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3769/5231] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:25 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:26.305813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a4c833fa-4344-4acc-8fd5-7cf26e10ffd5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:26.317969 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a4c833fa-4344-4acc-8fd5-7cf26e10ffd5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1683 microversion: 2.1 time: 0.239451 Sep 10 11:08:26.321585 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1463/5232] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:26 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1683 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:26.802915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ef17635-e3fd-4186-b16b-c50dcf8ef264 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:26.805102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ef17635-e3fd-4186-b16b-c50dcf8ef264 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:26.815738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ef17635-e3fd-4186-b16b-c50dcf8ef264 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:26.817189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ef17635-e3fd-4186-b16b-c50dcf8ef264 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:26.817886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ef17635-e3fd-4186-b16b-c50dcf8ef264 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:26.819646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ef17635-e3fd-4186-b16b-c50dcf8ef264 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:26.820387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ef17635-e3fd-4186-b16b-c50dcf8ef264 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:26.821316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ef17635-e3fd-4186-b16b-c50dcf8ef264 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:27.083907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5869619d-47c6-461d-8c22-57f055b9125f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:27.092501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5869619d-47c6-461d-8c22-57f055b9125f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:27.102740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5869619d-47c6-461d-8c22-57f055b9125f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:27.106209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5869619d-47c6-461d-8c22-57f055b9125f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:27.108316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5869619d-47c6-461d-8c22-57f055b9125f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:27.109320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5869619d-47c6-461d-8c22-57f055b9125f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:27.110183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5869619d-47c6-461d-8c22-57f055b9125f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:27.112502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5869619d-47c6-461d-8c22-57f055b9125f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:27.251328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5869619d-47c6-461d-8c22-57f055b9125f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:27.261996 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5869619d-47c6-461d-8c22-57f055b9125f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1214 microversion: 2.1 time: 0.183851 Sep 10 11:08:27.263472 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1464/5233] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:27 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:27.327030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a4a41bc9-905b-49fc-8ec6-662ca25c6b2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:27.327570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a4a41bc9-905b-49fc-8ec6-662ca25c6b2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:27.335934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a41bc9-905b-49fc-8ec6-662ca25c6b2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:27.336428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a41bc9-905b-49fc-8ec6-662ca25c6b2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:27.336919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a41bc9-905b-49fc-8ec6-662ca25c6b2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:27.337887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a41bc9-905b-49fc-8ec6-662ca25c6b2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:27.338346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a41bc9-905b-49fc-8ec6-662ca25c6b2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:27.338769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a41bc9-905b-49fc-8ec6-662ca25c6b2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:27.533756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5ef17635-e3fd-4186-b16b-c50dcf8ef264 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:27.550667 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ef17635-e3fd-4186-b16b-c50dcf8ef264 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1671 microversion: 2.1 time: 0.751805 Sep 10 11:08:27.552192 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3770/5234] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:26 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1671 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:27.562088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ce7a8f7e-5fb5-4ded-b1bc-4cb023c2120c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:27.562993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ce7a8f7e-5fb5-4ded-b1bc-4cb023c2120c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:27.576896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7a8f7e-5fb5-4ded-b1bc-4cb023c2120c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:27.578202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7a8f7e-5fb5-4ded-b1bc-4cb023c2120c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:27.578719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7a8f7e-5fb5-4ded-b1bc-4cb023c2120c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:27.579689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7a8f7e-5fb5-4ded-b1bc-4cb023c2120c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:27.580318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7a8f7e-5fb5-4ded-b1bc-4cb023c2120c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:27.581111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ce7a8f7e-5fb5-4ded-b1bc-4cb023c2120c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:27.896214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a4a41bc9-905b-49fc-8ec6-662ca25c6b2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:27.904371 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a4a41bc9-905b-49fc-8ec6-662ca25c6b2d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1375 microversion: 2.1 time: 0.582387 Sep 10 11:08:27.910605 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1465/5235] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:27 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1375 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:27.963740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ce7a8f7e-5fb5-4ded-b1bc-4cb023c2120c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:27.985875 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ce7a8f7e-5fb5-4ded-b1bc-4cb023c2120c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1683 microversion: 2.1 time: 0.426003 Sep 10 11:08:27.985875 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3771/5236] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:27 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1683 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:28.289010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-85aef33b-62c4-47ad-8382-cb4e59ff606b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:28.290421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-85aef33b-62c4-47ad-8382-cb4e59ff606b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:28.303969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85aef33b-62c4-47ad-8382-cb4e59ff606b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:28.305809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85aef33b-62c4-47ad-8382-cb4e59ff606b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:28.307980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85aef33b-62c4-47ad-8382-cb4e59ff606b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:28.308823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85aef33b-62c4-47ad-8382-cb4e59ff606b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:28.311734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85aef33b-62c4-47ad-8382-cb4e59ff606b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:28.313407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85aef33b-62c4-47ad-8382-cb4e59ff606b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:28.581306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b98e5a35-2aa4-403e-9f7f-ffc30d59255f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:28.593467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b98e5a35-2aa4-403e-9f7f-ffc30d59255f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:28.607312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b98e5a35-2aa4-403e-9f7f-ffc30d59255f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:28.619117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b98e5a35-2aa4-403e-9f7f-ffc30d59255f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:28.621132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b98e5a35-2aa4-403e-9f7f-ffc30d59255f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:28.624294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b98e5a35-2aa4-403e-9f7f-ffc30d59255f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:28.624998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b98e5a35-2aa4-403e-9f7f-ffc30d59255f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:28.630304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b98e5a35-2aa4-403e-9f7f-ffc30d59255f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:28.650487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-85aef33b-62c4-47ad-8382-cb4e59ff606b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:28.663832 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-85aef33b-62c4-47ad-8382-cb4e59ff606b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1214 microversion: 2.1 time: 0.379748 Sep 10 11:08:28.684345 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1466/5237] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:28 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1214 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:28.856441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b98e5a35-2aa4-403e-9f7f-ffc30d59255f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:28.875006 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b98e5a35-2aa4-403e-9f7f-ffc30d59255f tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1603 microversion: 2.1 time: 0.299485 Sep 10 11:08:28.876362 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3772/5238] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:28 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1603 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:28.929063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-485b408e-d709-43b3-a4d2-5dd4855cb9b8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:28.929924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-485b408e-d709-43b3-a4d2-5dd4855cb9b8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:28.954082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-485b408e-d709-43b3-a4d2-5dd4855cb9b8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:28.955072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-485b408e-d709-43b3-a4d2-5dd4855cb9b8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:28.955931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-485b408e-d709-43b3-a4d2-5dd4855cb9b8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:28.957056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-485b408e-d709-43b3-a4d2-5dd4855cb9b8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:28.966288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-485b408e-d709-43b3-a4d2-5dd4855cb9b8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:28.967042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-485b408e-d709-43b3-a4d2-5dd4855cb9b8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:28.976925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-711a5ae4-21be-404f-8c72-b3cbc98d34bc req-71af3b83-d20c-4d30-ac4b-8dc795f4fa0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a767d108-b969-487e-baf9-c8f14e5a7746", "name": "network-vif-deleted", "tag": "c0a2123b-8ff7-4eaa-b49d-0f7a862da857"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:29.066948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-711a5ae4-21be-404f-8c72-b3cbc98d34bc req-71af3b83-d20c-4d30-ac4b-8dc795f4fa0a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:29.070714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-711a5ae4-21be-404f-8c72-b3cbc98d34bc req-71af3b83-d20c-4d30-ac4b-8dc795f4fa0a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:29.071656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-711a5ae4-21be-404f-8c72-b3cbc98d34bc req-71af3b83-d20c-4d30-ac4b-8dc795f4fa0a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:29.118544 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-711a5ae4-21be-404f-8c72-b3cbc98d34bc req-71af3b83-d20c-4d30-ac4b-8dc795f4fa0a service nova] Creating event network-vif-deleted:c0a2123b-8ff7-4eaa-b49d-0f7a862da857 for instance a767d108-b969-487e-baf9-c8f14e5a7746 on n-h2-856894-1 Sep 10 11:08:29.136467 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-711a5ae4-21be-404f-8c72-b3cbc98d34bc req-71af3b83-d20c-4d30-ac4b-8dc795f4fa0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164354 Sep 10 11:08:29.137479 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3773/5239] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:29.153050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e4ef7633-d72c-414b-acae-bb76555a6257 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:29.157186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e4ef7633-d72c-414b-acae-bb76555a6257 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:29.173995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ef7633-d72c-414b-acae-bb76555a6257 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:29.179477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ef7633-d72c-414b-acae-bb76555a6257 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:29.180157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ef7633-d72c-414b-acae-bb76555a6257 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:29.181146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ef7633-d72c-414b-acae-bb76555a6257 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:29.181798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ef7633-d72c-414b-acae-bb76555a6257 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:29.182413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e4ef7633-d72c-414b-acae-bb76555a6257 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:29.475049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e4ef7633-d72c-414b-acae-bb76555a6257 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:29.491769 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e4ef7633-d72c-414b-acae-bb76555a6257 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1615 microversion: 2.1 time: 0.351267 Sep 10 11:08:29.492400 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3774/5240] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:29 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1615 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:29.541298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-277286b1-ba06-44f6-ae0a-5474afdbcdf0 req-cb26d2d3-595f-48d0-ae78-75b33445216f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bb0301-cc8a-4021-8698-f01374cccc3c", "name": "network-vif-deleted", "tag": "faa09232-7597-4d98-82d7-eba609b5a2f8"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:29.553948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-277286b1-ba06-44f6-ae0a-5474afdbcdf0 req-cb26d2d3-595f-48d0-ae78-75b33445216f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:29.555073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-277286b1-ba06-44f6-ae0a-5474afdbcdf0 req-cb26d2d3-595f-48d0-ae78-75b33445216f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:29.555349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-277286b1-ba06-44f6-ae0a-5474afdbcdf0 req-cb26d2d3-595f-48d0-ae78-75b33445216f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:29.569480 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-277286b1-ba06-44f6-ae0a-5474afdbcdf0 req-cb26d2d3-595f-48d0-ae78-75b33445216f service nova] Creating event network-vif-deleted:faa09232-7597-4d98-82d7-eba609b5a2f8 for instance b0bb0301-cc8a-4021-8698-f01374cccc3c on n-h2-856894-1 Sep 10 11:08:29.574589 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-277286b1-ba06-44f6-ae0a-5474afdbcdf0 req-cb26d2d3-595f-48d0-ae78-75b33445216f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066296 Sep 10 11:08:29.575465 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3775/5241] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:29.692200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9ef1e5ab-0fb1-47a3-8a22-13e3f5173c1b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:29.693713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9ef1e5ab-0fb1-47a3-8a22-13e3f5173c1b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:29.710756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef1e5ab-0fb1-47a3-8a22-13e3f5173c1b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:29.712579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef1e5ab-0fb1-47a3-8a22-13e3f5173c1b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:29.713275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef1e5ab-0fb1-47a3-8a22-13e3f5173c1b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:29.715429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef1e5ab-0fb1-47a3-8a22-13e3f5173c1b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:29.716340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef1e5ab-0fb1-47a3-8a22-13e3f5173c1b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:29.717622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9ef1e5ab-0fb1-47a3-8a22-13e3f5173c1b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.150991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-485b408e-d709-43b3-a4d2-5dd4855cb9b8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:30.166147 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-485b408e-d709-43b3-a4d2-5dd4855cb9b8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1562 microversion: 2.1 time: 1.242794 Sep 10 11:08:30.171927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9ef1e5ab-0fb1-47a3-8a22-13e3f5173c1b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:30.180633 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9ef1e5ab-0fb1-47a3-8a22-13e3f5173c1b tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1270 microversion: 2.1 time: 0.492851 Sep 10 11:08:30.185414 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3776/5242] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:29 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1270 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:30.188669 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1467/5243] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:28 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1562 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:30.191030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:30.191934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:30.193489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b5d6f041-d32f-46ca-a9f9-4e5038a7e40b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:30.194154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b5d6f041-d32f-46ca-a9f9-4e5038a7e40b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:30.209147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5d6f041-d32f-46ca-a9f9-4e5038a7e40b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:30.209964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:30.210279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:30.210751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.211504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:30.211797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5d6f041-d32f-46ca-a9f9-4e5038a7e40b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:30.211984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:30.212240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5d6f041-d32f-46ca-a9f9-4e5038a7e40b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.213316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5d6f041-d32f-46ca-a9f9-4e5038a7e40b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:30.213949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5d6f041-d32f-46ca-a9f9-4e5038a7e40b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:30.214546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5d6f041-d32f-46ca-a9f9-4e5038a7e40b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.228082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.327528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:30.328066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:30.328524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.332038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lazy-loading 'fault' on Instance uuid a767d108-b969-487e-baf9-c8f14e5a7746 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:08:30.523099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:30.531362 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1f5e745d-2ac9-4d60-ba25-22379aadca62 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1489 microversion: 2.1 time: 0.344663 Sep 10 11:08:30.545836 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3777/5244] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:30 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1489 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:30.551634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:30.610696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:30.632657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b5d6f041-d32f-46ca-a9f9-4e5038a7e40b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:30.633409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:30.635629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:30.639981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.640992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:30.661581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:30.662284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.672254 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b5d6f041-d32f-46ca-a9f9-4e5038a7e40b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1562 microversion: 2.1 time: 0.481360 Sep 10 11:08:30.673769 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1468/5245] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:30 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1562 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:30.733806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:30.734868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:30.735914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.736579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lazy-loading 'fault' on Instance uuid 96a7ff1d-6a10-433b-810e-83327d6b6aa7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:08:30.842111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-902a5b0a-437c-44f5-a412-0d31c079a49d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:30.844374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-902a5b0a-437c-44f5-a412-0d31c079a49d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:30.860859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-902a5b0a-437c-44f5-a412-0d31c079a49d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:30.861390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-902a5b0a-437c-44f5-a412-0d31c079a49d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:30.861831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-902a5b0a-437c-44f5-a412-0d31c079a49d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.862535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-902a5b0a-437c-44f5-a412-0d31c079a49d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:30.862988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-902a5b0a-437c-44f5-a412-0d31c079a49d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:30.863415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-902a5b0a-437c-44f5-a412-0d31c079a49d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:30.873082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:30.886492 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85be0760-4651-45f2-bb95-3bba953e5a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1332 microversion: 2.1 time: 0.338560 Sep 10 11:08:30.888498 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3778/5246] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:30 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1332 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:30.934463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-902a5b0a-437c-44f5-a412-0d31c079a49d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:08:31.090102 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-902a5b0a-437c-44f5-a412-0d31c079a49d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 204 len: 0 microversion: 2.1 time: 0.258841 Sep 10 11:08:31.091554 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1469/5247] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:08:30 2022] DELETE /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:08:31.099896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c84d368-3ee2-430b-b129-769e6cfb58f6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:31.101140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6c84d368-3ee2-430b-b129-769e6cfb58f6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:31.108462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c84d368-3ee2-430b-b129-769e6cfb58f6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.109597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c84d368-3ee2-430b-b129-769e6cfb58f6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.110239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c84d368-3ee2-430b-b129-769e6cfb58f6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.111979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c84d368-3ee2-430b-b129-769e6cfb58f6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.113089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c84d368-3ee2-430b-b129-769e6cfb58f6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.113714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c84d368-3ee2-430b-b129-769e6cfb58f6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.186513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-23fa523c-f86b-4b28-a3f4-1ec96e48f764 req-5ec0fe4a-e5cb-440c-aa1c-dcfa1d40d602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8558817-c2c4-4560-b3a7-7c8cf553cf85", "name": "network-vif-deleted", "tag": "fe8e4495-749c-4ec8-aab2-ba99445a54f5"}, {"server_uuid": "96a7ff1d-6a10-433b-810e-83327d6b6aa7", "name": "network-vif-deleted", "tag": "44d576eb-9280-4f38-963e-4a571dbf2835"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:31.200884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-23fa523c-f86b-4b28-a3f4-1ec96e48f764 req-5ec0fe4a-e5cb-440c-aa1c-dcfa1d40d602 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.202026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-23fa523c-f86b-4b28-a3f4-1ec96e48f764 req-5ec0fe4a-e5cb-440c-aa1c-dcfa1d40d602 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.202706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-23fa523c-f86b-4b28-a3f4-1ec96e48f764 req-5ec0fe4a-e5cb-440c-aa1c-dcfa1d40d602 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.235525 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-23fa523c-f86b-4b28-a3f4-1ec96e48f764 req-5ec0fe4a-e5cb-440c-aa1c-dcfa1d40d602 service nova] Creating event network-vif-deleted:fe8e4495-749c-4ec8-aab2-ba99445a54f5 for instance e8558817-c2c4-4560-b3a7-7c8cf553cf85 on n-h2-856894-1 Sep 10 11:08:31.237852 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-23fa523c-f86b-4b28-a3f4-1ec96e48f764 req-5ec0fe4a-e5cb-440c-aa1c-dcfa1d40d602 service nova] Creating event network-vif-deleted:44d576eb-9280-4f38-963e-4a571dbf2835 for instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 on n-h2-856894-1 Sep 10 11:08:31.258771 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-23fa523c-f86b-4b28-a3f4-1ec96e48f764 req-5ec0fe4a-e5cb-440c-aa1c-dcfa1d40d602 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077095 Sep 10 11:08:31.261864 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1470/5248] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:31.276425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4abb8c5f-56d3-43f5-a8c0-09caf0540420 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:31.281252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4abb8c5f-56d3-43f5-a8c0-09caf0540420 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:31.297940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4abb8c5f-56d3-43f5-a8c0-09caf0540420 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.298610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4abb8c5f-56d3-43f5-a8c0-09caf0540420 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.299161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4abb8c5f-56d3-43f5-a8c0-09caf0540420 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.303670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4abb8c5f-56d3-43f5-a8c0-09caf0540420 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.304424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4abb8c5f-56d3-43f5-a8c0-09caf0540420 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.308048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4abb8c5f-56d3-43f5-a8c0-09caf0540420 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.437162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4abb8c5f-56d3-43f5-a8c0-09caf0540420 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:31.451470 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4abb8c5f-56d3-43f5-a8c0-09caf0540420 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1276 microversion: 2.1 time: 0.188216 Sep 10 11:08:31.452347 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1471/5249] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:31 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1276 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:31.519028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6c84d368-3ee2-430b-b129-769e6cfb58f6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:31.555732 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c84d368-3ee2-430b-b129-769e6cfb58f6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1568 microversion: 2.1 time: 0.458970 Sep 10 11:08:31.559346 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3779/5250] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:31 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1568 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:31.560838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:31.562291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:31.588765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.589305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.589754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.593905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.595917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.596376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.696060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.696566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.697012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.697509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lazy-loading 'fault' on Instance uuid a767d108-b969-487e-baf9-c8f14e5a7746 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:08:31.917761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:31.918727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:31.919565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:31.932608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.933140 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8d0f0b50-25bf-4f04-b72e-4ebcb7970adc tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1489 microversion: 2.1 time: 0.378765 Sep 10 11:08:31.936114 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1472/5251] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:31 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1489 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:31.937032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.937761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.939004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.939721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.940414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.994437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:31.994958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:31.995428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:31.996023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lazy-loading 'fault' on Instance uuid 96a7ff1d-6a10-433b-810e-83327d6b6aa7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:08:32.081940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:32.095171 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f42dfe2-15c2-4f35-ba8b-d2d5de55352a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1332 microversion: 2.1 time: 0.182173 Sep 10 11:08:32.096292 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3780/5252] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:31 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1332 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:32.481746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7b93e922-317f-4165-8a9d-fe56e6e4fdfd tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:32.482588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7b93e922-317f-4165-8a9d-fe56e6e4fdfd tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:32.496157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b93e922-317f-4165-8a9d-fe56e6e4fdfd tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:32.497044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b93e922-317f-4165-8a9d-fe56e6e4fdfd tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:32.497744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b93e922-317f-4165-8a9d-fe56e6e4fdfd tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:32.498678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b93e922-317f-4165-8a9d-fe56e6e4fdfd tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:32.499696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b93e922-317f-4165-8a9d-fe56e6e4fdfd tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:32.500558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7b93e922-317f-4165-8a9d-fe56e6e4fdfd tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:32.593029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4afcbd0f-4d0d-4773-a74a-4eecd7f11666 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:32.600455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4afcbd0f-4d0d-4773-a74a-4eecd7f11666 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:32.625272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7b93e922-317f-4165-8a9d-fe56e6e4fdfd tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:32.633443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:32.640211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4afcbd0f-4d0d-4773-a74a-4eecd7f11666 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:32.643000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4afcbd0f-4d0d-4773-a74a-4eecd7f11666 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:32.643632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4afcbd0f-4d0d-4773-a74a-4eecd7f11666 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:32.644845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4afcbd0f-4d0d-4773-a74a-4eecd7f11666 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:32.646478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4afcbd0f-4d0d-4773-a74a-4eecd7f11666 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:32.647600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4afcbd0f-4d0d-4773-a74a-4eecd7f11666 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:32.659747 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7b93e922-317f-4165-8a9d-fe56e6e4fdfd tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1276 microversion: 2.1 time: 0.183684 Sep 10 11:08:32.677193 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1473/5253] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:32 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:32.977746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:32.979196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:33.003904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:33.006438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:33.008154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:33.008999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:33.012902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:33.013404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:33.135555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:33.136106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:33.145036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:33.155409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lazy-loading 'fault' on Instance uuid a767d108-b969-487e-baf9-c8f14e5a7746 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:08:33.194470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4afcbd0f-4d0d-4773-a74a-4eecd7f11666 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:33.202730 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4afcbd0f-4d0d-4773-a74a-4eecd7f11666 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1568 microversion: 2.1 time: 0.613501 Sep 10 11:08:33.203331 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3781/5254] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:32 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1568 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:33.221040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:33.226604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:33.254665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:33.255588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:33.256448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:33.257442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:33.257985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:33.258498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:33.300685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:33.328173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5075387b0b14438ab9164683b752b867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78b1d49bc8c4c35aa78e48220a3685c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:33.339535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:33.341316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:33.342809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:33.344391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lazy-loading 'fault' on Instance uuid 96a7ff1d-6a10-433b-810e-83327d6b6aa7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:08:33.348740 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-93ee10fd-3766-420c-b96c-e0414fd103ea tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 200 len: 1489 microversion: 2.1 time: 0.388131 Sep 10 11:08:33.358438 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1474/5255] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:32 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 1489 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:33.498226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:33.546381 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b587b7e8-dde9-45c9-8e1c-74d02e1c21bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1332 microversion: 2.1 time: 0.335461 Sep 10 11:08:33.549823 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3782/5256] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:33 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1332 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:33.692404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96575e8b-08db-41ea-803f-172aca8f5170 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:33.693614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-96575e8b-08db-41ea-803f-172aca8f5170 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:33.712837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:33.734064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96575e8b-08db-41ea-803f-172aca8f5170 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:33.736866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96575e8b-08db-41ea-803f-172aca8f5170 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:33.739974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96575e8b-08db-41ea-803f-172aca8f5170 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:33.745027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96575e8b-08db-41ea-803f-172aca8f5170 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:33.748080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96575e8b-08db-41ea-803f-172aca8f5170 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:33.748545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96575e8b-08db-41ea-803f-172aca8f5170 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:33.770287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:34.233881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-010280bc-4a9d-4491-a6c4-819f8cf17100 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:34.234672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-010280bc-4a9d-4491-a6c4-819f8cf17100 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:34.252207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-010280bc-4a9d-4491-a6c4-819f8cf17100 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:34.253837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-010280bc-4a9d-4491-a6c4-819f8cf17100 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:34.255575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-010280bc-4a9d-4491-a6c4-819f8cf17100 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:34.258285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-010280bc-4a9d-4491-a6c4-819f8cf17100 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:34.260141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-010280bc-4a9d-4491-a6c4-819f8cf17100 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:34.263446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-010280bc-4a9d-4491-a6c4-819f8cf17100 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:34.602807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-96575e8b-08db-41ea-803f-172aca8f5170 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:34.613245 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-96575e8b-08db-41ea-803f-172aca8f5170 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1318 microversion: 2.1 time: 0.925289 Sep 10 11:08:34.630011 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1475/5257] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:33 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1318 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:34.648963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:34.649625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] [instance: a767d108-b969-487e-baf9-c8f14e5a7746] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:34.665964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:34.666736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:34.667381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:34.674229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:34.675007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:34.675617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:34.749129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:34.759658 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] HTTP exception thrown: Instance a767d108-b969-487e-baf9-c8f14e5a7746 could not be found. Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Request method failure captured: Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 HTTP/1.1 Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG849gzEElinsUq6kAchRQxggwjcpykb8dLhQhKJesZPZ0JE8uImB0N-I-8R-YdHs6brdNdnPEzFRMLxl0t45Uv7d8H-4zvplsG97Pt5lPQXQo1Yspo3SwmKXsDlK8M4G_Cyu9UmZ4mZmr6r5zH_WJmJXGoUkLCcfYzyIwWW0wZ8K_o Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: a78b1d49bc8c4c35aa78e48220a3685c Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestNetworkBasicOps-480786429 Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a78b1d49bc8c4c35aa78e48220a3685c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a78b1d49bc8c4c35aa78e48220a3685c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a78b1d49bc8c4c35aa78e48220a3685c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a78b1d49bc8c4c35aa78e48220a3685c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestNetworkBasicOps-480786429 Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: a78b1d49bc8c4c35aa78e48220a3685c Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestNetworkBasicOps-480786429 Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestNetworkBasicOps-480786429-project Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 5075387b0b14438ab9164683b752b867 Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestNetworkBasicOps-480786429-project Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance a767d108-b969-487e-baf9-c8f14e5a7746 could not be found. Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'a767d108-b969-487e-baf9-c8f14e5a7746'} Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a767d108-b969-487e-baf9-c8f14e5a7746 could not be found. Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a767d108-b969-487e-baf9-c8f14e5a7746 could not be found. Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:34.760589 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:34.765232 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:34.765232 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:34.765232 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:34.765232 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:08:34.765232 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:08:34.765232 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a767d108-b969-487e-baf9-c8f14e5a7746 could not be found. Sep 10 11:08:34.765232 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:34.765816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Returning 404 to user: Instance a767d108-b969-487e-baf9-c8f14e5a7746 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:08:34.766642 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-51d8c620-248d-4681-b413-418a60dd6466 tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746" status: 404 len: 111 microversion: 2.1 time: 0.135245 Sep 10 11:08:34.782445 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1476/5258] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:34 2022] GET /compute/v2.1/servers/a767d108-b969-487e-baf9-c8f14e5a7746 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:08:34.790527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:34.791154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:34.807922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:34.808443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:34.808882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:34.809674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:34.810138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:34.810575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:34.883764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:34.884265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:34.884714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:34.885214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lazy-loading 'fault' on Instance uuid 96a7ff1d-6a10-433b-810e-83327d6b6aa7 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:08:35.007857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-010280bc-4a9d-4491-a6c4-819f8cf17100 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:35.021511 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-010280bc-4a9d-4491-a6c4-819f8cf17100 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1568 microversion: 2.1 time: 0.793469 Sep 10 11:08:35.023284 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3783/5259] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:34 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1568 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:35.027609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:35.036255 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1d2ac462-e709-42ab-8e33-bca1f53e0d1b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 200 len: 1332 microversion: 2.1 time: 0.252431 Sep 10 11:08:35.049319 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1477/5260] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:34 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 1332 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:35.463940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7396328a-f881-47a5-9ed6-37bc962e3b73 req-84610c12-bf54-41c2-b7d4-f76484707ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7a6945-0d6f-4b7f-aa84-bf819e1d968c", "tag": "cfa6c35c-870e-4f93-8be0-cd411546eeb7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:35.494906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7396328a-f881-47a5-9ed6-37bc962e3b73 req-84610c12-bf54-41c2-b7d4-f76484707ceb service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:35.496394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7396328a-f881-47a5-9ed6-37bc962e3b73 req-84610c12-bf54-41c2-b7d4-f76484707ceb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:35.497046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7396328a-f881-47a5-9ed6-37bc962e3b73 req-84610c12-bf54-41c2-b7d4-f76484707ceb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:35.519424 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7396328a-f881-47a5-9ed6-37bc962e3b73 req-84610c12-bf54-41c2-b7d4-f76484707ceb service nova] Creating event network-changed:cfa6c35c-870e-4f93-8be0-cd411546eeb7 for instance da7a6945-0d6f-4b7f-aa84-bf819e1d968c on n-h2-856894-1 Sep 10 11:08:35.530778 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7396328a-f881-47a5-9ed6-37bc962e3b73 req-84610c12-bf54-41c2-b7d4-f76484707ceb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072577 Sep 10 11:08:35.541874 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3784/5261] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:35.649958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-df3fe88e-bb94-440b-8cc9-48b5d839b941 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:35.650670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-df3fe88e-bb94-440b-8cc9-48b5d839b941 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:35.669981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df3fe88e-bb94-440b-8cc9-48b5d839b941 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:35.670502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df3fe88e-bb94-440b-8cc9-48b5d839b941 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:35.670955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df3fe88e-bb94-440b-8cc9-48b5d839b941 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:35.677010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df3fe88e-bb94-440b-8cc9-48b5d839b941 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:35.678981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df3fe88e-bb94-440b-8cc9-48b5d839b941 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:35.679944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df3fe88e-bb94-440b-8cc9-48b5d839b941 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:35.720386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4568caad-7070-4c57-a5de-079e545b2eba tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] Calling method '.version_select at 0x7efcad317310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:35.799540 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4568caad-7070-4c57-a5de-079e545b2eba tempest-TestNetworkBasicOps-480786429 tempest-TestNetworkBasicOps-480786429-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2136408561" status: 202 len: 0 microversion: 2.1 time: 0.083869 Sep 10 11:08:35.801192 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3785/5262] 10.222.0.20 () {58 vars in 1257 bytes} [Sat Sep 10 11:08:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2136408561 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:08:36.051589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-608b6ca8-aea5-4df4-a429-db5bb1be68db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:36.052528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-608b6ca8-aea5-4df4-a429-db5bb1be68db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:36.066165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-608b6ca8-aea5-4df4-a429-db5bb1be68db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:36.075312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-608b6ca8-aea5-4df4-a429-db5bb1be68db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:36.075816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-608b6ca8-aea5-4df4-a429-db5bb1be68db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:36.079206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-608b6ca8-aea5-4df4-a429-db5bb1be68db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:36.079790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-608b6ca8-aea5-4df4-a429-db5bb1be68db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:36.080257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-608b6ca8-aea5-4df4-a429-db5bb1be68db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:36.198482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-df3fe88e-bb94-440b-8cc9-48b5d839b941 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:36.206595 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-df3fe88e-bb94-440b-8cc9-48b5d839b941 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1318 microversion: 2.1 time: 0.561561 Sep 10 11:08:36.213926 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1478/5263] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:35 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:36.238885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:36.245621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:36.280012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:36.280685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:36.281411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:36.282912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:36.283632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:36.284292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:36.314830 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 HTTP/1.1 Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '96a7ff1d-6a10-433b-810e-83327d6b6aa7'} Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:36.321684 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:36.326673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:36.326673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:36.326673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:36.326673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:08:36.326673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:08:36.326673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:08:36.326673 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:36.331164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:08:36.332282 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-76e379e5-2d75-4890-b90a-5a4c72d00772 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 404 len: 111 microversion: 2.1 time: 0.105011 Sep 10 11:08:36.338099 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1479/5264] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:36 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:08:36.346292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-92ecd021-b50d-4c7d-9805-4b5c1fa0da74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '.version_select at 0x7efcae61eb80>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:36.388320 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-92ecd021-b50d-4c7d-9805-4b5c1fa0da74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703126854" status: 202 len: 0 microversion: 2.1 time: 0.045791 Sep 10 11:08:36.389635 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1480/5265] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 11:08:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703126854 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:08:36.396630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-608b6ca8-aea5-4df4-a429-db5bb1be68db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:36.406918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-608b6ca8-aea5-4df4-a429-db5bb1be68db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1360 microversion: 2.1 time: 0.361515 Sep 10 11:08:36.411108 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3786/5266] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:36 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1360 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:37.240156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-539f5f46-7d27-4bbf-aaba-33997f98dc90 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:37.240985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-539f5f46-7d27-4bbf-aaba-33997f98dc90 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:37.254202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-539f5f46-7d27-4bbf-aaba-33997f98dc90 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:37.271141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-539f5f46-7d27-4bbf-aaba-33997f98dc90 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:37.272788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-539f5f46-7d27-4bbf-aaba-33997f98dc90 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:37.274005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-539f5f46-7d27-4bbf-aaba-33997f98dc90 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:37.275081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-539f5f46-7d27-4bbf-aaba-33997f98dc90 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:37.278092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-539f5f46-7d27-4bbf-aaba-33997f98dc90 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:37.437501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51fae49b-9b94-4e10-b238-43bf6a6e8dbf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:37.438875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51fae49b-9b94-4e10-b238-43bf6a6e8dbf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:37.446677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51fae49b-9b94-4e10-b238-43bf6a6e8dbf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:37.453492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51fae49b-9b94-4e10-b238-43bf6a6e8dbf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:37.454413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51fae49b-9b94-4e10-b238-43bf6a6e8dbf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:37.456208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51fae49b-9b94-4e10-b238-43bf6a6e8dbf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:37.463205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51fae49b-9b94-4e10-b238-43bf6a6e8dbf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:37.464389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51fae49b-9b94-4e10-b238-43bf6a6e8dbf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:37.931787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-51fae49b-9b94-4e10-b238-43bf6a6e8dbf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:37.970474 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51fae49b-9b94-4e10-b238-43bf6a6e8dbf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1360 microversion: 2.1 time: 0.536741 Sep 10 11:08:37.993534 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3787/5267] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:37 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1360 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:37.999950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-63a4144d-3b97-4e73-9a9d-ca0cfdc03d57 req-0af41263-cded-44bd-af25-5e6f829718b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0effa7f-ec16-4c53-88e9-e03c342c299e", "name": "network-vif-deleted", "tag": "0f48d1c5-8417-4dc8-ad6c-a9df0153aa83"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:38.020823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-63a4144d-3b97-4e73-9a9d-ca0cfdc03d57 req-0af41263-cded-44bd-af25-5e6f829718b4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:38.022358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-63a4144d-3b97-4e73-9a9d-ca0cfdc03d57 req-0af41263-cded-44bd-af25-5e6f829718b4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:38.023061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-63a4144d-3b97-4e73-9a9d-ca0cfdc03d57 req-0af41263-cded-44bd-af25-5e6f829718b4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:38.052407 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-63a4144d-3b97-4e73-9a9d-ca0cfdc03d57 req-0af41263-cded-44bd-af25-5e6f829718b4 service nova] Creating event network-vif-deleted:0f48d1c5-8417-4dc8-ad6c-a9df0153aa83 for instance d0effa7f-ec16-4c53-88e9-e03c342c299e on n-h2-856894-1 Sep 10 11:08:38.058497 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-63a4144d-3b97-4e73-9a9d-ca0cfdc03d57 req-0af41263-cded-44bd-af25-5e6f829718b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063000 Sep 10 11:08:38.059718 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3788/5268] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:38.262774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-539f5f46-7d27-4bbf-aaba-33997f98dc90 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:38.271223 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-539f5f46-7d27-4bbf-aaba-33997f98dc90 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1318 microversion: 2.1 time: 1.035285 Sep 10 11:08:38.274227 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1481/5269] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:37 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1318 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:38.778365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6415a64b-cc7b-4ee6-ac0f-f9e0f0d682bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:38.779735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6415a64b-cc7b-4ee6-ac0f-f9e0f0d682bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:38.795486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6415a64b-cc7b-4ee6-ac0f-f9e0f0d682bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:38.798992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6415a64b-cc7b-4ee6-ac0f-f9e0f0d682bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:38.799756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6415a64b-cc7b-4ee6-ac0f-f9e0f0d682bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:38.800760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6415a64b-cc7b-4ee6-ac0f-f9e0f0d682bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:38.801498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6415a64b-cc7b-4ee6-ac0f-f9e0f0d682bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:38.819554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6415a64b-cc7b-4ee6-ac0f-f9e0f0d682bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:38.998226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aca2cdbb-27c6-4554-9138-3b23d30f22e5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:39.000014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-aca2cdbb-27c6-4554-9138-3b23d30f22e5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:39.017641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-6415a64b-cc7b-4ee6-ac0f-f9e0f0d682bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lazy-loading 'services' on Instance uuid cf201661-21b8-4623-b580-b9cafba66341 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:08:39.030422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aca2cdbb-27c6-4554-9138-3b23d30f22e5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:39.035162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aca2cdbb-27c6-4554-9138-3b23d30f22e5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:39.035737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aca2cdbb-27c6-4554-9138-3b23d30f22e5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:39.039232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aca2cdbb-27c6-4554-9138-3b23d30f22e5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:39.044594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aca2cdbb-27c6-4554-9138-3b23d30f22e5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:39.046596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aca2cdbb-27c6-4554-9138-3b23d30f22e5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:39.202913 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6415a64b-cc7b-4ee6-ac0f-f9e0f0d682bf tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments/08f0edf2-e681-467e-a8aa-1ad864266a28" status: 202 len: 0 microversion: 2.1 time: 0.428587 Sep 10 11:08:39.203642 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3789/5270] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:08:38 2022] DELETE /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments/08f0edf2-e681-467e-a8aa-1ad864266a28 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:08:39.210753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a304a514-1210-46a8-81e1-605ed4663bb2 req-cc5f60f2-9e70-45bf-94ef-9d0a6d819c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d022d3c-088d-458f-8163-b9779f84500b", "tag": "7deed0d5-76b5-4daa-ac3d-ec228fec7d83"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:39.253997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a304a514-1210-46a8-81e1-605ed4663bb2 req-cc5f60f2-9e70-45bf-94ef-9d0a6d819c5a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:39.255681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a304a514-1210-46a8-81e1-605ed4663bb2 req-cc5f60f2-9e70-45bf-94ef-9d0a6d819c5a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:39.258965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a304a514-1210-46a8-81e1-605ed4663bb2 req-cc5f60f2-9e70-45bf-94ef-9d0a6d819c5a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:39.291804 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a304a514-1210-46a8-81e1-605ed4663bb2 req-cc5f60f2-9e70-45bf-94ef-9d0a6d819c5a service nova] Creating event network-changed:7deed0d5-76b5-4daa-ac3d-ec228fec7d83 for instance 0d022d3c-088d-458f-8163-b9779f84500b on n-h2-856894-1 Sep 10 11:08:39.315008 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a304a514-1210-46a8-81e1-605ed4663bb2 req-cc5f60f2-9e70-45bf-94ef-9d0a6d819c5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109643 Sep 10 11:08:39.316234 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3790/5271] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:39.322473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-643b493e-a89b-4874-8313-791c6a17f68a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:39.331850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-643b493e-a89b-4874-8313-791c6a17f68a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:39.348000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-aca2cdbb-27c6-4554-9138-3b23d30f22e5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:39.351130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643b493e-a89b-4874-8313-791c6a17f68a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:39.353171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643b493e-a89b-4874-8313-791c6a17f68a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:39.353851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643b493e-a89b-4874-8313-791c6a17f68a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:39.354766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643b493e-a89b-4874-8313-791c6a17f68a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:39.355627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643b493e-a89b-4874-8313-791c6a17f68a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:39.356366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-643b493e-a89b-4874-8313-791c6a17f68a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:39.360634 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aca2cdbb-27c6-4554-9138-3b23d30f22e5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1360 microversion: 2.1 time: 0.366383 Sep 10 11:08:39.363564 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1482/5272] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:38 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1360 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:39.399143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-265394b9-8a03-46cf-9061-5a22100d906a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:39.407288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-265394b9-8a03-46cf-9061-5a22100d906a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:39.423935 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-643b493e-a89b-4874-8313-791c6a17f68a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102460 Sep 10 11:08:39.424960 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3791/5273] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:39 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:39.426995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-265394b9-8a03-46cf-9061-5a22100d906a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:39.435796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-265394b9-8a03-46cf-9061-5a22100d906a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:39.439616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-265394b9-8a03-46cf-9061-5a22100d906a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:39.442924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-265394b9-8a03-46cf-9061-5a22100d906a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:39.444740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-265394b9-8a03-46cf-9061-5a22100d906a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:39.451387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-265394b9-8a03-46cf-9061-5a22100d906a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:39.813720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-265394b9-8a03-46cf-9061-5a22100d906a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:39.823034 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-265394b9-8a03-46cf-9061-5a22100d906a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1318 microversion: 2.1 time: 0.454337 Sep 10 11:08:39.826751 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1483/5274] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:39 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:40.386731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0334ecc1-4ad0-4407-93b9-8e7a12dd506c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:40.387399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0334ecc1-4ad0-4407-93b9-8e7a12dd506c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:40.402451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0334ecc1-4ad0-4407-93b9-8e7a12dd506c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:40.403006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0334ecc1-4ad0-4407-93b9-8e7a12dd506c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:40.403495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0334ecc1-4ad0-4407-93b9-8e7a12dd506c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:40.404277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0334ecc1-4ad0-4407-93b9-8e7a12dd506c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:40.411113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0334ecc1-4ad0-4407-93b9-8e7a12dd506c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:40.411832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0334ecc1-4ad0-4407-93b9-8e7a12dd506c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:40.437164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f2ba6710-f437-409f-8b45-fb07ca32d160 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:40.440268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f2ba6710-f437-409f-8b45-fb07ca32d160 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:40.452477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2ba6710-f437-409f-8b45-fb07ca32d160 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:40.456372 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2ba6710-f437-409f-8b45-fb07ca32d160 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:40.457201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2ba6710-f437-409f-8b45-fb07ca32d160 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:40.458183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2ba6710-f437-409f-8b45-fb07ca32d160 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:40.460578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2ba6710-f437-409f-8b45-fb07ca32d160 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:40.461334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f2ba6710-f437-409f-8b45-fb07ca32d160 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:40.529303 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f2ba6710-f437-409f-8b45-fb07ca32d160 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095959 Sep 10 11:08:40.534784 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1484/5275] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:40 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:40.853964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-06fae6b1-b9a1-4374-b24b-754b1cb53e11 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:40.854724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-06fae6b1-b9a1-4374-b24b-754b1cb53e11 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:40.868941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06fae6b1-b9a1-4374-b24b-754b1cb53e11 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:40.869476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06fae6b1-b9a1-4374-b24b-754b1cb53e11 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:40.869985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06fae6b1-b9a1-4374-b24b-754b1cb53e11 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:40.870773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06fae6b1-b9a1-4374-b24b-754b1cb53e11 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:40.871302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06fae6b1-b9a1-4374-b24b-754b1cb53e11 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:40.878288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06fae6b1-b9a1-4374-b24b-754b1cb53e11 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:41.157491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0334ecc1-4ad0-4407-93b9-8e7a12dd506c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:41.200571 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0334ecc1-4ad0-4407-93b9-8e7a12dd506c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1360 microversion: 2.1 time: 0.816834 Sep 10 11:08:41.203807 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3792/5276] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:40 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1360 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:41.311311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-06fae6b1-b9a1-4374-b24b-754b1cb53e11 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:41.321359 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-06fae6b1-b9a1-4374-b24b-754b1cb53e11 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1318 microversion: 2.1 time: 0.471908 Sep 10 11:08:41.325736 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1485/5277] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:40 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:41.544877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f106104-00de-4a2d-9c72-179912ff3f02 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:41.547274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f106104-00de-4a2d-9c72-179912ff3f02 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:41.579263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f106104-00de-4a2d-9c72-179912ff3f02 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:41.582275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f106104-00de-4a2d-9c72-179912ff3f02 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:41.585331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f106104-00de-4a2d-9c72-179912ff3f02 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:41.587325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f106104-00de-4a2d-9c72-179912ff3f02 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:41.589426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f106104-00de-4a2d-9c72-179912ff3f02 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:41.591112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f106104-00de-4a2d-9c72-179912ff3f02 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:41.708573 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f106104-00de-4a2d-9c72-179912ff3f02 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168537 Sep 10 11:08:41.715971 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3793/5278] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:41 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:42.229151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b7f1ebd8-9cdb-4c37-9e71-14afa84c81c4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:42.230476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b7f1ebd8-9cdb-4c37-9e71-14afa84c81c4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:42.237812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebd8-9cdb-4c37-9e71-14afa84c81c4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:42.249994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebd8-9cdb-4c37-9e71-14afa84c81c4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:42.250786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebd8-9cdb-4c37-9e71-14afa84c81c4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:42.251728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebd8-9cdb-4c37-9e71-14afa84c81c4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:42.252365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebd8-9cdb-4c37-9e71-14afa84c81c4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:42.252983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebd8-9cdb-4c37-9e71-14afa84c81c4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:42.348694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8493637-56e1-402a-938a-e85e7c916647 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:42.350540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f8493637-56e1-402a-938a-e85e7c916647 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:42.362126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8493637-56e1-402a-938a-e85e7c916647 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:42.362904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8493637-56e1-402a-938a-e85e7c916647 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:42.365766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8493637-56e1-402a-938a-e85e7c916647 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:42.367171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8493637-56e1-402a-938a-e85e7c916647 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:42.369198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8493637-56e1-402a-938a-e85e7c916647 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:42.370007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8493637-56e1-402a-938a-e85e7c916647 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:42.460801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b7f1ebd8-9cdb-4c37-9e71-14afa84c81c4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:42.471120 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b7f1ebd8-9cdb-4c37-9e71-14afa84c81c4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1360 microversion: 2.1 time: 0.245935 Sep 10 11:08:42.478536 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1486/5279] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:42 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1360 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:42.728646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9175cc2b-ee4e-4904-867b-ca4ca70136f9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:42.731345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9175cc2b-ee4e-4904-867b-ca4ca70136f9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:42.747550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9175cc2b-ee4e-4904-867b-ca4ca70136f9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:42.749654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9175cc2b-ee4e-4904-867b-ca4ca70136f9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:42.758978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9175cc2b-ee4e-4904-867b-ca4ca70136f9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:42.760102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9175cc2b-ee4e-4904-867b-ca4ca70136f9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:42.760761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9175cc2b-ee4e-4904-867b-ca4ca70136f9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:42.761508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9175cc2b-ee4e-4904-867b-ca4ca70136f9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:42.843642 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9175cc2b-ee4e-4904-867b-ca4ca70136f9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119674 Sep 10 11:08:42.845042 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1487/5280] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:42 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:43.083882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f8493637-56e1-402a-938a-e85e7c916647 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:43.093084 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8493637-56e1-402a-938a-e85e7c916647 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1318 microversion: 2.1 time: 0.748982 Sep 10 11:08:43.099202 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3794/5281] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:42 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1318 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:43.554320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0acbe5e2-42a9-4a12-b76c-d711e1d6d9a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:43.555740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0acbe5e2-42a9-4a12-b76c-d711e1d6d9a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:43.579466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0acbe5e2-42a9-4a12-b76c-d711e1d6d9a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:43.581526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0acbe5e2-42a9-4a12-b76c-d711e1d6d9a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:43.581971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0acbe5e2-42a9-4a12-b76c-d711e1d6d9a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:43.582706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0acbe5e2-42a9-4a12-b76c-d711e1d6d9a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:43.583165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0acbe5e2-42a9-4a12-b76c-d711e1d6d9a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:43.583588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0acbe5e2-42a9-4a12-b76c-d711e1d6d9a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:43.775210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0acbe5e2-42a9-4a12-b76c-d711e1d6d9a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:43.785703 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0acbe5e2-42a9-4a12-b76c-d711e1d6d9a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1360 microversion: 2.1 time: 0.277856 Sep 10 11:08:43.789126 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1488/5282] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:43 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1360 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:43.860024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d7f0412-538d-48a3-89c9-708f6101bdc0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:43.866129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d7f0412-538d-48a3-89c9-708f6101bdc0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:43.898987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7f0412-538d-48a3-89c9-708f6101bdc0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:43.899745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7f0412-538d-48a3-89c9-708f6101bdc0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:43.900378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7f0412-538d-48a3-89c9-708f6101bdc0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:43.904703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7f0412-538d-48a3-89c9-708f6101bdc0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:43.905685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7f0412-538d-48a3-89c9-708f6101bdc0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:43.906417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7f0412-538d-48a3-89c9-708f6101bdc0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:43.984428 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d7f0412-538d-48a3-89c9-708f6101bdc0 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129189 Sep 10 11:08:43.986168 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3795/5283] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:43 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:44.125555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e582d279-8c7b-4668-91b5-af53dc04605a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:44.126570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e582d279-8c7b-4668-91b5-af53dc04605a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:44.137890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e582d279-8c7b-4668-91b5-af53dc04605a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:44.138602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e582d279-8c7b-4668-91b5-af53dc04605a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:44.141463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e582d279-8c7b-4668-91b5-af53dc04605a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:44.142396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e582d279-8c7b-4668-91b5-af53dc04605a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:44.143082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e582d279-8c7b-4668-91b5-af53dc04605a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:44.144835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e582d279-8c7b-4668-91b5-af53dc04605a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:44.813776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:44.814578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:44.825630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:44.829481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:44.830041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:44.832690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:44.833350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:44.835754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:44.892781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e582d279-8c7b-4668-91b5-af53dc04605a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:44.901577 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e582d279-8c7b-4668-91b5-af53dc04605a tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1318 microversion: 2.1 time: 0.780233 Sep 10 11:08:44.906262 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1489/5284] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:44 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:44.943441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:44.946109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:44.946706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:44.951618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lazy-loading 'fault' on Instance uuid d0effa7f-ec16-4c53-88e9-e03c342c299e {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:08:44.996302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0dec53b7-302c-49e3-b06d-3c6b49b11e66 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:44.998794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0dec53b7-302c-49e3-b06d-3c6b49b11e66 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:45.011301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dec53b7-302c-49e3-b06d-3c6b49b11e66 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:45.012055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dec53b7-302c-49e3-b06d-3c6b49b11e66 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:45.012650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dec53b7-302c-49e3-b06d-3c6b49b11e66 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:45.017883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dec53b7-302c-49e3-b06d-3c6b49b11e66 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:45.018574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dec53b7-302c-49e3-b06d-3c6b49b11e66 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:45.019200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dec53b7-302c-49e3-b06d-3c6b49b11e66 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:45.078550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:45.095292 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0dec53b7-302c-49e3-b06d-3c6b49b11e66 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102861 Sep 10 11:08:45.095884 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1490/5285] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:44 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:08:45.103509 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2fd36ad-1d73-4f62-ad55-5110654c9fca tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 200 len: 1365 microversion: 2.1 time: 0.289686 Sep 10 11:08:45.105467 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3796/5286] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:44 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:45.258930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-52879b47-bb36-4a59-b725-e78103494017 req-f796840e-0833-4a92-a907-4f219ed5baec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7a6945-0d6f-4b7f-aa84-bf819e1d968c", "name": "network-vif-plugged", "status": "completed", "tag": "cfa6c35c-870e-4f93-8be0-cd411546eeb7"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:45.277675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-52879b47-bb36-4a59-b725-e78103494017 req-f796840e-0833-4a92-a907-4f219ed5baec service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:45.278217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-52879b47-bb36-4a59-b725-e78103494017 req-f796840e-0833-4a92-a907-4f219ed5baec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:45.278654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-52879b47-bb36-4a59-b725-e78103494017 req-f796840e-0833-4a92-a907-4f219ed5baec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:45.312448 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-52879b47-bb36-4a59-b725-e78103494017 req-f796840e-0833-4a92-a907-4f219ed5baec service nova] Creating event network-vif-plugged:cfa6c35c-870e-4f93-8be0-cd411546eeb7 for instance da7a6945-0d6f-4b7f-aa84-bf819e1d968c on n-h2-856894-1 Sep 10 11:08:45.327506 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-52879b47-bb36-4a59-b725-e78103494017 req-f796840e-0833-4a92-a907-4f219ed5baec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072627 Sep 10 11:08:45.331111 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1491/5287] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:45.934910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e4c54e3-b4bd-447a-83d4-47a45c595bf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:45.935848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9e4c54e3-b4bd-447a-83d4-47a45c595bf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:45.953192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e4c54e3-b4bd-447a-83d4-47a45c595bf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:45.953637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e4c54e3-b4bd-447a-83d4-47a45c595bf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:45.954106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e4c54e3-b4bd-447a-83d4-47a45c595bf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:45.954860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e4c54e3-b4bd-447a-83d4-47a45c595bf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:45.955340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e4c54e3-b4bd-447a-83d4-47a45c595bf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:45.955790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e4c54e3-b4bd-447a-83d4-47a45c595bf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:46.111731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b73f04d9-5f4f-4c82-ab8a-530a1e94115c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:46.114296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b73f04d9-5f4f-4c82-ab8a-530a1e94115c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:46.135766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73f04d9-5f4f-4c82-ab8a-530a1e94115c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:46.136420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73f04d9-5f4f-4c82-ab8a-530a1e94115c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:46.137618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73f04d9-5f4f-4c82-ab8a-530a1e94115c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:46.138461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73f04d9-5f4f-4c82-ab8a-530a1e94115c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:46.143338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73f04d9-5f4f-4c82-ab8a-530a1e94115c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:46.143723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b73f04d9-5f4f-4c82-ab8a-530a1e94115c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:46.254993 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b73f04d9-5f4f-4c82-ab8a-530a1e94115c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150095 Sep 10 11:08:46.261368 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1492/5288] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:46 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:46.273395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:46.274217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:46.290590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:46.291293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:46.293334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:46.294312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:46.296824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:46.297541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:46.346765 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e HTTP/1.1 Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'd0effa7f-ec16-4c53-88e9-e03c342c299e'} Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:46.352257 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:46.360420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:46.360420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:46.360420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:46.360420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:08:46.360420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:08:46.360420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:08:46.360420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:46.360420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:08:46.360420 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c2f5d2bc-de05-46e3-a9f6-4d31477db4a2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 404 len: 111 microversion: 2.1 time: 0.091337 Sep 10 11:08:46.360420 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1493/5289] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:46 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:08:46.498120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9e4c54e3-b4bd-447a-83d4-47a45c595bf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:46.536889 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9e4c54e3-b4bd-447a-83d4-47a45c595bf9 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1318 microversion: 2.1 time: 0.606938 Sep 10 11:08:46.538276 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3797/5290] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:45 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1318 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:47.270059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-63a1a042-ec64-4e0d-9e9a-8053fe6e7b81 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:47.272538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-63a1a042-ec64-4e0d-9e9a-8053fe6e7b81 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:47.292692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63a1a042-ec64-4e0d-9e9a-8053fe6e7b81 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:47.295982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63a1a042-ec64-4e0d-9e9a-8053fe6e7b81 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:47.299141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63a1a042-ec64-4e0d-9e9a-8053fe6e7b81 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:47.302091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63a1a042-ec64-4e0d-9e9a-8053fe6e7b81 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:47.303939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63a1a042-ec64-4e0d-9e9a-8053fe6e7b81 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:47.306155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63a1a042-ec64-4e0d-9e9a-8053fe6e7b81 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:47.378030 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-63a1a042-ec64-4e0d-9e9a-8053fe6e7b81 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112983 Sep 10 11:08:47.383979 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1494/5291] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:47 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:47.565269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-992bac6b-87b0-4a1c-84ca-32bbcdef979e tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:47.567661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-992bac6b-87b0-4a1c-84ca-32bbcdef979e tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:47.597215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-992bac6b-87b0-4a1c-84ca-32bbcdef979e tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:47.598460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-992bac6b-87b0-4a1c-84ca-32bbcdef979e tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:47.600298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-992bac6b-87b0-4a1c-84ca-32bbcdef979e tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:47.601380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-992bac6b-87b0-4a1c-84ca-32bbcdef979e tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:47.603580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-992bac6b-87b0-4a1c-84ca-32bbcdef979e tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:47.605269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-992bac6b-87b0-4a1c-84ca-32bbcdef979e tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:47.978816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-a5950c9e-46c9-4537-a90d-67e4bd1ef532 req-8ff30d76-7a46-4753-8228-b5ec524d46ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d022d3c-088d-458f-8163-b9779f84500b", "name": "network-vif-plugged", "status": "completed", "tag": "7deed0d5-76b5-4daa-ac3d-ec228fec7d83"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:47.998409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a5950c9e-46c9-4537-a90d-67e4bd1ef532 req-8ff30d76-7a46-4753-8228-b5ec524d46ce service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:47.998970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a5950c9e-46c9-4537-a90d-67e4bd1ef532 req-8ff30d76-7a46-4753-8228-b5ec524d46ce service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:48.000249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a5950c9e-46c9-4537-a90d-67e4bd1ef532 req-8ff30d76-7a46-4753-8228-b5ec524d46ce service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:48.029035 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-a5950c9e-46c9-4537-a90d-67e4bd1ef532 req-8ff30d76-7a46-4753-8228-b5ec524d46ce service nova] Creating event network-vif-plugged:7deed0d5-76b5-4daa-ac3d-ec228fec7d83 for instance 0d022d3c-088d-458f-8163-b9779f84500b on n-h2-856894-1 Sep 10 11:08:48.055493 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-a5950c9e-46c9-4537-a90d-67e4bd1ef532 req-8ff30d76-7a46-4753-8228-b5ec524d46ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079850 Sep 10 11:08:48.057594 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1495/5292] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:48.392622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5d1fcbfd-7d17-42a7-b985-d739ca752c79 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:48.395078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5d1fcbfd-7d17-42a7-b985-d739ca752c79 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:48.415036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d1fcbfd-7d17-42a7-b985-d739ca752c79 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:48.418686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d1fcbfd-7d17-42a7-b985-d739ca752c79 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:48.422186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d1fcbfd-7d17-42a7-b985-d739ca752c79 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:48.424010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d1fcbfd-7d17-42a7-b985-d739ca752c79 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:48.424770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d1fcbfd-7d17-42a7-b985-d739ca752c79 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:48.426541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5d1fcbfd-7d17-42a7-b985-d739ca752c79 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:48.525409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:48.559658 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5d1fcbfd-7d17-42a7-b985-d739ca752c79 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172506 Sep 10 11:08:48.560869 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1496/5293] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:48 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:08:48.593236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-992bac6b-87b0-4a1c-84ca-32bbcdef979e tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:48.604174 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-992bac6b-87b0-4a1c-84ca-32bbcdef979e tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1318 microversion: 2.1 time: 1.046198 Sep 10 11:08:48.610002 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3798/5294] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:47 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1318 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:49.575190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1f7a6438-34eb-4049-84ef-c072f21b9b37 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:49.580042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1f7a6438-34eb-4049-84ef-c072f21b9b37 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:49.606131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f7a6438-34eb-4049-84ef-c072f21b9b37 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:49.607595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f7a6438-34eb-4049-84ef-c072f21b9b37 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:49.609189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f7a6438-34eb-4049-84ef-c072f21b9b37 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:49.611678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f7a6438-34eb-4049-84ef-c072f21b9b37 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:49.612449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f7a6438-34eb-4049-84ef-c072f21b9b37 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:49.613685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f7a6438-34eb-4049-84ef-c072f21b9b37 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:49.635856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f482b7c0-bbdf-4ca9-9eee-28f07f4bda4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:49.636559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f482b7c0-bbdf-4ca9-9eee-28f07f4bda4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:49.650891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f482b7c0-bbdf-4ca9-9eee-28f07f4bda4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:49.651432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f482b7c0-bbdf-4ca9-9eee-28f07f4bda4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:49.652901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f482b7c0-bbdf-4ca9-9eee-28f07f4bda4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:49.655780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f482b7c0-bbdf-4ca9-9eee-28f07f4bda4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:49.657668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f482b7c0-bbdf-4ca9-9eee-28f07f4bda4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:49.658899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f482b7c0-bbdf-4ca9-9eee-28f07f4bda4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:49.683412 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1f7a6438-34eb-4049-84ef-c072f21b9b37 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115434 Sep 10 11:08:49.687912 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1497/5295] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:49 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:50.004039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f482b7c0-bbdf-4ca9-9eee-28f07f4bda4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:50.015988 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f482b7c0-bbdf-4ca9-9eee-28f07f4bda4f tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1505 microversion: 2.1 time: 0.385262 Sep 10 11:08:50.017411 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3799/5296] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:49 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:08:50.040914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c76ee451-e666-4e18-8b8b-a2ff24d4b981 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:50.041988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c76ee451-e666-4e18-8b8b-a2ff24d4b981 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: da7a6945-0d6f-4b7f-aa84-bf819e1d968c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:50.061417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c76ee451-e666-4e18-8b8b-a2ff24d4b981 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:50.062063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c76ee451-e666-4e18-8b8b-a2ff24d4b981 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:50.063684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c76ee451-e666-4e18-8b8b-a2ff24d4b981 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:50.064426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c76ee451-e666-4e18-8b8b-a2ff24d4b981 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:50.064886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c76ee451-e666-4e18-8b8b-a2ff24d4b981 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:50.065336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c76ee451-e666-4e18-8b8b-a2ff24d4b981 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:50.352223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c76ee451-e666-4e18-8b8b-a2ff24d4b981 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:50.362822 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c76ee451-e666-4e18-8b8b-a2ff24d4b981 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c" status: 200 len: 1506 microversion: 2.1 time: 0.326602 Sep 10 11:08:50.365945 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1498/5297] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:50 2022] GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:50.399708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bdff99dd-7d66-476c-a707-5ee61b456be2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:50.400565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bdff99dd-7d66-476c-a707-5ee61b456be2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: da7a6945-0d6f-4b7f-aa84-bf819e1d968c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:50.414602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdff99dd-7d66-476c-a707-5ee61b456be2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:50.415650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdff99dd-7d66-476c-a707-5ee61b456be2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:50.416412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdff99dd-7d66-476c-a707-5ee61b456be2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:50.417389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdff99dd-7d66-476c-a707-5ee61b456be2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:50.417851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdff99dd-7d66-476c-a707-5ee61b456be2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:50.418473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bdff99dd-7d66-476c-a707-5ee61b456be2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:50.469748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:50.483500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bdff99dd-7d66-476c-a707-5ee61b456be2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: da7a6945-0d6f-4b7f-aa84-bf819e1d968c] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:08:50.585312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bdff99dd-7d66-476c-a707-5ee61b456be2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c" status: 204 len: 0 microversion: 2.1 time: 0.189367 Sep 10 11:08:50.586184 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3800/5298] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:08:50 2022] DELETE /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:08:50.594834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-32f8dc36-9f34-43f6-ab73-8e33057829e2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:50.595969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-32f8dc36-9f34-43f6-ab73-8e33057829e2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:50.603471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32f8dc36-9f34-43f6-ab73-8e33057829e2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:50.604154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32f8dc36-9f34-43f6-ab73-8e33057829e2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:50.604842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32f8dc36-9f34-43f6-ab73-8e33057829e2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:50.606260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32f8dc36-9f34-43f6-ab73-8e33057829e2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:50.606889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32f8dc36-9f34-43f6-ab73-8e33057829e2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:50.607482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32f8dc36-9f34-43f6-ab73-8e33057829e2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:50.640989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-32f8dc36-9f34-43f6-ab73-8e33057829e2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:08:50.702010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-777dcac6-49d1-456c-9662-ed42cf3dff9d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:50.704588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-777dcac6-49d1-456c-9662-ed42cf3dff9d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:50.724268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-777dcac6-49d1-456c-9662-ed42cf3dff9d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:50.725353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-777dcac6-49d1-456c-9662-ed42cf3dff9d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:50.725810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-777dcac6-49d1-456c-9662-ed42cf3dff9d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:50.726535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-777dcac6-49d1-456c-9662-ed42cf3dff9d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:50.727003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-777dcac6-49d1-456c-9662-ed42cf3dff9d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:50.727439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-777dcac6-49d1-456c-9662-ed42cf3dff9d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:50.736387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:08:50.741414 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-32f8dc36-9f34-43f6-ab73-8e33057829e2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 204 len: 0 microversion: 2.1 time: 0.150563 Sep 10 11:08:50.745232 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1499/5299] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:08:50 2022] DELETE /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:08:50.752539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-50b144d6-dee3-4d78-83aa-2ac2dc104bc2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:50.753360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-50b144d6-dee3-4d78-83aa-2ac2dc104bc2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: da7a6945-0d6f-4b7f-aa84-bf819e1d968c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:50.761370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b144d6-dee3-4d78-83aa-2ac2dc104bc2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:50.762078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b144d6-dee3-4d78-83aa-2ac2dc104bc2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:50.762817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b144d6-dee3-4d78-83aa-2ac2dc104bc2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:50.763754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b144d6-dee3-4d78-83aa-2ac2dc104bc2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:50.765144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b144d6-dee3-4d78-83aa-2ac2dc104bc2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:50.765883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b144d6-dee3-4d78-83aa-2ac2dc104bc2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:50.793455 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-777dcac6-49d1-456c-9662-ed42cf3dff9d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095786 Sep 10 11:08:50.794059 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3801/5300] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:50 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:51.235042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-50b144d6-dee3-4d78-83aa-2ac2dc104bc2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:51.243709 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-50b144d6-dee3-4d78-83aa-2ac2dc104bc2 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c" status: 200 len: 1512 microversion: 2.1 time: 0.496630 Sep 10 11:08:51.245415 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1500/5301] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:50 2022] GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c => generated 1512 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:51.806531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27c61923-3175-4f68-99e1-70b8c99cdfa3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:51.808733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-27c61923-3175-4f68-99e1-70b8c99cdfa3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:51.823061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27c61923-3175-4f68-99e1-70b8c99cdfa3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:51.823559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27c61923-3175-4f68-99e1-70b8c99cdfa3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:51.824378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27c61923-3175-4f68-99e1-70b8c99cdfa3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:51.825882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27c61923-3175-4f68-99e1-70b8c99cdfa3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:51.827073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27c61923-3175-4f68-99e1-70b8c99cdfa3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:51.835337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27c61923-3175-4f68-99e1-70b8c99cdfa3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:51.898669 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27c61923-3175-4f68-99e1-70b8c99cdfa3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096574 Sep 10 11:08:51.899955 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3802/5302] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:51 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:08:52.267248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c70c8a44-0065-4079-8218-1c54f72b3518 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:52.267856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c70c8a44-0065-4079-8218-1c54f72b3518 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: da7a6945-0d6f-4b7f-aa84-bf819e1d968c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:52.289662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c70c8a44-0065-4079-8218-1c54f72b3518 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:52.290157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c70c8a44-0065-4079-8218-1c54f72b3518 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:52.290593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c70c8a44-0065-4079-8218-1c54f72b3518 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:52.291482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c70c8a44-0065-4079-8218-1c54f72b3518 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:52.292105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c70c8a44-0065-4079-8218-1c54f72b3518 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:52.292717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c70c8a44-0065-4079-8218-1c54f72b3518 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:52.766325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c70c8a44-0065-4079-8218-1c54f72b3518 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:52.775211 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c70c8a44-0065-4079-8218-1c54f72b3518 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c" status: 200 len: 1512 microversion: 2.1 time: 0.512410 Sep 10 11:08:52.775808 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1501/5303] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:52 2022] GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c => generated 1512 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:52.912629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b3619f0d-7e4e-4ec0-80c1-e5e0a5d56b57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:52.915686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b3619f0d-7e4e-4ec0-80c1-e5e0a5d56b57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:52.931989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3619f0d-7e4e-4ec0-80c1-e5e0a5d56b57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:52.935717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3619f0d-7e4e-4ec0-80c1-e5e0a5d56b57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:52.936520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3619f0d-7e4e-4ec0-80c1-e5e0a5d56b57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:52.937505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3619f0d-7e4e-4ec0-80c1-e5e0a5d56b57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:52.939129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3619f0d-7e4e-4ec0-80c1-e5e0a5d56b57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:52.939745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3619f0d-7e4e-4ec0-80c1-e5e0a5d56b57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:53.028970 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b3619f0d-7e4e-4ec0-80c1-e5e0a5d56b57 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121275 Sep 10 11:08:53.029634 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3803/5304] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:08:52 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:08:53.136944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0a5aa04f-90c2-4525-a818-696cc36f5a59 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:53.137481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0a5aa04f-90c2-4525-a818-696cc36f5a59 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:53.147777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a5aa04f-90c2-4525-a818-696cc36f5a59 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:53.148272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a5aa04f-90c2-4525-a818-696cc36f5a59 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:53.148709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a5aa04f-90c2-4525-a818-696cc36f5a59 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:53.149436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a5aa04f-90c2-4525-a818-696cc36f5a59 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:53.149894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a5aa04f-90c2-4525-a818-696cc36f5a59 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:53.150316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a5aa04f-90c2-4525-a818-696cc36f5a59 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:53.196244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0a5aa04f-90c2-4525-a818-696cc36f5a59 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:08:53.402991 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0a5aa04f-90c2-4525-a818-696cc36f5a59 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 204 len: 0 microversion: 2.1 time: 0.269388 Sep 10 11:08:53.407204 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1502/5305] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:08:53 2022] DELETE /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:08:53.417881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b238053-2a0e-4203-99aa-2b68537adc4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:53.418025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b238053-2a0e-4203-99aa-2b68537adc4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:53.425046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b238053-2a0e-4203-99aa-2b68537adc4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:53.429585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b238053-2a0e-4203-99aa-2b68537adc4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:53.430367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b238053-2a0e-4203-99aa-2b68537adc4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:53.431306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b238053-2a0e-4203-99aa-2b68537adc4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:53.438250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b238053-2a0e-4203-99aa-2b68537adc4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:53.446611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b238053-2a0e-4203-99aa-2b68537adc4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:53.806618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3b6c02f1-83b0-4d2b-b164-153d2e6f67d8 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:53.807649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3b6c02f1-83b0-4d2b-b164-153d2e6f67d8 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: da7a6945-0d6f-4b7f-aa84-bf819e1d968c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:53.817121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6c02f1-83b0-4d2b-b164-153d2e6f67d8 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:53.820167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6c02f1-83b0-4d2b-b164-153d2e6f67d8 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:53.821769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6c02f1-83b0-4d2b-b164-153d2e6f67d8 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:53.822910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6c02f1-83b0-4d2b-b164-153d2e6f67d8 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:53.827924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6c02f1-83b0-4d2b-b164-153d2e6f67d8 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:53.828656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b6c02f1-83b0-4d2b-b164-153d2e6f67d8 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:53.859067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b238053-2a0e-4203-99aa-2b68537adc4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:53.869572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b238053-2a0e-4203-99aa-2b68537adc4f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1682 microversion: 2.1 time: 0.457697 Sep 10 11:08:53.870747 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3804/5306] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:53 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1682 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:54.316630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2c14ac30-fe5d-4716-8a39-7f5cff693af9 req-7b870408-1546-4669-b5be-6fac366f292f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7a6945-0d6f-4b7f-aa84-bf819e1d968c", "name": "network-vif-deleted", "tag": "cfa6c35c-870e-4f93-8be0-cd411546eeb7"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:54.346988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2c14ac30-fe5d-4716-8a39-7f5cff693af9 req-7b870408-1546-4669-b5be-6fac366f292f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:54.347496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2c14ac30-fe5d-4716-8a39-7f5cff693af9 req-7b870408-1546-4669-b5be-6fac366f292f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:54.347964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2c14ac30-fe5d-4716-8a39-7f5cff693af9 req-7b870408-1546-4669-b5be-6fac366f292f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:54.375156 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2c14ac30-fe5d-4716-8a39-7f5cff693af9 req-7b870408-1546-4669-b5be-6fac366f292f service nova] Creating event network-vif-deleted:cfa6c35c-870e-4f93-8be0-cd411546eeb7 for instance da7a6945-0d6f-4b7f-aa84-bf819e1d968c on n-h2-856894-1 Sep 10 11:08:54.393563 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2c14ac30-fe5d-4716-8a39-7f5cff693af9 req-7b870408-1546-4669-b5be-6fac366f292f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080737 Sep 10 11:08:54.421511 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3805/5307] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:08:54.869339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3b6c02f1-83b0-4d2b-b164-153d2e6f67d8 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:54.879854 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3b6c02f1-83b0-4d2b-b164-153d2e6f67d8 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c" status: 200 len: 1512 microversion: 2.1 time: 1.081012 Sep 10 11:08:54.899333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edfcc958-922a-442e-8038-710d1d1734e9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:54.900069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-edfcc958-922a-442e-8038-710d1d1734e9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:54.900674 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1503/5308] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:53 2022] GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c => generated 1512 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:54.930879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edfcc958-922a-442e-8038-710d1d1734e9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:54.931467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edfcc958-922a-442e-8038-710d1d1734e9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:54.931938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edfcc958-922a-442e-8038-710d1d1734e9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:54.932676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edfcc958-922a-442e-8038-710d1d1734e9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:54.933293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edfcc958-922a-442e-8038-710d1d1734e9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:54.933832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edfcc958-922a-442e-8038-710d1d1734e9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:55.337017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-edfcc958-922a-442e-8038-710d1d1734e9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:55.374742 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-edfcc958-922a-442e-8038-710d1d1734e9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1682 microversion: 2.1 time: 0.480200 Sep 10 11:08:55.376094 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3806/5309] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:54 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1682 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:55.871012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-877416da-996c-4add-bb7b-e6bc7bbc6c84 req-246be3f1-07ff-4650-9bbc-73be6fd2fbb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d022d3c-088d-458f-8163-b9779f84500b", "name": "network-vif-deleted", "tag": "7deed0d5-76b5-4daa-ac3d-ec228fec7d83"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:08:55.908608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:55.909406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: da7a6945-0d6f-4b7f-aa84-bf819e1d968c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:55.923159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-877416da-996c-4add-bb7b-e6bc7bbc6c84 req-246be3f1-07ff-4650-9bbc-73be6fd2fbb3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:55.925666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-877416da-996c-4add-bb7b-e6bc7bbc6c84 req-246be3f1-07ff-4650-9bbc-73be6fd2fbb3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:55.926676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-877416da-996c-4add-bb7b-e6bc7bbc6c84 req-246be3f1-07ff-4650-9bbc-73be6fd2fbb3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:55.929498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:55.933609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:55.942061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:55.948054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:55.952067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:55.953452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:55.992780 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-877416da-996c-4add-bb7b-e6bc7bbc6c84 req-246be3f1-07ff-4650-9bbc-73be6fd2fbb3 service nova] Creating event network-vif-deleted:7deed0d5-76b5-4daa-ac3d-ec228fec7d83 for instance 0d022d3c-088d-458f-8163-b9779f84500b on n-h2-856894-1 Sep 10 11:08:56.034513 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-877416da-996c-4add-bb7b-e6bc7bbc6c84 req-246be3f1-07ff-4650-9bbc-73be6fd2fbb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167517 Sep 10 11:08:56.038168 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1504/5310] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:08:56.061622 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] HTTP exception thrown: Instance da7a6945-0d6f-4b7f-aa84-bf819e1d968c could not be found. Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Request method failure captured: Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c HTTP/1.1 Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHAQavyF32ltwyHLoXoP314fOBY8hBnuGaVRL1SYhOhkFb3kR1y5SAVYDxZHUUv36T5yEJNJL7I0-Z1zcyGuBh2J8A3YCCUGQPAeRplmaWiNJYJMmTlzxMJ4rKsezNgu-s2-3X5mZ1Ic0YdtZK-8ipope8mYbdXU8M1X7n2rCDLFKgY Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 0023c5d33126427f998980ae3d740416 Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-MultipleCreateTestJSON-365980567 Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0023c5d33126427f998980ae3d740416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0023c5d33126427f998980ae3d740416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0023c5d33126427f998980ae3d740416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0023c5d33126427f998980ae3d740416", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-MultipleCreateTestJSON-365980567 Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 0023c5d33126427f998980ae3d740416 Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-MultipleCreateTestJSON-365980567 Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-MultipleCreateTestJSON-365980567-project Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 63dc964dc0474d61be32ca9b0f0e9d54 Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-MultipleCreateTestJSON-365980567-project Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance da7a6945-0d6f-4b7f-aa84-bf819e1d968c could not be found. Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'da7a6945-0d6f-4b7f-aa84-bf819e1d968c'} Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7a6945-0d6f-4b7f-aa84-bf819e1d968c could not be found. Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7a6945-0d6f-4b7f-aa84-bf819e1d968c could not be found. Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:56.063539 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:08:56.072403 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:56.072403 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:56.072403 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:56.072403 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:08:56.072403 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:08:56.072403 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7a6945-0d6f-4b7f-aa84-bf819e1d968c could not be found. Sep 10 11:08:56.072403 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:08:56.072403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Returning 404 to user: Instance da7a6945-0d6f-4b7f-aa84-bf819e1d968c could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:08:56.072403 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a25c6d7d-c011-4d39-a0e5-a672e70b0ae5 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c" status: 404 len: 111 microversion: 2.1 time: 0.161240 Sep 10 11:08:56.072403 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3807/5311] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:55 2022] GET /compute/v2.1/servers/da7a6945-0d6f-4b7f-aa84-bf819e1d968c => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:08:56.075924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:56.077212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:56.092983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:56.093523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:56.108166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:56.112853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:56.113620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:56.114224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:56.195716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:56.196519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:56.196624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:56.197012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lazy-loading 'fault' on Instance uuid 0d022d3c-088d-458f-8163-b9779f84500b {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:08:56.397679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2d00083-2423-4c04-8597-da22e9f87033 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:56.398418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e2d00083-2423-4c04-8597-da22e9f87033 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:56.414807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2d00083-2423-4c04-8597-da22e9f87033 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:56.418503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2d00083-2423-4c04-8597-da22e9f87033 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:56.420521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2d00083-2423-4c04-8597-da22e9f87033 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:56.423664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2d00083-2423-4c04-8597-da22e9f87033 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:56.424203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2d00083-2423-4c04-8597-da22e9f87033 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:56.428633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2d00083-2423-4c04-8597-da22e9f87033 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:56.561139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63dc964dc0474d61be32ca9b0f0e9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0023c5d33126427f998980ae3d740416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:56.574935 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a55f0c24-57f9-4698-a09b-244384e60a92 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 200 len: 1308 microversion: 2.1 time: 0.504097 Sep 10 11:08:56.576406 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1505/5312] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:56 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 1308 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:57.043774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e2d00083-2423-4c04-8597-da22e9f87033 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:57.054452 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2d00083-2423-4c04-8597-da22e9f87033 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1682 microversion: 2.1 time: 0.660834 Sep 10 11:08:57.055037 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3808/5313] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:56 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1682 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:57.609158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:57.610392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] [instance: 0d022d3c-088d-458f-8163-b9779f84500b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:57.629739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:57.631349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:57.634827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:57.635946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:57.638135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:57.638751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:57.682332 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] HTTP exception thrown: Instance 0d022d3c-088d-458f-8163-b9779f84500b could not be found. Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Request method failure captured: Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b HTTP/1.1 Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHAQavyF32ltwyHLoXoP314fOBY8hBnuGaVRL1SYhOhkFb3kR1y5SAVYDxZHUUv36T5yEJNJL7I0-Z1zcyGuBh2J8A3YCCUGQPAeRplmaWiNJYJMmTlzxMJ4rKsezNgu-s2-3X5mZ1Ic0YdtZK-8ipope8mYbdXU8M1X7n2rCDLFKgY Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 0023c5d33126427f998980ae3d740416 Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-MultipleCreateTestJSON-365980567 Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0023c5d33126427f998980ae3d740416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0023c5d33126427f998980ae3d740416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0023c5d33126427f998980ae3d740416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0023c5d33126427f998980ae3d740416", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-MultipleCreateTestJSON-365980567 Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 0023c5d33126427f998980ae3d740416 Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-MultipleCreateTestJSON-365980567 Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-MultipleCreateTestJSON-365980567-project Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 63dc964dc0474d61be32ca9b0f0e9d54 Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-MultipleCreateTestJSON-365980567-project Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 0d022d3c-088d-458f-8163-b9779f84500b could not be found. Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '0d022d3c-088d-458f-8163-b9779f84500b'} Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d022d3c-088d-458f-8163-b9779f84500b could not be found. Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d022d3c-088d-458f-8163-b9779f84500b could not be found. Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:08:57.684855 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:57.690518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:08:57.690518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:08:57.690518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:08:57.690518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:08:57.690518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:08:57.690518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d022d3c-088d-458f-8163-b9779f84500b could not be found. Sep 10 11:08:57.690518 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:08:57.698934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] Returning 404 to user: Instance 0d022d3c-088d-458f-8163-b9779f84500b could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:08:57.711546 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-10a7049b-681b-4024-afe8-bcd94f4adad6 tempest-MultipleCreateTestJSON-365980567 tempest-MultipleCreateTestJSON-365980567-project] 10.222.0.20 "GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b" status: 404 len: 111 microversion: 2.1 time: 0.101281 Sep 10 11:08:57.717530 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1506/5314] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:57 2022] GET /compute/v2.1/servers/0d022d3c-088d-458f-8163-b9779f84500b => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:08:58.080521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-78c77c33-71cd-442d-b47e-90ccc708cfde tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:58.081254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-78c77c33-71cd-442d-b47e-90ccc708cfde tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:58.106764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78c77c33-71cd-442d-b47e-90ccc708cfde tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:58.110748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78c77c33-71cd-442d-b47e-90ccc708cfde tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:58.112050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78c77c33-71cd-442d-b47e-90ccc708cfde tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:58.129586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78c77c33-71cd-442d-b47e-90ccc708cfde tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:58.131911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78c77c33-71cd-442d-b47e-90ccc708cfde tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:58.133685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-78c77c33-71cd-442d-b47e-90ccc708cfde tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:58.771476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-78c77c33-71cd-442d-b47e-90ccc708cfde tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:08:58.783065 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-78c77c33-71cd-442d-b47e-90ccc708cfde tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1682 microversion: 2.1 time: 0.706415 Sep 10 11:08:58.807050 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3809/5315] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:58 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1682 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:08:59.820885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-584071f2-dd81-4cd3-9417-948fa77cf678 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:08:59.821531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-584071f2-dd81-4cd3-9417-948fa77cf678 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:08:59.838066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-584071f2-dd81-4cd3-9417-948fa77cf678 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:59.850233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-584071f2-dd81-4cd3-9417-948fa77cf678 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:59.853658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-584071f2-dd81-4cd3-9417-948fa77cf678 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:08:59.856380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-584071f2-dd81-4cd3-9417-948fa77cf678 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:08:59.857537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-584071f2-dd81-4cd3-9417-948fa77cf678 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:08:59.860472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-584071f2-dd81-4cd3-9417-948fa77cf678 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:00.052006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-60d6e0e4-2677-45cb-b935-264c694146ef req-edaa24cb-17d5-4809-8061-768284052b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf201661-21b8-4623-b580-b9cafba66341", "name": "network-vif-deleted", "tag": "462beb9f-f388-4565-9a86-bfc0c0624af4"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:00.099282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-60d6e0e4-2677-45cb-b935-264c694146ef req-edaa24cb-17d5-4809-8061-768284052b37 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:00.099816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-60d6e0e4-2677-45cb-b935-264c694146ef req-edaa24cb-17d5-4809-8061-768284052b37 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:00.108718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-60d6e0e4-2677-45cb-b935-264c694146ef req-edaa24cb-17d5-4809-8061-768284052b37 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:00.145728 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-60d6e0e4-2677-45cb-b935-264c694146ef req-edaa24cb-17d5-4809-8061-768284052b37 service nova] Creating event network-vif-deleted:462beb9f-f388-4565-9a86-bfc0c0624af4 for instance cf201661-21b8-4623-b580-b9cafba66341 on n-h2-856894-1 Sep 10 11:09:00.163862 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-60d6e0e4-2677-45cb-b935-264c694146ef req-edaa24cb-17d5-4809-8061-768284052b37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115601 Sep 10 11:09:00.168409 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3810/5316] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:09:00.231442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-584071f2-dd81-4cd3-9417-948fa77cf678 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:00.259819 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-584071f2-dd81-4cd3-9417-948fa77cf678 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 200 len: 1614 microversion: 2.1 time: 0.441804 Sep 10 11:09:00.261715 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1507/5317] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:08:59 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 1614 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:01.288824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:01.290668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:01.314602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:01.315131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:01.315598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:01.316336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:01.316807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:01.321319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:01.352124 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 HTTP/1.1 Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'cf201661-21b8-4623-b580-b9cafba66341'} Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:01.354755 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:01.359787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:01.359787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:01.359787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:01.359787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:09:01.359787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:09:01.359787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:09:01.359787 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:01.364942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:09:01.367352 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dc33b765-831b-437e-b5f0-2546bb3a6074 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 404 len: 111 microversion: 2.1 time: 0.083157 Sep 10 11:09:01.369324 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3811/5318] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:01 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:09:01.382703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-72d1822a-456f-4b4e-a94f-fe544bfe6265 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '.version_select at 0x7efcaeb9c700>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:01.438530 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-72d1822a-456f-4b4e-a94f-fe544bfe6265 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842355759" status: 202 len: 0 microversion: 2.1 time: 0.063399 Sep 10 11:09:01.444634 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1508/5319] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Sep 10 11:09:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842355759 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:09:02.128706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d8965aa1-053e-47fc-af94-5ba1e396ac7e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:02.130003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d8965aa1-053e-47fc-af94-5ba1e396ac7e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:02.147126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8965aa1-053e-47fc-af94-5ba1e396ac7e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:02.147918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8965aa1-053e-47fc-af94-5ba1e396ac7e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:02.150979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8965aa1-053e-47fc-af94-5ba1e396ac7e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:02.152161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8965aa1-053e-47fc-af94-5ba1e396ac7e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:02.156447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8965aa1-053e-47fc-af94-5ba1e396ac7e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:02.157266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8965aa1-053e-47fc-af94-5ba1e396ac7e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:02.264737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d8965aa1-053e-47fc-af94-5ba1e396ac7e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:09:02.539598 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d8965aa1-053e-47fc-af94-5ba1e396ac7e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 204 len: 0 microversion: 2.1 time: 0.414479 Sep 10 11:09:02.541810 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3812/5320] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:09:02 2022] DELETE /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:09:02.553473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c36fa593-0f5c-48c5-9f00-2b3fa6802d0a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:02.555803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c36fa593-0f5c-48c5-9f00-2b3fa6802d0a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:02.580799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c36fa593-0f5c-48c5-9f00-2b3fa6802d0a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:02.582801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c36fa593-0f5c-48c5-9f00-2b3fa6802d0a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:02.584129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c36fa593-0f5c-48c5-9f00-2b3fa6802d0a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:02.585364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c36fa593-0f5c-48c5-9f00-2b3fa6802d0a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:02.586177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c36fa593-0f5c-48c5-9f00-2b3fa6802d0a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:02.586956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c36fa593-0f5c-48c5-9f00-2b3fa6802d0a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:03.058432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c36fa593-0f5c-48c5-9f00-2b3fa6802d0a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:03.079516 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c36fa593-0f5c-48c5-9f00-2b3fa6802d0a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1411 microversion: 2.1 time: 0.530519 Sep 10 11:09:03.082760 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1509/5321] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:02 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1411 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:03.793667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e69b888-e860-451f-a45d-eb95dc7a3a8d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: .version_select at 0x7efcad22c670>, body: {"keypair": {"name": "tempest-keypair-1551943434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUWtdvfc5QElTu9QdUM6dJYkvgB8rALODuz5dQzt/I9ZpG9DuwaF55Q1joyx7//dSHnjwBbyur3K989CS7fAB7DDKkT0YFv2wr2x6VyXgd/5Bn63O0Q5tOAXZOKVTq9Zw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:03.818961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:03.841278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0e69b888-e860-451f-a45d-eb95dc7a3a8d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for project b28403f237c84af2a051fa9feb72f60b. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:03.852566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0e69b888-e860-451f-a45d-eb95dc7a3a8d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for user c3b1df3721f24d13807ab7f4c4a677f8 and project b28403f237c84af2a051fa9feb72f60b. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:03.893466 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e69b888-e860-451f-a45d-eb95dc7a3a8d tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107634 Sep 10 11:09:03.895629 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3813/5322] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:09:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:04.107550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-64ac007b-6736-430e-92dd-78d0713666ec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:04.108169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-64ac007b-6736-430e-92dd-78d0713666ec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:04.126378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64ac007b-6736-430e-92dd-78d0713666ec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:04.127150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64ac007b-6736-430e-92dd-78d0713666ec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:04.127808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64ac007b-6736-430e-92dd-78d0713666ec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:04.130634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64ac007b-6736-430e-92dd-78d0713666ec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:04.131364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64ac007b-6736-430e-92dd-78d0713666ec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:04.132046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64ac007b-6736-430e-92dd-78d0713666ec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:04.464352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-64ac007b-6736-430e-92dd-78d0713666ec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:04.483578 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-64ac007b-6736-430e-92dd-78d0713666ec tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1411 microversion: 2.1 time: 0.378409 Sep 10 11:09:04.494769 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1510/5323] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:04 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1411 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:05.517215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-08b0e718-b663-4a5e-a54b-94f915760f46 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:05.518083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-08b0e718-b663-4a5e-a54b-94f915760f46 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:05.540306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08b0e718-b663-4a5e-a54b-94f915760f46 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:05.544466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08b0e718-b663-4a5e-a54b-94f915760f46 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:05.545480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08b0e718-b663-4a5e-a54b-94f915760f46 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:05.547892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08b0e718-b663-4a5e-a54b-94f915760f46 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:05.553453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08b0e718-b663-4a5e-a54b-94f915760f46 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:05.556767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08b0e718-b663-4a5e-a54b-94f915760f46 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:06.326168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-08b0e718-b663-4a5e-a54b-94f915760f46 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:06.334393 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-08b0e718-b663-4a5e-a54b-94f915760f46 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1411 microversion: 2.1 time: 0.822428 Sep 10 11:09:06.335006 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3814/5324] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:05 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1411 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:06.692325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-9c496235-45ed-49a4-b49c-dee18ccbdaa0 req-e2ca149b-5fcd-4e52-841a-e2d3c93dcb4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372a7f3b-98aa-471d-8eb2-a739d5816300", "name": "network-vif-deleted", "tag": "b8aa0119-058f-4555-b17b-68e33baf5f6c"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:06.724264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9c496235-45ed-49a4-b49c-dee18ccbdaa0 req-e2ca149b-5fcd-4e52-841a-e2d3c93dcb4e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:06.726136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9c496235-45ed-49a4-b49c-dee18ccbdaa0 req-e2ca149b-5fcd-4e52-841a-e2d3c93dcb4e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:06.728846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9c496235-45ed-49a4-b49c-dee18ccbdaa0 req-e2ca149b-5fcd-4e52-841a-e2d3c93dcb4e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:06.774777 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-9c496235-45ed-49a4-b49c-dee18ccbdaa0 req-e2ca149b-5fcd-4e52-841a-e2d3c93dcb4e service nova] Creating event network-vif-deleted:b8aa0119-058f-4555-b17b-68e33baf5f6c for instance 372a7f3b-98aa-471d-8eb2-a739d5816300 on n-h2-856894-1 Sep 10 11:09:06.817640 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-9c496235-45ed-49a4-b49c-dee18ccbdaa0 req-e2ca149b-5fcd-4e52-841a-e2d3c93dcb4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131428 Sep 10 11:09:06.820025 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1511/5325] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:07.313970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-343137019", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e19ca223-58e0-4bb3-8cd0-347d45a52b81"}], "security_groups": [{"name": "tempest-securitygroup--70587625"}], "key_name": "tempest-keypair-1551943434", "user_data": "}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:07.364766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1872c000-a771-4909-8539-264653c2e477 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:07.367046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1872c000-a771-4909-8539-264653c2e477 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:07.374459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1872c000-a771-4909-8539-264653c2e477 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:07.375310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1872c000-a771-4909-8539-264653c2e477 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:07.375747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1872c000-a771-4909-8539-264653c2e477 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:07.376461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1872c000-a771-4909-8539-264653c2e477 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:07.376964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1872c000-a771-4909-8539-264653c2e477 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:07.377419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1872c000-a771-4909-8539-264653c2e477 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:07.542716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1872c000-a771-4909-8539-264653c2e477 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:07.547286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:07.580960 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1872c000-a771-4909-8539-264653c2e477 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1202 microversion: 2.1 time: 0.222595 Sep 10 11:09:07.583935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] validate_networks() for [('e19ca223-58e0-4bb3-8cd0-347d45a52b81', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:09:07.590706 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1512/5326] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:07 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1202 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:08.399117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:09:08.399717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:09:08.400046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:09:08.400479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:09:08.400915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:09:08.417473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:08.417987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:08.418445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:08.419249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:08.419667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:08.420113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:08.468116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for project b28403f237c84af2a051fa9feb72f60b. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:08.474143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for user c3b1df3721f24d13807ab7f4c4a677f8 and project b28403f237c84af2a051fa9feb72f60b. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:08.506790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:09:08.509061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:09:08.611746 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c4d184d-d08c-4b1d-85a3-efbf76eece91 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.328171 Sep 10 11:09:08.612667 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3815/5327] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:09:07 2022] POST /compute/v2.1/servers => generated 400 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:09:08.625501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-70a164a2-eec9-4102-adb5-b87ae2b9b69f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:08.626379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-70a164a2-eec9-4102-adb5-b87ae2b9b69f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:08.627024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-09eb8316-76a2-4f3c-b04f-b54e9ff37693 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:08.627650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-09eb8316-76a2-4f3c-b04f-b54e9ff37693 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:08.642513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09eb8316-76a2-4f3c-b04f-b54e9ff37693 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:08.643032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09eb8316-76a2-4f3c-b04f-b54e9ff37693 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:08.643478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09eb8316-76a2-4f3c-b04f-b54e9ff37693 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:08.644197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09eb8316-76a2-4f3c-b04f-b54e9ff37693 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:08.652927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09eb8316-76a2-4f3c-b04f-b54e9ff37693 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:08.653518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09eb8316-76a2-4f3c-b04f-b54e9ff37693 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:08.756773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-70a164a2-eec9-4102-adb5-b87ae2b9b69f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:08.767852 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-70a164a2-eec9-4102-adb5-b87ae2b9b69f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1241 microversion: 2.1 time: 0.147069 Sep 10 11:09:08.771453 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3816/5328] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:08 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1241 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:08.809390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-09eb8316-76a2-4f3c-b04f-b54e9ff37693 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:08.824051 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-09eb8316-76a2-4f3c-b04f-b54e9ff37693 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1202 microversion: 2.1 time: 0.212942 Sep 10 11:09:08.825335 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1513/5329] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:08 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1202 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:09.792965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-609260c3-3dcc-4a85-8ae7-523ab4e233b4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:09.794977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-609260c3-3dcc-4a85-8ae7-523ab4e233b4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:09.813815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-609260c3-3dcc-4a85-8ae7-523ab4e233b4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:09.820756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-609260c3-3dcc-4a85-8ae7-523ab4e233b4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:09.821250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-609260c3-3dcc-4a85-8ae7-523ab4e233b4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:09.829604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-609260c3-3dcc-4a85-8ae7-523ab4e233b4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:09.830718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-609260c3-3dcc-4a85-8ae7-523ab4e233b4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:09.831533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-609260c3-3dcc-4a85-8ae7-523ab4e233b4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:09.853319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8afdc73e-2b20-46d5-a0cb-e641e13dccad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:09.854745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8afdc73e-2b20-46d5-a0cb-e641e13dccad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:09.869466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8afdc73e-2b20-46d5-a0cb-e641e13dccad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:09.870412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8afdc73e-2b20-46d5-a0cb-e641e13dccad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:09.871686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8afdc73e-2b20-46d5-a0cb-e641e13dccad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:09.873111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8afdc73e-2b20-46d5-a0cb-e641e13dccad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:09.877478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8afdc73e-2b20-46d5-a0cb-e641e13dccad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:09.877930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8afdc73e-2b20-46d5-a0cb-e641e13dccad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:09.990592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8afdc73e-2b20-46d5-a0cb-e641e13dccad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:10.003016 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8afdc73e-2b20-46d5-a0cb-e641e13dccad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1202 microversion: 2.1 time: 0.154832 Sep 10 11:09:10.010965 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1514/5330] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:09 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:09:10.058127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-609260c3-3dcc-4a85-8ae7-523ab4e233b4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:10.069667 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-609260c3-3dcc-4a85-8ae7-523ab4e233b4 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1293 microversion: 2.1 time: 0.281783 Sep 10 11:09:10.085954 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3817/5331] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:09 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1293 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:11.031509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-19e7c188-bf10-4dde-8a0b-3cd1e776ef5d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:11.032127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-19e7c188-bf10-4dde-8a0b-3cd1e776ef5d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:11.051912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19e7c188-bf10-4dde-8a0b-3cd1e776ef5d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:11.052965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19e7c188-bf10-4dde-8a0b-3cd1e776ef5d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:11.053599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19e7c188-bf10-4dde-8a0b-3cd1e776ef5d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:11.054426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19e7c188-bf10-4dde-8a0b-3cd1e776ef5d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:11.054921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19e7c188-bf10-4dde-8a0b-3cd1e776ef5d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:11.055426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19e7c188-bf10-4dde-8a0b-3cd1e776ef5d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:11.102680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3cb05a1e-d9db-4523-9f5b-414ce323a1c5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:11.104711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3cb05a1e-d9db-4523-9f5b-414ce323a1c5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:11.128384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cb05a1e-d9db-4523-9f5b-414ce323a1c5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:11.130908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cb05a1e-d9db-4523-9f5b-414ce323a1c5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:11.132024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cb05a1e-d9db-4523-9f5b-414ce323a1c5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:11.133932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cb05a1e-d9db-4523-9f5b-414ce323a1c5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:11.136355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cb05a1e-d9db-4523-9f5b-414ce323a1c5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:11.136999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cb05a1e-d9db-4523-9f5b-414ce323a1c5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:11.218316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-19e7c188-bf10-4dde-8a0b-3cd1e776ef5d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:11.241624 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-19e7c188-bf10-4dde-8a0b-3cd1e776ef5d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1202 microversion: 2.1 time: 0.211311 Sep 10 11:09:11.255534 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1515/5332] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:11 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1202 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:11.263952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3cb05a1e-d9db-4523-9f5b-414ce323a1c5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:11.276451 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3cb05a1e-d9db-4523-9f5b-414ce323a1c5 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1299 microversion: 2.1 time: 0.181599 Sep 10 11:09:11.277622 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3818/5333] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:11 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:12.270294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-634fb7ac-b44c-4010-9932-30051990af31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:12.271009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-634fb7ac-b44c-4010-9932-30051990af31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:12.290350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-634fb7ac-b44c-4010-9932-30051990af31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:12.304728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f373b4ec-87b8-4693-bc97-55b68107bba1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:12.305431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f373b4ec-87b8-4693-bc97-55b68107bba1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:12.308770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-634fb7ac-b44c-4010-9932-30051990af31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:12.313622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-634fb7ac-b44c-4010-9932-30051990af31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:12.314297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-634fb7ac-b44c-4010-9932-30051990af31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:12.314673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-634fb7ac-b44c-4010-9932-30051990af31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:12.315104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-634fb7ac-b44c-4010-9932-30051990af31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:12.326394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f373b4ec-87b8-4693-bc97-55b68107bba1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:12.326394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f373b4ec-87b8-4693-bc97-55b68107bba1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:12.326826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f373b4ec-87b8-4693-bc97-55b68107bba1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:12.327821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f373b4ec-87b8-4693-bc97-55b68107bba1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:12.328461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f373b4ec-87b8-4693-bc97-55b68107bba1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:12.330999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f373b4ec-87b8-4693-bc97-55b68107bba1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:12.417022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:12.494005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-634fb7ac-b44c-4010-9932-30051990af31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:12.503526 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-634fb7ac-b44c-4010-9932-30051990af31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1202 microversion: 2.1 time: 0.237169 Sep 10 11:09:12.519276 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1516/5334] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:12 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1202 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:13.049027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f373b4ec-87b8-4693-bc97-55b68107bba1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:13.060312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f373b4ec-87b8-4693-bc97-55b68107bba1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1365 microversion: 2.1 time: 0.763187 Sep 10 11:09:13.079933 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3819/5335] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:12 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1365 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:09:13.527956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0e5c03aa-bfa3-44c2-8470-e00924cce6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:13.528599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0e5c03aa-bfa3-44c2-8470-e00924cce6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:13.539539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e5c03aa-bfa3-44c2-8470-e00924cce6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:13.540043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e5c03aa-bfa3-44c2-8470-e00924cce6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:13.540485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e5c03aa-bfa3-44c2-8470-e00924cce6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:13.541268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e5c03aa-bfa3-44c2-8470-e00924cce6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:13.553933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e5c03aa-bfa3-44c2-8470-e00924cce6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:13.554397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e5c03aa-bfa3-44c2-8470-e00924cce6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:13.687851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0e5c03aa-bfa3-44c2-8470-e00924cce6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:13.703584 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0e5c03aa-bfa3-44c2-8470-e00924cce6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1202 microversion: 2.1 time: 0.179515 Sep 10 11:09:13.704339 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1517/5336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:13 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:14.085688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8e2034c-4028-4194-957e-6800b7d10651 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:14.087207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8e2034c-4028-4194-957e-6800b7d10651 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:14.101672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8e2034c-4028-4194-957e-6800b7d10651 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:14.105235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8e2034c-4028-4194-957e-6800b7d10651 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:14.105961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8e2034c-4028-4194-957e-6800b7d10651 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:14.108136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8e2034c-4028-4194-957e-6800b7d10651 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:14.109037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8e2034c-4028-4194-957e-6800b7d10651 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:14.109923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8e2034c-4028-4194-957e-6800b7d10651 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:14.410526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8e2034c-4028-4194-957e-6800b7d10651 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:14.423549 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8e2034c-4028-4194-957e-6800b7d10651 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1365 microversion: 2.1 time: 0.341711 Sep 10 11:09:14.424790 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3820/5337] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:14 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:14.727961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:14.728574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:14.742774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:14.743277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:14.743713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:14.744421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:14.744878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:14.745361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:14.803928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:14.804423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:14.805053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:14.805763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lazy-loading 'fault' on Instance uuid 372a7f3b-98aa-471d-8eb2-a739d5816300 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:09:14.885905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:14.898512 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2e079cf6-3f7c-41f6-8cf3-1593d201cee9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 200 len: 1161 microversion: 2.1 time: 0.174876 Sep 10 11:09:14.899129 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1518/5338] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:14 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 1161 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:15.027826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7ee218a5-dc0a-4cdc-8e6f-e93d7511d526 req-8757a199-d75a-4e27-adbb-36e38abc983c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180ab04a-8bae-48f5-8019-be7b91bcf855", "tag": "c522ca58-4da8-43f9-8acf-020539462916"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:15.075555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ee218a5-dc0a-4cdc-8e6f-e93d7511d526 req-8757a199-d75a-4e27-adbb-36e38abc983c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:15.082373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ee218a5-dc0a-4cdc-8e6f-e93d7511d526 req-8757a199-d75a-4e27-adbb-36e38abc983c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:15.082840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ee218a5-dc0a-4cdc-8e6f-e93d7511d526 req-8757a199-d75a-4e27-adbb-36e38abc983c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:15.114456 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7ee218a5-dc0a-4cdc-8e6f-e93d7511d526 req-8757a199-d75a-4e27-adbb-36e38abc983c service nova] Creating event network-changed:c522ca58-4da8-43f9-8acf-020539462916 for instance 180ab04a-8bae-48f5-8019-be7b91bcf855 on n-h2-856894-1 Sep 10 11:09:15.125119 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7ee218a5-dc0a-4cdc-8e6f-e93d7511d526 req-8757a199-d75a-4e27-adbb-36e38abc983c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105270 Sep 10 11:09:15.129005 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3821/5339] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:15.448316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-685b480b-2fa9-4010-99a3-665c4232c42b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:15.448931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-685b480b-2fa9-4010-99a3-665c4232c42b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:15.460535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685b480b-2fa9-4010-99a3-665c4232c42b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:15.461031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685b480b-2fa9-4010-99a3-665c4232c42b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:15.464631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685b480b-2fa9-4010-99a3-665c4232c42b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:15.465687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685b480b-2fa9-4010-99a3-665c4232c42b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:15.468451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685b480b-2fa9-4010-99a3-665c4232c42b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:15.469102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685b480b-2fa9-4010-99a3-665c4232c42b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:15.898444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-685b480b-2fa9-4010-99a3-665c4232c42b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:15.909873 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-685b480b-2fa9-4010-99a3-665c4232c42b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1365 microversion: 2.1 time: 0.462624 Sep 10 11:09:15.912366 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1519/5340] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:15 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1365 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:15.930655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:15.931938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:15.942521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:15.946036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:15.949799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:15.950965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:15.951700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:15.953619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:15.980477 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 HTTP/1.1 Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '372a7f3b-98aa-471d-8eb2-a739d5816300'} Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:15.982547 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:15.988754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:15.988754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:15.988754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:15.988754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:09:15.988754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:09:15.988754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:15.988754 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:15.990825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:09:15.991919 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-345f7f75-fa7e-4049-aa01-4f6a6cc46758 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 404 len: 111 microversion: 2.1 time: 0.067968 Sep 10 11:09:15.993158 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3822/5341] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:15 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:09:16.940919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6513b1e7-ad0c-4584-9dcd-776ceebfb8a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:16.942011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6513b1e7-ad0c-4584-9dcd-776ceebfb8a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:16.954186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6513b1e7-ad0c-4584-9dcd-776ceebfb8a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:16.954631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6513b1e7-ad0c-4584-9dcd-776ceebfb8a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:16.955530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6513b1e7-ad0c-4584-9dcd-776ceebfb8a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:16.955777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6513b1e7-ad0c-4584-9dcd-776ceebfb8a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:16.959479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6513b1e7-ad0c-4584-9dcd-776ceebfb8a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:16.959887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6513b1e7-ad0c-4584-9dcd-776ceebfb8a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:18.035173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8b4ae54c-8f26-4d89-b5ba-335e1a881a0b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Action: 'create', calling method: .version_select at 0x7efcae89aa60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-122673789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmz1iKhqsAU4TmZtIf72a0yMGb0wZiXRYjnRqZAHXectpYkjGzinR326Gx3NJ0tBb1jlXMHaM5J/k0REYuJtueZQL+YFIo2ld09TQUvd+EWxwlOA7+jBmxXXC5vKz1Suw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:18.090549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8b4ae54c-8f26-4d89-b5ba-335e1a881a0b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Getting quotas for project e591cc2fea57479a945f0baa4a3016c3. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:18.129965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8b4ae54c-8f26-4d89-b5ba-335e1a881a0b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Getting quotas for user 55485ee5ef694329bd808aba72abdf63 and project e591cc2fea57479a945f0baa4a3016c3. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:18.182649 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8b4ae54c-8f26-4d89-b5ba-335e1a881a0b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.552527 Sep 10 11:09:18.183623 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3823/5342] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:09:17 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:18.218359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6513b1e7-ad0c-4584-9dcd-776ceebfb8a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:18.231387 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6513b1e7-ad0c-4584-9dcd-776ceebfb8a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1365 microversion: 2.1 time: 1.293122 Sep 10 11:09:18.235918 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1520/5343] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:16 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1365 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:09:19.259113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:19.264712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71523f60-e8ce-485e-942f-62a0259e038e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:19.265379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-71523f60-e8ce-485e-942f-62a0259e038e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:19.276508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71523f60-e8ce-485e-942f-62a0259e038e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:19.277099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71523f60-e8ce-485e-942f-62a0259e038e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:19.285872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71523f60-e8ce-485e-942f-62a0259e038e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:19.287207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71523f60-e8ce-485e-942f-62a0259e038e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:19.287887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71523f60-e8ce-485e-942f-62a0259e038e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:19.288516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71523f60-e8ce-485e-942f-62a0259e038e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:20.229400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-71523f60-e8ce-485e-942f-62a0259e038e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:20.246052 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71523f60-e8ce-485e-942f-62a0259e038e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1365 microversion: 2.1 time: 0.987492 Sep 10 11:09:20.247847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3824/5344] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:19 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1365 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:21.274080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f838f08b-f5a6-42db-ab01-155668f2d00a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:21.275512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f838f08b-f5a6-42db-ab01-155668f2d00a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:21.287108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:21.294291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f838f08b-f5a6-42db-ab01-155668f2d00a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:21.295196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f838f08b-f5a6-42db-ab01-155668f2d00a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:21.295643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f838f08b-f5a6-42db-ab01-155668f2d00a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:21.296365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f838f08b-f5a6-42db-ab01-155668f2d00a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:21.296818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f838f08b-f5a6-42db-ab01-155668f2d00a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:21.297276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f838f08b-f5a6-42db-ab01-155668f2d00a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:21.639954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-794840624", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "da4a857f-e2b8-4abc-83ad-86adb265085f"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:21.754790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] validate_networks() for [('da4a857f-e2b8-4abc-83ad-86adb265085f', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:09:22.308431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f838f08b-f5a6-42db-ab01-155668f2d00a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:22.319107 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f838f08b-f5a6-42db-ab01-155668f2d00a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1365 microversion: 2.1 time: 1.047008 Sep 10 11:09:22.319720 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1521/5345] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:21 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1365 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:22.333327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-842156133", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-122673789", "security_groups": [{"name": "tempest-secgroup-smoke-1491858567"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "12ecf9df-3968-45c0-8acc-6704cd833df6"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:22.573901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] validate_networks() for [('12ecf9df-3968-45c0-8acc-6704cd833df6', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:09:23.074406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:09:23.074924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:09:23.075335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:09:23.075763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:09:23.076391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:09:23.108433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:23.109527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:23.110552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:23.112174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:23.112926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:23.113880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:23.138744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Getting quotas for project 3de7b81c33324351b90ebdd38bb46f4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:23.152712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Getting quotas for user f304e14a0c4241259d928ec0d1a69ad7 and project 3de7b81c33324351b90ebdd38bb46f4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:23.176425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:09:23.180768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:09:23.296816 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-518a9192-6ef1-4b1d-8235-1209eed80c59 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.996197 Sep 10 11:09:23.305040 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3825/5346] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:09:23.310354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8309f221-f3f4-4746-8cd4-2fdfb417677b tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:23.311006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8309f221-f3f4-4746-8cd4-2fdfb417677b tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:23.852432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8309f221-f3f4-4746-8cd4-2fdfb417677b tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:23.861770 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8309f221-f3f4-4746-8cd4-2fdfb417677b tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1213 microversion: 2.1 time: 0.553941 Sep 10 11:09:23.878943 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3826/5347] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:23 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1213 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:23.897029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b0d3dde-1b8c-4e12-90c3-ae18f72cd554 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:23.897943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b0d3dde-1b8c-4e12-90c3-ae18f72cd554 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:23.910573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0d3dde-1b8c-4e12-90c3-ae18f72cd554 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:23.911587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0d3dde-1b8c-4e12-90c3-ae18f72cd554 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:23.912237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0d3dde-1b8c-4e12-90c3-ae18f72cd554 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:23.914650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0d3dde-1b8c-4e12-90c3-ae18f72cd554 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:23.917837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0d3dde-1b8c-4e12-90c3-ae18f72cd554 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:23.918502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0d3dde-1b8c-4e12-90c3-ae18f72cd554 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:24.259824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Getting quotas for project e591cc2fea57479a945f0baa4a3016c3. Resources: dict_keys(['metadata_items']) {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:24.280762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Getting quotas for user 55485ee5ef694329bd808aba72abdf63 and project e591cc2fea57479a945f0baa4a3016c3. Resources: dict_keys(['metadata_items']) {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:24.307090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0b0d3dde-1b8c-4e12-90c3-ae18f72cd554 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:24.318775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:09:24.320611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:09:24.323423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:09:24.324408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:09:24.325026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:09:24.325396 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b0d3dde-1b8c-4e12-90c3-ae18f72cd554 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1365 microversion: 2.1 time: 0.445163 Sep 10 11:09:24.326958 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3827/5348] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:23 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1365 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:24.340977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:24.343979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:24.367319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:24.372406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:24.372888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:24.373678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:24.375139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:24.375655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:24.376774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:24.379468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:24.381086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:24.382048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:24.382568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:24.383006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:24.417827 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e HTTP/1.1 Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd0effa7f-ec16-4c53-88e9-e03c342c299e'} Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:09:24.422540 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:09:24.427907 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0731baec-01f7-458a-908a-a7d2325c0d83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 404 len: 111 microversion: 2.1 time: 0.094995 Sep 10 11:09:24.429375 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3828/5349] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:09:24 2022] DELETE /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:09:24.435175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Getting quotas for project e591cc2fea57479a945f0baa4a3016c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:24.458407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Getting quotas for user 55485ee5ef694329bd808aba72abdf63 and project e591cc2fea57479a945f0baa4a3016c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:24.475448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:09:24.478040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:09:24.537509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8decd71c-4e54-489a-b418-e28d8b3d9113 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Action: 'create', calling method: .version_select at 0x7efcb2be9c10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:24.563273 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0a8645f6-58ed-449f-820b-98c3dfd0b9b9 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.233775 Sep 10 11:09:24.569390 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1522/5350] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:09:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:09:24.573738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8decd71c-4e54-489a-b418-e28d8b3d9113 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Getting quotas for project 4b9e1111668241308e4e7ba4e7b7e7b2. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:24.585718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:24.586345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: d0effa7f-ec16-4c53-88e9-e03c342c299e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:24.588349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8decd71c-4e54-489a-b418-e28d8b3d9113 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Getting quotas for user 2a0c71d7ee0941f8ae22e154c1e47da8 and project 4b9e1111668241308e4e7ba4e7b7e7b2. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:24.620785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:24.626791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:24.627816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:24.628480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:24.632246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:24.636149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:24.636872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:24.656222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8decd71c-4e54-489a-b418-e28d8b3d9113 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Getting quotas for project 4b9e1111668241308e4e7ba4e7b7e7b2. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:24.684099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-8decd71c-4e54-489a-b418-e28d8b3d9113 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Getting quotas for user 2a0c71d7ee0941f8ae22e154c1e47da8 and project 4b9e1111668241308e4e7ba4e7b7e7b2. Resources: {'server_groups'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:24.695597 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e HTTP/1.1 Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'd0effa7f-ec16-4c53-88e9-e03c342c299e'} Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:24.702093 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:24.707284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:24.707284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:24.707284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:24.707284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:09:24.707284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:09:24.707284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. Sep 10 11:09:24.707284 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:24.707284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance d0effa7f-ec16-4c53-88e9-e03c342c299e could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:09:24.707284 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e857ccc1-1410-479b-9a4a-69c81962a76c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e" status: 404 len: 111 microversion: 2.1 time: 0.133189 Sep 10 11:09:24.709606 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1523/5351] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:24 2022] GET /compute/v2.1/servers/d0effa7f-ec16-4c53-88e9-e03c342c299e => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:09:24.717663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e4de9ce-2783-48c3-818b-9bb35ece50b3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:24.717848 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8decd71c-4e54-489a-b418-e28d8b3d9113 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.286143 Sep 10 11:09:24.718632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3e4de9ce-2783-48c3-818b-9bb35ece50b3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:24.722526 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3829/5352] 10.222.0.20 () {62 vars in 1214 bytes} [Sat Sep 10 11:09:24 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:09:24.741921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95ad881b-a422-4866-834a-9ea90e9b9076 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:24.767939 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95ad881b-a422-4866-834a-9ea90e9b9076 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.028295 Sep 10 11:09:24.771798 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3830/5353] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Sep 10 11:09:24 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:09:24.808175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9604d0ea-e2e9-4d6c-9c87-743319f1e948 req-80e41039-89f7-48b5-8605-f56ecad2ac20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180ab04a-8bae-48f5-8019-be7b91bcf855", "name": "network-vif-plugged", "status": "completed", "tag": "c522ca58-4da8-43f9-8acf-020539462916"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:24.820133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9604d0ea-e2e9-4d6c-9c87-743319f1e948 req-80e41039-89f7-48b5-8605-f56ecad2ac20 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:24.820642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9604d0ea-e2e9-4d6c-9c87-743319f1e948 req-80e41039-89f7-48b5-8605-f56ecad2ac20 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:24.821134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9604d0ea-e2e9-4d6c-9c87-743319f1e948 req-80e41039-89f7-48b5-8605-f56ecad2ac20 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:24.854606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9604d0ea-e2e9-4d6c-9c87-743319f1e948 req-80e41039-89f7-48b5-8605-f56ecad2ac20 service nova] Creating event network-vif-plugged:c522ca58-4da8-43f9-8acf-020539462916 for instance 180ab04a-8bae-48f5-8019-be7b91bcf855 on n-h2-856894-1 Sep 10 11:09:24.867464 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9604d0ea-e2e9-4d6c-9c87-743319f1e948 req-80e41039-89f7-48b5-8605-f56ecad2ac20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090549 Sep 10 11:09:24.870269 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3831/5354] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:09:24.884908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69258bb1-3e0a-469b-896b-a5c0ac1fa123 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:24.891354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3e4de9ce-2783-48c3-818b-9bb35ece50b3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:24.901934 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3e4de9ce-2783-48c3-818b-9bb35ece50b3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1301 microversion: 2.1 time: 0.191069 Sep 10 11:09:24.906918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69258bb1-3e0a-469b-896b-a5c0ac1fa123 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/d7eef515-5a8d-4e76-ad9f-0708b06c64e0" status: 200 len: 235 microversion: 2.64 time: 0.035129 Sep 10 11:09:24.909170 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3832/5355] 10.222.0.20 () {60 vars in 1304 bytes} [Sat Sep 10 11:09:24 2022] GET /compute/v2.1/os-server-groups/d7eef515-5a8d-4e76-ad9f-0708b06c64e0 => generated 235 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:09:24.917123 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1524/5356] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:24 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1301 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:24.924019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5cece920-adef-487c-8614-e6073f228d51 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:24.925258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5cece920-adef-487c-8614-e6073f228d51 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:24.932063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-48c58d29-6022-432e-9211-498a19846738 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:24.936882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cece920-adef-487c-8614-e6073f228d51 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:24.946482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cece920-adef-487c-8614-e6073f228d51 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:24.947269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cece920-adef-487c-8614-e6073f228d51 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:24.968044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cece920-adef-487c-8614-e6073f228d51 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:24.975298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cece920-adef-487c-8614-e6073f228d51 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:24.977589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cece920-adef-487c-8614-e6073f228d51 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:25.015574 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-48c58d29-6022-432e-9211-498a19846738 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/d7eef515-5a8d-4e76-ad9f-0708b06c64e0" status: 204 len: 0 microversion: 2.64 time: 0.092466 Sep 10 11:09:25.018490 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1525/5357] 10.222.0.20 () {60 vars in 1307 bytes} [Sat Sep 10 11:09:24 2022] DELETE /compute/v2.1/os-server-groups/d7eef515-5a8d-4e76-ad9f-0708b06c64e0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:09:25.030575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-86d95725-0508-4990-838b-e7e25551cd46 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:25.039673 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-86d95725-0508-4990-838b-e7e25551cd46 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] HTTP exception thrown: Instance group d7eef515-5a8d-4e76-ad9f-0708b06c64e0 could not be found. Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-86d95725-0508-4990-838b-e7e25551cd46 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Request method failure captured: Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/os-server-groups/d7eef515-5a8d-4e76-ad9f-0708b06c64e0 HTTP/1.1 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHBk4HUiw4Y6EwLSQxoawK2sfiHd8gBQbUM41PS_-T6kh4_L7OOrr_TFhU6Rd_8RnnfyQc7cCIVIxHniAuzO9WziXhr-q6ZJiteh2TNm2Yg3vePzXQMejWp8A89PSAJ0BgOCrM4H-D6I3ntIqU7KSjewW1zo1bJDWDf9vWDXHRgAtG8 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Openstack-Nova-Api-Version: 2.64 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 4b9e1111668241308e4e7ba4e7b7e7b2 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerGroup264TestJSON-2080633320 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b9e1111668241308e4e7ba4e7b7e7b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b9e1111668241308e4e7ba4e7b7e7b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b9e1111668241308e4e7ba4e7b7e7b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b9e1111668241308e4e7ba4e7b7e7b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerGroup264TestJSON-2080633320 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 4b9e1111668241308e4e7ba4e7b7e7b2 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2080633320 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerGroup264TestJSON-2080633320-project Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 2a0c71d7ee0941f8ae22e154c1e47da8 Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerGroup264TestJSON-2080633320-project Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance group d7eef515-5a8d-4e76-ad9f-0708b06c64e0 could not be found. Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'd7eef515-5a8d-4e76-ad9f-0708b06c64e0'} Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d7eef515-5a8d-4e76-ad9f-0708b06c64e0 could not be found. Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d7eef515-5a8d-4e76-ad9f-0708b06c64e0 could not be found. Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:25.042528 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:25.048216 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:25.048216 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:25.048216 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:09:25.048216 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:09:25.048216 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d7eef515-5a8d-4e76-ad9f-0708b06c64e0 could not be found. Sep 10 11:09:25.048216 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:25.048216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-86d95725-0508-4990-838b-e7e25551cd46 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] Returning 404 to user: Instance group d7eef515-5a8d-4e76-ad9f-0708b06c64e0 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:09:25.048216 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-86d95725-0508-4990-838b-e7e25551cd46 tempest-ServerGroup264TestJSON-2080633320 tempest-ServerGroup264TestJSON-2080633320-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/d7eef515-5a8d-4e76-ad9f-0708b06c64e0" status: 404 len: 117 microversion: 2.64 time: 0.019430 Sep 10 11:09:25.050422 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1526/5358] 10.222.0.20 () {60 vars in 1307 bytes} [Sat Sep 10 11:09:25 2022] DELETE /compute/v2.1/os-server-groups/d7eef515-5a8d-4e76-ad9f-0708b06c64e0 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:09:25.246274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5cece920-adef-487c-8614-e6073f228d51 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:25.259966 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5cece920-adef-487c-8614-e6073f228d51 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1265 microversion: 2.1 time: 0.348233 Sep 10 11:09:25.261594 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3833/5359] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:24 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:25.352313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-78145ec9-0758-4f1d-93bd-1ce1251418cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:25.354472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-78145ec9-0758-4f1d-93bd-1ce1251418cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:25.381149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78145ec9-0758-4f1d-93bd-1ce1251418cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:25.381822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78145ec9-0758-4f1d-93bd-1ce1251418cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:25.382480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78145ec9-0758-4f1d-93bd-1ce1251418cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:25.387129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78145ec9-0758-4f1d-93bd-1ce1251418cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:25.387866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78145ec9-0758-4f1d-93bd-1ce1251418cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:25.388493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78145ec9-0758-4f1d-93bd-1ce1251418cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:25.931657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad3108f1-5a5d-48a2-bed5-6805872e861b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:25.932538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ad3108f1-5a5d-48a2-bed5-6805872e861b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:26.100348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ad3108f1-5a5d-48a2-bed5-6805872e861b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:26.103143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=33 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:26.116304 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad3108f1-5a5d-48a2-bed5-6805872e861b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1301 microversion: 2.1 time: 0.189795 Sep 10 11:09:26.120151 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3834/5360] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:25 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1301 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:26.284180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:26.289213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78145ec9-0758-4f1d-93bd-1ce1251418cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:26.290673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:26.314520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:26.314958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:26.315416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:26.316153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:26.316627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:26.316880 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-78145ec9-0758-4f1d-93bd-1ce1251418cc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1365 microversion: 2.1 time: 0.960984 Sep 10 11:09:26.317887 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1527/5361] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:25 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1365 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:26.330846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:26.338998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-570e4b05-4a8b-49ff-9485-ad8a48a8f39f tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:26.344921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-570e4b05-4a8b-49ff-9485-ad8a48a8f39f tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:26.375009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-570e4b05-4a8b-49ff-9485-ad8a48a8f39f tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:26.375708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-570e4b05-4a8b-49ff-9485-ad8a48a8f39f tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:26.375954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-570e4b05-4a8b-49ff-9485-ad8a48a8f39f tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:26.376654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-570e4b05-4a8b-49ff-9485-ad8a48a8f39f tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:26.377131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-570e4b05-4a8b-49ff-9485-ad8a48a8f39f tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:26.377557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-570e4b05-4a8b-49ff-9485-ad8a48a8f39f tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:26.406549 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 HTTP/1.1 Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '372a7f3b-98aa-471d-8eb2-a739d5816300'} Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:09:26.408317 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:26.413276 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:26.416019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:09:26.417236 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb9db076-c02e-480a-9afc-f5bf16d27264 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 404 len: 111 microversion: 2.1 time: 0.139138 Sep 10 11:09:26.428260 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3835/5362] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:09:26 2022] DELETE /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:09:26.433677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:26.448196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 372a7f3b-98aa-471d-8eb2-a739d5816300] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:26.457541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:26.466950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:26.467433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:26.473433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:26.474688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:26.478064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:26.538199 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 HTTP/1.1 Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '372a7f3b-98aa-471d-8eb2-a739d5816300'} Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:26.560646 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:26.564106 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:26.564106 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:26.564106 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:26.564106 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:09:26.564106 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:09:26.564106 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. Sep 10 11:09:26.564106 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:09:26.568345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance 372a7f3b-98aa-471d-8eb2-a739d5816300 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:09:26.581457 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5adf6524-3c62-4b36-b281-6e27b7f65829 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300" status: 404 len: 111 microversion: 2.1 time: 0.147997 Sep 10 11:09:26.583862 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3836/5363] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:26 2022] GET /compute/v2.1/servers/372a7f3b-98aa-471d-8eb2-a739d5816300 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:09:26.722945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7c08e71a-3341-4664-8e8b-62ee108dd250 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Action: 'create', calling method: .version_select at 0x7efcad3ef430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1846616331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+uCLkMF1rj+KsMW9ZPyG08Ho6AYO6zXjKNabSq09+9D0Iz5xg+ugaCW/u+wZXksVL+/QdJYKVfeukeP8J+9WPEsrXQ+awUTB6jBeHVRrXkGHWXDlA/GapRS1osCq+jLA=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:26.758737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7c08e71a-3341-4664-8e8b-62ee108dd250 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for project 86907574971943a2b584ef3fecdb5965. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:26.773567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7c08e71a-3341-4664-8e8b-62ee108dd250 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for user 78004185356641b990a951dc95e6ca0c and project 86907574971943a2b584ef3fecdb5965. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:26.803685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-570e4b05-4a8b-49ff-9485-ad8a48a8f39f tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:26.809526 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7c08e71a-3341-4664-8e8b-62ee108dd250 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.090649 Sep 10 11:09:26.816577 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3837/5364] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:09:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:26.832187 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-570e4b05-4a8b-49ff-9485-ad8a48a8f39f tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1271 microversion: 2.1 time: 0.512758 Sep 10 11:09:26.833791 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1528/5365] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:26 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1271 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:27.148780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8d9afcc0-6bc9-40b4-88b4-b690bcb04f17 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:27.149545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8d9afcc0-6bc9-40b4-88b4-b690bcb04f17 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:27.160515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9afcc0-6bc9-40b4-88b4-b690bcb04f17 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:27.162116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9afcc0-6bc9-40b4-88b4-b690bcb04f17 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:27.162580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9afcc0-6bc9-40b4-88b4-b690bcb04f17 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:27.163484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9afcc0-6bc9-40b4-88b4-b690bcb04f17 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:27.163962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9afcc0-6bc9-40b4-88b4-b690bcb04f17 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:27.164544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9afcc0-6bc9-40b4-88b4-b690bcb04f17 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:27.303484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d9afcc0-6bc9-40b4-88b4-b690bcb04f17 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:27.313383 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8d9afcc0-6bc9-40b4-88b4-b690bcb04f17 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1353 microversion: 2.1 time: 0.170076 Sep 10 11:09:27.314698 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3838/5366] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:27 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:27.356459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bcfb8510-7082-46a5-98ce-dff21086cdef tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:27.357379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bcfb8510-7082-46a5-98ce-dff21086cdef tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:27.366582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfb8510-7082-46a5-98ce-dff21086cdef tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:27.367373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfb8510-7082-46a5-98ce-dff21086cdef tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:27.368311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfb8510-7082-46a5-98ce-dff21086cdef tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:27.369721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfb8510-7082-46a5-98ce-dff21086cdef tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:27.370776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfb8510-7082-46a5-98ce-dff21086cdef tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:27.373237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bcfb8510-7082-46a5-98ce-dff21086cdef tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:27.859326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1609d26-97cc-4c95-9f03-a86b4e3f7695 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:27.860186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1609d26-97cc-4c95-9f03-a86b4e3f7695 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:27.874731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1609d26-97cc-4c95-9f03-a86b4e3f7695 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:27.876122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1609d26-97cc-4c95-9f03-a86b4e3f7695 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:27.877210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1609d26-97cc-4c95-9f03-a86b4e3f7695 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:27.878669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1609d26-97cc-4c95-9f03-a86b4e3f7695 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:27.880751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1609d26-97cc-4c95-9f03-a86b4e3f7695 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:27.882659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1609d26-97cc-4c95-9f03-a86b4e3f7695 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:27.888541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bcfb8510-7082-46a5-98ce-dff21086cdef tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:27.913398 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bcfb8510-7082-46a5-98ce-dff21086cdef tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1555 microversion: 2.1 time: 0.555484 Sep 10 11:09:27.917900 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1529/5367] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:27 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1555 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:27.950434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e7cd553a-1d97-423a-aeaa-65ed62d47e30 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:27.950847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e7cd553a-1d97-423a-aeaa-65ed62d47e30 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:27.957243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7cd553a-1d97-423a-aeaa-65ed62d47e30 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:27.963012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7cd553a-1d97-423a-aeaa-65ed62d47e30 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:27.968426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7cd553a-1d97-423a-aeaa-65ed62d47e30 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:27.970133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7cd553a-1d97-423a-aeaa-65ed62d47e30 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:27.970617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7cd553a-1d97-423a-aeaa-65ed62d47e30 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:27.971238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7cd553a-1d97-423a-aeaa-65ed62d47e30 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:28.291982 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e7cd553a-1d97-423a-aeaa-65ed62d47e30 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.346017 Sep 10 11:09:28.292838 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1530/5368] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:09:27 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-interface => generated 284 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:28.341797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5d8a7eb-810e-48b8-bd8b-e29dee676458 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:28.350150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a5d8a7eb-810e-48b8-bd8b-e29dee676458 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:28.372819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5d8a7eb-810e-48b8-bd8b-e29dee676458 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:28.373370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5d8a7eb-810e-48b8-bd8b-e29dee676458 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:28.373823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5d8a7eb-810e-48b8-bd8b-e29dee676458 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:28.374712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5d8a7eb-810e-48b8-bd8b-e29dee676458 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:28.386194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5d8a7eb-810e-48b8-bd8b-e29dee676458 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:28.386694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5d8a7eb-810e-48b8-bd8b-e29dee676458 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:28.648761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1609d26-97cc-4c95-9f03-a86b4e3f7695 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:28.665389 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1609d26-97cc-4c95-9f03-a86b4e3f7695 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1313 microversion: 2.1 time: 0.809470 Sep 10 11:09:28.666687 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3839/5369] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:27 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1313 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:28.810847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a5d8a7eb-810e-48b8-bd8b-e29dee676458 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:28.826395 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a5d8a7eb-810e-48b8-bd8b-e29dee676458 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1359 microversion: 2.1 time: 0.488317 Sep 10 11:09:28.827657 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1531/5370] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:28 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1359 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:09:29.375681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-10c90c30-de90-40f0-9987-e3639b30339f req-14570032-bd21-470b-9c94-ae345e709ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d38beb5-d7c6-4ad5-a358-7a45d7d87492", "tag": "28c2ffcb-8f11-4d8d-8fec-1b8680de8f40"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:29.387417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-10c90c30-de90-40f0-9987-e3639b30339f req-14570032-bd21-470b-9c94-ae345e709ba4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:29.388139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-10c90c30-de90-40f0-9987-e3639b30339f req-14570032-bd21-470b-9c94-ae345e709ba4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:29.388805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-10c90c30-de90-40f0-9987-e3639b30339f req-14570032-bd21-470b-9c94-ae345e709ba4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:29.406396 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-10c90c30-de90-40f0-9987-e3639b30339f req-14570032-bd21-470b-9c94-ae345e709ba4 service nova] Creating event network-changed:28c2ffcb-8f11-4d8d-8fec-1b8680de8f40 for instance 5d38beb5-d7c6-4ad5-a358-7a45d7d87492 on n-h2-856894-1 Sep 10 11:09:29.412525 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-10c90c30-de90-40f0-9987-e3639b30339f req-14570032-bd21-470b-9c94-ae345e709ba4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041078 Sep 10 11:09:29.413853 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3840/5371] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:29.697351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f5d85fb4-ec92-4246-b96a-d893b6071171 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:29.698817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f5d85fb4-ec92-4246-b96a-d893b6071171 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:29.716003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5d85fb4-ec92-4246-b96a-d893b6071171 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:29.716513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5d85fb4-ec92-4246-b96a-d893b6071171 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:29.719251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5d85fb4-ec92-4246-b96a-d893b6071171 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:29.722861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5d85fb4-ec92-4246-b96a-d893b6071171 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:29.724539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5d85fb4-ec92-4246-b96a-d893b6071171 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:29.725434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5d85fb4-ec92-4246-b96a-d893b6071171 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:29.852095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f0f4be4b-f276-475d-bf1a-a6527359c065 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:29.853520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f0f4be4b-f276-475d-bf1a-a6527359c065 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:29.871510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0f4be4b-f276-475d-bf1a-a6527359c065 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:29.872371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0f4be4b-f276-475d-bf1a-a6527359c065 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:29.873858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0f4be4b-f276-475d-bf1a-a6527359c065 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:29.879186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0f4be4b-f276-475d-bf1a-a6527359c065 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:29.879979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0f4be4b-f276-475d-bf1a-a6527359c065 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:29.880657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f0f4be4b-f276-475d-bf1a-a6527359c065 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:30.192397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f0f4be4b-f276-475d-bf1a-a6527359c065 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:30.212641 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f0f4be4b-f276-475d-bf1a-a6527359c065 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1359 microversion: 2.1 time: 0.365478 Sep 10 11:09:30.214380 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3841/5372] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:29 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1359 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:09:30.278456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f5d85fb4-ec92-4246-b96a-d893b6071171 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:30.305257 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f5d85fb4-ec92-4246-b96a-d893b6071171 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1313 microversion: 2.1 time: 0.612119 Sep 10 11:09:30.306212 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1532/5373] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:29 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:31.242336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab09d7c1-44fd-4af7-885e-e1b468a03e68 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:31.242991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab09d7c1-44fd-4af7-885e-e1b468a03e68 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:31.253379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab09d7c1-44fd-4af7-885e-e1b468a03e68 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:31.254214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab09d7c1-44fd-4af7-885e-e1b468a03e68 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:31.255472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab09d7c1-44fd-4af7-885e-e1b468a03e68 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:31.256424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab09d7c1-44fd-4af7-885e-e1b468a03e68 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:31.257143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab09d7c1-44fd-4af7-885e-e1b468a03e68 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:31.257801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab09d7c1-44fd-4af7-885e-e1b468a03e68 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:31.328643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b5394b4-4eeb-4556-97af-3169e16d193e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:31.329370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0b5394b4-4eeb-4556-97af-3169e16d193e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:31.355812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5394b4-4eeb-4556-97af-3169e16d193e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:31.356392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5394b4-4eeb-4556-97af-3169e16d193e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:31.356848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5394b4-4eeb-4556-97af-3169e16d193e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:31.357629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5394b4-4eeb-4556-97af-3169e16d193e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:31.358092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5394b4-4eeb-4556-97af-3169e16d193e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:31.358523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b5394b4-4eeb-4556-97af-3169e16d193e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:31.763818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab09d7c1-44fd-4af7-885e-e1b468a03e68 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:31.772856 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab09d7c1-44fd-4af7-885e-e1b468a03e68 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1427 microversion: 2.1 time: 0.536312 Sep 10 11:09:31.785649 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3842/5374] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:31 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1427 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:31.967031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0b5394b4-4eeb-4556-97af-3169e16d193e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:31.970484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:31.987032 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0b5394b4-4eeb-4556-97af-3169e16d193e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1313 microversion: 2.1 time: 0.662615 Sep 10 11:09:31.987636 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1533/5375] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:31 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1313 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:09:32.247417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-41f77fae-24de-4f81-bd86-035b47d22f60 req-53af47f6-57e1-42ad-a471-a1881edd4867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180ab04a-8bae-48f5-8019-be7b91bcf855", "tag": "c522ca58-4da8-43f9-8acf-020539462916"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:32.279309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41f77fae-24de-4f81-bd86-035b47d22f60 req-53af47f6-57e1-42ad-a471-a1881edd4867 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:32.285176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41f77fae-24de-4f81-bd86-035b47d22f60 req-53af47f6-57e1-42ad-a471-a1881edd4867 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:32.285783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41f77fae-24de-4f81-bd86-035b47d22f60 req-53af47f6-57e1-42ad-a471-a1881edd4867 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:32.323999 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-41f77fae-24de-4f81-bd86-035b47d22f60 req-53af47f6-57e1-42ad-a471-a1881edd4867 service nova] Creating event network-changed:c522ca58-4da8-43f9-8acf-020539462916 for instance 180ab04a-8bae-48f5-8019-be7b91bcf855 on n-h2-856894-1 Sep 10 11:09:32.343858 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-41f77fae-24de-4f81-bd86-035b47d22f60 req-53af47f6-57e1-42ad-a471-a1881edd4867 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102177 Sep 10 11:09:32.345023 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3843/5376] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:32.810426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-53305157-67dc-40ea-86e4-4a33eab02fc0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:32.814087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-53305157-67dc-40ea-86e4-4a33eab02fc0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:32.824688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53305157-67dc-40ea-86e4-4a33eab02fc0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:32.825194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53305157-67dc-40ea-86e4-4a33eab02fc0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:32.825636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53305157-67dc-40ea-86e4-4a33eab02fc0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:32.826339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53305157-67dc-40ea-86e4-4a33eab02fc0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:32.837886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53305157-67dc-40ea-86e4-4a33eab02fc0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:32.838567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-53305157-67dc-40ea-86e4-4a33eab02fc0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:33.012261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1250304d-599b-45ea-80f7-843e22ba0e67 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:33.012990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1250304d-599b-45ea-80f7-843e22ba0e67 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:33.053652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1250304d-599b-45ea-80f7-843e22ba0e67 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:33.054323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1250304d-599b-45ea-80f7-843e22ba0e67 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:33.054794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1250304d-599b-45ea-80f7-843e22ba0e67 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:33.059747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1250304d-599b-45ea-80f7-843e22ba0e67 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:33.064678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1250304d-599b-45ea-80f7-843e22ba0e67 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:33.065257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1250304d-599b-45ea-80f7-843e22ba0e67 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:33.146617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:33.613732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-53305157-67dc-40ea-86e4-4a33eab02fc0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:33.630036 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-53305157-67dc-40ea-86e4-4a33eab02fc0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1427 microversion: 2.1 time: 0.823599 Sep 10 11:09:33.630623 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1534/5377] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:32 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1427 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:34.428388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1250304d-599b-45ea-80f7-843e22ba0e67 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:34.440101 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1250304d-599b-45ea-80f7-843e22ba0e67 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1313 microversion: 2.1 time: 1.431641 Sep 10 11:09:34.441334 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3844/5378] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:33 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1313 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:34.654199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-152cdef6-c920-4d77-a311-3d489e21f7fc tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:34.654846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-152cdef6-c920-4d77-a311-3d489e21f7fc tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:34.657721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:34.676062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-152cdef6-c920-4d77-a311-3d489e21f7fc tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:34.676606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-152cdef6-c920-4d77-a311-3d489e21f7fc tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:34.677051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-152cdef6-c920-4d77-a311-3d489e21f7fc tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:34.677794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-152cdef6-c920-4d77-a311-3d489e21f7fc tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:34.678245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-152cdef6-c920-4d77-a311-3d489e21f7fc tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:34.678861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-152cdef6-c920-4d77-a311-3d489e21f7fc tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:34.849004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-951b6770-39a7-4277-9c7b-0d6d313927f1 req-3d774f67-fb74-4d9f-a246-9d5105ce0eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0828a95e-ab0c-46cf-b8e4-ebbcd16f0311", "tag": "9eadaa63-1be2-47a3-a6ab-8dc69087bda1"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:34.881810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-951b6770-39a7-4277-9c7b-0d6d313927f1 req-3d774f67-fb74-4d9f-a246-9d5105ce0eea service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:34.882626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-951b6770-39a7-4277-9c7b-0d6d313927f1 req-3d774f67-fb74-4d9f-a246-9d5105ce0eea service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:34.883538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-951b6770-39a7-4277-9c7b-0d6d313927f1 req-3d774f67-fb74-4d9f-a246-9d5105ce0eea service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:34.897298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=12 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:34.900088 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-951b6770-39a7-4277-9c7b-0d6d313927f1 req-3d774f67-fb74-4d9f-a246-9d5105ce0eea service nova] Creating event network-changed:9eadaa63-1be2-47a3-a6ab-8dc69087bda1 for instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 on n-h2-856894-1 Sep 10 11:09:34.906775 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-951b6770-39a7-4277-9c7b-0d6d313927f1 req-3d774f67-fb74-4d9f-a246-9d5105ce0eea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080441 Sep 10 11:09:34.907837 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3845/5379] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:35.121365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-152cdef6-c920-4d77-a311-3d489e21f7fc tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:35.147024 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-152cdef6-c920-4d77-a311-3d489e21f7fc tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1427 microversion: 2.1 time: 0.496763 Sep 10 11:09:35.151582 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1535/5380] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:34 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1427 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:35.464784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0980fdae-1b58-45a9-bd0e-6de009c57d05 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:35.465553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0980fdae-1b58-45a9-bd0e-6de009c57d05 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:35.478521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0980fdae-1b58-45a9-bd0e-6de009c57d05 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:35.479547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0980fdae-1b58-45a9-bd0e-6de009c57d05 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:35.480203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0980fdae-1b58-45a9-bd0e-6de009c57d05 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:35.481361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0980fdae-1b58-45a9-bd0e-6de009c57d05 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:35.482425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0980fdae-1b58-45a9-bd0e-6de009c57d05 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:35.483313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0980fdae-1b58-45a9-bd0e-6de009c57d05 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:35.840983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0980fdae-1b58-45a9-bd0e-6de009c57d05 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:35.853361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0980fdae-1b58-45a9-bd0e-6de009c57d05 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1313 microversion: 2.1 time: 0.394467 Sep 10 11:09:35.853969 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3846/5381] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:35 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:36.180242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-346483d8-519f-46eb-8385-582200a594ac tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:36.180242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-346483d8-519f-46eb-8385-582200a594ac tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:36.188776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-346483d8-519f-46eb-8385-582200a594ac tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:36.189347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-346483d8-519f-46eb-8385-582200a594ac tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:36.189798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-346483d8-519f-46eb-8385-582200a594ac tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:36.190609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-346483d8-519f-46eb-8385-582200a594ac tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:36.191106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-346483d8-519f-46eb-8385-582200a594ac tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:36.191877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-346483d8-519f-46eb-8385-582200a594ac tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:36.435409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-04bb0ebd-d029-4c02-b5a8-5a59cddbc318 req-8ece6d63-3b76-4917-b264-51daa6ddf687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d38beb5-d7c6-4ad5-a358-7a45d7d87492", "name": "network-vif-plugged", "status": "completed", "tag": "28c2ffcb-8f11-4d8d-8fec-1b8680de8f40"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:36.453403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-04bb0ebd-d029-4c02-b5a8-5a59cddbc318 req-8ece6d63-3b76-4917-b264-51daa6ddf687 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:36.453973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-04bb0ebd-d029-4c02-b5a8-5a59cddbc318 req-8ece6d63-3b76-4917-b264-51daa6ddf687 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:36.459582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-04bb0ebd-d029-4c02-b5a8-5a59cddbc318 req-8ece6d63-3b76-4917-b264-51daa6ddf687 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:36.477093 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-04bb0ebd-d029-4c02-b5a8-5a59cddbc318 req-8ece6d63-3b76-4917-b264-51daa6ddf687 service nova] Creating event network-vif-plugged:28c2ffcb-8f11-4d8d-8fec-1b8680de8f40 for instance 5d38beb5-d7c6-4ad5-a358-7a45d7d87492 on n-h2-856894-1 Sep 10 11:09:36.484701 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-04bb0ebd-d029-4c02-b5a8-5a59cddbc318 req-8ece6d63-3b76-4917-b264-51daa6ddf687 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058009 Sep 10 11:09:36.486847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3847/5382] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:36.541407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-346483d8-519f-46eb-8385-582200a594ac tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:36.550472 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-346483d8-519f-46eb-8385-582200a594ac tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1427 microversion: 2.1 time: 0.376934 Sep 10 11:09:36.552647 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1536/5383] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:36 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1427 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:36.881748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-036b2b76-55bf-4137-9055-1e73d27b6573 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:36.882910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-036b2b76-55bf-4137-9055-1e73d27b6573 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:36.885188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=5 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:36.894625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036b2b76-55bf-4137-9055-1e73d27b6573 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:36.896150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036b2b76-55bf-4137-9055-1e73d27b6573 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:36.896823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036b2b76-55bf-4137-9055-1e73d27b6573 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:36.897959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036b2b76-55bf-4137-9055-1e73d27b6573 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:36.898629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036b2b76-55bf-4137-9055-1e73d27b6573 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:36.899146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-036b2b76-55bf-4137-9055-1e73d27b6573 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:37.307394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-036b2b76-55bf-4137-9055-1e73d27b6573 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:37.317925 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-036b2b76-55bf-4137-9055-1e73d27b6573 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1313 microversion: 2.1 time: 0.440769 Sep 10 11:09:37.321170 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3848/5384] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:36 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:37.503925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-19682e7c-e80e-445f-a3cd-bb3bfc7bbd76 tempest-ExtensionsTest-1093654276 tempest-ExtensionsTest-1093654276-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:37.505574 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-19682e7c-e80e-445f-a3cd-bb3bfc7bbd76 tempest-ExtensionsTest-1093654276 tempest-ExtensionsTest-1093654276-project] 10.222.0.20 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.162306 Sep 10 11:09:37.506916 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1537/5385] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Sep 10 11:09:37 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:37.515856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d63e0af0-3c20-4d34-98a2-94c32fc0a161 tempest-ExtensionsTest-1093654276 tempest-ExtensionsTest-1093654276-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:37.518369 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d63e0af0-3c20-4d34-98a2-94c32fc0a161 tempest-ExtensionsTest-1093654276 tempest-ExtensionsTest-1093654276-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006424 Sep 10 11:09:37.525214 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3849/5386] 10.222.0.20 () {58 vars in 1134 bytes} [Sat Sep 10 11:09:37 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:09:37.609353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e1ced08f-763e-4c59-a10f-afa3099d883f tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:37.610001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e1ced08f-763e-4c59-a10f-afa3099d883f tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:37.621309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1ced08f-763e-4c59-a10f-afa3099d883f tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:37.621808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1ced08f-763e-4c59-a10f-afa3099d883f tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:37.622452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1ced08f-763e-4c59-a10f-afa3099d883f tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:37.623385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1ced08f-763e-4c59-a10f-afa3099d883f tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:37.624037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1ced08f-763e-4c59-a10f-afa3099d883f tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:37.624679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1ced08f-763e-4c59-a10f-afa3099d883f tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:37.827921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e1ced08f-763e-4c59-a10f-afa3099d883f tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:37.841147 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e1ced08f-763e-4c59-a10f-afa3099d883f tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1427 microversion: 2.1 time: 0.245250 Sep 10 11:09:37.841658 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1538/5387] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:37 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1427 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:38.345674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37ec5638-4f3b-4b63-be39-3a81017fc252 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:38.346361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-37ec5638-4f3b-4b63-be39-3a81017fc252 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:38.367208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37ec5638-4f3b-4b63-be39-3a81017fc252 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:38.367723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37ec5638-4f3b-4b63-be39-3a81017fc252 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:38.368089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37ec5638-4f3b-4b63-be39-3a81017fc252 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:38.370268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37ec5638-4f3b-4b63-be39-3a81017fc252 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:38.372125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37ec5638-4f3b-4b63-be39-3a81017fc252 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:38.374118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37ec5638-4f3b-4b63-be39-3a81017fc252 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:38.601487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-37ec5638-4f3b-4b63-be39-3a81017fc252 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:38.614703 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-37ec5638-4f3b-4b63-be39-3a81017fc252 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1497 microversion: 2.1 time: 0.274565 Sep 10 11:09:38.616843 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3850/5388] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:38 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1497 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:38.867531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ae65d1a-5883-4ffd-a44d-7e8b56e0f20d tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:38.868232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ae65d1a-5883-4ffd-a44d-7e8b56e0f20d tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:38.878936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ae65d1a-5883-4ffd-a44d-7e8b56e0f20d tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:38.879679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ae65d1a-5883-4ffd-a44d-7e8b56e0f20d tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:38.880350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ae65d1a-5883-4ffd-a44d-7e8b56e0f20d tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:38.882530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ae65d1a-5883-4ffd-a44d-7e8b56e0f20d tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:38.883145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ae65d1a-5883-4ffd-a44d-7e8b56e0f20d tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:38.883722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ae65d1a-5883-4ffd-a44d-7e8b56e0f20d tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:39.116708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ae65d1a-5883-4ffd-a44d-7e8b56e0f20d tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:39.127853 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ae65d1a-5883-4ffd-a44d-7e8b56e0f20d tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1427 microversion: 2.1 time: 0.266895 Sep 10 11:09:39.130785 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1539/5389] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:38 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1427 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:09:40.159100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-01983660-f24f-4ccf-94b0-7d236a942d69 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:40.160476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-01983660-f24f-4ccf-94b0-7d236a942d69 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:40.184174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01983660-f24f-4ccf-94b0-7d236a942d69 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:40.184981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01983660-f24f-4ccf-94b0-7d236a942d69 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:40.185676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01983660-f24f-4ccf-94b0-7d236a942d69 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:40.186571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01983660-f24f-4ccf-94b0-7d236a942d69 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:40.187193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01983660-f24f-4ccf-94b0-7d236a942d69 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:40.188431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01983660-f24f-4ccf-94b0-7d236a942d69 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:40.242528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:40.456570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-01983660-f24f-4ccf-94b0-7d236a942d69 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:40.468940 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-01983660-f24f-4ccf-94b0-7d236a942d69 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1427 microversion: 2.1 time: 0.317059 Sep 10 11:09:40.470200 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3851/5390] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:40 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1427 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:09:41.496322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a18b9113-15b7-4727-9aca-a876c2b3329b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:41.497393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a18b9113-15b7-4727-9aca-a876c2b3329b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:41.514594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a18b9113-15b7-4727-9aca-a876c2b3329b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:41.518765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a18b9113-15b7-4727-9aca-a876c2b3329b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:41.519947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a18b9113-15b7-4727-9aca-a876c2b3329b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:41.528866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a18b9113-15b7-4727-9aca-a876c2b3329b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:41.529377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a18b9113-15b7-4727-9aca-a876c2b3329b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:41.529815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a18b9113-15b7-4727-9aca-a876c2b3329b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:41.773835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a18b9113-15b7-4727-9aca-a876c2b3329b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:41.792212 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a18b9113-15b7-4727-9aca-a876c2b3329b tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1427 microversion: 2.1 time: 0.302235 Sep 10 11:09:41.798573 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1540/5391] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:41 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1427 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:42.664245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-07128254-63e5-4393-b68f-264d8e647e89 req-a5063a46-63ac-4483-91f7-6cb9c406b2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0828a95e-ab0c-46cf-b8e4-ebbcd16f0311", "name": "network-vif-plugged", "status": "completed", "tag": "9eadaa63-1be2-47a3-a6ab-8dc69087bda1"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:42.688862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-07128254-63e5-4393-b68f-264d8e647e89 req-a5063a46-63ac-4483-91f7-6cb9c406b2dd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:42.693363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-07128254-63e5-4393-b68f-264d8e647e89 req-a5063a46-63ac-4483-91f7-6cb9c406b2dd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:42.695051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-07128254-63e5-4393-b68f-264d8e647e89 req-a5063a46-63ac-4483-91f7-6cb9c406b2dd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:42.730518 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-07128254-63e5-4393-b68f-264d8e647e89 req-a5063a46-63ac-4483-91f7-6cb9c406b2dd service nova] Creating event network-vif-plugged:9eadaa63-1be2-47a3-a6ab-8dc69087bda1 for instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 on n-h2-856894-1 Sep 10 11:09:42.745525 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-07128254-63e5-4393-b68f-264d8e647e89 req-a5063a46-63ac-4483-91f7-6cb9c406b2dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091719 Sep 10 11:09:42.748680 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3852/5392] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:42.823545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ff34709b-3f9d-4808-ba97-53a68be2ee82 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:42.824976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ff34709b-3f9d-4808-ba97-53a68be2ee82 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:42.842791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff34709b-3f9d-4808-ba97-53a68be2ee82 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:42.845085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff34709b-3f9d-4808-ba97-53a68be2ee82 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:42.846293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff34709b-3f9d-4808-ba97-53a68be2ee82 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:42.847609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff34709b-3f9d-4808-ba97-53a68be2ee82 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:42.864338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff34709b-3f9d-4808-ba97-53a68be2ee82 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:42.864801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff34709b-3f9d-4808-ba97-53a68be2ee82 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:43.139888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ff34709b-3f9d-4808-ba97-53a68be2ee82 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:43.146232 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ff34709b-3f9d-4808-ba97-53a68be2ee82 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1427 microversion: 2.1 time: 0.327497 Sep 10 11:09:43.146852 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1541/5393] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:42 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1427 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:43.318197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad1a29b0-d02c-4b58-aae9-af1801e82440 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:43.318989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ad1a29b0-d02c-4b58-aae9-af1801e82440 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:43.327100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad1a29b0-d02c-4b58-aae9-af1801e82440 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:43.327974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad1a29b0-d02c-4b58-aae9-af1801e82440 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:43.328518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad1a29b0-d02c-4b58-aae9-af1801e82440 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:43.329357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad1a29b0-d02c-4b58-aae9-af1801e82440 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:43.329838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad1a29b0-d02c-4b58-aae9-af1801e82440 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:43.330287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad1a29b0-d02c-4b58-aae9-af1801e82440 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:43.371242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ad1a29b0-d02c-4b58-aae9-af1801e82440 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:09:43.537856 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad1a29b0-d02c-4b58-aae9-af1801e82440 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 204 len: 0 microversion: 2.1 time: 0.226449 Sep 10 11:09:43.538484 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3853/5394] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:09:43 2022] DELETE /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:09:43.547629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d723a67c-23d9-4213-a0fd-217d6e131b27 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:43.548253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d723a67c-23d9-4213-a0fd-217d6e131b27 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:43.558213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d723a67c-23d9-4213-a0fd-217d6e131b27 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:43.561270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d723a67c-23d9-4213-a0fd-217d6e131b27 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:43.562971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d723a67c-23d9-4213-a0fd-217d6e131b27 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:43.564687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d723a67c-23d9-4213-a0fd-217d6e131b27 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:43.565190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d723a67c-23d9-4213-a0fd-217d6e131b27 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:43.567552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d723a67c-23d9-4213-a0fd-217d6e131b27 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:43.804625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d723a67c-23d9-4213-a0fd-217d6e131b27 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:43.820068 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d723a67c-23d9-4213-a0fd-217d6e131b27 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1503 microversion: 2.1 time: 0.273264 Sep 10 11:09:43.835995 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1542/5395] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:43 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:44.174501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c99c039-3467-42ff-b993-278aa9b233d0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:44.175513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c99c039-3467-42ff-b993-278aa9b233d0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:44.195739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c99c039-3467-42ff-b993-278aa9b233d0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:44.196285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c99c039-3467-42ff-b993-278aa9b233d0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:44.199303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c99c039-3467-42ff-b993-278aa9b233d0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:44.201478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c99c039-3467-42ff-b993-278aa9b233d0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:44.202003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c99c039-3467-42ff-b993-278aa9b233d0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:44.204291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c99c039-3467-42ff-b993-278aa9b233d0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:44.523034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c99c039-3467-42ff-b993-278aa9b233d0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:44.544636 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c99c039-3467-42ff-b993-278aa9b233d0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1427 microversion: 2.1 time: 0.375362 Sep 10 11:09:44.548017 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3854/5396] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:44 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1427 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:44.845794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-58784d61-2bd6-4aa5-b1f3-176bca9d057c tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:44.846415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-58784d61-2bd6-4aa5-b1f3-176bca9d057c tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:44.860427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58784d61-2bd6-4aa5-b1f3-176bca9d057c tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:44.861020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58784d61-2bd6-4aa5-b1f3-176bca9d057c tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:44.861661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58784d61-2bd6-4aa5-b1f3-176bca9d057c tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:44.865408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58784d61-2bd6-4aa5-b1f3-176bca9d057c tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:44.865956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58784d61-2bd6-4aa5-b1f3-176bca9d057c tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:44.866464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58784d61-2bd6-4aa5-b1f3-176bca9d057c tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:45.388505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-58784d61-2bd6-4aa5-b1f3-176bca9d057c tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:45.402083 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-58784d61-2bd6-4aa5-b1f3-176bca9d057c tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1503 microversion: 2.1 time: 0.560409 Sep 10 11:09:45.402801 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1543/5397] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:44 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1503 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:45.573784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-135298ba-ee7d-431a-9839-1156843d03b0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:45.575221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-135298ba-ee7d-431a-9839-1156843d03b0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:45.584037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-135298ba-ee7d-431a-9839-1156843d03b0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:45.584823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-135298ba-ee7d-431a-9839-1156843d03b0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:45.585500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-135298ba-ee7d-431a-9839-1156843d03b0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:45.586510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-135298ba-ee7d-431a-9839-1156843d03b0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:45.587213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-135298ba-ee7d-431a-9839-1156843d03b0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:45.587880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-135298ba-ee7d-431a-9839-1156843d03b0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:46.428073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-98b244fd-c1e9-4d8f-99e8-6e6836d6c31e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:46.432779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-98b244fd-c1e9-4d8f-99e8-6e6836d6c31e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:46.441981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98b244fd-c1e9-4d8f-99e8-6e6836d6c31e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:46.442766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98b244fd-c1e9-4d8f-99e8-6e6836d6c31e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:46.443401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98b244fd-c1e9-4d8f-99e8-6e6836d6c31e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:46.444174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98b244fd-c1e9-4d8f-99e8-6e6836d6c31e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:46.446393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98b244fd-c1e9-4d8f-99e8-6e6836d6c31e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:46.446952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-98b244fd-c1e9-4d8f-99e8-6e6836d6c31e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:46.493252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-135298ba-ee7d-431a-9839-1156843d03b0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:46.503630 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-135298ba-ee7d-431a-9839-1156843d03b0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1607 microversion: 2.1 time: 0.937393 Sep 10 11:09:46.505114 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3855/5398] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:45 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1607 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:46.529946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5c8bc624-7387-45a5-86fa-56557fdaea48 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:46.532086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5c8bc624-7387-45a5-86fa-56557fdaea48 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:46.553064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c8bc624-7387-45a5-86fa-56557fdaea48 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:46.553873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c8bc624-7387-45a5-86fa-56557fdaea48 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:46.554685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c8bc624-7387-45a5-86fa-56557fdaea48 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:46.556144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c8bc624-7387-45a5-86fa-56557fdaea48 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:46.557277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c8bc624-7387-45a5-86fa-56557fdaea48 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:46.558151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c8bc624-7387-45a5-86fa-56557fdaea48 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:46.884080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-98b244fd-c1e9-4d8f-99e8-6e6836d6c31e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:46.893697 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-98b244fd-c1e9-4d8f-99e8-6e6836d6c31e tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1503 microversion: 2.1 time: 0.471102 Sep 10 11:09:46.896503 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1544/5399] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:46 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1503 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:47.007695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5c8bc624-7387-45a5-86fa-56557fdaea48 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:47.031289 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5c8bc624-7387-45a5-86fa-56557fdaea48 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1607 microversion: 2.1 time: 0.507397 Sep 10 11:09:47.032001 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3856/5400] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:46 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1607 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:47.055189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d0cce707-0bd9-4244-b965-6658dd33a299 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:47.056792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d0cce707-0bd9-4244-b965-6658dd33a299 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:47.069811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0cce707-0bd9-4244-b965-6658dd33a299 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:47.071323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0cce707-0bd9-4244-b965-6658dd33a299 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:47.073671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0cce707-0bd9-4244-b965-6658dd33a299 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:47.078332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0cce707-0bd9-4244-b965-6658dd33a299 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:47.080929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0cce707-0bd9-4244-b965-6658dd33a299 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:47.083087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0cce707-0bd9-4244-b965-6658dd33a299 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:47.437229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d0cce707-0bd9-4244-b965-6658dd33a299 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:47.448869 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d0cce707-0bd9-4244-b965-6658dd33a299 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1607 microversion: 2.1 time: 0.397578 Sep 10 11:09:47.450028 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1545/5401] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:47 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1607 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:47.555395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9517313d-2d9a-4a1b-abb9-ba1d88a1af39 req-97e35639-aa23-4117-8557-9c83f7194181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d38beb5-d7c6-4ad5-a358-7a45d7d87492", "name": "network-vif-deleted", "tag": "28c2ffcb-8f11-4d8d-8fec-1b8680de8f40"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:47.577045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9517313d-2d9a-4a1b-abb9-ba1d88a1af39 req-97e35639-aa23-4117-8557-9c83f7194181 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:47.578579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9517313d-2d9a-4a1b-abb9-ba1d88a1af39 req-97e35639-aa23-4117-8557-9c83f7194181 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:47.579893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9517313d-2d9a-4a1b-abb9-ba1d88a1af39 req-97e35639-aa23-4117-8557-9c83f7194181 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:47.617152 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9517313d-2d9a-4a1b-abb9-ba1d88a1af39 req-97e35639-aa23-4117-8557-9c83f7194181 service nova] Creating event network-vif-deleted:28c2ffcb-8f11-4d8d-8fec-1b8680de8f40 for instance 5d38beb5-d7c6-4ad5-a358-7a45d7d87492 on n-h2-856894-1 Sep 10 11:09:47.625065 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9517313d-2d9a-4a1b-abb9-ba1d88a1af39 req-97e35639-aa23-4117-8557-9c83f7194181 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.362804 Sep 10 11:09:47.626438 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3857/5402] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:09:47.923806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:47.924763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:47.949321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:47.949938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:47.951827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:47.952525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:47.953375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:47.955194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:48.078091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:48.082666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:48.083540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:48.084168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lazy-loading 'fault' on Instance uuid 5d38beb5-d7c6-4ad5-a358-7a45d7d87492 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:09:48.211437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f304e14a0c4241259d928ec0d1a69ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7b81c33324351b90ebdd38bb46f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:48.224738 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6e1eb2f0-f8d3-437b-aac3-a193b50ddf41 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 200 len: 1303 microversion: 2.1 time: 0.305556 Sep 10 11:09:48.227044 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1546/5403] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:47 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 1303 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:09:48.716575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8ebe310-eef7-42d4-bafd-e9ce32d160aa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Action: 'create', calling method: .version_select at 0x7efcadd11820>, body: {"keypair": {"name": "tempest-keypair-771928341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9LUeh03lRDsoKFX7XL2wCuf7HhSzCrhNFVmAvX+4OPDasUuzrlKgbhfr/xfvyl1v36cyfCAgsXrZYf4Yl8uC9w8WqsHknwNzPUEBCPfhFshR1kez5Z1ixlFoeZSgCT+Q=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:48.743406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a8ebe310-eef7-42d4-bafd-e9ce32d160aa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Getting quotas for project adc08265fd4c43aa822728bd86e1fed1. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:48.749842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a8ebe310-eef7-42d4-bafd-e9ce32d160aa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Getting quotas for user 2c62573dd17f47fe9dd98200cc04bd23 and project adc08265fd4c43aa822728bd86e1fed1. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:48.776690 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8ebe310-eef7-42d4-bafd-e9ce32d160aa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.172385 Sep 10 11:09:48.777373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3858/5404] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Sep 10 11:09:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:09:49.253666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:49.254487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] [instance: 5d38beb5-d7c6-4ad5-a358-7a45d7d87492] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:49.263651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:49.265210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:49.266086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:49.266999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:49.267707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:49.268403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:49.287016 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] HTTP exception thrown: Instance 5d38beb5-d7c6-4ad5-a358-7a45d7d87492 could not be found. Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Request method failure captured: Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 HTTP/1.1 Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHBe1i-weF7oyuDDik5ywR6J9EFOaHBgrnAmVymIINiuL0hJuJAfV-g9u2RvkPFhj3o8yC6ydZ-FB-KC7D_h1t7OR8bqixptgFGJFooyIBt8Ex9ue7iPgxCz-rgLY-iIuBhS8pyqV4ULAmOurHs2BjtkHJk9ZUtDW0U9czFbxa8XdHA Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 3de7b81c33324351b90ebdd38bb46f4a Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-VolumesActionsTest-601550647 Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3de7b81c33324351b90ebdd38bb46f4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3de7b81c33324351b90ebdd38bb46f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3de7b81c33324351b90ebdd38bb46f4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3de7b81c33324351b90ebdd38bb46f4a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-VolumesActionsTest-601550647 Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 3de7b81c33324351b90ebdd38bb46f4a Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-VolumesActionsTest-601550647 Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-VolumesActionsTest-601550647-project Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: f304e14a0c4241259d928ec0d1a69ad7 Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-VolumesActionsTest-601550647-project Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 5d38beb5-d7c6-4ad5-a358-7a45d7d87492 could not be found. Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5d38beb5-d7c6-4ad5-a358-7a45d7d87492'} Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d38beb5-d7c6-4ad5-a358-7a45d7d87492 could not be found. Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d38beb5-d7c6-4ad5-a358-7a45d7d87492 could not be found. Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:09:49.289556 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:49.294173 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:09:49.294173 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:09:49.294173 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:09:49.294173 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:09:49.294173 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:09:49.294173 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d38beb5-d7c6-4ad5-a358-7a45d7d87492 could not be found. Sep 10 11:09:49.294173 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:09:49.295829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] Returning 404 to user: Instance 5d38beb5-d7c6-4ad5-a358-7a45d7d87492 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:09:49.297874 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9c0749ec-ddb2-4a97-a7b6-2f4f6d08b9b6 tempest-VolumesActionsTest-601550647 tempest-VolumesActionsTest-601550647-project] 10.222.0.20 "GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492" status: 404 len: 111 microversion: 2.1 time: 0.048170 Sep 10 11:09:49.299121 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1547/5405] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:09:49 2022] GET /compute/v2.1/servers/5d38beb5-d7c6-4ad5-a358-7a45d7d87492 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:09:51.117611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7001d301-78a5-48e0-b7d5-71e210da7ff8 req-f6af2ea2-b953-4d2f-886b-0822ba55e0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0828a95e-ab0c-46cf-b8e4-ebbcd16f0311", "tag": "9eadaa63-1be2-47a3-a6ab-8dc69087bda1"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:51.183268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7001d301-78a5-48e0-b7d5-71e210da7ff8 req-f6af2ea2-b953-4d2f-886b-0822ba55e0e6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:51.184130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7001d301-78a5-48e0-b7d5-71e210da7ff8 req-f6af2ea2-b953-4d2f-886b-0822ba55e0e6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:51.184620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7001d301-78a5-48e0-b7d5-71e210da7ff8 req-f6af2ea2-b953-4d2f-886b-0822ba55e0e6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:51.251134 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7001d301-78a5-48e0-b7d5-71e210da7ff8 req-f6af2ea2-b953-4d2f-886b-0822ba55e0e6 service nova] Creating event network-changed:9eadaa63-1be2-47a3-a6ab-8dc69087bda1 for instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 on n-h2-856894-1 Sep 10 11:09:51.295563 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7001d301-78a5-48e0-b7d5-71e210da7ff8 req-f6af2ea2-b953-4d2f-886b-0822ba55e0e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157578 Sep 10 11:09:51.299307 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3859/5406] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:51.378384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-869410658", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44c581b5-2ac2-4123-94e1-4b984ff98606"}], "security_groups": [{"name": "tempest-securitygroup--2072784575"}], "key_name": "tempest-keypair-771928341", "user_data": "}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:51.393651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:51.686895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] validate_networks() for [('44c581b5-2ac2-4123-94e1-4b984ff98606', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:09:53.291252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:09:53.293697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:09:53.294483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:09:53.295069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:09:53.296690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:09:53.341513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:53.342789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:53.347837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:53.350467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:53.351529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:53.360591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:53.401629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Getting quotas for project adc08265fd4c43aa822728bd86e1fed1. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:09:53.435460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Getting quotas for user 2c62573dd17f47fe9dd98200cc04bd23 and project adc08265fd4c43aa822728bd86e1fed1. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:09:53.475393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:09:53.479840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:09:53.607399 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1aaa8941-dc04-4ddb-9883-24e789ebaf47 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.233852 Sep 10 11:09:53.610407 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1548/5407] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 11:09:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2236 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:09:53.621404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a0b8af96-011c-4ce0-8297-371f2d2e9a78 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:53.622462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a0b8af96-011c-4ce0-8297-371f2d2e9a78 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:53.641692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:09:53.891622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a0b8af96-011c-4ce0-8297-371f2d2e9a78 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:53.910743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a0b8af96-011c-4ce0-8297-371f2d2e9a78 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:53.929907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a0b8af96-011c-4ce0-8297-371f2d2e9a78 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:53.931176 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a0b8af96-011c-4ce0-8297-371f2d2e9a78 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1280 microversion: 2.20 time: 0.314946 Sep 10 11:09:53.931787 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3860/5408] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:09:53 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1280 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:09:54.960838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:54.962056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:54.968548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:54.969304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:54.969981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:54.971381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:54.972069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:54.972756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:55.109889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:55.121813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:55.123869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:55.125600 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f4d44b53-4c46-42fd-97eb-6b79cca21b6d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1332 microversion: 2.20 time: 0.170226 Sep 10 11:09:55.157851 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1549/5409] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:09:54 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1332 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:09:56.163401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:56.164231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:56.180227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:56.184866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:56.185595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:56.186665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:56.187298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:56.189991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:56.326108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:56.364099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:56.367500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:56.371938 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e522560-8a01-45b8-a75c-b8d32e985819 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1338 microversion: 2.20 time: 0.213808 Sep 10 11:09:56.374866 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3861/5410] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:09:56 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1338 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:09:57.406687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:57.407686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:57.418037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:57.418549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:57.419001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:57.419723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:57.421572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:57.422196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:57.684660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:57.699251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:57.704504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:57.710431 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f14fdfb5-a5da-42be-abfc-e6816d77dc96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1406 microversion: 2.20 time: 0.307423 Sep 10 11:09:57.712368 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1550/5411] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:09:57 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:09:57.905957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-54f6f890-ae87-4e96-8e87-25cdfdf4dfcd req-a543ff8e-e2bf-43a3-b2e8-39e253fdc9ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881d6159-5456-4a2f-98c2-0c3e66109b01", "tag": "f2b9da4b-7521-484c-90f9-f1b853ab04d2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:09:57.958007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-54f6f890-ae87-4e96-8e87-25cdfdf4dfcd req-a543ff8e-e2bf-43a3-b2e8-39e253fdc9ed service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:57.958558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-54f6f890-ae87-4e96-8e87-25cdfdf4dfcd req-a543ff8e-e2bf-43a3-b2e8-39e253fdc9ed service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:57.959035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-54f6f890-ae87-4e96-8e87-25cdfdf4dfcd req-a543ff8e-e2bf-43a3-b2e8-39e253fdc9ed service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:57.990480 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-54f6f890-ae87-4e96-8e87-25cdfdf4dfcd req-a543ff8e-e2bf-43a3-b2e8-39e253fdc9ed service nova] Creating event network-changed:f2b9da4b-7521-484c-90f9-f1b853ab04d2 for instance 881d6159-5456-4a2f-98c2-0c3e66109b01 on n-h2-856894-1 Sep 10 11:09:58.010131 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-54f6f890-ae87-4e96-8e87-25cdfdf4dfcd req-a543ff8e-e2bf-43a3-b2e8-39e253fdc9ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108495 Sep 10 11:09:58.011059 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3862/5412] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:09:58.744468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:09:58.745102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:09:58.787109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:58.787593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:58.788033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:58.788942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:09:58.789580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:09:58.790201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:09:59.129287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:59.139544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:59.157372 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:09:59.159197 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4be49726-737f-4ee8-bd26-3895bc0bd530 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1406 microversion: 2.20 time: 0.418616 Sep 10 11:09:59.159801 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1551/5413] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:09:58 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:10:00.194934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:00.195808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:00.204381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:00.205267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:00.205949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:00.207749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:00.208496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:00.209312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:00.443297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:00.452412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:00.458848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:00.460454 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27108f06-1c98-462f-8706-c9245b3f607b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1406 microversion: 2.20 time: 0.272296 Sep 10 11:10:00.473193 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3863/5414] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:00 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:01.368924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1908488388", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1846616331", "security_groups": [{"name": "tempest-secgroup-smoke-153191676"}], "block_device_mapping_v2": [{"uuid": "7dcb8625-23e0-4434-9688-097c2f6562ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e65712d8-efe4-477c-ab8b-0eb50d70eafc"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:01.486378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:01.487335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:01.498815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:01.501285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:01.504533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:01.505423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:01.506008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:01.506550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:01.517854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] validate_networks() for [('e65712d8-efe4-477c-ab8b-0eb50d70eafc', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:10:01.807709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:01.820266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:01.822791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:01.824688 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a21eaa3c-8deb-4783-bf6c-cefdd184e624 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1406 microversion: 2.20 time: 0.342365 Sep 10 11:10:01.828015 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3864/5415] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:01 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:10:02.052569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:10:02.052999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:10:02.053538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:10:02.053952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:10:02.054369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:10:02.073453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:02.073952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:02.074391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:02.075120 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:02.075578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:02.076129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:02.094022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:10:02.099209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for user 78004185356641b990a951dc95e6ca0c and project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:10:02.163849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:10:02.165995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7dcb8625-23e0-4434-9688-097c2f6562ac',volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:10:02.357407 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d9116498-cad8-4f95-beae-567e557c5fc6 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.992215 Sep 10 11:10:02.358343 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1552/5416] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:10:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:10:02.370947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b461d0c1-8708-4f70-a1a5-a4f6612bf4df tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:02.371606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b461d0c1-8708-4f70-a1a5-a4f6612bf4df tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:02.465351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b461d0c1-8708-4f70-a1a5-a4f6612bf4df tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:02.476456 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b461d0c1-8708-4f70-a1a5-a4f6612bf4df tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1095 microversion: 2.1 time: 0.109820 Sep 10 11:10:02.476984 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3865/5417] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:02 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1095 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:02.858830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:02.859698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:02.871957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:02.874072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:02.875304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:02.876181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:02.877698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:02.879801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:02.885651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=100 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:03.338727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:03.349596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:03.351074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:03.352228 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5e0e68b7-e94e-436b-b526-61641f916343 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1406 microversion: 2.20 time: 0.499862 Sep 10 11:10:03.358323 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1553/5418] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:02 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:03.500805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8d86e264-8f48-4141-b129-3a324d32454a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:03.501515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8d86e264-8f48-4141-b129-3a324d32454a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:03.510104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d86e264-8f48-4141-b129-3a324d32454a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:03.515710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d86e264-8f48-4141-b129-3a324d32454a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:03.516374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d86e264-8f48-4141-b129-3a324d32454a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:03.524549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d86e264-8f48-4141-b129-3a324d32454a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:03.525236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d86e264-8f48-4141-b129-3a324d32454a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:03.525713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d86e264-8f48-4141-b129-3a324d32454a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:03.604600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d86e264-8f48-4141-b129-3a324d32454a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:03.612557 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8d86e264-8f48-4141-b129-3a324d32454a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1193 microversion: 2.1 time: 0.116564 Sep 10 11:10:03.614023 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3866/5419] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:03 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1193 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:04.381220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:04.381760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:04.391766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:04.395529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:04.395988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:04.396708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:04.398968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:04.399560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:04.528347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-72e2bc20-5a88-4240-9bfa-4f9559ed2df9 req-314cb2b7-2e0f-4764-86bd-7f9c43e91520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881d6159-5456-4a2f-98c2-0c3e66109b01", "name": "network-vif-plugged", "status": "completed", "tag": "f2b9da4b-7521-484c-90f9-f1b853ab04d2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:04.548156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-72e2bc20-5a88-4240-9bfa-4f9559ed2df9 req-314cb2b7-2e0f-4764-86bd-7f9c43e91520 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:04.548798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-72e2bc20-5a88-4240-9bfa-4f9559ed2df9 req-314cb2b7-2e0f-4764-86bd-7f9c43e91520 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:04.549382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-72e2bc20-5a88-4240-9bfa-4f9559ed2df9 req-314cb2b7-2e0f-4764-86bd-7f9c43e91520 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:04.578585 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-72e2bc20-5a88-4240-9bfa-4f9559ed2df9 req-314cb2b7-2e0f-4764-86bd-7f9c43e91520 service nova] Creating event network-vif-plugged:f2b9da4b-7521-484c-90f9-f1b853ab04d2 for instance 881d6159-5456-4a2f-98c2-0c3e66109b01 on n-h2-856894-1 Sep 10 11:10:04.589736 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-72e2bc20-5a88-4240-9bfa-4f9559ed2df9 req-314cb2b7-2e0f-4764-86bd-7f9c43e91520 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065060 Sep 10 11:10:04.593765 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3867/5420] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:04.648354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97564d01-7440-4515-a2d3-680e32a3c642 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:04.650114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-97564d01-7440-4515-a2d3-680e32a3c642 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:04.667260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97564d01-7440-4515-a2d3-680e32a3c642 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:04.669698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97564d01-7440-4515-a2d3-680e32a3c642 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:04.671010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:04.672681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97564d01-7440-4515-a2d3-680e32a3c642 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:04.676480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97564d01-7440-4515-a2d3-680e32a3c642 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:04.677650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97564d01-7440-4515-a2d3-680e32a3c642 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:04.678851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97564d01-7440-4515-a2d3-680e32a3c642 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:04.689536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:04.694453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:04.696332 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9120be6d-fb59-4c2d-b993-40c82cf735e4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1406 microversion: 2.20 time: 0.319847 Sep 10 11:10:04.699587 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1554/5421] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:04 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:04.819190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-97564d01-7440-4515-a2d3-680e32a3c642 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:04.832896 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-97564d01-7440-4515-a2d3-680e32a3c642 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1211 microversion: 2.1 time: 0.199539 Sep 10 11:10:04.834419 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3868/5422] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:04 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1211 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:10:05.723563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:05.724183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:05.740454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:05.741112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:05.742256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:05.743056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:05.743727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:05.744518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:05.856093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a23aa494-45f3-414a-909c-69ee45884753 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:05.856728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a23aa494-45f3-414a-909c-69ee45884753 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:05.865268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a23aa494-45f3-414a-909c-69ee45884753 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:05.866043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a23aa494-45f3-414a-909c-69ee45884753 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:05.866703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a23aa494-45f3-414a-909c-69ee45884753 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:05.867603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a23aa494-45f3-414a-909c-69ee45884753 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:05.868255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a23aa494-45f3-414a-909c-69ee45884753 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:05.868917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a23aa494-45f3-414a-909c-69ee45884753 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:06.019788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:06.032102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:06.033970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:06.036325 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ffcc12f-2b8e-4352-aa61-a0d948f5399c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1406 microversion: 2.20 time: 0.317756 Sep 10 11:10:06.037658 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1555/5423] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:05 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:06.113762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a23aa494-45f3-414a-909c-69ee45884753 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:06.123677 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a23aa494-45f3-414a-909c-69ee45884753 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1278 microversion: 2.1 time: 0.271524 Sep 10 11:10:06.134384 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3869/5424] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:05 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:06.255732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-9d001aaf-790f-4b04-b197-54eb390f65b2 req-11fa1d02-cd7d-4ab8-ba67-3528d8d8d060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3c398a-6428-4e59-b945-77f5fafdb729", "tag": "333543d7-58c3-4f4c-a7c7-b7981a9ef87e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:06.268195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63d412e8-2c53-40d2-8a44-e33967315691 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:06.270324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63d412e8-2c53-40d2-8a44-e33967315691 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:06.285853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9d001aaf-790f-4b04-b197-54eb390f65b2 req-11fa1d02-cd7d-4ab8-ba67-3528d8d8d060 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:06.286475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9d001aaf-790f-4b04-b197-54eb390f65b2 req-11fa1d02-cd7d-4ab8-ba67-3528d8d8d060 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:06.287297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9d001aaf-790f-4b04-b197-54eb390f65b2 req-11fa1d02-cd7d-4ab8-ba67-3528d8d8d060 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:06.289807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d412e8-2c53-40d2-8a44-e33967315691 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:06.290353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d412e8-2c53-40d2-8a44-e33967315691 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:06.291374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d412e8-2c53-40d2-8a44-e33967315691 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:06.292138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d412e8-2c53-40d2-8a44-e33967315691 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:06.295212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d412e8-2c53-40d2-8a44-e33967315691 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:06.295711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63d412e8-2c53-40d2-8a44-e33967315691 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:06.302258 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-9d001aaf-790f-4b04-b197-54eb390f65b2 req-11fa1d02-cd7d-4ab8-ba67-3528d8d8d060 service nova] Creating event network-changed:333543d7-58c3-4f4c-a7c7-b7981a9ef87e for instance 9c3c398a-6428-4e59-b945-77f5fafdb729 on n-h2-856894-1 Sep 10 11:10:06.307777 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-9d001aaf-790f-4b04-b197-54eb390f65b2 req-11fa1d02-cd7d-4ab8-ba67-3528d8d8d060 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055767 Sep 10 11:10:06.309130 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1556/5425] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:06.336036 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63d412e8-2c53-40d2-8a44-e33967315691 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/ips" status: 200 len: 149 microversion: 2.1 time: 0.077482 Sep 10 11:10:06.344143 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3870/5426] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 11:10:06 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/ips => generated 149 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:10:07.065799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:07.067630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:07.077483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:07.089928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:07.090629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:07.091568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:07.092202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:07.092810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:07.151162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15470277-1b46-43eb-abed-cb42327e6bd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:07.151804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15470277-1b46-43eb-abed-cb42327e6bd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:07.164537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15470277-1b46-43eb-abed-cb42327e6bd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:07.165498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15470277-1b46-43eb-abed-cb42327e6bd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:07.166108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15470277-1b46-43eb-abed-cb42327e6bd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:07.168918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15470277-1b46-43eb-abed-cb42327e6bd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:07.169652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15470277-1b46-43eb-abed-cb42327e6bd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:07.172864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15470277-1b46-43eb-abed-cb42327e6bd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:07.575004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:07.601703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:07.605888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:07.607171 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-993739fb-949d-4011-b8cb-1d228f0b0bdd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1598 microversion: 2.20 time: 0.548072 Sep 10 11:10:07.617156 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1557/5427] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:07 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1598 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:07.617519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15470277-1b46-43eb-abed-cb42327e6bd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:07.622052 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15470277-1b46-43eb-abed-cb42327e6bd0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1278 microversion: 2.1 time: 0.474849 Sep 10 11:10:07.625217 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3871/5428] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:07 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1278 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:10:07.650092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2b01e709-2b8b-433b-9370-25b43b7443ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:07.653637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2b01e709-2b8b-433b-9370-25b43b7443ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:07.670439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b01e709-2b8b-433b-9370-25b43b7443ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:07.671676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b01e709-2b8b-433b-9370-25b43b7443ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:07.672500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b01e709-2b8b-433b-9370-25b43b7443ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:07.673645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b01e709-2b8b-433b-9370-25b43b7443ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:07.674761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b01e709-2b8b-433b-9370-25b43b7443ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:07.677091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b01e709-2b8b-433b-9370-25b43b7443ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:07.957349 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2b01e709-2b8b-433b-9370-25b43b7443ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.320098 Sep 10 11:10:07.957953 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1558/5429] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Sep 10 11:10:07 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-interface => generated 284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:10:08.658870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1e2b4c49-91ad-46c5-ba4f-09a6f6e1d690 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:08.660040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1e2b4c49-91ad-46c5-ba4f-09a6f6e1d690 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:08.681460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e2b4c49-91ad-46c5-ba4f-09a6f6e1d690 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:08.690343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e2b4c49-91ad-46c5-ba4f-09a6f6e1d690 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:08.691125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e2b4c49-91ad-46c5-ba4f-09a6f6e1d690 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:08.692705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e2b4c49-91ad-46c5-ba4f-09a6f6e1d690 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:08.695823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e2b4c49-91ad-46c5-ba4f-09a6f6e1d690 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:08.696032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1e2b4c49-91ad-46c5-ba4f-09a6f6e1d690 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:08.941928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1e2b4c49-91ad-46c5-ba4f-09a6f6e1d690 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:08.951912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1ae9eec9-4579-4b26-b4ec-77cba5e3973c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:08.955140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1ae9eec9-4579-4b26-b4ec-77cba5e3973c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:08.963641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:08.973114 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1e2b4c49-91ad-46c5-ba4f-09a6f6e1d690 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1278 microversion: 2.1 time: 0.321763 Sep 10 11:10:08.982636 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3872/5430] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:08 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1278 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:08.997012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ae9eec9-4579-4b26-b4ec-77cba5e3973c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:08.997627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ae9eec9-4579-4b26-b4ec-77cba5e3973c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:08.998143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ae9eec9-4579-4b26-b4ec-77cba5e3973c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:08.998934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ae9eec9-4579-4b26-b4ec-77cba5e3973c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:09.001673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ae9eec9-4579-4b26-b4ec-77cba5e3973c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:09.002327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ae9eec9-4579-4b26-b4ec-77cba5e3973c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:09.840503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c279f214-7831-4d2f-9070-41feb3d19d2d req-5e987b3d-1620-46c6-8f91-accfcdecce05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881d6159-5456-4a2f-98c2-0c3e66109b01", "tag": "f2b9da4b-7521-484c-90f9-f1b853ab04d2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:09.867631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c279f214-7831-4d2f-9070-41feb3d19d2d req-5e987b3d-1620-46c6-8f91-accfcdecce05 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:09.879709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c279f214-7831-4d2f-9070-41feb3d19d2d req-5e987b3d-1620-46c6-8f91-accfcdecce05 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:09.880792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c279f214-7831-4d2f-9070-41feb3d19d2d req-5e987b3d-1620-46c6-8f91-accfcdecce05 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:09.915168 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c279f214-7831-4d2f-9070-41feb3d19d2d req-5e987b3d-1620-46c6-8f91-accfcdecce05 service nova] Creating event network-changed:f2b9da4b-7521-484c-90f9-f1b853ab04d2 for instance 881d6159-5456-4a2f-98c2-0c3e66109b01 on n-h2-856894-1 Sep 10 11:10:09.922879 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1ae9eec9-4579-4b26-b4ec-77cba5e3973c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.978170 Sep 10 11:10:09.923723 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1559/5431] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:10:08 2022] POST /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments => generated 194 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:10:09.944496 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c279f214-7831-4d2f-9070-41feb3d19d2d req-5e987b3d-1620-46c6-8f91-accfcdecce05 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108749 Sep 10 11:10:09.946088 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3873/5432] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:10:10.010018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5340cd87-1282-4209-a8f0-71aa7f195971 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:10.011308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5340cd87-1282-4209-a8f0-71aa7f195971 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:10.028400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5340cd87-1282-4209-a8f0-71aa7f195971 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:10.030464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5340cd87-1282-4209-a8f0-71aa7f195971 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:10.032068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5340cd87-1282-4209-a8f0-71aa7f195971 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:10.034932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5340cd87-1282-4209-a8f0-71aa7f195971 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:10.036207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5340cd87-1282-4209-a8f0-71aa7f195971 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:10.038581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5340cd87-1282-4209-a8f0-71aa7f195971 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:10.446539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5340cd87-1282-4209-a8f0-71aa7f195971 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:10.458455 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5340cd87-1282-4209-a8f0-71aa7f195971 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1278 microversion: 2.1 time: 0.452684 Sep 10 11:10:10.459044 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1560/5433] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:10 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1278 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:11.489288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42161b6d-1cef-4b5b-bd65-e4929be55e8c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:11.490657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42161b6d-1cef-4b5b-bd65-e4929be55e8c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:11.505652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42161b6d-1cef-4b5b-bd65-e4929be55e8c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:11.509805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42161b6d-1cef-4b5b-bd65-e4929be55e8c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:11.510587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42161b6d-1cef-4b5b-bd65-e4929be55e8c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:11.511988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42161b6d-1cef-4b5b-bd65-e4929be55e8c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:11.513006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42161b6d-1cef-4b5b-bd65-e4929be55e8c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:11.513776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42161b6d-1cef-4b5b-bd65-e4929be55e8c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:11.791439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-42161b6d-1cef-4b5b-bd65-e4929be55e8c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:11.801029 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42161b6d-1cef-4b5b-bd65-e4929be55e8c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1278 microversion: 2.1 time: 0.318135 Sep 10 11:10:11.802243 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3874/5434] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:11 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1278 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:10:12.825823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-808a36db-e2cd-41e4-9c67-be2c960fbf27 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:12.826442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-808a36db-e2cd-41e4-9c67-be2c960fbf27 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:12.829307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:12.829975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=12 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:12.846755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-808a36db-e2cd-41e4-9c67-be2c960fbf27 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:12.847608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-808a36db-e2cd-41e4-9c67-be2c960fbf27 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:12.848355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-808a36db-e2cd-41e4-9c67-be2c960fbf27 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:12.849283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-808a36db-e2cd-41e4-9c67-be2c960fbf27 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:12.849923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-808a36db-e2cd-41e4-9c67-be2c960fbf27 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:12.850504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-808a36db-e2cd-41e4-9c67-be2c960fbf27 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:13.030028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-808a36db-e2cd-41e4-9c67-be2c960fbf27 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:13.040599 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-808a36db-e2cd-41e4-9c67-be2c960fbf27 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1266 microversion: 2.1 time: 0.218273 Sep 10 11:10:13.041855 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1561/5435] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:12 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:14.065353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-566124df-f429-4830-8369-3077733ece64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:14.066328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-566124df-f429-4830-8369-3077733ece64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:14.068802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:14.075946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-566124df-f429-4830-8369-3077733ece64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:14.076903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-566124df-f429-4830-8369-3077733ece64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:14.077740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-566124df-f429-4830-8369-3077733ece64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:14.078778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-566124df-f429-4830-8369-3077733ece64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:14.079401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-566124df-f429-4830-8369-3077733ece64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:14.080259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-566124df-f429-4830-8369-3077733ece64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:14.248026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-566124df-f429-4830-8369-3077733ece64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:14.256798 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-566124df-f429-4830-8369-3077733ece64 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1266 microversion: 2.1 time: 0.196391 Sep 10 11:10:14.258337 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3875/5436] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:14 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:15.280131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-af338259-c481-41a7-8d8e-eb1d672e2b2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:15.280738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-af338259-c481-41a7-8d8e-eb1d672e2b2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:15.300899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af338259-c481-41a7-8d8e-eb1d672e2b2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:15.301769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af338259-c481-41a7-8d8e-eb1d672e2b2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:15.302505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af338259-c481-41a7-8d8e-eb1d672e2b2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:15.303888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af338259-c481-41a7-8d8e-eb1d672e2b2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:15.304784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af338259-c481-41a7-8d8e-eb1d672e2b2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:15.305777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af338259-c481-41a7-8d8e-eb1d672e2b2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:15.556531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-af338259-c481-41a7-8d8e-eb1d672e2b2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:15.566396 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-af338259-c481-41a7-8d8e-eb1d672e2b2e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1266 microversion: 2.1 time: 0.288450 Sep 10 11:10:15.568369 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1562/5437] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:15 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:16.593603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e9f7d302-1172-4a8d-bdf8-9defafce61f5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:16.594281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e9f7d302-1172-4a8d-bdf8-9defafce61f5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:16.602403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9f7d302-1172-4a8d-bdf8-9defafce61f5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:16.602914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9f7d302-1172-4a8d-bdf8-9defafce61f5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:16.603379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9f7d302-1172-4a8d-bdf8-9defafce61f5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:16.604107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9f7d302-1172-4a8d-bdf8-9defafce61f5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:16.604592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9f7d302-1172-4a8d-bdf8-9defafce61f5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:16.605046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e9f7d302-1172-4a8d-bdf8-9defafce61f5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:16.743095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e9f7d302-1172-4a8d-bdf8-9defafce61f5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:16.751229 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e9f7d302-1172-4a8d-bdf8-9defafce61f5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1266 microversion: 2.1 time: 0.161606 Sep 10 11:10:16.751805 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3876/5438] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:16 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:10:17.774531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b8b13a94-dd01-4016-ace6-dae0e14fbcb9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:17.775055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b8b13a94-dd01-4016-ace6-dae0e14fbcb9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:17.801121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8b13a94-dd01-4016-ace6-dae0e14fbcb9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:17.801618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8b13a94-dd01-4016-ace6-dae0e14fbcb9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:17.802060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8b13a94-dd01-4016-ace6-dae0e14fbcb9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:17.802761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8b13a94-dd01-4016-ace6-dae0e14fbcb9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:17.803219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8b13a94-dd01-4016-ace6-dae0e14fbcb9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:17.803673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8b13a94-dd01-4016-ace6-dae0e14fbcb9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:17.953834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b8b13a94-dd01-4016-ace6-dae0e14fbcb9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:17.962799 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b8b13a94-dd01-4016-ace6-dae0e14fbcb9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1266 microversion: 2.1 time: 0.192043 Sep 10 11:10:17.963526 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1563/5439] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:17 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:18.986348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-64adbf0e-722a-4b29-a4f1-336a2e3708cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:18.986929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-64adbf0e-722a-4b29-a4f1-336a2e3708cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:18.994956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64adbf0e-722a-4b29-a4f1-336a2e3708cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:18.995538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64adbf0e-722a-4b29-a4f1-336a2e3708cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:18.995947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64adbf0e-722a-4b29-a4f1-336a2e3708cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:18.996679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64adbf0e-722a-4b29-a4f1-336a2e3708cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:18.997193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64adbf0e-722a-4b29-a4f1-336a2e3708cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:18.997650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64adbf0e-722a-4b29-a4f1-336a2e3708cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:19.145825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-64adbf0e-722a-4b29-a4f1-336a2e3708cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:19.154357 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-64adbf0e-722a-4b29-a4f1-336a2e3708cc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1266 microversion: 2.1 time: 0.172068 Sep 10 11:10:19.155045 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3877/5440] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:18 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:20.178826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d0260345-1b19-4741-a53f-314bbbf1c0b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:20.180246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d0260345-1b19-4741-a53f-314bbbf1c0b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:20.187572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0260345-1b19-4741-a53f-314bbbf1c0b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:20.188068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0260345-1b19-4741-a53f-314bbbf1c0b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:20.188621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0260345-1b19-4741-a53f-314bbbf1c0b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:20.189459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0260345-1b19-4741-a53f-314bbbf1c0b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:20.190080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0260345-1b19-4741-a53f-314bbbf1c0b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:20.190442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0260345-1b19-4741-a53f-314bbbf1c0b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:20.418697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d0260345-1b19-4741-a53f-314bbbf1c0b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:20.428819 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d0260345-1b19-4741-a53f-314bbbf1c0b1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1266 microversion: 2.1 time: 0.253829 Sep 10 11:10:20.431822 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1564/5441] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:20 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:21.463459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f77d04df-98a9-438f-aac0-bcaa4ee78de0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:21.465028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f77d04df-98a9-438f-aac0-bcaa4ee78de0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:21.472825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f77d04df-98a9-438f-aac0-bcaa4ee78de0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:21.473638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f77d04df-98a9-438f-aac0-bcaa4ee78de0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:21.474100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f77d04df-98a9-438f-aac0-bcaa4ee78de0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:21.474871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f77d04df-98a9-438f-aac0-bcaa4ee78de0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:21.475344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f77d04df-98a9-438f-aac0-bcaa4ee78de0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:21.475815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f77d04df-98a9-438f-aac0-bcaa4ee78de0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:21.648239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f77d04df-98a9-438f-aac0-bcaa4ee78de0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:21.666173 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f77d04df-98a9-438f-aac0-bcaa4ee78de0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1266 microversion: 2.1 time: 0.206614 Sep 10 11:10:21.672989 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3878/5442] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:21 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:22.636502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-c9a5f190-7320-4917-82c1-d4e2252af648 req-9dabce9d-33c2-40de-b02a-48be04d7b433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3c398a-6428-4e59-b945-77f5fafdb729", "name": "network-vif-plugged", "status": "completed", "tag": "333543d7-58c3-4f4c-a7c7-b7981a9ef87e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:22.663782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:22.681509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c9a5f190-7320-4917-82c1-d4e2252af648 req-9dabce9d-33c2-40de-b02a-48be04d7b433 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:22.686794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:22.698100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c9a5f190-7320-4917-82c1-d4e2252af648 req-9dabce9d-33c2-40de-b02a-48be04d7b433 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:22.698968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c9a5f190-7320-4917-82c1-d4e2252af648 req-9dabce9d-33c2-40de-b02a-48be04d7b433 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:22.699911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:22.718924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:22.720015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:22.720682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:22.721680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:22.723058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:22.723722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:22.738277 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-c9a5f190-7320-4917-82c1-d4e2252af648 req-9dabce9d-33c2-40de-b02a-48be04d7b433 service nova] Creating event network-vif-plugged:333543d7-58c3-4f4c-a7c7-b7981a9ef87e for instance 9c3c398a-6428-4e59-b945-77f5fafdb729 on n-h2-856894-1 Sep 10 11:10:22.744855 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-c9a5f190-7320-4917-82c1-d4e2252af648 req-9dabce9d-33c2-40de-b02a-48be04d7b433 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119254 Sep 10 11:10:22.746229 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1565/5443] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:22.753433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2b066284-71df-4a06-8f38-f801339b60c5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:22.754668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2b066284-71df-4a06-8f38-f801339b60c5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:22.762434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b066284-71df-4a06-8f38-f801339b60c5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:22.763258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b066284-71df-4a06-8f38-f801339b60c5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:22.763911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b066284-71df-4a06-8f38-f801339b60c5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:22.765029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b066284-71df-4a06-8f38-f801339b60c5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:22.765809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b066284-71df-4a06-8f38-f801339b60c5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:22.766430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2b066284-71df-4a06-8f38-f801339b60c5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:22.907032 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Invalid volume: volume 7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b is already attached to instances: 180ab04a-8bae-48f5-8019-be7b91bcf855 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments HTTP/1.1 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 74 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: {"volumeAttachment": {"volumeId": "7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b"}} Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: exception: Invalid volume: volume 7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b is already attached to instances: 180ab04a-8bae-48f5-8019-be7b91bcf855 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '180ab04a-8bae-48f5-8019-be7b91bcf855', 'body': {'volumeAttachment': {'volumeId': '7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b'}}} Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b is already attached to instances: 180ab04a-8bae-48f5-8019-be7b91bcf855 Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:10:22.910468 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b is already attached to instances: 180ab04a-8bae-48f5-8019-be7b91bcf855 Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b is already attached to instances: 180ab04a-8bae-48f5-8019-be7b91bcf855 Sep 10 11:10:22.914343 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:10:22.916828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 400 to user: Invalid volume: volume 7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b is already attached to instances: 180ab04a-8bae-48f5-8019-be7b91bcf855 {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:10:22.917826 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c23b8ebb-0831-4145-94c8-43f1bf0207ed tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.237257 Sep 10 11:10:22.918828 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3879/5444] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:10:22 2022] POST /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments => generated 174 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:10:23.002133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2b066284-71df-4a06-8f38-f801339b60c5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:23.011488 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2b066284-71df-4a06-8f38-f801339b60c5 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1266 microversion: 2.1 time: 0.263677 Sep 10 11:10:23.015164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f45d1e82-7b27-458f-96dd-ade8c5045157 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:23.015761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f45d1e82-7b27-458f-96dd-ade8c5045157 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:23.024535 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1566/5445] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:22 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:23.027218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f45d1e82-7b27-458f-96dd-ade8c5045157 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:23.029580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f45d1e82-7b27-458f-96dd-ade8c5045157 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:23.030651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f45d1e82-7b27-458f-96dd-ade8c5045157 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:23.032610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f45d1e82-7b27-458f-96dd-ade8c5045157 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:23.034797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f45d1e82-7b27-458f-96dd-ade8c5045157 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:23.035334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f45d1e82-7b27-458f-96dd-ade8c5045157 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:23.165730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-f45d1e82-7b27-458f-96dd-ade8c5045157 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lazy-loading 'services' on Instance uuid 180ab04a-8bae-48f5-8019-be7b91bcf855 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:10:23.261644 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f45d1e82-7b27-458f-96dd-ade8c5045157 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments/7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b" status: 202 len: 0 microversion: 2.1 time: 0.251403 Sep 10 11:10:23.262749 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3880/5446] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:10:23 2022] DELETE /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments/7b5b9d60-f13d-4526-ac98-0efb9d3fdb6b => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:10:23.272048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6c01e055-ba44-4255-9314-c57a6d467e6e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:23.274729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6c01e055-ba44-4255-9314-c57a6d467e6e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:23.282099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c01e055-ba44-4255-9314-c57a6d467e6e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:23.283192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c01e055-ba44-4255-9314-c57a6d467e6e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:23.284032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c01e055-ba44-4255-9314-c57a6d467e6e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:23.285381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c01e055-ba44-4255-9314-c57a6d467e6e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:23.286015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c01e055-ba44-4255-9314-c57a6d467e6e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:23.286616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c01e055-ba44-4255-9314-c57a6d467e6e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:23.385244 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6c01e055-ba44-4255-9314-c57a6d467e6e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115426 Sep 10 11:10:23.386056 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1567/5447] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:10:23 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:10:24.045672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82830ecb-15f3-4b97-b738-a728d526db98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:24.046538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82830ecb-15f3-4b97-b738-a728d526db98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:24.051084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=45 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:24.059963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82830ecb-15f3-4b97-b738-a728d526db98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:24.060722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82830ecb-15f3-4b97-b738-a728d526db98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:24.061298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82830ecb-15f3-4b97-b738-a728d526db98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:24.062373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82830ecb-15f3-4b97-b738-a728d526db98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:24.063407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82830ecb-15f3-4b97-b738-a728d526db98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:24.064644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82830ecb-15f3-4b97-b738-a728d526db98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:24.225898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-82830ecb-15f3-4b97-b738-a728d526db98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:24.234359 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82830ecb-15f3-4b97-b738-a728d526db98 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1266 microversion: 2.1 time: 0.193774 Sep 10 11:10:24.234954 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3881/5448] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:24 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:24.402249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7abf5cb6-d4cb-4426-9892-257d4e85936a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:24.405288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7abf5cb6-d4cb-4426-9892-257d4e85936a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:24.432356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7abf5cb6-d4cb-4426-9892-257d4e85936a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:24.432853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7abf5cb6-d4cb-4426-9892-257d4e85936a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:24.433326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7abf5cb6-d4cb-4426-9892-257d4e85936a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:24.434403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7abf5cb6-d4cb-4426-9892-257d4e85936a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:24.435241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7abf5cb6-d4cb-4426-9892-257d4e85936a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:24.436733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7abf5cb6-d4cb-4426-9892-257d4e85936a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:24.479864 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7abf5cb6-d4cb-4426-9892-257d4e85936a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084355 Sep 10 11:10:24.480514 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1568/5449] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:10:24 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:25.256598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c6811c20-91e5-4b50-9468-202c0dca5a21 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:25.259191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c6811c20-91e5-4b50-9468-202c0dca5a21 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:25.269049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6811c20-91e5-4b50-9468-202c0dca5a21 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:25.269595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6811c20-91e5-4b50-9468-202c0dca5a21 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:25.270054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6811c20-91e5-4b50-9468-202c0dca5a21 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:25.270775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6811c20-91e5-4b50-9468-202c0dca5a21 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:25.271250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6811c20-91e5-4b50-9468-202c0dca5a21 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:25.271709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c6811c20-91e5-4b50-9468-202c0dca5a21 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:25.474372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c6811c20-91e5-4b50-9468-202c0dca5a21 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:25.483535 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c6811c20-91e5-4b50-9468-202c0dca5a21 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1453 microversion: 2.1 time: 0.230849 Sep 10 11:10:25.484789 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3882/5450] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:25 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1453 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:10:25.492823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-acf7fecb-cb95-45cf-9a4e-af15ac4a6eb2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:25.495107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-acf7fecb-cb95-45cf-9a4e-af15ac4a6eb2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:25.509185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51b0b20d-fd43-4b2a-bd26-69477eacdaef tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:25.509836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51b0b20d-fd43-4b2a-bd26-69477eacdaef tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:25.510069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf7fecb-cb95-45cf-9a4e-af15ac4a6eb2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:25.510569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf7fecb-cb95-45cf-9a4e-af15ac4a6eb2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:25.511017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf7fecb-cb95-45cf-9a4e-af15ac4a6eb2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:25.511714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf7fecb-cb95-45cf-9a4e-af15ac4a6eb2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:25.512170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf7fecb-cb95-45cf-9a4e-af15ac4a6eb2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:25.512602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acf7fecb-cb95-45cf-9a4e-af15ac4a6eb2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:25.521623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b0b20d-fd43-4b2a-bd26-69477eacdaef tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:25.522293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b0b20d-fd43-4b2a-bd26-69477eacdaef tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:25.523124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b0b20d-fd43-4b2a-bd26-69477eacdaef tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:25.523853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b0b20d-fd43-4b2a-bd26-69477eacdaef tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:25.524333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b0b20d-fd43-4b2a-bd26-69477eacdaef tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:25.524883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51b0b20d-fd43-4b2a-bd26-69477eacdaef tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:25.580401 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-acf7fecb-cb95-45cf-9a4e-af15ac4a6eb2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091361 Sep 10 11:10:25.585781 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1569/5451] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:10:25 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:25.712394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-51b0b20d-fd43-4b2a-bd26-69477eacdaef tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:25.724982 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51b0b20d-fd43-4b2a-bd26-69477eacdaef tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1453 microversion: 2.1 time: 0.221644 Sep 10 11:10:25.737995 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3883/5452] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:25 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1453 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:10:26.497696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a625fc7d-72d9-4aaa-b48d-4a5b0853de83 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:26.498219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a625fc7d-72d9-4aaa-b48d-4a5b0853de83 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:26.512079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a625fc7d-72d9-4aaa-b48d-4a5b0853de83 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:26.515187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a625fc7d-72d9-4aaa-b48d-4a5b0853de83 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:26.516100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a625fc7d-72d9-4aaa-b48d-4a5b0853de83 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:26.517348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a625fc7d-72d9-4aaa-b48d-4a5b0853de83 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:26.517889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a625fc7d-72d9-4aaa-b48d-4a5b0853de83 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:26.520271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a625fc7d-72d9-4aaa-b48d-4a5b0853de83 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:26.529995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:26.560255 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a625fc7d-72d9-4aaa-b48d-4a5b0853de83 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.068421 Sep 10 11:10:26.561321 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1570/5453] 10.222.0.20 () {58 vars in 1293 bytes} [Sat Sep 10 11:10:26 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311/os-server-password => generated 116 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:26.593378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3baf7b5c-0723-448b-8cdb-d01362d4d67b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:26.595798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3baf7b5c-0723-448b-8cdb-d01362d4d67b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:26.607926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3baf7b5c-0723-448b-8cdb-d01362d4d67b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:26.608333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3baf7b5c-0723-448b-8cdb-d01362d4d67b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:26.608925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3baf7b5c-0723-448b-8cdb-d01362d4d67b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:26.609674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3baf7b5c-0723-448b-8cdb-d01362d4d67b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:26.610316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3baf7b5c-0723-448b-8cdb-d01362d4d67b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:26.621458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3baf7b5c-0723-448b-8cdb-d01362d4d67b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:26.698616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3baf7b5c-0723-448b-8cdb-d01362d4d67b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109474 Sep 10 11:10:26.699230 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3884/5454] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:10:26 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:27.711633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c52523ed-ea11-4c18-83dd-f2c1b8d13dcc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:27.715115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c52523ed-ea11-4c18-83dd-f2c1b8d13dcc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:27.723046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c52523ed-ea11-4c18-83dd-f2c1b8d13dcc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:27.724976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c52523ed-ea11-4c18-83dd-f2c1b8d13dcc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:27.725870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c52523ed-ea11-4c18-83dd-f2c1b8d13dcc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:27.726873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c52523ed-ea11-4c18-83dd-f2c1b8d13dcc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:27.727518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c52523ed-ea11-4c18-83dd-f2c1b8d13dcc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:27.728102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c52523ed-ea11-4c18-83dd-f2c1b8d13dcc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:27.766421 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c52523ed-ea11-4c18-83dd-f2c1b8d13dcc tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059739 Sep 10 11:10:27.767276 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1571/5455] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:10:27 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:28.645849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-579e8af8-822a-4b18-9558-a695136ae10a req-55d3377f-8cde-496d-896e-211d35e7b047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3c398a-6428-4e59-b945-77f5fafdb729", "tag": "333543d7-58c3-4f4c-a7c7-b7981a9ef87e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:28.675914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-579e8af8-822a-4b18-9558-a695136ae10a req-55d3377f-8cde-496d-896e-211d35e7b047 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:28.676670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-579e8af8-822a-4b18-9558-a695136ae10a req-55d3377f-8cde-496d-896e-211d35e7b047 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:28.677145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-579e8af8-822a-4b18-9558-a695136ae10a req-55d3377f-8cde-496d-896e-211d35e7b047 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:28.698345 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-579e8af8-822a-4b18-9558-a695136ae10a req-55d3377f-8cde-496d-896e-211d35e7b047 service nova] Creating event network-changed:333543d7-58c3-4f4c-a7c7-b7981a9ef87e for instance 9c3c398a-6428-4e59-b945-77f5fafdb729 on n-h2-856894-1 Sep 10 11:10:28.713948 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-579e8af8-822a-4b18-9558-a695136ae10a req-55d3377f-8cde-496d-896e-211d35e7b047 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073104 Sep 10 11:10:28.719632 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3885/5456] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:28.780243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-659fb1dd-9884-4934-8480-806fb33425e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:28.783747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-659fb1dd-9884-4934-8480-806fb33425e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:28.802758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-659fb1dd-9884-4934-8480-806fb33425e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:28.807522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-659fb1dd-9884-4934-8480-806fb33425e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:28.810335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-659fb1dd-9884-4934-8480-806fb33425e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:28.811344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-659fb1dd-9884-4934-8480-806fb33425e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:28.812297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-659fb1dd-9884-4934-8480-806fb33425e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:28.815350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-659fb1dd-9884-4934-8480-806fb33425e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:28.931458 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-659fb1dd-9884-4934-8480-806fb33425e8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155461 Sep 10 11:10:28.937169 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1572/5457] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:10:28 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:29.948556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60836875-8d00-47cf-b704-afdefb110b3e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:29.951574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60836875-8d00-47cf-b704-afdefb110b3e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:29.965535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60836875-8d00-47cf-b704-afdefb110b3e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:29.966068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60836875-8d00-47cf-b704-afdefb110b3e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:29.969955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60836875-8d00-47cf-b704-afdefb110b3e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:29.971257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60836875-8d00-47cf-b704-afdefb110b3e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:29.972509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60836875-8d00-47cf-b704-afdefb110b3e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:29.973299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60836875-8d00-47cf-b704-afdefb110b3e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:30.022233 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60836875-8d00-47cf-b704-afdefb110b3e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079082 Sep 10 11:10:30.027486 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3886/5458] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:10:29 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:31.038200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a2a35fc7-33f8-4839-94c4-8c8244ef0a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:31.040763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a2a35fc7-33f8-4839-94c4-8c8244ef0a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:31.048953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a35fc7-33f8-4839-94c4-8c8244ef0a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:31.049767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a35fc7-33f8-4839-94c4-8c8244ef0a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:31.051256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a35fc7-33f8-4839-94c4-8c8244ef0a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:31.052151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a35fc7-33f8-4839-94c4-8c8244ef0a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:31.052769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a35fc7-33f8-4839-94c4-8c8244ef0a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:31.053421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a35fc7-33f8-4839-94c4-8c8244ef0a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:31.088777 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a2a35fc7-33f8-4839-94c4-8c8244ef0a80 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058533 Sep 10 11:10:31.089387 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1573/5459] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:10:31 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:10:31.161108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7454e21a-f143-4f3e-9f03-7cb4473d07a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:31.161751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7454e21a-f143-4f3e-9f03-7cb4473d07a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:31.168967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7454e21a-f143-4f3e-9f03-7cb4473d07a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:31.169586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7454e21a-f143-4f3e-9f03-7cb4473d07a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:31.170119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7454e21a-f143-4f3e-9f03-7cb4473d07a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:31.170935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7454e21a-f143-4f3e-9f03-7cb4473d07a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:31.171482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7454e21a-f143-4f3e-9f03-7cb4473d07a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:31.172102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7454e21a-f143-4f3e-9f03-7cb4473d07a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:31.199370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7454e21a-f143-4f3e-9f03-7cb4473d07a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:10:31.286044 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7454e21a-f143-4f3e-9f03-7cb4473d07a9 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 204 len: 0 microversion: 2.1 time: 0.128253 Sep 10 11:10:31.287242 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3887/5460] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:10:31 2022] DELETE /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:10:31.296753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-de316173-ad62-4994-a3da-c2f5fda866c8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:31.297412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-de316173-ad62-4994-a3da-c2f5fda866c8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:31.304667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-de316173-ad62-4994-a3da-c2f5fda866c8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:31.305407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-de316173-ad62-4994-a3da-c2f5fda866c8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:31.306015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-de316173-ad62-4994-a3da-c2f5fda866c8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:31.330993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-de316173-ad62-4994-a3da-c2f5fda866c8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:31.331546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-de316173-ad62-4994-a3da-c2f5fda866c8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:31.331994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-de316173-ad62-4994-a3da-c2f5fda866c8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:31.495492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-de316173-ad62-4994-a3da-c2f5fda866c8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:31.503983 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-de316173-ad62-4994-a3da-c2f5fda866c8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1679 microversion: 2.1 time: 0.211594 Sep 10 11:10:31.507036 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1574/5461] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:31 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:32.528593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b8e05b6-6ef3-4777-8442-bcfbcdb473d8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:32.529570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b8e05b6-6ef3-4777-8442-bcfbcdb473d8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:32.536735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b8e05b6-6ef3-4777-8442-bcfbcdb473d8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:32.537590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b8e05b6-6ef3-4777-8442-bcfbcdb473d8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:32.538127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b8e05b6-6ef3-4777-8442-bcfbcdb473d8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:32.538919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b8e05b6-6ef3-4777-8442-bcfbcdb473d8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:32.539507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b8e05b6-6ef3-4777-8442-bcfbcdb473d8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:32.540016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b8e05b6-6ef3-4777-8442-bcfbcdb473d8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:32.566743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:32.730604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b8e05b6-6ef3-4777-8442-bcfbcdb473d8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:32.742481 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b8e05b6-6ef3-4777-8442-bcfbcdb473d8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1679 microversion: 2.1 time: 0.218320 Sep 10 11:10:32.744172 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3888/5462] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:32 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:33.767631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3bd873f9-eb9e-46c5-97c2-4ba111e4f5d6 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:33.769491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3bd873f9-eb9e-46c5-97c2-4ba111e4f5d6 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:33.778262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bd873f9-eb9e-46c5-97c2-4ba111e4f5d6 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:33.779062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bd873f9-eb9e-46c5-97c2-4ba111e4f5d6 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:33.779772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bd873f9-eb9e-46c5-97c2-4ba111e4f5d6 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:33.780745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bd873f9-eb9e-46c5-97c2-4ba111e4f5d6 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:33.781431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bd873f9-eb9e-46c5-97c2-4ba111e4f5d6 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:33.782067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3bd873f9-eb9e-46c5-97c2-4ba111e4f5d6 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:33.906428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3bd873f9-eb9e-46c5-97c2-4ba111e4f5d6 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:33.915331 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3bd873f9-eb9e-46c5-97c2-4ba111e4f5d6 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1613 microversion: 2.1 time: 0.152607 Sep 10 11:10:33.916866 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1575/5463] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:33 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1613 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:34.157886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b004fbc3-1381-4917-94af-bc7583b4b974 req-da664ca2-db61-420a-84de-c1121dc824d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180ab04a-8bae-48f5-8019-be7b91bcf855", "name": "network-vif-deleted", "tag": "c522ca58-4da8-43f9-8acf-020539462916"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:34.187661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b004fbc3-1381-4917-94af-bc7583b4b974 req-da664ca2-db61-420a-84de-c1121dc824d4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:34.188880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b004fbc3-1381-4917-94af-bc7583b4b974 req-da664ca2-db61-420a-84de-c1121dc824d4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:34.189459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b004fbc3-1381-4917-94af-bc7583b4b974 req-da664ca2-db61-420a-84de-c1121dc824d4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:34.206221 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b004fbc3-1381-4917-94af-bc7583b4b974 req-da664ca2-db61-420a-84de-c1121dc824d4 service nova] Creating event network-vif-deleted:c522ca58-4da8-43f9-8acf-020539462916 for instance 180ab04a-8bae-48f5-8019-be7b91bcf855 on n-h2-856894-1 Sep 10 11:10:34.213649 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b004fbc3-1381-4917-94af-bc7583b4b974 req-da664ca2-db61-420a-84de-c1121dc824d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059447 Sep 10 11:10:34.215220 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3889/5464] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:34.942144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:34.942897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:34.956758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:34.958299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:34.961228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:34.963655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:34.964550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:34.966755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:35.014720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:35.015557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:35.016278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:35.016992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lazy-loading 'fault' on Instance uuid 180ab04a-8bae-48f5-8019-be7b91bcf855 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:10:35.115683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:35.123171 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-965dcce3-09f3-402d-a08b-ae898f5c26b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 200 len: 1331 microversion: 2.1 time: 0.187086 Sep 10 11:10:35.124375 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1576/5465] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:34 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 1331 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:36.149769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:36.150770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:36.173659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:36.174472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:36.174974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:36.175886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:36.176400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:36.176867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:36.197164 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 HTTP/1.1 Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '180ab04a-8bae-48f5-8019-be7b91bcf855'} Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:10:36.198992 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:10:36.203381 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:10:36.203381 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:10:36.203381 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:10:36.203381 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:10:36.203381 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:10:36.203381 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:10:36.203381 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:10:36.203381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:10:36.203381 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-64fe47db-8638-4753-b225-7c6a9d368e5e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 404 len: 111 microversion: 2.1 time: 0.055899 Sep 10 11:10:36.203381 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3890/5466] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:36 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:10:36.211068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-77aad760-80ea-4196-82bd-3b62a29c5e40 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '.version_select at 0x7efcaedc7af0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:36.234454 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-77aad760-80ea-4196-82bd-3b62a29c5e40 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551943434" status: 202 len: 0 microversion: 2.1 time: 0.027663 Sep 10 11:10:36.236061 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1577/5467] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 11:10:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551943434 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:10:37.019003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5de33655-3e16-4409-a477-2720880b5703 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: .version_select at 0x7efcb2bd8b80>, body: {"keypair": {"name": "tempest-keypair-1049414143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ0Pi9QWUlkILs8Y8sd3AxY4MU70KGjK1C5DxHcFEr9lx+yonyVLJ32n9bYYOinGl8UIRTkHcl9fdznpzfqBcg+TpmtlcDSyvrVJJMx8CIqPMAskGpBX1Djlkx+OoDtMw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:37.060348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-5de33655-3e16-4409-a477-2720880b5703 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for project b28403f237c84af2a051fa9feb72f60b. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:10:37.067132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-5de33655-3e16-4409-a477-2720880b5703 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for user c3b1df3721f24d13807ab7f4c4a677f8 and project b28403f237c84af2a051fa9feb72f60b. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:10:37.110699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5de33655-3e16-4409-a477-2720880b5703 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095977 Sep 10 11:10:37.117260 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3891/5468] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:10:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:38.983818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1247742436", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e19ca223-58e0-4bb3-8cd0-347d45a52b81"}], "security_groups": [{"name": "tempest-securitygroup--1525464138"}], "key_name": "tempest-keypair-1049414143", "user_data": "}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:39.105545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] validate_networks() for [('e19ca223-58e0-4bb3-8cd0-347d45a52b81', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:10:39.535456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:10:39.535882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:10:39.536352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:10:39.536762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:10:39.537458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:10:39.547016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:39.547499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:39.547940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:39.557200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:39.557695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:39.558107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:39.577955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for project b28403f237c84af2a051fa9feb72f60b. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:10:39.585264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Getting quotas for user c3b1df3721f24d13807ab7f4c4a677f8 and project b28403f237c84af2a051fa9feb72f60b. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:10:39.598697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:10:39.601040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:10:39.651146 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5017486d-bed9-4727-bb45-090c11e0bc6c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.672441 Sep 10 11:10:39.651796 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1578/5469] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:10:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:10:39.700938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea5d6ad1-e4cb-4c80-994e-12df689a8a9b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:39.705829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea5d6ad1-e4cb-4c80-994e-12df689a8a9b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:39.778858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ea5d6ad1-e4cb-4c80-994e-12df689a8a9b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:39.789987 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea5d6ad1-e4cb-4c80-994e-12df689a8a9b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1242 microversion: 2.1 time: 0.130220 Sep 10 11:10:39.791432 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3892/5470] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:39 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:40.815312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2e8170fe-0ca3-4e68-86e8-9a4b7f2d990e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:40.817128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2e8170fe-0ca3-4e68-86e8-9a4b7f2d990e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:40.824064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e8170fe-0ca3-4e68-86e8-9a4b7f2d990e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:40.824561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e8170fe-0ca3-4e68-86e8-9a4b7f2d990e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:40.825108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e8170fe-0ca3-4e68-86e8-9a4b7f2d990e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:40.825943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e8170fe-0ca3-4e68-86e8-9a4b7f2d990e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:40.826554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e8170fe-0ca3-4e68-86e8-9a4b7f2d990e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:40.826975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e8170fe-0ca3-4e68-86e8-9a4b7f2d990e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:40.950142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2e8170fe-0ca3-4e68-86e8-9a4b7f2d990e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:40.960182 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2e8170fe-0ca3-4e68-86e8-9a4b7f2d990e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1294 microversion: 2.1 time: 0.150849 Sep 10 11:10:40.966038 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1579/5471] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:40 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1294 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:42.002271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ecc656a0-2973-46ec-bbb9-2a05ca2cc92b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:42.004297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ecc656a0-2973-46ec-bbb9-2a05ca2cc92b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:42.013404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc656a0-2973-46ec-bbb9-2a05ca2cc92b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:42.014236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc656a0-2973-46ec-bbb9-2a05ca2cc92b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:42.014914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc656a0-2973-46ec-bbb9-2a05ca2cc92b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:42.015884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc656a0-2973-46ec-bbb9-2a05ca2cc92b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:42.016591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc656a0-2973-46ec-bbb9-2a05ca2cc92b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:42.017903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ecc656a0-2973-46ec-bbb9-2a05ca2cc92b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:42.329540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ecc656a0-2973-46ec-bbb9-2a05ca2cc92b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:42.343906 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ecc656a0-2973-46ec-bbb9-2a05ca2cc92b tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1368 microversion: 2.1 time: 0.354332 Sep 10 11:10:42.345304 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3893/5472] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:41 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:42.761671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-247c46c8-453a-4a6e-9979-d36d8c7f562b req-6fda4052-6e74-40dd-9f13-b84ef3982011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84aeda03-e643-4983-b623-21bd91e457de", "tag": "04085c18-f5ec-4e73-bad3-0ec9fc10a27d"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:42.783456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-247c46c8-453a-4a6e-9979-d36d8c7f562b req-6fda4052-6e74-40dd-9f13-b84ef3982011 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:42.784456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-247c46c8-453a-4a6e-9979-d36d8c7f562b req-6fda4052-6e74-40dd-9f13-b84ef3982011 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:42.784900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-247c46c8-453a-4a6e-9979-d36d8c7f562b req-6fda4052-6e74-40dd-9f13-b84ef3982011 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:42.804392 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-247c46c8-453a-4a6e-9979-d36d8c7f562b req-6fda4052-6e74-40dd-9f13-b84ef3982011 service nova] Creating event network-changed:04085c18-f5ec-4e73-bad3-0ec9fc10a27d for instance 84aeda03-e643-4983-b623-21bd91e457de on n-h2-856894-1 Sep 10 11:10:42.820303 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-247c46c8-453a-4a6e-9979-d36d8c7f562b req-6fda4052-6e74-40dd-9f13-b84ef3982011 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062267 Sep 10 11:10:42.826043 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1580/5473] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:10:43.531808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95dde07a-7642-4db5-8623-f1653b032e1f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:43.532550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95dde07a-7642-4db5-8623-f1653b032e1f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:43.542651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95dde07a-7642-4db5-8623-f1653b032e1f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:43.543272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95dde07a-7642-4db5-8623-f1653b032e1f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:43.544485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95dde07a-7642-4db5-8623-f1653b032e1f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:43.545324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95dde07a-7642-4db5-8623-f1653b032e1f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:43.546031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95dde07a-7642-4db5-8623-f1653b032e1f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:43.546720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95dde07a-7642-4db5-8623-f1653b032e1f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:43.727270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95dde07a-7642-4db5-8623-f1653b032e1f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:43.736369 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95dde07a-7642-4db5-8623-f1653b032e1f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1368 microversion: 2.1 time: 0.370064 Sep 10 11:10:43.738528 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3894/5474] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:43 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1368 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:44.761774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-54206fb9-807c-4e95-bc84-c37054ea365c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:44.763464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-54206fb9-807c-4e95-bc84-c37054ea365c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:44.775043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54206fb9-807c-4e95-bc84-c37054ea365c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:44.777312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54206fb9-807c-4e95-bc84-c37054ea365c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:44.779061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54206fb9-807c-4e95-bc84-c37054ea365c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:44.779905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54206fb9-807c-4e95-bc84-c37054ea365c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:44.780458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54206fb9-807c-4e95-bc84-c37054ea365c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:44.780966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54206fb9-807c-4e95-bc84-c37054ea365c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:44.798758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c7eff9e-0cd5-400b-a6d8-c7e81a7287ed tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:44.800993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c7eff9e-0cd5-400b-a6d8-c7e81a7287ed tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:44.814226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c7eff9e-0cd5-400b-a6d8-c7e81a7287ed tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:44.815011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c7eff9e-0cd5-400b-a6d8-c7e81a7287ed tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:44.815938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c7eff9e-0cd5-400b-a6d8-c7e81a7287ed tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:44.817062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c7eff9e-0cd5-400b-a6d8-c7e81a7287ed tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:44.817815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c7eff9e-0cd5-400b-a6d8-c7e81a7287ed tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:44.818251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c7eff9e-0cd5-400b-a6d8-c7e81a7287ed tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:44.856777 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c7eff9e-0cd5-400b-a6d8-c7e81a7287ed tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/ips" status: 200 len: 151 microversion: 2.20 time: 0.063017 Sep 10 11:10:44.858646 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3895/5475] 10.222.0.20 () {60 vars in 1289 bytes} [Sat Sep 10 11:10:44 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/ips => generated 151 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:10:45.086408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-54206fb9-807c-4e95-bc84-c37054ea365c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:45.095240 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-54206fb9-807c-4e95-bc84-c37054ea365c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1368 microversion: 2.1 time: 0.338977 Sep 10 11:10:45.096065 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1581/5476] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:44 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1368 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:46.119196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c156bcd4-bb4b-4df4-a577-f26f757dc891 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:46.119825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c156bcd4-bb4b-4df4-a577-f26f757dc891 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:46.127348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c156bcd4-bb4b-4df4-a577-f26f757dc891 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:46.127849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c156bcd4-bb4b-4df4-a577-f26f757dc891 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:46.128460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c156bcd4-bb4b-4df4-a577-f26f757dc891 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:46.129346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c156bcd4-bb4b-4df4-a577-f26f757dc891 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:46.130036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c156bcd4-bb4b-4df4-a577-f26f757dc891 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:46.130455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c156bcd4-bb4b-4df4-a577-f26f757dc891 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:46.312864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c156bcd4-bb4b-4df4-a577-f26f757dc891 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:46.321462 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c156bcd4-bb4b-4df4-a577-f26f757dc891 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1368 microversion: 2.1 time: 0.206229 Sep 10 11:10:46.322255 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3896/5477] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:46 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:46.881300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-93693e6d-ca5c-4949-90bf-6ac61cdb8fbd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:46.881845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-93693e6d-ca5c-4949-90bf-6ac61cdb8fbd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:46.890872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93693e6d-ca5c-4949-90bf-6ac61cdb8fbd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:46.891655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93693e6d-ca5c-4949-90bf-6ac61cdb8fbd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:46.892276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93693e6d-ca5c-4949-90bf-6ac61cdb8fbd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:46.893884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93693e6d-ca5c-4949-90bf-6ac61cdb8fbd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:46.894507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93693e6d-ca5c-4949-90bf-6ac61cdb8fbd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:46.894941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93693e6d-ca5c-4949-90bf-6ac61cdb8fbd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:46.925743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-93693e6d-ca5c-4949-90bf-6ac61cdb8fbd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lazy-loading 'flavor' on Instance uuid 881d6159-5456-4a2f-98c2-0c3e66109b01 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:10:47.182311 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-93693e6d-ca5c-4949-90bf-6ac61cdb8fbd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "POST /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/action" status: 202 len: 0 microversion: 2.20 time: 0.304885 Sep 10 11:10:47.186276 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1582/5478] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 11:10:46 2022] POST /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:10:47.194119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:47.195011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:47.204034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:47.204833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:47.205465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:47.206888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:47.207516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:47.208140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:47.344803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-46bc5ecc-e552-4372-b55c-4d209b06cced tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:47.345550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-46bc5ecc-e552-4372-b55c-4d209b06cced tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:47.352280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46bc5ecc-e552-4372-b55c-4d209b06cced tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:47.353005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46bc5ecc-e552-4372-b55c-4d209b06cced tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:47.353469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46bc5ecc-e552-4372-b55c-4d209b06cced tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:47.354349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46bc5ecc-e552-4372-b55c-4d209b06cced tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:47.354959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46bc5ecc-e552-4372-b55c-4d209b06cced tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:47.355546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46bc5ecc-e552-4372-b55c-4d209b06cced tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:47.365644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:47.386121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:47.387602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:47.388840 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88bd7a18-deb2-43ca-8032-fb9a09a3a72f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.201032 Sep 10 11:10:47.401431 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3897/5479] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:47 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:47.549229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-46bc5ecc-e552-4372-b55c-4d209b06cced tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:47.561739 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-46bc5ecc-e552-4372-b55c-4d209b06cced tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1368 microversion: 2.1 time: 0.221138 Sep 10 11:10:47.562478 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1583/5480] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:47 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:10:48.420060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:48.420905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:48.429388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:48.430002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:48.430526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:48.432045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:48.432535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:48.433058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:48.588482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7af19430-2e0c-49e8-a01a-31cd79c460f3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:48.589804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7af19430-2e0c-49e8-a01a-31cd79c460f3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:48.599745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7af19430-2e0c-49e8-a01a-31cd79c460f3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:48.600325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7af19430-2e0c-49e8-a01a-31cd79c460f3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:48.600807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7af19430-2e0c-49e8-a01a-31cd79c460f3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:48.602134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7af19430-2e0c-49e8-a01a-31cd79c460f3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:48.603586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7af19430-2e0c-49e8-a01a-31cd79c460f3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:48.604678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7af19430-2e0c-49e8-a01a-31cd79c460f3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:48.703007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:48.716850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:48.720275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:48.723830 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e3bf278-a8cb-4b60-a06f-009dc1561965 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.308511 Sep 10 11:10:48.726532 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3898/5481] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:48 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:48.863472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7af19430-2e0c-49e8-a01a-31cd79c460f3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:48.882097 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7af19430-2e0c-49e8-a01a-31cd79c460f3 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1368 microversion: 2.1 time: 0.298850 Sep 10 11:10:48.882891 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1584/5482] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:48 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:10:48.898885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-834812e5-9c58-41c1-98d3-2f2399fc1a94 req-33d1980f-975c-4560-9667-54ebbd1f8eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84aeda03-e643-4983-b623-21bd91e457de", "name": "network-vif-plugged", "status": "completed", "tag": "04085c18-f5ec-4e73-bad3-0ec9fc10a27d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:48.915151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-834812e5-9c58-41c1-98d3-2f2399fc1a94 req-33d1980f-975c-4560-9667-54ebbd1f8eeb service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:48.915757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-834812e5-9c58-41c1-98d3-2f2399fc1a94 req-33d1980f-975c-4560-9667-54ebbd1f8eeb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:48.916208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-834812e5-9c58-41c1-98d3-2f2399fc1a94 req-33d1980f-975c-4560-9667-54ebbd1f8eeb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:48.928370 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-834812e5-9c58-41c1-98d3-2f2399fc1a94 req-33d1980f-975c-4560-9667-54ebbd1f8eeb service nova] Creating event network-vif-plugged:04085c18-f5ec-4e73-bad3-0ec9fc10a27d for instance 84aeda03-e643-4983-b623-21bd91e457de on n-h2-856894-1 Sep 10 11:10:48.936000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-834812e5-9c58-41c1-98d3-2f2399fc1a94 req-33d1980f-975c-4560-9667-54ebbd1f8eeb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128430 Sep 10 11:10:48.936664 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3899/5483] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:49.755140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:49.755759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:49.757856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:49.758672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:49.765831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:49.766363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:49.766856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:49.767594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:49.768166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:49.768632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:49.906943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:49.909012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0169b93e-2669-4786-b72c-881fddb1bf3f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:49.910076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0169b93e-2669-4786-b72c-881fddb1bf3f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:49.913493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:49.919317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:49.919680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0169b93e-2669-4786-b72c-881fddb1bf3f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:49.920165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0169b93e-2669-4786-b72c-881fddb1bf3f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:49.920625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0169b93e-2669-4786-b72c-881fddb1bf3f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:49.921231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:49.921412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0169b93e-2669-4786-b72c-881fddb1bf3f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:49.921861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0169b93e-2669-4786-b72c-881fddb1bf3f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:49.922315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0169b93e-2669-4786-b72c-881fddb1bf3f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:49.922740 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-715af5d0-902b-4dfd-b7fc-554d1395d903 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.173090 Sep 10 11:10:49.925228 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1585/5484] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:49 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:50.071835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0169b93e-2669-4786-b72c-881fddb1bf3f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:50.080021 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0169b93e-2669-4786-b72c-881fddb1bf3f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1368 microversion: 2.1 time: 0.175572 Sep 10 11:10:50.080600 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3900/5485] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:49 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:10:50.953179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:50.954598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:50.965438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:50.966079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:50.966638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:50.967453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:50.968007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:50.968957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:51.104177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87feb816-c14c-410b-ae3a-e7796660b9eb tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:51.105537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87feb816-c14c-410b-ae3a-e7796660b9eb tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:51.118376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87feb816-c14c-410b-ae3a-e7796660b9eb tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:51.119233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87feb816-c14c-410b-ae3a-e7796660b9eb tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:51.119927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87feb816-c14c-410b-ae3a-e7796660b9eb tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:51.120910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87feb816-c14c-410b-ae3a-e7796660b9eb tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:51.121607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87feb816-c14c-410b-ae3a-e7796660b9eb tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:51.122237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87feb816-c14c-410b-ae3a-e7796660b9eb tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:51.147762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:51.161228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:51.167589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:51.169340 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-edf7f391-1f4e-4087-875b-dfda6fe35a37 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.220015 Sep 10 11:10:51.172557 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1586/5486] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:50 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:51.294297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-87feb816-c14c-410b-ae3a-e7796660b9eb tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:51.304528 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87feb816-c14c-410b-ae3a-e7796660b9eb tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1558 microversion: 2.1 time: 0.204355 Sep 10 11:10:51.314295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3901/5487] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:10:51 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:10:51.331193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a1ccf2aa-825b-470e-b703-7c3310d29b9e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:51.331856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a1ccf2aa-825b-470e-b703-7c3310d29b9e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:51.338968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2aa-825b-470e-b703-7c3310d29b9e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:51.339637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2aa-825b-470e-b703-7c3310d29b9e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:51.340486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2aa-825b-470e-b703-7c3310d29b9e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:51.341477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2aa-825b-470e-b703-7c3310d29b9e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:51.342040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2aa-825b-470e-b703-7c3310d29b9e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:51.342688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1ccf2aa-825b-470e-b703-7c3310d29b9e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:51.346233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:51.441527 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a1ccf2aa-825b-470e-b703-7c3310d29b9e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115941 Sep 10 11:10:51.442277 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1587/5488] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:10:51 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:52.203805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:52.205409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:52.218049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:52.219085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:52.220010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:52.221122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:52.222551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:52.223153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:52.420475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:52.433771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:52.437241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:52.439440 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fed25afc-9e59-4538-b1d9-5fa1c055cd61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.241076 Sep 10 11:10:52.441168 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3902/5489] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:52 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:10:52.664752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-ec4cd486-9d9d-4b7c-8f62-5df1db64f176 req-934f14e2-ec77-4b6a-af77-8499694488e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84aeda03-e643-4983-b623-21bd91e457de", "tag": "04085c18-f5ec-4e73-bad3-0ec9fc10a27d"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:10:52.675286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ec4cd486-9d9d-4b7c-8f62-5df1db64f176 req-934f14e2-ec77-4b6a-af77-8499694488e8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:52.675765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ec4cd486-9d9d-4b7c-8f62-5df1db64f176 req-934f14e2-ec77-4b6a-af77-8499694488e8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:52.676358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ec4cd486-9d9d-4b7c-8f62-5df1db64f176 req-934f14e2-ec77-4b6a-af77-8499694488e8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:52.691506 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-ec4cd486-9d9d-4b7c-8f62-5df1db64f176 req-934f14e2-ec77-4b6a-af77-8499694488e8 service nova] Creating event network-changed:04085c18-f5ec-4e73-bad3-0ec9fc10a27d for instance 84aeda03-e643-4983-b623-21bd91e457de on n-h2-856894-1 Sep 10 11:10:52.698666 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-ec4cd486-9d9d-4b7c-8f62-5df1db64f176 req-934f14e2-ec77-4b6a-af77-8499694488e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039109 Sep 10 11:10:52.699465 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1588/5490] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:10:53.470166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:53.471692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:53.480061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:53.480816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:53.482121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:53.483035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:53.483523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:53.483985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:53.659806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:53.677408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:53.679980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:53.682069 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-84c1586e-6566-42de-bbc0-8b453294c49c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.218738 Sep 10 11:10:53.683165 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3903/5491] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:53 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:54.721966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:54.723869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:54.728426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:54.745794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:54.746526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:54.747165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:54.748178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:54.748978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:54.750410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:54.949373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:54.964702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:54.967126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:54.968957 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5571383d-26e1-4922-a278-0521354d4d03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.254356 Sep 10 11:10:54.970074 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1589/5492] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:54 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:55.999997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:56.001357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:56.019767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:10:56.026463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:56.029186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:56.030417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:56.032769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:56.035134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:56.035642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:56.198766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:56.209236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:56.211124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:56.212399 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26f2f025-74d2-4262-b9f3-a4c353e8e155 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.218148 Sep 10 11:10:56.213162 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3904/5493] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:55 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:57.241232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:57.242326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:57.250582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:57.251269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:57.251846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:57.253574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:57.254162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:57.254745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:57.432719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:57.444343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:57.447653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:57.449372 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-840809de-975d-4678-9a91-ed55b63923de tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.213401 Sep 10 11:10:57.450623 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1590/5494] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:57 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:58.481573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:58.482109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:58.495529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:58.496208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:58.496685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:58.497466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:58.497948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:58.498402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:58.730119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:58.741985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:58.744363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:58.746350 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db7bff14-4c16-49a6-ac0b-b9a4841af296 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.268718 Sep 10 11:10:58.747609 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3905/5495] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:58 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:10:59.781569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:10:59.783286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:10:59.794529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:59.795331 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:59.795860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:59.796631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:10:59.797187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:10:59.797880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:10:59.953871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:59.963187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:59.964778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:10:59.965950 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f683e1c5-f255-483d-a456-97f2aac954d4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.192119 Sep 10 11:10:59.966529 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1591/5496] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:10:59 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:00.992393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:00.993524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:01.004551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:01.005161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:01.005919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:01.006852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:01.007506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:01.007978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:01.169161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:01.178350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:01.180081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:01.181336 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56be731a-f897-4f59-b00a-ff54ddfa18fa tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.193418 Sep 10 11:11:01.182129 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3906/5497] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:00 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:02.207924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:02.208536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:02.215505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:02.215991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:02.216436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:02.217152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:02.217613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:02.218044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:02.355680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:02.364395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:02.365875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:02.367456 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-474e6450-c4dd-4a69-8fa9-2276f8db18ba tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.163998 Sep 10 11:11:02.368126 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1592/5498] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:02 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:03.394971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:03.395694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:03.402974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:03.403527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:03.403978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:03.404848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:03.405390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:03.405831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:03.410521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=85 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:03.601470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:03.614477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:03.616027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:03.617869 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-314b4c77-cada-4b49-86a5-9357dc963cab tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1743 microversion: 2.20 time: 0.227000 Sep 10 11:11:03.618630 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3907/5499] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:03 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1743 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:04.644260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:04.645221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:04.673009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:04.673724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:04.674649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:04.675424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:04.675856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:04.676280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:05.028480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:05.041738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:05.043503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:05.044736 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-56d3958f-2298-4108-9eea-e861f8470402 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1738 microversion: 2.20 time: 0.404769 Sep 10 11:11:05.045369 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1593/5500] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:04 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1738 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:06.075029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:06.075839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:06.084657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:06.085348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:06.085910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:06.086812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:06.087390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:06.087974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:06.266351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:06.279377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:06.281090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:06.282433 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a5f550c-37c2-4e4b-a04e-e51e18521514 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1738 microversion: 2.20 time: 0.211460 Sep 10 11:11:06.283115 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3908/5501] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:06 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:06.801897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-3efacd9b-1d80-4af4-ac90-bad723d03121 req-e3f7a80b-23aa-411b-85db-27c582e0da18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881d6159-5456-4a2f-98c2-0c3e66109b01", "name": "network-vif-plugged", "status": "completed", "tag": "f2b9da4b-7521-484c-90f9-f1b853ab04d2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:06.813494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3efacd9b-1d80-4af4-ac90-bad723d03121 req-e3f7a80b-23aa-411b-85db-27c582e0da18 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:06.814428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3efacd9b-1d80-4af4-ac90-bad723d03121 req-e3f7a80b-23aa-411b-85db-27c582e0da18 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:06.815188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3efacd9b-1d80-4af4-ac90-bad723d03121 req-e3f7a80b-23aa-411b-85db-27c582e0da18 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:06.832992 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3efacd9b-1d80-4af4-ac90-bad723d03121 req-e3f7a80b-23aa-411b-85db-27c582e0da18 service nova] Creating event network-vif-plugged:f2b9da4b-7521-484c-90f9-f1b853ab04d2 for instance 881d6159-5456-4a2f-98c2-0c3e66109b01 on n-h2-856894-1 Sep 10 11:11:06.840603 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-3efacd9b-1d80-4af4-ac90-bad723d03121 req-e3f7a80b-23aa-411b-85db-27c582e0da18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043025 Sep 10 11:11:06.843102 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1594/5502] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:07.319240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:07.321291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:07.352262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:07.357254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:07.362797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:07.363741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:07.365724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:07.367525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:08.025454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:08.051730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:08.055750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:08.058598 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8a49bf0f-db5a-48a3-b7b5-f00cd3424368 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1738 microversion: 2.20 time: 0.745746 Sep 10 11:11:08.060632 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3909/5503] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:07 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1738 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:09.094356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:09.094771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:09.105819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:09.106565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:09.107160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:09.108030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:09.108631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:09.109230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:09.286632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:09.302154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:09.304404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:09.306019 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-66901df2-8677-419f-b088-ae98ea8ee492 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1738 microversion: 2.20 time: 0.216207 Sep 10 11:11:09.317250 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1595/5504] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:09 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:10.334733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:10.335355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:10.342804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:10.343608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:10.344129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:10.344924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:10.345499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:10.346663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:10.511685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:10.523363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:10.525589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:10.527738 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aefb38ae-deb3-44ba-afd4-cac447fc2e5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1738 microversion: 2.20 time: 0.196813 Sep 10 11:11:10.528568 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3910/5505] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:10 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:11.216476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-874833238", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "94b2cb9c-6370-4bb1-962b-85e66666ba78"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:11.277944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] validate_networks() for [('94b2cb9c-6370-4bb1-962b-85e66666ba78', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:11:11.554766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:11.555591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:11.569596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:11.570391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:11.570849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:11.571941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:11.572576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:11.573436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:11.868276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:11.883119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:11.886195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:11.887423 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-62029f9c-43a2-404a-94d3-0e822a67f27a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1738 microversion: 2.20 time: 0.336666 Sep 10 11:11:11.887998 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3911/5506] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:11 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1738 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:12.026612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:11:12.027246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:11:12.027893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:11:12.028494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:11:12.028947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:11:12.052987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:12.053788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:12.054231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:12.055025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:12.055499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:12.055928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:12.084462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Getting quotas for project af65a177b6334cae9bdca1325c9661b7. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:11:12.095196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Getting quotas for user b8ec035d8b0b4366b7940e0f1b5d4411 and project af65a177b6334cae9bdca1325c9661b7. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:11:12.110272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:11:12.117680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:11:12.219258 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5ac66204-99a2-4016-a5c5-b4c218fdfdd5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006012 Sep 10 11:11:12.220918 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1596/5507] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:11:12.234936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-61e8ee30-cee4-4ba5-a705-f505851d1adc tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:12.235577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-61e8ee30-cee4-4ba5-a705-f505851d1adc tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:12.302982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-61e8ee30-cee4-4ba5-a705-f505851d1adc tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:12.312781 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-61e8ee30-cee4-4ba5-a705-f505851d1adc tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1213 microversion: 2.1 time: 0.082163 Sep 10 11:11:12.313514 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3912/5508] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:12 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:12.915357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:12.916052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:12.925665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:12.927733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:12.928188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:12.928912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:12.929406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:12.929843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:13.129935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:13.156611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:13.162216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:13.164209 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5a93b918-07f3-49b0-915c-e931b1a52c30 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1738 microversion: 2.20 time: 0.253787 Sep 10 11:11:13.165843 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1597/5509] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:12 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:13.337650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b0151c6-f284-41c7-882c-c2ce200d3522 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:13.338288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9b0151c6-f284-41c7-882c-c2ce200d3522 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:13.346758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b0151c6-f284-41c7-882c-c2ce200d3522 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:13.347481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b0151c6-f284-41c7-882c-c2ce200d3522 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:13.347937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b0151c6-f284-41c7-882c-c2ce200d3522 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:13.348824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b0151c6-f284-41c7-882c-c2ce200d3522 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:13.349328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b0151c6-f284-41c7-882c-c2ce200d3522 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:13.349769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b0151c6-f284-41c7-882c-c2ce200d3522 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:13.431998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9b0151c6-f284-41c7-882c-c2ce200d3522 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:13.444585 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9b0151c6-f284-41c7-882c-c2ce200d3522 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1265 microversion: 2.1 time: 0.111394 Sep 10 11:11:13.445297 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3913/5510] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:13 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:14.193590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:14.195010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:14.218662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:14.219580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:14.220192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:14.221193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:14.221808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:14.222423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:14.472168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2f6426c-2dbb-492e-b1c4-287d156833b9 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:14.473542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e2f6426c-2dbb-492e-b1c4-287d156833b9 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:14.484324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f6426c-2dbb-492e-b1c4-287d156833b9 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:14.488756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f6426c-2dbb-492e-b1c4-287d156833b9 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:14.489602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f6426c-2dbb-492e-b1c4-287d156833b9 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:14.491252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f6426c-2dbb-492e-b1c4-287d156833b9 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:14.494060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f6426c-2dbb-492e-b1c4-287d156833b9 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:14.494781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2f6426c-2dbb-492e-b1c4-287d156833b9 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:14.500154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:14.532022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:14.546133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:14.548118 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a56e9764-2fc6-4e69-b7ac-db0588c05a48 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1738 microversion: 2.20 time: 0.359140 Sep 10 11:11:14.553222 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1598/5511] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:14 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:14.662126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e2f6426c-2dbb-492e-b1c4-287d156833b9 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:14.685469 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2f6426c-2dbb-492e-b1c4-287d156833b9 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1271 microversion: 2.1 time: 0.218060 Sep 10 11:11:14.713225 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3914/5512] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:14 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:15.577860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:15.578465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:15.585553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:15.586260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:15.586862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:15.587567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:15.588182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:15.588603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:15.720100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73e0b848-1b88-4482-84cb-06f35055963b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:15.721894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73e0b848-1b88-4482-84cb-06f35055963b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:15.736861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73e0b848-1b88-4482-84cb-06f35055963b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:15.754369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73e0b848-1b88-4482-84cb-06f35055963b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:15.755098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73e0b848-1b88-4482-84cb-06f35055963b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:15.756654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73e0b848-1b88-4482-84cb-06f35055963b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:15.757583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73e0b848-1b88-4482-84cb-06f35055963b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:15.758431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73e0b848-1b88-4482-84cb-06f35055963b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:15.967119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:15.977557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:15.979809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:15.981376 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3c83897a-00c9-425e-a209-5f7d0314a5e7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1738 microversion: 2.20 time: 0.407360 Sep 10 11:11:15.983464 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1599/5513] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:15 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1738 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:16.085953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73e0b848-1b88-4482-84cb-06f35055963b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:16.097008 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73e0b848-1b88-4482-84cb-06f35055963b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1313 microversion: 2.1 time: 0.380907 Sep 10 11:11:16.114891 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3915/5514] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:15 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:16.208606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-ff4dd5d4-1a97-43cf-bf91-065972e308f4 req-b849bbea-935d-4dea-bcc2-93f89354f6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f00f86d8-4d1b-4950-b47f-90e52a59f543", "tag": "e87f4f23-a36b-4d19-817e-f9169e334ad2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:16.227148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ff4dd5d4-1a97-43cf-bf91-065972e308f4 req-b849bbea-935d-4dea-bcc2-93f89354f6ff service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:16.227645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ff4dd5d4-1a97-43cf-bf91-065972e308f4 req-b849bbea-935d-4dea-bcc2-93f89354f6ff service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:16.228685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ff4dd5d4-1a97-43cf-bf91-065972e308f4 req-b849bbea-935d-4dea-bcc2-93f89354f6ff service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:16.243057 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-ff4dd5d4-1a97-43cf-bf91-065972e308f4 req-b849bbea-935d-4dea-bcc2-93f89354f6ff service nova] Creating event network-changed:e87f4f23-a36b-4d19-817e-f9169e334ad2 for instance f00f86d8-4d1b-4950-b47f-90e52a59f543 on n-h2-856894-1 Sep 10 11:11:16.259321 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-ff4dd5d4-1a97-43cf-bf91-065972e308f4 req-b849bbea-935d-4dea-bcc2-93f89354f6ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055554 Sep 10 11:11:16.260582 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1600/5515] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:17.010679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:17.012001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:17.020849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:17.021464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:17.021996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:17.023095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:17.023799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:17.024441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:17.130098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4e28d3d5-fc14-44d5-bbcf-8cbecd9eca47 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:17.130862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4e28d3d5-fc14-44d5-bbcf-8cbecd9eca47 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:17.142187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e28d3d5-fc14-44d5-bbcf-8cbecd9eca47 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:17.143305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e28d3d5-fc14-44d5-bbcf-8cbecd9eca47 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:17.148426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e28d3d5-fc14-44d5-bbcf-8cbecd9eca47 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:17.151122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e28d3d5-fc14-44d5-bbcf-8cbecd9eca47 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:17.151755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e28d3d5-fc14-44d5-bbcf-8cbecd9eca47 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:17.152540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4e28d3d5-fc14-44d5-bbcf-8cbecd9eca47 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:17.239702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:17.253748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:17.256429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:17.257724 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b0649cd3-1d74-4232-a958-66a92c4faa93 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1738 microversion: 2.20 time: 0.254279 Sep 10 11:11:17.258300 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3916/5516] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:17 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:17.322733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4e28d3d5-fc14-44d5-bbcf-8cbecd9eca47 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:17.333464 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4e28d3d5-fc14-44d5-bbcf-8cbecd9eca47 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1313 microversion: 2.1 time: 0.209462 Sep 10 11:11:17.334596 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1601/5517] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:17 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:18.285822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:18.286215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:18.295170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:18.295765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:18.296401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:18.297149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:18.297780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:18.298233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:18.358188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ce4f82ef-1347-461a-8dcb-4a6ca4d2184d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:18.358796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ce4f82ef-1347-461a-8dcb-4a6ca4d2184d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:18.365935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce4f82ef-1347-461a-8dcb-4a6ca4d2184d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:18.366718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce4f82ef-1347-461a-8dcb-4a6ca4d2184d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:18.367381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce4f82ef-1347-461a-8dcb-4a6ca4d2184d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:18.368309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce4f82ef-1347-461a-8dcb-4a6ca4d2184d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:18.368963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce4f82ef-1347-461a-8dcb-4a6ca4d2184d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:18.369622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ce4f82ef-1347-461a-8dcb-4a6ca4d2184d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:18.650942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:18.660356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:18.661862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:18.663459 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f03092d4-0c57-46ad-bdf9-cf8026851d44 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1720 microversion: 2.20 time: 0.382101 Sep 10 11:11:18.664039 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3917/5518] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:18 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1720 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:18.734660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ce4f82ef-1347-461a-8dcb-4a6ca4d2184d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:18.743143 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ce4f82ef-1347-461a-8dcb-4a6ca4d2184d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1313 microversion: 2.1 time: 0.388738 Sep 10 11:11:18.744133 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1602/5519] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:18 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:11:19.691881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:19.693761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:19.701796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:19.702401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:19.703163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:19.703952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:19.704667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:19.705150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:19.766655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4b7ffb47-89e0-4cd1-ab97-6e488f10ba5e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:19.767212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4b7ffb47-89e0-4cd1-ab97-6e488f10ba5e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:19.774101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b7ffb47-89e0-4cd1-ab97-6e488f10ba5e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:19.774586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b7ffb47-89e0-4cd1-ab97-6e488f10ba5e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:19.775039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b7ffb47-89e0-4cd1-ab97-6e488f10ba5e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:19.775716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b7ffb47-89e0-4cd1-ab97-6e488f10ba5e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:19.776169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b7ffb47-89e0-4cd1-ab97-6e488f10ba5e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:19.776599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b7ffb47-89e0-4cd1-ab97-6e488f10ba5e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:19.884031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:19.892419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:19.894541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:19.895738 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-89524cca-d5c8-46da-838b-873089e0505a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1720 microversion: 2.20 time: 0.208923 Sep 10 11:11:19.896311 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3918/5520] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:19 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:19.929478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4b7ffb47-89e0-4cd1-ab97-6e488f10ba5e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:19.937262 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4b7ffb47-89e0-4cd1-ab97-6e488f10ba5e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1313 microversion: 2.1 time: 0.174799 Sep 10 11:11:19.937842 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1603/5521] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:19 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:11:20.921716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:20.922678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:20.934059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:20.935601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:20.937366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:20.939337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:20.942892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:20.943365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:20.962390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9df2d52-43dd-41fc-80cc-cd4b8abe2649 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:20.965944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9df2d52-43dd-41fc-80cc-cd4b8abe2649 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:20.976452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df2d52-43dd-41fc-80cc-cd4b8abe2649 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:20.977105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df2d52-43dd-41fc-80cc-cd4b8abe2649 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:20.977851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df2d52-43dd-41fc-80cc-cd4b8abe2649 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:20.978801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df2d52-43dd-41fc-80cc-cd4b8abe2649 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:20.979345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df2d52-43dd-41fc-80cc-cd4b8abe2649 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:20.979955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df2d52-43dd-41fc-80cc-cd4b8abe2649 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:21.599851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:21.603019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9df2d52-43dd-41fc-80cc-cd4b8abe2649 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:21.610148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=88 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:21.612822 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9df2d52-43dd-41fc-80cc-cd4b8abe2649 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1313 microversion: 2.1 time: 0.656632 Sep 10 11:11:21.612972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:21.614117 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1604/5522] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:20 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:21.615208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:21.617171 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-be8e025c-d29a-4afd-ac4c-7e50efcb3d69 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1723 microversion: 2.20 time: 0.699422 Sep 10 11:11:21.631097 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3919/5523] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:20 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1723 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:21.648227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-48dd4604-e7cd-4698-971b-18688dffd2eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c349ff6-2379-459d-9c05-d01a8a1e7c64"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:21.651486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-48dd4604-e7cd-4698-971b-18688dffd2eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:21.658407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48dd4604-e7cd-4698-971b-18688dffd2eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:21.659170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48dd4604-e7cd-4698-971b-18688dffd2eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:21.660375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48dd4604-e7cd-4698-971b-18688dffd2eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:21.661127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48dd4604-e7cd-4698-971b-18688dffd2eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:21.661594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48dd4604-e7cd-4698-971b-18688dffd2eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:21.662030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48dd4604-e7cd-4698-971b-18688dffd2eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:22.072320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:22.103685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:22.122463 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-48dd4604-e7cd-4698-971b-18688dffd2eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "POST /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.480901 Sep 10 11:11:22.123114 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1605/5524] 10.222.0.20 () {62 vars in 1364 bytes} [Sat Sep 10 11:11:21 2022] POST /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments => generated 188 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:11:22.257530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87e505f6-f995-493d-b497-eb4f26453672 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:22.258115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87e505f6-f995-493d-b497-eb4f26453672 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:22.264746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e505f6-f995-493d-b497-eb4f26453672 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:22.265273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e505f6-f995-493d-b497-eb4f26453672 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:22.265726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e505f6-f995-493d-b497-eb4f26453672 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:22.266439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e505f6-f995-493d-b497-eb4f26453672 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:22.266889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e505f6-f995-493d-b497-eb4f26453672 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:22.267330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87e505f6-f995-493d-b497-eb4f26453672 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:22.308094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87e505f6-f995-493d-b497-eb4f26453672 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128788) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 11:11:22.318327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:22.373433 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87e505f6-f995-493d-b497-eb4f26453672 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "POST /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/action" status: 202 len: 0 microversion: 2.20 time: 0.120491 Sep 10 11:11:22.374065 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3920/5525] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 11:11:22 2022] POST /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:11:22.382842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:22.383462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:22.389517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:22.390007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:22.390446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:22.391142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:22.391601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:22.392033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:22.542189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:22.555033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:22.556759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:22.558190 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-20d69c50-72a9-4376-b928-e9aa39b3864a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1749 microversion: 2.20 time: 0.179959 Sep 10 11:11:22.569321 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1606/5526] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:22 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:22.637227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6f38403-76fc-4f3c-9663-54bb770c648e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:22.637869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6f38403-76fc-4f3c-9663-54bb770c648e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:22.647508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f38403-76fc-4f3c-9663-54bb770c648e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:22.648029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f38403-76fc-4f3c-9663-54bb770c648e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:22.648762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f38403-76fc-4f3c-9663-54bb770c648e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:22.650667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f38403-76fc-4f3c-9663-54bb770c648e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:22.651195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f38403-76fc-4f3c-9663-54bb770c648e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:22.651647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f38403-76fc-4f3c-9663-54bb770c648e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:22.809058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f6f38403-76fc-4f3c-9663-54bb770c648e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:22.819443 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6f38403-76fc-4f3c-9663-54bb770c648e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1313 microversion: 2.1 time: 0.185947 Sep 10 11:11:22.825106 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3921/5527] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:22 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:22.905676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-57b537d1-e996-46dc-9161-d87f316b023d req-89f1f6dd-f1d3-4f8d-8471-e0e04bf50a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00f86d8-4d1b-4950-b47f-90e52a59f543", "name": "network-vif-plugged", "status": "completed", "tag": "e87f4f23-a36b-4d19-817e-f9169e334ad2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:22.935846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-57b537d1-e996-46dc-9161-d87f316b023d req-89f1f6dd-f1d3-4f8d-8471-e0e04bf50a0b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:22.936510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-57b537d1-e996-46dc-9161-d87f316b023d req-89f1f6dd-f1d3-4f8d-8471-e0e04bf50a0b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:22.937127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-57b537d1-e996-46dc-9161-d87f316b023d req-89f1f6dd-f1d3-4f8d-8471-e0e04bf50a0b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:22.956850 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-57b537d1-e996-46dc-9161-d87f316b023d req-89f1f6dd-f1d3-4f8d-8471-e0e04bf50a0b service nova] Creating event network-vif-plugged:e87f4f23-a36b-4d19-817e-f9169e334ad2 for instance f00f86d8-4d1b-4950-b47f-90e52a59f543 on n-h2-856894-1 Sep 10 11:11:22.964183 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-57b537d1-e996-46dc-9161-d87f316b023d req-89f1f6dd-f1d3-4f8d-8471-e0e04bf50a0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061908 Sep 10 11:11:22.964931 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1607/5528] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:23.588037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:23.588595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:23.595771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:23.596267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:23.597279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:23.597990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:23.598463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:23.598905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:23.735232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:23.744270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:23.745846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:23.747046 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0206aab1-56b6-451e-8f75-6288209f7244 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1751 microversion: 2.20 time: 0.163157 Sep 10 11:11:23.747619 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3922/5529] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:23 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:23.843839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-136c406a-7774-4059-a98e-7aa61d885730 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:23.844635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-136c406a-7774-4059-a98e-7aa61d885730 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:23.852759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-136c406a-7774-4059-a98e-7aa61d885730 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:23.853285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-136c406a-7774-4059-a98e-7aa61d885730 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:23.853741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-136c406a-7774-4059-a98e-7aa61d885730 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:23.854417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-136c406a-7774-4059-a98e-7aa61d885730 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:23.854991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-136c406a-7774-4059-a98e-7aa61d885730 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:23.855421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-136c406a-7774-4059-a98e-7aa61d885730 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:24.001994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-136c406a-7774-4059-a98e-7aa61d885730 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:24.010711 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-136c406a-7774-4059-a98e-7aa61d885730 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1313 microversion: 2.1 time: 0.171178 Sep 10 11:11:24.011714 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1608/5530] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:23 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:24.773342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:24.774601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:24.782968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:24.783503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:24.783982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:24.784767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:24.785301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:24.785765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:24.933163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:24.935461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:24.945371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:24.946924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:24.948130 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6eb754dd-1fea-410a-8e51-9096f12c5324 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1751 microversion: 2.20 time: 0.178990 Sep 10 11:11:24.948710 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3923/5531] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:24 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:24.979781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-0275f4ce-c57b-47ad-ab42-cdf5dbebf0f5 req-75ced4f4-c60a-4af3-ab12-6b2a20eb8d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881d6159-5456-4a2f-98c2-0c3e66109b01", "name": "network-vif-unplugged", "status": "completed", "tag": "f2b9da4b-7521-484c-90f9-f1b853ab04d2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:24.985636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:24.992270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0275f4ce-c57b-47ad-ab42-cdf5dbebf0f5 req-75ced4f4-c60a-4af3-ab12-6b2a20eb8d23 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:24.992838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0275f4ce-c57b-47ad-ab42-cdf5dbebf0f5 req-75ced4f4-c60a-4af3-ab12-6b2a20eb8d23 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:24.993369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0275f4ce-c57b-47ad-ab42-cdf5dbebf0f5 req-75ced4f4-c60a-4af3-ab12-6b2a20eb8d23 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:25.005100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.compute.server_external_events [req-0275f4ce-c57b-47ad-ab42-cdf5dbebf0f5 req-75ced4f4-c60a-4af3-ab12-6b2a20eb8d23 service nova] Unable to find a host for instance 881d6159-5456-4a2f-98c2-0c3e66109b01. Dropping event network-vif-unplugged {{(pid=128787) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 11:11:25.006107 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-0275f4ce-c57b-47ad-ab42-cdf5dbebf0f5 req-75ced4f4-c60a-4af3-ab12-6b2a20eb8d23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030295 Sep 10 11:11:25.006694 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1609/5532] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 11:11:25.035278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-17f1474f-b79b-4174-94e9-65e7105d4e23 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:25.036177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-17f1474f-b79b-4174-94e9-65e7105d4e23 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:25.044094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17f1474f-b79b-4174-94e9-65e7105d4e23 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:25.044600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17f1474f-b79b-4174-94e9-65e7105d4e23 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:25.045056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17f1474f-b79b-4174-94e9-65e7105d4e23 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:25.045823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17f1474f-b79b-4174-94e9-65e7105d4e23 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:25.046297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17f1474f-b79b-4174-94e9-65e7105d4e23 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:25.046739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17f1474f-b79b-4174-94e9-65e7105d4e23 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:25.184319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-17f1474f-b79b-4174-94e9-65e7105d4e23 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:25.192412 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-17f1474f-b79b-4174-94e9-65e7105d4e23 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1498 microversion: 2.1 time: 0.161685 Sep 10 11:11:25.192999 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3924/5533] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:25 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:25.578520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5186ebef-1e69-46aa-b0da-8dba667e0d6e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:25.579237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5186ebef-1e69-46aa-b0da-8dba667e0d6e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:25.586355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5186ebef-1e69-46aa-b0da-8dba667e0d6e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:25.587024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5186ebef-1e69-46aa-b0da-8dba667e0d6e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:25.587460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5186ebef-1e69-46aa-b0da-8dba667e0d6e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:25.588203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5186ebef-1e69-46aa-b0da-8dba667e0d6e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:25.588659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5186ebef-1e69-46aa-b0da-8dba667e0d6e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:25.589127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5186ebef-1e69-46aa-b0da-8dba667e0d6e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:25.619795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5186ebef-1e69-46aa-b0da-8dba667e0d6e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:11:25.736195 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5186ebef-1e69-46aa-b0da-8dba667e0d6e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 204 len: 0 microversion: 2.1 time: 0.160731 Sep 10 11:11:25.738032 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1610/5534] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:11:25 2022] DELETE /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:11:25.746908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0719320c-480f-4b82-9e63-e5151cac83a5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:25.747576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0719320c-480f-4b82-9e63-e5151cac83a5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:25.753900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719320c-480f-4b82-9e63-e5151cac83a5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:25.754593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719320c-480f-4b82-9e63-e5151cac83a5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:25.755205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719320c-480f-4b82-9e63-e5151cac83a5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:25.756072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719320c-480f-4b82-9e63-e5151cac83a5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:25.756707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719320c-480f-4b82-9e63-e5151cac83a5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:25.757345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719320c-480f-4b82-9e63-e5151cac83a5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:25.895816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0719320c-480f-4b82-9e63-e5151cac83a5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:25.905004 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0719320c-480f-4b82-9e63-e5151cac83a5 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1504 microversion: 2.1 time: 0.162534 Sep 10 11:11:25.905626 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3925/5535] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:25 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:25.975412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:25.976181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:25.983086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:25.983659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:25.983999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:25.984693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:25.985168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:25.985593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:26.119567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:26.128699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:26.130315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:26.131665 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bed529cd-4f26-4e88-9da2-9e9aabb2e8ca tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1751 microversion: 2.20 time: 0.161154 Sep 10 11:11:26.132696 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1611/5536] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:25 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:26.929737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-286ab124-74f4-4246-a45b-35fc6f81fc2c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:26.930466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-286ab124-74f4-4246-a45b-35fc6f81fc2c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:26.934297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:26.941495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-286ab124-74f4-4246-a45b-35fc6f81fc2c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:26.942108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-286ab124-74f4-4246-a45b-35fc6f81fc2c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:26.942631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-286ab124-74f4-4246-a45b-35fc6f81fc2c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:26.944203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-286ab124-74f4-4246-a45b-35fc6f81fc2c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:26.944839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-286ab124-74f4-4246-a45b-35fc6f81fc2c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:26.945315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-286ab124-74f4-4246-a45b-35fc6f81fc2c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:27.126323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-286ab124-74f4-4246-a45b-35fc6f81fc2c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:27.135443 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-286ab124-74f4-4246-a45b-35fc6f81fc2c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1504 microversion: 2.1 time: 0.210456 Sep 10 11:11:27.139817 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3926/5537] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:26 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:27.162880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:27.163543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:27.170572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:27.171064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:27.171491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:27.172340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:27.172939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:27.173534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:27.365376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:27.374900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:27.376349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:27.377816 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4d79f08c-5d42-43cf-8f08-f38e92ab35cf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1751 microversion: 2.20 time: 0.219694 Sep 10 11:11:27.378383 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1612/5538] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:27 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1751 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:27.963791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a7a843a3-fe55-478c-93d3-b3f362a03957 req-079f4a2e-568f-460b-8343-48a1eabf9ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00f86d8-4d1b-4950-b47f-90e52a59f543", "name": "network-vif-deleted", "tag": "e87f4f23-a36b-4d19-817e-f9169e334ad2"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:27.975855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a7a843a3-fe55-478c-93d3-b3f362a03957 req-079f4a2e-568f-460b-8343-48a1eabf9ed8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:27.976483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a7a843a3-fe55-478c-93d3-b3f362a03957 req-079f4a2e-568f-460b-8343-48a1eabf9ed8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:27.977027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a7a843a3-fe55-478c-93d3-b3f362a03957 req-079f4a2e-568f-460b-8343-48a1eabf9ed8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:27.996396 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a7a843a3-fe55-478c-93d3-b3f362a03957 req-079f4a2e-568f-460b-8343-48a1eabf9ed8 service nova] Creating event network-vif-deleted:e87f4f23-a36b-4d19-817e-f9169e334ad2 for instance f00f86d8-4d1b-4950-b47f-90e52a59f543 on n-h2-856894-1 Sep 10 11:11:28.002234 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a7a843a3-fe55-478c-93d3-b3f362a03957 req-079f4a2e-568f-460b-8343-48a1eabf9ed8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041926 Sep 10 11:11:28.004530 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3927/5539] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:28.167653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:28.168268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:28.175742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:28.176502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:28.177109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:28.178021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:28.178642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:28.179213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:28.223758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:28.224181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:28.224626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:28.225102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lazy-loading 'fault' on Instance uuid f00f86d8-4d1b-4950-b47f-90e52a59f543 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:11:28.283465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:28.291787 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2fd63889-40db-4ea7-93eb-dbf558be83f2 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 200 len: 1303 microversion: 2.1 time: 0.128009 Sep 10 11:11:28.297734 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1613/5540] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:28 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:28.406104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:28.406796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:28.413991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:28.414693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:28.415168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:28.416070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:28.416557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:28.417006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:28.566260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:28.577438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:28.581346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:28.583054 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-11dd08d5-3b25-4efd-82aa-505afcfde5ac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1751 microversion: 2.20 time: 0.182547 Sep 10 11:11:28.594739 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3928/5541] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:28 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:29.316869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:29.317522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: f00f86d8-4d1b-4950-b47f-90e52a59f543] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:29.324559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:29.325086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:29.325646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:29.326466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:29.326925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:29.327354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:29.343116 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] HTTP exception thrown: Instance f00f86d8-4d1b-4950-b47f-90e52a59f543 could not be found. Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Request method failure captured: Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 HTTP/1.1 Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHDMALzM8VecL3D12FqLv-fUg1zvBEJajryoFGRwD11KJTLx8hxfgkjDTYnHsvBcsQoUySvVrRgSzq6e7HmJtP-_exkIaR20sN0DvOCXMFFFXQW7ewOdY7N4PBixc5U1qfV57I6q7BeoQ4I3-07Yp8hJ0fQHXKALBYQFNBKGvGDxM5Q Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: af65a177b6334cae9bdca1325c9661b7 Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-VolumesActionsTest-1504646386 Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af65a177b6334cae9bdca1325c9661b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/af65a177b6334cae9bdca1325c9661b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af65a177b6334cae9bdca1325c9661b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_af65a177b6334cae9bdca1325c9661b7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-VolumesActionsTest-1504646386 Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: af65a177b6334cae9bdca1325c9661b7 Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-VolumesActionsTest-1504646386 Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-VolumesActionsTest-1504646386-project Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b8ec035d8b0b4366b7940e0f1b5d4411 Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-VolumesActionsTest-1504646386-project Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance f00f86d8-4d1b-4950-b47f-90e52a59f543 could not be found. Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f00f86d8-4d1b-4950-b47f-90e52a59f543'} Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f00f86d8-4d1b-4950-b47f-90e52a59f543 could not be found. Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f00f86d8-4d1b-4950-b47f-90e52a59f543 could not be found. Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:11:29.345014 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:11:29.349285 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:11:29.349285 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:11:29.349285 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:11:29.349285 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:11:29.349285 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:11:29.349285 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f00f86d8-4d1b-4950-b47f-90e52a59f543 could not be found. Sep 10 11:11:29.349285 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:11:29.349285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Returning 404 to user: Instance f00f86d8-4d1b-4950-b47f-90e52a59f543 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:11:29.349285 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6719ce83-8b33-4fcb-adce-b479ec1eb8e1 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543" status: 404 len: 111 microversion: 2.1 time: 0.034689 Sep 10 11:11:29.349285 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1614/5542] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:29 2022] GET /compute/v2.1/servers/f00f86d8-4d1b-4950-b47f-90e52a59f543 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:11:29.454108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1545093950", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "94b2cb9c-6370-4bb1-962b-85e66666ba78"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:29.509836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] validate_networks() for [('94b2cb9c-6370-4bb1-962b-85e66666ba78', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:11:29.611903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:29.612730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:29.618844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:29.619408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:29.619920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:29.620691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:29.621256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:29.621749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:29.828338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:29.837850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:29.839774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:29.840972 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a370cc32-0186-4db4-90ff-5265ecd0b823 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.233122 Sep 10 11:11:29.841561 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1615/5543] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:29 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:30.050276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:11:30.051247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:11:30.051747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:11:30.052176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:11:30.052734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:11:30.062033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:30.062569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:30.063026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:30.063774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:30.064254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:30.064699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:30.083820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Getting quotas for project af65a177b6334cae9bdca1325c9661b7. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:11:30.089511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Getting quotas for user b8ec035d8b0b4366b7940e0f1b5d4411 and project af65a177b6334cae9bdca1325c9661b7. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:11:30.103895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:11:30.107915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:11:30.158455 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88fd68d0-7b4e-4e80-bc82-3067ba481ab8 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708276 Sep 10 11:11:30.159974 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3929/5544] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:11:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:11:30.170809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-97ba9175-b3e7-43c5-a7d8-0922ee053b4c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:30.171417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-97ba9175-b3e7-43c5-a7d8-0922ee053b4c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:30.247642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-97ba9175-b3e7-43c5-a7d8-0922ee053b4c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:30.258745 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-97ba9175-b3e7-43c5-a7d8-0922ee053b4c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1214 microversion: 2.1 time: 0.091565 Sep 10 11:11:30.259434 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1616/5545] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:30 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:30.450776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cf1cc9d-00c5-4114-a217-0ff40785bfe7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:30.451515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6cf1cc9d-00c5-4114-a217-0ff40785bfe7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:30.464693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf1cc9d-00c5-4114-a217-0ff40785bfe7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:30.465272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf1cc9d-00c5-4114-a217-0ff40785bfe7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:30.465848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf1cc9d-00c5-4114-a217-0ff40785bfe7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:30.466578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf1cc9d-00c5-4114-a217-0ff40785bfe7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:30.467199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf1cc9d-00c5-4114-a217-0ff40785bfe7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:30.467791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cf1cc9d-00c5-4114-a217-0ff40785bfe7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:30.494761 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cf1cc9d-00c5-4114-a217-0ff40785bfe7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/ips" status: 200 len: 149 microversion: 2.1 time: 0.048097 Sep 10 11:11:30.502515 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3930/5546] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Sep 10 11:11:30 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:30.872347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:30.873053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:30.880717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:30.881316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:30.882112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:30.883046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:30.884502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:30.885367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:31.045556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:31.056520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:31.058351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:31.059797 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-763f6411-18a9-4817-9954-18b375ce5e0d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.193682 Sep 10 11:11:31.060865 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1617/5547] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:30 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:31.286785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5afced12-e143-4956-b4ec-d635e6709e9a tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:31.288006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5afced12-e143-4956-b4ec-d635e6709e9a tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:31.298099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5afced12-e143-4956-b4ec-d635e6709e9a tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:31.300953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5afced12-e143-4956-b4ec-d635e6709e9a tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:31.301822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5afced12-e143-4956-b4ec-d635e6709e9a tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:31.302910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5afced12-e143-4956-b4ec-d635e6709e9a tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:31.303735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5afced12-e143-4956-b4ec-d635e6709e9a tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:31.305001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5afced12-e143-4956-b4ec-d635e6709e9a tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:31.441352 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5afced12-e143-4956-b4ec-d635e6709e9a tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:31.452121 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5afced12-e143-4956-b4ec-d635e6709e9a tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1266 microversion: 2.1 time: 0.170036 Sep 10 11:11:31.453622 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3931/5548] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:31 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:32.092150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:32.093447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:32.102885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:32.103606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:32.104333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:32.105437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:32.106112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:32.107472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:32.356349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:32.368800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:32.370608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:32.372101 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8353c290-07de-4f35-b99a-3ea5fb27c29d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.288763 Sep 10 11:11:32.372893 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1618/5549] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:32 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:32.482792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d96d6ce-4189-4ae8-883a-f053bd20a357 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:32.483320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d96d6ce-4189-4ae8-883a-f053bd20a357 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:32.490668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d96d6ce-4189-4ae8-883a-f053bd20a357 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:32.491189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d96d6ce-4189-4ae8-883a-f053bd20a357 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:32.491647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d96d6ce-4189-4ae8-883a-f053bd20a357 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:32.503418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d96d6ce-4189-4ae8-883a-f053bd20a357 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:32.504056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d96d6ce-4189-4ae8-883a-f053bd20a357 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:32.504576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d96d6ce-4189-4ae8-883a-f053bd20a357 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:32.634330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d96d6ce-4189-4ae8-883a-f053bd20a357 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:32.645885 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d96d6ce-4189-4ae8-883a-f053bd20a357 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1266 microversion: 2.1 time: 0.167099 Sep 10 11:11:32.647334 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3932/5550] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:32 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:33.052336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-28e10c2d-aa4a-4678-b402-a91f60d4a568 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8227a5fb-ca23-49be-85c4-9780b232d8ee"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:33.054880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-28e10c2d-aa4a-4678-b402-a91f60d4a568 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:33.061826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28e10c2d-aa4a-4678-b402-a91f60d4a568 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:33.062631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28e10c2d-aa4a-4678-b402-a91f60d4a568 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:33.063356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28e10c2d-aa4a-4678-b402-a91f60d4a568 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:33.064240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28e10c2d-aa4a-4678-b402-a91f60d4a568 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:33.064955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28e10c2d-aa4a-4678-b402-a91f60d4a568 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:33.066159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-28e10c2d-aa4a-4678-b402-a91f60d4a568 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:33.158130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:33.402512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:33.403154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:33.413986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:33.417742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:33.420052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:33.424101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:33.424699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:33.430380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:33.723707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:33.734470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:33.744692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:33.746339 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2a277463-e50b-4728-b037-8ba81925b4e6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.347933 Sep 10 11:11:33.751213 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3933/5551] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:33 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:33.764185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53f4fcb6-5593-4050-8237-fa3270420b1c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:33.765343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53f4fcb6-5593-4050-8237-fa3270420b1c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:33.779048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f4fcb6-5593-4050-8237-fa3270420b1c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:33.779729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f4fcb6-5593-4050-8237-fa3270420b1c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:33.780206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f4fcb6-5593-4050-8237-fa3270420b1c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:33.780935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f4fcb6-5593-4050-8237-fa3270420b1c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:33.781456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f4fcb6-5593-4050-8237-fa3270420b1c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:33.781926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f4fcb6-5593-4050-8237-fa3270420b1c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:33.889615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53f4fcb6-5593-4050-8237-fa3270420b1c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:33.899166 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53f4fcb6-5593-4050-8237-fa3270420b1c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1266 microversion: 2.1 time: 0.146470 Sep 10 11:11:33.900084 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3934/5552] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:33 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:34.775707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:34.776379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:34.784271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:34.784519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:34.784980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:34.785729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:34.786199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:34.786647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:35.010942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:35.024283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:35.028637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:35.030090 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7f3c25ca-deb8-4623-b31a-86665eacf1c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.258739 Sep 10 11:11:35.031240 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3935/5553] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:34 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:35.047242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b755b2df-0ae1-4c23-9f08-d1c1f1733084 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:35.047882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b755b2df-0ae1-4c23-9f08-d1c1f1733084 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:35.056935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b755b2df-0ae1-4c23-9f08-d1c1f1733084 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:35.057486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b755b2df-0ae1-4c23-9f08-d1c1f1733084 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:35.057945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b755b2df-0ae1-4c23-9f08-d1c1f1733084 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:35.058665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b755b2df-0ae1-4c23-9f08-d1c1f1733084 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:35.059138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b755b2df-0ae1-4c23-9f08-d1c1f1733084 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:35.059575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b755b2df-0ae1-4c23-9f08-d1c1f1733084 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:35.169756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b755b2df-0ae1-4c23-9f08-d1c1f1733084 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:35.179692 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b755b2df-0ae1-4c23-9f08-d1c1f1733084 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1266 microversion: 2.1 time: 0.147258 Sep 10 11:11:35.180505 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3936/5554] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:35 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:36.058463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:36.060400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:36.070987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:36.071888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:36.072561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:36.073504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:36.074761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:36.075432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:36.414555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:36.435331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:36.445978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:36.454764 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15c428d7-d9da-49aa-8bf8-c50c93234b5b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.400935 Sep 10 11:11:36.456463 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3937/5555] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:36 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:36.461417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82e03e2e-a71c-47aa-89a9-880f61da5b2d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:36.475298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82e03e2e-a71c-47aa-89a9-880f61da5b2d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:36.487102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82e03e2e-a71c-47aa-89a9-880f61da5b2d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:36.494275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82e03e2e-a71c-47aa-89a9-880f61da5b2d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:36.496006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82e03e2e-a71c-47aa-89a9-880f61da5b2d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:36.497363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82e03e2e-a71c-47aa-89a9-880f61da5b2d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:36.498028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82e03e2e-a71c-47aa-89a9-880f61da5b2d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:36.498490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82e03e2e-a71c-47aa-89a9-880f61da5b2d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:36.652354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-82e03e2e-a71c-47aa-89a9-880f61da5b2d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:36.662507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82e03e2e-a71c-47aa-89a9-880f61da5b2d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1266 microversion: 2.1 time: 0.204583 Sep 10 11:11:36.663381 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3938/5556] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:36 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:37.488704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:37.490127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:37.515051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:37.515907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:37.516563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:37.517512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:37.518695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:37.519311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:37.717797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:37.731909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:37.733435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:37.734955 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6404bf6-002d-4358-910d-053386bc1017 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.251230 Sep 10 11:11:37.754815 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3939/5557] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:37 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:37.767749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f9fd947-ee14-44c1-aaaf-00431062569d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:37.769440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0f9fd947-ee14-44c1-aaaf-00431062569d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:37.777849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f9fd947-ee14-44c1-aaaf-00431062569d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:37.779044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f9fd947-ee14-44c1-aaaf-00431062569d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:37.779594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f9fd947-ee14-44c1-aaaf-00431062569d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:37.780551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f9fd947-ee14-44c1-aaaf-00431062569d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:37.781292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f9fd947-ee14-44c1-aaaf-00431062569d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:37.782911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f9fd947-ee14-44c1-aaaf-00431062569d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:37.895467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0f9fd947-ee14-44c1-aaaf-00431062569d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:37.907248 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f9fd947-ee14-44c1-aaaf-00431062569d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1266 microversion: 2.1 time: 0.150931 Sep 10 11:11:37.908145 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3940/5558] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:37 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:38.763150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:38.764635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:38.786226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:38.786908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:38.787476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:38.788832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:38.789474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:38.791250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:39.061129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:39.077024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:39.078815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:39.080134 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d815360a-75c0-42fc-863a-b2e99d452a03 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.321843 Sep 10 11:11:39.081769 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3941/5559] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:38 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:39.089850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea22ff70-d623-4334-aafd-a837f89369aa tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:39.106023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea22ff70-d623-4334-aafd-a837f89369aa tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:39.114958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea22ff70-d623-4334-aafd-a837f89369aa tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:39.115624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea22ff70-d623-4334-aafd-a837f89369aa tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:39.116176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea22ff70-d623-4334-aafd-a837f89369aa tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:39.116971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea22ff70-d623-4334-aafd-a837f89369aa tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:39.117537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea22ff70-d623-4334-aafd-a837f89369aa tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:39.118173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea22ff70-d623-4334-aafd-a837f89369aa tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:39.122988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:39.200733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ea22ff70-d623-4334-aafd-a837f89369aa tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:39.213747 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea22ff70-d623-4334-aafd-a837f89369aa tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1266 microversion: 2.1 time: 0.127450 Sep 10 11:11:39.215072 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3942/5560] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:39 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:39.884723 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-28e10c2d-aa4a-4678-b402-a91f60d4a568 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "POST /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.836731 Sep 10 11:11:39.886443 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1619/5561] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:11:33 2022] POST /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments => generated 194 bytes in 6839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:40.113580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:40.115707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:40.123743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:40.125949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:40.133403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:40.135471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:40.136128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:40.137088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:40.137730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:40.138464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:40.246905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-79a761f9-8c1e-44ce-8860-bc1c61ded30e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:40.248154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-79a761f9-8c1e-44ce-8860-bc1c61ded30e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:40.256306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:40.258644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-79a761f9-8c1e-44ce-8860-bc1c61ded30e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:40.259472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-79a761f9-8c1e-44ce-8860-bc1c61ded30e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:40.260138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-79a761f9-8c1e-44ce-8860-bc1c61ded30e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:40.262469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-79a761f9-8c1e-44ce-8860-bc1c61ded30e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:40.262972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-79a761f9-8c1e-44ce-8860-bc1c61ded30e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:40.263438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-79a761f9-8c1e-44ce-8860-bc1c61ded30e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:40.422894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-79a761f9-8c1e-44ce-8860-bc1c61ded30e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:40.442765 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-79a761f9-8c1e-44ce-8860-bc1c61ded30e tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1274 microversion: 2.1 time: 0.209028 Sep 10 11:11:40.444833 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1620/5562] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:40 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1274 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:11:40.707904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:40.718681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:40.721855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:40.723197 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4ea7f918-49bf-44eb-878d-ece7dc0cb0c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.617060 Sep 10 11:11:40.725738 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3943/5563] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:40 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:41.472199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6de772e8-bfe1-42c1-84cb-b3b72d247078 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:41.472824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6de772e8-bfe1-42c1-84cb-b3b72d247078 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:41.480980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6de772e8-bfe1-42c1-84cb-b3b72d247078 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:41.481740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6de772e8-bfe1-42c1-84cb-b3b72d247078 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:41.482363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6de772e8-bfe1-42c1-84cb-b3b72d247078 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:41.483135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6de772e8-bfe1-42c1-84cb-b3b72d247078 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:41.483670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6de772e8-bfe1-42c1-84cb-b3b72d247078 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:41.484140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6de772e8-bfe1-42c1-84cb-b3b72d247078 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:41.753837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:41.754476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:41.763314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:41.763836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:41.764295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:41.765367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:41.766065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:41.766727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:41.804893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6de772e8-bfe1-42c1-84cb-b3b72d247078 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:41.821219 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6de772e8-bfe1-42c1-84cb-b3b72d247078 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1314 microversion: 2.1 time: 0.353374 Sep 10 11:11:41.822044 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1621/5564] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:41 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:42.045177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:42.073193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:42.074702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:42.086925 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d182d3ad-1a84-4a70-8644-a2df0f1c44b1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.337019 Sep 10 11:11:42.091052 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3944/5565] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:41 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:42.850334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-036e67be-1e70-4348-add3-16c4c6568d27 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:42.851933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-036e67be-1e70-4348-add3-16c4c6568d27 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:42.877134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-036e67be-1e70-4348-add3-16c4c6568d27 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:42.881130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5c5a86f1-06a3-453c-9b13-b348ad8eff59 req-bd1a80bb-a1d2-4321-963d-f810b7f486b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8779dcf-c007-4804-a17c-78035087a84c", "tag": "50e70852-e7fe-4ce0-b4b8-0de11f6e7449"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:42.881938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-036e67be-1e70-4348-add3-16c4c6568d27 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:42.882491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-036e67be-1e70-4348-add3-16c4c6568d27 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:42.883599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-036e67be-1e70-4348-add3-16c4c6568d27 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:42.887365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-036e67be-1e70-4348-add3-16c4c6568d27 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:42.888603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-036e67be-1e70-4348-add3-16c4c6568d27 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:42.894533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5c5a86f1-06a3-453c-9b13-b348ad8eff59 req-bd1a80bb-a1d2-4321-963d-f810b7f486b4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:42.895397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5c5a86f1-06a3-453c-9b13-b348ad8eff59 req-bd1a80bb-a1d2-4321-963d-f810b7f486b4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:42.896134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5c5a86f1-06a3-453c-9b13-b348ad8eff59 req-bd1a80bb-a1d2-4321-963d-f810b7f486b4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:42.919010 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5c5a86f1-06a3-453c-9b13-b348ad8eff59 req-bd1a80bb-a1d2-4321-963d-f810b7f486b4 service nova] Creating event network-changed:50e70852-e7fe-4ce0-b4b8-0de11f6e7449 for instance a8779dcf-c007-4804-a17c-78035087a84c on n-h2-856894-1 Sep 10 11:11:42.941912 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5c5a86f1-06a3-453c-9b13-b348ad8eff59 req-bd1a80bb-a1d2-4321-963d-f810b7f486b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065696 Sep 10 11:11:42.944345 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3945/5566] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:11:43.115522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:43.116257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:43.129684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:43.130195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:43.130664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:43.131444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:43.131922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:43.132396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:43.320521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-036e67be-1e70-4348-add3-16c4c6568d27 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:43.335889 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-036e67be-1e70-4348-add3-16c4c6568d27 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1314 microversion: 2.1 time: 0.492371 Sep 10 11:11:43.350226 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1622/5567] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:42 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:43.359675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:43.377467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:43.380521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:43.382133 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-292bcfbd-099e-4ecd-b331-2d147363088d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.271138 Sep 10 11:11:43.383088 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3946/5568] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:43 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:44.364758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-359ff5b4-6bd9-4f1b-8860-659618420510 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:44.366285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-359ff5b4-6bd9-4f1b-8860-659618420510 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:44.379560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-359ff5b4-6bd9-4f1b-8860-659618420510 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:44.380992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-359ff5b4-6bd9-4f1b-8860-659618420510 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:44.381461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-359ff5b4-6bd9-4f1b-8860-659618420510 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:44.384740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-359ff5b4-6bd9-4f1b-8860-659618420510 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:44.385285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-359ff5b4-6bd9-4f1b-8860-659618420510 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:44.385724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-359ff5b4-6bd9-4f1b-8860-659618420510 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:44.414795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:44.415596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:44.427448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:44.428859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:44.429530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:44.430647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:44.431520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:44.432171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:44.715988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-359ff5b4-6bd9-4f1b-8860-659618420510 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:44.761297 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-359ff5b4-6bd9-4f1b-8860-659618420510 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1314 microversion: 2.1 time: 0.400933 Sep 10 11:11:44.782068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:44.790193 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1623/5569] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:44 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:44.801274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:44.810385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:44.811803 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-25588396-31a9-4d4e-8123-3622f8f9c493 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.402360 Sep 10 11:11:44.812955 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3947/5570] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:44 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:45.784834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-542c57a2-e5f2-486b-9d84-1b088338bca4 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:45.785495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-542c57a2-e5f2-486b-9d84-1b088338bca4 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:45.799653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-542c57a2-e5f2-486b-9d84-1b088338bca4 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:45.800346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-542c57a2-e5f2-486b-9d84-1b088338bca4 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:45.800941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-542c57a2-e5f2-486b-9d84-1b088338bca4 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:45.801908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-542c57a2-e5f2-486b-9d84-1b088338bca4 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:45.802361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-542c57a2-e5f2-486b-9d84-1b088338bca4 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:45.802786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-542c57a2-e5f2-486b-9d84-1b088338bca4 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:45.843866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:45.845134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:45.852673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:45.853193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:45.853751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:45.854577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:45.859292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:45.859927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:46.465330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:46.484531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:46.486201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:46.487900 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-08f918da-0f7b-4637-b0e5-73c6e59c6aa8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.649857 Sep 10 11:11:46.495132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3948/5571] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:45 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:11:46.545713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-542c57a2-e5f2-486b-9d84-1b088338bca4 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:46.554538 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-542c57a2-e5f2-486b-9d84-1b088338bca4 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1314 microversion: 2.1 time: 0.774182 Sep 10 11:11:46.561211 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1624/5572] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:45 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:47.524506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:47.525165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:47.532606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:47.533483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:47.534186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:47.535210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:47.535899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:47.536556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:47.582064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8efe9bb7-7a66-44d1-b46f-c043df01e07c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:47.583002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8efe9bb7-7a66-44d1-b46f-c043df01e07c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:47.593789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8efe9bb7-7a66-44d1-b46f-c043df01e07c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:47.594589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8efe9bb7-7a66-44d1-b46f-c043df01e07c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:47.595024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8efe9bb7-7a66-44d1-b46f-c043df01e07c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:47.595952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8efe9bb7-7a66-44d1-b46f-c043df01e07c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:47.596573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8efe9bb7-7a66-44d1-b46f-c043df01e07c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:47.597213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8efe9bb7-7a66-44d1-b46f-c043df01e07c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:47.824577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:47.840001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:47.842659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:47.843979 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d75781a4-fd51-4ac0-9cbe-93ebf2c0569a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.323458 Sep 10 11:11:47.846962 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3949/5573] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:47 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:47.903125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8efe9bb7-7a66-44d1-b46f-c043df01e07c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:47.916693 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8efe9bb7-7a66-44d1-b46f-c043df01e07c tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1314 microversion: 2.1 time: 0.339955 Sep 10 11:11:47.917886 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1625/5574] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:47 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:48.871318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:48.871978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:48.880524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:48.881497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:48.882181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:48.883195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:48.883894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:48.884596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:49.081029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8527a25e-c5cd-486e-9183-5bed39e51bb2 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:49.082917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8527a25e-c5cd-486e-9183-5bed39e51bb2 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:49.083264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8527a25e-c5cd-486e-9183-5bed39e51bb2 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:49.083715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8527a25e-c5cd-486e-9183-5bed39e51bb2 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:49.084419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8527a25e-c5cd-486e-9183-5bed39e51bb2 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:49.084871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8527a25e-c5cd-486e-9183-5bed39e51bb2 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:49.085318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8527a25e-c5cd-486e-9183-5bed39e51bb2 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:49.090881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:49.105299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:49.107456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:49.112637 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aaf316bd-27ff-4a81-9e24-ed219f60999e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.245345 Sep 10 11:11:49.114336 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3950/5575] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:48 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:49.120622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80a967d6-fdc5-40aa-abd1-8a1e1bd98a38 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:49.122563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80a967d6-fdc5-40aa-abd1-8a1e1bd98a38 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:49.133650 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8527a25e-c5cd-486e-9183-5bed39e51bb2 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.225732 Sep 10 11:11:49.134479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a967d6-fdc5-40aa-abd1-8a1e1bd98a38 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:49.135067 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1626/5576] 10.222.0.20 () {58 vars in 1185 bytes} [Sat Sep 10 11:11:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:11:49.146032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a967d6-fdc5-40aa-abd1-8a1e1bd98a38 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:49.146692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a967d6-fdc5-40aa-abd1-8a1e1bd98a38 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:49.147819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a967d6-fdc5-40aa-abd1-8a1e1bd98a38 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:49.148443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a967d6-fdc5-40aa-abd1-8a1e1bd98a38 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:49.149039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a967d6-fdc5-40aa-abd1-8a1e1bd98a38 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:49.153098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-1e0ea465-e285-4cf4-a886-a5fa2eab77c5 req-a1b692ea-cf72-4760-aed2-425b82688be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8779dcf-c007-4804-a17c-78035087a84c", "name": "network-vif-plugged", "status": "completed", "tag": "50e70852-e7fe-4ce0-b4b8-0de11f6e7449"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:49.165769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1e0ea465-e285-4cf4-a886-a5fa2eab77c5 req-a1b692ea-cf72-4760-aed2-425b82688be7 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:49.166449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1e0ea465-e285-4cf4-a886-a5fa2eab77c5 req-a1b692ea-cf72-4760-aed2-425b82688be7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:49.166947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1e0ea465-e285-4cf4-a886-a5fa2eab77c5 req-a1b692ea-cf72-4760-aed2-425b82688be7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:49.189284 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-1e0ea465-e285-4cf4-a886-a5fa2eab77c5 req-a1b692ea-cf72-4760-aed2-425b82688be7 service nova] Creating event network-vif-plugged:50e70852-e7fe-4ce0-b4b8-0de11f6e7449 for instance a8779dcf-c007-4804-a17c-78035087a84c on n-h2-856894-1 Sep 10 11:11:49.198131 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-1e0ea465-e285-4cf4-a886-a5fa2eab77c5 req-a1b692ea-cf72-4760-aed2-425b82688be7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049974 Sep 10 11:11:49.199515 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1627/5577] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:11:49.285180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-398438493", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "availability_zone": "nova:n-h2-856894-1", "networks": [{"uuid": "5db5943c-2430-479d-9d72-f0e87479421d"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:49.358419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] validate_networks() for [('5db5943c-2430-479d-9d72-f0e87479421d', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:11:49.407968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80a967d6-fdc5-40aa-abd1-8a1e1bd98a38 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:49.417856 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80a967d6-fdc5-40aa-abd1-8a1e1bd98a38 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1314 microversion: 2.1 time: 0.301918 Sep 10 11:11:49.419225 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3951/5578] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:49 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:49.798063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:11:49.802142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:11:49.802692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:11:49.803119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:11:49.803545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:11:49.813173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:49.813897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:49.814590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:49.815520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:49.816202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:49.816851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:49.838976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Getting quotas for project aebc92b18358432399615828dbbffa05. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:11:49.845394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Getting quotas for user 4fa0cfe8b89d409282bc88ba370e6b7a and project aebc92b18358432399615828dbbffa05. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:11:49.860035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:11:49.863097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:11:49.912197 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5ddce0a6-cb85-495a-ab28-ec56dd75be63 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631746 Sep 10 11:11:49.913486 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1628/5579] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:11:49.924965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0df3ffa2-0917-4614-b023-a2cc793b8efa tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:49.925846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0df3ffa2-0917-4614-b023-a2cc793b8efa tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:50.006153 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0df3ffa2-0917-4614-b023-a2cc793b8efa tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1328 microversion: 2.1 time: 0.085577 Sep 10 11:11:50.006883 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3952/5580] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:49 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1328 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:11:50.141499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:50.142171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:50.152830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:50.153805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:50.154470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:50.155845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:50.156320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:50.157910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:50.313002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:50.323545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:50.325020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:50.326319 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-25254875-c553-440a-9d3b-b70485ea46ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.188810 Sep 10 11:11:50.326880 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1629/5581] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:50 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:50.442640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5c657ff-f10f-4959-a631-ddbe575fca95 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:50.443286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e5c657ff-f10f-4959-a631-ddbe575fca95 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:50.451784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c657ff-f10f-4959-a631-ddbe575fca95 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:50.452403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c657ff-f10f-4959-a631-ddbe575fca95 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:50.452950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c657ff-f10f-4959-a631-ddbe575fca95 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:50.453888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c657ff-f10f-4959-a631-ddbe575fca95 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:50.454401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c657ff-f10f-4959-a631-ddbe575fca95 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:50.454873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5c657ff-f10f-4959-a631-ddbe575fca95 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:50.606367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e5c657ff-f10f-4959-a631-ddbe575fca95 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:50.617857 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e5c657ff-f10f-4959-a631-ddbe575fca95 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1314 microversion: 2.1 time: 0.179615 Sep 10 11:11:50.618645 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3953/5582] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:50 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:51.029569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3f713515-8812-4bb8-b67d-0aa9b3e05ae3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:51.030493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3f713515-8812-4bb8-b67d-0aa9b3e05ae3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:51.037560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f713515-8812-4bb8-b67d-0aa9b3e05ae3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:51.038304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f713515-8812-4bb8-b67d-0aa9b3e05ae3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:51.038756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f713515-8812-4bb8-b67d-0aa9b3e05ae3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:51.039710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f713515-8812-4bb8-b67d-0aa9b3e05ae3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:51.040166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f713515-8812-4bb8-b67d-0aa9b3e05ae3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:51.040605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f713515-8812-4bb8-b67d-0aa9b3e05ae3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:51.109451 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3f713515-8812-4bb8-b67d-0aa9b3e05ae3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1415 microversion: 2.1 time: 0.083691 Sep 10 11:11:51.110040 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1630/5583] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:51 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1415 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:51.352928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:51.354388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:51.362601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:51.363118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:51.363578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:51.364720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:51.365848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:51.366311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:51.380466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-c80dc64c-d988-4408-8cf4-f40030cccd2f req-85d21299-3cdf-4b72-83ad-f083cf4d7f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881d6159-5456-4a2f-98c2-0c3e66109b01", "name": "network-vif-plugged", "status": "completed", "tag": "f2b9da4b-7521-484c-90f9-f1b853ab04d2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:51.399231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c80dc64c-d988-4408-8cf4-f40030cccd2f req-85d21299-3cdf-4b72-83ad-f083cf4d7f7a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:51.399775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c80dc64c-d988-4408-8cf4-f40030cccd2f req-85d21299-3cdf-4b72-83ad-f083cf4d7f7a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:51.400195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c80dc64c-d988-4408-8cf4-f40030cccd2f req-85d21299-3cdf-4b72-83ad-f083cf4d7f7a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:51.413497 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-c80dc64c-d988-4408-8cf4-f40030cccd2f req-85d21299-3cdf-4b72-83ad-f083cf4d7f7a service nova] Creating event network-vif-plugged:f2b9da4b-7521-484c-90f9-f1b853ab04d2 for instance 881d6159-5456-4a2f-98c2-0c3e66109b01 on n-h2-856894-1 Sep 10 11:11:51.419293 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-c80dc64c-d988-4408-8cf4-f40030cccd2f req-85d21299-3cdf-4b72-83ad-f083cf4d7f7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043942 Sep 10 11:11:51.420096 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1631/5584] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:11:51.618260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:51.631215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:51.633382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:51.635228 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-015c6ac7-eb6e-4514-bed5-442eaa56cdee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.286164 Sep 10 11:11:51.636328 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3954/5585] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:51 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:51.645154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c0273353-70a2-4231-9a18-596a61ca0d7b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:51.646170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c0273353-70a2-4231-9a18-596a61ca0d7b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:51.652697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0273353-70a2-4231-9a18-596a61ca0d7b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:51.653425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0273353-70a2-4231-9a18-596a61ca0d7b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:51.653933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0273353-70a2-4231-9a18-596a61ca0d7b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:51.654867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0273353-70a2-4231-9a18-596a61ca0d7b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:51.655409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0273353-70a2-4231-9a18-596a61ca0d7b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:51.656108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c0273353-70a2-4231-9a18-596a61ca0d7b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:51.977632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c0273353-70a2-4231-9a18-596a61ca0d7b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:51.992115 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c0273353-70a2-4231-9a18-596a61ca0d7b tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1498 microversion: 2.1 time: 0.350902 Sep 10 11:11:51.993835 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1632/5586] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:51 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1498 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:52.133568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f23f294-1e9f-48c3-85bf-6250cd144ae6 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:52.134636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f23f294-1e9f-48c3-85bf-6250cd144ae6 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:52.151688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f23f294-1e9f-48c3-85bf-6250cd144ae6 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:52.152482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f23f294-1e9f-48c3-85bf-6250cd144ae6 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:52.153146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f23f294-1e9f-48c3-85bf-6250cd144ae6 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:52.154149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f23f294-1e9f-48c3-85bf-6250cd144ae6 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:52.157688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f23f294-1e9f-48c3-85bf-6250cd144ae6 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:52.158929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f23f294-1e9f-48c3-85bf-6250cd144ae6 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:52.288472 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f23f294-1e9f-48c3-85bf-6250cd144ae6 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1421 microversion: 2.1 time: 0.159533 Sep 10 11:11:52.289730 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3955/5587] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:52 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1421 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:52.650714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6b6f7a9a-c0e0-4f44-b10d-8425b74c5c14 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:52.651276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6b6f7a9a-c0e0-4f44-b10d-8425b74c5c14 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:52.661737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f7a9a-c0e0-4f44-b10d-8425b74c5c14 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:52.662499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f7a9a-c0e0-4f44-b10d-8425b74c5c14 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:52.663392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f7a9a-c0e0-4f44-b10d-8425b74c5c14 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:52.664672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f7a9a-c0e0-4f44-b10d-8425b74c5c14 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:52.665388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f7a9a-c0e0-4f44-b10d-8425b74c5c14 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:52.666116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6b6f7a9a-c0e0-4f44-b10d-8425b74c5c14 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:52.673698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:52.675047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:52.696432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:52.696944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:52.697669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:52.698577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:52.699211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:52.699897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:52.723094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6b6f7a9a-c0e0-4f44-b10d-8425b74c5c14 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:11:52.818526 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6b6f7a9a-c0e0-4f44-b10d-8425b74c5c14 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 204 len: 0 microversion: 2.1 time: 0.171501 Sep 10 11:11:52.819124 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1633/5588] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:11:52 2022] DELETE /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:11:52.830746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-deae29df-b015-4e35-8389-46e09524ac72 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:52.831561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-deae29df-b015-4e35-8389-46e09524ac72 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:52.838061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deae29df-b015-4e35-8389-46e09524ac72 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:52.838472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deae29df-b015-4e35-8389-46e09524ac72 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:52.838983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deae29df-b015-4e35-8389-46e09524ac72 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:52.839774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deae29df-b015-4e35-8389-46e09524ac72 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:52.840299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deae29df-b015-4e35-8389-46e09524ac72 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:52.840816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-deae29df-b015-4e35-8389-46e09524ac72 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:52.876307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:52.889529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:52.891621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:52.893863 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94befbcb-a48f-4fb5-bc4f-323bbf2375ee tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.232255 Sep 10 11:11:52.894453 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3956/5589] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:52 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:53.092560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-deae29df-b015-4e35-8389-46e09524ac72 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:53.100538 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-deae29df-b015-4e35-8389-46e09524ac72 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1504 microversion: 2.1 time: 0.274052 Sep 10 11:11:53.113619 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1634/5590] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:52 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:53.284670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bcb9da19-cf22-4c0d-88a0-e6c6df3a561f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:53.285231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bcb9da19-cf22-4c0d-88a0-e6c6df3a561f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:53.292214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcb9da19-cf22-4c0d-88a0-e6c6df3a561f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:53.292747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcb9da19-cf22-4c0d-88a0-e6c6df3a561f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:53.293246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcb9da19-cf22-4c0d-88a0-e6c6df3a561f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:53.293979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcb9da19-cf22-4c0d-88a0-e6c6df3a561f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:53.294660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcb9da19-cf22-4c0d-88a0-e6c6df3a561f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:53.295265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bcb9da19-cf22-4c0d-88a0-e6c6df3a561f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:53.314055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0d767d06-5ef5-4b98-86c4-d43bc03da4d7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:53.316342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0d767d06-5ef5-4b98-86c4-d43bc03da4d7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:53.322866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d767d06-5ef5-4b98-86c4-d43bc03da4d7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:53.323558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d767d06-5ef5-4b98-86c4-d43bc03da4d7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:53.324175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d767d06-5ef5-4b98-86c4-d43bc03da4d7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:53.325042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d767d06-5ef5-4b98-86c4-d43bc03da4d7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:53.325802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d767d06-5ef5-4b98-86c4-d43bc03da4d7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:53.326477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d767d06-5ef5-4b98-86c4-d43bc03da4d7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:53.381525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-bcb9da19-cf22-4c0d-88a0-e6c6df3a561f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lazy-loading 'services' on Instance uuid 84aeda03-e643-4983-b623-21bd91e457de {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:11:53.460785 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bcb9da19-cf22-4c0d-88a0-e6c6df3a561f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments/8227a5fb-ca23-49be-85c4-9780b232d8ee" status: 202 len: 0 microversion: 2.1 time: 0.180037 Sep 10 11:11:53.461447 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3957/5591] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:11:53 2022] DELETE /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments/8227a5fb-ca23-49be-85c4-9780b232d8ee => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:11:53.471626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8b5537b-113b-4393-bf87-6674709d3129 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:53.474071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8b5537b-113b-4393-bf87-6674709d3129 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:53.480384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b5537b-113b-4393-bf87-6674709d3129 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:53.481039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b5537b-113b-4393-bf87-6674709d3129 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:53.481496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b5537b-113b-4393-bf87-6674709d3129 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:53.482214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b5537b-113b-4393-bf87-6674709d3129 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:53.482758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b5537b-113b-4393-bf87-6674709d3129 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:53.483204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8b5537b-113b-4393-bf87-6674709d3129 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:53.513521 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8b5537b-113b-4393-bf87-6674709d3129 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047273 Sep 10 11:11:53.514102 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3958/5592] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:11:53 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:53.548466 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0d767d06-5ef5-4b98-86c4-d43bc03da4d7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1463 microversion: 2.1 time: 0.240040 Sep 10 11:11:53.549592 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1635/5593] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:53 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1463 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:11:53.788361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-52ff62f9-8cab-4b0c-a3ae-c0e84122e261 req-b57d65ad-4717-4d85-a8d6-218c997209ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d029b976-77cc-48d2-8173-a5fa87488a75", "tag": "e3de1e00-4042-45b0-ae3e-dd3df8decccd"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:53.799564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-52ff62f9-8cab-4b0c-a3ae-c0e84122e261 req-b57d65ad-4717-4d85-a8d6-218c997209ff service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:53.800057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-52ff62f9-8cab-4b0c-a3ae-c0e84122e261 req-b57d65ad-4717-4d85-a8d6-218c997209ff service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:53.800506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-52ff62f9-8cab-4b0c-a3ae-c0e84122e261 req-b57d65ad-4717-4d85-a8d6-218c997209ff service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:53.811649 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-52ff62f9-8cab-4b0c-a3ae-c0e84122e261 req-b57d65ad-4717-4d85-a8d6-218c997209ff service nova] Creating event network-changed:e3de1e00-4042-45b0-ae3e-dd3df8decccd for instance d029b976-77cc-48d2-8173-a5fa87488a75 on n-h2-856894-1 Sep 10 11:11:53.817154 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-52ff62f9-8cab-4b0c-a3ae-c0e84122e261 req-b57d65ad-4717-4d85-a8d6-218c997209ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032810 Sep 10 11:11:53.817980 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3959/5594] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:53.922832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:53.923374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:53.930785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:53.931272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:53.931708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:53.932396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:53.932846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:53.933299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:53.935971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:54.079296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:54.092898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:54.094580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:54.096642 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7f32481a-1348-4fd8-9eb6-b97a3cf56865 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1807 microversion: 2.20 time: 0.177220 Sep 10 11:11:54.097784 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1636/5595] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:53 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:54.129059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fca73c54-e1f8-47cc-97ba-df6652e240eb tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:54.130181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fca73c54-e1f8-47cc-97ba-df6652e240eb tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:54.138967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fca73c54-e1f8-47cc-97ba-df6652e240eb tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:54.139488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fca73c54-e1f8-47cc-97ba-df6652e240eb tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:54.139950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fca73c54-e1f8-47cc-97ba-df6652e240eb tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:54.140674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fca73c54-e1f8-47cc-97ba-df6652e240eb tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:54.141211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fca73c54-e1f8-47cc-97ba-df6652e240eb tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:54.141832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fca73c54-e1f8-47cc-97ba-df6652e240eb tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:54.162360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:54.295228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fca73c54-e1f8-47cc-97ba-df6652e240eb tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:54.303819 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fca73c54-e1f8-47cc-97ba-df6652e240eb tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1504 microversion: 2.1 time: 0.179594 Sep 10 11:11:54.318016 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3960/5596] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:54 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:54.526190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0bd21c38-e64e-469a-bca8-5f095132e49e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:54.528333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0bd21c38-e64e-469a-bca8-5f095132e49e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:54.535127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bd21c38-e64e-469a-bca8-5f095132e49e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:54.535620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bd21c38-e64e-469a-bca8-5f095132e49e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:54.536145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bd21c38-e64e-469a-bca8-5f095132e49e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:54.536818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bd21c38-e64e-469a-bca8-5f095132e49e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:54.537209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bd21c38-e64e-469a-bca8-5f095132e49e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:54.537641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0bd21c38-e64e-469a-bca8-5f095132e49e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:54.569626 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0bd21c38-e64e-469a-bca8-5f095132e49e tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047364 Sep 10 11:11:54.570216 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1637/5597] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:11:54 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:54.573336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1856dde1-98e9-423c-8973-d74bb5e3db79 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:54.574608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1856dde1-98e9-423c-8973-d74bb5e3db79 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:54.581863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1856dde1-98e9-423c-8973-d74bb5e3db79 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:54.582366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1856dde1-98e9-423c-8973-d74bb5e3db79 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:54.582818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1856dde1-98e9-423c-8973-d74bb5e3db79 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:54.583566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1856dde1-98e9-423c-8973-d74bb5e3db79 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:54.584041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1856dde1-98e9-423c-8973-d74bb5e3db79 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:54.584486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1856dde1-98e9-423c-8973-d74bb5e3db79 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:54.716620 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1856dde1-98e9-423c-8973-d74bb5e3db79 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1463 microversion: 2.1 time: 0.148259 Sep 10 11:11:54.731105 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3961/5598] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:54 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:11:55.124008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:55.124627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:55.129044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:55.137025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:55.137794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:55.138261 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:55.138967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:55.139422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:55.139852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:55.327373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6aef40e5-0ca5-4de4-9d90-535e894b897d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:55.328042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6aef40e5-0ca5-4de4-9d90-535e894b897d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:55.335310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aef40e5-0ca5-4de4-9d90-535e894b897d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:55.335807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aef40e5-0ca5-4de4-9d90-535e894b897d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:55.336254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aef40e5-0ca5-4de4-9d90-535e894b897d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:55.336952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aef40e5-0ca5-4de4-9d90-535e894b897d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:55.337447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aef40e5-0ca5-4de4-9d90-535e894b897d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:55.337885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aef40e5-0ca5-4de4-9d90-535e894b897d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:55.441327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6aef40e5-0ca5-4de4-9d90-535e894b897d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:55.452483 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6aef40e5-0ca5-4de4-9d90-535e894b897d tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1462 microversion: 2.1 time: 0.129101 Sep 10 11:11:55.453422 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3962/5599] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:55 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1462 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:11:55.583212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0f639a9b-132e-4dbf-9fa4-d7cc50b7c778 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:55.585919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0f639a9b-132e-4dbf-9fa4-d7cc50b7c778 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:55.593054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f639a9b-132e-4dbf-9fa4-d7cc50b7c778 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:55.593819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f639a9b-132e-4dbf-9fa4-d7cc50b7c778 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:55.594684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f639a9b-132e-4dbf-9fa4-d7cc50b7c778 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:55.595023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f639a9b-132e-4dbf-9fa4-d7cc50b7c778 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:55.595502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f639a9b-132e-4dbf-9fa4-d7cc50b7c778 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:55.595948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0f639a9b-132e-4dbf-9fa4-d7cc50b7c778 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:55.630036 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0f639a9b-132e-4dbf-9fa4-d7cc50b7c778 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051546 Sep 10 11:11:55.630918 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3963/5600] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:11:55 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:11:55.739480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53a3e004-5212-4fb5-bae9-87e880552b04 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:55.740162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53a3e004-5212-4fb5-bae9-87e880552b04 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:55.746768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3e004-5212-4fb5-bae9-87e880552b04 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:55.747283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3e004-5212-4fb5-bae9-87e880552b04 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:55.747740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3e004-5212-4fb5-bae9-87e880552b04 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:55.748461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3e004-5212-4fb5-bae9-87e880552b04 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:55.749141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3e004-5212-4fb5-bae9-87e880552b04 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:55.749770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53a3e004-5212-4fb5-bae9-87e880552b04 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:55.831474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:55.840983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:55.842466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:55.843790 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4a9051a9-5dd9-4ea4-b774-95f85e749a88 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1794 microversion: 2.20 time: 0.723758 Sep 10 11:11:55.844369 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1638/5601] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:11:55 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1794 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:11:55.938132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-49318901-3737-4f7d-b6b5-febfbc5f5d50 req-cf046d2f-6f4a-4a43-874e-d5cf2289bb37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8779dcf-c007-4804-a17c-78035087a84c", "name": "network-vif-deleted", "tag": "50e70852-e7fe-4ce0-b4b8-0de11f6e7449"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:11:55.975602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-49318901-3737-4f7d-b6b5-febfbc5f5d50 req-cf046d2f-6f4a-4a43-874e-d5cf2289bb37 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:55.978104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-49318901-3737-4f7d-b6b5-febfbc5f5d50 req-cf046d2f-6f4a-4a43-874e-d5cf2289bb37 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:55.978661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-49318901-3737-4f7d-b6b5-febfbc5f5d50 req-cf046d2f-6f4a-4a43-874e-d5cf2289bb37 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:55.993198 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-49318901-3737-4f7d-b6b5-febfbc5f5d50 req-cf046d2f-6f4a-4a43-874e-d5cf2289bb37 service nova] Creating event network-vif-deleted:50e70852-e7fe-4ce0-b4b8-0de11f6e7449 for instance a8779dcf-c007-4804-a17c-78035087a84c on n-h2-856894-1 Sep 10 11:11:55.998925 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-49318901-3737-4f7d-b6b5-febfbc5f5d50 req-cf046d2f-6f4a-4a43-874e-d5cf2289bb37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068768 Sep 10 11:11:56.000530 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1639/5602] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:11:56.044806 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53a3e004-5212-4fb5-bae9-87e880552b04 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1463 microversion: 2.1 time: 0.309059 Sep 10 11:11:56.054453 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3964/5603] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:55 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1463 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:56.476549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:56.477423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:56.485090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:56.485590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:56.486027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:56.486723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:56.487322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:56.487782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:56.521898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:56.522384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:56.522817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:56.523268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lazy-loading 'fault' on Instance uuid a8779dcf-c007-4804-a17c-78035087a84c {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:11:56.566771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:56.574765 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4edb6f19-f442-4c13-87a3-e4d3ae42d115 tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1304 microversion: 2.1 time: 0.102453 Sep 10 11:11:56.575348 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1640/5604] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:56 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:56.642880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c52fcf02-870f-456b-8261-da99ed86fa74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:56.645051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c52fcf02-870f-456b-8261-da99ed86fa74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:56.652054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52fcf02-870f-456b-8261-da99ed86fa74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:56.652546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52fcf02-870f-456b-8261-da99ed86fa74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:56.652995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52fcf02-870f-456b-8261-da99ed86fa74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:56.653721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52fcf02-870f-456b-8261-da99ed86fa74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:56.654186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52fcf02-870f-456b-8261-da99ed86fa74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:56.654626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c52fcf02-870f-456b-8261-da99ed86fa74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:56.688376 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c52fcf02-870f-456b-8261-da99ed86fa74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049626 Sep 10 11:11:56.688966 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3965/5605] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:11:56 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:57.068966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8da992f8-4de6-4075-8dca-58b9ab07fd83 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:57.069661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8da992f8-4de6-4075-8dca-58b9ab07fd83 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:57.075701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8da992f8-4de6-4075-8dca-58b9ab07fd83 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:57.076266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8da992f8-4de6-4075-8dca-58b9ab07fd83 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:57.076708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8da992f8-4de6-4075-8dca-58b9ab07fd83 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:57.077426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8da992f8-4de6-4075-8dca-58b9ab07fd83 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:57.077882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8da992f8-4de6-4075-8dca-58b9ab07fd83 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:57.078307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8da992f8-4de6-4075-8dca-58b9ab07fd83 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:57.216365 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8da992f8-4de6-4075-8dca-58b9ab07fd83 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1463 microversion: 2.1 time: 0.152265 Sep 10 11:11:57.231914 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1641/5606] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:57 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:57.598311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:57.598942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:57.600872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:57.606973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:57.607478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:57.607937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:57.608638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:57.609145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:57.609592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:57.643790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:57.644497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:57.644723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:57.645383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lazy-loading 'fault' on Instance uuid a8779dcf-c007-4804-a17c-78035087a84c {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:11:57.700820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-055f151b-02b4-4b79-943b-10759704a906 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:57.703105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-055f151b-02b4-4b79-943b-10759704a906 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:57.708808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8ec035d8b0b4366b7940e0f1b5d4411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af65a177b6334cae9bdca1325c9661b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:11:57.711812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-055f151b-02b4-4b79-943b-10759704a906 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:57.712321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-055f151b-02b4-4b79-943b-10759704a906 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:57.713104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-055f151b-02b4-4b79-943b-10759704a906 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:57.713842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-055f151b-02b4-4b79-943b-10759704a906 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:57.714298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-055f151b-02b4-4b79-943b-10759704a906 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:57.714723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-055f151b-02b4-4b79-943b-10759704a906 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:57.717799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-547413bd-594c-4105-a0da-3ad6fc087dbe tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 200 len: 1304 microversion: 2.1 time: 0.122524 Sep 10 11:11:57.729150 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3966/5607] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:57 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:57.748173 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-055f151b-02b4-4b79-943b-10759704a906 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051333 Sep 10 11:11:57.749751 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1642/5608] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:11:57 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:58.239912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3f1199c6-9afd-4c9d-96d4-56c17f77e8b7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:58.240488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3f1199c6-9afd-4c9d-96d4-56c17f77e8b7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:58.247529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f1199c6-9afd-4c9d-96d4-56c17f77e8b7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:58.248043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f1199c6-9afd-4c9d-96d4-56c17f77e8b7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:58.248504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f1199c6-9afd-4c9d-96d4-56c17f77e8b7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:58.249252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f1199c6-9afd-4c9d-96d4-56c17f77e8b7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:58.249735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f1199c6-9afd-4c9d-96d4-56c17f77e8b7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:58.250185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3f1199c6-9afd-4c9d-96d4-56c17f77e8b7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:58.375917 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3f1199c6-9afd-4c9d-96d4-56c17f77e8b7 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1463 microversion: 2.1 time: 0.140018 Sep 10 11:11:58.376506 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3967/5609] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:58 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1463 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:58.742278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:58.742936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] [instance: a8779dcf-c007-4804-a17c-78035087a84c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:58.749911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:58.750398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:58.750836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:58.751522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:58.752518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:58.752946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:58.760562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8aa76088-4037-41c5-b2ef-1e134bb5a565 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:58.762734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8aa76088-4037-41c5-b2ef-1e134bb5a565 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:58.781445 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] HTTP exception thrown: Instance a8779dcf-c007-4804-a17c-78035087a84c could not be found. Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Request method failure captured: Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c HTTP/1.1 Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHDMALzM8VecL3D12FqLv-fUg1zvBEJajryoFGRwD11KJTLx8hxfgkjDTYnHsvBcsQoUySvVrRgSzq6e7HmJtP-_exkIaR20sN0DvOCXMFFFXQW7ewOdY7N4PBixc5U1qfV57I6q7BeoQ4I3-07Yp8hJ0fQHXKALBYQFNBKGvGDxM5Q Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: af65a177b6334cae9bdca1325c9661b7 Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-VolumesActionsTest-1504646386 Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af65a177b6334cae9bdca1325c9661b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/af65a177b6334cae9bdca1325c9661b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af65a177b6334cae9bdca1325c9661b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_af65a177b6334cae9bdca1325c9661b7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-VolumesActionsTest-1504646386 Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: af65a177b6334cae9bdca1325c9661b7 Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-VolumesActionsTest-1504646386 Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-VolumesActionsTest-1504646386-project Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: b8ec035d8b0b4366b7940e0f1b5d4411 Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-VolumesActionsTest-1504646386-project Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance a8779dcf-c007-4804-a17c-78035087a84c could not be found. Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'a8779dcf-c007-4804-a17c-78035087a84c'} Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8779dcf-c007-4804-a17c-78035087a84c could not be found. Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8779dcf-c007-4804-a17c-78035087a84c could not be found. Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:11:58.783019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:11:58.787413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:11:58.787413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:11:58.787413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:11:58.787413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:11:58.787413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:11:58.787413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8779dcf-c007-4804-a17c-78035087a84c could not be found. Sep 10 11:11:58.787413 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:11:58.787413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] Returning 404 to user: Instance a8779dcf-c007-4804-a17c-78035087a84c could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:11:58.787413 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2ed5fd80-39bd-455c-915e-195e878b02be tempest-VolumesActionsTest-1504646386 tempest-VolumesActionsTest-1504646386-project] 10.222.0.20 "GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c" status: 404 len: 111 microversion: 2.1 time: 0.046032 Sep 10 11:11:58.788991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa76088-4037-41c5-b2ef-1e134bb5a565 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:58.789579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa76088-4037-41c5-b2ef-1e134bb5a565 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:58.790040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa76088-4037-41c5-b2ef-1e134bb5a565 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:58.790786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa76088-4037-41c5-b2ef-1e134bb5a565 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:58.793426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa76088-4037-41c5-b2ef-1e134bb5a565 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:58.793426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8aa76088-4037-41c5-b2ef-1e134bb5a565 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:58.796389 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1643/5610] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:58 2022] GET /compute/v2.1/servers/a8779dcf-c007-4804-a17c-78035087a84c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:11:58.826729 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8aa76088-4037-41c5-b2ef-1e134bb5a565 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070207 Sep 10 11:11:58.827647 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3968/5611] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:11:58 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:11:59.398348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-45928a52-4ff5-4bc4-895e-ac224efd5aef tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:59.399067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-45928a52-4ff5-4bc4-895e-ac224efd5aef tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:59.405542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45928a52-4ff5-4bc4-895e-ac224efd5aef tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:59.406113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45928a52-4ff5-4bc4-895e-ac224efd5aef tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:59.406655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45928a52-4ff5-4bc4-895e-ac224efd5aef tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:59.407485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45928a52-4ff5-4bc4-895e-ac224efd5aef tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:59.408553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45928a52-4ff5-4bc4-895e-ac224efd5aef tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:59.409403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45928a52-4ff5-4bc4-895e-ac224efd5aef tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:59.578139 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-45928a52-4ff5-4bc4-895e-ac224efd5aef tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1463 microversion: 2.1 time: 0.183531 Sep 10 11:11:59.578715 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1644/5612] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:11:59 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1463 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:11:59.840100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe9bea6b-5377-4f9f-9b6e-1773435cde39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:59.842373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fe9bea6b-5377-4f9f-9b6e-1773435cde39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:59.850174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe9bea6b-5377-4f9f-9b6e-1773435cde39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:59.850687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe9bea6b-5377-4f9f-9b6e-1773435cde39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:59.851244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe9bea6b-5377-4f9f-9b6e-1773435cde39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:59.851969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe9bea6b-5377-4f9f-9b6e-1773435cde39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:59.852446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe9bea6b-5377-4f9f-9b6e-1773435cde39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:59.852901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe9bea6b-5377-4f9f-9b6e-1773435cde39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:59.882219 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe9bea6b-5377-4f9f-9b6e-1773435cde39 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046203 Sep 10 11:11:59.882813 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3969/5613] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:11:59 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:11:59.947873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dcf5eb68-cc72-4ef4-8925-99478b0e4fa1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:11:59.948373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dcf5eb68-cc72-4ef4-8925-99478b0e4fa1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:11:59.951455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:59.952694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:11:59.959991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf5eb68-cc72-4ef4-8925-99478b0e4fa1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:59.960880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf5eb68-cc72-4ef4-8925-99478b0e4fa1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:59.961355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf5eb68-cc72-4ef4-8925-99478b0e4fa1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:59.962595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf5eb68-cc72-4ef4-8925-99478b0e4fa1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:11:59.963356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf5eb68-cc72-4ef4-8925-99478b0e4fa1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:11:59.963789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf5eb68-cc72-4ef4-8925-99478b0e4fa1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:11:59.994004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dcf5eb68-cc72-4ef4-8925-99478b0e4fa1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:12:00.079425 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dcf5eb68-cc72-4ef4-8925-99478b0e4fa1 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 204 len: 0 microversion: 2.1 time: 0.135332 Sep 10 11:12:00.080785 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1645/5614] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:11:59 2022] DELETE /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:12:00.089479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-88daee8f-2e8e-486f-8da0-c82acbb0bc61 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:00.090344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-88daee8f-2e8e-486f-8da0-c82acbb0bc61 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:00.092787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:00.102993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88daee8f-2e8e-486f-8da0-c82acbb0bc61 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:00.103539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88daee8f-2e8e-486f-8da0-c82acbb0bc61 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:00.104186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88daee8f-2e8e-486f-8da0-c82acbb0bc61 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:00.104921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88daee8f-2e8e-486f-8da0-c82acbb0bc61 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:00.105428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88daee8f-2e8e-486f-8da0-c82acbb0bc61 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:00.105879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-88daee8f-2e8e-486f-8da0-c82acbb0bc61 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:00.249462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-88daee8f-2e8e-486f-8da0-c82acbb0bc61 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:00.260665 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-88daee8f-2e8e-486f-8da0-c82acbb0bc61 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1682 microversion: 2.1 time: 0.174863 Sep 10 11:12:00.261851 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3970/5615] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:00 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:00.607026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9c72aac-1ee3-4b27-8b14-b4e2ab893f8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:00.608010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9c72aac-1ee3-4b27-8b14-b4e2ab893f8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:00.619621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9c72aac-1ee3-4b27-8b14-b4e2ab893f8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:00.620936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9c72aac-1ee3-4b27-8b14-b4e2ab893f8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:00.621634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9c72aac-1ee3-4b27-8b14-b4e2ab893f8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:00.622554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9c72aac-1ee3-4b27-8b14-b4e2ab893f8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:00.623183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9c72aac-1ee3-4b27-8b14-b4e2ab893f8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:00.623766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9c72aac-1ee3-4b27-8b14-b4e2ab893f8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:00.786602 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9c72aac-1ee3-4b27-8b14-b4e2ab893f8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1463 microversion: 2.1 time: 0.186447 Sep 10 11:12:00.787388 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1646/5616] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:00 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1463 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:01.082240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5cb5478a-fcc5-4d5d-9adc-d4de0d5039be req-3674fc7d-fd41-4425-a31f-ff14d2e93869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d029b976-77cc-48d2-8173-a5fa87488a75", "name": "network-vif-plugged", "status": "completed", "tag": "e3de1e00-4042-45b0-ae3e-dd3df8decccd"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:01.104328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5cb5478a-fcc5-4d5d-9adc-d4de0d5039be req-3674fc7d-fd41-4425-a31f-ff14d2e93869 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:01.104862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5cb5478a-fcc5-4d5d-9adc-d4de0d5039be req-3674fc7d-fd41-4425-a31f-ff14d2e93869 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:01.105370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5cb5478a-fcc5-4d5d-9adc-d4de0d5039be req-3674fc7d-fd41-4425-a31f-ff14d2e93869 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:01.139878 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5cb5478a-fcc5-4d5d-9adc-d4de0d5039be req-3674fc7d-fd41-4425-a31f-ff14d2e93869 service nova] Creating event network-vif-plugged:e3de1e00-4042-45b0-ae3e-dd3df8decccd for instance d029b976-77cc-48d2-8173-a5fa87488a75 on n-h2-856894-1 Sep 10 11:12:01.154386 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5cb5478a-fcc5-4d5d-9adc-d4de0d5039be req-3674fc7d-fd41-4425-a31f-ff14d2e93869 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077324 Sep 10 11:12:01.158639 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3971/5617] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:01.286936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3c9b8895-3df8-4936-a3a1-0d3263eb5127 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:01.288223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3c9b8895-3df8-4936-a3a1-0d3263eb5127 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:01.296059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c9b8895-3df8-4936-a3a1-0d3263eb5127 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:01.296863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c9b8895-3df8-4936-a3a1-0d3263eb5127 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:01.297799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c9b8895-3df8-4936-a3a1-0d3263eb5127 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:01.299630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c9b8895-3df8-4936-a3a1-0d3263eb5127 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:01.300500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c9b8895-3df8-4936-a3a1-0d3263eb5127 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:01.301143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c9b8895-3df8-4936-a3a1-0d3263eb5127 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:01.443280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c9b8895-3df8-4936-a3a1-0d3263eb5127 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:01.452153 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3c9b8895-3df8-4936-a3a1-0d3263eb5127 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1682 microversion: 2.1 time: 0.169074 Sep 10 11:12:01.452985 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1647/5618] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:01 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:01.811914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1abc73f3-f376-4905-8aa2-df6346f58ecc tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:01.812890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1abc73f3-f376-4905-8aa2-df6346f58ecc tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:01.823096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1abc73f3-f376-4905-8aa2-df6346f58ecc tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:01.823677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1abc73f3-f376-4905-8aa2-df6346f58ecc tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:01.824310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1abc73f3-f376-4905-8aa2-df6346f58ecc tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:01.825293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1abc73f3-f376-4905-8aa2-df6346f58ecc tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:01.825975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1abc73f3-f376-4905-8aa2-df6346f58ecc tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:01.826702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1abc73f3-f376-4905-8aa2-df6346f58ecc tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:02.061019 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1abc73f3-f376-4905-8aa2-df6346f58ecc tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1463 microversion: 2.1 time: 0.253921 Sep 10 11:12:02.065817 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3972/5619] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:01 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:02.480799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7dd1ef49-3f20-4bd1-9204-b387f53ab26c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:02.482241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7dd1ef49-3f20-4bd1-9204-b387f53ab26c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:02.492257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef49-3f20-4bd1-9204-b387f53ab26c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:02.493188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef49-3f20-4bd1-9204-b387f53ab26c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:02.493846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef49-3f20-4bd1-9204-b387f53ab26c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:02.494925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef49-3f20-4bd1-9204-b387f53ab26c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:02.495671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef49-3f20-4bd1-9204-b387f53ab26c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:02.496453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef49-3f20-4bd1-9204-b387f53ab26c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:02.592178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7dd1ef49-3f20-4bd1-9204-b387f53ab26c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:02.611978 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7dd1ef49-3f20-4bd1-9204-b387f53ab26c tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1614 microversion: 2.1 time: 0.138075 Sep 10 11:12:02.613461 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1648/5620] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:02 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1614 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:03.052477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d8bb6f6b-dfba-47aa-bea1-61f0366a5781 req-6c15b3ef-7f89-4ad7-b673-f99e986b8efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84aeda03-e643-4983-b623-21bd91e457de", "name": "network-vif-deleted", "tag": "04085c18-f5ec-4e73-bad3-0ec9fc10a27d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:03.072732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d8bb6f6b-dfba-47aa-bea1-61f0366a5781 req-6c15b3ef-7f89-4ad7-b673-f99e986b8efc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:03.077242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d8bb6f6b-dfba-47aa-bea1-61f0366a5781 req-6c15b3ef-7f89-4ad7-b673-f99e986b8efc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:03.077916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d8bb6f6b-dfba-47aa-bea1-61f0366a5781 req-6c15b3ef-7f89-4ad7-b673-f99e986b8efc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:03.087874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-565a1e1c-a229-4cff-a929-71d1309349d9 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:03.091734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-565a1e1c-a229-4cff-a929-71d1309349d9 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:03.110895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-565a1e1c-a229-4cff-a929-71d1309349d9 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:03.111506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-565a1e1c-a229-4cff-a929-71d1309349d9 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:03.111949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-565a1e1c-a229-4cff-a929-71d1309349d9 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:03.112664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-565a1e1c-a229-4cff-a929-71d1309349d9 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:03.113155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-565a1e1c-a229-4cff-a929-71d1309349d9 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:03.113596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-565a1e1c-a229-4cff-a929-71d1309349d9 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:03.116763 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d8bb6f6b-dfba-47aa-bea1-61f0366a5781 req-6c15b3ef-7f89-4ad7-b673-f99e986b8efc service nova] Creating event network-vif-deleted:04085c18-f5ec-4e73-bad3-0ec9fc10a27d for instance 84aeda03-e643-4983-b623-21bd91e457de on n-h2-856894-1 Sep 10 11:12:03.132717 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d8bb6f6b-dfba-47aa-bea1-61f0366a5781 req-6c15b3ef-7f89-4ad7-b673-f99e986b8efc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084736 Sep 10 11:12:03.136077 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3973/5621] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:03.347464 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-565a1e1c-a229-4cff-a929-71d1309349d9 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1648 microversion: 2.1 time: 0.264374 Sep 10 11:12:03.348365 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1649/5622] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:03 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1648 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:12:03.372500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8816b5ed-825a-4c9c-b48d-868f4df983d8 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:03.373290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8816b5ed-825a-4c9c-b48d-868f4df983d8 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:03.381473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8816b5ed-825a-4c9c-b48d-868f4df983d8 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:03.382254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8816b5ed-825a-4c9c-b48d-868f4df983d8 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:03.382902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8816b5ed-825a-4c9c-b48d-868f4df983d8 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:03.384010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8816b5ed-825a-4c9c-b48d-868f4df983d8 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:03.384650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8816b5ed-825a-4c9c-b48d-868f4df983d8 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:03.385288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8816b5ed-825a-4c9c-b48d-868f4df983d8 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:03.552099 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8816b5ed-825a-4c9c-b48d-868f4df983d8 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1648 microversion: 2.1 time: 0.183650 Sep 10 11:12:03.552996 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3974/5623] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:03 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1648 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:03.575614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fc282751-40fe-49f7-bf97-c75f9612aa94 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:03.576928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fc282751-40fe-49f7-bf97-c75f9612aa94 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:03.585409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc282751-40fe-49f7-bf97-c75f9612aa94 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:03.585914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc282751-40fe-49f7-bf97-c75f9612aa94 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:03.586358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc282751-40fe-49f7-bf97-c75f9612aa94 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:03.587074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc282751-40fe-49f7-bf97-c75f9612aa94 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:03.587718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc282751-40fe-49f7-bf97-c75f9612aa94 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:03.588312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc282751-40fe-49f7-bf97-c75f9612aa94 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:03.636957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:03.637637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:03.655747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:03.656999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:03.657691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:03.659862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:03.660462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:03.662330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:03.738957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:03.739762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:03.740538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:03.741707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lazy-loading 'fault' on Instance uuid 84aeda03-e643-4983-b623-21bd91e457de {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:12:03.797757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b1df3721f24d13807ab7f4c4a677f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28403f237c84af2a051fa9feb72f60b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:03.820449 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-769eee18-ab42-45f1-bac7-624cebef8eb8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 200 len: 1332 microversion: 2.1 time: 0.188078 Sep 10 11:12:03.825120 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fc282751-40fe-49f7-bf97-c75f9612aa94 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1648 microversion: 2.1 time: 0.253490 Sep 10 11:12:03.826454 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3975/5624] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:03 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 1332 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:03.827649 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1650/5625] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:03 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1648 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:04.119525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-561341143", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "availability_zone": "nova:n-h1-856894-1", "networks": [{"uuid": "5db5943c-2430-479d-9d72-f0e87479421d"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:04.247281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] validate_networks() for [('5db5943c-2430-479d-9d72-f0e87479421d', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:12:04.942623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:12:04.943071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:12:04.943568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:12:04.943999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:12:04.944449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:12:04.951584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:04.952194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:04.966837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:04.968319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:04.968822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:04.971310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:04.972516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:04.972977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:04.973673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:04.974138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:04.974873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:04.975345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:04.975820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:04.981016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:05.002057 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de HTTP/1.1 Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '84aeda03-e643-4983-b623-21bd91e457de'} Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:05.006864 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:05.010670 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:05.010670 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:05.010670 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:05.010670 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:05.010670 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:05.010670 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:05.010670 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:05.012636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:05.013727 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cea77076-cbdc-44a4-9e8f-520a9d2ee56a tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 404 len: 111 microversion: 2.1 time: 0.065983 Sep 10 11:12:05.016129 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1651/5626] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:04 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:05.024680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-75cb28b9-60c5-4b91-b30b-4864654b0614 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '.version_select at 0x7efcade90790>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:05.034968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Getting quotas for project aebc92b18358432399615828dbbffa05. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:12:05.042628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Getting quotas for user 4fa0cfe8b89d409282bc88ba370e6b7a and project aebc92b18358432399615828dbbffa05. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:12:05.059462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:12:05.062338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:12:05.066124 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-75cb28b9-60c5-4b91-b30b-4864654b0614 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049414143" status: 202 len: 0 microversion: 2.1 time: 0.043777 Sep 10 11:12:05.068644 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1652/5627] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 11:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1049414143 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:12:05.120285 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a57c7452-30ac-4e0e-9581-1e8f2c28e8e1 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006612 Sep 10 11:12:05.130149 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3976/5628] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:12:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:12:05.133494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-346acbfe-aa0a-4dc1-b856-fbb350111068 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:05.134118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-346acbfe-aa0a-4dc1-b856-fbb350111068 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:05.224419 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-346acbfe-aa0a-4dc1-b856-fbb350111068 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1328 microversion: 2.1 time: 0.094861 Sep 10 11:12:05.225472 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1653/5629] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:05 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:06.252954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-de11398e-898f-4251-8d49-241dbb4b411b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:06.257179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-de11398e-898f-4251-8d49-241dbb4b411b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:06.284600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de11398e-898f-4251-8d49-241dbb4b411b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:06.287677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de11398e-898f-4251-8d49-241dbb4b411b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:06.288830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de11398e-898f-4251-8d49-241dbb4b411b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:06.290255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de11398e-898f-4251-8d49-241dbb4b411b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:06.293184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de11398e-898f-4251-8d49-241dbb4b411b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:06.294054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-de11398e-898f-4251-8d49-241dbb4b411b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:06.411464 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-de11398e-898f-4251-8d49-241dbb4b411b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1415 microversion: 2.1 time: 0.164450 Sep 10 11:12:06.412873 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3977/5630] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:06 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1415 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:07.436373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-685d4e4f-11e8-4cc5-8e8c-b9b901d8eb8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:07.437178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-685d4e4f-11e8-4cc5-8e8c-b9b901d8eb8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:07.453841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685d4e4f-11e8-4cc5-8e8c-b9b901d8eb8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:07.455877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685d4e4f-11e8-4cc5-8e8c-b9b901d8eb8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:07.465488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685d4e4f-11e8-4cc5-8e8c-b9b901d8eb8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:07.478445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685d4e4f-11e8-4cc5-8e8c-b9b901d8eb8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:07.479508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685d4e4f-11e8-4cc5-8e8c-b9b901d8eb8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:07.481463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-685d4e4f-11e8-4cc5-8e8c-b9b901d8eb8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:07.678815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:07.686928 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-685d4e4f-11e8-4cc5-8e8c-b9b901d8eb8b tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1463 microversion: 2.1 time: 0.255324 Sep 10 11:12:07.687740 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1654/5631] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:07 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1463 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:12:08.623778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4c981b03-f167-4f9a-841c-c1e156f7764b req-02b80318-ddb9-4e47-aaed-d3e17ed90cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccb72846-1cdb-4dac-84d6-b7314c54f615", "tag": "c879a4e9-1258-4019-ab46-a58c5b81ff7e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:08.659320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4c981b03-f167-4f9a-841c-c1e156f7764b req-02b80318-ddb9-4e47-aaed-d3e17ed90cb9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:08.661324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4c981b03-f167-4f9a-841c-c1e156f7764b req-02b80318-ddb9-4e47-aaed-d3e17ed90cb9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:08.662645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4c981b03-f167-4f9a-841c-c1e156f7764b req-02b80318-ddb9-4e47-aaed-d3e17ed90cb9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:08.680782 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4c981b03-f167-4f9a-841c-c1e156f7764b req-02b80318-ddb9-4e47-aaed-d3e17ed90cb9 service nova] Creating event network-changed:c879a4e9-1258-4019-ab46-a58c5b81ff7e for instance ccb72846-1cdb-4dac-84d6-b7314c54f615 on n-h1-856894-1 Sep 10 11:12:08.689817 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4c981b03-f167-4f9a-841c-c1e156f7764b req-02b80318-ddb9-4e47-aaed-d3e17ed90cb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213026 Sep 10 11:12:08.691058 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3978/5632] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:08.712620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9f27487e-9e56-4a05-a0c5-fcef4112a7f3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:08.713456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9f27487e-9e56-4a05-a0c5-fcef4112a7f3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:08.730277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f27487e-9e56-4a05-a0c5-fcef4112a7f3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:08.730780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f27487e-9e56-4a05-a0c5-fcef4112a7f3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:08.731240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f27487e-9e56-4a05-a0c5-fcef4112a7f3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:08.731960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f27487e-9e56-4a05-a0c5-fcef4112a7f3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:08.732422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f27487e-9e56-4a05-a0c5-fcef4112a7f3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:08.732856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f27487e-9e56-4a05-a0c5-fcef4112a7f3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:08.989953 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9f27487e-9e56-4a05-a0c5-fcef4112a7f3 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1463 microversion: 2.1 time: 0.279195 Sep 10 11:12:08.990556 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1655/5633] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:08 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1463 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:10.023743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93d03c33-ec59-4e45-9f5d-4cb814338ade tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:10.025154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93d03c33-ec59-4e45-9f5d-4cb814338ade tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:10.035963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d03c33-ec59-4e45-9f5d-4cb814338ade tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:10.036739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d03c33-ec59-4e45-9f5d-4cb814338ade tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:10.037396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d03c33-ec59-4e45-9f5d-4cb814338ade tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:10.038554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d03c33-ec59-4e45-9f5d-4cb814338ade tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:10.039212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d03c33-ec59-4e45-9f5d-4cb814338ade tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:10.039822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93d03c33-ec59-4e45-9f5d-4cb814338ade tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:10.042916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=100 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:10.211720 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93d03c33-ec59-4e45-9f5d-4cb814338ade tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1463 microversion: 2.1 time: 0.192899 Sep 10 11:12:10.228537 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3979/5634] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:10 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1463 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:10.435757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:10.436479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:10.452722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:10.453522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:10.459828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:10.460737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:10.461311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:10.461926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:10.478676 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de HTTP/1.1 Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '84aeda03-e643-4983-b623-21bd91e457de'} Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:10.481334 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:10.485491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:10.486253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:10.487333 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fdb1434a-31b0-45ee-8142-0b2724b885b8 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 404 len: 111 microversion: 2.1 time: 0.056770 Sep 10 11:12:10.490452 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1656/5635] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:12:10 2022] DELETE /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:10.498675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:10.500108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 84aeda03-e643-4983-b623-21bd91e457de] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:10.508176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:10.509181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:10.510210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:10.514972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:10.520907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:10.526418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:10.557125 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de HTTP/1.1 Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '84aeda03-e643-4983-b623-21bd91e457de'} Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:10.559615 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:12:10.564648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:10.564648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:10.564648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:10.564648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:10.564648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:10.564648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. Sep 10 11:12:10.564648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:12:10.566277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance 84aeda03-e643-4983-b623-21bd91e457de could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:10.567431 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c84f4c05-d5e0-410c-ace2-a7ec73f3ac74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de" status: 404 len: 111 microversion: 2.1 time: 0.073217 Sep 10 11:12:10.570246 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3980/5636] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:10 2022] GET /compute/v2.1/servers/84aeda03-e643-4983-b623-21bd91e457de => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:11.236426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a2a47e5c-0a6a-4595-90ee-500e76bdba24 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:11.237929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a2a47e5c-0a6a-4595-90ee-500e76bdba24 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:11.247306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a47e5c-0a6a-4595-90ee-500e76bdba24 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:11.247744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a47e5c-0a6a-4595-90ee-500e76bdba24 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:11.248185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a47e5c-0a6a-4595-90ee-500e76bdba24 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:11.248891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a47e5c-0a6a-4595-90ee-500e76bdba24 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:11.249387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a47e5c-0a6a-4595-90ee-500e76bdba24 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:11.249811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2a47e5c-0a6a-4595-90ee-500e76bdba24 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:11.550965 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a2a47e5c-0a6a-4595-90ee-500e76bdba24 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1463 microversion: 2.1 time: 0.318859 Sep 10 11:12:11.551686 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1657/5637] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:11 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1463 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:12:12.576152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-59b468ae-acc5-47ce-a8be-fc3a0814b550 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:12.576787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-59b468ae-acc5-47ce-a8be-fc3a0814b550 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:12.584420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b468ae-acc5-47ce-a8be-fc3a0814b550 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:12.584929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b468ae-acc5-47ce-a8be-fc3a0814b550 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:12.585436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b468ae-acc5-47ce-a8be-fc3a0814b550 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:12.586154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b468ae-acc5-47ce-a8be-fc3a0814b550 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:12.586623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b468ae-acc5-47ce-a8be-fc3a0814b550 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:12.587060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-59b468ae-acc5-47ce-a8be-fc3a0814b550 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:12.813769 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-59b468ae-acc5-47ce-a8be-fc3a0814b550 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1463 microversion: 2.1 time: 0.241165 Sep 10 11:12:12.815013 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3981/5638] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:12 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1463 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:12:13.115094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-0c2e5983-e9ec-489c-a1b2-55b0267cb5a7 req-91439dd1-03ef-4157-b475-2a1b03bb61b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb72846-1cdb-4dac-84d6-b7314c54f615", "name": "network-vif-plugged", "status": "completed", "tag": "c879a4e9-1258-4019-ab46-a58c5b81ff7e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:13.135654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0c2e5983-e9ec-489c-a1b2-55b0267cb5a7 req-91439dd1-03ef-4157-b475-2a1b03bb61b3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:13.137645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0c2e5983-e9ec-489c-a1b2-55b0267cb5a7 req-91439dd1-03ef-4157-b475-2a1b03bb61b3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:13.138350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0c2e5983-e9ec-489c-a1b2-55b0267cb5a7 req-91439dd1-03ef-4157-b475-2a1b03bb61b3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:13.159130 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-0c2e5983-e9ec-489c-a1b2-55b0267cb5a7 req-91439dd1-03ef-4157-b475-2a1b03bb61b3 service nova] Creating event network-vif-plugged:c879a4e9-1258-4019-ab46-a58c5b81ff7e for instance ccb72846-1cdb-4dac-84d6-b7314c54f615 on n-h1-856894-1 Sep 10 11:12:13.171616 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-0c2e5983-e9ec-489c-a1b2-55b0267cb5a7 req-91439dd1-03ef-4157-b475-2a1b03bb61b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061251 Sep 10 11:12:13.172231 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1658/5639] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:13.842732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fe4dee46-91d8-47e4-b9a6-01787d64d8ae tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:13.844413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fe4dee46-91d8-47e4-b9a6-01787d64d8ae tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:13.857668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe4dee46-91d8-47e4-b9a6-01787d64d8ae tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:13.863364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe4dee46-91d8-47e4-b9a6-01787d64d8ae tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:13.864642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe4dee46-91d8-47e4-b9a6-01787d64d8ae tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:13.866099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe4dee46-91d8-47e4-b9a6-01787d64d8ae tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:13.867283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe4dee46-91d8-47e4-b9a6-01787d64d8ae tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:13.867970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fe4dee46-91d8-47e4-b9a6-01787d64d8ae tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:14.094428 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fe4dee46-91d8-47e4-b9a6-01787d64d8ae tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1463 microversion: 2.1 time: 0.258076 Sep 10 11:12:14.098635 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3982/5640] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:13 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:15.108057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:15.108646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:15.123836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c92dea29-1589-4314-91f6-0396406c82ab tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:15.124788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c92dea29-1589-4314-91f6-0396406c82ab tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:15.130467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:15.131537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.131833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:15.132283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.138591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dea29-1589-4314-91f6-0396406c82ab tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.139432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dea29-1589-4314-91f6-0396406c82ab tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.141060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dea29-1589-4314-91f6-0396406c82ab tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.142399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dea29-1589-4314-91f6-0396406c82ab tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.144119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dea29-1589-4314-91f6-0396406c82ab tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.144806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92dea29-1589-4314-91f6-0396406c82ab tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.148560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.149501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.149992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.150495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.169788 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 HTTP/1.1 Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '180ab04a-8bae-48f5-8019-be7b91bcf855'} Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:15.171491 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cd58430e-7cac-486f-90aa-78c03a546a74 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 404 len: 111 microversion: 2.1 time: 0.072183 Sep 10 11:12:15.176209 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1659/5641] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:12:15 2022] DELETE /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:15.186773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:15.187682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 180ab04a-8bae-48f5-8019-be7b91bcf855] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:15.195352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.196193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.196880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.197833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.198689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.199461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.232747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:15.269704 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 HTTP/1.1 Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '180ab04a-8bae-48f5-8019-be7b91bcf855'} Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:15.273282 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.278273 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.278273 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:15.278273 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:15.278273 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:15.278273 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:15.278273 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. Sep 10 11:12:15.278273 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.281391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance 180ab04a-8bae-48f5-8019-be7b91bcf855 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:15.285231 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-30d7701b-5f59-411d-9690-0609c2aaf168 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855" status: 404 len: 111 microversion: 2.1 time: 0.102997 Sep 10 11:12:15.289928 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1660/5642] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:15 2022] GET /compute/v2.1/servers/180ab04a-8bae-48f5-8019-be7b91bcf855 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:15.301265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:15.302197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:15.314154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.315722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.316614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.317502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.318064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.318743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.338596 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 HTTP/1.1 Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '96a7ff1d-6a10-433b-810e-83327d6b6aa7'} Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:15.340590 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:12:15.344271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.348291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:15.349650 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0be0bb4e-90d7-4848-8c82-4423eba3fff2 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 404 len: 111 microversion: 2.1 time: 0.058411 Sep 10 11:12:15.350456 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1661/5643] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:12:15 2022] DELETE /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:15.359132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:15.360079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: 96a7ff1d-6a10-433b-810e-83327d6b6aa7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:15.367944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.368530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.369260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.370189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.370977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.371751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.389254 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 HTTP/1.1 Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '96a7ff1d-6a10-433b-810e-83327d6b6aa7'} Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:15.391092 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.398241 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:15.398241 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:15.398241 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:15.398241 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:15.398241 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:15.398241 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. Sep 10 11:12:15.398241 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:15.400188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance 96a7ff1d-6a10-433b-810e-83327d6b6aa7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:15.401488 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e1b5162c-52f8-4de4-8c0f-4fbfa5ff6eff tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7" status: 404 len: 111 microversion: 2.1 time: 0.046621 Sep 10 11:12:15.405518 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1662/5644] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:15 2022] GET /compute/v2.1/servers/96a7ff1d-6a10-433b-810e-83327d6b6aa7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:15.429799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c92dea29-1589-4314-91f6-0396406c82ab tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1647 microversion: 2.1 time: 0.311074 Sep 10 11:12:15.432543 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3983/5645] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:15 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1647 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:15.458487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5b5825f8-faca-4116-ac30-d2d784e5086e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:15.464566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5b5825f8-faca-4116-ac30-d2d784e5086e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:15.482005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b5825f8-faca-4116-ac30-d2d784e5086e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.482770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b5825f8-faca-4116-ac30-d2d784e5086e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.483434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b5825f8-faca-4116-ac30-d2d784e5086e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.484396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b5825f8-faca-4116-ac30-d2d784e5086e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.485015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b5825f8-faca-4116-ac30-d2d784e5086e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.485696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b5825f8-faca-4116-ac30-d2d784e5086e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.696392 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5b5825f8-faca-4116-ac30-d2d784e5086e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1647 microversion: 2.1 time: 0.242256 Sep 10 11:12:15.697054 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1663/5646] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:15 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1647 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:15.724314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6b22000d-a72d-49f0-ab90-bf12c417c2f0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:15.724961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6b22000d-a72d-49f0-ab90-bf12c417c2f0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:15.742741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b22000d-a72d-49f0-ab90-bf12c417c2f0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.743265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b22000d-a72d-49f0-ab90-bf12c417c2f0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.743729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b22000d-a72d-49f0-ab90-bf12c417c2f0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:15.744465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b22000d-a72d-49f0-ab90-bf12c417c2f0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:15.744946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b22000d-a72d-49f0-ab90-bf12c417c2f0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:15.745434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b22000d-a72d-49f0-ab90-bf12c417c2f0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:16.031227 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6b22000d-a72d-49f0-ab90-bf12c417c2f0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1647 microversion: 2.1 time: 0.311288 Sep 10 11:12:16.034473 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3984/5647] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:15 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1647 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:16.077731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-833b5e44-b7a0-466b-b257-b49cd31f0533 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:16.078243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-833b5e44-b7a0-466b-b257-b49cd31f0533 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:16.092159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-833b5e44-b7a0-466b-b257-b49cd31f0533 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:16.092685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-833b5e44-b7a0-466b-b257-b49cd31f0533 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:16.093955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-833b5e44-b7a0-466b-b257-b49cd31f0533 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:16.094702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-833b5e44-b7a0-466b-b257-b49cd31f0533 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:16.095701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-833b5e44-b7a0-466b-b257-b49cd31f0533 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:16.096600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-833b5e44-b7a0-466b-b257-b49cd31f0533 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:16.142919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-833b5e44-b7a0-466b-b257-b49cd31f0533 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:12:16.280271 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-833b5e44-b7a0-466b-b257-b49cd31f0533 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 204 len: 0 microversion: 2.1 time: 0.208504 Sep 10 11:12:16.281175 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1664/5648] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:12:16 2022] DELETE /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:12:16.290120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8eabc32-8f77-4797-b0cf-561282422730 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:16.290896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e8eabc32-8f77-4797-b0cf-561282422730 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:16.305327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8eabc32-8f77-4797-b0cf-561282422730 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:16.306377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8eabc32-8f77-4797-b0cf-561282422730 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:16.307041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8eabc32-8f77-4797-b0cf-561282422730 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:16.307962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8eabc32-8f77-4797-b0cf-561282422730 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:16.308645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8eabc32-8f77-4797-b0cf-561282422730 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:16.309220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8eabc32-8f77-4797-b0cf-561282422730 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:16.489600 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8eabc32-8f77-4797-b0cf-561282422730 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1653 microversion: 2.1 time: 0.203415 Sep 10 11:12:16.490799 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3985/5649] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:16 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1653 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:17.514727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-45094b89-d58d-45da-9551-a3519fd648bb tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:17.516383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-45094b89-d58d-45da-9551-a3519fd648bb tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:17.525382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45094b89-d58d-45da-9551-a3519fd648bb tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:17.526475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45094b89-d58d-45da-9551-a3519fd648bb tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:17.527141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45094b89-d58d-45da-9551-a3519fd648bb tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:17.528058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45094b89-d58d-45da-9551-a3519fd648bb tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:17.528707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45094b89-d58d-45da-9551-a3519fd648bb tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:17.529362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45094b89-d58d-45da-9551-a3519fd648bb tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:17.697449 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-45094b89-d58d-45da-9551-a3519fd648bb tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1653 microversion: 2.1 time: 0.187081 Sep 10 11:12:17.698872 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1665/5650] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:17 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1653 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:18.274532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e82c4c95-fc14-41d2-a1bf-b01dbb1b163c req-155bc076-6e07-480e-9c55-6f76900d93b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb72846-1cdb-4dac-84d6-b7314c54f615", "name": "network-vif-deleted", "tag": "c879a4e9-1258-4019-ab46-a58c5b81ff7e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:18.302868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e82c4c95-fc14-41d2-a1bf-b01dbb1b163c req-155bc076-6e07-480e-9c55-6f76900d93b0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:18.305956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e82c4c95-fc14-41d2-a1bf-b01dbb1b163c req-155bc076-6e07-480e-9c55-6f76900d93b0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:18.307100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e82c4c95-fc14-41d2-a1bf-b01dbb1b163c req-155bc076-6e07-480e-9c55-6f76900d93b0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:18.326224 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e82c4c95-fc14-41d2-a1bf-b01dbb1b163c req-155bc076-6e07-480e-9c55-6f76900d93b0 service nova] Creating event network-vif-deleted:c879a4e9-1258-4019-ab46-a58c5b81ff7e for instance ccb72846-1cdb-4dac-84d6-b7314c54f615 on n-h1-856894-1 Sep 10 11:12:18.350811 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e82c4c95-fc14-41d2-a1bf-b01dbb1b163c req-155bc076-6e07-480e-9c55-6f76900d93b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080458 Sep 10 11:12:18.353301 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3986/5651] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:18.724209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:18.724926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:18.736627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:18.737989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:18.738435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:18.739171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:18.739655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:18.740080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:18.795225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:18.796080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:18.796976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:18.798739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lazy-loading 'fault' on Instance uuid ccb72846-1cdb-4dac-84d6-b7314c54f615 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:12:18.952090 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1203b091-e272-41a9-afb2-94681c09c606 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 200 len: 1453 microversion: 2.1 time: 0.231818 Sep 10 11:12:18.955655 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1666/5652] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:18 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 1453 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:19.982672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:19.984024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: ccb72846-1cdb-4dac-84d6-b7314c54f615] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:19.991543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:19.992454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:19.994213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:19.995215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:19.995857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:19.996751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:19.997413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:19.998426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:20.011799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:20.012384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:20.012897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:20.014345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:20.014983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:20.016008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:20.016704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] HTTP exception thrown: Instance ccb72846-1cdb-4dac-84d6-b7314c54f615 could not be found. Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Request method failure captured: Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 HTTP/1.1 Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHD0pAO2kTKDVnTCyhuHRA6ZVV7-jk-s53FCuChhPr1KHarmbKAUMTVELCawybcHIXLO1SzFsHC9joTC1lArm4KcRdEw6B-gq_mw1CghwZp3ASNd71P3W2dbu5xx0O5WJDlupbRUD35UjsVg3NQ0Zsxg-1lDJybjSdkpmZdYuAgDSCM Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: aebc92b18358432399615828dbbffa05 Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestServerMultinode-5921027 Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aebc92b18358432399615828dbbffa05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aebc92b18358432399615828dbbffa05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aebc92b18358432399615828dbbffa05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aebc92b18358432399615828dbbffa05", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestServerMultinode-5921027 Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: aebc92b18358432399615828dbbffa05 Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestServerMultinode-5921027 Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestServerMultinode-5921027-project-admin Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 4fa0cfe8b89d409282bc88ba370e6b7a Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestServerMultinode-5921027-project-admin Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance ccb72846-1cdb-4dac-84d6-b7314c54f615 could not be found. Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'ccb72846-1cdb-4dac-84d6-b7314c54f615'} Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccb72846-1cdb-4dac-84d6-b7314c54f615 could not be found. Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccb72846-1cdb-4dac-84d6-b7314c54f615 could not be found. Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:20.018974 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.023146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:20.023146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:20.023146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:20.023146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:20.023146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:20.023146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccb72846-1cdb-4dac-84d6-b7314c54f615 could not be found. Sep 10 11:12:20.023146 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.027423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Returning 404 to user: Instance ccb72846-1cdb-4dac-84d6-b7314c54f615 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:20.028447 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0b001d9-8d6c-4413-8423-9e9539ccc41d tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615" status: 404 len: 111 microversion: 2.1 time: 0.050446 Sep 10 11:12:20.029251 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3987/5653] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:19 2022] GET /compute/v2.1/servers/ccb72846-1cdb-4dac-84d6-b7314c54f615 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:20.037596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2075a67f-0507-4764-a8aa-67bbd47b4808 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:20.038376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2075a67f-0507-4764-a8aa-67bbd47b4808 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:20.046244 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 HTTP/1.1 Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'cf201661-21b8-4623-b580-b9cafba66341'} Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:20.051770 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:12:20.056171 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.056979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2075a67f-0507-4764-a8aa-67bbd47b4808 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:20.056979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2075a67f-0507-4764-a8aa-67bbd47b4808 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:20.057396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2075a67f-0507-4764-a8aa-67bbd47b4808 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:20.057983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2075a67f-0507-4764-a8aa-67bbd47b4808 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:20.058462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2075a67f-0507-4764-a8aa-67bbd47b4808 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:20.058908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2075a67f-0507-4764-a8aa-67bbd47b4808 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:20.059992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:20.061884 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-09f89775-7807-4680-b1a1-a2746649c6a7 tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 404 len: 111 microversion: 2.1 time: 0.074637 Sep 10 11:12:20.063358 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1667/5654] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:12:19 2022] DELETE /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:20.074969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:20.075854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] [instance: cf201661-21b8-4623-b580-b9cafba66341] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:20.084473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:20.085739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:20.086833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:20.088451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:20.090211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:20.091224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:20.109996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2075a67f-0507-4764-a8aa-67bbd47b4808 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:12:20.114018 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] HTTP exception thrown: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Request method failure captured: Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 HTTP/1.1 Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG-Hs3Xp6mi9XnnFnqOC1B6SICVJ7PMhwJfeJr13s0Yepi2qh473EDoja_XBbXyjBb2AHj8iKoQuFjvBlqrQb87j6qKoIPzDG_Y5j_PXXfjm09JoU0s1kY8iALewGEwt0Wu0hT-QPRPVEozDsxzErpWjEEb9BlPUaZGe-M3f_cS9RQk Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b28403f237c84af2a051fa9feb72f60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b28403f237c84af2a051fa9feb72f60b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: b28403f237c84af2a051fa9feb72f60b Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-520652670 Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: c3b1df3721f24d13807ab7f4c4a677f8 Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeNegativeTest-520652670-project Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'cf201661-21b8-4623-b580-b9cafba66341'} Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:20.116271 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.124348 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:20.124348 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:20.124348 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:20.124348 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:20.124348 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:20.124348 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. Sep 10 11:12:20.124348 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:20.124348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] Returning 404 to user: Instance cf201661-21b8-4623-b580-b9cafba66341 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:20.124348 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cf62e8a2-0f24-4774-8a4d-5f47fdbbf04f tempest-AttachVolumeNegativeTest-520652670 tempest-AttachVolumeNegativeTest-520652670-project] 10.222.0.20 "GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341" status: 404 len: 111 microversion: 2.1 time: 0.050149 Sep 10 11:12:20.124348 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1668/5655] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:20 2022] GET /compute/v2.1/servers/cf201661-21b8-4623-b580-b9cafba66341 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:20.294946 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2075a67f-0507-4764-a8aa-67bbd47b4808 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 204 len: 0 microversion: 2.1 time: 0.260406 Sep 10 11:12:20.296143 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3988/5656] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:12:20 2022] DELETE /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:12:20.309770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-649abe4d-f461-4640-93ca-8e44536990a0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:20.310658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-649abe4d-f461-4640-93ca-8e44536990a0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:20.319974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649abe4d-f461-4640-93ca-8e44536990a0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:20.320806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649abe4d-f461-4640-93ca-8e44536990a0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:20.321495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649abe4d-f461-4640-93ca-8e44536990a0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:20.322402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649abe4d-f461-4640-93ca-8e44536990a0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:20.323008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649abe4d-f461-4640-93ca-8e44536990a0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:20.323437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649abe4d-f461-4640-93ca-8e44536990a0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:20.654337 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-649abe4d-f461-4640-93ca-8e44536990a0 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1654 microversion: 2.1 time: 0.351705 Sep 10 11:12:20.655106 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1669/5657] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:20 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1654 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:21.678900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f62d8968-328e-4fe7-9e07-8ce8e4874952 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:21.680599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f62d8968-328e-4fe7-9e07-8ce8e4874952 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:21.706432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f62d8968-328e-4fe7-9e07-8ce8e4874952 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:21.707126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f62d8968-328e-4fe7-9e07-8ce8e4874952 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:21.707875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f62d8968-328e-4fe7-9e07-8ce8e4874952 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:21.708622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f62d8968-328e-4fe7-9e07-8ce8e4874952 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:21.709136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f62d8968-328e-4fe7-9e07-8ce8e4874952 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:21.709596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f62d8968-328e-4fe7-9e07-8ce8e4874952 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:22.425799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f62d8968-328e-4fe7-9e07-8ce8e4874952 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1654 microversion: 2.1 time: 0.751524 Sep 10 11:12:22.426563 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3989/5658] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:21 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1654 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:23.322136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-2db83be0-568d-4062-adac-11809d3c321f req-d297c3c7-17d6-4fee-a537-a87478b625be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d029b976-77cc-48d2-8173-a5fa87488a75", "name": "network-vif-deleted", "tag": "e3de1e00-4042-45b0-ae3e-dd3df8decccd"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:23.372322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2db83be0-568d-4062-adac-11809d3c321f req-d297c3c7-17d6-4fee-a537-a87478b625be service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:23.380890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2db83be0-568d-4062-adac-11809d3c321f req-d297c3c7-17d6-4fee-a537-a87478b625be service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:23.381529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2db83be0-568d-4062-adac-11809d3c321f req-d297c3c7-17d6-4fee-a537-a87478b625be service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:23.400886 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-2db83be0-568d-4062-adac-11809d3c321f req-d297c3c7-17d6-4fee-a537-a87478b625be service nova] Creating event network-vif-deleted:e3de1e00-4042-45b0-ae3e-dd3df8decccd for instance d029b976-77cc-48d2-8173-a5fa87488a75 on n-h2-856894-1 Sep 10 11:12:23.417610 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-2db83be0-568d-4062-adac-11809d3c321f req-d297c3c7-17d6-4fee-a537-a87478b625be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105059 Sep 10 11:12:23.418222 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1670/5659] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:23.450800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:23.451850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:23.469205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:23.469927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:23.473709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:23.475404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:23.476478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:23.477026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:23.562061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:23.565747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:23.566386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:23.566899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lazy-loading 'fault' on Instance uuid d029b976-77cc-48d2-8173-a5fa87488a75 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:12:23.626403 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3082908-64e2-4aed-8054-ac7521ac7d5e tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 200 len: 1453 microversion: 2.1 time: 0.180789 Sep 10 11:12:23.629807 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3990/5660] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:23 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:24.652978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:24.653729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] [instance: d029b976-77cc-48d2-8173-a5fa87488a75] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:24.661835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:24.662917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:24.663781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:24.664649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:24.665431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:24.666038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:24.686911 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] HTTP exception thrown: Instance d029b976-77cc-48d2-8173-a5fa87488a75 could not be found. Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Request method failure captured: Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 HTTP/1.1 Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHD0pAO2kTKDVnTCyhuHRA6ZVV7-jk-s53FCuChhPr1KHarmbKAUMTVELCawybcHIXLO1SzFsHC9joTC1lArm4KcRdEw6B-gq_mw1CghwZp3ASNd71P3W2dbu5xx0O5WJDlupbRUD35UjsVg3NQ0Zsxg-1lDJybjSdkpmZdYuAgDSCM Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: aebc92b18358432399615828dbbffa05 Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestServerMultinode-5921027 Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aebc92b18358432399615828dbbffa05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aebc92b18358432399615828dbbffa05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aebc92b18358432399615828dbbffa05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aebc92b18358432399615828dbbffa05", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestServerMultinode-5921027 Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: aebc92b18358432399615828dbbffa05 Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestServerMultinode-5921027 Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestServerMultinode-5921027-project-admin Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 4fa0cfe8b89d409282bc88ba370e6b7a Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestServerMultinode-5921027-project-admin Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance d029b976-77cc-48d2-8173-a5fa87488a75 could not be found. Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'd029b976-77cc-48d2-8173-a5fa87488a75'} Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d029b976-77cc-48d2-8173-a5fa87488a75 could not be found. Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d029b976-77cc-48d2-8173-a5fa87488a75 could not be found. Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:24.689456 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:24.694361 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:24.694361 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:24.694361 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:24.694361 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:24.694361 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:24.694361 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d029b976-77cc-48d2-8173-a5fa87488a75 could not be found. Sep 10 11:12:24.694361 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:24.697697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] Returning 404 to user: Instance d029b976-77cc-48d2-8173-a5fa87488a75 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:24.699751 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7fcedb87-1982-4c8a-8658-6d3c8b83d984 tempest-TestServerMultinode-5921027 tempest-TestServerMultinode-5921027-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75" status: 404 len: 111 microversion: 2.1 time: 0.053431 Sep 10 11:12:24.712711 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1671/5661] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:24 2022] GET /compute/v2.1/servers/d029b976-77cc-48d2-8173-a5fa87488a75 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:28.192200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-123530a1-9ee4-404c-9ef5-a039b8cf3005 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:28.199199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-123530a1-9ee4-404c-9ef5-a039b8cf3005 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:28.202588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:28.208441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-123530a1-9ee4-404c-9ef5-a039b8cf3005 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:28.209227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-123530a1-9ee4-404c-9ef5-a039b8cf3005 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:28.209833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-123530a1-9ee4-404c-9ef5-a039b8cf3005 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:28.214571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-123530a1-9ee4-404c-9ef5-a039b8cf3005 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:28.215267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-123530a1-9ee4-404c-9ef5-a039b8cf3005 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:28.215884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-123530a1-9ee4-404c-9ef5-a039b8cf3005 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:28.261522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-123530a1-9ee4-404c-9ef5-a039b8cf3005 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:12:28.420637 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-123530a1-9ee4-404c-9ef5-a039b8cf3005 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 204 len: 0 microversion: 2.1 time: 0.232985 Sep 10 11:12:28.421603 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3991/5662] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:12:28 2022] DELETE /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:12:28.433596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-08de6994-c3e5-44a6-9a22-3e3b387e8096 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:28.435060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-08de6994-c3e5-44a6-9a22-3e3b387e8096 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:28.447851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:28.452719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08de6994-c3e5-44a6-9a22-3e3b387e8096 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:28.452719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08de6994-c3e5-44a6-9a22-3e3b387e8096 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:28.453589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08de6994-c3e5-44a6-9a22-3e3b387e8096 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:28.455733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08de6994-c3e5-44a6-9a22-3e3b387e8096 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:28.457590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08de6994-c3e5-44a6-9a22-3e3b387e8096 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:28.458981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-08de6994-c3e5-44a6-9a22-3e3b387e8096 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:28.561135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-68fac93d-637e-4852-b1cc-9b7b5d58566d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:28.561773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-68fac93d-637e-4852-b1cc-9b7b5d58566d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:28.571165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68fac93d-637e-4852-b1cc-9b7b5d58566d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:28.572126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68fac93d-637e-4852-b1cc-9b7b5d58566d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:28.575244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68fac93d-637e-4852-b1cc-9b7b5d58566d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:28.577869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68fac93d-637e-4852-b1cc-9b7b5d58566d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:28.583409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68fac93d-637e-4852-b1cc-9b7b5d58566d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:28.584014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-68fac93d-637e-4852-b1cc-9b7b5d58566d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:28.675111 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-68fac93d-637e-4852-b1cc-9b7b5d58566d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments/7c349ff6-2379-459d-9c05-d01a8a1e7c64" status: 200 len: 194 microversion: 2.20 time: 0.128534 Sep 10 11:12:28.675936 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3992/5663] 10.222.0.20 () {60 vars in 1454 bytes} [Sat Sep 10 11:12:28 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments/7c349ff6-2379-459d-9c05-d01a8a1e7c64 => generated 194 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:12:28.712085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-08de6994-c3e5-44a6-9a22-3e3b387e8096 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:28.724280 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-08de6994-c3e5-44a6-9a22-3e3b387e8096 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1577 microversion: 2.1 time: 0.298343 Sep 10 11:12:28.729701 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1672/5664] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:28 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1577 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:12:28.764609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5548ae28-f2cb-4837-9986-4802be396bb5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:28.765237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5548ae28-f2cb-4837-9986-4802be396bb5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:28.772615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5548ae28-f2cb-4837-9986-4802be396bb5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:28.773283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5548ae28-f2cb-4837-9986-4802be396bb5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:28.774010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5548ae28-f2cb-4837-9986-4802be396bb5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:28.775319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5548ae28-f2cb-4837-9986-4802be396bb5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:28.776029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5548ae28-f2cb-4837-9986-4802be396bb5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:28.776713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5548ae28-f2cb-4837-9986-4802be396bb5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:28.884011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5548ae28-f2cb-4837-9986-4802be396bb5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lazy-loading 'services' on Instance uuid 881d6159-5456-4a2f-98c2-0c3e66109b01 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:12:28.888062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:28.983639 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5548ae28-f2cb-4837-9986-4802be396bb5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments/7c349ff6-2379-459d-9c05-d01a8a1e7c64" status: 202 len: 0 microversion: 2.20 time: 0.222782 Sep 10 11:12:28.984728 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3993/5665] 10.222.0.20 () {60 vars in 1457 bytes} [Sat Sep 10 11:12:28 2022] DELETE /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments/7c349ff6-2379-459d-9c05-d01a8a1e7c64 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:12:28.993486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-100d5e1e-8fe6-4caa-a790-1e0ae339bad8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:28.996830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-100d5e1e-8fe6-4caa-a790-1e0ae339bad8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:29.004198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-100d5e1e-8fe6-4caa-a790-1e0ae339bad8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:29.005632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-100d5e1e-8fe6-4caa-a790-1e0ae339bad8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:29.006300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-100d5e1e-8fe6-4caa-a790-1e0ae339bad8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:29.007217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-100d5e1e-8fe6-4caa-a790-1e0ae339bad8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:29.007878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-100d5e1e-8fe6-4caa-a790-1e0ae339bad8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:29.008720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-100d5e1e-8fe6-4caa-a790-1e0ae339bad8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:29.049292 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-100d5e1e-8fe6-4caa-a790-1e0ae339bad8 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059915 Sep 10 11:12:29.050313 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1673/5666] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 11:12:28 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:12:29.757475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b7f1d162-1e1b-49b4-9112-38c8f3917b26 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:29.758880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b7f1d162-1e1b-49b4-9112-38c8f3917b26 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:29.766265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7f1d162-1e1b-49b4-9112-38c8f3917b26 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:29.766812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7f1d162-1e1b-49b4-9112-38c8f3917b26 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:29.767268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7f1d162-1e1b-49b4-9112-38c8f3917b26 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:29.767989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7f1d162-1e1b-49b4-9112-38c8f3917b26 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:29.768461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7f1d162-1e1b-49b4-9112-38c8f3917b26 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:29.769206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7f1d162-1e1b-49b4-9112-38c8f3917b26 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:30.064182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b24ac5b7-ebe0-4969-868c-249850000f72 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:30.067410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b24ac5b7-ebe0-4969-868c-249850000f72 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:30.076229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b24ac5b7-ebe0-4969-868c-249850000f72 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:30.076809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b24ac5b7-ebe0-4969-868c-249850000f72 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:30.077383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b24ac5b7-ebe0-4969-868c-249850000f72 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:30.078186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b24ac5b7-ebe0-4969-868c-249850000f72 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:30.078743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b24ac5b7-ebe0-4969-868c-249850000f72 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:30.079305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b24ac5b7-ebe0-4969-868c-249850000f72 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:30.124027 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b24ac5b7-ebe0-4969-868c-249850000f72 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065059 Sep 10 11:12:30.124812 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1674/5667] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 11:12:30 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:12:30.125431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b7f1d162-1e1b-49b4-9112-38c8f3917b26 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:30.138074 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b7f1d162-1e1b-49b4-9112-38c8f3917b26 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1577 microversion: 2.1 time: 0.385258 Sep 10 11:12:30.138676 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3994/5668] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:29 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1577 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:31.137290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5725b17b-39c3-434b-b1f3-0d28bd928da3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:31.140219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5725b17b-39c3-434b-b1f3-0d28bd928da3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:31.148386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5725b17b-39c3-434b-b1f3-0d28bd928da3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:31.149262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5725b17b-39c3-434b-b1f3-0d28bd928da3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:31.149938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5725b17b-39c3-434b-b1f3-0d28bd928da3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:31.150888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5725b17b-39c3-434b-b1f3-0d28bd928da3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:31.151556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5725b17b-39c3-434b-b1f3-0d28bd928da3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:31.152192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5725b17b-39c3-434b-b1f3-0d28bd928da3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:31.162192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5be51166-9a30-4918-aff9-f2880f2feecc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:31.163787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5be51166-9a30-4918-aff9-f2880f2feecc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:31.181685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5be51166-9a30-4918-aff9-f2880f2feecc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:31.182562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5be51166-9a30-4918-aff9-f2880f2feecc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:31.183258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5be51166-9a30-4918-aff9-f2880f2feecc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:31.184204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5be51166-9a30-4918-aff9-f2880f2feecc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:31.184890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5be51166-9a30-4918-aff9-f2880f2feecc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:31.185593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5be51166-9a30-4918-aff9-f2880f2feecc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:31.223343 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5725b17b-39c3-434b-b1f3-0d28bd928da3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090098 Sep 10 11:12:31.225529 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1675/5669] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 11:12:31 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:12:31.647632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5be51166-9a30-4918-aff9-f2880f2feecc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:31.670410 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5be51166-9a30-4918-aff9-f2880f2feecc tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1577 microversion: 2.1 time: 0.511453 Sep 10 11:12:31.676383 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3995/5670] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:31 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1577 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:12:32.239595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fce14a2a-1420-40c1-82eb-d91f9382aa07 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:32.243116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fce14a2a-1420-40c1-82eb-d91f9382aa07 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:32.260888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fce14a2a-1420-40c1-82eb-d91f9382aa07 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:32.261611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fce14a2a-1420-40c1-82eb-d91f9382aa07 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:32.262228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fce14a2a-1420-40c1-82eb-d91f9382aa07 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:32.263213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fce14a2a-1420-40c1-82eb-d91f9382aa07 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:32.263872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fce14a2a-1420-40c1-82eb-d91f9382aa07 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:32.264448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fce14a2a-1420-40c1-82eb-d91f9382aa07 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:32.269332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:32.323280 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fce14a2a-1420-40c1-82eb-d91f9382aa07 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088717 Sep 10 11:12:32.324194 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1676/5671] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 11:12:32 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:12:32.671983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e1254289-ec5b-46c2-bd75-e5e884c0b31d req-a25a26e0-9240-4e72-91f2-a30226704d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3c398a-6428-4e59-b945-77f5fafdb729", "name": "network-vif-deleted", "tag": "333543d7-58c3-4f4c-a7c7-b7981a9ef87e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:32.703661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e1254289-ec5b-46c2-bd75-e5e884c0b31d req-a25a26e0-9240-4e72-91f2-a30226704d05 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:32.704766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e1254289-ec5b-46c2-bd75-e5e884c0b31d req-a25a26e0-9240-4e72-91f2-a30226704d05 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:32.705401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e1254289-ec5b-46c2-bd75-e5e884c0b31d req-a25a26e0-9240-4e72-91f2-a30226704d05 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:32.707496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-02144eaa-4615-48ef-8aa8-89f0a79ee914 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:32.708264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-02144eaa-4615-48ef-8aa8-89f0a79ee914 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:32.722389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02144eaa-4615-48ef-8aa8-89f0a79ee914 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:32.725755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02144eaa-4615-48ef-8aa8-89f0a79ee914 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:32.727022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02144eaa-4615-48ef-8aa8-89f0a79ee914 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:32.730616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02144eaa-4615-48ef-8aa8-89f0a79ee914 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:32.731268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02144eaa-4615-48ef-8aa8-89f0a79ee914 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:32.732861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-02144eaa-4615-48ef-8aa8-89f0a79ee914 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:32.754458 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e1254289-ec5b-46c2-bd75-e5e884c0b31d req-a25a26e0-9240-4e72-91f2-a30226704d05 service nova] Creating event network-vif-deleted:333543d7-58c3-4f4c-a7c7-b7981a9ef87e for instance 9c3c398a-6428-4e59-b945-77f5fafdb729 on n-h2-856894-1 Sep 10 11:12:32.770593 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e1254289-ec5b-46c2-bd75-e5e884c0b31d req-a25a26e0-9240-4e72-91f2-a30226704d05 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106731 Sep 10 11:12:32.772462 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3996/5672] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:32.925861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-02144eaa-4615-48ef-8aa8-89f0a79ee914 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:32.942956 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-02144eaa-4615-48ef-8aa8-89f0a79ee914 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1226 microversion: 2.1 time: 0.238186 Sep 10 11:12:32.944445 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1677/5673] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:32 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1226 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:33.338349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a144fb0d-7aec-4bd8-910c-1ce41d382e96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:33.340860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a144fb0d-7aec-4bd8-910c-1ce41d382e96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:33.355392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a144fb0d-7aec-4bd8-910c-1ce41d382e96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:33.356045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a144fb0d-7aec-4bd8-910c-1ce41d382e96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:33.356522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a144fb0d-7aec-4bd8-910c-1ce41d382e96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:33.357287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a144fb0d-7aec-4bd8-910c-1ce41d382e96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:33.357763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a144fb0d-7aec-4bd8-910c-1ce41d382e96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:33.358209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a144fb0d-7aec-4bd8-910c-1ce41d382e96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:33.441462 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a144fb0d-7aec-4bd8-910c-1ce41d382e96 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108544 Sep 10 11:12:33.442987 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3997/5674] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 11:12:33 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:12:33.967786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a2075be9-dade-464d-884b-790d7bfe05db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:33.968641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a2075be9-dade-464d-884b-790d7bfe05db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:33.979945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2075be9-dade-464d-884b-790d7bfe05db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:33.980456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2075be9-dade-464d-884b-790d7bfe05db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:33.980908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2075be9-dade-464d-884b-790d7bfe05db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:33.981653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2075be9-dade-464d-884b-790d7bfe05db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:33.982126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2075be9-dade-464d-884b-790d7bfe05db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:33.982540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2075be9-dade-464d-884b-790d7bfe05db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:34.148435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a2075be9-dade-464d-884b-790d7bfe05db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:34.162085 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a2075be9-dade-464d-884b-790d7bfe05db tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1226 microversion: 2.1 time: 0.197114 Sep 10 11:12:34.164320 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1678/5675] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:33 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1226 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:34.459504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6b1b4dc0-8ed7-4ce4-b2fd-c15b1b068397 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:34.459504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6b1b4dc0-8ed7-4ce4-b2fd-c15b1b068397 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:34.472014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b1b4dc0-8ed7-4ce4-b2fd-c15b1b068397 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:34.473104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b1b4dc0-8ed7-4ce4-b2fd-c15b1b068397 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:34.473913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b1b4dc0-8ed7-4ce4-b2fd-c15b1b068397 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:34.475969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b1b4dc0-8ed7-4ce4-b2fd-c15b1b068397 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:34.476738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b1b4dc0-8ed7-4ce4-b2fd-c15b1b068397 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:34.477492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b1b4dc0-8ed7-4ce4-b2fd-c15b1b068397 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:34.517616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6b1b4dc0-8ed7-4ce4-b2fd-c15b1b068397 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065455 Sep 10 11:12:34.518234 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3998/5676] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 11:12:34 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:12:35.190968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-765c149c-9aa5-4902-a8ec-5e6c3ecc49ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:35.192285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-765c149c-9aa5-4902-a8ec-5e6c3ecc49ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:35.203016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-765c149c-9aa5-4902-a8ec-5e6c3ecc49ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:35.203794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-765c149c-9aa5-4902-a8ec-5e6c3ecc49ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:35.205575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-765c149c-9aa5-4902-a8ec-5e6c3ecc49ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:35.207814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-765c149c-9aa5-4902-a8ec-5e6c3ecc49ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:35.208710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-765c149c-9aa5-4902-a8ec-5e6c3ecc49ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:35.209420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-765c149c-9aa5-4902-a8ec-5e6c3ecc49ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:35.339143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-765c149c-9aa5-4902-a8ec-5e6c3ecc49ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:35.352817 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-765c149c-9aa5-4902-a8ec-5e6c3ecc49ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1226 microversion: 2.1 time: 0.167748 Sep 10 11:12:35.369603 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1679/5677] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:35 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1226 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:35.533850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-77cbfd8e-9462-4c5d-a39b-5dd990eac750 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:35.538589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-77cbfd8e-9462-4c5d-a39b-5dd990eac750 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:35.547521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77cbfd8e-9462-4c5d-a39b-5dd990eac750 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:35.549459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77cbfd8e-9462-4c5d-a39b-5dd990eac750 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:35.550329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77cbfd8e-9462-4c5d-a39b-5dd990eac750 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:35.551933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77cbfd8e-9462-4c5d-a39b-5dd990eac750 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:35.553105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77cbfd8e-9462-4c5d-a39b-5dd990eac750 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:35.553809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77cbfd8e-9462-4c5d-a39b-5dd990eac750 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:35.609098 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-77cbfd8e-9462-4c5d-a39b-5dd990eac750 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082546 Sep 10 11:12:35.615311 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 3999/5678] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 11:12:35 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:12:36.379128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-936b3238-1fec-4863-91d2-3b87f0bfdc40 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:36.380726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-936b3238-1fec-4863-91d2-3b87f0bfdc40 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:36.390223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-936b3238-1fec-4863-91d2-3b87f0bfdc40 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:36.392330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-936b3238-1fec-4863-91d2-3b87f0bfdc40 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:36.392945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-936b3238-1fec-4863-91d2-3b87f0bfdc40 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:36.394220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-936b3238-1fec-4863-91d2-3b87f0bfdc40 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:36.395166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-936b3238-1fec-4863-91d2-3b87f0bfdc40 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:36.396038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-936b3238-1fec-4863-91d2-3b87f0bfdc40 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:36.475580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-936b3238-1fec-4863-91d2-3b87f0bfdc40 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:36.485967 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-936b3238-1fec-4863-91d2-3b87f0bfdc40 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1226 microversion: 2.1 time: 0.112308 Sep 10 11:12:36.489817 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1680/5679] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:36 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:36.622722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9848154-4f70-43bd-bc50-9b5ed83454cc tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:36.624920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9848154-4f70-43bd-bc50-9b5ed83454cc tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:36.632477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9848154-4f70-43bd-bc50-9b5ed83454cc tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:36.633231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9848154-4f70-43bd-bc50-9b5ed83454cc tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:36.633833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9848154-4f70-43bd-bc50-9b5ed83454cc tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:36.634701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9848154-4f70-43bd-bc50-9b5ed83454cc tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:36.635164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9848154-4f70-43bd-bc50-9b5ed83454cc tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:36.635975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9848154-4f70-43bd-bc50-9b5ed83454cc tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:36.674267 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9848154-4f70-43bd-bc50-9b5ed83454cc tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055554 Sep 10 11:12:36.675465 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4000/5680] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 11:12:36 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:36.745684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-007a0db5-1a76-48d3-a99b-4f728fd129c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:36.746182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-007a0db5-1a76-48d3-a99b-4f728fd129c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:36.752482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-007a0db5-1a76-48d3-a99b-4f728fd129c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:36.752977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-007a0db5-1a76-48d3-a99b-4f728fd129c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:36.753645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-007a0db5-1a76-48d3-a99b-4f728fd129c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:36.754384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-007a0db5-1a76-48d3-a99b-4f728fd129c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:36.755048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-007a0db5-1a76-48d3-a99b-4f728fd129c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:36.755477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-007a0db5-1a76-48d3-a99b-4f728fd129c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:36.781409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-007a0db5-1a76-48d3-a99b-4f728fd129c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:12:36.872016 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-007a0db5-1a76-48d3-a99b-4f728fd129c1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 204 len: 0 microversion: 2.20 time: 0.129155 Sep 10 11:12:36.876338 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1681/5681] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 11:12:36 2022] DELETE /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:12:36.882060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:36.882686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:36.888813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:36.889334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:36.889788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:36.890490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:36.890983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:36.891444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:37.045273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:37.054619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:37.056149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:37.057866 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b7de46ef-e010-4903-bbd8-c0ee155381ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.179550 Sep 10 11:12:37.058530 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4001/5682] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:36 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:12:37.512261 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-00022e14-52da-4a15-9caf-c2a5cccfdb33 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:37.512966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-00022e14-52da-4a15-9caf-c2a5cccfdb33 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:37.519780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00022e14-52da-4a15-9caf-c2a5cccfdb33 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:37.520262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00022e14-52da-4a15-9caf-c2a5cccfdb33 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:37.520697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00022e14-52da-4a15-9caf-c2a5cccfdb33 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:37.521414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00022e14-52da-4a15-9caf-c2a5cccfdb33 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:37.521862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00022e14-52da-4a15-9caf-c2a5cccfdb33 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:37.522281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00022e14-52da-4a15-9caf-c2a5cccfdb33 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:37.592359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-00022e14-52da-4a15-9caf-c2a5cccfdb33 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:37.601538 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-00022e14-52da-4a15-9caf-c2a5cccfdb33 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1226 microversion: 2.1 time: 0.093420 Sep 10 11:12:37.602112 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1682/5683] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:37 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:38.084729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:38.085641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:38.093761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:38.094268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:38.095301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:38.096003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:38.096463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:38.096913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:38.252608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:38.260822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:38.262342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:38.263541 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7726de6b-74bd-43ff-ad0f-66cb40e5aca4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1722 microversion: 2.20 time: 0.183058 Sep 10 11:12:38.264271 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4002/5684] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:38 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:12:38.626713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a92dd2e4-83d9-4f9d-90ae-960192aff246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:38.628204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a92dd2e4-83d9-4f9d-90ae-960192aff246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:38.637455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a92dd2e4-83d9-4f9d-90ae-960192aff246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:38.638994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a92dd2e4-83d9-4f9d-90ae-960192aff246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:38.639801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a92dd2e4-83d9-4f9d-90ae-960192aff246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:38.641594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a92dd2e4-83d9-4f9d-90ae-960192aff246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:38.642257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a92dd2e4-83d9-4f9d-90ae-960192aff246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:38.642901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a92dd2e4-83d9-4f9d-90ae-960192aff246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:38.756083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a92dd2e4-83d9-4f9d-90ae-960192aff246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:38.768032 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a92dd2e4-83d9-4f9d-90ae-960192aff246 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1226 microversion: 2.1 time: 0.145649 Sep 10 11:12:38.768797 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1683/5685] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:38 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1226 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:39.290850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:39.292339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:39.300969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:39.301963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:39.302653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:39.303758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:39.304423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:39.305048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:39.421255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:39.431229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:39.433667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:39.435840 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-267d8dbd-a6e9-49d1-8fe4-a227939ba12f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 200 len: 1654 microversion: 2.20 time: 0.149253 Sep 10 11:12:39.436807 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4003/5686] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:39 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:12:39.523246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7c83cf94-53de-443b-bbbf-0490939e563d req-a22a8272-35d7-4e1d-a1bd-3cb55900fdba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881d6159-5456-4a2f-98c2-0c3e66109b01", "name": "network-vif-deleted", "tag": "f2b9da4b-7521-484c-90f9-f1b853ab04d2"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:39.580674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7c83cf94-53de-443b-bbbf-0490939e563d req-a22a8272-35d7-4e1d-a1bd-3cb55900fdba service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:39.588001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7c83cf94-53de-443b-bbbf-0490939e563d req-a22a8272-35d7-4e1d-a1bd-3cb55900fdba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:39.590883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7c83cf94-53de-443b-bbbf-0490939e563d req-a22a8272-35d7-4e1d-a1bd-3cb55900fdba service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:39.615277 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7c83cf94-53de-443b-bbbf-0490939e563d req-a22a8272-35d7-4e1d-a1bd-3cb55900fdba service nova] Creating event network-vif-deleted:f2b9da4b-7521-484c-90f9-f1b853ab04d2 for instance 881d6159-5456-4a2f-98c2-0c3e66109b01 on n-h2-856894-1 Sep 10 11:12:39.626589 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-7c83cf94-53de-443b-bbbf-0490939e563d req-a22a8272-35d7-4e1d-a1bd-3cb55900fdba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116112 Sep 10 11:12:39.627733 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1684/5687] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:39.792806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3044d91-95d2-4ae4-9a66-523233a66410 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:39.793497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e3044d91-95d2-4ae4-9a66-523233a66410 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:39.802425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3044d91-95d2-4ae4-9a66-523233a66410 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:39.802884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3044d91-95d2-4ae4-9a66-523233a66410 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:39.803356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3044d91-95d2-4ae4-9a66-523233a66410 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:39.804073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3044d91-95d2-4ae4-9a66-523233a66410 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:39.804547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3044d91-95d2-4ae4-9a66-523233a66410 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:39.806776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3044d91-95d2-4ae4-9a66-523233a66410 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:39.946580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e3044d91-95d2-4ae4-9a66-523233a66410 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:39.958282 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3044d91-95d2-4ae4-9a66-523233a66410 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 200 len: 1226 microversion: 2.1 time: 0.170143 Sep 10 11:12:39.958898 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4004/5688] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:39 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 1226 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:40.468744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:40.469516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:40.486583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:40.487076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:40.487518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:40.488219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:40.488673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:40.489167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:40.504068 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] HTTP exception thrown: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Request method failure captured: Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 HTTP/1.1 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHB84mCWtUjNZCH2AF34UHrkKtxs7AetgIhJfWoQ6tL0tKDPOOL0a12JOobqpWIIWrJhO7NfvVSzcdEvdFq5UJDKUryCzMome2v1J5ZrwqS9hXbaMnWkekNuSdQ0Az68nPLGAaJTky9qjQeg7UPOdpiUm5AYtLr0YugyRneTKdm0niY Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adc08265fd4c43aa822728bd86e1fed1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 2c62573dd17f47fe9dd98200cc04bd23 Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '881d6159-5456-4a2f-98c2-0c3e66109b01'} Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:40.506019 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:40.510578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:40.510578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:40.510578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:40.510578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:40.510578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:40.510578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:40.510578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:12:40.510578 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:40.511907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Returning 404 to user: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:40.512778 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c6f35fdb-bb64-4534-8a3d-4c2e158312d1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 404 len: 111 microversion: 2.20 time: 0.050072 Sep 10 11:12:40.513387 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1685/5689] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:40 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:12:40.522154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f05358e3-24f0-41cb-b395-bb503c17bfc6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '.version_select at 0x7efcae6fe550>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:40.547404 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f05358e3-24f0-41cb-b395-bb503c17bfc6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-771928341" status: 204 len: 0 microversion: 2.20 time: 0.028660 Sep 10 11:12:40.548977 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4005/5690] 10.222.0.20 () {60 vars in 1259 bytes} [Sat Sep 10 11:12:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-771928341 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:12:40.983060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:40.984938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:40.993815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:40.997038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:40.997743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:40.998473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:40.998942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:40.999368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:41.015446 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 HTTP/1.1 Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '9c3c398a-6428-4e59-b945-77f5fafdb729'} Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:12:41.017524 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:41.022300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:12:41.022300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:12:41.022300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:12:41.022300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:12:41.022300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:12:41.022300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:12:41.022300 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:12:41.022300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:12:41.022300 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-13d09020-e82a-4c42-9a14-b1941af7bc9f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 404 len: 111 microversion: 2.1 time: 0.041213 Sep 10 11:12:41.022300 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1686/5691] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:40 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:12:41.152949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1652070468", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1846616331", "security_groups": [{"name": "tempest-secgroup-smoke-153191676"}], "block_device_mapping_v2": [{"uuid": "7dcb8625-23e0-4434-9688-097c2f6562ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e65712d8-efe4-477c-ab8b-0eb50d70eafc"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:41.294585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-320cfc35-9191-4564-b7d8-e452aeca39ce tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Action: 'create', calling method: .version_select at 0x7efcaeb9c700>, body: {"keypair": {"name": "tempest-keypair-1520942628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKTiglRp9MAFR8JBEIjviOCZaLd4pxcnoDLfLEzdRUfzjYT64pxnHfixsuuoW3lg8ScNIClYed18H67zY518b6Z59pBtYHBTr7buLpkDrPgvCBNXeWMwhJxZT71l8tp8Q=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:41.305319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] validate_networks() for [('e65712d8-efe4-477c-ab8b-0eb50d70eafc', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:12:41.310721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-320cfc35-9191-4564-b7d8-e452aeca39ce tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Getting quotas for project adc08265fd4c43aa822728bd86e1fed1. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:12:41.316631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-320cfc35-9191-4564-b7d8-e452aeca39ce tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Getting quotas for user 2c62573dd17f47fe9dd98200cc04bd23 and project adc08265fd4c43aa822728bd86e1fed1. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:12:41.344197 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-320cfc35-9191-4564-b7d8-e452aeca39ce tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053575 Sep 10 11:12:41.345121 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1687/5692] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Sep 10 11:12:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:12:42.179588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:12:42.180092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:12:42.180587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:12:42.181020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:12:42.181552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:12:42.192770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:42.193338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:42.193965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:42.194709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:42.195314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:42.195614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:42.215867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:12:42.222322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for user 78004185356641b990a951dc95e6ca0c and project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:12:42.304264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:12:42.306441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7dcb8625-23e0-4434-9688-097c2f6562ac',volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:12:42.473394 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d352d308-59a7-4936-a016-71ea5dd7215c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.325027 Sep 10 11:12:42.474526 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4006/5693] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:12:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:12:42.487633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4ac15b74-2701-4a01-b98c-b9e78e184918 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:42.488928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4ac15b74-2701-4a01-b98c-b9e78e184918 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:42.576722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4ac15b74-2701-4a01-b98c-b9e78e184918 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:42.586105 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4ac15b74-2701-4a01-b98c-b9e78e184918 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1095 microversion: 2.1 time: 0.103406 Sep 10 11:12:42.586687 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1688/5694] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:42 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:12:43.334024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-260977423", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44c581b5-2ac2-4123-94e1-4b984ff98606"}], "security_groups": [{"name": "tempest-securitygroup--854863906"}], "key_name": "tempest-keypair-1520942628", "user_data": "}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:43.440186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] validate_networks() for [('44c581b5-2ac2-4123-94e1-4b984ff98606', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:12:43.613226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f5a176c8-4857-46cd-a95f-7612c97b7d10 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:43.614469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f5a176c8-4857-46cd-a95f-7612c97b7d10 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:43.630658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a176c8-4857-46cd-a95f-7612c97b7d10 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:43.631805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a176c8-4857-46cd-a95f-7612c97b7d10 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:43.632576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a176c8-4857-46cd-a95f-7612c97b7d10 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:43.633582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a176c8-4857-46cd-a95f-7612c97b7d10 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:43.635360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a176c8-4857-46cd-a95f-7612c97b7d10 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:43.637658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a176c8-4857-46cd-a95f-7612c97b7d10 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:43.770355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f5a176c8-4857-46cd-a95f-7612c97b7d10 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:43.780466 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f5a176c8-4857-46cd-a95f-7612c97b7d10 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1201 microversion: 2.1 time: 0.171121 Sep 10 11:12:43.798135 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1689/5695] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:43 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1201 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:43.946205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:12:43.946655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:12:43.947155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:12:43.947889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:12:43.948332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:12:43.958775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:43.959772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:43.960397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:43.961376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:43.962015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:43.962624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:43.981968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Getting quotas for project adc08265fd4c43aa822728bd86e1fed1. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:12:43.988578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Getting quotas for user 2c62573dd17f47fe9dd98200cc04bd23 and project adc08265fd4c43aa822728bd86e1fed1. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:12:44.003444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:12:44.006299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:12:44.076843 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c4390497-e48a-43a1-b661-3077fae30f75 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.748716 Sep 10 11:12:44.082430 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4007/5696] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Sep 10 11:12:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:12:44.093961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cb0b367b-a8a7-4b97-aaab-537231b9d96b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:44.095559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cb0b367b-a8a7-4b97-aaab-537231b9d96b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:44.193675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cb0b367b-a8a7-4b97-aaab-537231b9d96b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:44.204689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cb0b367b-a8a7-4b97-aaab-537231b9d96b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:44.210936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cb0b367b-a8a7-4b97-aaab-537231b9d96b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:44.216031 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cb0b367b-a8a7-4b97-aaab-537231b9d96b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1281 microversion: 2.20 time: 0.123028 Sep 10 11:12:44.216646 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1690/5697] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:44 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1281 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:12:44.808231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9d9bdf0c-d7cb-4122-95bf-39b5ca3eee31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:44.809125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9d9bdf0c-d7cb-4122-95bf-39b5ca3eee31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:44.829402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d9bdf0c-d7cb-4122-95bf-39b5ca3eee31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:44.830724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d9bdf0c-d7cb-4122-95bf-39b5ca3eee31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:44.831389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d9bdf0c-d7cb-4122-95bf-39b5ca3eee31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:44.832318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d9bdf0c-d7cb-4122-95bf-39b5ca3eee31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:44.832801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d9bdf0c-d7cb-4122-95bf-39b5ca3eee31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:44.833287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9d9bdf0c-d7cb-4122-95bf-39b5ca3eee31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:45.076121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9d9bdf0c-d7cb-4122-95bf-39b5ca3eee31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:45.087200 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9d9bdf0c-d7cb-4122-95bf-39b5ca3eee31 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1278 microversion: 2.1 time: 0.284620 Sep 10 11:12:45.088613 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4008/5698] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:44 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:45.245259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:45.246522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:45.255547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:45.256725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:45.257639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:45.258501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:45.259114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:45.259729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:45.332184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:45.347216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:45.348141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:45.349416 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d64ce918-d668-42ed-a3ba-72498252e409 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1333 microversion: 2.20 time: 0.108486 Sep 10 11:12:45.361094 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1691/5699] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:45 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1333 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:12:45.667715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-be47f425-4299-4ba9-b302-d43058dde5d3 req-acdb0a2e-3692-4f70-beb6-71ad15c26e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52301294-2a27-4b7d-9bf2-41c5594f53a9", "tag": "c73dea59-dfd7-4e75-9cec-9c64481e96b5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:45.710823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-be47f425-4299-4ba9-b302-d43058dde5d3 req-acdb0a2e-3692-4f70-beb6-71ad15c26e9a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:45.714861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-be47f425-4299-4ba9-b302-d43058dde5d3 req-acdb0a2e-3692-4f70-beb6-71ad15c26e9a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:45.717541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-be47f425-4299-4ba9-b302-d43058dde5d3 req-acdb0a2e-3692-4f70-beb6-71ad15c26e9a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:45.764188 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-be47f425-4299-4ba9-b302-d43058dde5d3 req-acdb0a2e-3692-4f70-beb6-71ad15c26e9a service nova] Creating event network-changed:c73dea59-dfd7-4e75-9cec-9c64481e96b5 for instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 on n-h1-856894-1 Sep 10 11:12:45.772909 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-be47f425-4299-4ba9-b302-d43058dde5d3 req-acdb0a2e-3692-4f70-beb6-71ad15c26e9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109356 Sep 10 11:12:45.774451 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4009/5700] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:46.111833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-530370cb-a895-4b61-b829-c9aba2267423 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:46.112742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-530370cb-a895-4b61-b829-c9aba2267423 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:46.120926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-530370cb-a895-4b61-b829-c9aba2267423 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:46.123133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-530370cb-a895-4b61-b829-c9aba2267423 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:46.123753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-530370cb-a895-4b61-b829-c9aba2267423 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:46.128968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-530370cb-a895-4b61-b829-c9aba2267423 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:46.129641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-530370cb-a895-4b61-b829-c9aba2267423 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:46.130234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-530370cb-a895-4b61-b829-c9aba2267423 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:46.377276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:46.378001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:46.392511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:46.393564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:46.394499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:46.395825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:46.396775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:46.397698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:46.417910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-530370cb-a895-4b61-b829-c9aba2267423 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:46.440700 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-530370cb-a895-4b61-b829-c9aba2267423 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1278 microversion: 2.1 time: 0.332531 Sep 10 11:12:46.441986 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1692/5701] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:46 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1278 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:46.523025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:46.534744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:46.536516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:46.538937 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95520fc7-30ec-4392-9336-08a595824270 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1339 microversion: 2.20 time: 0.165971 Sep 10 11:12:46.555646 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4010/5702] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:46 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1339 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:12:47.463773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0368767d-b237-4711-a671-653fbe605091 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:47.467000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0368767d-b237-4711-a671-653fbe605091 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:47.475554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368767d-b237-4711-a671-653fbe605091 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:47.476286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368767d-b237-4711-a671-653fbe605091 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:47.477060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368767d-b237-4711-a671-653fbe605091 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:47.477946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368767d-b237-4711-a671-653fbe605091 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:47.478722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368767d-b237-4711-a671-653fbe605091 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:47.479306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0368767d-b237-4711-a671-653fbe605091 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:47.567931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:47.569412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:47.577096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:47.578140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:47.578979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:47.579744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:47.580222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:47.580678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:47.866182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0368767d-b237-4711-a671-653fbe605091 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:47.874445 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0368767d-b237-4711-a671-653fbe605091 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1278 microversion: 2.1 time: 0.414470 Sep 10 11:12:47.875018 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1693/5703] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:47 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1278 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:47.886140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:47.895907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:47.897624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:47.899455 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2bb68d8-fc64-47f9-ac0c-c902ac7fed61 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1406 microversion: 2.20 time: 0.336026 Sep 10 11:12:47.900200 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4011/5704] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:47 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:12:48.072770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-969fd2bf-79d4-4059-976d-ca2303767b90 req-b60fac95-4be3-4211-a89d-b89691afc38f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54fcc5d6-b26c-46f0-9597-d700cc9af3a6", "tag": "e80c3326-5dd0-4d81-b155-a38fbcc73b75"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:48.114427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-969fd2bf-79d4-4059-976d-ca2303767b90 req-b60fac95-4be3-4211-a89d-b89691afc38f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:48.115184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-969fd2bf-79d4-4059-976d-ca2303767b90 req-b60fac95-4be3-4211-a89d-b89691afc38f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:48.115795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-969fd2bf-79d4-4059-976d-ca2303767b90 req-b60fac95-4be3-4211-a89d-b89691afc38f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:48.142054 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-969fd2bf-79d4-4059-976d-ca2303767b90 req-b60fac95-4be3-4211-a89d-b89691afc38f service nova] Creating event network-changed:e80c3326-5dd0-4d81-b155-a38fbcc73b75 for instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 on n-h2-856894-1 Sep 10 11:12:48.158973 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-969fd2bf-79d4-4059-976d-ca2303767b90 req-b60fac95-4be3-4211-a89d-b89691afc38f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104715 Sep 10 11:12:48.160624 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1694/5705] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:48.897935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14804325-4bba-4602-894c-41443d832eab tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:48.898657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14804325-4bba-4602-894c-41443d832eab tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:48.906023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14804325-4bba-4602-894c-41443d832eab tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:48.906668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14804325-4bba-4602-894c-41443d832eab tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:48.907237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14804325-4bba-4602-894c-41443d832eab tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:48.908041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14804325-4bba-4602-894c-41443d832eab tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:48.910609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14804325-4bba-4602-894c-41443d832eab tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:48.911128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14804325-4bba-4602-894c-41443d832eab tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:48.926629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:48.928044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:48.940992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:48.941648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:48.942082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:48.943051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:48.943555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:48.943909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:49.142211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14804325-4bba-4602-894c-41443d832eab tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:49.153268 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14804325-4bba-4602-894c-41443d832eab tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1278 microversion: 2.1 time: 0.259359 Sep 10 11:12:49.155162 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4012/5706] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:48 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:49.167979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:49.176753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:49.178244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:49.179374 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5714ae8e-00fd-44d9-bcc6-c44ee3fabd0a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1406 microversion: 2.20 time: 0.257978 Sep 10 11:12:49.179945 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1695/5707] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:48 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:12:50.177628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a18785b9-e585-42f1-8517-c2c7fe98d21a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:50.178280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a18785b9-e585-42f1-8517-c2c7fe98d21a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:50.185609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a18785b9-e585-42f1-8517-c2c7fe98d21a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:50.186119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a18785b9-e585-42f1-8517-c2c7fe98d21a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:50.186580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a18785b9-e585-42f1-8517-c2c7fe98d21a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:50.187333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a18785b9-e585-42f1-8517-c2c7fe98d21a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:50.187811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a18785b9-e585-42f1-8517-c2c7fe98d21a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:50.188286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a18785b9-e585-42f1-8517-c2c7fe98d21a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:50.207672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:50.208494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:50.221725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:50.222208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:50.222832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:50.223524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:50.223976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:50.224394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:50.405617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a18785b9-e585-42f1-8517-c2c7fe98d21a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:50.410570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:50.411813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:50.415380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:50.417572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a18785b9-e585-42f1-8517-c2c7fe98d21a tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1266 microversion: 2.1 time: 0.243771 Sep 10 11:12:50.418480 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4013/5708] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:50 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:50.423655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:50.425246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:50.426368 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-91b2337b-4552-44be-a37d-8f17f8a28675 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1406 microversion: 2.20 time: 0.224459 Sep 10 11:12:50.427058 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1696/5709] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:50 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:12:51.454837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-653c09d3-9407-4e29-8eda-2b5ed2bb5c2c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:51.455470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-653c09d3-9407-4e29-8eda-2b5ed2bb5c2c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:51.466359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:51.466970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:51.474296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:51.474780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:51.475211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:51.475899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:51.476347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:51.476765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:51.479629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653c09d3-9407-4e29-8eda-2b5ed2bb5c2c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:51.480160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653c09d3-9407-4e29-8eda-2b5ed2bb5c2c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:51.480662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653c09d3-9407-4e29-8eda-2b5ed2bb5c2c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:51.481351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653c09d3-9407-4e29-8eda-2b5ed2bb5c2c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:51.481822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653c09d3-9407-4e29-8eda-2b5ed2bb5c2c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:51.482264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-653c09d3-9407-4e29-8eda-2b5ed2bb5c2c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:51.720013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-653c09d3-9407-4e29-8eda-2b5ed2bb5c2c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:51.723203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:51.729695 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-653c09d3-9407-4e29-8eda-2b5ed2bb5c2c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1266 microversion: 2.1 time: 0.279677 Sep 10 11:12:51.730550 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4014/5710] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:51 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:51.734521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:51.736625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:51.737896 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4ff533f7-9462-412e-a6fd-deee98625c3a tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1406 microversion: 2.20 time: 0.275740 Sep 10 11:12:51.738556 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1697/5711] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:51 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:12:52.753707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3efbfb39-b095-4ca3-8edf-2e03f3e6d6f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:52.754343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3efbfb39-b095-4ca3-8edf-2e03f3e6d6f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:52.761541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3efbfb39-b095-4ca3-8edf-2e03f3e6d6f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:52.762048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3efbfb39-b095-4ca3-8edf-2e03f3e6d6f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:52.762868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3efbfb39-b095-4ca3-8edf-2e03f3e6d6f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:52.763586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3efbfb39-b095-4ca3-8edf-2e03f3e6d6f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:52.764057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3efbfb39-b095-4ca3-8edf-2e03f3e6d6f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:52.764497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3efbfb39-b095-4ca3-8edf-2e03f3e6d6f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:52.765649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:52.768452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:52.775124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:52.775124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:52.775665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:52.775925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:52.776401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:52.776796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:52.976658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3efbfb39-b095-4ca3-8edf-2e03f3e6d6f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:52.979285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:52.986522 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3efbfb39-b095-4ca3-8edf-2e03f3e6d6f7 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1266 microversion: 2.1 time: 0.237083 Sep 10 11:12:52.988451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:52.990230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:52.991356 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-77e081fb-3515-433b-a3f1-11ccf740fda1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1406 microversion: 2.20 time: 0.230601 Sep 10 11:12:52.991909 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1698/5712] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:52 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:12:53.001685 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4015/5713] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:52 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:53.291073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-87353ba7-671d-4f9a-b4cb-fbbf9d817ea4 req-2dd3342a-e44f-4bec-9e8b-7fd7ec372df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fcc5d6-b26c-46f0-9597-d700cc9af3a6", "name": "network-vif-plugged", "status": "completed", "tag": "e80c3326-5dd0-4d81-b155-a38fbcc73b75"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:53.304280 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-87353ba7-671d-4f9a-b4cb-fbbf9d817ea4 req-2dd3342a-e44f-4bec-9e8b-7fd7ec372df5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:53.304953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-87353ba7-671d-4f9a-b4cb-fbbf9d817ea4 req-2dd3342a-e44f-4bec-9e8b-7fd7ec372df5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:53.305841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-87353ba7-671d-4f9a-b4cb-fbbf9d817ea4 req-2dd3342a-e44f-4bec-9e8b-7fd7ec372df5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:53.319156 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-87353ba7-671d-4f9a-b4cb-fbbf9d817ea4 req-2dd3342a-e44f-4bec-9e8b-7fd7ec372df5 service nova] Creating event network-vif-plugged:e80c3326-5dd0-4d81-b155-a38fbcc73b75 for instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 on n-h2-856894-1 Sep 10 11:12:53.325718 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-87353ba7-671d-4f9a-b4cb-fbbf9d817ea4 req-2dd3342a-e44f-4bec-9e8b-7fd7ec372df5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038614 Sep 10 11:12:53.327239 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1699/5714] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:12:54.010343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9edce486-5624-407f-ad92-2859e916672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:54.010981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9edce486-5624-407f-ad92-2859e916672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:54.014259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:54.015103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:54.018540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:54.019248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:54.021739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9edce486-5624-407f-ad92-2859e916672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:54.022454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9edce486-5624-407f-ad92-2859e916672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:54.022914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9edce486-5624-407f-ad92-2859e916672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:54.023630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9edce486-5624-407f-ad92-2859e916672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:54.024110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9edce486-5624-407f-ad92-2859e916672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:54.024556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9edce486-5624-407f-ad92-2859e916672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:54.026912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:54.027383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:54.028009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:54.028858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:54.029356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:54.029785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:54.197828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:54.228768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9edce486-5624-407f-ad92-2859e916672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:54.236910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:54.237110 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9edce486-5624-407f-ad92-2859e916672d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1266 microversion: 2.1 time: 0.230715 Sep 10 11:12:54.237706 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4016/5715] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:54 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:54.250868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:54.252328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:54.253462 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-69759833-bb14-47ba-9e8f-e2db49bd7869 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1406 microversion: 2.20 time: 0.240335 Sep 10 11:12:54.254025 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1700/5716] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:54 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:12:55.261695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1330903-dda1-48aa-8430-d9bb82f87ba4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:55.262826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1330903-dda1-48aa-8430-d9bb82f87ba4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:55.271343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1330903-dda1-48aa-8430-d9bb82f87ba4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:55.271939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1330903-dda1-48aa-8430-d9bb82f87ba4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:55.272473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1330903-dda1-48aa-8430-d9bb82f87ba4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:55.273306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1330903-dda1-48aa-8430-d9bb82f87ba4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:55.273791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1330903-dda1-48aa-8430-d9bb82f87ba4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:55.274563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1330903-dda1-48aa-8430-d9bb82f87ba4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:55.279319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:55.280577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:55.288164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:55.288985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:55.289533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:55.290306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:55.290865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:55.291360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:55.481484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b1330903-dda1-48aa-8430-d9bb82f87ba4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:55.488867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:55.490841 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1330903-dda1-48aa-8430-d9bb82f87ba4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1266 microversion: 2.1 time: 0.234813 Sep 10 11:12:55.491543 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4017/5717] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:55 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:55.497583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:55.499397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:55.500925 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4783326b-149c-4a1f-9f24-f66183d0348b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1598 microversion: 2.20 time: 0.225343 Sep 10 11:12:55.513168 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1701/5718] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:12:55 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1598 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:12:55.528182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-abf2915e-2cec-43ab-9ed8-2082aa2f9243 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:55.528711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-abf2915e-2cec-43ab-9ed8-2082aa2f9243 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:55.536039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abf2915e-2cec-43ab-9ed8-2082aa2f9243 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:55.536558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abf2915e-2cec-43ab-9ed8-2082aa2f9243 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:55.537544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abf2915e-2cec-43ab-9ed8-2082aa2f9243 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:55.539053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abf2915e-2cec-43ab-9ed8-2082aa2f9243 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:55.539928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abf2915e-2cec-43ab-9ed8-2082aa2f9243 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:55.540757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-abf2915e-2cec-43ab-9ed8-2082aa2f9243 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:55.675214 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-abf2915e-2cec-43ab-9ed8-2082aa2f9243 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151222 Sep 10 11:12:55.675835 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4018/5719] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Sep 10 11:12:55 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:12:56.515423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-079f06aa-0414-4e6e-8894-a63f8e2df8e0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:56.516074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-079f06aa-0414-4e6e-8894-a63f8e2df8e0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:56.523069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-079f06aa-0414-4e6e-8894-a63f8e2df8e0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:56.523556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-079f06aa-0414-4e6e-8894-a63f8e2df8e0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:56.524283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-079f06aa-0414-4e6e-8894-a63f8e2df8e0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:56.525214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-079f06aa-0414-4e6e-8894-a63f8e2df8e0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:56.525659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-079f06aa-0414-4e6e-8894-a63f8e2df8e0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:56.526303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-079f06aa-0414-4e6e-8894-a63f8e2df8e0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:56.988189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ff4cd500-329a-4298-81d1-6def738f863a req-587435e6-4025-4ef4-9688-49e303ce8b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54fcc5d6-b26c-46f0-9597-d700cc9af3a6", "tag": "e80c3326-5dd0-4d81-b155-a38fbcc73b75"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:56.992786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-079f06aa-0414-4e6e-8894-a63f8e2df8e0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:57.002088 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-079f06aa-0414-4e6e-8894-a63f8e2df8e0 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1266 microversion: 2.1 time: 0.490613 Sep 10 11:12:57.006464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ff4cd500-329a-4298-81d1-6def738f863a req-587435e6-4025-4ef4-9688-49e303ce8b1c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:57.007201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ff4cd500-329a-4298-81d1-6def738f863a req-587435e6-4025-4ef4-9688-49e303ce8b1c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:57.007799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ff4cd500-329a-4298-81d1-6def738f863a req-587435e6-4025-4ef4-9688-49e303ce8b1c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:57.019726 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1702/5720] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:56 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1266 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:57.032334 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ff4cd500-329a-4298-81d1-6def738f863a req-587435e6-4025-4ef4-9688-49e303ce8b1c service nova] Creating event network-changed:e80c3326-5dd0-4d81-b155-a38fbcc73b75 for instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 on n-h2-856894-1 Sep 10 11:12:57.038033 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ff4cd500-329a-4298-81d1-6def738f863a req-587435e6-4025-4ef4-9688-49e303ce8b1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054368 Sep 10 11:12:57.039222 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4019/5721] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:12:58.026819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fbcab42e-80ae-4716-a68d-edc1405dcab8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:58.027464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fbcab42e-80ae-4716-a68d-edc1405dcab8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:58.034986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbcab42e-80ae-4716-a68d-edc1405dcab8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:58.035478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbcab42e-80ae-4716-a68d-edc1405dcab8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:58.035915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbcab42e-80ae-4716-a68d-edc1405dcab8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:58.036825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbcab42e-80ae-4716-a68d-edc1405dcab8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:58.037483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbcab42e-80ae-4716-a68d-edc1405dcab8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:58.037923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbcab42e-80ae-4716-a68d-edc1405dcab8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:58.276283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fbcab42e-80ae-4716-a68d-edc1405dcab8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:58.284308 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fbcab42e-80ae-4716-a68d-edc1405dcab8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1266 microversion: 2.1 time: 0.262058 Sep 10 11:12:58.284945 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1703/5722] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:58 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:12:59.310645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0499f6b1-caae-4809-9561-04f04c187235 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:12:59.312465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0499f6b1-caae-4809-9561-04f04c187235 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:12:59.319767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:59.322933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0499f6b1-caae-4809-9561-04f04c187235 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:59.323653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0499f6b1-caae-4809-9561-04f04c187235 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:59.324362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0499f6b1-caae-4809-9561-04f04c187235 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:59.325557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0499f6b1-caae-4809-9561-04f04c187235 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:59.326734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0499f6b1-caae-4809-9561-04f04c187235 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:59.327601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0499f6b1-caae-4809-9561-04f04c187235 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:59.407344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-8376c4f4-da46-438e-9323-74334c49daa2 req-053b6448-6298-4fca-858a-bf0bc6996b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52301294-2a27-4b7d-9bf2-41c5594f53a9", "name": "network-vif-plugged", "status": "completed", "tag": "c73dea59-dfd7-4e75-9cec-9c64481e96b5"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:12:59.422717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:12:59.427707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8376c4f4-da46-438e-9323-74334c49daa2 req-053b6448-6298-4fca-858a-bf0bc6996b21 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:12:59.434945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8376c4f4-da46-438e-9323-74334c49daa2 req-053b6448-6298-4fca-858a-bf0bc6996b21 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:12:59.435896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8376c4f4-da46-438e-9323-74334c49daa2 req-053b6448-6298-4fca-858a-bf0bc6996b21 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:12:59.483590 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-8376c4f4-da46-438e-9323-74334c49daa2 req-053b6448-6298-4fca-858a-bf0bc6996b21 service nova] Creating event network-vif-plugged:c73dea59-dfd7-4e75-9cec-9c64481e96b5 for instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 on n-h1-856894-1 Sep 10 11:12:59.491460 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-8376c4f4-da46-438e-9323-74334c49daa2 req-053b6448-6298-4fca-858a-bf0bc6996b21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090586 Sep 10 11:12:59.499182 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1704/5723] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:12:59.572477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0499f6b1-caae-4809-9561-04f04c187235 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:12:59.583985 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0499f6b1-caae-4809-9561-04f04c187235 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1266 microversion: 2.1 time: 0.279707 Sep 10 11:12:59.586311 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4020/5724] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:12:59 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:13:00.610241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-afda9391-038b-421f-a6d5-bbc384713813 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:00.610936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-afda9391-038b-421f-a6d5-bbc384713813 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:00.617474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afda9391-038b-421f-a6d5-bbc384713813 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:00.617970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afda9391-038b-421f-a6d5-bbc384713813 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:00.618405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afda9391-038b-421f-a6d5-bbc384713813 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:00.619901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afda9391-038b-421f-a6d5-bbc384713813 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:00.620379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afda9391-038b-421f-a6d5-bbc384713813 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:00.621191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-afda9391-038b-421f-a6d5-bbc384713813 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:00.760436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-afda9391-038b-421f-a6d5-bbc384713813 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:00.768602 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-afda9391-038b-421f-a6d5-bbc384713813 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1266 microversion: 2.1 time: 0.164293 Sep 10 11:13:00.769224 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1705/5725] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:13:00 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:13:01.793852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb510b30-61f1-40b9-94c3-375ffe624d7d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:01.794317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb510b30-61f1-40b9-94c3-375ffe624d7d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:01.804745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb510b30-61f1-40b9-94c3-375ffe624d7d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:01.805288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb510b30-61f1-40b9-94c3-375ffe624d7d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:01.806019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb510b30-61f1-40b9-94c3-375ffe624d7d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:01.806758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb510b30-61f1-40b9-94c3-375ffe624d7d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:01.807226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb510b30-61f1-40b9-94c3-375ffe624d7d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:01.807675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb510b30-61f1-40b9-94c3-375ffe624d7d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:01.990038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb510b30-61f1-40b9-94c3-375ffe624d7d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:02.004472 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb510b30-61f1-40b9-94c3-375ffe624d7d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1453 microversion: 2.1 time: 0.216203 Sep 10 11:13:02.018038 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4021/5726] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:13:01 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1453 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:13:02.030520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5f5933ec-1b92-4626-ac78-bc4ee1fc9e9c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:02.032450 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5f5933ec-1b92-4626-ac78-bc4ee1fc9e9c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:02.040839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f5933ec-1b92-4626-ac78-bc4ee1fc9e9c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:02.041655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f5933ec-1b92-4626-ac78-bc4ee1fc9e9c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:02.042300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f5933ec-1b92-4626-ac78-bc4ee1fc9e9c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:02.043294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f5933ec-1b92-4626-ac78-bc4ee1fc9e9c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:02.043953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f5933ec-1b92-4626-ac78-bc4ee1fc9e9c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:02.044569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f5933ec-1b92-4626-ac78-bc4ee1fc9e9c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:02.200898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5f5933ec-1b92-4626-ac78-bc4ee1fc9e9c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:02.209341 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5f5933ec-1b92-4626-ac78-bc4ee1fc9e9c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1453 microversion: 2.1 time: 0.184310 Sep 10 11:13:02.209928 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1706/5727] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:13:02 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:13:04.548259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3e396c99-814a-47fa-874d-7b6f5c043c9e req-11f7b73b-5de0-4a90-8f8b-0db69bcc116f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52301294-2a27-4b7d-9bf2-41c5594f53a9", "tag": "c73dea59-dfd7-4e75-9cec-9c64481e96b5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:13:04.560821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e396c99-814a-47fa-874d-7b6f5c043c9e req-11f7b73b-5de0-4a90-8f8b-0db69bcc116f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:04.561459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e396c99-814a-47fa-874d-7b6f5c043c9e req-11f7b73b-5de0-4a90-8f8b-0db69bcc116f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:04.561930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e396c99-814a-47fa-874d-7b6f5c043c9e req-11f7b73b-5de0-4a90-8f8b-0db69bcc116f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:04.574313 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3e396c99-814a-47fa-874d-7b6f5c043c9e req-11f7b73b-5de0-4a90-8f8b-0db69bcc116f service nova] Creating event network-changed:c73dea59-dfd7-4e75-9cec-9c64481e96b5 for instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 on n-h1-856894-1 Sep 10 11:13:04.583895 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3e396c99-814a-47fa-874d-7b6f5c043c9e req-11f7b73b-5de0-4a90-8f8b-0db69bcc116f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040488 Sep 10 11:13:04.587823 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4022/5728] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:13:33.368661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-76cddb79-c648-4017-8457-98f1589c56b0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:33.369266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-76cddb79-c648-4017-8457-98f1589c56b0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:33.371374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=5 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:13:33.372037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=53 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:13:33.378812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76cddb79-c648-4017-8457-98f1589c56b0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:33.379304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76cddb79-c648-4017-8457-98f1589c56b0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:33.379746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76cddb79-c648-4017-8457-98f1589c56b0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:33.380438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76cddb79-c648-4017-8457-98f1589c56b0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:33.380895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76cddb79-c648-4017-8457-98f1589c56b0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:33.381342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-76cddb79-c648-4017-8457-98f1589c56b0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:33.405403 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-76cddb79-c648-4017-8457-98f1589c56b0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/ips" status: 200 len: 152 microversion: 2.20 time: 0.041290 Sep 10 11:13:33.405990 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1707/5729] 10.222.0.20 () {60 vars in 1289 bytes} [Sat Sep 10 11:13:33 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:13:35.308328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=5 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:13:35.309230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=45 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:13:35.314176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef7f850f-a3ac-4e8b-84a6-5fd6d528dbc1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:13:35.315043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef7f850f-a3ac-4e8b-84a6-5fd6d528dbc1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:35.322356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef7f850f-a3ac-4e8b-84a6-5fd6d528dbc1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:35.323162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef7f850f-a3ac-4e8b-84a6-5fd6d528dbc1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:35.323768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef7f850f-a3ac-4e8b-84a6-5fd6d528dbc1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:35.324634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef7f850f-a3ac-4e8b-84a6-5fd6d528dbc1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:35.325357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef7f850f-a3ac-4e8b-84a6-5fd6d528dbc1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:35.325949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef7f850f-a3ac-4e8b-84a6-5fd6d528dbc1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:35.351213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-ef7f850f-a3ac-4e8b-84a6-5fd6d528dbc1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lazy-loading 'flavor' on Instance uuid 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:13:35.550170 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef7f850f-a3ac-4e8b-84a6-5fd6d528dbc1 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "POST /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/action" status: 202 len: 0 microversion: 2.20 time: 0.243972 Sep 10 11:13:35.550842 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4023/5730] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 11:13:35 2022] POST /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:13:35.559618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:35.560977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:35.568557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:35.569065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:35.569520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:35.570613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:35.571241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:35.571658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:35.920785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:35.929615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:35.931075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:35.932279 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-619eb811-0c3c-4754-879f-53d6be6530b3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.376884 Sep 10 11:13:35.932856 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1708/5731] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:35 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:36.962778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:36.963614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:36.971881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:36.972395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:36.972849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:36.973649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:36.974126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:36.974652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:37.198588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:37.207845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:37.209373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:37.210771 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f16386a8-f9a3-4618-aa24-2da890f8835b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.256008 Sep 10 11:13:37.211348 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4024/5732] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:36 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:38.237776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:38.239012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:38.246230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:38.246723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:38.247156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:38.247862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:38.248311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:38.248914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:38.443743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:38.454227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:38.455686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:38.457091 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-888bf905-f8d2-4044-8142-6a51f17c87eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.223904 Sep 10 11:13:38.457809 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1709/5733] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:38 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:39.487240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:39.488006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:39.495872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:39.496714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:39.497316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:39.500167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:39.500957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:39.501559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:39.651187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:39.661480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:39.663253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:39.665301 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c92d43a5-d7d8-477b-b11b-037932a66712 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.183110 Sep 10 11:13:39.666777 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4025/5734] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:39 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:40.699904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:40.700662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:40.709248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:40.709788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:40.710222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:40.710925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:40.711365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:40.711787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:40.897887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:40.907150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:40.909063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:40.910551 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-39c6112a-85e8-4f4b-bc4b-8dd312848223 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.216487 Sep 10 11:13:40.911730 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1710/5735] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:40 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:41.940343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:41.941776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:41.954044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:41.954965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:41.955716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:41.956967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:41.961867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:41.962540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:42.304116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:42.316351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:42.318590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:42.319928 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90b4d3d9-b805-4a17-99d1-84241bfc6ab5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.386040 Sep 10 11:13:42.320816 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4026/5736] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:41 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:43.355193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:43.356809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:43.372078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:43.372983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:43.373920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:43.375543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:43.376230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:43.377243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:43.644314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:43.659079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:43.664522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:43.667966 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d9b9e6e2-184a-486a-915f-ba08041cd238 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.317074 Sep 10 11:13:43.670041 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1711/5737] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:43 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:44.709450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:44.711008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:44.717692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:44.718642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:44.721896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:44.727562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:44.728543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:44.729262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:45.132358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:45.148266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:45.151837 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:45.155415 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc35b3c7-6268-4af5-ae29-8ff0aa4ed288 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.461552 Sep 10 11:13:45.165283 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4027/5738] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:44 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:46.189123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:46.189748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:46.198244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:46.198970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:46.199656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:46.200366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:46.201040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:46.201643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:46.399284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:46.408467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:46.410007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:46.411177 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7de3661e-7f76-491e-a27a-6bc8e8e038a7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.227620 Sep 10 11:13:46.411739 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1712/5739] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:46 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:47.439932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:47.440574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:47.449910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:47.450868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:47.451657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:47.453163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:47.453858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:47.454528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:47.741111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:47.752367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:47.754174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:47.755425 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a3e8b5e7-f391-44d4-8edc-ee09975cbccd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.320321 Sep 10 11:13:47.756561 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4028/5740] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:47 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:48.785637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:48.786258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:48.795324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:48.796662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:48.797576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:48.798913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:48.799545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:48.800709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:49.005603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:49.015605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:49.022855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:49.029530 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e82bec9a-76f1-4803-84ce-a14895006d6f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.248719 Sep 10 11:13:49.033132 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1713/5741] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:48 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:50.074290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:50.076332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:50.087985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:50.088965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:50.089648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:50.091110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:50.091762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:50.092369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:50.328115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:50.342049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:50.344551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:50.346051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b1368e4-cdc5-4cf7-8f41-a9cf480f9fa9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.277905 Sep 10 11:13:50.347170 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4029/5742] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:50 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:51.375732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:51.376349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:51.383642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:51.383957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:51.384396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:51.385137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:51.385810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:51.387806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:51.529556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:51.537846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:51.539589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:51.540761 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bdc4112c-1a17-41e4-88a6-982491c78a62 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1744 microversion: 2.20 time: 0.169653 Sep 10 11:13:51.541367 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1714/5743] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:51 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:52.568431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:52.569120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:52.577820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:52.578324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:52.578904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:52.579706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:52.580358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:52.580810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:52.728563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:52.737829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:52.739470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:52.740726 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-584eb45c-c9cd-4d45-ad8f-01a6a000b342 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1744 microversion: 2.20 time: 0.176419 Sep 10 11:13:52.742689 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4030/5744] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:52 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:13:53.769231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:53.769781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:53.791853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:53.792452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:53.792911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:53.793792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:53.794258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:53.794689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:53.981386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:53.991712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:53.993703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:53.995143 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5f6e6a53-32cc-46f6-b84c-5f083e059a56 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1739 microversion: 2.20 time: 0.231772 Sep 10 11:13:54.009588 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1715/5745] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:53 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:55.022338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:55.023785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:55.040898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:55.043519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:55.044270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:55.045444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:55.047415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:55.049439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:55.437273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:55.447466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:55.448952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:55.451188 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4cbca7e1-b77d-456f-b02b-34e1c5708878 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1739 microversion: 2.20 time: 0.433171 Sep 10 11:13:55.452113 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4031/5746] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:55 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1739 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:55.652364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-1404cbcd-f2a1-415b-9ad2-1936490d5a38 req-5239b964-629f-4f4e-8191-f824b50c4341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fcc5d6-b26c-46f0-9597-d700cc9af3a6", "name": "network-vif-plugged", "status": "completed", "tag": "e80c3326-5dd0-4d81-b155-a38fbcc73b75"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:13:55.672049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1404cbcd-f2a1-415b-9ad2-1936490d5a38 req-5239b964-629f-4f4e-8191-f824b50c4341 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:55.673540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1404cbcd-f2a1-415b-9ad2-1936490d5a38 req-5239b964-629f-4f4e-8191-f824b50c4341 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:55.674157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1404cbcd-f2a1-415b-9ad2-1936490d5a38 req-5239b964-629f-4f4e-8191-f824b50c4341 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:55.702533 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-1404cbcd-f2a1-415b-9ad2-1936490d5a38 req-5239b964-629f-4f4e-8191-f824b50c4341 service nova] Creating event network-vif-plugged:e80c3326-5dd0-4d81-b155-a38fbcc73b75 for instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 on n-h2-856894-1 Sep 10 11:13:55.723748 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-1404cbcd-f2a1-415b-9ad2-1936490d5a38 req-5239b964-629f-4f4e-8191-f824b50c4341 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075302 Sep 10 11:13:55.724366 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1716/5747] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:13:56.477686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:56.478325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:56.486200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:56.487031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:56.487717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:56.488681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:56.489298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:56.489813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:56.700560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:56.738485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:56.740243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:56.741602 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f89532a-311c-4de2-8c4f-f6c05399c876 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1739 microversion: 2.20 time: 0.267932 Sep 10 11:13:56.742809 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4032/5748] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:56 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:57.774455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:57.775828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:57.788610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:57.790967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:57.791606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:57.792497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:57.796471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:57.797160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:58.206761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:58.215310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:58.216810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:58.218080 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3557470d-7586-4b59-9aa6-739764f4dd43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1739 microversion: 2.20 time: 0.449229 Sep 10 11:13:58.218874 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1717/5749] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:57 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1739 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:13:59.250175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:13:59.252273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:13:59.267548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:59.270808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:59.271844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:59.274005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:13:59.275758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:13:59.276387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:13:59.519756 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:59.528487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:59.530627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:13:59.531858 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae8319dc-323c-4eb6-92e7-29475eebc011 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1739 microversion: 2.20 time: 0.287827 Sep 10 11:13:59.541982 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4033/5750] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:13:59 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:00.559010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:00.559636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:00.593747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:00.593747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:00.593747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:00.593747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:00.593747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:00.593747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:00.874443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:00.884161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:00.885829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:00.887186 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a7f5ba38-0895-4909-b0fe-85d2a0d0d63f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1739 microversion: 2.20 time: 0.332219 Sep 10 11:14:00.888241 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1718/5751] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:00 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:01.916986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:01.919047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:01.940605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:01.941138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:01.941594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:01.942421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:01.942892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:01.943981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:02.415829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:02.441393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:02.441393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:02.441393 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74283f8b-8173-4ef7-b300-45a1316a2c31 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1739 microversion: 2.20 time: 0.526064 Sep 10 11:14:02.441393 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4034/5752] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:01 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1739 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:03.472762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:03.474733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:03.479785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=25 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:03.493046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:03.495206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:03.496516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:03.501323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:03.502135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:03.502779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:03.559229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=67 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:04.170649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:04.180558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:04.187069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:04.188456 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-272b3ce3-0f85-433b-b490-5e02085a8d28 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1739 microversion: 2.20 time: 0.721390 Sep 10 11:14:04.189143 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1719/5753] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:03 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1739 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:05.216378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:05.217752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:05.224608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:05.225158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:05.225626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:05.226388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:05.226870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:05.227319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:05.380301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:05.382749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:05.390826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:05.392383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:05.393671 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7047d2e6-9aaf-44ec-9c88-c7c5118b154e tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1739 microversion: 2.20 time: 0.181772 Sep 10 11:14:05.394254 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4035/5754] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:05 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:06.419505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:06.420234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:06.427509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:06.427992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:06.428419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:06.429156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:06.429603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:06.430146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:06.568972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:06.578656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:06.580103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:06.581298 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-94dfb6be-a63d-40a3-b1ae-4d761f96f1ea tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1721 microversion: 2.20 time: 0.165685 Sep 10 11:14:06.581863 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1720/5755] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:06 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:07.608415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:07.609050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:07.612323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=27 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:07.618796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:07.619300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:07.619755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:07.620471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:07.620946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:07.621422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:07.936436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:07.944699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:07.946197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:07.947391 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c9575690-349f-4ce4-9c5c-f36ebf5feab6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1721 microversion: 2.20 time: 0.343593 Sep 10 11:14:07.947977 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4036/5756] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:07 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:08.973053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:08.973678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:08.980363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:08.980837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:08.981305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:08.981989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:08.982436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:08.982866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:09.116541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:09.125163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:09.126799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:09.127899 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-00abd49e-4017-4ea2-a123-45dfc145b7dd tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1664 microversion: 2.20 time: 0.158785 Sep 10 11:14:09.128465 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1721/5757] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:08 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:09.155238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb697c93-41f6-4635-bdb3-8b516224fedf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cbeb2b2-8b54-46cc-84b1-a91c0546a6c0"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:14:09.158134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb697c93-41f6-4635-bdb3-8b516224fedf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:09.166057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb697c93-41f6-4635-bdb3-8b516224fedf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:09.166818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb697c93-41f6-4635-bdb3-8b516224fedf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:09.167473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb697c93-41f6-4635-bdb3-8b516224fedf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:09.168394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb697c93-41f6-4635-bdb3-8b516224fedf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:09.169027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb697c93-41f6-4635-bdb3-8b516224fedf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:09.169497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb697c93-41f6-4635-bdb3-8b516224fedf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:09.482366 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb697c93-41f6-4635-bdb3-8b516224fedf tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "POST /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331772 Sep 10 11:14:09.483748 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4037/5758] 10.222.0.20 () {62 vars in 1364 bytes} [Sat Sep 10 11:14:09 2022] POST /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:14:09.591047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-0f2a538c-bc22-4672-b060-4b20e0cb32a8 req-9892968a-579b-454b-ad4b-bebf4f6512c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fcc5d6-b26c-46f0-9597-d700cc9af3a6", "name": "network-vif-unplugged", "status": "completed", "tag": "e80c3326-5dd0-4d81-b155-a38fbcc73b75"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:14:09.613306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0f2a538c-bc22-4672-b060-4b20e0cb32a8 req-9892968a-579b-454b-ad4b-bebf4f6512c7 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:09.613904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0f2a538c-bc22-4672-b060-4b20e0cb32a8 req-9892968a-579b-454b-ad4b-bebf4f6512c7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:09.614508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0f2a538c-bc22-4672-b060-4b20e0cb32a8 req-9892968a-579b-454b-ad4b-bebf4f6512c7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:09.621190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3c109016-3a05-4523-8b3c-e5d0c757633c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:09.622019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3c109016-3a05-4523-8b3c-e5d0c757633c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:09.629667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c109016-3a05-4523-8b3c-e5d0c757633c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:09.630476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c109016-3a05-4523-8b3c-e5d0c757633c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:09.631140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c109016-3a05-4523-8b3c-e5d0c757633c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:09.631442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.compute.server_external_events [req-0f2a538c-bc22-4672-b060-4b20e0cb32a8 req-9892968a-579b-454b-ad4b-bebf4f6512c7 service nova] Unable to find a host for instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6. Dropping event network-vif-unplugged {{(pid=128787) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 11:14:09.632356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c109016-3a05-4523-8b3c-e5d0c757633c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:09.632782 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-0f2a538c-bc22-4672-b060-4b20e0cb32a8 req-9892968a-579b-454b-ad4b-bebf4f6512c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048024 Sep 10 11:14:09.633305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c109016-3a05-4523-8b3c-e5d0c757633c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:09.633975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3c109016-3a05-4523-8b3c-e5d0c757633c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:09.634298 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1722/5759] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 11:14:09.879870 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3c109016-3a05-4523-8b3c-e5d0c757633c tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/os-volume_attachments/3cbeb2b2-8b54-46cc-84b1-a91c0546a6c0" status: 202 len: 0 microversion: 2.20 time: 0.263186 Sep 10 11:14:09.880452 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4038/5760] 10.222.0.20 () {60 vars in 1457 bytes} [Sat Sep 10 11:14:09 2022] DELETE /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/os-volume_attachments/3cbeb2b2-8b54-46cc-84b1-a91c0546a6c0 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:14:09.942827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e43749cd-3706-434d-938e-859eb8ce5704 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:14:09.943419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e43749cd-3706-434d-938e-859eb8ce5704 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:09.949339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43749cd-3706-434d-938e-859eb8ce5704 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:09.949819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43749cd-3706-434d-938e-859eb8ce5704 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:09.950251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43749cd-3706-434d-938e-859eb8ce5704 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:09.950933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43749cd-3706-434d-938e-859eb8ce5704 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:09.951400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43749cd-3706-434d-938e-859eb8ce5704 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:09.952361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e43749cd-3706-434d-938e-859eb8ce5704 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:09.994596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e43749cd-3706-434d-938e-859eb8ce5704 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128787) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 11:14:10.074176 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e43749cd-3706-434d-938e-859eb8ce5704 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "POST /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/action" status: 202 len: 0 microversion: 2.20 time: 0.135099 Sep 10 11:14:10.074677 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1723/5761] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Sep 10 11:14:09 2022] POST /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:14:10.083545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:10.084427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:10.100203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:10.100659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:10.101139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:10.101862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:10.102340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:10.102782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:10.291868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:10.302566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:10.304333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:10.306183 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b9be9f8-38ef-4b10-97bb-ba16539313ef tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1672 microversion: 2.20 time: 0.226087 Sep 10 11:14:10.306763 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4039/5762] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:10 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1672 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:11.332515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:11.333157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:11.344197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:11.344415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:11.344826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:11.345601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:11.346065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:11.346497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:11.491756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:11.500871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:11.502386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:11.503572 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2bc9edae-134f-40d7-8d53-5cb52675911f tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.175093 Sep 10 11:14:11.504147 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1724/5763] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:11 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:12.186934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-73f739ab-ebe0-4980-acfb-ca2a6afe6962 req-ac409475-7402-4bb9-aa1b-00b1319d4cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54fcc5d6-b26c-46f0-9597-d700cc9af3a6", "tag": "e80c3326-5dd0-4d81-b155-a38fbcc73b75"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:14:12.198872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-73f739ab-ebe0-4980-acfb-ca2a6afe6962 req-ac409475-7402-4bb9-aa1b-00b1319d4cfd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:12.199447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-73f739ab-ebe0-4980-acfb-ca2a6afe6962 req-ac409475-7402-4bb9-aa1b-00b1319d4cfd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:12.199988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-73f739ab-ebe0-4980-acfb-ca2a6afe6962 req-ac409475-7402-4bb9-aa1b-00b1319d4cfd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:12.234912 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-73f739ab-ebe0-4980-acfb-ca2a6afe6962 req-ac409475-7402-4bb9-aa1b-00b1319d4cfd service nova] Creating event network-changed:e80c3326-5dd0-4d81-b155-a38fbcc73b75 for instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 on n-h1-856894-1 Sep 10 11:14:12.246376 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-73f739ab-ebe0-4980-acfb-ca2a6afe6962 req-ac409475-7402-4bb9-aa1b-00b1319d4cfd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063727 Sep 10 11:14:12.247258 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4040/5764] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:14:12.531613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:12.533108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:12.540836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:12.541826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:12.542503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:12.543348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:12.543955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:12.544663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:12.742975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:12.752767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:12.754700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:12.756157 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0dc0317d-ed3a-4644-9817-6bdce533c7eb tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.229301 Sep 10 11:14:12.757291 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1725/5765] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:12 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:13.784059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:13.785938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:13.799821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:13.800686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:13.801442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:13.802457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:13.803176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:13.803945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:13.975176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:13.988720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:13.990240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:13.998677 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7cad52ca-63e9-4996-99e8-680df0870a82 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.213384 Sep 10 11:14:13.999957 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4041/5766] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:13 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:14:15.027711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:15.028508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:15.036001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:15.036497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:15.036940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:15.037703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:15.038160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:15.038764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:15.238592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:15.253602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:15.260388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:15.261873 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a901edb7-fc26-487c-ba2d-d0482e3a7fe9 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.238028 Sep 10 11:14:15.262448 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1726/5767] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:15 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:16.288640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:16.290423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:16.298704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:16.299426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:16.300189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:16.301016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:16.301759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:16.302422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:16.455880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:16.464522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:16.466312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:16.468154 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5cd17fc8-c55e-4bba-8c41-d735bc4bcbe6 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.183955 Sep 10 11:14:16.483600 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4042/5768] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:16 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:17.494259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:17.495603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:17.507787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:17.508637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:17.509351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:17.510397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:17.511281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:17.512385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:17.709384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:17.720052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:17.721848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:17.723256 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f50a09e0-6f5e-4b54-8b52-b33ee5427ef3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.233261 Sep 10 11:14:17.723821 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1727/5769] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:17 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:18.752711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:18.753473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:18.761180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:18.762081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:18.762567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:18.763405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:18.763856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:18.764348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:18.918624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:18.929657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:18.931136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:18.932429 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8d20baa7-6657-4771-bffc-d38a643f9cf4 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.185974 Sep 10 11:14:18.933130 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4043/5770] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:18 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:19.959266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:19.959979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:19.966856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:19.967369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:19.967817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:19.968518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:19.968976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:19.969448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:20.119963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:20.129165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:20.130617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:20.132101 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c5d2bcbc-4f4a-424f-a1c0-43b54d254a8d tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.177155 Sep 10 11:14:20.145110 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1728/5771] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:19 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:21.158423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:21.158968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:21.166427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:21.166928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:21.167382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:21.168084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:21.168551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:21.168992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:21.305459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:21.314260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:21.315728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:21.316913 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a4f7fb50-4cb5-4381-97ec-68b9a8213b38 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.162662 Sep 10 11:14:21.317526 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4044/5772] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:21 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:22.344383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:22.345228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:22.352200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:22.352780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:22.353325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:22.354026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:22.354476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:22.354936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:22.485937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:22.494417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:22.496035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:22.497350 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f62fe399-5f83-455c-bf8b-4c7880e49b43 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.157131 Sep 10 11:14:22.498914 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1729/5773] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:22 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:23.523933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:23.524745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:23.533799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:23.534327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:23.534795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:23.535549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:23.536175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:23.536628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:23.692535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:23.702614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:23.704388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:23.705931 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4ab56d1f-1132-4302-8c24-6a388cfd32db tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.186473 Sep 10 11:14:23.725269 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4045/5774] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:23 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:24.734213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:24.734829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:24.741622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:24.742109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:24.742753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:24.743451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:24.743909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:24.744377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:24.943018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:24.953223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:24.955557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:24.957209 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cb759267-ff4d-484b-a232-617bf30ee093 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.226922 Sep 10 11:14:24.958434 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1730/5775] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:24 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:14:25.792195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-bbc7a04e-2779-47cb-b968-6fd5b3fe14e8 req-8b462d3d-e0c8-4453-adef-f13adb4f34e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fcc5d6-b26c-46f0-9597-d700cc9af3a6", "name": "network-vif-plugged", "status": "completed", "tag": "e80c3326-5dd0-4d81-b155-a38fbcc73b75"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:14:25.808109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bbc7a04e-2779-47cb-b968-6fd5b3fe14e8 req-8b462d3d-e0c8-4453-adef-f13adb4f34e3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:25.808888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bbc7a04e-2779-47cb-b968-6fd5b3fe14e8 req-8b462d3d-e0c8-4453-adef-f13adb4f34e3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:25.809497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-bbc7a04e-2779-47cb-b968-6fd5b3fe14e8 req-8b462d3d-e0c8-4453-adef-f13adb4f34e3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:25.822482 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-bbc7a04e-2779-47cb-b968-6fd5b3fe14e8 req-8b462d3d-e0c8-4453-adef-f13adb4f34e3 service nova] Creating event network-vif-plugged:e80c3326-5dd0-4d81-b155-a38fbcc73b75 for instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 on n-h1-856894-1 Sep 10 11:14:25.828061 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-bbc7a04e-2779-47cb-b968-6fd5b3fe14e8 req-8b462d3d-e0c8-4453-adef-f13adb4f34e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041632 Sep 10 11:14:25.828900 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4046/5776] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:14:25.984240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:25.984824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:25.991814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:25.992295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:25.992731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:25.993464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:25.993903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:25.994344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:26.142321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:26.150518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:26.152090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:26.153120 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c2b3bc53-dd94-4645-bf0b-cd4a9ecab8b5 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.172858 Sep 10 11:14:26.153685 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1731/5777] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:25 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:27.181258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:27.182086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:27.188873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:27.189577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:27.190215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:27.191099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:27.191574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:27.192216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:27.356254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:27.369443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:27.371288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:27.372562 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7e2ea21a-2b66-4d9a-bc4c-3536669dc7e0 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1730 microversion: 2.20 time: 0.196541 Sep 10 11:14:27.373484 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4047/5778] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:27 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:28.398635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:28.399237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:28.406299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:28.406780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:28.407213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:28.407904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:28.408359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:28.408978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:28.551464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:28.559755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:28.561290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:28.562464 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-786fa07a-89f7-40fb-b979-bfd06704d163 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1717 microversion: 2.20 time: 0.167770 Sep 10 11:14:28.563031 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1732/5779] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:14:28 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:14:30.270257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a192961-8e0c-4659-b80c-487b88b89d66 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:30.270772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1a192961-8e0c-4659-b80c-487b88b89d66 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:30.276852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a192961-8e0c-4659-b80c-487b88b89d66 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:30.277386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a192961-8e0c-4659-b80c-487b88b89d66 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:30.277838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a192961-8e0c-4659-b80c-487b88b89d66 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:30.278538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a192961-8e0c-4659-b80c-487b88b89d66 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:30.279003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a192961-8e0c-4659-b80c-487b88b89d66 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:30.279479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a192961-8e0c-4659-b80c-487b88b89d66 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:30.298875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:30.307420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1a192961-8e0c-4659-b80c-487b88b89d66 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:14:30.388047 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a192961-8e0c-4659-b80c-487b88b89d66 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 204 len: 0 microversion: 2.1 time: 0.371159 Sep 10 11:14:30.388906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4048/5780] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:14:30 2022] DELETE /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:14:30.397622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bb16d51a-87f7-4d84-8a93-7378ecf793ee tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:30.398391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bb16d51a-87f7-4d84-8a93-7378ecf793ee tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:30.405985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb16d51a-87f7-4d84-8a93-7378ecf793ee tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:30.406468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb16d51a-87f7-4d84-8a93-7378ecf793ee tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:30.406934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb16d51a-87f7-4d84-8a93-7378ecf793ee tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:30.407625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb16d51a-87f7-4d84-8a93-7378ecf793ee tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:30.408081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb16d51a-87f7-4d84-8a93-7378ecf793ee tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:30.408505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bb16d51a-87f7-4d84-8a93-7378ecf793ee tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:30.546322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bb16d51a-87f7-4d84-8a93-7378ecf793ee tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:30.554228 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bb16d51a-87f7-4d84-8a93-7378ecf793ee tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1732 microversion: 2.1 time: 0.160824 Sep 10 11:14:30.555175 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1733/5781] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:30 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:31.577913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3d1c90fb-8bb7-4f8b-b6fb-cfd4386e00f0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:31.578687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3d1c90fb-8bb7-4f8b-b6fb-cfd4386e00f0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:31.585890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1c90fb-8bb7-4f8b-b6fb-cfd4386e00f0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:31.586367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1c90fb-8bb7-4f8b-b6fb-cfd4386e00f0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:31.586840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1c90fb-8bb7-4f8b-b6fb-cfd4386e00f0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:31.588320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1c90fb-8bb7-4f8b-b6fb-cfd4386e00f0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:31.588970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1c90fb-8bb7-4f8b-b6fb-cfd4386e00f0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:31.589521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3d1c90fb-8bb7-4f8b-b6fb-cfd4386e00f0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:31.733378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3d1c90fb-8bb7-4f8b-b6fb-cfd4386e00f0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:31.742725 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3d1c90fb-8bb7-4f8b-b6fb-cfd4386e00f0 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1732 microversion: 2.1 time: 0.169148 Sep 10 11:14:31.743326 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4049/5782] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:31 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:32.698592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7ee3ca7e-cf21-4f34-b693-3587292f3e2c req-6f5ab168-c74b-4536-9756-67d790f434e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0828a95e-ab0c-46cf-b8e4-ebbcd16f0311", "name": "network-vif-deleted", "tag": "9eadaa63-1be2-47a3-a6ab-8dc69087bda1"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:14:32.713449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7ee3ca7e-cf21-4f34-b693-3587292f3e2c req-6f5ab168-c74b-4536-9756-67d790f434e9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:32.713978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7ee3ca7e-cf21-4f34-b693-3587292f3e2c req-6f5ab168-c74b-4536-9756-67d790f434e9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:32.714404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7ee3ca7e-cf21-4f34-b693-3587292f3e2c req-6f5ab168-c74b-4536-9756-67d790f434e9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:32.729493 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7ee3ca7e-cf21-4f34-b693-3587292f3e2c req-6f5ab168-c74b-4536-9756-67d790f434e9 service nova] Creating event network-vif-deleted:9eadaa63-1be2-47a3-a6ab-8dc69087bda1 for instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 on n-h2-856894-1 Sep 10 11:14:32.735158 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-7ee3ca7e-cf21-4f34-b693-3587292f3e2c req-6f5ab168-c74b-4536-9756-67d790f434e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040142 Sep 10 11:14:32.735758 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1734/5783] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:14:32.765984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ba90c650-bfa4-47be-9551-8a83b55ca411 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:32.767211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ba90c650-bfa4-47be-9551-8a83b55ca411 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:32.775251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba90c650-bfa4-47be-9551-8a83b55ca411 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:32.776005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba90c650-bfa4-47be-9551-8a83b55ca411 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:32.776664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba90c650-bfa4-47be-9551-8a83b55ca411 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:32.777695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba90c650-bfa4-47be-9551-8a83b55ca411 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:32.778387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba90c650-bfa4-47be-9551-8a83b55ca411 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:32.779050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba90c650-bfa4-47be-9551-8a83b55ca411 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:32.862729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ba90c650-bfa4-47be-9551-8a83b55ca411 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55485ee5ef694329bd808aba72abdf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e591cc2fea57479a945f0baa4a3016c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:32.872317 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ba90c650-bfa4-47be-9551-8a83b55ca411 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 200 len: 1382 microversion: 2.1 time: 0.110210 Sep 10 11:14:32.873769 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4050/5784] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:32 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 1382 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:33.898073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:33.899491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:33.906544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:33.909623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:33.910500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:33.911175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:33.912104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:33.912770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:33.913428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:33.919732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:33.936001 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] HTTP exception thrown: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Request method failure captured: Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 HTTP/1.1 Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHBMmD9v0X3m5FlZidK0O_v24mYUQUEG15aBATU-5zUGLMBjcskk0xdXaJpQtnmSRXjPjSe4i23HbzJ8HBmSBmod8kvNTCYgOBSCbPAIlNoj8QjL1PsGHmgxeLMRDztIWyKbi8OIusyGm4AXCsizls2AzM0G5Os0btKjWhD_3d_YaUo Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: e591cc2fea57479a945f0baa4a3016c3 Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestServerBasicOps-1795698735 Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e591cc2fea57479a945f0baa4a3016c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e591cc2fea57479a945f0baa4a3016c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e591cc2fea57479a945f0baa4a3016c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e591cc2fea57479a945f0baa4a3016c3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestServerBasicOps-1795698735 Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: e591cc2fea57479a945f0baa4a3016c3 Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestServerBasicOps-1795698735 Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestServerBasicOps-1795698735-project Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 55485ee5ef694329bd808aba72abdf63 Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestServerBasicOps-1795698735-project Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '0828a95e-ab0c-46cf-b8e4-ebbcd16f0311'} Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:14:33.938124 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:14:33.942197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:14:33.942197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:14:33.942197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:14:33.942197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:14:33.942197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:14:33.942197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:33.942197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:14:33.944082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Returning 404 to user: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:14:33.945231 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6523567e-cb3f-406b-bfdc-4395ba8854dd tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 404 len: 111 microversion: 2.1 time: 0.051493 Sep 10 11:14:33.946386 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1735/5785] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:33 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:14:34.459964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:34.460491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:34.468708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:34.469380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:34.469842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:34.470558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:34.471035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:34.471483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:34.485620 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] HTTP exception thrown: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Request method failure captured: Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 HTTP/1.1 Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHBMmD9v0X3m5FlZidK0O_v24mYUQUEG15aBATU-5zUGLMBjcskk0xdXaJpQtnmSRXjPjSe4i23HbzJ8HBmSBmod8kvNTCYgOBSCbPAIlNoj8QjL1PsGHmgxeLMRDztIWyKbi8OIusyGm4AXCsizls2AzM0G5Os0btKjWhD_3d_YaUo Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: e591cc2fea57479a945f0baa4a3016c3 Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestServerBasicOps-1795698735 Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e591cc2fea57479a945f0baa4a3016c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e591cc2fea57479a945f0baa4a3016c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e591cc2fea57479a945f0baa4a3016c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e591cc2fea57479a945f0baa4a3016c3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestServerBasicOps-1795698735 Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: e591cc2fea57479a945f0baa4a3016c3 Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestServerBasicOps-1795698735 Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestServerBasicOps-1795698735-project Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 55485ee5ef694329bd808aba72abdf63 Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestServerBasicOps-1795698735-project Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '0828a95e-ab0c-46cf-b8e4-ebbcd16f0311'} Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:14:34.487515 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Returning 404 to user: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c60bd99c-5f5c-47dd-8469-a28936afcbb3 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 404 len: 111 microversion: 2.1 time: 0.033071 Sep 10 11:14:34.495312 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4051/5786] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:14:34 2022] DELETE /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:14:34.497731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:34.498354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] [instance: 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:34.505177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:34.505658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:34.506089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:34.506772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:34.507221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:34.507641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:34.522578 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] HTTP exception thrown: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Request method failure captured: Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 HTTP/1.1 Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHBMmD9v0X3m5FlZidK0O_v24mYUQUEG15aBATU-5zUGLMBjcskk0xdXaJpQtnmSRXjPjSe4i23HbzJ8HBmSBmod8kvNTCYgOBSCbPAIlNoj8QjL1PsGHmgxeLMRDztIWyKbi8OIusyGm4AXCsizls2AzM0G5Os0btKjWhD_3d_YaUo Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: e591cc2fea57479a945f0baa4a3016c3 Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestServerBasicOps-1795698735 Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e591cc2fea57479a945f0baa4a3016c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e591cc2fea57479a945f0baa4a3016c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e591cc2fea57479a945f0baa4a3016c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e591cc2fea57479a945f0baa4a3016c3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestServerBasicOps-1795698735 Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: e591cc2fea57479a945f0baa4a3016c3 Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestServerBasicOps-1795698735 Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestServerBasicOps-1795698735-project Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 55485ee5ef694329bd808aba72abdf63 Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestServerBasicOps-1795698735-project Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '0828a95e-ab0c-46cf-b8e4-ebbcd16f0311'} Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:14:34.524146 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:14:34.532635 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:14:34.532635 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:14:34.532635 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:14:34.532635 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:14:34.532635 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:14:34.532635 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. Sep 10 11:14:34.532635 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:14:34.532635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Returning 404 to user: Instance 0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:14:34.532635 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8280ea26-66d3-45bf-89b2-e6998d403e57 tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311" status: 404 len: 111 microversion: 2.1 time: 0.031642 Sep 10 11:14:34.532635 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1736/5787] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:34 2022] GET /compute/v2.1/servers/0828a95e-ab0c-46cf-b8e4-ebbcd16f0311 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:14:34.719526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-360ff8f1-875d-4ded-ab56-8ac356e9271c tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] Calling method '.version_select at 0x7efcae6dbd30>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:34.756579 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-360ff8f1-875d-4ded-ab56-8ac356e9271c tempest-TestServerBasicOps-1795698735 tempest-TestServerBasicOps-1795698735-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-122673789" status: 202 len: 0 microversion: 2.1 time: 0.040936 Sep 10 11:14:34.758492 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4052/5788] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Sep 10 11:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-122673789 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:14:47.568644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-516909788", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1846616331", "security_groups": [{"name": "tempest-secgroup-smoke-153191676"}], "block_device_mapping_v2": [{"uuid": "92d410f0-e94c-4540-8060-5096e427ccd2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e65712d8-efe4-477c-ab8b-0eb50d70eafc"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:14:47.580414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:47.581179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:47.689935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] validate_networks() for [('e65712d8-efe4-477c-ab8b-0eb50d70eafc', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:14:48.116490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:14:48.116919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:14:48.117431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:14:48.117999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:14:48.118421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:14:48.128339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:48.128748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:48.129531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:48.130265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:48.130718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:48.131332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:48.150030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:14:48.155319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Getting quotas for user 78004185356641b990a951dc95e6ca0c and project 86907574971943a2b584ef3fecdb5965. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:14:48.215239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:14:48.217491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92d410f0-e94c-4540-8060-5096e427ccd2',volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:14:48.352898 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0dff4d74-9b15-46e5-ab3c-e4aa81ad9e3b tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.788055 Sep 10 11:14:48.354284 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1737/5789] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:14:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:14:48.364057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:48.366066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:48.373695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bb57ba61-304f-46fd-ada4-2a18491695c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:48.375253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bb57ba61-304f-46fd-ada4-2a18491695c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:48.440552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bb57ba61-304f-46fd-ada4-2a18491695c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:48.447874 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bb57ba61-304f-46fd-ada4-2a18491695c8 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1094 microversion: 2.1 time: 0.086698 Sep 10 11:14:48.448455 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4053/5790] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:48 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:14:49.472459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a021e101-44c5-49d3-ae3d-cb4aee51606d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:49.473055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a021e101-44c5-49d3-ae3d-cb4aee51606d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:49.482833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a021e101-44c5-49d3-ae3d-cb4aee51606d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:49.483333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a021e101-44c5-49d3-ae3d-cb4aee51606d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:49.483861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a021e101-44c5-49d3-ae3d-cb4aee51606d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:49.484600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a021e101-44c5-49d3-ae3d-cb4aee51606d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:49.485059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a021e101-44c5-49d3-ae3d-cb4aee51606d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:49.486295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a021e101-44c5-49d3-ae3d-cb4aee51606d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:49.563260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a021e101-44c5-49d3-ae3d-cb4aee51606d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:49.572852 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a021e101-44c5-49d3-ae3d-cb4aee51606d tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1200 microversion: 2.1 time: 0.105202 Sep 10 11:14:49.573688 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1738/5791] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:49 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1200 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:50.596320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-863663b4-291f-49b6-93c3-3eac58303006 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:50.598242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-863663b4-291f-49b6-93c3-3eac58303006 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:50.612711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863663b4-291f-49b6-93c3-3eac58303006 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:50.613542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863663b4-291f-49b6-93c3-3eac58303006 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:50.614438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863663b4-291f-49b6-93c3-3eac58303006 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:50.616730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863663b4-291f-49b6-93c3-3eac58303006 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:50.618500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863663b4-291f-49b6-93c3-3eac58303006 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:50.619077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-863663b4-291f-49b6-93c3-3eac58303006 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:50.951393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-863663b4-291f-49b6-93c3-3eac58303006 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:50.963075 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-863663b4-291f-49b6-93c3-3eac58303006 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1277 microversion: 2.1 time: 0.370805 Sep 10 11:14:50.967225 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4054/5792] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:50 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1277 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:51.746972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-373a8b23-682f-462f-915c-62b566e83d85 req-1a978330-ee3f-4b8e-b5eb-cb35affb5a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b92510e1-0608-41b0-9481-2ce7dc56803c", "tag": "9ef3e588-1377-415c-b1bf-65da7b6399ab"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:14:51.760049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-373a8b23-682f-462f-915c-62b566e83d85 req-1a978330-ee3f-4b8e-b5eb-cb35affb5a89 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:51.760903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-373a8b23-682f-462f-915c-62b566e83d85 req-1a978330-ee3f-4b8e-b5eb-cb35affb5a89 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:51.762201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-373a8b23-682f-462f-915c-62b566e83d85 req-1a978330-ee3f-4b8e-b5eb-cb35affb5a89 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:51.775306 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-373a8b23-682f-462f-915c-62b566e83d85 req-1a978330-ee3f-4b8e-b5eb-cb35affb5a89 service nova] Creating event network-changed:9ef3e588-1377-415c-b1bf-65da7b6399ab for instance b92510e1-0608-41b0-9481-2ce7dc56803c on n-h2-856894-1 Sep 10 11:14:51.780652 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-373a8b23-682f-462f-915c-62b566e83d85 req-1a978330-ee3f-4b8e-b5eb-cb35affb5a89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353548 Sep 10 11:14:51.781873 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1739/5793] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:14:51.990287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b306c2b6-dda5-41e3-aeef-a31181ac7a16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:51.991595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b306c2b6-dda5-41e3-aeef-a31181ac7a16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:51.999239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b306c2b6-dda5-41e3-aeef-a31181ac7a16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:52.000056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b306c2b6-dda5-41e3-aeef-a31181ac7a16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:52.000731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b306c2b6-dda5-41e3-aeef-a31181ac7a16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:52.001696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b306c2b6-dda5-41e3-aeef-a31181ac7a16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:52.002396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b306c2b6-dda5-41e3-aeef-a31181ac7a16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:52.003062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b306c2b6-dda5-41e3-aeef-a31181ac7a16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:52.190249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b306c2b6-dda5-41e3-aeef-a31181ac7a16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:52.198882 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b306c2b6-dda5-41e3-aeef-a31181ac7a16 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1277 microversion: 2.1 time: 0.212482 Sep 10 11:14:52.199780 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4055/5794] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:51 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:53.226922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dd684d3a-70f0-419b-9e20-2ad5c895ec5e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:53.228017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dd684d3a-70f0-419b-9e20-2ad5c895ec5e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:53.242543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd684d3a-70f0-419b-9e20-2ad5c895ec5e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:53.243048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd684d3a-70f0-419b-9e20-2ad5c895ec5e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:53.243491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd684d3a-70f0-419b-9e20-2ad5c895ec5e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:53.244217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd684d3a-70f0-419b-9e20-2ad5c895ec5e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:53.244673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd684d3a-70f0-419b-9e20-2ad5c895ec5e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:53.245340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd684d3a-70f0-419b-9e20-2ad5c895ec5e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:53.397570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dd684d3a-70f0-419b-9e20-2ad5c895ec5e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:53.406469 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dd684d3a-70f0-419b-9e20-2ad5c895ec5e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1277 microversion: 2.1 time: 0.187086 Sep 10 11:14:53.407371 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1740/5795] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:53 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:54.430410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93803610-81a2-4cab-8c88-845ce6c2a66c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:54.430965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93803610-81a2-4cab-8c88-845ce6c2a66c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:54.439101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93803610-81a2-4cab-8c88-845ce6c2a66c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:54.439610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93803610-81a2-4cab-8c88-845ce6c2a66c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:54.440067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93803610-81a2-4cab-8c88-845ce6c2a66c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:54.440784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93803610-81a2-4cab-8c88-845ce6c2a66c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:54.441330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93803610-81a2-4cab-8c88-845ce6c2a66c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:54.441777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93803610-81a2-4cab-8c88-845ce6c2a66c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:54.582589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93803610-81a2-4cab-8c88-845ce6c2a66c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:54.590972 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93803610-81a2-4cab-8c88-845ce6c2a66c tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1277 microversion: 2.1 time: 0.164681 Sep 10 11:14:54.591858 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4056/5796] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:54 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:55.613890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7cf2d16f-7fe0-4950-8d26-e1f7422e6506 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:55.614521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7cf2d16f-7fe0-4950-8d26-e1f7422e6506 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:55.621935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cf2d16f-7fe0-4950-8d26-e1f7422e6506 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:55.622444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cf2d16f-7fe0-4950-8d26-e1f7422e6506 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:55.622881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cf2d16f-7fe0-4950-8d26-e1f7422e6506 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:55.623568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cf2d16f-7fe0-4950-8d26-e1f7422e6506 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:55.624016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cf2d16f-7fe0-4950-8d26-e1f7422e6506 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:55.624436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7cf2d16f-7fe0-4950-8d26-e1f7422e6506 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:55.781971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7cf2d16f-7fe0-4950-8d26-e1f7422e6506 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:55.789710 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7cf2d16f-7fe0-4950-8d26-e1f7422e6506 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1265 microversion: 2.1 time: 0.179745 Sep 10 11:14:55.790530 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1741/5797] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:55 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:56.813485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-83779518-f7ec-465c-9b97-883075d3daaf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:56.814170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-83779518-f7ec-465c-9b97-883075d3daaf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:56.821323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83779518-f7ec-465c-9b97-883075d3daaf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:56.821818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83779518-f7ec-465c-9b97-883075d3daaf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:56.822267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83779518-f7ec-465c-9b97-883075d3daaf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:56.822963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83779518-f7ec-465c-9b97-883075d3daaf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:56.823432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83779518-f7ec-465c-9b97-883075d3daaf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:56.823896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83779518-f7ec-465c-9b97-883075d3daaf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:56.971394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-83779518-f7ec-465c-9b97-883075d3daaf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:56.979939 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-83779518-f7ec-465c-9b97-883075d3daaf tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1265 microversion: 2.1 time: 0.171039 Sep 10 11:14:56.980521 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4057/5798] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:56 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:58.004479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-93fa21b9-7dc4-417a-ac3b-b5c0d8989aeb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:58.005716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-93fa21b9-7dc4-417a-ac3b-b5c0d8989aeb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:58.012773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93fa21b9-7dc4-417a-ac3b-b5c0d8989aeb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:58.013719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93fa21b9-7dc4-417a-ac3b-b5c0d8989aeb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:58.014172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93fa21b9-7dc4-417a-ac3b-b5c0d8989aeb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:58.014860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93fa21b9-7dc4-417a-ac3b-b5c0d8989aeb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:58.015543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93fa21b9-7dc4-417a-ac3b-b5c0d8989aeb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:58.015920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-93fa21b9-7dc4-417a-ac3b-b5c0d8989aeb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:58.140800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:58.165161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-93fa21b9-7dc4-417a-ac3b-b5c0d8989aeb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:58.168242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:58.179676 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-93fa21b9-7dc4-417a-ac3b-b5c0d8989aeb tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1265 microversion: 2.1 time: 0.179232 Sep 10 11:14:58.185293 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1742/5799] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:57 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:14:59.207757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dfbf1a99-0344-43fb-a9e9-4554f420bbdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:59.208636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dfbf1a99-0344-43fb-a9e9-4554f420bbdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:59.212296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:14:59.218450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfbf1a99-0344-43fb-a9e9-4554f420bbdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:59.218886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfbf1a99-0344-43fb-a9e9-4554f420bbdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:59.219408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfbf1a99-0344-43fb-a9e9-4554f420bbdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:59.220285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfbf1a99-0344-43fb-a9e9-4554f420bbdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:59.220875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfbf1a99-0344-43fb-a9e9-4554f420bbdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:59.221415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dfbf1a99-0344-43fb-a9e9-4554f420bbdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:59.369671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dfbf1a99-0344-43fb-a9e9-4554f420bbdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:14:59.378616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dfbf1a99-0344-43fb-a9e9-4554f420bbdd tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1265 microversion: 2.1 time: 0.175509 Sep 10 11:14:59.379445 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4058/5800] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:14:59 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:59.814307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e4ab4781-94c9-4c83-ad27-b59507ba0538 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:59.817337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e4ab4781-94c9-4c83-ad27-b59507ba0538 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:59.826959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4ab4781-94c9-4c83-ad27-b59507ba0538 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:59.827659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4ab4781-94c9-4c83-ad27-b59507ba0538 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:59.828300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4ab4781-94c9-4c83-ad27-b59507ba0538 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:59.829334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4ab4781-94c9-4c83-ad27-b59507ba0538 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:59.829986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4ab4781-94c9-4c83-ad27-b59507ba0538 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:59.830608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4ab4781-94c9-4c83-ad27-b59507ba0538 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:59.865101 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e4ab4781-94c9-4c83-ad27-b59507ba0538 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055109 Sep 10 11:14:59.866027 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1743/5801] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Sep 10 11:14:59 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:14:59.965660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-00a9e5e6-69df-42ea-8afc-e4a904c00e49 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:14:59.967683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-00a9e5e6-69df-42ea-8afc-e4a904c00e49 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:14:59.975016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00a9e5e6-69df-42ea-8afc-e4a904c00e49 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:59.975740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00a9e5e6-69df-42ea-8afc-e4a904c00e49 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:59.976420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00a9e5e6-69df-42ea-8afc-e4a904c00e49 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:14:59.977389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00a9e5e6-69df-42ea-8afc-e4a904c00e49 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:14:59.978080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00a9e5e6-69df-42ea-8afc-e4a904c00e49 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:14:59.978959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-00a9e5e6-69df-42ea-8afc-e4a904c00e49 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:00.006649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-00a9e5e6-69df-42ea-8afc-e4a904c00e49 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:15:00.107876 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-00a9e5e6-69df-42ea-8afc-e4a904c00e49 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 204 len: 0 microversion: 2.20 time: 0.145519 Sep 10 11:15:00.109094 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4059/5802] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 11:14:59 2022] DELETE /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:15:00.119040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:00.120001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:00.129416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:00.129908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:00.130345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:00.131045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:00.131495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:00.131916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:00.281646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:00.290951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:00.292453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:00.293752 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-976453de-3bb9-4325-b1c7-14bb2a9f10b7 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.179781 Sep 10 11:15:00.302567 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1744/5803] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:15:00 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:15:00.403221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-94179d75-0fb6-48a6-a65d-fddc9c000f83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:00.403994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-94179d75-0fb6-48a6-a65d-fddc9c000f83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:00.411176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94179d75-0fb6-48a6-a65d-fddc9c000f83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:00.412350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94179d75-0fb6-48a6-a65d-fddc9c000f83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:00.412817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94179d75-0fb6-48a6-a65d-fddc9c000f83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:00.413603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94179d75-0fb6-48a6-a65d-fddc9c000f83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:00.414086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94179d75-0fb6-48a6-a65d-fddc9c000f83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:00.414538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-94179d75-0fb6-48a6-a65d-fddc9c000f83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:00.563372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-94179d75-0fb6-48a6-a65d-fddc9c000f83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:00.572509 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-94179d75-0fb6-48a6-a65d-fddc9c000f83 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1265 microversion: 2.1 time: 0.174156 Sep 10 11:15:00.573761 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4060/5804] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:15:00 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:15:01.322066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:01.322956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:01.330653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:01.331167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:01.331658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:01.332380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:01.332853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:01.333365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:01.541200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:01.549902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:01.551506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:01.552916 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8f0164a8-d04c-4ee6-86ea-e0b97234c722 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1723 microversion: 2.20 time: 0.236908 Sep 10 11:15:01.553615 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1745/5805] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:15:01 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:15:01.595887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d7314e8-8f13-41d9-b276-b22ab8356d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:01.596672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d7314e8-8f13-41d9-b276-b22ab8356d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:01.603859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7314e8-8f13-41d9-b276-b22ab8356d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:01.604730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7314e8-8f13-41d9-b276-b22ab8356d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:01.605299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7314e8-8f13-41d9-b276-b22ab8356d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:01.606082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7314e8-8f13-41d9-b276-b22ab8356d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:01.606622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7314e8-8f13-41d9-b276-b22ab8356d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:01.607159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d7314e8-8f13-41d9-b276-b22ab8356d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:01.830570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d7314e8-8f13-41d9-b276-b22ab8356d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:01.843915 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d7314e8-8f13-41d9-b276-b22ab8356d9e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1265 microversion: 2.1 time: 0.250460 Sep 10 11:15:01.844832 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4061/5806] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:15:01 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:15:02.417499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-174cf317-fbed-45cd-ad07-1a35a1824b4f req-51fa37e8-a2c9-4785-a453-0a99f0cbbc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fcc5d6-b26c-46f0-9597-d700cc9af3a6", "name": "network-vif-deleted", "tag": "e80c3326-5dd0-4d81-b155-a38fbcc73b75"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:15:02.428619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-174cf317-fbed-45cd-ad07-1a35a1824b4f req-51fa37e8-a2c9-4785-a453-0a99f0cbbc28 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:02.429283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-174cf317-fbed-45cd-ad07-1a35a1824b4f req-51fa37e8-a2c9-4785-a453-0a99f0cbbc28 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:02.429815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-174cf317-fbed-45cd-ad07-1a35a1824b4f req-51fa37e8-a2c9-4785-a453-0a99f0cbbc28 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:02.441711 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-174cf317-fbed-45cd-ad07-1a35a1824b4f req-51fa37e8-a2c9-4785-a453-0a99f0cbbc28 service nova] Creating event network-vif-deleted:e80c3326-5dd0-4d81-b155-a38fbcc73b75 for instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 on n-h1-856894-1 Sep 10 11:15:02.447037 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-174cf317-fbed-45cd-ad07-1a35a1824b4f req-51fa37e8-a2c9-4785-a453-0a99f0cbbc28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033449 Sep 10 11:15:02.451330 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1746/5807] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:15:02.580090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:02.580768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:02.595526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:02.595978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:02.596532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:02.597181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:02.597662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:02.598112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:02.689840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:02.690853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:02.691542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:02.692977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lazy-loading 'fault' on Instance uuid 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:15:02.798608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:02.818020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:02.819750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c62573dd17f47fe9dd98200cc04bd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc08265fd4c43aa822728bd86e1fed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:02.824996 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a35eabb-d46c-415f-9970-d2988d76e837 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 200 len: 1371 microversion: 2.20 time: 0.249527 Sep 10 11:15:02.841380 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4062/5808] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:15:02 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:15:02.867803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-508ee46b-33cc-4f03-a297-8603c580983f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:02.868421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-508ee46b-33cc-4f03-a297-8603c580983f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:02.882981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-508ee46b-33cc-4f03-a297-8603c580983f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:02.883478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-508ee46b-33cc-4f03-a297-8603c580983f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:02.883917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-508ee46b-33cc-4f03-a297-8603c580983f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:02.884618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-508ee46b-33cc-4f03-a297-8603c580983f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:02.885295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-508ee46b-33cc-4f03-a297-8603c580983f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:02.885732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-508ee46b-33cc-4f03-a297-8603c580983f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:03.041418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-508ee46b-33cc-4f03-a297-8603c580983f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:03.049354 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-508ee46b-33cc-4f03-a297-8603c580983f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1265 microversion: 2.1 time: 0.185913 Sep 10 11:15:03.049960 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1747/5809] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:15:02 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:15:03.855673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:03.856647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:03.864135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:03.864772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:03.865369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:03.867066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:03.867660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:03.868218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:03.884719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] HTTP exception thrown: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Request method failure captured: Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 HTTP/1.1 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHB84mCWtUjNZCH2AF34UHrkKtxs7AetgIhJfWoQ6tL0tKDPOOL0a12JOobqpWIIWrJhO7NfvVSzcdEvdFq5UJDKUryCzMome2v1J5ZrwqS9hXbaMnWkekNuSdQ0Az68nPLGAaJTky9qjQeg7UPOdpiUm5AYtLr0YugyRneTKdm0niY Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adc08265fd4c43aa822728bd86e1fed1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 2c62573dd17f47fe9dd98200cc04bd23 Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '54fcc5d6-b26c-46f0-9597-d700cc9af3a6'} Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:03.886567 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:15:03.892187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:03.892187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:03.892187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:15:03.892187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:15:03.892187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:15:03.892187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:15:03.892187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:03.892187 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:03.892187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Returning 404 to user: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:15:03.892187 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b7af04d-045e-4e08-a448-21ead1d97534 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 404 len: 111 microversion: 2.20 time: 0.038231 Sep 10 11:15:03.894081 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4063/5810] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:15:03 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:15:03.900072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e815f314-5252-4763-b3ca-c558795623c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '.version_select at 0x7efcb2ceb4c0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:03.920403 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e815f314-5252-4763-b3ca-c558795623c3 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520942628" status: 204 len: 0 microversion: 2.20 time: 0.024126 Sep 10 11:15:03.921266 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1748/5811] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Sep 10 11:15:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520942628 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:15:04.074417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c098a82-91b1-4b0c-928c-7c163151137f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:04.074517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c098a82-91b1-4b0c-928c-7c163151137f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:04.081405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c098a82-91b1-4b0c-928c-7c163151137f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:04.082615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c098a82-91b1-4b0c-928c-7c163151137f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:04.083085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c098a82-91b1-4b0c-928c-7c163151137f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:04.083812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c098a82-91b1-4b0c-928c-7c163151137f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:04.084456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c098a82-91b1-4b0c-928c-7c163151137f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:04.084900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c098a82-91b1-4b0c-928c-7c163151137f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:04.239360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9c098a82-91b1-4b0c-928c-7c163151137f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:04.248245 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c098a82-91b1-4b0c-928c-7c163151137f tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1265 microversion: 2.1 time: 0.178333 Sep 10 11:15:04.248819 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4064/5812] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:15:04 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:15:05.273258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d96bd617-cd6a-412c-a2a8-b0dd95cae155 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:05.273865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d96bd617-cd6a-412c-a2a8-b0dd95cae155 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:05.283286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d96bd617-cd6a-412c-a2a8-b0dd95cae155 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:05.284037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d96bd617-cd6a-412c-a2a8-b0dd95cae155 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:05.284648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d96bd617-cd6a-412c-a2a8-b0dd95cae155 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:05.285549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d96bd617-cd6a-412c-a2a8-b0dd95cae155 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:05.286213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d96bd617-cd6a-412c-a2a8-b0dd95cae155 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:05.286790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d96bd617-cd6a-412c-a2a8-b0dd95cae155 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:05.453830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d96bd617-cd6a-412c-a2a8-b0dd95cae155 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:05.465223 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d96bd617-cd6a-412c-a2a8-b0dd95cae155 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1265 microversion: 2.1 time: 0.196933 Sep 10 11:15:05.467316 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1749/5813] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:15:05 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:15:06.010898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c18d6e0a-5037-40ea-92b2-31be4b567000 req-636308e0-90f9-4b98-aa13-5085fc3f7b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92510e1-0608-41b0-9481-2ce7dc56803c", "name": "network-vif-plugged", "status": "completed", "tag": "9ef3e588-1377-415c-b1bf-65da7b6399ab"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:15:06.027908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c18d6e0a-5037-40ea-92b2-31be4b567000 req-636308e0-90f9-4b98-aa13-5085fc3f7b38 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:06.029283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c18d6e0a-5037-40ea-92b2-31be4b567000 req-636308e0-90f9-4b98-aa13-5085fc3f7b38 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:06.029929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c18d6e0a-5037-40ea-92b2-31be4b567000 req-636308e0-90f9-4b98-aa13-5085fc3f7b38 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:06.074478 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c18d6e0a-5037-40ea-92b2-31be4b567000 req-636308e0-90f9-4b98-aa13-5085fc3f7b38 service nova] Creating event network-vif-plugged:9ef3e588-1377-415c-b1bf-65da7b6399ab for instance b92510e1-0608-41b0-9481-2ce7dc56803c on n-h2-856894-1 Sep 10 11:15:06.105934 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c18d6e0a-5037-40ea-92b2-31be4b567000 req-636308e0-90f9-4b98-aa13-5085fc3f7b38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098121 Sep 10 11:15:06.109142 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4065/5814] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:15:06.492868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f06d5e80-dfd2-4b8b-9ddc-299e6185b2b2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:06.494071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f06d5e80-dfd2-4b8b-9ddc-299e6185b2b2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:06.502227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f06d5e80-dfd2-4b8b-9ddc-299e6185b2b2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:06.502929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f06d5e80-dfd2-4b8b-9ddc-299e6185b2b2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:06.503554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f06d5e80-dfd2-4b8b-9ddc-299e6185b2b2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:06.504262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f06d5e80-dfd2-4b8b-9ddc-299e6185b2b2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:06.504707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f06d5e80-dfd2-4b8b-9ddc-299e6185b2b2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:06.505168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f06d5e80-dfd2-4b8b-9ddc-299e6185b2b2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:06.718987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f06d5e80-dfd2-4b8b-9ddc-299e6185b2b2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:06.731079 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f06d5e80-dfd2-4b8b-9ddc-299e6185b2b2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1265 microversion: 2.1 time: 0.243170 Sep 10 11:15:06.735436 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1750/5815] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:15:06 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:15:06.841016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:06.842117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:06.849156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:06.849844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:06.850488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:06.851210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:06.851680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:06.852278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:06.866051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] HTTP exception thrown: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Request method failure captured: Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 HTTP/1.1 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHB84mCWtUjNZCH2AF34UHrkKtxs7AetgIhJfWoQ6tL0tKDPOOL0a12JOobqpWIIWrJhO7NfvVSzcdEvdFq5UJDKUryCzMome2v1J5ZrwqS9hXbaMnWkekNuSdQ0Az68nPLGAaJTky9qjQeg7UPOdpiUm5AYtLr0YugyRneTKdm0niY Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adc08265fd4c43aa822728bd86e1fed1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 2c62573dd17f47fe9dd98200cc04bd23 Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '54fcc5d6-b26c-46f0-9597-d700cc9af3a6'} Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:15:06.867977 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:06.872469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Returning 404 to user: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:15:06.873887 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b6e9315a-c359-4929-b58f-f4774b08f28b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 404 len: 111 microversion: 2.20 time: 0.037463 Sep 10 11:15:06.874466 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4066/5816] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 11:15:06 2022] DELETE /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:15:06.882995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:06.884072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 54fcc5d6-b26c-46f0-9597-d700cc9af3a6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:06.891684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:06.892412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:06.893099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:06.894147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:06.894833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:06.895694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:06.911525 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] HTTP exception thrown: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Request method failure captured: Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 HTTP/1.1 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHB84mCWtUjNZCH2AF34UHrkKtxs7AetgIhJfWoQ6tL0tKDPOOL0a12JOobqpWIIWrJhO7NfvVSzcdEvdFq5UJDKUryCzMome2v1J5ZrwqS9hXbaMnWkekNuSdQ0Az68nPLGAaJTky9qjQeg7UPOdpiUm5AYtLr0YugyRneTKdm0niY Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adc08265fd4c43aa822728bd86e1fed1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 2c62573dd17f47fe9dd98200cc04bd23 Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '54fcc5d6-b26c-46f0-9597-d700cc9af3a6'} Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:15:06.913365 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:15:06.918337 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:15:06.918337 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:06.918337 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:15:06.918337 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:15:06.918337 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:15:06.918337 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:15:06.918337 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. Sep 10 11:15:06.918337 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:15:06.919903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Returning 404 to user: Instance 54fcc5d6-b26c-46f0-9597-d700cc9af3a6 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:15:06.920988 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-eef4cb1e-2157-4a60-b5e4-82674a3bce6b tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6" status: 404 len: 111 microversion: 2.20 time: 0.042134 Sep 10 11:15:06.925230 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1751/5817] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:15:06 2022] GET /compute/v2.1/servers/54fcc5d6-b26c-46f0-9597-d700cc9af3a6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:15:07.763330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c1da3c11-9433-41bd-9004-848081a52924 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:07.764081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c1da3c11-9433-41bd-9004-848081a52924 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:07.784587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1da3c11-9433-41bd-9004-848081a52924 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:07.785306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1da3c11-9433-41bd-9004-848081a52924 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:07.789667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1da3c11-9433-41bd-9004-848081a52924 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:07.790850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1da3c11-9433-41bd-9004-848081a52924 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:07.791565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1da3c11-9433-41bd-9004-848081a52924 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:07.792240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c1da3c11-9433-41bd-9004-848081a52924 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:07.993775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c1da3c11-9433-41bd-9004-848081a52924 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:08.004118 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c1da3c11-9433-41bd-9004-848081a52924 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1452 microversion: 2.1 time: 0.244158 Sep 10 11:15:08.006738 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4067/5818] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:15:07 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1452 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:15:08.033006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7da073fe-1c61-4f70-aef8-b24bd0932c77 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:08.034315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7da073fe-1c61-4f70-aef8-b24bd0932c77 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:08.043043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7da073fe-1c61-4f70-aef8-b24bd0932c77 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:08.043927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7da073fe-1c61-4f70-aef8-b24bd0932c77 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:08.044963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7da073fe-1c61-4f70-aef8-b24bd0932c77 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:08.045614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7da073fe-1c61-4f70-aef8-b24bd0932c77 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:08.046309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7da073fe-1c61-4f70-aef8-b24bd0932c77 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:08.046951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7da073fe-1c61-4f70-aef8-b24bd0932c77 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:08.196931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7da073fe-1c61-4f70-aef8-b24bd0932c77 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:15:08.206435 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7da073fe-1c61-4f70-aef8-b24bd0932c77 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1452 microversion: 2.1 time: 0.178128 Sep 10 11:15:08.207569 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1752/5819] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:15:08 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:15:10.063147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0dab3175-97de-4872-9b7c-3fdf95aaeb3f req-0dea6a3f-8b4c-4941-9fac-9d21265da085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b92510e1-0608-41b0-9481-2ce7dc56803c", "tag": "9ef3e588-1377-415c-b1bf-65da7b6399ab"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:15:10.082928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0dab3175-97de-4872-9b7c-3fdf95aaeb3f req-0dea6a3f-8b4c-4941-9fac-9d21265da085 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:10.085347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0dab3175-97de-4872-9b7c-3fdf95aaeb3f req-0dea6a3f-8b4c-4941-9fac-9d21265da085 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:10.087447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0dab3175-97de-4872-9b7c-3fdf95aaeb3f req-0dea6a3f-8b4c-4941-9fac-9d21265da085 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:10.151617 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0dab3175-97de-4872-9b7c-3fdf95aaeb3f req-0dea6a3f-8b4c-4941-9fac-9d21265da085 service nova] Creating event network-changed:9ef3e588-1377-415c-b1bf-65da7b6399ab for instance b92510e1-0608-41b0-9481-2ce7dc56803c on n-h2-856894-1 Sep 10 11:15:10.160270 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0dab3175-97de-4872-9b7c-3fdf95aaeb3f req-0dea6a3f-8b4c-4941-9fac-9d21265da085 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102465 Sep 10 11:15:10.161740 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4068/5820] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:15:10.315314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:10.316452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:10.323897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:10.324691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:10.325923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:10.326706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:10.327392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:10.328255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:10.343177 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] HTTP exception thrown: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Request method failure captured: Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 HTTP/1.1 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHB84mCWtUjNZCH2AF34UHrkKtxs7AetgIhJfWoQ6tL0tKDPOOL0a12JOobqpWIIWrJhO7NfvVSzcdEvdFq5UJDKUryCzMome2v1J5ZrwqS9hXbaMnWkekNuSdQ0Az68nPLGAaJTky9qjQeg7UPOdpiUm5AYtLr0YugyRneTKdm0niY Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adc08265fd4c43aa822728bd86e1fed1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 2c62573dd17f47fe9dd98200cc04bd23 Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '881d6159-5456-4a2f-98c2-0c3e66109b01'} Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:15:10.345057 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:15:10.350936 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:15:10.353183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Returning 404 to user: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:15:10.354966 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ae4070ea-6ba4-4729-a12b-6ce866901aac tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 404 len: 111 microversion: 2.20 time: 0.043352 Sep 10 11:15:10.365125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:15:10.366210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] [instance: 881d6159-5456-4a2f-98c2-0c3e66109b01] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:15:10.369629 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1753/5821] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Sep 10 11:15:10 2022] DELETE /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 10 11:15:10.373439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:10.374199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:10.374895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:10.375853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:15:10.376549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:15:10.377249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:15:10.402943 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] HTTP exception thrown: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Request method failure captured: Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 HTTP/1.1 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHB84mCWtUjNZCH2AF34UHrkKtxs7AetgIhJfWoQ6tL0tKDPOOL0a12JOobqpWIIWrJhO7NfvVSzcdEvdFq5UJDKUryCzMome2v1J5ZrwqS9hXbaMnWkekNuSdQ0Az68nPLGAaJTky9qjQeg7UPOdpiUm5AYtLr0YugyRneTKdm0niY Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adc08265fd4c43aa822728bd86e1fed1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adc08265fd4c43aa822728bd86e1fed1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: adc08265fd4c43aa822728bd86e1fed1 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1072302881 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 2c62573dd17f47fe9dd98200cc04bd23 Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1072302881-project Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '881d6159-5456-4a2f-98c2-0c3e66109b01'} Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:10.412942 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:15:10.417963 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:10.417963 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:15:10.417963 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:15:10.417963 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:15:10.417963 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:15:10.417963 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:15:10.417963 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. Sep 10 11:15:10.417963 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:15:10.427351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] Returning 404 to user: Instance 881d6159-5456-4a2f-98c2-0c3e66109b01 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:15:10.428643 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-edc4228d-9505-477e-a183-6b6af4fae198 tempest-AttachVolumeShelveTestJSON-1072302881 tempest-AttachVolumeShelveTestJSON-1072302881-project] 10.222.0.20 "GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01" status: 404 len: 111 microversion: 2.20 time: 0.067965 Sep 10 11:15:10.433323 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4069/5822] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Sep 10 11:15:10 2022] GET /compute/v2.1/servers/881d6159-5456-4a2f-98c2-0c3e66109b01 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:16:00.769472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:00.770437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=76 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:00.908307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ecdbbb31-55ba-4679-a6d5-e4901914f6ec tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1973216159", "availability_zone": "foo_zone"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:00.912053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.aggregate [None req-ecdbbb31-55ba-4679-a6d5-e4901914f6ec tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Generated uuid 14c25a94-2809-4bc2-935d-a5260bd69a01 for aggregate {{(pid=128787) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:16:00.956468 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ecdbbb31-55ba-4679-a6d5-e4901914f6ec tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.191665 Sep 10 11:16:00.963678 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1754/5823] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Sep 10 11:16:00 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:00.971523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3c77605-94b7-4d06-ac7f-4236d960be12 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:00.981531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:00.982370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:00.983755 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:16:00.984056 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 11:16:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates/19/action (ip 10.222.0.20) !!! Sep 10 11:16:01.033027 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3c77605-94b7-4d06-ac7f-4236d960be12 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.067094 Sep 10 11:16:01.034349 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4070/5824] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 11:16:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:01.049810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d0f96c6d-10a3-42ba-852c-ac49d856ecc7 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:01.053584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0f96c6d-10a3-42ba-852c-ac49d856ecc7 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:01.054148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0f96c6d-10a3-42ba-852c-ac49d856ecc7 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:01.058398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0f96c6d-10a3-42ba-852c-ac49d856ecc7 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:01.059360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0f96c6d-10a3-42ba-852c-ac49d856ecc7 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:01.059906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0f96c6d-10a3-42ba-852c-ac49d856ecc7 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:01.060406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d0f96c6d-10a3-42ba-852c-ac49d856ecc7 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:01.098461 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d0f96c6d-10a3-42ba-852c-ac49d856ecc7 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053500 Sep 10 11:16:01.099489 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1755/5825] 10.222.0.20 () {58 vars in 1176 bytes} [Sat Sep 10 11:16:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:01.111049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae3493b7-e35e-42fd-9012-75241aa01bfe tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:01.129704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae3493b7-e35e-42fd-9012-75241aa01bfe tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.022526 Sep 10 11:16:01.130951 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4071/5826] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Sep 10 11:16:01 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:01.149478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0a1820bc-cdc3-4b08-8b7d-8bd6d35c4ebc tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-856894-1"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:01.162009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a1820bc-cdc3-4b08-8b7d-8bd6d35c4ebc tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:01.164998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a1820bc-cdc3-4b08-8b7d-8bd6d35c4ebc tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:01.165998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a1820bc-cdc3-4b08-8b7d-8bd6d35c4ebc tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:01.545333 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0a1820bc-cdc3-4b08-8b7d-8bd6d35c4ebc tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.399489 Sep 10 11:16:01.557655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-670068a3-bc1b-4cef-8dcd-41a6976ce67c tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:01.564184 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1756/5827] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 11:16:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:01.569520 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-670068a3-bc1b-4cef-8dcd-41a6976ce67c tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.015393 Sep 10 11:16:01.570373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4072/5828] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 11:16:01 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:01.590228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b3b324d8-f310-4595-8fc6-3d46f6f85c59 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1823295075", "availability_zone": "foo_zone"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:01.674224 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b3b324d8-f310-4595-8fc6-3d46f6f85c59 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.094295 Sep 10 11:16:01.675396 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1757/5829] 10.222.0.20 () {60 vars in 1173 bytes} [Sat Sep 10 11:16:01 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:01.691335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2c5afc30-e58c-4f75-9404-9246b7bb33c5 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:01.731826 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2c5afc30-e58c-4f75-9404-9246b7bb33c5 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.044880 Sep 10 11:16:01.734830 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4073/5830] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 11:16:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:01.749916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c2b9f518-47a5-4af4-ad5c-092a4f9ec7db tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:01.758984 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c2b9f518-47a5-4af4-ad5c-092a4f9ec7db tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.013473 Sep 10 11:16:01.759577 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1758/5831] 10.222.0.20 () {58 vars in 1152 bytes} [Sat Sep 10 11:16:01 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:01.771835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3822e868-b351-494b-9aec-6b7f1a46d352 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-856894-1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:01.785662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3822e868-b351-494b-9aec-6b7f1a46d352 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:01.786436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3822e868-b351-494b-9aec-6b7f1a46d352 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:01.787066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3822e868-b351-494b-9aec-6b7f1a46d352 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:02.025690 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3822e868-b351-494b-9aec-6b7f1a46d352 tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.257467 Sep 10 11:16:02.027865 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4074/5832] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Sep 10 11:16:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:16:02.042246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-78d99074-a1b9-4357-81cb-34ec0500355e tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:02.084458 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-78d99074-a1b9-4357-81cb-34ec0500355e tempest-TestAggregatesBasicOps-1231897202 tempest-TestAggregatesBasicOps-1231897202-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.045818 Sep 10 11:16:02.092743 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1759/5833] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Sep 10 11:16:02 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:16:14.298883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:14.300278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:14.535646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56d78170-d31e-49cf-9bc8-eeb4fc23ac1e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'create', calling method: .version_select at 0x7efcad3f3160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2068043573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF91VD8KzWYR0bWV1Q+oA2qtsPBhsymW4pB47n2Sgn9ENrKjVpgVuvyTw+6cMkXaaebCe7e9gcFetE4hoAQe5+bE8ftKAX9bPIMmKJrxjezMugJ68zQ39phqwKsfDe4xmg=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:14.563474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-56d78170-d31e-49cf-9bc8-eeb4fc23ac1e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for project aad1c11f4349492a8c53684e82676e2e. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:16:14.571749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-56d78170-d31e-49cf-9bc8-eeb4fc23ac1e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for user 28049b2f9a484bf68b61b0769cef6616 and project aad1c11f4349492a8c53684e82676e2e. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:16:14.612735 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56d78170-d31e-49cf-9bc8-eeb4fc23ac1e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.315477 Sep 10 11:16:14.619045 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4075/5834] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:16:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:23.201103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:23.201924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:23.206184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:23.215968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-992100897", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "70f059b2-636d-41df-8559-d699a240857b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2068043573", "security_groups": [{"name": "tempest-secgroup-smoke-1064490982"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:23.403602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] validate_networks() for [('70f059b2-636d-41df-8559-d699a240857b', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:16:24.327823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:16:24.331053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:16:24.331606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:16:24.332030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:16:24.332471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:16:24.348633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:24.349155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:24.350147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:24.351105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:24.351764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:24.352395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:24.386216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for project aad1c11f4349492a8c53684e82676e2e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:16:24.400501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for user 28049b2f9a484bf68b61b0769cef6616 and project aad1c11f4349492a8c53684e82676e2e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:16:24.414532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:16:24.419426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:16:24.498039 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a4a87ca7-d407-4035-9350-497a51e09412 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.298565 Sep 10 11:16:24.499088 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1760/5835] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:16:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:16:24.512702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fd23a3d1-9148-4d5d-a27f-0b3a676bb1dc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:24.513981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fd23a3d1-9148-4d5d-a27f-0b3a676bb1dc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:24.583439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:24.619341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fd23a3d1-9148-4d5d-a27f-0b3a676bb1dc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:24.628848 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fd23a3d1-9148-4d5d-a27f-0b3a676bb1dc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1266 microversion: 2.1 time: 0.121777 Sep 10 11:16:24.630369 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4076/5836] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:24 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:25.652162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-403ef37e-92a2-48e2-a7c0-7e884cc87a09 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:25.653329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-403ef37e-92a2-48e2-a7c0-7e884cc87a09 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:25.660726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-403ef37e-92a2-48e2-a7c0-7e884cc87a09 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:25.661268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-403ef37e-92a2-48e2-a7c0-7e884cc87a09 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:25.661928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-403ef37e-92a2-48e2-a7c0-7e884cc87a09 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:25.671099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-403ef37e-92a2-48e2-a7c0-7e884cc87a09 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:25.671614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-403ef37e-92a2-48e2-a7c0-7e884cc87a09 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:25.672067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-403ef37e-92a2-48e2-a7c0-7e884cc87a09 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:25.745158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-403ef37e-92a2-48e2-a7c0-7e884cc87a09 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:25.753171 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-403ef37e-92a2-48e2-a7c0-7e884cc87a09 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1318 microversion: 2.1 time: 0.104892 Sep 10 11:16:25.753756 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1761/5837] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:25 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1318 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:16:26.779866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0288ebdb-0f34-40e1-9d3b-9b21f04de9d1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:26.780623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0288ebdb-0f34-40e1-9d3b-9b21f04de9d1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:26.791871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0288ebdb-0f34-40e1-9d3b-9b21f04de9d1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:26.792932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0288ebdb-0f34-40e1-9d3b-9b21f04de9d1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:26.794131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0288ebdb-0f34-40e1-9d3b-9b21f04de9d1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:26.795453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0288ebdb-0f34-40e1-9d3b-9b21f04de9d1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:26.799715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0288ebdb-0f34-40e1-9d3b-9b21f04de9d1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:26.800542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0288ebdb-0f34-40e1-9d3b-9b21f04de9d1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:26.980898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0288ebdb-0f34-40e1-9d3b-9b21f04de9d1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:26.991409 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0288ebdb-0f34-40e1-9d3b-9b21f04de9d1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1324 microversion: 2.1 time: 0.215968 Sep 10 11:16:26.992010 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4077/5838] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:26 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:16:28.016344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e69cd2a1-a129-4daa-812f-67e6be558443 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:28.017101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e69cd2a1-a129-4daa-812f-67e6be558443 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:28.024650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69cd2a1-a129-4daa-812f-67e6be558443 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:28.025371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69cd2a1-a129-4daa-812f-67e6be558443 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:28.026011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69cd2a1-a129-4daa-812f-67e6be558443 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:28.026910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69cd2a1-a129-4daa-812f-67e6be558443 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:28.027755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69cd2a1-a129-4daa-812f-67e6be558443 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:28.028299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e69cd2a1-a129-4daa-812f-67e6be558443 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:28.311704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e69cd2a1-a129-4daa-812f-67e6be558443 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:28.325338 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e69cd2a1-a129-4daa-812f-67e6be558443 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1392 microversion: 2.1 time: 0.312589 Sep 10 11:16:28.327340 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1762/5839] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:28 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:28.640282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ecba4c8e-ee25-45ba-a19e-39d991999b6b req-e1a1c426-8b8d-46b6-bea7-44f04c4f1081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aba4054-8908-476e-b8a7-7f6ef9675db1", "tag": "c68434dc-d68d-438e-8cd8-aeeaf751ea02"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:28.655600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ecba4c8e-ee25-45ba-a19e-39d991999b6b req-e1a1c426-8b8d-46b6-bea7-44f04c4f1081 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:28.656422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ecba4c8e-ee25-45ba-a19e-39d991999b6b req-e1a1c426-8b8d-46b6-bea7-44f04c4f1081 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:28.657209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ecba4c8e-ee25-45ba-a19e-39d991999b6b req-e1a1c426-8b8d-46b6-bea7-44f04c4f1081 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:28.673534 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ecba4c8e-ee25-45ba-a19e-39d991999b6b req-e1a1c426-8b8d-46b6-bea7-44f04c4f1081 service nova] Creating event network-changed:c68434dc-d68d-438e-8cd8-aeeaf751ea02 for instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 on n-h1-856894-1 Sep 10 11:16:28.679661 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ecba4c8e-ee25-45ba-a19e-39d991999b6b req-e1a1c426-8b8d-46b6-bea7-44f04c4f1081 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043618 Sep 10 11:16:28.681111 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4078/5840] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:29.349304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d324716a-ce47-4b19-bfb2-bf101e386bf3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:29.349948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d324716a-ce47-4b19-bfb2-bf101e386bf3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:29.357507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d324716a-ce47-4b19-bfb2-bf101e386bf3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:29.357918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d324716a-ce47-4b19-bfb2-bf101e386bf3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:29.358378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d324716a-ce47-4b19-bfb2-bf101e386bf3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:29.359081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d324716a-ce47-4b19-bfb2-bf101e386bf3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:29.359538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d324716a-ce47-4b19-bfb2-bf101e386bf3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:29.359966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d324716a-ce47-4b19-bfb2-bf101e386bf3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:29.515567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d324716a-ce47-4b19-bfb2-bf101e386bf3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:29.522137 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d324716a-ce47-4b19-bfb2-bf101e386bf3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1392 microversion: 2.1 time: 0.176964 Sep 10 11:16:29.522939 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1763/5841] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:29 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:30.549257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a74dea6-0f5c-4a98-8010-eb842090ef81 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:30.549993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a74dea6-0f5c-4a98-8010-eb842090ef81 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:30.557746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a74dea6-0f5c-4a98-8010-eb842090ef81 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:30.558254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a74dea6-0f5c-4a98-8010-eb842090ef81 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:30.559010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a74dea6-0f5c-4a98-8010-eb842090ef81 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:30.559823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a74dea6-0f5c-4a98-8010-eb842090ef81 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:30.560371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a74dea6-0f5c-4a98-8010-eb842090ef81 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:30.561047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a74dea6-0f5c-4a98-8010-eb842090ef81 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:30.716075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a74dea6-0f5c-4a98-8010-eb842090ef81 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:30.724359 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a74dea6-0f5c-4a98-8010-eb842090ef81 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1392 microversion: 2.1 time: 0.182576 Sep 10 11:16:30.741996 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4079/5842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:30 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:31.749800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-14d9685b-9f32-41a3-930a-93e472130aaa tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:31.750427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-14d9685b-9f32-41a3-930a-93e472130aaa tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:31.757580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14d9685b-9f32-41a3-930a-93e472130aaa tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:31.758074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14d9685b-9f32-41a3-930a-93e472130aaa tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:31.758517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14d9685b-9f32-41a3-930a-93e472130aaa tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:31.759216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14d9685b-9f32-41a3-930a-93e472130aaa tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:31.759673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14d9685b-9f32-41a3-930a-93e472130aaa tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:31.760689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-14d9685b-9f32-41a3-930a-93e472130aaa tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:31.908068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-14d9685b-9f32-41a3-930a-93e472130aaa tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:31.916249 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-14d9685b-9f32-41a3-930a-93e472130aaa tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1392 microversion: 2.1 time: 0.170295 Sep 10 11:16:31.916925 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1764/5843] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:31 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:16:32.515586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f09643aa-0f91-4e33-a8a4-8c90e0e2e3b4 req-7ddb4078-e8c2-4466-acd0-38588b0a6aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aba4054-8908-476e-b8a7-7f6ef9675db1", "name": "network-vif-plugged", "status": "completed", "tag": "c68434dc-d68d-438e-8cd8-aeeaf751ea02"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:32.529900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f09643aa-0f91-4e33-a8a4-8c90e0e2e3b4 req-7ddb4078-e8c2-4466-acd0-38588b0a6aa3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:32.530399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f09643aa-0f91-4e33-a8a4-8c90e0e2e3b4 req-7ddb4078-e8c2-4466-acd0-38588b0a6aa3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:32.530846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f09643aa-0f91-4e33-a8a4-8c90e0e2e3b4 req-7ddb4078-e8c2-4466-acd0-38588b0a6aa3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:32.550041 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f09643aa-0f91-4e33-a8a4-8c90e0e2e3b4 req-7ddb4078-e8c2-4466-acd0-38588b0a6aa3 service nova] Creating event network-vif-plugged:c68434dc-d68d-438e-8cd8-aeeaf751ea02 for instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 on n-h1-856894-1 Sep 10 11:16:32.556312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f09643aa-0f91-4e33-a8a4-8c90e0e2e3b4 req-7ddb4078-e8c2-4466-acd0-38588b0a6aa3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200770 Sep 10 11:16:32.557459 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4080/5844] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:32.939346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5bfe48fc-2c24-49da-bda1-178132feb589 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:32.940562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5bfe48fc-2c24-49da-bda1-178132feb589 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:32.948307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bfe48fc-2c24-49da-bda1-178132feb589 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:32.948794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bfe48fc-2c24-49da-bda1-178132feb589 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:32.949260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bfe48fc-2c24-49da-bda1-178132feb589 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:32.949955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bfe48fc-2c24-49da-bda1-178132feb589 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:32.950444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bfe48fc-2c24-49da-bda1-178132feb589 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:32.950856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5bfe48fc-2c24-49da-bda1-178132feb589 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:33.094075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5bfe48fc-2c24-49da-bda1-178132feb589 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:33.101982 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5bfe48fc-2c24-49da-bda1-178132feb589 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1392 microversion: 2.1 time: 0.166528 Sep 10 11:16:33.102566 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1765/5845] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:32 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:34.126549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5c240068-f5be-4cc7-8939-7b65ee2d0f1d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:34.128724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5c240068-f5be-4cc7-8939-7b65ee2d0f1d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:34.136464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c240068-f5be-4cc7-8939-7b65ee2d0f1d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:34.137141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c240068-f5be-4cc7-8939-7b65ee2d0f1d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:34.138072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c240068-f5be-4cc7-8939-7b65ee2d0f1d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:34.138938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c240068-f5be-4cc7-8939-7b65ee2d0f1d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:34.139865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c240068-f5be-4cc7-8939-7b65ee2d0f1d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:34.140312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c240068-f5be-4cc7-8939-7b65ee2d0f1d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:34.409246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5c240068-f5be-4cc7-8939-7b65ee2d0f1d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:34.417514 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5c240068-f5be-4cc7-8939-7b65ee2d0f1d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1565 microversion: 2.1 time: 0.295686 Sep 10 11:16:34.418115 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4081/5846] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:34 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1565 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:34.442423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4c2e1e40-be1b-4a53-b7a2-6bf1439cae86 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:34.443199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4c2e1e40-be1b-4a53-b7a2-6bf1439cae86 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:34.446017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:34.447061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:34.453997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c2e1e40-be1b-4a53-b7a2-6bf1439cae86 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:34.454489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c2e1e40-be1b-4a53-b7a2-6bf1439cae86 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:34.454935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c2e1e40-be1b-4a53-b7a2-6bf1439cae86 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:34.455804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c2e1e40-be1b-4a53-b7a2-6bf1439cae86 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:34.456330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c2e1e40-be1b-4a53-b7a2-6bf1439cae86 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:34.456784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c2e1e40-be1b-4a53-b7a2-6bf1439cae86 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:34.629971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4c2e1e40-be1b-4a53-b7a2-6bf1439cae86 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:34.638322 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4c2e1e40-be1b-4a53-b7a2-6bf1439cae86 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1565 microversion: 2.1 time: 0.199796 Sep 10 11:16:34.638907 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1766/5847] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:34 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1565 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:36.430408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8703acad-87c5-429c-90bc-191512916f79 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:36.431178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8703acad-87c5-429c-90bc-191512916f79 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:36.432391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-45689f2f-19a1-4372-ba59-7bf5c2830f06 req-9f77b909-1ca9-4439-ac5d-f396b2f667cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aba4054-8908-476e-b8a7-7f6ef9675db1", "tag": "c68434dc-d68d-438e-8cd8-aeeaf751ea02"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:36.433970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:36.440998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8703acad-87c5-429c-90bc-191512916f79 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:36.441597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8703acad-87c5-429c-90bc-191512916f79 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:36.442057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8703acad-87c5-429c-90bc-191512916f79 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:36.442779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8703acad-87c5-429c-90bc-191512916f79 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:36.443334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8703acad-87c5-429c-90bc-191512916f79 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:36.444047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8703acad-87c5-429c-90bc-191512916f79 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:36.448423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-45689f2f-19a1-4372-ba59-7bf5c2830f06 req-9f77b909-1ca9-4439-ac5d-f396b2f667cc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:36.448912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-45689f2f-19a1-4372-ba59-7bf5c2830f06 req-9f77b909-1ca9-4439-ac5d-f396b2f667cc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:36.449371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-45689f2f-19a1-4372-ba59-7bf5c2830f06 req-9f77b909-1ca9-4439-ac5d-f396b2f667cc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:36.464858 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-45689f2f-19a1-4372-ba59-7bf5c2830f06 req-9f77b909-1ca9-4439-ac5d-f396b2f667cc service nova] Creating event network-changed:c68434dc-d68d-438e-8cd8-aeeaf751ea02 for instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 on n-h1-856894-1 Sep 10 11:16:36.472668 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-45689f2f-19a1-4372-ba59-7bf5c2830f06 req-9f77b909-1ca9-4439-ac5d-f396b2f667cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044286 Sep 10 11:16:36.476715 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1767/5848] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:16:36.753991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8703acad-87c5-429c-90bc-191512916f79 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:36.766586 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8703acad-87c5-429c-90bc-191512916f79 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1565 microversion: 2.1 time: 0.340786 Sep 10 11:16:36.767754 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4082/5849] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:36 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1565 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:50.814881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:50.816057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=40 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:50.816351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:50.817244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=28 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:16:50.821054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0784638e-e39b-4b91-8a27-91f281004a85 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:50.821433 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e65f6a62-629e-4530-a183-eb3a6c7474cd req-736a4efc-3720-4ecd-8a29-fd4d0b8f78a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b92510e1-0608-41b0-9481-2ce7dc56803c", "tag": "9ef3e588-1377-415c-b1bf-65da7b6399ab"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:50.824788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0784638e-e39b-4b91-8a27-91f281004a85 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:50.834651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0784638e-e39b-4b91-8a27-91f281004a85 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:50.835172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0784638e-e39b-4b91-8a27-91f281004a85 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:50.835609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0784638e-e39b-4b91-8a27-91f281004a85 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:50.836305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0784638e-e39b-4b91-8a27-91f281004a85 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:50.836759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0784638e-e39b-4b91-8a27-91f281004a85 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:50.837207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0784638e-e39b-4b91-8a27-91f281004a85 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:50.848156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e65f6a62-629e-4530-a183-eb3a6c7474cd req-736a4efc-3720-4ecd-8a29-fd4d0b8f78a5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:50.848915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e65f6a62-629e-4530-a183-eb3a6c7474cd req-736a4efc-3720-4ecd-8a29-fd4d0b8f78a5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:50.849816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e65f6a62-629e-4530-a183-eb3a6c7474cd req-736a4efc-3720-4ecd-8a29-fd4d0b8f78a5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:50.862982 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e65f6a62-629e-4530-a183-eb3a6c7474cd req-736a4efc-3720-4ecd-8a29-fd4d0b8f78a5 service nova] Creating event network-changed:9ef3e588-1377-415c-b1bf-65da7b6399ab for instance b92510e1-0608-41b0-9481-2ce7dc56803c on n-h2-856894-1 Sep 10 11:16:50.866659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0784638e-e39b-4b91-8a27-91f281004a85 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:16:50.868348 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e65f6a62-629e-4530-a183-eb3a6c7474cd req-736a4efc-3720-4ecd-8a29-fd4d0b8f78a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053290 Sep 10 11:16:50.869571 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4083/5850] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:16:50.975209 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0784638e-e39b-4b91-8a27-91f281004a85 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 204 len: 0 microversion: 2.1 time: 0.162418 Sep 10 11:16:50.976265 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1768/5851] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:16:50 2022] DELETE /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:16:50.986024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df9eaa1e-169c-4069-8701-d498856dc945 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:50.986755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-df9eaa1e-169c-4069-8701-d498856dc945 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:50.994553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df9eaa1e-169c-4069-8701-d498856dc945 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:50.995343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df9eaa1e-169c-4069-8701-d498856dc945 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:50.995970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df9eaa1e-169c-4069-8701-d498856dc945 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:50.996869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df9eaa1e-169c-4069-8701-d498856dc945 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:50.997677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df9eaa1e-169c-4069-8701-d498856dc945 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:50.999327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-df9eaa1e-169c-4069-8701-d498856dc945 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:51.183152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-df9eaa1e-169c-4069-8701-d498856dc945 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:51.191843 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-df9eaa1e-169c-4069-8701-d498856dc945 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1577 microversion: 2.1 time: 0.210065 Sep 10 11:16:51.193182 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4084/5852] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:50 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:52.216332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d7c5db33-3a0b-4d8f-9265-b90f7d21f6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:52.217024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d7c5db33-3a0b-4d8f-9265-b90f7d21f6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:52.227334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7c5db33-3a0b-4d8f-9265-b90f7d21f6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:52.227941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7c5db33-3a0b-4d8f-9265-b90f7d21f6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:52.229652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7c5db33-3a0b-4d8f-9265-b90f7d21f6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:52.231637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7c5db33-3a0b-4d8f-9265-b90f7d21f6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:52.232504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7c5db33-3a0b-4d8f-9265-b90f7d21f6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:52.232968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7c5db33-3a0b-4d8f-9265-b90f7d21f6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:52.488862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d7c5db33-3a0b-4d8f-9265-b90f7d21f6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:52.498003 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d7c5db33-3a0b-4d8f-9265-b90f7d21f6ad tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1577 microversion: 2.1 time: 0.285665 Sep 10 11:16:52.498910 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1769/5853] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:52 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1577 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:53.184254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-44d6e93f-7b78-4097-a62d-5fc84f65da1d req-da4084e3-20be-4991-8450-5c2d6a4ea2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92510e1-0608-41b0-9481-2ce7dc56803c", "name": "network-vif-deleted", "tag": "9ef3e588-1377-415c-b1bf-65da7b6399ab"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:53.194497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-44d6e93f-7b78-4097-a62d-5fc84f65da1d req-da4084e3-20be-4991-8450-5c2d6a4ea2e6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:53.194977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-44d6e93f-7b78-4097-a62d-5fc84f65da1d req-da4084e3-20be-4991-8450-5c2d6a4ea2e6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:53.195508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-44d6e93f-7b78-4097-a62d-5fc84f65da1d req-da4084e3-20be-4991-8450-5c2d6a4ea2e6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:53.209121 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-44d6e93f-7b78-4097-a62d-5fc84f65da1d req-da4084e3-20be-4991-8450-5c2d6a4ea2e6 service nova] Creating event network-vif-deleted:9ef3e588-1377-415c-b1bf-65da7b6399ab for instance b92510e1-0608-41b0-9481-2ce7dc56803c on n-h2-856894-1 Sep 10 11:16:53.215877 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-44d6e93f-7b78-4097-a62d-5fc84f65da1d req-da4084e3-20be-4991-8450-5c2d6a4ea2e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035706 Sep 10 11:16:53.216865 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4085/5854] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:16:53.527067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e65bd236-64ad-4426-b4f4-7e8053cc05e4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:53.528360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e65bd236-64ad-4426-b4f4-7e8053cc05e4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:53.536580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e65bd236-64ad-4426-b4f4-7e8053cc05e4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:53.537421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e65bd236-64ad-4426-b4f4-7e8053cc05e4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:53.538105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e65bd236-64ad-4426-b4f4-7e8053cc05e4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:53.539045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e65bd236-64ad-4426-b4f4-7e8053cc05e4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:53.539708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e65bd236-64ad-4426-b4f4-7e8053cc05e4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:53.540343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e65bd236-64ad-4426-b4f4-7e8053cc05e4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:53.622992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e65bd236-64ad-4426-b4f4-7e8053cc05e4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:53.634478 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e65bd236-64ad-4426-b4f4-7e8053cc05e4 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1225 microversion: 2.1 time: 0.115902 Sep 10 11:16:53.636275 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1770/5855] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:53 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:54.659255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dba0e753-23a1-4c2e-bb32-4b477a59e63e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:54.660067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dba0e753-23a1-4c2e-bb32-4b477a59e63e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:54.674475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dba0e753-23a1-4c2e-bb32-4b477a59e63e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:54.675588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dba0e753-23a1-4c2e-bb32-4b477a59e63e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:54.676052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dba0e753-23a1-4c2e-bb32-4b477a59e63e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:54.676767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dba0e753-23a1-4c2e-bb32-4b477a59e63e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:54.677264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dba0e753-23a1-4c2e-bb32-4b477a59e63e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:54.677703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dba0e753-23a1-4c2e-bb32-4b477a59e63e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:54.751920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dba0e753-23a1-4c2e-bb32-4b477a59e63e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:54.762563 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dba0e753-23a1-4c2e-bb32-4b477a59e63e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1225 microversion: 2.1 time: 0.107755 Sep 10 11:16:54.772373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4086/5856] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:54 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:55.791311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-68f9c035-aa43-4aaf-a067-4c42333e0cc3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:55.792970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-68f9c035-aa43-4aaf-a067-4c42333e0cc3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:55.802415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68f9c035-aa43-4aaf-a067-4c42333e0cc3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:55.803953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68f9c035-aa43-4aaf-a067-4c42333e0cc3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:55.804573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68f9c035-aa43-4aaf-a067-4c42333e0cc3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:55.805353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68f9c035-aa43-4aaf-a067-4c42333e0cc3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:55.805834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68f9c035-aa43-4aaf-a067-4c42333e0cc3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:55.806259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-68f9c035-aa43-4aaf-a067-4c42333e0cc3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:55.874158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-68f9c035-aa43-4aaf-a067-4c42333e0cc3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:55.882770 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-68f9c035-aa43-4aaf-a067-4c42333e0cc3 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1225 microversion: 2.1 time: 0.099984 Sep 10 11:16:55.884121 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1771/5857] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:55 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:56.906946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-29c98d18-08f3-4698-abd7-d16335c06408 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:56.907570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-29c98d18-08f3-4698-abd7-d16335c06408 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:56.914605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29c98d18-08f3-4698-abd7-d16335c06408 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:56.915107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29c98d18-08f3-4698-abd7-d16335c06408 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:56.915818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29c98d18-08f3-4698-abd7-d16335c06408 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:56.916540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29c98d18-08f3-4698-abd7-d16335c06408 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:56.917052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29c98d18-08f3-4698-abd7-d16335c06408 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:56.917584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29c98d18-08f3-4698-abd7-d16335c06408 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:56.988878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-29c98d18-08f3-4698-abd7-d16335c06408 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:16:56.997699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-29c98d18-08f3-4698-abd7-d16335c06408 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 200 len: 1225 microversion: 2.1 time: 0.094528 Sep 10 11:16:56.998627 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4087/5858] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:56 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:16:58.021128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:16:58.021743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: b92510e1-0608-41b0-9481-2ce7dc56803c] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:58.028705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:58.029221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:58.029661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:58.030346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:58.030798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:58.031223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:58.045251 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance b92510e1-0608-41b0-9481-2ce7dc56803c could not be found. Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c HTTP/1.1 Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance b92510e1-0608-41b0-9481-2ce7dc56803c could not be found. Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'b92510e1-0608-41b0-9481-2ce7dc56803c'} Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92510e1-0608-41b0-9481-2ce7dc56803c could not be found. Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92510e1-0608-41b0-9481-2ce7dc56803c could not be found. Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:16:58.046894 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:16:58.052376 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:16:58.052376 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:16:58.052376 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:16:58.052376 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:16:58.052376 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:16:58.052376 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92510e1-0608-41b0-9481-2ce7dc56803c could not be found. Sep 10 11:16:58.052376 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:16:58.052376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance b92510e1-0608-41b0-9481-2ce7dc56803c could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:16:58.052376 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-014f84f8-76c6-4541-b39c-a5f89e2780f1 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c" status: 404 len: 111 microversion: 2.1 time: 0.031021 Sep 10 11:16:58.052376 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1772/5859] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:16:58 2022] GET /compute/v2.1/servers/b92510e1-0608-41b0-9481-2ce7dc56803c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:16:58.151220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f5ba122-14f5-4247-af16-43484dcd786c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:16:58.156139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f5ba122-14f5-4247-af16-43484dcd786c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:16:58.165234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5ba122-14f5-4247-af16-43484dcd786c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:58.165994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5ba122-14f5-4247-af16-43484dcd786c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:58.167051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5ba122-14f5-4247-af16-43484dcd786c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:58.167838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5ba122-14f5-4247-af16-43484dcd786c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:16:58.168314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5ba122-14f5-4247-af16-43484dcd786c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:16:58.168753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5ba122-14f5-4247-af16-43484dcd786c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:16:58.247607 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f5ba122-14f5-4247-af16-43484dcd786c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1/action" status: 200 len: 24571 microversion: 2.1 time: 0.100506 Sep 10 11:16:58.252448 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4088/5860] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:16:58 2022] POST /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1/action => generated 24571 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:17:04.646875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-acad4473-54b6-4ff2-a806-ac75041df94e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:04.647492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-acad4473-54b6-4ff2-a806-ac75041df94e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:04.649209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-13e5ecef-8c6a-4a6e-a884-5fe3c7411e46 req-6b20015b-6a13-4f6a-8698-23f7a7238be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52301294-2a27-4b7d-9bf2-41c5594f53a9", "tag": "c73dea59-dfd7-4e75-9cec-9c64481e96b5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:17:04.656003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acad4473-54b6-4ff2-a806-ac75041df94e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:04.656625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acad4473-54b6-4ff2-a806-ac75041df94e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:04.657202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acad4473-54b6-4ff2-a806-ac75041df94e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:04.658006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acad4473-54b6-4ff2-a806-ac75041df94e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:04.658687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acad4473-54b6-4ff2-a806-ac75041df94e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:04.659235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-acad4473-54b6-4ff2-a806-ac75041df94e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:04.660819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-13e5ecef-8c6a-4a6e-a884-5fe3c7411e46 req-6b20015b-6a13-4f6a-8698-23f7a7238be0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:04.661555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-13e5ecef-8c6a-4a6e-a884-5fe3c7411e46 req-6b20015b-6a13-4f6a-8698-23f7a7238be0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:04.662012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-13e5ecef-8c6a-4a6e-a884-5fe3c7411e46 req-6b20015b-6a13-4f6a-8698-23f7a7238be0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:04.674921 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-13e5ecef-8c6a-4a6e-a884-5fe3c7411e46 req-6b20015b-6a13-4f6a-8698-23f7a7238be0 service nova] Creating event network-changed:c73dea59-dfd7-4e75-9cec-9c64481e96b5 for instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 on n-h1-856894-1 Sep 10 11:17:04.680038 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-13e5ecef-8c6a-4a6e-a884-5fe3c7411e46 req-6b20015b-6a13-4f6a-8698-23f7a7238be0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035068 Sep 10 11:17:04.680865 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4089/5861] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:17:04.696735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-acad4473-54b6-4ff2-a806-ac75041df94e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:17:04.780729 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-acad4473-54b6-4ff2-a806-ac75041df94e tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 204 len: 0 microversion: 2.1 time: 0.137634 Sep 10 11:17:04.781987 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1773/5862] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:17:04 2022] DELETE /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:17:04.791982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c0ddc0cc-d20d-4d8a-b650-be8a13e91949 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:04.792769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c0ddc0cc-d20d-4d8a-b650-be8a13e91949 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:04.809396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ddc0cc-d20d-4d8a-b650-be8a13e91949 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:04.809922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ddc0cc-d20d-4d8a-b650-be8a13e91949 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:04.811690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ddc0cc-d20d-4d8a-b650-be8a13e91949 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:04.812480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ddc0cc-d20d-4d8a-b650-be8a13e91949 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:04.812957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ddc0cc-d20d-4d8a-b650-be8a13e91949 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:04.814483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c0ddc0cc-d20d-4d8a-b650-be8a13e91949 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:04.993200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c0ddc0cc-d20d-4d8a-b650-be8a13e91949 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:05.003160 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c0ddc0cc-d20d-4d8a-b650-be8a13e91949 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1578 microversion: 2.1 time: 0.216633 Sep 10 11:17:05.004025 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4090/5863] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:04 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:06.027635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e34662d-1e84-4d53-bdbc-37f1164ca6ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:06.028465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1e34662d-1e84-4d53-bdbc-37f1164ca6ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:06.035448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e34662d-1e84-4d53-bdbc-37f1164ca6ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:06.036024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e34662d-1e84-4d53-bdbc-37f1164ca6ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:06.036530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e34662d-1e84-4d53-bdbc-37f1164ca6ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:06.037322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e34662d-1e84-4d53-bdbc-37f1164ca6ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:06.037847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e34662d-1e84-4d53-bdbc-37f1164ca6ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:06.038341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e34662d-1e84-4d53-bdbc-37f1164ca6ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:06.349574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1e34662d-1e84-4d53-bdbc-37f1164ca6ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:06.358417 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1e34662d-1e84-4d53-bdbc-37f1164ca6ee tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1578 microversion: 2.1 time: 0.335725 Sep 10 11:17:06.359553 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1774/5864] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:06 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1578 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:06.892590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a00298a0-c0fb-499f-a397-4b6c49920e8f req-5e910930-f4f7-4ade-8dd6-a89ce107faa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52301294-2a27-4b7d-9bf2-41c5594f53a9", "name": "network-vif-deleted", "tag": "c73dea59-dfd7-4e75-9cec-9c64481e96b5"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:17:06.909645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a00298a0-c0fb-499f-a397-4b6c49920e8f req-5e910930-f4f7-4ade-8dd6-a89ce107faa9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:06.910160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a00298a0-c0fb-499f-a397-4b6c49920e8f req-5e910930-f4f7-4ade-8dd6-a89ce107faa9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:06.910602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a00298a0-c0fb-499f-a397-4b6c49920e8f req-5e910930-f4f7-4ade-8dd6-a89ce107faa9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:06.924232 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a00298a0-c0fb-499f-a397-4b6c49920e8f req-5e910930-f4f7-4ade-8dd6-a89ce107faa9 service nova] Creating event network-vif-deleted:c73dea59-dfd7-4e75-9cec-9c64481e96b5 for instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 on n-h1-856894-1 Sep 10 11:17:06.929065 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a00298a0-c0fb-499f-a397-4b6c49920e8f req-5e910930-f4f7-4ade-8dd6-a89ce107faa9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040419 Sep 10 11:17:06.929699 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4091/5865] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:17:07.393899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7dc5fc3b-a78e-4cbb-958b-0969b711e1c2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:07.394910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7dc5fc3b-a78e-4cbb-958b-0969b711e1c2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:07.403871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc5fc3b-a78e-4cbb-958b-0969b711e1c2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:07.404758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc5fc3b-a78e-4cbb-958b-0969b711e1c2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:07.405427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc5fc3b-a78e-4cbb-958b-0969b711e1c2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:07.406232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc5fc3b-a78e-4cbb-958b-0969b711e1c2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:07.406908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc5fc3b-a78e-4cbb-958b-0969b711e1c2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:07.407542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc5fc3b-a78e-4cbb-958b-0969b711e1c2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:07.478500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7dc5fc3b-a78e-4cbb-958b-0969b711e1c2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:07.489024 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7dc5fc3b-a78e-4cbb-958b-0969b711e1c2 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1226 microversion: 2.1 time: 0.101063 Sep 10 11:17:07.489999 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1775/5866] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:07 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:08.514792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a66a4ca5-0560-4a17-8d3a-0f2941f7e800 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:08.516406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a66a4ca5-0560-4a17-8d3a-0f2941f7e800 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:08.525115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66a4ca5-0560-4a17-8d3a-0f2941f7e800 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:08.525856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66a4ca5-0560-4a17-8d3a-0f2941f7e800 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:08.526679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66a4ca5-0560-4a17-8d3a-0f2941f7e800 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:08.527566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66a4ca5-0560-4a17-8d3a-0f2941f7e800 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:08.528278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66a4ca5-0560-4a17-8d3a-0f2941f7e800 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:08.528917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a66a4ca5-0560-4a17-8d3a-0f2941f7e800 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:08.603422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a66a4ca5-0560-4a17-8d3a-0f2941f7e800 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:08.611728 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a66a4ca5-0560-4a17-8d3a-0f2941f7e800 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1226 microversion: 2.1 time: 0.102377 Sep 10 11:17:08.612393 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4092/5867] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:08 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:09.349204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-50fa4cec-78a3-4c42-b4c6-5b190ba3ba3d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:09.349991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-50fa4cec-78a3-4c42-b4c6-5b190ba3ba3d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:09.357395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50fa4cec-78a3-4c42-b4c6-5b190ba3ba3d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:09.357892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50fa4cec-78a3-4c42-b4c6-5b190ba3ba3d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:09.358330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50fa4cec-78a3-4c42-b4c6-5b190ba3ba3d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:09.359040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50fa4cec-78a3-4c42-b4c6-5b190ba3ba3d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:09.359492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50fa4cec-78a3-4c42-b4c6-5b190ba3ba3d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:09.359947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50fa4cec-78a3-4c42-b4c6-5b190ba3ba3d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:09.623242 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-50fa4cec-78a3-4c42-b4c6-5b190ba3ba3d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1834 microversion: 2.1 time: 0.277407 Sep 10 11:17:09.626376 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1776/5868] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:09 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1834 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:09.644102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3eb06bfb-0743-495d-ba97-2cbe686da8e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:09.644767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3eb06bfb-0743-495d-ba97-2cbe686da8e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:09.652814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb06bfb-0743-495d-ba97-2cbe686da8e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:09.653591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb06bfb-0743-495d-ba97-2cbe686da8e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:09.654219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb06bfb-0743-495d-ba97-2cbe686da8e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:09.655134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb06bfb-0743-495d-ba97-2cbe686da8e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:09.656016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb06bfb-0743-495d-ba97-2cbe686da8e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:09.656659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-049e27aa-1758-4280-a461-60059a85aaea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:09.657644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-049e27aa-1758-4280-a461-60059a85aaea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:09.658067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3eb06bfb-0743-495d-ba97-2cbe686da8e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:09.675425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-049e27aa-1758-4280-a461-60059a85aaea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:09.676355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-049e27aa-1758-4280-a461-60059a85aaea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:09.677004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-049e27aa-1758-4280-a461-60059a85aaea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:09.677935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-049e27aa-1758-4280-a461-60059a85aaea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:09.678595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-049e27aa-1758-4280-a461-60059a85aaea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:09.679020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-049e27aa-1758-4280-a461-60059a85aaea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:09.763747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3eb06bfb-0743-495d-ba97-2cbe686da8e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:09.773315 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3eb06bfb-0743-495d-ba97-2cbe686da8e9 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1226 microversion: 2.1 time: 0.133180 Sep 10 11:17:09.774645 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4093/5869] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:09 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:09.854453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-049e27aa-1758-4280-a461-60059a85aaea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:09.862769 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-049e27aa-1758-4280-a461-60059a85aaea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1683 microversion: 2.1 time: 0.211930 Sep 10 11:17:09.863434 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1777/5870] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:09 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:17:09.978227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-11b326ae-270f-421f-91ec-d1cc1a01ce6b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:17:09.980499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-11b326ae-270f-421f-91ec-d1cc1a01ce6b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:09.986778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11b326ae-270f-421f-91ec-d1cc1a01ce6b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:09.987389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11b326ae-270f-421f-91ec-d1cc1a01ce6b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:09.987854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11b326ae-270f-421f-91ec-d1cc1a01ce6b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:09.988571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11b326ae-270f-421f-91ec-d1cc1a01ce6b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:09.989044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11b326ae-270f-421f-91ec-d1cc1a01ce6b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:09.989512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11b326ae-270f-421f-91ec-d1cc1a01ce6b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:10.041807 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-11b326ae-270f-421f-91ec-d1cc1a01ce6b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1/action" status: 200 len: 32641 microversion: 2.1 time: 0.067236 Sep 10 11:17:10.042923 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4094/5871] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:17:09 2022] POST /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1/action => generated 32641 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:17:10.217385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:17:10.218282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:10.224924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:10.225464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:10.225904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:10.226644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:10.227111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:10.227542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:10.327551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6404ccb62eb7497c8ec33b14a5a79f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ffd2a9ef2b4001b78dccb298a510e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:10.328390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] flavor_id is None. Assuming migration. {{(pid=128787) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 11:17:10.328970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128787) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:17:10.497520 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-92ed7c88-cc18-40eb-b0d1-df196aa42066 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1/action" status: 202 len: 0 microversion: 2.1 time: 0.284241 Sep 10 11:17:10.498501 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1778/5872] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:17:10 2022] POST /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:17:10.507283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cae5cbc7-9de9-4925-a82b-cca7dfcacc17 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:10.508339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cae5cbc7-9de9-4925-a82b-cca7dfcacc17 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:10.517233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cae5cbc7-9de9-4925-a82b-cca7dfcacc17 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:10.518049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cae5cbc7-9de9-4925-a82b-cca7dfcacc17 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:10.518734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cae5cbc7-9de9-4925-a82b-cca7dfcacc17 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:10.519673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cae5cbc7-9de9-4925-a82b-cca7dfcacc17 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:10.520357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cae5cbc7-9de9-4925-a82b-cca7dfcacc17 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:10.521043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cae5cbc7-9de9-4925-a82b-cca7dfcacc17 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:10.714537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cae5cbc7-9de9-4925-a82b-cca7dfcacc17 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:10.723194 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cae5cbc7-9de9-4925-a82b-cca7dfcacc17 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1692 microversion: 2.1 time: 0.220042 Sep 10 11:17:10.737665 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4095/5873] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:10 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1692 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:10.797607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b7f6af99-30db-44f2-8fb0-e2b57ddc0d94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:10.798930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b7f6af99-30db-44f2-8fb0-e2b57ddc0d94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:10.805832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f6af99-30db-44f2-8fb0-e2b57ddc0d94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:10.806428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f6af99-30db-44f2-8fb0-e2b57ddc0d94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:10.806988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f6af99-30db-44f2-8fb0-e2b57ddc0d94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:10.807928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f6af99-30db-44f2-8fb0-e2b57ddc0d94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:10.808690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f6af99-30db-44f2-8fb0-e2b57ddc0d94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:10.809259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7f6af99-30db-44f2-8fb0-e2b57ddc0d94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:10.896268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b7f6af99-30db-44f2-8fb0-e2b57ddc0d94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78004185356641b990a951dc95e6ca0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86907574971943a2b584ef3fecdb5965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:10.904958 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b7f6af99-30db-44f2-8fb0-e2b57ddc0d94 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 200 len: 1226 microversion: 2.1 time: 0.112239 Sep 10 11:17:10.905593 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1779/5874] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:10 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:11.750542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c977c521-e1de-4bd9-af7a-89d03af6a7d6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:11.751176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c977c521-e1de-4bd9-af7a-89d03af6a7d6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:11.758802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c977c521-e1de-4bd9-af7a-89d03af6a7d6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:11.759310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c977c521-e1de-4bd9-af7a-89d03af6a7d6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:11.760289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c977c521-e1de-4bd9-af7a-89d03af6a7d6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:11.760998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c977c521-e1de-4bd9-af7a-89d03af6a7d6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:11.761560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c977c521-e1de-4bd9-af7a-89d03af6a7d6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:11.762005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c977c521-e1de-4bd9-af7a-89d03af6a7d6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:11.898786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c977c521-e1de-4bd9-af7a-89d03af6a7d6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:11.908933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c977c521-e1de-4bd9-af7a-89d03af6a7d6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1692 microversion: 2.1 time: 0.162156 Sep 10 11:17:11.909573 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4096/5875] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:11 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:11.929781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:11.930504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 52301294-2a27-4b7d-9bf2-41c5594f53a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:11.941254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:11.941861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:11.942459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:11.943534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:11.944218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:11.944690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:11.953829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:17:11.967354 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 could not be found. Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 HTTP/1.1 Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 could not be found. Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '52301294-2a27-4b7d-9bf2-41c5594f53a9'} Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 could not be found. Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 could not be found. Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:17:11.969681 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:17:11.974043 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:17:11.974043 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:17:11.974043 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:17:11.974043 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:17:11.974043 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:17:11.974043 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 could not be found. Sep 10 11:17:11.974043 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:17:11.974043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance 52301294-2a27-4b7d-9bf2-41c5594f53a9 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:17:11.974043 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-739f9839-8023-49af-89c7-ee09f4630e15 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9" status: 404 len: 111 microversion: 2.1 time: 0.045304 Sep 10 11:17:11.974043 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1780/5876] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:11 2022] GET /compute/v2.1/servers/52301294-2a27-4b7d-9bf2-41c5594f53a9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:17:12.459002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:12.459806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:12.467664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:12.468178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:12.468635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:12.469385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:12.469861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:12.470306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:12.484683 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 HTTP/1.1 Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '9c3c398a-6428-4e59-b945-77f5fafdb729'} Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:17:12.486568 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d55be60d-4d04-4cbc-ac83-b63e55d04688 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 404 len: 111 microversion: 2.1 time: 0.033217 Sep 10 11:17:12.491240 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4097/5877] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:17:12 2022] DELETE /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:17:12.496908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:12.497549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] [instance: 9c3c398a-6428-4e59-b945-77f5fafdb729] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:12.504142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:12.504627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:12.505057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:12.506412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:12.506875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:12.507300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:12.521671 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] HTTP exception thrown: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Request method failure captured: Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 HTTP/1.1 Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHG70stbhKkztnyTl3UEU20KbLFSIFZDxeSk75wVwhTo6BhNrJiTxHF8RplLNqtiEqWf6ndgguwA0BT7KSpNxkc-rOcE_-Hqw2-2-e7PoldEuTS-Fn8hzzx_Xhw-4i6KZnzSytIX_Pn_oSBIT1A7-5seVBhJEgM8sDfiY2d4-bt5w_6A Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86907574971943a2b584ef3fecdb5965"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86907574971943a2b584ef3fecdb5965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86907574971943a2b584ef3fecdb5965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 86907574971943a2b584ef3fecdb5965 Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1052923210 Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 78004185356641b990a951dc95e6ca0c Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestVolumeBootPattern-1052923210-project Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '9c3c398a-6428-4e59-b945-77f5fafdb729'} Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:17:12.523195 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:17:12.528597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:17:12.528597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:17:12.528597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:17:12.528597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:17:12.528597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:17:12.528597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. Sep 10 11:17:12.528597 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:17:12.529903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Returning 404 to user: Instance 9c3c398a-6428-4e59-b945-77f5fafdb729 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:17:12.530840 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1011519d-05a7-4a28-bb5d-95966b9b8a08 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729" status: 404 len: 111 microversion: 2.1 time: 0.037764 Sep 10 11:17:12.531432 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1781/5878] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:12 2022] GET /compute/v2.1/servers/9c3c398a-6428-4e59-b945-77f5fafdb729 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:17:12.933366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-394426e1-2557-4e59-8860-b3431d82e793 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:12.934156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-394426e1-2557-4e59-8860-b3431d82e793 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:12.941063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-394426e1-2557-4e59-8860-b3431d82e793 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:12.941729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-394426e1-2557-4e59-8860-b3431d82e793 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:12.942279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-394426e1-2557-4e59-8860-b3431d82e793 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:12.943098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-394426e1-2557-4e59-8860-b3431d82e793 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:12.943722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-394426e1-2557-4e59-8860-b3431d82e793 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:12.944236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-394426e1-2557-4e59-8860-b3431d82e793 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:13.126264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-394426e1-2557-4e59-8860-b3431d82e793 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:13.138304 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-394426e1-2557-4e59-8860-b3431d82e793 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1692 microversion: 2.1 time: 0.208847 Sep 10 11:17:13.139083 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4098/5879] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:12 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1692 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:14.162252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a19b7117-3b0d-49fe-b115-9ed9474e59be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:14.163275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a19b7117-3b0d-49fe-b115-9ed9474e59be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:14.171858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a19b7117-3b0d-49fe-b115-9ed9474e59be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:14.173002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a19b7117-3b0d-49fe-b115-9ed9474e59be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:14.173738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a19b7117-3b0d-49fe-b115-9ed9474e59be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:14.174629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a19b7117-3b0d-49fe-b115-9ed9474e59be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:14.175173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a19b7117-3b0d-49fe-b115-9ed9474e59be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:14.176397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a19b7117-3b0d-49fe-b115-9ed9474e59be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:14.334551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a19b7117-3b0d-49fe-b115-9ed9474e59be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:14.343572 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a19b7117-3b0d-49fe-b115-9ed9474e59be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1692 microversion: 2.1 time: 0.185363 Sep 10 11:17:14.344485 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1782/5880] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:14 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:15.368103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8961b6ec-d9a1-4b69-bc74-57e58d0844c2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:15.368657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8961b6ec-d9a1-4b69-bc74-57e58d0844c2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:15.376320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8961b6ec-d9a1-4b69-bc74-57e58d0844c2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:15.376819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8961b6ec-d9a1-4b69-bc74-57e58d0844c2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:15.377316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8961b6ec-d9a1-4b69-bc74-57e58d0844c2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:15.378024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8961b6ec-d9a1-4b69-bc74-57e58d0844c2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:15.378698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8961b6ec-d9a1-4b69-bc74-57e58d0844c2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:15.379136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8961b6ec-d9a1-4b69-bc74-57e58d0844c2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:15.559765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8961b6ec-d9a1-4b69-bc74-57e58d0844c2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:15.569327 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8961b6ec-d9a1-4b69-bc74-57e58d0844c2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1692 microversion: 2.1 time: 0.205230 Sep 10 11:17:15.570108 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4099/5881] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:15 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:15.978219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e8732ed3-7387-445b-bc1e-8504e12dd877 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] Calling method '.version_select at 0x7efcadbf0160>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:16.011688 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e8732ed3-7387-445b-bc1e-8504e12dd877 tempest-TestVolumeBootPattern-1052923210 tempest-TestVolumeBootPattern-1052923210-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1846616331" status: 202 len: 0 microversion: 2.1 time: 0.037157 Sep 10 11:17:16.018844 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1783/5882] 10.222.0.20 () {58 vars in 1263 bytes} [Sat Sep 10 11:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1846616331 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:17:16.599364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-97dd2455-3d85-47da-8575-15e0211571a2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:16.601102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-97dd2455-3d85-47da-8575-15e0211571a2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:16.622427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97dd2455-3d85-47da-8575-15e0211571a2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:16.623225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97dd2455-3d85-47da-8575-15e0211571a2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:16.623872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97dd2455-3d85-47da-8575-15e0211571a2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:16.625015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97dd2455-3d85-47da-8575-15e0211571a2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:16.625715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97dd2455-3d85-47da-8575-15e0211571a2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:16.626344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-97dd2455-3d85-47da-8575-15e0211571a2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:16.924769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-97dd2455-3d85-47da-8575-15e0211571a2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:16.937464 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-97dd2455-3d85-47da-8575-15e0211571a2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1692 microversion: 2.1 time: 0.346371 Sep 10 11:17:16.938897 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4100/5883] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:16 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1692 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:17.966385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3145ed18-ec00-49a0-832f-aaa72c6b15f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:17.967112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3145ed18-ec00-49a0-832f-aaa72c6b15f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:17.976360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3145ed18-ec00-49a0-832f-aaa72c6b15f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:17.976974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3145ed18-ec00-49a0-832f-aaa72c6b15f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:17.977538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3145ed18-ec00-49a0-832f-aaa72c6b15f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:17.980172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3145ed18-ec00-49a0-832f-aaa72c6b15f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:17.980172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3145ed18-ec00-49a0-832f-aaa72c6b15f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:17.982904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3145ed18-ec00-49a0-832f-aaa72c6b15f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:18.398209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3145ed18-ec00-49a0-832f-aaa72c6b15f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:18.408426 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3145ed18-ec00-49a0-832f-aaa72c6b15f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1697 microversion: 2.1 time: 0.449958 Sep 10 11:17:18.409913 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1784/5884] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:17 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1697 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:19.439400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23e895ef-a153-4c62-9b1e-d7d73d0690e2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:19.440054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23e895ef-a153-4c62-9b1e-d7d73d0690e2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:19.458353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e895ef-a153-4c62-9b1e-d7d73d0690e2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:19.458868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e895ef-a153-4c62-9b1e-d7d73d0690e2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:19.459336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e895ef-a153-4c62-9b1e-d7d73d0690e2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:19.460067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e895ef-a153-4c62-9b1e-d7d73d0690e2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:19.460560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e895ef-a153-4c62-9b1e-d7d73d0690e2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:19.461001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23e895ef-a153-4c62-9b1e-d7d73d0690e2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:19.642009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23e895ef-a153-4c62-9b1e-d7d73d0690e2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:19.653958 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23e895ef-a153-4c62-9b1e-d7d73d0690e2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1697 microversion: 2.1 time: 0.221854 Sep 10 11:17:19.655868 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4101/5885] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:19 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1697 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:20.680705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cdae337c-3463-4d9d-9cb2-07e341b14dbf tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:20.682202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cdae337c-3463-4d9d-9cb2-07e341b14dbf tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:20.688995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae337c-3463-4d9d-9cb2-07e341b14dbf tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:20.689649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae337c-3463-4d9d-9cb2-07e341b14dbf tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:20.690355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae337c-3463-4d9d-9cb2-07e341b14dbf tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:20.691175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae337c-3463-4d9d-9cb2-07e341b14dbf tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:20.691867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae337c-3463-4d9d-9cb2-07e341b14dbf tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:20.692608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdae337c-3463-4d9d-9cb2-07e341b14dbf tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:20.883803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cdae337c-3463-4d9d-9cb2-07e341b14dbf tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:20.892300 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cdae337c-3463-4d9d-9cb2-07e341b14dbf tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1697 microversion: 2.1 time: 0.216562 Sep 10 11:17:20.892900 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1785/5886] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:20 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1697 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:21.916619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21a94d93-687c-4d2c-b543-a09bdb85343f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:21.917857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21a94d93-687c-4d2c-b543-a09bdb85343f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:21.927413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=39 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:17:21.931933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a94d93-687c-4d2c-b543-a09bdb85343f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:21.935173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a94d93-687c-4d2c-b543-a09bdb85343f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:21.935861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a94d93-687c-4d2c-b543-a09bdb85343f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:21.936957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a94d93-687c-4d2c-b543-a09bdb85343f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:21.940222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a94d93-687c-4d2c-b543-a09bdb85343f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:21.941238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21a94d93-687c-4d2c-b543-a09bdb85343f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:21.980301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=91 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:17:22.234365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21a94d93-687c-4d2c-b543-a09bdb85343f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:22.241980 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21a94d93-687c-4d2c-b543-a09bdb85343f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1697 microversion: 2.1 time: 0.329619 Sep 10 11:17:22.256351 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4102/5887] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:21 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1697 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:23.272388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cb5031d0-ebdb-439c-9c04-16aa81e37ec7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:23.276357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cb5031d0-ebdb-439c-9c04-16aa81e37ec7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:23.280168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:17:23.285502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb5031d0-ebdb-439c-9c04-16aa81e37ec7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:23.286000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb5031d0-ebdb-439c-9c04-16aa81e37ec7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:23.286441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb5031d0-ebdb-439c-9c04-16aa81e37ec7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:23.287145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb5031d0-ebdb-439c-9c04-16aa81e37ec7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:23.287600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb5031d0-ebdb-439c-9c04-16aa81e37ec7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:23.288057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb5031d0-ebdb-439c-9c04-16aa81e37ec7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:23.844352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cb5031d0-ebdb-439c-9c04-16aa81e37ec7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:23.854891 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cb5031d0-ebdb-439c-9c04-16aa81e37ec7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1697 microversion: 2.1 time: 0.587627 Sep 10 11:17:23.857418 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1786/5888] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:23 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1697 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:24.879008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-24b8a966-6a98-4a40-857f-5d0c61987460 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:24.880322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-24b8a966-6a98-4a40-857f-5d0c61987460 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:24.887233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24b8a966-6a98-4a40-857f-5d0c61987460 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:24.887785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24b8a966-6a98-4a40-857f-5d0c61987460 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:24.888244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24b8a966-6a98-4a40-857f-5d0c61987460 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:24.888955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24b8a966-6a98-4a40-857f-5d0c61987460 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:24.889641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24b8a966-6a98-4a40-857f-5d0c61987460 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:24.890138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24b8a966-6a98-4a40-857f-5d0c61987460 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:25.050560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-24b8a966-6a98-4a40-857f-5d0c61987460 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:25.059764 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-24b8a966-6a98-4a40-857f-5d0c61987460 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1697 microversion: 2.1 time: 0.184652 Sep 10 11:17:25.073539 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4103/5889] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:24 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1697 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:26.085263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d38c72e0-426f-4559-b41e-262937b29507 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:26.085881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d38c72e0-426f-4559-b41e-262937b29507 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:26.092836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d38c72e0-426f-4559-b41e-262937b29507 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:26.093369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d38c72e0-426f-4559-b41e-262937b29507 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:26.093814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d38c72e0-426f-4559-b41e-262937b29507 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:26.094501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d38c72e0-426f-4559-b41e-262937b29507 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:26.094958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d38c72e0-426f-4559-b41e-262937b29507 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:26.095382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d38c72e0-426f-4559-b41e-262937b29507 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:26.228891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d38c72e0-426f-4559-b41e-262937b29507 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:26.236701 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d38c72e0-426f-4559-b41e-262937b29507 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1697 microversion: 2.1 time: 0.155394 Sep 10 11:17:26.237291 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1787/5890] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:26 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:27.260970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7aa03a96-0dda-4086-8675-3624f9356df7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:27.262300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7aa03a96-0dda-4086-8675-3624f9356df7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:27.269566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa03a96-0dda-4086-8675-3624f9356df7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:27.270066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa03a96-0dda-4086-8675-3624f9356df7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:27.270518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa03a96-0dda-4086-8675-3624f9356df7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:27.271218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa03a96-0dda-4086-8675-3624f9356df7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:27.271686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa03a96-0dda-4086-8675-3624f9356df7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:27.272131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7aa03a96-0dda-4086-8675-3624f9356df7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:27.403681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7aa03a96-0dda-4086-8675-3624f9356df7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:27.411702 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7aa03a96-0dda-4086-8675-3624f9356df7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1697 microversion: 2.1 time: 0.154729 Sep 10 11:17:27.412252 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4104/5891] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:27 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:28.436010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-91bea9fd-0a86-4555-aeeb-d6c11e5dfd4d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:28.436619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-91bea9fd-0a86-4555-aeeb-d6c11e5dfd4d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:28.443366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91bea9fd-0a86-4555-aeeb-d6c11e5dfd4d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:28.444434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91bea9fd-0a86-4555-aeeb-d6c11e5dfd4d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:28.444869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91bea9fd-0a86-4555-aeeb-d6c11e5dfd4d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:28.445581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91bea9fd-0a86-4555-aeeb-d6c11e5dfd4d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:28.446029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91bea9fd-0a86-4555-aeeb-d6c11e5dfd4d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:28.447017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-91bea9fd-0a86-4555-aeeb-d6c11e5dfd4d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:28.584941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-91bea9fd-0a86-4555-aeeb-d6c11e5dfd4d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:28.593532 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-91bea9fd-0a86-4555-aeeb-d6c11e5dfd4d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1697 microversion: 2.1 time: 0.161404 Sep 10 11:17:28.594119 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1788/5892] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:28 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:29.617785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c28231bd-5548-4fb8-94fb-d3cdd70daee3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:29.618460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c28231bd-5548-4fb8-94fb-d3cdd70daee3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:29.626088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c28231bd-5548-4fb8-94fb-d3cdd70daee3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:29.626819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c28231bd-5548-4fb8-94fb-d3cdd70daee3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:29.627284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c28231bd-5548-4fb8-94fb-d3cdd70daee3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:29.628025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c28231bd-5548-4fb8-94fb-d3cdd70daee3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:29.628505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c28231bd-5548-4fb8-94fb-d3cdd70daee3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:29.628955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c28231bd-5548-4fb8-94fb-d3cdd70daee3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:29.859485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c28231bd-5548-4fb8-94fb-d3cdd70daee3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:29.868107 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c28231bd-5548-4fb8-94fb-d3cdd70daee3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1696 microversion: 2.1 time: 0.254240 Sep 10 11:17:29.873372 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4105/5893] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:29 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1696 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:30.285198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-76b56626-194e-4f17-99c8-aa48e0900d23 req-024e2743-532f-4824-9a6c-90fd30d9c09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aba4054-8908-476e-b8a7-7f6ef9675db1", "name": "network-vif-unplugged", "status": "completed", "tag": "c68434dc-d68d-438e-8cd8-aeeaf751ea02"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:17:30.307827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-76b56626-194e-4f17-99c8-aa48e0900d23 req-024e2743-532f-4824-9a6c-90fd30d9c09a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:30.308777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-76b56626-194e-4f17-99c8-aa48e0900d23 req-024e2743-532f-4824-9a6c-90fd30d9c09a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:30.309509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-76b56626-194e-4f17-99c8-aa48e0900d23 req-024e2743-532f-4824-9a6c-90fd30d9c09a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:30.324219 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-76b56626-194e-4f17-99c8-aa48e0900d23 req-024e2743-532f-4824-9a6c-90fd30d9c09a service nova] Creating event network-vif-unplugged:c68434dc-d68d-438e-8cd8-aeeaf751ea02 for instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 on n-h2-856894-1 Sep 10 11:17:30.332904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-76b56626-194e-4f17-99c8-aa48e0900d23 req-024e2743-532f-4824-9a6c-90fd30d9c09a service nova] Instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:17:30.345134 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-76b56626-194e-4f17-99c8-aa48e0900d23 req-024e2743-532f-4824-9a6c-90fd30d9c09a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063766 Sep 10 11:17:30.346019 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1789/5894] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:17:30.898496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-04c78b23-1efc-40fa-aad2-d06c5d5dcb8b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:30.899132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-04c78b23-1efc-40fa-aad2-d06c5d5dcb8b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:30.906981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04c78b23-1efc-40fa-aad2-d06c5d5dcb8b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:30.907639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04c78b23-1efc-40fa-aad2-d06c5d5dcb8b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:30.908103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04c78b23-1efc-40fa-aad2-d06c5d5dcb8b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:30.908836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04c78b23-1efc-40fa-aad2-d06c5d5dcb8b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:30.909339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04c78b23-1efc-40fa-aad2-d06c5d5dcb8b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:30.909785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04c78b23-1efc-40fa-aad2-d06c5d5dcb8b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:31.128241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-04c78b23-1efc-40fa-aad2-d06c5d5dcb8b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:31.138416 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-04c78b23-1efc-40fa-aad2-d06c5d5dcb8b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1696 microversion: 2.1 time: 0.243754 Sep 10 11:17:31.139027 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4106/5895] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:30 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1696 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:32.164687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-986486f4-2990-4ccd-99ac-3088406799e7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:32.165593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-986486f4-2990-4ccd-99ac-3088406799e7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:32.172956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-986486f4-2990-4ccd-99ac-3088406799e7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:32.173470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-986486f4-2990-4ccd-99ac-3088406799e7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:32.173908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-986486f4-2990-4ccd-99ac-3088406799e7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:32.174607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-986486f4-2990-4ccd-99ac-3088406799e7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:32.175059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-986486f4-2990-4ccd-99ac-3088406799e7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:32.175483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-986486f4-2990-4ccd-99ac-3088406799e7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:32.322025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-986486f4-2990-4ccd-99ac-3088406799e7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:32.330502 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-986486f4-2990-4ccd-99ac-3088406799e7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1694 microversion: 2.1 time: 0.171092 Sep 10 11:17:32.331163 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1790/5896] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:32 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:32.376087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b519c41a-ca0c-49ec-b884-22c928b656df req-c6d9eff8-0994-4d5a-89ba-e434827aeff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aba4054-8908-476e-b8a7-7f6ef9675db1", "tag": "c68434dc-d68d-438e-8cd8-aeeaf751ea02"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:17:32.386833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b519c41a-ca0c-49ec-b884-22c928b656df req-c6d9eff8-0994-4d5a-89ba-e434827aeff2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:32.387408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b519c41a-ca0c-49ec-b884-22c928b656df req-c6d9eff8-0994-4d5a-89ba-e434827aeff2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:32.387929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b519c41a-ca0c-49ec-b884-22c928b656df req-c6d9eff8-0994-4d5a-89ba-e434827aeff2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:32.400407 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b519c41a-ca0c-49ec-b884-22c928b656df req-c6d9eff8-0994-4d5a-89ba-e434827aeff2 service nova] Creating event network-changed:c68434dc-d68d-438e-8cd8-aeeaf751ea02 for instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 on n-h2-856894-1 Sep 10 11:17:32.406007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-b519c41a-ca0c-49ec-b884-22c928b656df req-c6d9eff8-0994-4d5a-89ba-e434827aeff2 service nova] Instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:17:32.417857 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b519c41a-ca0c-49ec-b884-22c928b656df req-c6d9eff8-0994-4d5a-89ba-e434827aeff2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045462 Sep 10 11:17:32.418438 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4107/5897] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:17:33.355095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-69ac7806-b8b9-402c-b40c-3f820d8c779c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:33.356255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-69ac7806-b8b9-402c-b40c-3f820d8c779c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:33.364667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69ac7806-b8b9-402c-b40c-3f820d8c779c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:33.365199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69ac7806-b8b9-402c-b40c-3f820d8c779c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:33.366584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69ac7806-b8b9-402c-b40c-3f820d8c779c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:33.367746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69ac7806-b8b9-402c-b40c-3f820d8c779c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:33.368728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69ac7806-b8b9-402c-b40c-3f820d8c779c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:33.369316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69ac7806-b8b9-402c-b40c-3f820d8c779c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:33.572145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-69ac7806-b8b9-402c-b40c-3f820d8c779c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:33.580017 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-69ac7806-b8b9-402c-b40c-3f820d8c779c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1691 microversion: 2.1 time: 0.229471 Sep 10 11:17:33.580586 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1791/5898] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:33 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1691 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:33.604633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b85a8196-0372-4fcb-a28c-934e20469fbd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:17:33.605330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b85a8196-0372-4fcb-a28c-934e20469fbd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:33.611672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b85a8196-0372-4fcb-a28c-934e20469fbd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:33.612182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b85a8196-0372-4fcb-a28c-934e20469fbd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:33.612644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b85a8196-0372-4fcb-a28c-934e20469fbd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:33.613401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b85a8196-0372-4fcb-a28c-934e20469fbd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:33.613880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b85a8196-0372-4fcb-a28c-934e20469fbd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:33.614333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b85a8196-0372-4fcb-a28c-934e20469fbd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:33.680059 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b85a8196-0372-4fcb-a28c-934e20469fbd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1/action" status: 204 len: 0 microversion: 2.1 time: 0.080951 Sep 10 11:17:33.681388 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4108/5899] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:17:33 2022] POST /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:17:33.690887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-efd3bbf2-7121-47e1-a796-5d532d8849b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:33.691417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-efd3bbf2-7121-47e1-a796-5d532d8849b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:33.698846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efd3bbf2-7121-47e1-a796-5d532d8849b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:33.699528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efd3bbf2-7121-47e1-a796-5d532d8849b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:33.700074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efd3bbf2-7121-47e1-a796-5d532d8849b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:33.700918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efd3bbf2-7121-47e1-a796-5d532d8849b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:33.703078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efd3bbf2-7121-47e1-a796-5d532d8849b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:33.703535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efd3bbf2-7121-47e1-a796-5d532d8849b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:33.882386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-efd3bbf2-7121-47e1-a796-5d532d8849b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:33.893348 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-efd3bbf2-7121-47e1-a796-5d532d8849b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1691 microversion: 2.1 time: 0.207431 Sep 10 11:17:33.893926 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1792/5900] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:33 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1691 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:34.919599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15c285a9-9486-4a03-9938-3bb45cc0c6b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:34.920964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15c285a9-9486-4a03-9938-3bb45cc0c6b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:34.930021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c285a9-9486-4a03-9938-3bb45cc0c6b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:34.930533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c285a9-9486-4a03-9938-3bb45cc0c6b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:34.931863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c285a9-9486-4a03-9938-3bb45cc0c6b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:34.932828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c285a9-9486-4a03-9938-3bb45cc0c6b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:34.933530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c285a9-9486-4a03-9938-3bb45cc0c6b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:34.934226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15c285a9-9486-4a03-9938-3bb45cc0c6b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:35.135471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15c285a9-9486-4a03-9938-3bb45cc0c6b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:35.146373 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15c285a9-9486-4a03-9938-3bb45cc0c6b7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1691 microversion: 2.1 time: 0.231226 Sep 10 11:17:35.147515 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4109/5901] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:34 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:36.170571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f21f8ec9-01ce-40a8-9e7b-4b09193c1ed5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:17:36.171117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f21f8ec9-01ce-40a8-9e7b-4b09193c1ed5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:17:36.178014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f21f8ec9-01ce-40a8-9e7b-4b09193c1ed5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:36.178501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f21f8ec9-01ce-40a8-9e7b-4b09193c1ed5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:36.178940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f21f8ec9-01ce-40a8-9e7b-4b09193c1ed5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:36.179634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f21f8ec9-01ce-40a8-9e7b-4b09193c1ed5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:36.180095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f21f8ec9-01ce-40a8-9e7b-4b09193c1ed5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:36.180997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f21f8ec9-01ce-40a8-9e7b-4b09193c1ed5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:36.332315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f21f8ec9-01ce-40a8-9e7b-4b09193c1ed5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:17:36.340098 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f21f8ec9-01ce-40a8-9e7b-4b09193c1ed5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1683 microversion: 2.1 time: 0.174070 Sep 10 11:17:36.340673 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1793/5902] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:17:36 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:17:36.552319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d6fc4b7f-f459-4b92-bfe5-27e71522f220 req-ebccffb6-7d71-4855-897d-2f4d22732b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aba4054-8908-476e-b8a7-7f6ef9675db1", "name": "network-vif-plugged", "status": "completed", "tag": "c68434dc-d68d-438e-8cd8-aeeaf751ea02"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:17:36.565729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d6fc4b7f-f459-4b92-bfe5-27e71522f220 req-ebccffb6-7d71-4855-897d-2f4d22732b4a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:17:36.566234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d6fc4b7f-f459-4b92-bfe5-27e71522f220 req-ebccffb6-7d71-4855-897d-2f4d22732b4a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:17:36.567156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d6fc4b7f-f459-4b92-bfe5-27e71522f220 req-ebccffb6-7d71-4855-897d-2f4d22732b4a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:17:36.578803 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d6fc4b7f-f459-4b92-bfe5-27e71522f220 req-ebccffb6-7d71-4855-897d-2f4d22732b4a service nova] Creating event network-vif-plugged:c68434dc-d68d-438e-8cd8-aeeaf751ea02 for instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 on n-h2-856894-1 Sep 10 11:17:36.583889 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d6fc4b7f-f459-4b92-bfe5-27e71522f220 req-ebccffb6-7d71-4855-897d-2f4d22732b4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035764 Sep 10 11:17:36.584718 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4110/5903] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:18:00.537631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7131c5b5-0971-473c-8a4a-c6275006e2f0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:18:00.539840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7131c5b5-0971-473c-8a4a-c6275006e2f0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:00.543002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=15 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:00.543671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=66 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:00.549147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7131c5b5-0971-473c-8a4a-c6275006e2f0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:00.549632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7131c5b5-0971-473c-8a4a-c6275006e2f0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:00.550071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7131c5b5-0971-473c-8a4a-c6275006e2f0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:00.550769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7131c5b5-0971-473c-8a4a-c6275006e2f0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:00.551228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7131c5b5-0971-473c-8a4a-c6275006e2f0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:00.551658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7131c5b5-0971-473c-8a4a-c6275006e2f0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:00.609732 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7131c5b5-0971-473c-8a4a-c6275006e2f0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1/action" status: 200 len: 24578 microversion: 2.1 time: 0.075778 Sep 10 11:18:00.616964 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1794/5904] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:18:00 2022] POST /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1/action => generated 24578 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:18:06.878183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=17 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:06.879549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:06.884265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d09bd9b0-3708-4f22-8b20-8d2c15c7b504 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:06.885008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d09bd9b0-3708-4f22-8b20-8d2c15c7b504 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:06.894434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d09bd9b0-3708-4f22-8b20-8d2c15c7b504 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:06.894943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d09bd9b0-3708-4f22-8b20-8d2c15c7b504 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:06.895395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d09bd9b0-3708-4f22-8b20-8d2c15c7b504 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:06.896118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d09bd9b0-3708-4f22-8b20-8d2c15c7b504 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:06.896593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d09bd9b0-3708-4f22-8b20-8d2c15c7b504 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:06.897033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d09bd9b0-3708-4f22-8b20-8d2c15c7b504 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:07.029412 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d09bd9b0-3708-4f22-8b20-8d2c15c7b504 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1834 microversion: 2.1 time: 0.154060 Sep 10 11:18:07.033903 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4111/5905] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:06 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1834 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:08.211869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f935f172-c6e2-495c-9892-09877e9a394b req-b8ef3bc9-2f43-4072-9c8f-204549b589ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aba4054-8908-476e-b8a7-7f6ef9675db1", "tag": "c68434dc-d68d-438e-8cd8-aeeaf751ea02"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:18:08.215193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-45979429-2e4b-4c15-91d9-aee5b8a77863 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:08.216077 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-45979429-2e4b-4c15-91d9-aee5b8a77863 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:08.223954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45979429-2e4b-4c15-91d9-aee5b8a77863 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:08.224445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45979429-2e4b-4c15-91d9-aee5b8a77863 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:08.225026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45979429-2e4b-4c15-91d9-aee5b8a77863 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:08.225760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45979429-2e4b-4c15-91d9-aee5b8a77863 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:08.227617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45979429-2e4b-4c15-91d9-aee5b8a77863 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:08.228057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45979429-2e4b-4c15-91d9-aee5b8a77863 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:08.244460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f935f172-c6e2-495c-9892-09877e9a394b req-b8ef3bc9-2f43-4072-9c8f-204549b589ec service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:08.245374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f935f172-c6e2-495c-9892-09877e9a394b req-b8ef3bc9-2f43-4072-9c8f-204549b589ec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:08.245829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f935f172-c6e2-495c-9892-09877e9a394b req-b8ef3bc9-2f43-4072-9c8f-204549b589ec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:08.259433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-45979429-2e4b-4c15-91d9-aee5b8a77863 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:18:08.259933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f935f172-c6e2-495c-9892-09877e9a394b req-b8ef3bc9-2f43-4072-9c8f-204549b589ec service nova] Creating event network-changed:c68434dc-d68d-438e-8cd8-aeeaf751ea02 for instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 on n-h2-856894-1 Sep 10 11:18:08.265873 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f935f172-c6e2-495c-9892-09877e9a394b req-b8ef3bc9-2f43-4072-9c8f-204549b589ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057636 Sep 10 11:18:08.266895 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4112/5906] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:18:08.372062 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-45979429-2e4b-4c15-91d9-aee5b8a77863 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 204 len: 0 microversion: 2.1 time: 0.167364 Sep 10 11:18:08.372921 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1795/5907] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:18:08 2022] DELETE /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:18:08.381995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-54d66c20-7786-49b9-ad6f-7f9db9001e20 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:08.382767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-54d66c20-7786-49b9-ad6f-7f9db9001e20 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:08.391256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54d66c20-7786-49b9-ad6f-7f9db9001e20 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:08.391726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54d66c20-7786-49b9-ad6f-7f9db9001e20 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:08.396179 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54d66c20-7786-49b9-ad6f-7f9db9001e20 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:08.396941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54d66c20-7786-49b9-ad6f-7f9db9001e20 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:08.397454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54d66c20-7786-49b9-ad6f-7f9db9001e20 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:08.397900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-54d66c20-7786-49b9-ad6f-7f9db9001e20 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:08.573694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-54d66c20-7786-49b9-ad6f-7f9db9001e20 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:08.583580 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-54d66c20-7786-49b9-ad6f-7f9db9001e20 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1689 microversion: 2.1 time: 0.205749 Sep 10 11:18:08.584171 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4113/5908] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:08 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:09.607939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7bf35d74-c6d2-4eac-9e05-d42d41319fd1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:09.609370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7bf35d74-c6d2-4eac-9e05-d42d41319fd1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:09.618047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bf35d74-c6d2-4eac-9e05-d42d41319fd1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:09.618249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bf35d74-c6d2-4eac-9e05-d42d41319fd1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:09.618730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bf35d74-c6d2-4eac-9e05-d42d41319fd1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:09.619439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bf35d74-c6d2-4eac-9e05-d42d41319fd1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:09.620075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bf35d74-c6d2-4eac-9e05-d42d41319fd1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:09.620512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bf35d74-c6d2-4eac-9e05-d42d41319fd1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:09.848513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7bf35d74-c6d2-4eac-9e05-d42d41319fd1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:09.860505 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7bf35d74-c6d2-4eac-9e05-d42d41319fd1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1689 microversion: 2.1 time: 0.256738 Sep 10 11:18:09.861711 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1796/5909] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:09 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1689 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:10.405833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b9e602be-948d-4f25-92cb-54c9a8563f1d req-c056a15a-f97c-4298-928e-fb2a8e509cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aba4054-8908-476e-b8a7-7f6ef9675db1", "name": "network-vif-deleted", "tag": "c68434dc-d68d-438e-8cd8-aeeaf751ea02"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:18:10.421130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b9e602be-948d-4f25-92cb-54c9a8563f1d req-c056a15a-f97c-4298-928e-fb2a8e509cdb service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:10.421731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b9e602be-948d-4f25-92cb-54c9a8563f1d req-c056a15a-f97c-4298-928e-fb2a8e509cdb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:10.422625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b9e602be-948d-4f25-92cb-54c9a8563f1d req-c056a15a-f97c-4298-928e-fb2a8e509cdb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:10.438572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b9e602be-948d-4f25-92cb-54c9a8563f1d req-c056a15a-f97c-4298-928e-fb2a8e509cdb service nova] Creating event network-vif-deleted:c68434dc-d68d-438e-8cd8-aeeaf751ea02 for instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 on n-h2-856894-1 Sep 10 11:18:10.444652 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b9e602be-948d-4f25-92cb-54c9a8563f1d req-c056a15a-f97c-4298-928e-fb2a8e509cdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042535 Sep 10 11:18:10.445541 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4114/5910] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:18:10.884277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:10.884933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:10.899565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:10.900069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:10.900527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:10.901349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:10.901819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:10.902251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:10.934944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:10.935349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:10.935797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:10.936250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lazy-loading 'fault' on Instance uuid 7aba4054-8908-476e-b8a7-7f6ef9675db1 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:18:11.007209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:11.015488 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-076cf6af-753d-4155-8323-fa632dac5e2c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 200 len: 1356 microversion: 2.1 time: 0.135437 Sep 10 11:18:11.016071 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1797/5911] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:10 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 1356 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:12.040172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:12.046364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 7aba4054-8908-476e-b8a7-7f6ef9675db1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:12.049223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:12.049747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:12.050243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:12.050978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:12.051463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:12.051919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:12.067331 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] HTTP exception thrown: Instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 could not be found. Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Request method failure captured: Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 HTTP/1.1 Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHH99mNjQ7cQbIBFm5xMEZ09SACFhVgG8u0OC8VbKtc7kt4xMCSUwnrA_oKblEW8JDocge6AO3VQeTn5dPDK01j3vyI7zzY9BdVnAyaSXPFZgxHuuzje-hF9HrWs8Iqjz9AuPu-m3EbiyaYPoNSXA2WnlKdjtcvfaTnrFqxqwvxBOec Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: aad1c11f4349492a8c53684e82676e2e Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad1c11f4349492a8c53684e82676e2e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: aad1c11f4349492a8c53684e82676e2e Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestNetworkAdvancedServerOps-1400270813-project Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 28049b2f9a484bf68b61b0769cef6616 Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1400270813-project Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 could not be found. Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7aba4054-8908-476e-b8a7-7f6ef9675db1'} Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 could not be found. Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 could not be found. Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:18:12.069045 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 could not be found. Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Returning 404 to user: Instance 7aba4054-8908-476e-b8a7-7f6ef9675db1 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2f87e1d-4e8f-4919-b7ef-702a295339ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1" status: 404 len: 111 microversion: 2.1 time: 0.035356 Sep 10 11:18:12.073744 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4115/5912] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:12 2022] GET /compute/v2.1/servers/7aba4054-8908-476e-b8a7-7f6ef9675db1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:18:15.468657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4aa53e83-667e-45fa-bd5c-867072043185 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '.version_select at 0x7efcadc7f040>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:15.505339 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4aa53e83-667e-45fa-bd5c-867072043185 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2068043573" status: 202 len: 0 microversion: 2.1 time: 0.044563 Sep 10 11:18:15.509746 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1798/5913] 10.222.0.20 () {58 vars in 1284 bytes} [Sat Sep 10 11:18:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2068043573 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:18:15.547565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-18770b86-f0e4-425f-819d-eaf0cdcfc9e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'create', calling method: .version_select at 0x7efcae6c41f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1790479322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk9nPxIh+I8NigPcTwTeFkd6Y9NLQh8lTU5Y8gu2jmgEnUhc5Trg8cRQEpHJznkjLb6oQaC03v1N2CgCIeTyuaDG5Yhek3896Onolo63ssqC57ufvCdHFK/TZQHdDAi9A=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:18:15.564758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-18770b86-f0e4-425f-819d-eaf0cdcfc9e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for project aad1c11f4349492a8c53684e82676e2e. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:18:15.574877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-18770b86-f0e4-425f-819d-eaf0cdcfc9e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for user 28049b2f9a484bf68b61b0769cef6616 and project aad1c11f4349492a8c53684e82676e2e. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:18:15.600584 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-18770b86-f0e4-425f-819d-eaf0cdcfc9e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057148 Sep 10 11:18:15.601359 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4116/5914] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:18:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:18:21.659226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1531315066", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "506c4ae3-c705-4b68-8cbd-8aba6d5c9edc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1790479322", "security_groups": [{"name": "tempest-secgroup-smoke-1064651761"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:18:21.704930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:21.835809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] validate_networks() for [('506c4ae3-c705-4b68-8cbd-8aba6d5c9edc', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:18:22.369235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:18:22.370012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:18:22.370836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:18:22.371449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:18:22.372064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:18:22.390062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:22.391696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:22.392340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:22.393362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:22.393990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:22.394753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:22.427550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for project aad1c11f4349492a8c53684e82676e2e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:18:22.434230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for user 28049b2f9a484bf68b61b0769cef6616 and project aad1c11f4349492a8c53684e82676e2e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:18:22.455832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:18:22.458342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:18:22.515476 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b0804415-cd02-428d-bd94-15d9b60180c8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.861142 Sep 10 11:18:22.522466 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1799/5915] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:18:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:18:22.527304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=18 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:22.546251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-58190f5a-80ec-4b11-9de6-78927aacd724 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:22.547587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-58190f5a-80ec-4b11-9de6-78927aacd724 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:22.639752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-58190f5a-80ec-4b11-9de6-78927aacd724 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:22.649282 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-58190f5a-80ec-4b11-9de6-78927aacd724 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1267 microversion: 2.1 time: 0.124400 Sep 10 11:18:22.657990 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4117/5916] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:22 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:23.673479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-69e2c15f-008e-4236-a2fc-f03d871ffef9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:23.674407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-69e2c15f-008e-4236-a2fc-f03d871ffef9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:23.690257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e2c15f-008e-4236-a2fc-f03d871ffef9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:23.692529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e2c15f-008e-4236-a2fc-f03d871ffef9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:23.694459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e2c15f-008e-4236-a2fc-f03d871ffef9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:23.696928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e2c15f-008e-4236-a2fc-f03d871ffef9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:23.699116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e2c15f-008e-4236-a2fc-f03d871ffef9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:23.699970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-69e2c15f-008e-4236-a2fc-f03d871ffef9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:23.822445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-69e2c15f-008e-4236-a2fc-f03d871ffef9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:23.831059 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-69e2c15f-008e-4236-a2fc-f03d871ffef9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1319 microversion: 2.1 time: 0.162300 Sep 10 11:18:23.832177 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1800/5917] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:23 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:24.857623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2444234b-0f43-4f12-ae65-bc35485a7072 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:24.858580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2444234b-0f43-4f12-ae65-bc35485a7072 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:24.871411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2444234b-0f43-4f12-ae65-bc35485a7072 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:24.875519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2444234b-0f43-4f12-ae65-bc35485a7072 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:24.878697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2444234b-0f43-4f12-ae65-bc35485a7072 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:24.879602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2444234b-0f43-4f12-ae65-bc35485a7072 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:24.881274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2444234b-0f43-4f12-ae65-bc35485a7072 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:24.882879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2444234b-0f43-4f12-ae65-bc35485a7072 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:25.051498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2444234b-0f43-4f12-ae65-bc35485a7072 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:25.060483 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2444234b-0f43-4f12-ae65-bc35485a7072 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1393 microversion: 2.1 time: 0.206786 Sep 10 11:18:25.061501 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4118/5918] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:24 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1393 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:25.966758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-9f4d50d5-a70e-4dba-a0c7-c395898ebc9c req-a1ee2eaf-d826-4008-b342-58e9c82ce120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e946f79d-2f84-4dec-898c-f9240ffa910f", "tag": "cfaeff62-0ae1-46e7-8b35-700316aeca48"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:18:25.977650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9f4d50d5-a70e-4dba-a0c7-c395898ebc9c req-a1ee2eaf-d826-4008-b342-58e9c82ce120 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:25.978130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9f4d50d5-a70e-4dba-a0c7-c395898ebc9c req-a1ee2eaf-d826-4008-b342-58e9c82ce120 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:25.978553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9f4d50d5-a70e-4dba-a0c7-c395898ebc9c req-a1ee2eaf-d826-4008-b342-58e9c82ce120 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:25.990285 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-9f4d50d5-a70e-4dba-a0c7-c395898ebc9c req-a1ee2eaf-d826-4008-b342-58e9c82ce120 service nova] Creating event network-changed:cfaeff62-0ae1-46e7-8b35-700316aeca48 for instance e946f79d-2f84-4dec-898c-f9240ffa910f on n-h1-856894-1 Sep 10 11:18:25.995557 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-9f4d50d5-a70e-4dba-a0c7-c395898ebc9c req-a1ee2eaf-d826-4008-b342-58e9c82ce120 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186427 Sep 10 11:18:25.996225 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1801/5919] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:18:26.086422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e30275af-9c48-43a8-a229-66458ed53efe tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:26.087751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e30275af-9c48-43a8-a229-66458ed53efe tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:26.099295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e30275af-9c48-43a8-a229-66458ed53efe tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:26.100182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e30275af-9c48-43a8-a229-66458ed53efe tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:26.101027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e30275af-9c48-43a8-a229-66458ed53efe tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:26.102321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e30275af-9c48-43a8-a229-66458ed53efe tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:26.103207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e30275af-9c48-43a8-a229-66458ed53efe tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:26.103937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e30275af-9c48-43a8-a229-66458ed53efe tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:26.254763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e30275af-9c48-43a8-a229-66458ed53efe tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:26.266290 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e30275af-9c48-43a8-a229-66458ed53efe tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1393 microversion: 2.1 time: 0.185514 Sep 10 11:18:26.278349 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4119/5920] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:26 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1393 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:27.294094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1c35212c-f08f-476a-b65b-b98aa3878603 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:27.294808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1c35212c-f08f-476a-b65b-b98aa3878603 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:27.302627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c35212c-f08f-476a-b65b-b98aa3878603 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:27.302985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c35212c-f08f-476a-b65b-b98aa3878603 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:27.303426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c35212c-f08f-476a-b65b-b98aa3878603 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:27.304354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c35212c-f08f-476a-b65b-b98aa3878603 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:27.304817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c35212c-f08f-476a-b65b-b98aa3878603 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:27.305284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1c35212c-f08f-476a-b65b-b98aa3878603 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:27.451059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1c35212c-f08f-476a-b65b-b98aa3878603 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:27.459600 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1c35212c-f08f-476a-b65b-b98aa3878603 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1393 microversion: 2.1 time: 0.172209 Sep 10 11:18:27.474261 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1802/5921] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:27 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1393 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:28.482917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-850d7519-d235-4258-9d46-8b9ce5aeffb1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:28.483611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-850d7519-d235-4258-9d46-8b9ce5aeffb1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:28.490732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-850d7519-d235-4258-9d46-8b9ce5aeffb1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:28.491977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-850d7519-d235-4258-9d46-8b9ce5aeffb1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:28.492381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-850d7519-d235-4258-9d46-8b9ce5aeffb1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:28.493390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-850d7519-d235-4258-9d46-8b9ce5aeffb1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:28.493977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-850d7519-d235-4258-9d46-8b9ce5aeffb1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:28.494513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-850d7519-d235-4258-9d46-8b9ce5aeffb1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:28.648363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-850d7519-d235-4258-9d46-8b9ce5aeffb1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:28.656288 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-850d7519-d235-4258-9d46-8b9ce5aeffb1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1393 microversion: 2.1 time: 0.177307 Sep 10 11:18:28.656877 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4120/5922] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:28 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:29.680897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4680aa9d-f009-4b7a-82ad-dfb76cc25700 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:29.682129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4680aa9d-f009-4b7a-82ad-dfb76cc25700 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:29.689576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4680aa9d-f009-4b7a-82ad-dfb76cc25700 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:29.690076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4680aa9d-f009-4b7a-82ad-dfb76cc25700 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:29.690523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4680aa9d-f009-4b7a-82ad-dfb76cc25700 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:29.691236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4680aa9d-f009-4b7a-82ad-dfb76cc25700 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:29.691699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4680aa9d-f009-4b7a-82ad-dfb76cc25700 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:29.692130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4680aa9d-f009-4b7a-82ad-dfb76cc25700 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:29.830334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4680aa9d-f009-4b7a-82ad-dfb76cc25700 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:29.838730 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4680aa9d-f009-4b7a-82ad-dfb76cc25700 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1393 microversion: 2.1 time: 0.162951 Sep 10 11:18:29.839294 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1803/5923] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:29 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:30.862202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-676d7e9a-a192-4721-b5f8-bdaa52263409 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:30.862833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-676d7e9a-a192-4721-b5f8-bdaa52263409 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:30.870301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-676d7e9a-a192-4721-b5f8-bdaa52263409 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:30.871029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-676d7e9a-a192-4721-b5f8-bdaa52263409 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:30.871483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-676d7e9a-a192-4721-b5f8-bdaa52263409 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:30.872194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-676d7e9a-a192-4721-b5f8-bdaa52263409 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:30.872664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-676d7e9a-a192-4721-b5f8-bdaa52263409 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:30.873158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-676d7e9a-a192-4721-b5f8-bdaa52263409 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:31.008201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-3ec14d32-a679-4d0f-aa2d-5fbe6f7ad998 req-8c372ae1-9d9b-49d0-b904-4f726f17569c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e946f79d-2f84-4dec-898c-f9240ffa910f", "name": "network-vif-plugged", "status": "completed", "tag": "cfaeff62-0ae1-46e7-8b35-700316aeca48"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:18:31.023764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:31.028100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3ec14d32-a679-4d0f-aa2d-5fbe6f7ad998 req-8c372ae1-9d9b-49d0-b904-4f726f17569c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:31.028590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3ec14d32-a679-4d0f-aa2d-5fbe6f7ad998 req-8c372ae1-9d9b-49d0-b904-4f726f17569c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:31.029051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3ec14d32-a679-4d0f-aa2d-5fbe6f7ad998 req-8c372ae1-9d9b-49d0-b904-4f726f17569c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:31.052161 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3ec14d32-a679-4d0f-aa2d-5fbe6f7ad998 req-8c372ae1-9d9b-49d0-b904-4f726f17569c service nova] Creating event network-vif-plugged:cfaeff62-0ae1-46e7-8b35-700316aeca48 for instance e946f79d-2f84-4dec-898c-f9240ffa910f on n-h1-856894-1 Sep 10 11:18:31.063672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-676d7e9a-a192-4721-b5f8-bdaa52263409 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:31.073792 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-3ec14d32-a679-4d0f-aa2d-5fbe6f7ad998 req-8c372ae1-9d9b-49d0-b904-4f726f17569c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071090 Sep 10 11:18:31.075037 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1804/5924] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:18:31.080494 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-676d7e9a-a192-4721-b5f8-bdaa52263409 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1393 microversion: 2.1 time: 0.222159 Sep 10 11:18:31.087157 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4121/5925] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:30 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1393 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:32.105769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7137243e-29de-46eb-b096-eb7a292700ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:32.107202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7137243e-29de-46eb-b096-eb7a292700ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:32.114732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7137243e-29de-46eb-b096-eb7a292700ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:32.115474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7137243e-29de-46eb-b096-eb7a292700ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:32.117018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7137243e-29de-46eb-b096-eb7a292700ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:32.117765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7137243e-29de-46eb-b096-eb7a292700ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:32.118327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7137243e-29de-46eb-b096-eb7a292700ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:32.118898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7137243e-29de-46eb-b096-eb7a292700ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:32.299215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7137243e-29de-46eb-b096-eb7a292700ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:32.309564 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7137243e-29de-46eb-b096-eb7a292700ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1393 microversion: 2.1 time: 0.209257 Sep 10 11:18:32.310182 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1805/5926] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:32 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1393 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:33.334395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3fc63eb0-6139-46ae-954b-e362cb34f0e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:33.335126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3fc63eb0-6139-46ae-954b-e362cb34f0e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:33.338056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:33.344082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fc63eb0-6139-46ae-954b-e362cb34f0e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:33.344595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fc63eb0-6139-46ae-954b-e362cb34f0e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:33.345053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fc63eb0-6139-46ae-954b-e362cb34f0e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:33.345794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fc63eb0-6139-46ae-954b-e362cb34f0e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:33.346271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fc63eb0-6139-46ae-954b-e362cb34f0e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:33.346717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fc63eb0-6139-46ae-954b-e362cb34f0e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:33.494878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3fc63eb0-6139-46ae-954b-e362cb34f0e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:33.505872 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3fc63eb0-6139-46ae-954b-e362cb34f0e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1566 microversion: 2.1 time: 0.176265 Sep 10 11:18:33.506477 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4122/5927] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:33 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:33.529357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-22cc1c2c-8e23-4f66-9fcf-88cbb5e9e571 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:33.530085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-22cc1c2c-8e23-4f66-9fcf-88cbb5e9e571 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:33.532240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:33.533133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:33.541840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22cc1c2c-8e23-4f66-9fcf-88cbb5e9e571 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:33.542624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22cc1c2c-8e23-4f66-9fcf-88cbb5e9e571 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:33.543391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22cc1c2c-8e23-4f66-9fcf-88cbb5e9e571 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:33.544732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22cc1c2c-8e23-4f66-9fcf-88cbb5e9e571 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:33.545231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22cc1c2c-8e23-4f66-9fcf-88cbb5e9e571 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:33.545675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22cc1c2c-8e23-4f66-9fcf-88cbb5e9e571 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:33.690598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-22cc1c2c-8e23-4f66-9fcf-88cbb5e9e571 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:33.699428 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-22cc1c2c-8e23-4f66-9fcf-88cbb5e9e571 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1566 microversion: 2.1 time: 0.174125 Sep 10 11:18:33.700297 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1806/5928] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:33 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:35.401807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85e3286d-8ca1-418c-8e19-3d40a52f5890 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:18:35.402657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-85e3286d-8ca1-418c-8e19-3d40a52f5890 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:35.406566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-f455ac04-0c65-4909-a831-fd8c6fcb3a2d req-4f6fe28b-b94a-44db-9f4e-3218729f0093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e946f79d-2f84-4dec-898c-f9240ffa910f", "tag": "cfaeff62-0ae1-46e7-8b35-700316aeca48"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:18:35.409888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e3286d-8ca1-418c-8e19-3d40a52f5890 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:35.410514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e3286d-8ca1-418c-8e19-3d40a52f5890 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:35.410971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e3286d-8ca1-418c-8e19-3d40a52f5890 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:35.411688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e3286d-8ca1-418c-8e19-3d40a52f5890 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:35.412388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e3286d-8ca1-418c-8e19-3d40a52f5890 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:35.412832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85e3286d-8ca1-418c-8e19-3d40a52f5890 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:35.439399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f455ac04-0c65-4909-a831-fd8c6fcb3a2d req-4f6fe28b-b94a-44db-9f4e-3218729f0093 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:35.440155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f455ac04-0c65-4909-a831-fd8c6fcb3a2d req-4f6fe28b-b94a-44db-9f4e-3218729f0093 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:35.440824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f455ac04-0c65-4909-a831-fd8c6fcb3a2d req-4f6fe28b-b94a-44db-9f4e-3218729f0093 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:35.453959 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-f455ac04-0c65-4909-a831-fd8c6fcb3a2d req-4f6fe28b-b94a-44db-9f4e-3218729f0093 service nova] Creating event network-changed:cfaeff62-0ae1-46e7-8b35-700316aeca48 for instance e946f79d-2f84-4dec-898c-f9240ffa910f on n-h1-856894-1 Sep 10 11:18:35.462878 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-f455ac04-0c65-4909-a831-fd8c6fcb3a2d req-4f6fe28b-b94a-44db-9f4e-3218729f0093 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061707 Sep 10 11:18:35.464190 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1807/5929] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:18:35.576030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-85e3286d-8ca1-418c-8e19-3d40a52f5890 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:18:35.586801 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85e3286d-8ca1-418c-8e19-3d40a52f5890 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1566 microversion: 2.1 time: 0.189644 Sep 10 11:18:35.602523 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4123/5930] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:18:35 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:18:56.887473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=7 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:56.888247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=38 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:18:56.893222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-23a64dbe-6a75-47f7-a2e0-89c6f35c5ba7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:18:56.895822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-23a64dbe-6a75-47f7-a2e0-89c6f35c5ba7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:18:56.903139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23a64dbe-6a75-47f7-a2e0-89c6f35c5ba7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:56.903640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23a64dbe-6a75-47f7-a2e0-89c6f35c5ba7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:56.904098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23a64dbe-6a75-47f7-a2e0-89c6f35c5ba7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:56.904817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23a64dbe-6a75-47f7-a2e0-89c6f35c5ba7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:18:56.905335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23a64dbe-6a75-47f7-a2e0-89c6f35c5ba7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:18:56.905772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23a64dbe-6a75-47f7-a2e0-89c6f35c5ba7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:18:56.959580 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-23a64dbe-6a75-47f7-a2e0-89c6f35c5ba7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f/action" status: 200 len: 24562 microversion: 2.1 time: 0.074117 Sep 10 11:18:56.966688 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1808/5931] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:18:56 2022] POST /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f/action => generated 24562 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:19:07.964760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ed44b37-4a74-48f1-a64b-c94a33968bb1 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:07.965823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8ed44b37-4a74-48f1-a64b-c94a33968bb1 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:07.968908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:07.969801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=36 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:07.980443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed44b37-4a74-48f1-a64b-c94a33968bb1 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:07.980963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed44b37-4a74-48f1-a64b-c94a33968bb1 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:07.981455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed44b37-4a74-48f1-a64b-c94a33968bb1 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:07.982182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed44b37-4a74-48f1-a64b-c94a33968bb1 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:07.982658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed44b37-4a74-48f1-a64b-c94a33968bb1 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:07.983106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ed44b37-4a74-48f1-a64b-c94a33968bb1 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:08.248362 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ed44b37-4a74-48f1-a64b-c94a33968bb1 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1836 microversion: 2.1 time: 0.288706 Sep 10 11:19:08.248957 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4124/5932] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:07 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1836 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:08.275007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6d4eaf9f-b68d-44bc-8d16-8262bedba55e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:08.276091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6d4eaf9f-b68d-44bc-8d16-8262bedba55e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:08.280400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:08.281063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:08.288049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d4eaf9f-b68d-44bc-8d16-8262bedba55e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:08.288720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d4eaf9f-b68d-44bc-8d16-8262bedba55e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:08.289201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d4eaf9f-b68d-44bc-8d16-8262bedba55e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:08.289776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d4eaf9f-b68d-44bc-8d16-8262bedba55e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:08.290167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d4eaf9f-b68d-44bc-8d16-8262bedba55e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:08.290603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d4eaf9f-b68d-44bc-8d16-8262bedba55e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:08.488239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6d4eaf9f-b68d-44bc-8d16-8262bedba55e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:08.496123 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6d4eaf9f-b68d-44bc-8d16-8262bedba55e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1685 microversion: 2.1 time: 0.227363 Sep 10 11:19:08.496711 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1809/5933] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:08 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1685 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:08.598082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1b6a69ee-8112-4bb6-871b-e1062a5a77ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:08.601105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1b6a69ee-8112-4bb6-871b-e1062a5a77ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:08.608504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6a69ee-8112-4bb6-871b-e1062a5a77ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:08.609171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6a69ee-8112-4bb6-871b-e1062a5a77ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:08.609636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6a69ee-8112-4bb6-871b-e1062a5a77ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:08.610371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6a69ee-8112-4bb6-871b-e1062a5a77ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:08.610889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6a69ee-8112-4bb6-871b-e1062a5a77ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:08.614977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1b6a69ee-8112-4bb6-871b-e1062a5a77ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:08.678968 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1b6a69ee-8112-4bb6-871b-e1062a5a77ec tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f/action" status: 200 len: 32634 microversion: 2.1 time: 0.084591 Sep 10 11:19:08.679870 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4125/5934] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:19:08 2022] POST /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f/action => generated 32634 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:19:08.861273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:08.861913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:08.868634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:08.869209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:08.869671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:08.870422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:08.870930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:08.871385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:08.904866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6404ccb62eb7497c8ec33b14a5a79f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ffd2a9ef2b4001b78dccb298a510e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:08.905493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] flavor_id is None. Assuming migration. {{(pid=128787) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 11:19:08.905939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128787) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:19:09.018783 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-229c10ef-1e91-4133-a207-f6823a398146 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f/action" status: 202 len: 0 microversion: 2.1 time: 0.161565 Sep 10 11:19:09.019560 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1810/5935] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:19:08 2022] POST /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:19:09.029289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a86f415d-6be3-4dda-951c-1f514b3036ea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:09.030013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a86f415d-6be3-4dda-951c-1f514b3036ea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:09.037545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86f415d-6be3-4dda-951c-1f514b3036ea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:09.038054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86f415d-6be3-4dda-951c-1f514b3036ea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:09.038510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86f415d-6be3-4dda-951c-1f514b3036ea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:09.039226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86f415d-6be3-4dda-951c-1f514b3036ea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:09.039869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86f415d-6be3-4dda-951c-1f514b3036ea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:09.040488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a86f415d-6be3-4dda-951c-1f514b3036ea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:09.209572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a86f415d-6be3-4dda-951c-1f514b3036ea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:09.220232 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a86f415d-6be3-4dda-951c-1f514b3036ea tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1694 microversion: 2.1 time: 0.195354 Sep 10 11:19:09.221007 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4126/5936] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:09 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:10.244775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3b8608d4-92cf-452f-8b9e-defba850c93b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:10.245414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3b8608d4-92cf-452f-8b9e-defba850c93b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:10.252664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b8608d4-92cf-452f-8b9e-defba850c93b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:10.253180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b8608d4-92cf-452f-8b9e-defba850c93b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:10.253633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b8608d4-92cf-452f-8b9e-defba850c93b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:10.254316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b8608d4-92cf-452f-8b9e-defba850c93b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:10.254770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b8608d4-92cf-452f-8b9e-defba850c93b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:10.255192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b8608d4-92cf-452f-8b9e-defba850c93b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:10.405025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3b8608d4-92cf-452f-8b9e-defba850c93b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:10.413595 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3b8608d4-92cf-452f-8b9e-defba850c93b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1694 microversion: 2.1 time: 0.173469 Sep 10 11:19:10.414321 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1811/5937] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:10 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:11.438214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-92edf61f-d6aa-4cb8-88b3-f1707b4a23e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:11.438850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-92edf61f-d6aa-4cb8-88b3-f1707b4a23e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:11.445856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92edf61f-d6aa-4cb8-88b3-f1707b4a23e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:11.446361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92edf61f-d6aa-4cb8-88b3-f1707b4a23e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:11.446813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92edf61f-d6aa-4cb8-88b3-f1707b4a23e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:11.447575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92edf61f-d6aa-4cb8-88b3-f1707b4a23e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:11.448056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92edf61f-d6aa-4cb8-88b3-f1707b4a23e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:11.448499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92edf61f-d6aa-4cb8-88b3-f1707b4a23e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:11.592912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-92edf61f-d6aa-4cb8-88b3-f1707b4a23e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:11.601462 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-92edf61f-d6aa-4cb8-88b3-f1707b4a23e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.167186 Sep 10 11:19:11.602040 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4127/5938] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:11 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:12.624825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2de890f7-6c42-426f-9394-bc2ab19da469 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:12.625472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2de890f7-6c42-426f-9394-bc2ab19da469 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:12.632811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2de890f7-6c42-426f-9394-bc2ab19da469 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:12.633325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2de890f7-6c42-426f-9394-bc2ab19da469 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:12.633768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2de890f7-6c42-426f-9394-bc2ab19da469 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:12.634457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2de890f7-6c42-426f-9394-bc2ab19da469 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:12.634915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2de890f7-6c42-426f-9394-bc2ab19da469 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:12.635350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2de890f7-6c42-426f-9394-bc2ab19da469 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:12.769561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2de890f7-6c42-426f-9394-bc2ab19da469 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:12.778990 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2de890f7-6c42-426f-9394-bc2ab19da469 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.158097 Sep 10 11:19:12.779611 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1812/5939] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:12 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:13.804406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b1bd7db-99ce-4cbf-bf6d-6f02b9f7095d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:13.805062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b1bd7db-99ce-4cbf-bf6d-6f02b9f7095d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:13.812481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b1bd7db-99ce-4cbf-bf6d-6f02b9f7095d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:13.813023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b1bd7db-99ce-4cbf-bf6d-6f02b9f7095d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:13.813638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b1bd7db-99ce-4cbf-bf6d-6f02b9f7095d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:13.814363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b1bd7db-99ce-4cbf-bf6d-6f02b9f7095d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:13.814842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b1bd7db-99ce-4cbf-bf6d-6f02b9f7095d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:13.815402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b1bd7db-99ce-4cbf-bf6d-6f02b9f7095d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:13.956999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2b1bd7db-99ce-4cbf-bf6d-6f02b9f7095d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:13.968018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b1bd7db-99ce-4cbf-bf6d-6f02b9f7095d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.167855 Sep 10 11:19:13.973101 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4128/5940] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:13 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:14.997289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-228fe1c3-18f2-462b-9ef6-f7dfaf996ffc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:14.997904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-228fe1c3-18f2-462b-9ef6-f7dfaf996ffc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:15.004823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-228fe1c3-18f2-462b-9ef6-f7dfaf996ffc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:15.005353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-228fe1c3-18f2-462b-9ef6-f7dfaf996ffc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:15.006290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-228fe1c3-18f2-462b-9ef6-f7dfaf996ffc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:15.006989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-228fe1c3-18f2-462b-9ef6-f7dfaf996ffc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:15.007448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-228fe1c3-18f2-462b-9ef6-f7dfaf996ffc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:15.007876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-228fe1c3-18f2-462b-9ef6-f7dfaf996ffc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:15.146658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-228fe1c3-18f2-462b-9ef6-f7dfaf996ffc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:15.155859 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-228fe1c3-18f2-462b-9ef6-f7dfaf996ffc tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.162391 Sep 10 11:19:15.156728 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1813/5941] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:14 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:16.179114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e5b23ec-d612-411d-b687-b44c7a3b0c89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:16.179747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e5b23ec-d612-411d-b687-b44c7a3b0c89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:16.186696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e5b23ec-d612-411d-b687-b44c7a3b0c89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:16.187200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e5b23ec-d612-411d-b687-b44c7a3b0c89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:16.187650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e5b23ec-d612-411d-b687-b44c7a3b0c89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:16.188348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e5b23ec-d612-411d-b687-b44c7a3b0c89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:16.188819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e5b23ec-d612-411d-b687-b44c7a3b0c89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:16.189284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e5b23ec-d612-411d-b687-b44c7a3b0c89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:16.326762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0e5b23ec-d612-411d-b687-b44c7a3b0c89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:16.335554 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e5b23ec-d612-411d-b687-b44c7a3b0c89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.160323 Sep 10 11:19:16.336342 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4129/5942] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:16 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:17.358520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2162a3fd-c970-45a6-8f6e-87a1342c8886 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:17.359137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2162a3fd-c970-45a6-8f6e-87a1342c8886 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:17.366100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2162a3fd-c970-45a6-8f6e-87a1342c8886 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:17.366587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2162a3fd-c970-45a6-8f6e-87a1342c8886 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:17.367030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2162a3fd-c970-45a6-8f6e-87a1342c8886 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:17.367716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2162a3fd-c970-45a6-8f6e-87a1342c8886 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:17.368174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2162a3fd-c970-45a6-8f6e-87a1342c8886 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:17.368601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2162a3fd-c970-45a6-8f6e-87a1342c8886 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:17.507152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2162a3fd-c970-45a6-8f6e-87a1342c8886 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:17.515591 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2162a3fd-c970-45a6-8f6e-87a1342c8886 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.160913 Sep 10 11:19:17.516415 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1814/5943] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:17 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:18.538671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60bb7dba-584b-4371-b1da-3adde3ceab54 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:18.539313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60bb7dba-584b-4371-b1da-3adde3ceab54 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:18.546809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60bb7dba-584b-4371-b1da-3adde3ceab54 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:18.547327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60bb7dba-584b-4371-b1da-3adde3ceab54 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:18.548125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60bb7dba-584b-4371-b1da-3adde3ceab54 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:18.548488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60bb7dba-584b-4371-b1da-3adde3ceab54 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:18.548964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60bb7dba-584b-4371-b1da-3adde3ceab54 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:18.549435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60bb7dba-584b-4371-b1da-3adde3ceab54 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:18.684386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60bb7dba-584b-4371-b1da-3adde3ceab54 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:18.693778 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60bb7dba-584b-4371-b1da-3adde3ceab54 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.158139 Sep 10 11:19:18.693927 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4130/5944] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:18 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:19.717381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cb4bd994-2991-4e8e-a639-c837f89d589d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:19.718007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cb4bd994-2991-4e8e-a639-c837f89d589d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:19.725273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb4bd994-2991-4e8e-a639-c837f89d589d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:19.725764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb4bd994-2991-4e8e-a639-c837f89d589d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:19.726250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb4bd994-2991-4e8e-a639-c837f89d589d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:19.726951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb4bd994-2991-4e8e-a639-c837f89d589d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:19.727411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb4bd994-2991-4e8e-a639-c837f89d589d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:19.727860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cb4bd994-2991-4e8e-a639-c837f89d589d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:19.863819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cb4bd994-2991-4e8e-a639-c837f89d589d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:19.871745 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cb4bd994-2991-4e8e-a639-c837f89d589d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.158635 Sep 10 11:19:19.872329 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1815/5945] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:19 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:20.895488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e21ca85e-1822-4450-9ddc-4fea80803b2e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:20.896308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e21ca85e-1822-4450-9ddc-4fea80803b2e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:20.903703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21ca85e-1822-4450-9ddc-4fea80803b2e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:20.904213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21ca85e-1822-4450-9ddc-4fea80803b2e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:20.904665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21ca85e-1822-4450-9ddc-4fea80803b2e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:20.905405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21ca85e-1822-4450-9ddc-4fea80803b2e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:20.905879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21ca85e-1822-4450-9ddc-4fea80803b2e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:20.906506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21ca85e-1822-4450-9ddc-4fea80803b2e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:21.044808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e21ca85e-1822-4450-9ddc-4fea80803b2e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:21.053579 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e21ca85e-1822-4450-9ddc-4fea80803b2e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.162085 Sep 10 11:19:21.054425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4131/5946] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:20 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:22.076967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7bcbba47-66c1-411b-99b8-3fafb81a3af7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:22.077560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7bcbba47-66c1-411b-99b8-3fafb81a3af7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:22.084877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bcbba47-66c1-411b-99b8-3fafb81a3af7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:22.085387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bcbba47-66c1-411b-99b8-3fafb81a3af7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:22.085825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bcbba47-66c1-411b-99b8-3fafb81a3af7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:22.086515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bcbba47-66c1-411b-99b8-3fafb81a3af7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:22.086971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bcbba47-66c1-411b-99b8-3fafb81a3af7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:22.087404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7bcbba47-66c1-411b-99b8-3fafb81a3af7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:22.227277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7bcbba47-66c1-411b-99b8-3fafb81a3af7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:22.235240 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7bcbba47-66c1-411b-99b8-3fafb81a3af7 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.162324 Sep 10 11:19:22.235814 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1816/5947] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:22 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:23.259648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b6841ee6-8a19-4b24-a294-e64b433bd5ee tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:23.260297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b6841ee6-8a19-4b24-a294-e64b433bd5ee tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:23.269025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6841ee6-8a19-4b24-a294-e64b433bd5ee tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:23.269629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6841ee6-8a19-4b24-a294-e64b433bd5ee tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:23.270189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6841ee6-8a19-4b24-a294-e64b433bd5ee tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:23.271847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6841ee6-8a19-4b24-a294-e64b433bd5ee tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:23.272220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6841ee6-8a19-4b24-a294-e64b433bd5ee tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:23.272668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b6841ee6-8a19-4b24-a294-e64b433bd5ee tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:23.450863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b6841ee6-8a19-4b24-a294-e64b433bd5ee tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:23.461408 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b6841ee6-8a19-4b24-a294-e64b433bd5ee tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1699 microversion: 2.1 time: 0.206001 Sep 10 11:19:23.462029 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4132/5948] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:23 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1699 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:23.826415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-5547d75a-362b-4b58-8caf-bdad7bf9aa6a req-ba6950bf-eb34-4d33-8915-dbc7df4c9e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e946f79d-2f84-4dec-898c-f9240ffa910f", "name": "network-vif-unplugged", "status": "completed", "tag": "cfaeff62-0ae1-46e7-8b35-700316aeca48"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:23.837208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5547d75a-362b-4b58-8caf-bdad7bf9aa6a req-ba6950bf-eb34-4d33-8915-dbc7df4c9e4d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:23.837717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5547d75a-362b-4b58-8caf-bdad7bf9aa6a req-ba6950bf-eb34-4d33-8915-dbc7df4c9e4d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:23.838219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5547d75a-362b-4b58-8caf-bdad7bf9aa6a req-ba6950bf-eb34-4d33-8915-dbc7df4c9e4d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:23.851729 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-5547d75a-362b-4b58-8caf-bdad7bf9aa6a req-ba6950bf-eb34-4d33-8915-dbc7df4c9e4d service nova] Creating event network-vif-unplugged:cfaeff62-0ae1-46e7-8b35-700316aeca48 for instance e946f79d-2f84-4dec-898c-f9240ffa910f on n-h2-856894-1 Sep 10 11:19:23.858290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-5547d75a-362b-4b58-8caf-bdad7bf9aa6a req-ba6950bf-eb34-4d33-8915-dbc7df4c9e4d service nova] Instance e946f79d-2f84-4dec-898c-f9240ffa910f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:19:23.869946 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-5547d75a-362b-4b58-8caf-bdad7bf9aa6a req-ba6950bf-eb34-4d33-8915-dbc7df4c9e4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047605 Sep 10 11:19:23.870572 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1817/5949] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:19:24.486809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6bbf7f05-bfc3-4a6d-85bf-89d4206e5b1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:24.487439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6bbf7f05-bfc3-4a6d-85bf-89d4206e5b1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:24.497978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bbf7f05-bfc3-4a6d-85bf-89d4206e5b1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:24.507142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bbf7f05-bfc3-4a6d-85bf-89d4206e5b1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:24.507692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bbf7f05-bfc3-4a6d-85bf-89d4206e5b1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:24.508458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bbf7f05-bfc3-4a6d-85bf-89d4206e5b1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:24.508942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bbf7f05-bfc3-4a6d-85bf-89d4206e5b1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:24.509422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6bbf7f05-bfc3-4a6d-85bf-89d4206e5b1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:24.698936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6bbf7f05-bfc3-4a6d-85bf-89d4206e5b1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:24.707705 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6bbf7f05-bfc3-4a6d-85bf-89d4206e5b1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1698 microversion: 2.1 time: 0.224813 Sep 10 11:19:24.715262 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4133/5950] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:24 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1698 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:25.734616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dceff0fd-9cf9-4088-b44a-a4ec0f7f0db9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:25.735666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dceff0fd-9cf9-4088-b44a-a4ec0f7f0db9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:25.742424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dceff0fd-9cf9-4088-b44a-a4ec0f7f0db9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:25.742951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dceff0fd-9cf9-4088-b44a-a4ec0f7f0db9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:25.743353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dceff0fd-9cf9-4088-b44a-a4ec0f7f0db9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:25.744055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dceff0fd-9cf9-4088-b44a-a4ec0f7f0db9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:25.744515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dceff0fd-9cf9-4088-b44a-a4ec0f7f0db9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:25.744986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dceff0fd-9cf9-4088-b44a-a4ec0f7f0db9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:25.900637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e90cc108-0f80-4b74-b4d8-552367dde2ed req-018eb0de-c9ba-45a9-98c4-e58bba45f191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e946f79d-2f84-4dec-898c-f9240ffa910f", "tag": "cfaeff62-0ae1-46e7-8b35-700316aeca48"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:25.913157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e90cc108-0f80-4b74-b4d8-552367dde2ed req-018eb0de-c9ba-45a9-98c4-e58bba45f191 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:25.913862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e90cc108-0f80-4b74-b4d8-552367dde2ed req-018eb0de-c9ba-45a9-98c4-e58bba45f191 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:25.914904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e90cc108-0f80-4b74-b4d8-552367dde2ed req-018eb0de-c9ba-45a9-98c4-e58bba45f191 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:25.917058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dceff0fd-9cf9-4088-b44a-a4ec0f7f0db9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:25.928695 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dceff0fd-9cf9-4088-b44a-a4ec0f7f0db9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1696 microversion: 2.1 time: 0.199180 Sep 10 11:19:25.945098 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1818/5951] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:25 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:25.945691 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e90cc108-0f80-4b74-b4d8-552367dde2ed req-018eb0de-c9ba-45a9-98c4-e58bba45f191 service nova] Creating event network-changed:cfaeff62-0ae1-46e7-8b35-700316aeca48 for instance e946f79d-2f84-4dec-898c-f9240ffa910f on n-h2-856894-1 Sep 10 11:19:25.945691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-e90cc108-0f80-4b74-b4d8-552367dde2ed req-018eb0de-c9ba-45a9-98c4-e58bba45f191 service nova] Instance e946f79d-2f84-4dec-898c-f9240ffa910f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:19:25.956217 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e90cc108-0f80-4b74-b4d8-552367dde2ed req-018eb0de-c9ba-45a9-98c4-e58bba45f191 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060122 Sep 10 11:19:25.957410 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4134/5952] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:19:26.957460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e2b15a04-9ed6-41ae-bffd-b271a5797c19 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:26.958199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e2b15a04-9ed6-41ae-bffd-b271a5797c19 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:26.966297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b15a04-9ed6-41ae-bffd-b271a5797c19 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:26.966898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b15a04-9ed6-41ae-bffd-b271a5797c19 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:26.968213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b15a04-9ed6-41ae-bffd-b271a5797c19 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:26.969382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b15a04-9ed6-41ae-bffd-b271a5797c19 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:26.969804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b15a04-9ed6-41ae-bffd-b271a5797c19 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:26.970555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b15a04-9ed6-41ae-bffd-b271a5797c19 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:27.208961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e2b15a04-9ed6-41ae-bffd-b271a5797c19 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:27.220283 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e2b15a04-9ed6-41ae-bffd-b271a5797c19 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1693 microversion: 2.1 time: 0.268379 Sep 10 11:19:27.221577 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1819/5953] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:26 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1693 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:27.245667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cbbd3afd-0c37-42fc-b076-894fc5f3d994 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:27.246309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cbbd3afd-0c37-42fc-b076-894fc5f3d994 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:27.252830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbbd3afd-0c37-42fc-b076-894fc5f3d994 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:27.253390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbbd3afd-0c37-42fc-b076-894fc5f3d994 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:27.253845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbbd3afd-0c37-42fc-b076-894fc5f3d994 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:27.254562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbbd3afd-0c37-42fc-b076-894fc5f3d994 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:27.255063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbbd3afd-0c37-42fc-b076-894fc5f3d994 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:27.255512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cbbd3afd-0c37-42fc-b076-894fc5f3d994 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:27.371957 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cbbd3afd-0c37-42fc-b076-894fc5f3d994 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f/action" status: 202 len: 0 microversion: 2.1 time: 0.131114 Sep 10 11:19:27.372910 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4135/5954] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:19:27 2022] POST /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:19:27.381384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8296d106-acc8-4e36-aaa7-321f0cdda542 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:27.382816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8296d106-acc8-4e36-aaa7-321f0cdda542 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:27.392535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8296d106-acc8-4e36-aaa7-321f0cdda542 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:27.393217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8296d106-acc8-4e36-aaa7-321f0cdda542 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:27.393821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8296d106-acc8-4e36-aaa7-321f0cdda542 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:27.394624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8296d106-acc8-4e36-aaa7-321f0cdda542 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:27.395183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8296d106-acc8-4e36-aaa7-321f0cdda542 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:27.396247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8296d106-acc8-4e36-aaa7-321f0cdda542 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:27.603981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-973238538", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "0e79c580-7706-4209-8220-19d68cd09f31"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:27.660799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] validate_networks() for [('0e79c580-7706-4209-8220-19d68cd09f31', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:19:28.018996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8296d106-acc8-4e36-aaa7-321f0cdda542 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:28.027564 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8296d106-acc8-4e36-aaa7-321f0cdda542 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1692 microversion: 2.1 time: 0.650218 Sep 10 11:19:28.028431 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1820/5955] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:27 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1692 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:28.491941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:19:28.492417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:19:28.492873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:19:28.493438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:19:28.493868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:19:28.502822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:28.503348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:28.503792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:28.504536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:28.505504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:28.505955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:28.524035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Getting quotas for project c86e0403ece1466191df053f9cf2b959. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:19:28.529520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Getting quotas for user bcb2a2204e764d5c9b0224af8399e81d and project c86e0403ece1466191df053f9cf2b959. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:19:28.542190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:19:28.544707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:19:28.590953 n-d-856894-1 devstack@n-api.service[128788]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [cbd28549-c4f9-4def-83aa-55236dae37b9] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 11:19:29.055688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a8744be2-911a-425f-9d07-472f0e037e14 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:29.056319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a8744be2-911a-425f-9d07-472f0e037e14 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:29.062989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8744be2-911a-425f-9d07-472f0e037e14 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:29.063484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8744be2-911a-425f-9d07-472f0e037e14 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:29.064135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8744be2-911a-425f-9d07-472f0e037e14 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:29.064848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8744be2-911a-425f-9d07-472f0e037e14 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:29.065337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8744be2-911a-425f-9d07-472f0e037e14 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:29.065775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8744be2-911a-425f-9d07-472f0e037e14 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:29.206056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a8744be2-911a-425f-9d07-472f0e037e14 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:29.214878 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a8744be2-911a-425f-9d07-472f0e037e14 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1692 microversion: 2.1 time: 0.163646 Sep 10 11:19:29.215533 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1821/5956] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:29 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:19:29.600212 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [cbd28549-c4f9-4def-83aa-55236dae37b9] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44630. Sep 10 11:19:29.605622 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f4fe0089-2713-4009-8fd3-69cf616713fd tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.006012 Sep 10 11:19:29.606547 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4136/5957] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:19:29.618436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b403e462-7093-473e-a5c4-959f026ca715 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:29.619212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b403e462-7093-473e-a5c4-959f026ca715 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:29.673980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b403e462-7093-473e-a5c4-959f026ca715 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:29.681456 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b403e462-7093-473e-a5c4-959f026ca715 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1218 microversion: 2.1 time: 0.067437 Sep 10 11:19:29.681856 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1822/5958] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:29 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:19:30.242622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ca9101fb-6417-49c8-9a97-83f03d5a4a1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:30.243248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ca9101fb-6417-49c8-9a97-83f03d5a4a1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:30.251023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9101fb-6417-49c8-9a97-83f03d5a4a1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:30.251522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9101fb-6417-49c8-9a97-83f03d5a4a1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:30.251969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9101fb-6417-49c8-9a97-83f03d5a4a1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:30.252678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9101fb-6417-49c8-9a97-83f03d5a4a1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:30.253167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9101fb-6417-49c8-9a97-83f03d5a4a1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:30.253609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca9101fb-6417-49c8-9a97-83f03d5a4a1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:30.412703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ca9101fb-6417-49c8-9a97-83f03d5a4a1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:30.420826 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ca9101fb-6417-49c8-9a97-83f03d5a4a1c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1692 microversion: 2.1 time: 0.182675 Sep 10 11:19:30.421424 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4137/5959] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:30 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:30.705257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-396b6f1e-acb9-41d2-857b-1593c364fc40 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:30.705881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-396b6f1e-acb9-41d2-857b-1593c364fc40 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:30.715385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-396b6f1e-acb9-41d2-857b-1593c364fc40 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:30.716127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-396b6f1e-acb9-41d2-857b-1593c364fc40 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:30.716687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-396b6f1e-acb9-41d2-857b-1593c364fc40 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:30.717433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-396b6f1e-acb9-41d2-857b-1593c364fc40 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:30.717892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-396b6f1e-acb9-41d2-857b-1593c364fc40 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:30.718327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-396b6f1e-acb9-41d2-857b-1593c364fc40 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:30.796629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-396b6f1e-acb9-41d2-857b-1593c364fc40 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:30.805304 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-396b6f1e-acb9-41d2-857b-1593c364fc40 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1270 microversion: 2.1 time: 0.104343 Sep 10 11:19:30.806111 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1823/5960] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:30 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:31.445171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e9e7a8e-773c-4ee8-b881-cb060a3b5e83 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:31.445811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e9e7a8e-773c-4ee8-b881-cb060a3b5e83 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:31.452967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e9e7a8e-773c-4ee8-b881-cb060a3b5e83 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:31.453507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e9e7a8e-773c-4ee8-b881-cb060a3b5e83 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:31.453965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e9e7a8e-773c-4ee8-b881-cb060a3b5e83 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:31.454681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e9e7a8e-773c-4ee8-b881-cb060a3b5e83 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:31.455154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e9e7a8e-773c-4ee8-b881-cb060a3b5e83 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:31.455805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e9e7a8e-773c-4ee8-b881-cb060a3b5e83 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:31.689328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e9e7a8e-773c-4ee8-b881-cb060a3b5e83 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:31.700973 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e9e7a8e-773c-4ee8-b881-cb060a3b5e83 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1692 microversion: 2.1 time: 0.259477 Sep 10 11:19:31.709338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4138/5961] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:31 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1692 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:31.781963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-e66d5f07-4e6d-400e-88a1-fd995d117cf2 req-6cd6e93b-1a97-4c42-9b1b-5e616c0f0833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e946f79d-2f84-4dec-898c-f9240ffa910f", "tag": "cfaeff62-0ae1-46e7-8b35-700316aeca48"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:31.795289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e66d5f07-4e6d-400e-88a1-fd995d117cf2 req-6cd6e93b-1a97-4c42-9b1b-5e616c0f0833 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:31.796164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e66d5f07-4e6d-400e-88a1-fd995d117cf2 req-6cd6e93b-1a97-4c42-9b1b-5e616c0f0833 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:31.796819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e66d5f07-4e6d-400e-88a1-fd995d117cf2 req-6cd6e93b-1a97-4c42-9b1b-5e616c0f0833 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:31.811221 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-e66d5f07-4e6d-400e-88a1-fd995d117cf2 req-6cd6e93b-1a97-4c42-9b1b-5e616c0f0833 service nova] Creating event network-changed:cfaeff62-0ae1-46e7-8b35-700316aeca48 for instance e946f79d-2f84-4dec-898c-f9240ffa910f on n-h1-856894-1 Sep 10 11:19:31.818058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-e66d5f07-4e6d-400e-88a1-fd995d117cf2 req-6cd6e93b-1a97-4c42-9b1b-5e616c0f0833 service nova] Instance e946f79d-2f84-4dec-898c-f9240ffa910f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:19:31.829968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-152d2903-2bfc-4f5a-8197-a570109468d3 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:31.830997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-152d2903-2bfc-4f5a-8197-a570109468d3 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:31.843416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d2903-2bfc-4f5a-8197-a570109468d3 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:31.844570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d2903-2bfc-4f5a-8197-a570109468d3 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:31.845348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d2903-2bfc-4f5a-8197-a570109468d3 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:31.846299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d2903-2bfc-4f5a-8197-a570109468d3 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:31.848125 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-e66d5f07-4e6d-400e-88a1-fd995d117cf2 req-6cd6e93b-1a97-4c42-9b1b-5e616c0f0833 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070366 Sep 10 11:19:31.849508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d2903-2bfc-4f5a-8197-a570109468d3 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:31.850160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-152d2903-2bfc-4f5a-8197-a570109468d3 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:31.851212 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1824/5962] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:19:32.185471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-152d2903-2bfc-4f5a-8197-a570109468d3 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:32.193653 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-152d2903-2bfc-4f5a-8197-a570109468d3 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1318 microversion: 2.1 time: 0.368061 Sep 10 11:19:32.203071 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4139/5963] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:31 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:19:32.725990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c4c93b3a-9a0f-41da-9acf-ac013c767fce tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:32.726863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c4c93b3a-9a0f-41da-9acf-ac013c767fce tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:32.733319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4c93b3a-9a0f-41da-9acf-ac013c767fce tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:32.733803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4c93b3a-9a0f-41da-9acf-ac013c767fce tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:32.734244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4c93b3a-9a0f-41da-9acf-ac013c767fce tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:32.734940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4c93b3a-9a0f-41da-9acf-ac013c767fce tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:32.735389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4c93b3a-9a0f-41da-9acf-ac013c767fce tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:32.735811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c4c93b3a-9a0f-41da-9acf-ac013c767fce tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:32.754214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:32.976289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c4c93b3a-9a0f-41da-9acf-ac013c767fce tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:32.985112 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c4c93b3a-9a0f-41da-9acf-ac013c767fce tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1692 microversion: 2.1 time: 0.263488 Sep 10 11:19:32.997808 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1825/5964] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:32 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1692 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:33.010838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3013bae6-0c44-49b8-928d-283c99b681eb req-1c739469-211a-414b-95e2-856896a2c15b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff4f080-f591-46c4-9e6c-bda6c5d35b39", "tag": "f8560c49-5369-4c9d-85a4-7a64ac17b498"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:33.023073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3013bae6-0c44-49b8-928d-283c99b681eb req-1c739469-211a-414b-95e2-856896a2c15b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:33.023823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3013bae6-0c44-49b8-928d-283c99b681eb req-1c739469-211a-414b-95e2-856896a2c15b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:33.024501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3013bae6-0c44-49b8-928d-283c99b681eb req-1c739469-211a-414b-95e2-856896a2c15b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:33.029307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:33.048666 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3013bae6-0c44-49b8-928d-283c99b681eb req-1c739469-211a-414b-95e2-856896a2c15b service nova] Creating event network-changed:f8560c49-5369-4c9d-85a4-7a64ac17b498 for instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 on n-h2-856894-1 Sep 10 11:19:33.054731 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3013bae6-0c44-49b8-928d-283c99b681eb req-1c739469-211a-414b-95e2-856896a2c15b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047562 Sep 10 11:19:33.055351 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4140/5965] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:19:33.216161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b3de5104-e812-496e-b4b0-05c54198cc5a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:33.216792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b3de5104-e812-496e-b4b0-05c54198cc5a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:33.223256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3de5104-e812-496e-b4b0-05c54198cc5a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:33.224142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3de5104-e812-496e-b4b0-05c54198cc5a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:33.224660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3de5104-e812-496e-b4b0-05c54198cc5a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:33.225483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3de5104-e812-496e-b4b0-05c54198cc5a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:33.226050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3de5104-e812-496e-b4b0-05c54198cc5a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:33.226978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b3de5104-e812-496e-b4b0-05c54198cc5a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:33.560706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b3de5104-e812-496e-b4b0-05c54198cc5a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:33.569302 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b3de5104-e812-496e-b4b0-05c54198cc5a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1318 microversion: 2.1 time: 0.357024 Sep 10 11:19:33.569986 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1826/5966] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:33 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:34.026858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60df433d-ac6a-422a-a73b-9cdec53c6a04 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:34.029779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60df433d-ac6a-422a-a73b-9cdec53c6a04 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:34.050219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60df433d-ac6a-422a-a73b-9cdec53c6a04 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:34.052447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60df433d-ac6a-422a-a73b-9cdec53c6a04 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:34.053123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60df433d-ac6a-422a-a73b-9cdec53c6a04 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:34.054541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60df433d-ac6a-422a-a73b-9cdec53c6a04 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:34.055025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60df433d-ac6a-422a-a73b-9cdec53c6a04 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:34.055479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60df433d-ac6a-422a-a73b-9cdec53c6a04 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:34.337078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60df433d-ac6a-422a-a73b-9cdec53c6a04 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:34.344882 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60df433d-ac6a-422a-a73b-9cdec53c6a04 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1685 microversion: 2.1 time: 0.335876 Sep 10 11:19:34.345689 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4141/5967] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:34 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1685 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:34.593252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b394b86f-cb00-4bf8-b4ed-cda7a8b60d20 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:34.594114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b394b86f-cb00-4bf8-b4ed-cda7a8b60d20 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:34.601663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b394b86f-cb00-4bf8-b4ed-cda7a8b60d20 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:34.602228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b394b86f-cb00-4bf8-b4ed-cda7a8b60d20 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:34.602739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b394b86f-cb00-4bf8-b4ed-cda7a8b60d20 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:34.603441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b394b86f-cb00-4bf8-b4ed-cda7a8b60d20 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:34.603936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b394b86f-cb00-4bf8-b4ed-cda7a8b60d20 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:34.604354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b394b86f-cb00-4bf8-b4ed-cda7a8b60d20 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:34.832472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b394b86f-cb00-4bf8-b4ed-cda7a8b60d20 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:34.841700 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b394b86f-cb00-4bf8-b4ed-cda7a8b60d20 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1262 microversion: 2.1 time: 0.252343 Sep 10 11:19:34.842682 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1827/5968] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:34 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1262 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:19:35.081869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ae185e7b-bd2a-4fec-b67c-ea6a30ef41a8 req-63bf532c-c9a3-4301-86d9-f9e6396c2378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff4f080-f591-46c4-9e6c-bda6c5d35b39", "name": "network-vif-deleted", "tag": "f8560c49-5369-4c9d-85a4-7a64ac17b498"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:35.093770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae185e7b-bd2a-4fec-b67c-ea6a30ef41a8 req-63bf532c-c9a3-4301-86d9-f9e6396c2378 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:35.094404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae185e7b-bd2a-4fec-b67c-ea6a30ef41a8 req-63bf532c-c9a3-4301-86d9-f9e6396c2378 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:35.094850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ae185e7b-bd2a-4fec-b67c-ea6a30ef41a8 req-63bf532c-c9a3-4301-86d9-f9e6396c2378 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:35.109315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.server_external_events [req-ae185e7b-bd2a-4fec-b67c-ea6a30ef41a8 req-63bf532c-c9a3-4301-86d9-f9e6396c2378 service nova] Unable to find a host for instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39. Dropping event network-vif-deleted {{(pid=128788) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 11:19:35.110231 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ae185e7b-bd2a-4fec-b67c-ea6a30ef41a8 req-63bf532c-c9a3-4301-86d9-f9e6396c2378 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032491 Sep 10 11:19:35.110841 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4142/5969] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 10 11:19:35.444876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-f08a941b-b96a-442e-b3b6-2d5cb3e3bc23 req-d8b84e1c-97f6-471e-aa6c-19ac0b742fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e946f79d-2f84-4dec-898c-f9240ffa910f", "name": "network-vif-plugged", "status": "completed", "tag": "cfaeff62-0ae1-46e7-8b35-700316aeca48"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:35.456001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f08a941b-b96a-442e-b3b6-2d5cb3e3bc23 req-d8b84e1c-97f6-471e-aa6c-19ac0b742fe1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:35.456749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f08a941b-b96a-442e-b3b6-2d5cb3e3bc23 req-d8b84e1c-97f6-471e-aa6c-19ac0b742fe1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:35.457758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f08a941b-b96a-442e-b3b6-2d5cb3e3bc23 req-d8b84e1c-97f6-471e-aa6c-19ac0b742fe1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:35.470332 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-f08a941b-b96a-442e-b3b6-2d5cb3e3bc23 req-d8b84e1c-97f6-471e-aa6c-19ac0b742fe1 service nova] Creating event network-vif-plugged:cfaeff62-0ae1-46e7-8b35-700316aeca48 for instance e946f79d-2f84-4dec-898c-f9240ffa910f on n-h1-856894-1 Sep 10 11:19:35.475653 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-f08a941b-b96a-442e-b3b6-2d5cb3e3bc23 req-d8b84e1c-97f6-471e-aa6c-19ac0b742fe1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036329 Sep 10 11:19:35.476373 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1828/5970] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:19:35.871220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8391e30b-97da-41e5-899f-7de34b5804b4 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:35.872743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8391e30b-97da-41e5-899f-7de34b5804b4 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:35.878885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8391e30b-97da-41e5-899f-7de34b5804b4 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:35.879470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8391e30b-97da-41e5-899f-7de34b5804b4 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:35.879994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8391e30b-97da-41e5-899f-7de34b5804b4 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:35.880725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8391e30b-97da-41e5-899f-7de34b5804b4 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:35.881380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8391e30b-97da-41e5-899f-7de34b5804b4 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:35.881830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8391e30b-97da-41e5-899f-7de34b5804b4 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:35.944149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8391e30b-97da-41e5-899f-7de34b5804b4 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:35.951868 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8391e30b-97da-41e5-899f-7de34b5804b4 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1270 microversion: 2.1 time: 0.087615 Sep 10 11:19:35.952443 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4143/5971] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:35 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:36.977305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f3c8b6cc-7bb0-401e-982e-8b2e956dfe66 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:36.978021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f3c8b6cc-7bb0-401e-982e-8b2e956dfe66 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:36.984318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c8b6cc-7bb0-401e-982e-8b2e956dfe66 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:36.984804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c8b6cc-7bb0-401e-982e-8b2e956dfe66 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:36.985326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c8b6cc-7bb0-401e-982e-8b2e956dfe66 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:36.986003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c8b6cc-7bb0-401e-982e-8b2e956dfe66 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:36.986442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c8b6cc-7bb0-401e-982e-8b2e956dfe66 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:36.986870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f3c8b6cc-7bb0-401e-982e-8b2e956dfe66 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:37.116022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f3c8b6cc-7bb0-401e-982e-8b2e956dfe66 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:37.123736 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f3c8b6cc-7bb0-401e-982e-8b2e956dfe66 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1318 microversion: 2.1 time: 0.151704 Sep 10 11:19:37.124306 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1829/5972] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:36 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:37.433786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4d40f60a-dcfc-46b5-ac0a-61e437f4e5a8 req-e2fabee1-9393-4ccf-8c10-c48b746ac613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff4f080-f591-46c4-9e6c-bda6c5d35b39", "tag": "625f6c13-8f8d-48de-8f5f-957d7f1d473f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:37.447510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4d40f60a-dcfc-46b5-ac0a-61e437f4e5a8 req-e2fabee1-9393-4ccf-8c10-c48b746ac613 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:37.448014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4d40f60a-dcfc-46b5-ac0a-61e437f4e5a8 req-e2fabee1-9393-4ccf-8c10-c48b746ac613 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:37.448469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4d40f60a-dcfc-46b5-ac0a-61e437f4e5a8 req-e2fabee1-9393-4ccf-8c10-c48b746ac613 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:37.460862 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4d40f60a-dcfc-46b5-ac0a-61e437f4e5a8 req-e2fabee1-9393-4ccf-8c10-c48b746ac613 service nova] Creating event network-changed:625f6c13-8f8d-48de-8f5f-957d7f1d473f for instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 on n-h1-856894-1 Sep 10 11:19:37.466351 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4d40f60a-dcfc-46b5-ac0a-61e437f4e5a8 req-e2fabee1-9393-4ccf-8c10-c48b746ac613 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036104 Sep 10 11:19:37.466975 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4144/5973] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:19:38.148259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fe802436-44be-4926-b7a7-9a0cac63cbe9 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:38.148898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fe802436-44be-4926-b7a7-9a0cac63cbe9 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:38.155715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe802436-44be-4926-b7a7-9a0cac63cbe9 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:38.156201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe802436-44be-4926-b7a7-9a0cac63cbe9 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:38.156637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe802436-44be-4926-b7a7-9a0cac63cbe9 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:38.157342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe802436-44be-4926-b7a7-9a0cac63cbe9 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:38.157795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe802436-44be-4926-b7a7-9a0cac63cbe9 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:38.158218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe802436-44be-4926-b7a7-9a0cac63cbe9 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:38.292592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe802436-44be-4926-b7a7-9a0cac63cbe9 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:38.300143 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fe802436-44be-4926-b7a7-9a0cac63cbe9 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1318 microversion: 2.1 time: 0.155849 Sep 10 11:19:38.300710 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1830/5974] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:38 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:39.325649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a112b280-43e4-405f-91e3-268c6bcff809 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:39.326409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a112b280-43e4-405f-91e3-268c6bcff809 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:39.329269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:39.330117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:39.330668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:39.337426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a112b280-43e4-405f-91e3-268c6bcff809 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:39.337937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a112b280-43e4-405f-91e3-268c6bcff809 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:39.338397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a112b280-43e4-405f-91e3-268c6bcff809 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:39.339184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a112b280-43e4-405f-91e3-268c6bcff809 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:39.339664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a112b280-43e4-405f-91e3-268c6bcff809 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:39.340113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a112b280-43e4-405f-91e3-268c6bcff809 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:39.473915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a112b280-43e4-405f-91e3-268c6bcff809 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:39.481679 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a112b280-43e4-405f-91e3-268c6bcff809 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1318 microversion: 2.1 time: 0.160474 Sep 10 11:19:39.482273 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4145/5975] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:39 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:40.505547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e9c78090-9be8-4276-abba-8fce1efada34 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:40.506300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e9c78090-9be8-4276-abba-8fce1efada34 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:40.511015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:40.511834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=49 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:40.516676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9c78090-9be8-4276-abba-8fce1efada34 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:40.517188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9c78090-9be8-4276-abba-8fce1efada34 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:40.517623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9c78090-9be8-4276-abba-8fce1efada34 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:40.518374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9c78090-9be8-4276-abba-8fce1efada34 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:40.518825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9c78090-9be8-4276-abba-8fce1efada34 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:40.519246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9c78090-9be8-4276-abba-8fce1efada34 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:40.650855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e9c78090-9be8-4276-abba-8fce1efada34 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:40.658537 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e9c78090-9be8-4276-abba-8fce1efada34 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1318 microversion: 2.1 time: 0.157469 Sep 10 11:19:40.659115 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1831/5976] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:40 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:41.435285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-998b15da-05c7-45f9-8ec3-d90a29d26f65 req-b1939c23-0028-44a5-a6ba-f84417e1be9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff4f080-f591-46c4-9e6c-bda6c5d35b39", "name": "network-vif-plugged", "status": "completed", "tag": "625f6c13-8f8d-48de-8f5f-957d7f1d473f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:41.446427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-998b15da-05c7-45f9-8ec3-d90a29d26f65 req-b1939c23-0028-44a5-a6ba-f84417e1be9e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:41.447373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-998b15da-05c7-45f9-8ec3-d90a29d26f65 req-b1939c23-0028-44a5-a6ba-f84417e1be9e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:41.448008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-998b15da-05c7-45f9-8ec3-d90a29d26f65 req-b1939c23-0028-44a5-a6ba-f84417e1be9e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:41.461091 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-998b15da-05c7-45f9-8ec3-d90a29d26f65 req-b1939c23-0028-44a5-a6ba-f84417e1be9e service nova] Creating event network-vif-plugged:625f6c13-8f8d-48de-8f5f-957d7f1d473f for instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 on n-h1-856894-1 Sep 10 11:19:41.466142 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-998b15da-05c7-45f9-8ec3-d90a29d26f65 req-b1939c23-0028-44a5-a6ba-f84417e1be9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034692 Sep 10 11:19:41.467184 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4146/5977] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:19:41.681758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2f41ff5b-0eb3-4310-82df-0e620c4e38cf tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:41.682397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2f41ff5b-0eb3-4310-82df-0e620c4e38cf tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:41.689354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f41ff5b-0eb3-4310-82df-0e620c4e38cf tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:41.689851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f41ff5b-0eb3-4310-82df-0e620c4e38cf tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:41.690293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f41ff5b-0eb3-4310-82df-0e620c4e38cf tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:41.690991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f41ff5b-0eb3-4310-82df-0e620c4e38cf tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:41.691475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f41ff5b-0eb3-4310-82df-0e620c4e38cf tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:41.691904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2f41ff5b-0eb3-4310-82df-0e620c4e38cf tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:41.819629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2f41ff5b-0eb3-4310-82df-0e620c4e38cf tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:41.827581 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2f41ff5b-0eb3-4310-82df-0e620c4e38cf tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1318 microversion: 2.1 time: 0.149745 Sep 10 11:19:41.828152 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1832/5978] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:41 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:19:42.852157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15eb80d9-9b93-4262-82a7-42f383eec12d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:19:42.852868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15eb80d9-9b93-4262-82a7-42f383eec12d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:42.860054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15eb80d9-9b93-4262-82a7-42f383eec12d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:42.860547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15eb80d9-9b93-4262-82a7-42f383eec12d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:42.860997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15eb80d9-9b93-4262-82a7-42f383eec12d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:42.861719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15eb80d9-9b93-4262-82a7-42f383eec12d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:42.862184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15eb80d9-9b93-4262-82a7-42f383eec12d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:42.862620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15eb80d9-9b93-4262-82a7-42f383eec12d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:42.995282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15eb80d9-9b93-4262-82a7-42f383eec12d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:19:43.003163 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15eb80d9-9b93-4262-82a7-42f383eec12d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1507 microversion: 2.1 time: 0.155862 Sep 10 11:19:43.003742 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4147/5979] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:19:42 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:19:58.257008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9c2b76ef-68b5-4da3-b306-dd606eb312c0 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20a6b538-1534-4438-966e-93e745ff6790", "device": "/dev/sdb"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:19:58.259918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9c2b76ef-68b5-4da3-b306-dd606eb312c0 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:19:58.262133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:58.262790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=40 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:19:58.268283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c2b76ef-68b5-4da3-b306-dd606eb312c0 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:58.268760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c2b76ef-68b5-4da3-b306-dd606eb312c0 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:58.269230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c2b76ef-68b5-4da3-b306-dd606eb312c0 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:58.270553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c2b76ef-68b5-4da3-b306-dd606eb312c0 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:19:58.271002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c2b76ef-68b5-4da3-b306-dd606eb312c0 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:19:58.271426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c2b76ef-68b5-4da3-b306-dd606eb312c0 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:19:58.507065 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9c2b76ef-68b5-4da3-b306-dd606eb312c0 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "POST /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254600 Sep 10 11:19:58.507678 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1833/5980] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:19:58 2022] POST /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:00.550571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef729d4e-ded1-406f-8d01-4897c1266267 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:00.553424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef729d4e-ded1-406f-8d01-4897c1266267 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:00.556709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=5 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:00.557578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=31 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:00.563662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef729d4e-ded1-406f-8d01-4897c1266267 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:00.564165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef729d4e-ded1-406f-8d01-4897c1266267 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:00.564614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef729d4e-ded1-406f-8d01-4897c1266267 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:00.565349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef729d4e-ded1-406f-8d01-4897c1266267 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:00.565816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef729d4e-ded1-406f-8d01-4897c1266267 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:00.566252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef729d4e-ded1-406f-8d01-4897c1266267 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:00.623629 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef729d4e-ded1-406f-8d01-4897c1266267 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f/action" status: 200 len: 63257 microversion: 2.1 time: 0.077092 Sep 10 11:20:00.624608 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4148/5981] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:20:00 2022] POST /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f/action => generated 63257 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:20:07.157575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0911d54d-177b-4a74-b59a-c09e671b6008 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:07.158299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0911d54d-177b-4a74-b59a-c09e671b6008 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:07.165636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0911d54d-177b-4a74-b59a-c09e671b6008 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:07.166138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0911d54d-177b-4a74-b59a-c09e671b6008 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:07.166844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0911d54d-177b-4a74-b59a-c09e671b6008 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:07.167559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0911d54d-177b-4a74-b59a-c09e671b6008 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:07.168023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0911d54d-177b-4a74-b59a-c09e671b6008 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:07.168454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0911d54d-177b-4a74-b59a-c09e671b6008 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:07.297263 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0911d54d-177b-4a74-b59a-c09e671b6008 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1836 microversion: 2.1 time: 0.144634 Sep 10 11:20:07.297832 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1834/5982] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:07 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1836 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:08.127189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7966f2be-a99a-43f9-8540-e964b0b2fea2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:08.129346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7966f2be-a99a-43f9-8540-e964b0b2fea2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:08.138032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7966f2be-a99a-43f9-8540-e964b0b2fea2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:08.138616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7966f2be-a99a-43f9-8540-e964b0b2fea2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:08.139146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7966f2be-a99a-43f9-8540-e964b0b2fea2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:08.139940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7966f2be-a99a-43f9-8540-e964b0b2fea2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:08.140483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7966f2be-a99a-43f9-8540-e964b0b2fea2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:08.141000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7966f2be-a99a-43f9-8540-e964b0b2fea2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:08.173399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7966f2be-a99a-43f9-8540-e964b0b2fea2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:20:08.214242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-4368d72c-8672-48bd-adc4-062abb634c51 req-5f46acee-9a42-49ba-a08b-3b96f3b32ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e946f79d-2f84-4dec-898c-f9240ffa910f", "tag": "cfaeff62-0ae1-46e7-8b35-700316aeca48"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:08.231840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4368d72c-8672-48bd-adc4-062abb634c51 req-5f46acee-9a42-49ba-a08b-3b96f3b32ada service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:08.232344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4368d72c-8672-48bd-adc4-062abb634c51 req-5f46acee-9a42-49ba-a08b-3b96f3b32ada service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:08.233152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4368d72c-8672-48bd-adc4-062abb634c51 req-5f46acee-9a42-49ba-a08b-3b96f3b32ada service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:08.251189 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-4368d72c-8672-48bd-adc4-062abb634c51 req-5f46acee-9a42-49ba-a08b-3b96f3b32ada service nova] Creating event network-changed:cfaeff62-0ae1-46e7-8b35-700316aeca48 for instance e946f79d-2f84-4dec-898c-f9240ffa910f on n-h1-856894-1 Sep 10 11:20:08.262712 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-4368d72c-8672-48bd-adc4-062abb634c51 req-5f46acee-9a42-49ba-a08b-3b96f3b32ada service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144240 Sep 10 11:20:08.262890 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7966f2be-a99a-43f9-8540-e964b0b2fea2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 204 len: 0 microversion: 2.1 time: 0.146353 Sep 10 11:20:08.263992 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4149/5983] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:20:08 2022] DELETE /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:20:08.265181 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1835/5984] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:08.273896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-15f3ed1e-fc52-4058-a7fb-2a6dad139a8f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:08.274760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-15f3ed1e-fc52-4058-a7fb-2a6dad139a8f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:08.282301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f3ed1e-fc52-4058-a7fb-2a6dad139a8f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:08.282806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f3ed1e-fc52-4058-a7fb-2a6dad139a8f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:08.283260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f3ed1e-fc52-4058-a7fb-2a6dad139a8f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:08.283977 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f3ed1e-fc52-4058-a7fb-2a6dad139a8f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:08.284579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f3ed1e-fc52-4058-a7fb-2a6dad139a8f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:08.285588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-15f3ed1e-fc52-4058-a7fb-2a6dad139a8f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:08.425745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-15f3ed1e-fc52-4058-a7fb-2a6dad139a8f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:08.433881 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-15f3ed1e-fc52-4058-a7fb-2a6dad139a8f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1691 microversion: 2.1 time: 0.164232 Sep 10 11:20:08.434691 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4150/5985] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:08 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:09.459360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a7530e15-a228-4d6c-b440-6a9a889ee307 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:09.459968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a7530e15-a228-4d6c-b440-6a9a889ee307 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:09.466226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7530e15-a228-4d6c-b440-6a9a889ee307 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:09.466721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7530e15-a228-4d6c-b440-6a9a889ee307 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:09.467164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7530e15-a228-4d6c-b440-6a9a889ee307 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:09.467857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7530e15-a228-4d6c-b440-6a9a889ee307 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:09.468322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7530e15-a228-4d6c-b440-6a9a889ee307 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:09.468752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7530e15-a228-4d6c-b440-6a9a889ee307 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:09.603503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a7530e15-a228-4d6c-b440-6a9a889ee307 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:09.611312 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a7530e15-a228-4d6c-b440-6a9a889ee307 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1691 microversion: 2.1 time: 0.157313 Sep 10 11:20:09.611883 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1836/5986] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:09 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:10.577335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5a5a9361-1e54-4508-bcf3-bc8e85dd72a4 req-2d8f105a-f7d0-4336-8821-a47ef98017e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e946f79d-2f84-4dec-898c-f9240ffa910f", "name": "network-vif-deleted", "tag": "cfaeff62-0ae1-46e7-8b35-700316aeca48"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:10.591079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5a5a9361-1e54-4508-bcf3-bc8e85dd72a4 req-2d8f105a-f7d0-4336-8821-a47ef98017e1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:10.591896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5a5a9361-1e54-4508-bcf3-bc8e85dd72a4 req-2d8f105a-f7d0-4336-8821-a47ef98017e1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:10.592343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5a5a9361-1e54-4508-bcf3-bc8e85dd72a4 req-2d8f105a-f7d0-4336-8821-a47ef98017e1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:10.607187 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5a5a9361-1e54-4508-bcf3-bc8e85dd72a4 req-2d8f105a-f7d0-4336-8821-a47ef98017e1 service nova] Creating event network-vif-deleted:cfaeff62-0ae1-46e7-8b35-700316aeca48 for instance e946f79d-2f84-4dec-898c-f9240ffa910f on n-h1-856894-1 Sep 10 11:20:10.613933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5a5a9361-1e54-4508-bcf3-bc8e85dd72a4 req-2d8f105a-f7d0-4336-8821-a47ef98017e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039615 Sep 10 11:20:10.617699 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4151/5987] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:10.639140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a3d76f25-5c50-4c9a-9082-18e59a5539e6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:10.639773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a3d76f25-5c50-4c9a-9082-18e59a5539e6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:10.648230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3d76f25-5c50-4c9a-9082-18e59a5539e6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:10.649682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3d76f25-5c50-4c9a-9082-18e59a5539e6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:10.650470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3d76f25-5c50-4c9a-9082-18e59a5539e6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:10.651636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3d76f25-5c50-4c9a-9082-18e59a5539e6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:10.652116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3d76f25-5c50-4c9a-9082-18e59a5539e6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:10.652557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3d76f25-5c50-4c9a-9082-18e59a5539e6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:10.745914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a3d76f25-5c50-4c9a-9082-18e59a5539e6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:10.753848 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a3d76f25-5c50-4c9a-9082-18e59a5539e6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 200 len: 1352 microversion: 2.1 time: 0.120960 Sep 10 11:20:10.754482 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1837/5988] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:10 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 1352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:11.780983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:11.781909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: e946f79d-2f84-4dec-898c-f9240ffa910f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:11.789154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:11.789657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:11.790106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:11.790810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:11.791562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:11.792011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:11.807190 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] HTTP exception thrown: Instance e946f79d-2f84-4dec-898c-f9240ffa910f could not be found. Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Request method failure captured: Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f HTTP/1.1 Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHH99mNjQ7cQbIBFm5xMEZ09SACFhVgG8u0OC8VbKtc7kt4xMCSUwnrA_oKblEW8JDocge6AO3VQeTn5dPDK01j3vyI7zzY9BdVnAyaSXPFZgxHuuzje-hF9HrWs8Iqjz9AuPu-m3EbiyaYPoNSXA2WnlKdjtcvfaTnrFqxqwvxBOec Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: aad1c11f4349492a8c53684e82676e2e Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad1c11f4349492a8c53684e82676e2e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: aad1c11f4349492a8c53684e82676e2e Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestNetworkAdvancedServerOps-1400270813-project Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 28049b2f9a484bf68b61b0769cef6616 Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1400270813-project Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance e946f79d-2f84-4dec-898c-f9240ffa910f could not be found. Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'e946f79d-2f84-4dec-898c-f9240ffa910f'} Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e946f79d-2f84-4dec-898c-f9240ffa910f could not be found. Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e946f79d-2f84-4dec-898c-f9240ffa910f could not be found. Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:20:11.809772 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:20:11.815229 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:20:11.815229 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:20:11.815229 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:20:11.815229 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:20:11.815229 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:20:11.815229 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:20:11.815229 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e946f79d-2f84-4dec-898c-f9240ffa910f could not be found. Sep 10 11:20:11.815229 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:20:11.817740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Returning 404 to user: Instance e946f79d-2f84-4dec-898c-f9240ffa910f could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:20:11.818934 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9e15386b-faf0-49b5-b949-fc19d5245b3b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f" status: 404 len: 111 microversion: 2.1 time: 0.043474 Sep 10 11:20:11.820347 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4152/5989] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:11 2022] GET /compute/v2.1/servers/e946f79d-2f84-4dec-898c-f9240ffa910f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:20:15.353619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5c4c3cb3-72e4-4233-a63d-2c8315c951be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '.version_select at 0x7efcadc5f790>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:15.379445 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5c4c3cb3-72e4-4233-a63d-2c8315c951be tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1790479322" status: 202 len: 0 microversion: 2.1 time: 0.029687 Sep 10 11:20:15.380052 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1838/5990] 10.222.0.20 () {58 vars in 1284 bytes} [Sat Sep 10 11:20:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1790479322 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:20:15.411628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2e66926-f424-41a9-b9db-ad9fb612986f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'create', calling method: .version_select at 0x7efcad404ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-857262576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAgPn6Y6SReLtY20FXIHJ0HW+6mLkR/pSc26ursOicQ9TnjC1JtosjPGtHMQjgS8XOeSPtefgL3eXqxMmcIdaMiYYXwaLG2r4w1gXeGddahVCeg3mS2odnLg90/4SMz9A=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:15.429354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e2e66926-f424-41a9-b9db-ad9fb612986f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for project aad1c11f4349492a8c53684e82676e2e. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:20:15.435650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e2e66926-f424-41a9-b9db-ad9fb612986f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for user 28049b2f9a484bf68b61b0769cef6616 and project aad1c11f4349492a8c53684e82676e2e. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:20:15.459481 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2e66926-f424-41a9-b9db-ad9fb612986f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052351 Sep 10 11:20:15.460395 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4153/5991] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:20:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:21.420254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:21.424620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1588212177", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "b07556ec-e4f2-4a6d-af4a-e41f973642c4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-857262576", "security_groups": [{"name": "tempest-secgroup-smoke-932619388"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:21.561105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] validate_networks() for [('b07556ec-e4f2-4a6d-af4a-e41f973642c4', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:20:22.086298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:20:22.087519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:20:22.088115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:20:22.088644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:20:22.089362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:20:22.100443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:22.101104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:22.101653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:22.102673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:22.103238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:22.103929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:22.129901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for project aad1c11f4349492a8c53684e82676e2e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:20:22.135850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for user 28049b2f9a484bf68b61b0769cef6616 and project aad1c11f4349492a8c53684e82676e2e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:20:22.151583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:20:22.154194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:20:22.228114 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fb5aac95-91a0-423b-bbbc-1cf189a81a56 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.809005 Sep 10 11:20:22.231012 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1839/5992] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:20:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:20:22.242840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65e3930d-e680-4c16-ae06-e1a0ca1646c4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:22.243571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65e3930d-e680-4c16-ae06-e1a0ca1646c4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:22.246927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:22.343450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-65e3930d-e680-4c16-ae06-e1a0ca1646c4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:22.357401 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65e3930d-e680-4c16-ae06-e1a0ca1646c4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1266 microversion: 2.1 time: 0.118615 Sep 10 11:20:22.361402 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4154/5993] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:22 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:23.391315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ae90d565-da5f-44d4-8073-a54cd99c7eb6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:23.391946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ae90d565-da5f-44d4-8073-a54cd99c7eb6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:23.399602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae90d565-da5f-44d4-8073-a54cd99c7eb6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:23.400101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae90d565-da5f-44d4-8073-a54cd99c7eb6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:23.400542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae90d565-da5f-44d4-8073-a54cd99c7eb6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:23.401288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae90d565-da5f-44d4-8073-a54cd99c7eb6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:23.401749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae90d565-da5f-44d4-8073-a54cd99c7eb6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:23.402179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae90d565-da5f-44d4-8073-a54cd99c7eb6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:23.467780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ae90d565-da5f-44d4-8073-a54cd99c7eb6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:23.478462 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ae90d565-da5f-44d4-8073-a54cd99c7eb6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1318 microversion: 2.1 time: 0.091907 Sep 10 11:20:23.479065 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1840/5994] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:23 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1318 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:23.639247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f256eff7-b167-4140-9274-cc3bbceb5538 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:23.640343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f256eff7-b167-4140-9274-cc3bbceb5538 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:23.648573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f256eff7-b167-4140-9274-cc3bbceb5538 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:23.649397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f256eff7-b167-4140-9274-cc3bbceb5538 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:23.650046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f256eff7-b167-4140-9274-cc3bbceb5538 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:23.650951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f256eff7-b167-4140-9274-cc3bbceb5538 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:23.651597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f256eff7-b167-4140-9274-cc3bbceb5538 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:23.652208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f256eff7-b167-4140-9274-cc3bbceb5538 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:23.754104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-f256eff7-b167-4140-9274-cc3bbceb5538 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lazy-loading 'services' on Instance uuid 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:20:23.867565 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f256eff7-b167-4140-9274-cc3bbceb5538 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39/os-volume_attachments/20a6b538-1534-4438-966e-93e745ff6790" status: 202 len: 0 microversion: 2.1 time: 0.232757 Sep 10 11:20:23.868973 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4155/5995] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:20:23 2022] DELETE /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39/os-volume_attachments/20a6b538-1534-4438-966e-93e745ff6790 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:20:24.502936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-54d914d7-726b-43dd-a824-6e460a1007e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:24.505393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-54d914d7-726b-43dd-a824-6e460a1007e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:24.516503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54d914d7-726b-43dd-a824-6e460a1007e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:24.517016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54d914d7-726b-43dd-a824-6e460a1007e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:24.523288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54d914d7-726b-43dd-a824-6e460a1007e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:24.524612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54d914d7-726b-43dd-a824-6e460a1007e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:24.526014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54d914d7-726b-43dd-a824-6e460a1007e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:24.526913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54d914d7-726b-43dd-a824-6e460a1007e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:24.777086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-54d914d7-726b-43dd-a824-6e460a1007e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:24.785872 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-54d914d7-726b-43dd-a824-6e460a1007e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1391 microversion: 2.1 time: 0.286830 Sep 10 11:20:24.787096 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1841/5996] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:24 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1391 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:20:25.449565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a36d4989-9393-4eef-8e44-90c6f1678438 req-170698f2-bae1-4fec-ad11-7495dce86ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841e967f-3cdc-4551-89c4-37ad5f8e68f1", "tag": "f9d45277-ad9d-4135-88bf-76a66d734dd0"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:25.464376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a36d4989-9393-4eef-8e44-90c6f1678438 req-170698f2-bae1-4fec-ad11-7495dce86ce0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:25.464886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a36d4989-9393-4eef-8e44-90c6f1678438 req-170698f2-bae1-4fec-ad11-7495dce86ce0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:25.465367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a36d4989-9393-4eef-8e44-90c6f1678438 req-170698f2-bae1-4fec-ad11-7495dce86ce0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:25.477289 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a36d4989-9393-4eef-8e44-90c6f1678438 req-170698f2-bae1-4fec-ad11-7495dce86ce0 service nova] Creating event network-changed:f9d45277-ad9d-4135-88bf-76a66d734dd0 for instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 on n-h2-856894-1 Sep 10 11:20:25.482542 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a36d4989-9393-4eef-8e44-90c6f1678438 req-170698f2-bae1-4fec-ad11-7495dce86ce0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037183 Sep 10 11:20:25.483547 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4156/5997] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:25.810948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-39102a16-1cf4-4bad-82fc-50d1d950359a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:25.812096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-39102a16-1cf4-4bad-82fc-50d1d950359a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:25.819653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39102a16-1cf4-4bad-82fc-50d1d950359a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:25.820303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39102a16-1cf4-4bad-82fc-50d1d950359a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:25.820845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39102a16-1cf4-4bad-82fc-50d1d950359a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:25.821868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39102a16-1cf4-4bad-82fc-50d1d950359a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:25.822441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39102a16-1cf4-4bad-82fc-50d1d950359a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:25.823042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39102a16-1cf4-4bad-82fc-50d1d950359a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:26.220561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-39102a16-1cf4-4bad-82fc-50d1d950359a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:26.229725 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-39102a16-1cf4-4bad-82fc-50d1d950359a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1391 microversion: 2.1 time: 0.423182 Sep 10 11:20:26.231119 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1842/5998] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:25 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1391 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:27.258169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c4fb4a3f-587d-4800-9096-4930be2d4ad1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:27.258904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c4fb4a3f-587d-4800-9096-4930be2d4ad1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:27.274092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4fb4a3f-587d-4800-9096-4930be2d4ad1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:27.274917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4fb4a3f-587d-4800-9096-4930be2d4ad1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:27.275630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4fb4a3f-587d-4800-9096-4930be2d4ad1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:27.277406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4fb4a3f-587d-4800-9096-4930be2d4ad1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:27.277895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4fb4a3f-587d-4800-9096-4930be2d4ad1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:27.278393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c4fb4a3f-587d-4800-9096-4930be2d4ad1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:27.359758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c4fb4a3f-587d-4800-9096-4930be2d4ad1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:27.369423 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c4fb4a3f-587d-4800-9096-4930be2d4ad1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1268 microversion: 2.1 time: 0.117322 Sep 10 11:20:27.377708 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4157/5999] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:27 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1268 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:27.508517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-574e3682-375c-4fa6-ae70-a2bf4679ffe5 req-fd12fe02-04ce-4994-92bf-5b1cb440ad37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841e967f-3cdc-4551-89c4-37ad5f8e68f1", "name": "network-vif-deleted", "tag": "f9d45277-ad9d-4135-88bf-76a66d734dd0"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:27.518735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-574e3682-375c-4fa6-ae70-a2bf4679ffe5 req-fd12fe02-04ce-4994-92bf-5b1cb440ad37 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:27.519828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-574e3682-375c-4fa6-ae70-a2bf4679ffe5 req-fd12fe02-04ce-4994-92bf-5b1cb440ad37 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:27.520288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-574e3682-375c-4fa6-ae70-a2bf4679ffe5 req-fd12fe02-04ce-4994-92bf-5b1cb440ad37 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:27.532495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.compute.server_external_events [req-574e3682-375c-4fa6-ae70-a2bf4679ffe5 req-fd12fe02-04ce-4994-92bf-5b1cb440ad37 service nova] Unable to find a host for instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1. Dropping event network-vif-deleted {{(pid=128787) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 11:20:27.533365 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-574e3682-375c-4fa6-ae70-a2bf4679ffe5 req-fd12fe02-04ce-4994-92bf-5b1cb440ad37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.029148 Sep 10 11:20:27.533967 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1843/6000] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 11:20:28.395268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-624882fe-4d3c-46ca-b215-ada04ebbd6b0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:28.396658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-624882fe-4d3c-46ca-b215-ada04ebbd6b0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:28.410049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-624882fe-4d3c-46ca-b215-ada04ebbd6b0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:28.410894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-624882fe-4d3c-46ca-b215-ada04ebbd6b0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:28.411363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-624882fe-4d3c-46ca-b215-ada04ebbd6b0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:28.413369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-624882fe-4d3c-46ca-b215-ada04ebbd6b0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:28.414077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-624882fe-4d3c-46ca-b215-ada04ebbd6b0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:28.414903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-624882fe-4d3c-46ca-b215-ada04ebbd6b0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:28.496677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-624882fe-4d3c-46ca-b215-ada04ebbd6b0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:28.505133 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-624882fe-4d3c-46ca-b215-ada04ebbd6b0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1336 microversion: 2.1 time: 0.115747 Sep 10 11:20:28.505732 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4158/6001] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:28 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:29.381532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f7a5c35-0a30-4bcc-9eab-67c717710144 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:29.382678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7f7a5c35-0a30-4bcc-9eab-67c717710144 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:29.385836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:29.392677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7a5c35-0a30-4bcc-9eab-67c717710144 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:29.393289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7a5c35-0a30-4bcc-9eab-67c717710144 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:29.394263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7a5c35-0a30-4bcc-9eab-67c717710144 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:29.394975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7a5c35-0a30-4bcc-9eab-67c717710144 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:29.395435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7a5c35-0a30-4bcc-9eab-67c717710144 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:29.395897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f7a5c35-0a30-4bcc-9eab-67c717710144 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:29.423909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7f7a5c35-0a30-4bcc-9eab-67c717710144 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:20:29.505555 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7f7a5c35-0a30-4bcc-9eab-67c717710144 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 204 len: 0 microversion: 2.1 time: 0.128129 Sep 10 11:20:29.506331 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1844/6002] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:20:29 2022] DELETE /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:20:29.516479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8eb6d483-6e2b-482c-825e-178d3675275b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:29.517398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8eb6d483-6e2b-482c-825e-178d3675275b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:29.525602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb6d483-6e2b-482c-825e-178d3675275b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:29.526541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb6d483-6e2b-482c-825e-178d3675275b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:29.527080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb6d483-6e2b-482c-825e-178d3675275b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:29.528043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb6d483-6e2b-482c-825e-178d3675275b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:29.528585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb6d483-6e2b-482c-825e-178d3675275b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:29.529127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8eb6d483-6e2b-482c-825e-178d3675275b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:29.530369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-19f253ea-1338-4d93-8ada-78b1af12e5d9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:29.531102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-19f253ea-1338-4d93-8ada-78b1af12e5d9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:29.538211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19f253ea-1338-4d93-8ada-78b1af12e5d9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:29.538845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19f253ea-1338-4d93-8ada-78b1af12e5d9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:29.539291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19f253ea-1338-4d93-8ada-78b1af12e5d9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:29.539996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19f253ea-1338-4d93-8ada-78b1af12e5d9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:29.540458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19f253ea-1338-4d93-8ada-78b1af12e5d9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:29.540889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19f253ea-1338-4d93-8ada-78b1af12e5d9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:29.733973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8eb6d483-6e2b-482c-825e-178d3675275b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:29.742893 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8eb6d483-6e2b-482c-825e-178d3675275b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1513 microversion: 2.1 time: 0.230969 Sep 10 11:20:29.743501 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4159/6003] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:29 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:29.753787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-19f253ea-1338-4d93-8ada-78b1af12e5d9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:29.753787 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-19f253ea-1338-4d93-8ada-78b1af12e5d9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1391 microversion: 2.1 time: 0.227214 Sep 10 11:20:29.753787 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1845/6004] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:29 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:29.834040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-4a56854d-affd-40cb-adea-317d35887723 req-04c12e12-f913-49c8-b520-5e39ea3ab2ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841e967f-3cdc-4551-89c4-37ad5f8e68f1", "tag": "51d6ba43-a0a9-4d43-b8ab-4e4f37c2ab92"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:29.843731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4a56854d-affd-40cb-adea-317d35887723 req-04c12e12-f913-49c8-b520-5e39ea3ab2ee service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:29.844293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4a56854d-affd-40cb-adea-317d35887723 req-04c12e12-f913-49c8-b520-5e39ea3ab2ee service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:29.844801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4a56854d-affd-40cb-adea-317d35887723 req-04c12e12-f913-49c8-b520-5e39ea3ab2ee service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:29.856361 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-4a56854d-affd-40cb-adea-317d35887723 req-04c12e12-f913-49c8-b520-5e39ea3ab2ee service nova] Creating event network-changed:51d6ba43-a0a9-4d43-b8ab-4e4f37c2ab92 for instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 on n-h1-856894-1 Sep 10 11:20:29.861495 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-4a56854d-affd-40cb-adea-317d35887723 req-04c12e12-f913-49c8-b520-5e39ea3ab2ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031150 Sep 10 11:20:29.862472 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1846/6005] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:30.767678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-897da0b9-160f-4669-a542-680f422599c5 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:30.768410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-897da0b9-160f-4669-a542-680f422599c5 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:30.773126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:30.776785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-897da0b9-160f-4669-a542-680f422599c5 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:30.777020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4c0c3599-18bc-434c-8279-6382c4d0fe53 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:30.777515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-897da0b9-160f-4669-a542-680f422599c5 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:30.777884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4c0c3599-18bc-434c-8279-6382c4d0fe53 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:30.778077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-897da0b9-160f-4669-a542-680f422599c5 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:30.778870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-897da0b9-160f-4669-a542-680f422599c5 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:30.779408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-897da0b9-160f-4669-a542-680f422599c5 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:30.779937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-897da0b9-160f-4669-a542-680f422599c5 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:30.785367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c0c3599-18bc-434c-8279-6382c4d0fe53 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:30.786196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c0c3599-18bc-434c-8279-6382c4d0fe53 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:30.786964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c0c3599-18bc-434c-8279-6382c4d0fe53 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:30.787764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c0c3599-18bc-434c-8279-6382c4d0fe53 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:30.788407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c0c3599-18bc-434c-8279-6382c4d0fe53 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:30.788833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c0c3599-18bc-434c-8279-6382c4d0fe53 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:31.036688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-897da0b9-160f-4669-a542-680f422599c5 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:31.045932 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-897da0b9-160f-4669-a542-680f422599c5 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1513 microversion: 2.1 time: 0.282183 Sep 10 11:20:31.046701 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4160/6006] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:30 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:31.053018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4c0c3599-18bc-434c-8279-6382c4d0fe53 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:31.062621 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4c0c3599-18bc-434c-8279-6382c4d0fe53 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1391 microversion: 2.1 time: 0.290360 Sep 10 11:20:31.063429 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1847/6007] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:30 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1391 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:31.498126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-48beaf30-2836-41d5-9145-1ca90c081d38 req-6cf7c040-2023-4aed-9673-f96c0e109469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff4f080-f591-46c4-9e6c-bda6c5d35b39", "name": "network-vif-deleted", "tag": "625f6c13-8f8d-48de-8f5f-957d7f1d473f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:31.508562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-48beaf30-2836-41d5-9145-1ca90c081d38 req-6cf7c040-2023-4aed-9673-f96c0e109469 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:31.509396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-48beaf30-2836-41d5-9145-1ca90c081d38 req-6cf7c040-2023-4aed-9673-f96c0e109469 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:31.510079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-48beaf30-2836-41d5-9145-1ca90c081d38 req-6cf7c040-2023-4aed-9673-f96c0e109469 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:31.523696 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-48beaf30-2836-41d5-9145-1ca90c081d38 req-6cf7c040-2023-4aed-9673-f96c0e109469 service nova] Creating event network-vif-deleted:625f6c13-8f8d-48de-8f5f-957d7f1d473f for instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 on n-h1-856894-1 Sep 10 11:20:31.529477 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-48beaf30-2836-41d5-9145-1ca90c081d38 req-6cf7c040-2023-4aed-9673-f96c0e109469 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035164 Sep 10 11:20:31.530069 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4161/6008] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:32.069833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:32.070441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:32.077510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:32.077987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:32.078418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:32.079100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:32.079547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:32.079994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:32.088590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e034a39f-2dc9-4f47-86da-d39e6f77f5f4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:32.089386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e034a39f-2dc9-4f47-86da-d39e6f77f5f4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:32.095696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e034a39f-2dc9-4f47-86da-d39e6f77f5f4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:32.096206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e034a39f-2dc9-4f47-86da-d39e6f77f5f4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:32.096669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e034a39f-2dc9-4f47-86da-d39e6f77f5f4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:32.097415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e034a39f-2dc9-4f47-86da-d39e6f77f5f4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:32.097902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e034a39f-2dc9-4f47-86da-d39e6f77f5f4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:32.098356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e034a39f-2dc9-4f47-86da-d39e6f77f5f4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:32.111421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:32.112029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:32.112652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:32.112961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lazy-loading 'fault' on Instance uuid 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:20:32.115959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:32.144748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:32.163131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:32.171009 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cf7072c1-6306-423c-8956-a54a3afec20a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 200 len: 1308 microversion: 2.1 time: 0.105811 Sep 10 11:20:32.171589 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1848/6009] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:32 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:32.250066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e034a39f-2dc9-4f47-86da-d39e6f77f5f4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:32.258374 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e034a39f-2dc9-4f47-86da-d39e6f77f5f4 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1391 microversion: 2.1 time: 0.174968 Sep 10 11:20:32.258980 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4162/6010] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:32 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:20:33.194030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:33.194643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: 5ff4f080-f591-46c4-9e6c-bda6c5d35b39] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:33.201709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:33.202170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:33.202607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:33.203301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:33.203750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:33.204174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:33.217787 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] HTTP exception thrown: Instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 could not be found. Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Request method failure captured: Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 HTTP/1.1 Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHKJVWe-xFbKPgcUZ4QX5RfeglaqEw62QS79cS2mbuGwtFltRyPlFJq0R3QVp-mAobAXXX6l-Bf5il0BFgzOd4l-m1WR5O7Ob62KVPVxUSS_35TzuwHQGDa-5CAwkWtUYFOuW3CkleilE_djbwqCLW7BUuasNvRqk8Cne_dkcR4drBY Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: c86e0403ece1466191df053f9cf2b959 Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1558355024 Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c86e0403ece1466191df053f9cf2b959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c86e0403ece1466191df053f9cf2b959"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c86e0403ece1466191df053f9cf2b959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c86e0403ece1466191df053f9cf2b959", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-VolumesSnapshotTestJSON-1558355024 Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: c86e0403ece1466191df053f9cf2b959 Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1558355024 Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-VolumesSnapshotTestJSON-1558355024-project Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: bcb2a2204e764d5c9b0224af8399e81d Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-VolumesSnapshotTestJSON-1558355024-project Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 could not be found. Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5ff4f080-f591-46c4-9e6c-bda6c5d35b39'} Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 could not be found. Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 could not be found. Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:20:33.219420 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:20:33.225685 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:20:33.225685 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:20:33.225685 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:20:33.225685 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:20:33.225685 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:20:33.225685 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 could not be found. Sep 10 11:20:33.225685 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:20:33.225685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Returning 404 to user: Instance 5ff4f080-f591-46c4-9e6c-bda6c5d35b39 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:20:33.225685 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a432c113-bd59-47a3-8565-1e207a9640e7 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39" status: 404 len: 111 microversion: 2.1 time: 0.030694 Sep 10 11:20:33.225685 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1849/6011] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:33 2022] GET /compute/v2.1/servers/5ff4f080-f591-46c4-9e6c-bda6c5d35b39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:20:33.281338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8409048-4d06-4638-affd-4f0efb71aa78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:33.281965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e8409048-4d06-4638-affd-4f0efb71aa78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:33.285596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:33.290702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8409048-4d06-4638-affd-4f0efb71aa78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:33.291206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8409048-4d06-4638-affd-4f0efb71aa78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:33.291913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8409048-4d06-4638-affd-4f0efb71aa78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:33.292622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8409048-4d06-4638-affd-4f0efb71aa78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:33.293111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8409048-4d06-4638-affd-4f0efb71aa78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:33.293557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8409048-4d06-4638-affd-4f0efb71aa78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:33.445308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e8409048-4d06-4638-affd-4f0efb71aa78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:33.453533 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8409048-4d06-4638-affd-4f0efb71aa78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1391 microversion: 2.1 time: 0.175919 Sep 10 11:20:33.454162 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4163/6012] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:33 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:34.479855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-378371ec-f5f3-42a9-aa52-b710a956d83a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:34.480666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-378371ec-f5f3-42a9-aa52-b710a956d83a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:34.488401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-378371ec-f5f3-42a9-aa52-b710a956d83a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:34.488896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-378371ec-f5f3-42a9-aa52-b710a956d83a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:34.489360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-378371ec-f5f3-42a9-aa52-b710a956d83a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:34.490095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-378371ec-f5f3-42a9-aa52-b710a956d83a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:34.490557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-378371ec-f5f3-42a9-aa52-b710a956d83a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:34.490998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-378371ec-f5f3-42a9-aa52-b710a956d83a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:34.658014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-378371ec-f5f3-42a9-aa52-b710a956d83a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:34.667643 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-378371ec-f5f3-42a9-aa52-b710a956d83a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1391 microversion: 2.1 time: 0.193356 Sep 10 11:20:34.669938 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1850/6013] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:34 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1391 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:35.595661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-84e3ad56-6b1e-4d11-a371-83c51ce9c087 req-6bd97dd9-fb7f-4ded-b9d4-b3a9d0f8c33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841e967f-3cdc-4551-89c4-37ad5f8e68f1", "name": "network-vif-plugged", "status": "completed", "tag": "51d6ba43-a0a9-4d43-b8ab-4e4f37c2ab92"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:35.611345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-84e3ad56-6b1e-4d11-a371-83c51ce9c087 req-6bd97dd9-fb7f-4ded-b9d4-b3a9d0f8c33c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:35.611345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-84e3ad56-6b1e-4d11-a371-83c51ce9c087 req-6bd97dd9-fb7f-4ded-b9d4-b3a9d0f8c33c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:35.611345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-84e3ad56-6b1e-4d11-a371-83c51ce9c087 req-6bd97dd9-fb7f-4ded-b9d4-b3a9d0f8c33c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:35.623791 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-84e3ad56-6b1e-4d11-a371-83c51ce9c087 req-6bd97dd9-fb7f-4ded-b9d4-b3a9d0f8c33c service nova] Creating event network-vif-plugged:51d6ba43-a0a9-4d43-b8ab-4e4f37c2ab92 for instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 on n-h1-856894-1 Sep 10 11:20:35.629689 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-84e3ad56-6b1e-4d11-a371-83c51ce9c087 req-6bd97dd9-fb7f-4ded-b9d4-b3a9d0f8c33c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037876 Sep 10 11:20:35.630994 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4164/6014] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:35.694980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b320e86c-24f0-4cb3-a052-a445154479df tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:35.696952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b320e86c-24f0-4cb3-a052-a445154479df tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:35.710162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b320e86c-24f0-4cb3-a052-a445154479df tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:35.712513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b320e86c-24f0-4cb3-a052-a445154479df tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:35.712789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b320e86c-24f0-4cb3-a052-a445154479df tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:35.713547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b320e86c-24f0-4cb3-a052-a445154479df tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:35.714001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b320e86c-24f0-4cb3-a052-a445154479df tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:35.714425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b320e86c-24f0-4cb3-a052-a445154479df tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:35.863366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b320e86c-24f0-4cb3-a052-a445154479df tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:35.871265 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b320e86c-24f0-4cb3-a052-a445154479df tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1391 microversion: 2.1 time: 0.181460 Sep 10 11:20:35.871846 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1851/6015] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:35 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:36.913666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74f4b32b-4e46-473a-9722-724cebffd6e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:36.914585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74f4b32b-4e46-473a-9722-724cebffd6e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:36.923582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74f4b32b-4e46-473a-9722-724cebffd6e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:36.924083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74f4b32b-4e46-473a-9722-724cebffd6e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:36.924534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74f4b32b-4e46-473a-9722-724cebffd6e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:36.927260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74f4b32b-4e46-473a-9722-724cebffd6e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:36.928072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74f4b32b-4e46-473a-9722-724cebffd6e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:36.928522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74f4b32b-4e46-473a-9722-724cebffd6e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:37.071540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74f4b32b-4e46-473a-9722-724cebffd6e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:37.080174 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74f4b32b-4e46-473a-9722-724cebffd6e5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1563 microversion: 2.1 time: 0.188929 Sep 10 11:20:37.080818 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4165/6016] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:36 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:37.102721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-225210b2-1315-402e-a9f2-8ba7458307e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:37.103515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-225210b2-1315-402e-a9f2-8ba7458307e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:37.110763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-225210b2-1315-402e-a9f2-8ba7458307e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:37.111267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-225210b2-1315-402e-a9f2-8ba7458307e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:37.111722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-225210b2-1315-402e-a9f2-8ba7458307e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:37.113043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-225210b2-1315-402e-a9f2-8ba7458307e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:37.113534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-225210b2-1315-402e-a9f2-8ba7458307e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:37.113969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-225210b2-1315-402e-a9f2-8ba7458307e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:37.251478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-225210b2-1315-402e-a9f2-8ba7458307e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:37.259244 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-225210b2-1315-402e-a9f2-8ba7458307e1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1563 microversion: 2.1 time: 0.160527 Sep 10 11:20:37.259816 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1852/6017] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:37 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:39.349987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a022ea2-2028-43ab-b43d-ba2abc447b13 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:39.351393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0a022ea2-2028-43ab-b43d-ba2abc447b13 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:39.359134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-58ec0328-61c7-4411-b3f7-b1ef228bb687 req-6827bd57-664e-4f54-8822-017e1d31613e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841e967f-3cdc-4551-89c4-37ad5f8e68f1", "tag": "51d6ba43-a0a9-4d43-b8ab-4e4f37c2ab92"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:39.371777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a022ea2-2028-43ab-b43d-ba2abc447b13 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:39.372284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a022ea2-2028-43ab-b43d-ba2abc447b13 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:39.372736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a022ea2-2028-43ab-b43d-ba2abc447b13 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:39.373479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a022ea2-2028-43ab-b43d-ba2abc447b13 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:39.373949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a022ea2-2028-43ab-b43d-ba2abc447b13 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:39.374390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a022ea2-2028-43ab-b43d-ba2abc447b13 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:39.382900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-58ec0328-61c7-4411-b3f7-b1ef228bb687 req-6827bd57-664e-4f54-8822-017e1d31613e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:39.383513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-58ec0328-61c7-4411-b3f7-b1ef228bb687 req-6827bd57-664e-4f54-8822-017e1d31613e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:39.384051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-58ec0328-61c7-4411-b3f7-b1ef228bb687 req-6827bd57-664e-4f54-8822-017e1d31613e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:39.399574 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-58ec0328-61c7-4411-b3f7-b1ef228bb687 req-6827bd57-664e-4f54-8822-017e1d31613e service nova] Creating event network-changed:51d6ba43-a0a9-4d43-b8ab-4e4f37c2ab92 for instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 on n-h1-856894-1 Sep 10 11:20:39.408028 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-58ec0328-61c7-4411-b3f7-b1ef228bb687 req-6827bd57-664e-4f54-8822-017e1d31613e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052228 Sep 10 11:20:39.408828 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1853/6018] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:39.560316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0a022ea2-2028-43ab-b43d-ba2abc447b13 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:39.569458 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0a022ea2-2028-43ab-b43d-ba2abc447b13 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1563 microversion: 2.1 time: 0.223835 Sep 10 11:20:39.570300 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4166/6019] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:39 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:40.076468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1487108842", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "0e79c580-7706-4209-8220-19d68cd09f31"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:40.131925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] validate_networks() for [('0e79c580-7706-4209-8220-19d68cd09f31', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:20:40.520942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:20:40.521600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:20:40.521986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:20:40.522399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:20:40.522845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:20:40.531929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:40.532416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:40.532917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:40.533864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:40.534543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:40.534968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:40.556974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Getting quotas for project c86e0403ece1466191df053f9cf2b959. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:20:40.562663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Getting quotas for user bcb2a2204e764d5c9b0224af8399e81d and project c86e0403ece1466191df053f9cf2b959. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:20:40.576347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:20:40.578851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:20:40.625252 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a847aafa-bb4f-493f-87e7-c7230d0d607c tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554342 Sep 10 11:20:40.626042 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1854/6020] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:20:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:20:40.637602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc7fa4d1-9ab4-4a2d-a5c8-33cdccca9396 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:40.638250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cc7fa4d1-9ab4-4a2d-a5c8-33cdccca9396 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:40.698503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cc7fa4d1-9ab4-4a2d-a5c8-33cdccca9396 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:40.707173 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cc7fa4d1-9ab4-4a2d-a5c8-33cdccca9396 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1219 microversion: 2.1 time: 0.072462 Sep 10 11:20:40.708132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4167/6021] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:40 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:41.732776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9275f154-0589-4a64-a552-053dea5abf0f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:41.733521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9275f154-0589-4a64-a552-053dea5abf0f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:41.742302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9275f154-0589-4a64-a552-053dea5abf0f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:41.743024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9275f154-0589-4a64-a552-053dea5abf0f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:41.743832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9275f154-0589-4a64-a552-053dea5abf0f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:41.744860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9275f154-0589-4a64-a552-053dea5abf0f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:41.745460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9275f154-0589-4a64-a552-053dea5abf0f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:41.745966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9275f154-0589-4a64-a552-053dea5abf0f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:41.816854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9275f154-0589-4a64-a552-053dea5abf0f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:41.825211 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9275f154-0589-4a64-a552-053dea5abf0f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1277 microversion: 2.1 time: 0.098105 Sep 10 11:20:41.826030 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1855/6022] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:41 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:42.849261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b169e67-34e1-4c8e-b98f-830da240597f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:42.849895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9b169e67-34e1-4c8e-b98f-830da240597f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:42.858412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b169e67-34e1-4c8e-b98f-830da240597f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:42.858915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b169e67-34e1-4c8e-b98f-830da240597f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:42.859373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b169e67-34e1-4c8e-b98f-830da240597f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:42.860096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b169e67-34e1-4c8e-b98f-830da240597f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:42.860567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b169e67-34e1-4c8e-b98f-830da240597f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:42.861018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b169e67-34e1-4c8e-b98f-830da240597f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:42.995160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9b169e67-34e1-4c8e-b98f-830da240597f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:43.004026 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9b169e67-34e1-4c8e-b98f-830da240597f tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1319 microversion: 2.1 time: 0.158697 Sep 10 11:20:43.004602 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4168/6023] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:42 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:43.043473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-083f5326-bc47-4b48-9832-08895df79ad7 req-abee27d2-cd1e-4718-8c55-171d229b7d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43e2f02-0153-4933-9503-281a2495d252", "tag": "70aa8e8b-4002-4dec-811e-bb5a79f59b4b"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:43.055051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-083f5326-bc47-4b48-9832-08895df79ad7 req-abee27d2-cd1e-4718-8c55-171d229b7d09 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:43.055702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-083f5326-bc47-4b48-9832-08895df79ad7 req-abee27d2-cd1e-4718-8c55-171d229b7d09 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:43.056245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-083f5326-bc47-4b48-9832-08895df79ad7 req-abee27d2-cd1e-4718-8c55-171d229b7d09 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:43.068007 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-083f5326-bc47-4b48-9832-08895df79ad7 req-abee27d2-cd1e-4718-8c55-171d229b7d09 service nova] Creating event network-changed:70aa8e8b-4002-4dec-811e-bb5a79f59b4b for instance d43e2f02-0153-4933-9503-281a2495d252 on n-h1-856894-1 Sep 10 11:20:43.073153 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-083f5326-bc47-4b48-9832-08895df79ad7 req-abee27d2-cd1e-4718-8c55-171d229b7d09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034147 Sep 10 11:20:43.073876 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1856/6024] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:44.027062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b21a1e2a-e2c8-4ccc-973c-039a61d46010 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:44.027699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b21a1e2a-e2c8-4ccc-973c-039a61d46010 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:44.034631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b21a1e2a-e2c8-4ccc-973c-039a61d46010 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:44.035129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b21a1e2a-e2c8-4ccc-973c-039a61d46010 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:44.035576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b21a1e2a-e2c8-4ccc-973c-039a61d46010 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:44.036319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b21a1e2a-e2c8-4ccc-973c-039a61d46010 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:44.036790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b21a1e2a-e2c8-4ccc-973c-039a61d46010 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:44.037332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b21a1e2a-e2c8-4ccc-973c-039a61d46010 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:44.168373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b21a1e2a-e2c8-4ccc-973c-039a61d46010 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:44.177529 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b21a1e2a-e2c8-4ccc-973c-039a61d46010 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1319 microversion: 2.1 time: 0.154155 Sep 10 11:20:44.178206 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4169/6025] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:44 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:20:45.202246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-981fb542-cf4d-425e-bf15-14c645dc3409 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:45.202859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-981fb542-cf4d-425e-bf15-14c645dc3409 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:45.209508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-981fb542-cf4d-425e-bf15-14c645dc3409 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:45.209988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-981fb542-cf4d-425e-bf15-14c645dc3409 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:45.210422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-981fb542-cf4d-425e-bf15-14c645dc3409 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:45.211108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-981fb542-cf4d-425e-bf15-14c645dc3409 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:45.211556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-981fb542-cf4d-425e-bf15-14c645dc3409 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:45.211973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-981fb542-cf4d-425e-bf15-14c645dc3409 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:45.338878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-981fb542-cf4d-425e-bf15-14c645dc3409 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:45.347178 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-981fb542-cf4d-425e-bf15-14c645dc3409 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1319 microversion: 2.1 time: 0.149610 Sep 10 11:20:45.347791 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1857/6026] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:45 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:46.370199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-150234f4-b4c1-4518-8bc7-0353b0198d89 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:46.370861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-150234f4-b4c1-4518-8bc7-0353b0198d89 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:46.378251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150234f4-b4c1-4518-8bc7-0353b0198d89 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:46.378751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150234f4-b4c1-4518-8bc7-0353b0198d89 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:46.379209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150234f4-b4c1-4518-8bc7-0353b0198d89 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:46.379915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150234f4-b4c1-4518-8bc7-0353b0198d89 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:46.380387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150234f4-b4c1-4518-8bc7-0353b0198d89 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:46.380832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-150234f4-b4c1-4518-8bc7-0353b0198d89 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:46.510266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-150234f4-b4c1-4518-8bc7-0353b0198d89 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:46.518021 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-150234f4-b4c1-4518-8bc7-0353b0198d89 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1319 microversion: 2.1 time: 0.151748 Sep 10 11:20:46.519215 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4170/6027] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:46 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:47.541497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a353249a-8e9e-4e6b-b9ae-416e4156ba42 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:47.542619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a353249a-8e9e-4e6b-b9ae-416e4156ba42 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:47.549601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a353249a-8e9e-4e6b-b9ae-416e4156ba42 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:47.550090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a353249a-8e9e-4e6b-b9ae-416e4156ba42 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:47.550523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a353249a-8e9e-4e6b-b9ae-416e4156ba42 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:47.551209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a353249a-8e9e-4e6b-b9ae-416e4156ba42 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:47.551654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a353249a-8e9e-4e6b-b9ae-416e4156ba42 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:47.552085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a353249a-8e9e-4e6b-b9ae-416e4156ba42 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:47.556258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:47.694172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a353249a-8e9e-4e6b-b9ae-416e4156ba42 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:47.701984 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a353249a-8e9e-4e6b-b9ae-416e4156ba42 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1319 microversion: 2.1 time: 0.164379 Sep 10 11:20:47.702559 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1858/6028] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:47 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:48.726145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21694dfe-e147-44e7-853d-91f89f93c7da tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:48.726778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21694dfe-e147-44e7-853d-91f89f93c7da tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:48.733663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21694dfe-e147-44e7-853d-91f89f93c7da tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:48.734157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21694dfe-e147-44e7-853d-91f89f93c7da tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:48.734602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21694dfe-e147-44e7-853d-91f89f93c7da tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:48.735296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21694dfe-e147-44e7-853d-91f89f93c7da tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:48.735760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21694dfe-e147-44e7-853d-91f89f93c7da tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:48.736195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21694dfe-e147-44e7-853d-91f89f93c7da tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:48.868733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21694dfe-e147-44e7-853d-91f89f93c7da tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:48.876500 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21694dfe-e147-44e7-853d-91f89f93c7da tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1319 microversion: 2.1 time: 0.154826 Sep 10 11:20:48.877120 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4171/6029] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:48 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:49.606964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-481b4a14-7fc7-41cf-a609-ab281882fea0 req-59783f93-22c4-4aa1-8843-b270b9528c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43e2f02-0153-4933-9503-281a2495d252", "name": "network-vif-plugged", "status": "completed", "tag": "70aa8e8b-4002-4dec-811e-bb5a79f59b4b"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:49.619015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-481b4a14-7fc7-41cf-a609-ab281882fea0 req-59783f93-22c4-4aa1-8843-b270b9528c7d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:49.619503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-481b4a14-7fc7-41cf-a609-ab281882fea0 req-59783f93-22c4-4aa1-8843-b270b9528c7d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:49.620691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-481b4a14-7fc7-41cf-a609-ab281882fea0 req-59783f93-22c4-4aa1-8843-b270b9528c7d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:49.633212 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-481b4a14-7fc7-41cf-a609-ab281882fea0 req-59783f93-22c4-4aa1-8843-b270b9528c7d service nova] Creating event network-vif-plugged:70aa8e8b-4002-4dec-811e-bb5a79f59b4b for instance d43e2f02-0153-4933-9503-281a2495d252 on n-h1-856894-1 Sep 10 11:20:49.640266 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-481b4a14-7fc7-41cf-a609-ab281882fea0 req-59783f93-22c4-4aa1-8843-b270b9528c7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036688 Sep 10 11:20:49.640882 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1859/6030] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:20:49.900033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ab3b7b4-11fe-47f3-9341-febe228c5500 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:49.900672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3ab3b7b4-11fe-47f3-9341-febe228c5500 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:49.907615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab3b7b4-11fe-47f3-9341-febe228c5500 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:49.908123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab3b7b4-11fe-47f3-9341-febe228c5500 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:49.908578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab3b7b4-11fe-47f3-9341-febe228c5500 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:49.909313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab3b7b4-11fe-47f3-9341-febe228c5500 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:49.909789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab3b7b4-11fe-47f3-9341-febe228c5500 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:49.910238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3ab3b7b4-11fe-47f3-9341-febe228c5500 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:50.043944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3ab3b7b4-11fe-47f3-9341-febe228c5500 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:50.051869 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3ab3b7b4-11fe-47f3-9341-febe228c5500 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1319 microversion: 2.1 time: 0.155764 Sep 10 11:20:50.052457 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4172/6031] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:49 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:51.072998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:51.073856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:51.079269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1ce0a279-c012-4187-ba67-6ff6d8f04504 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:20:51.079974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1ce0a279-c012-4187-ba67-6ff6d8f04504 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:51.087558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ce0a279-c012-4187-ba67-6ff6d8f04504 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:51.088044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ce0a279-c012-4187-ba67-6ff6d8f04504 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:51.088487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ce0a279-c012-4187-ba67-6ff6d8f04504 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:51.089209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ce0a279-c012-4187-ba67-6ff6d8f04504 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:51.089674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ce0a279-c012-4187-ba67-6ff6d8f04504 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:51.090103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ce0a279-c012-4187-ba67-6ff6d8f04504 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:51.216960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1ce0a279-c012-4187-ba67-6ff6d8f04504 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:20:51.225402 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1ce0a279-c012-4187-ba67-6ff6d8f04504 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1507 microversion: 2.1 time: 0.153330 Sep 10 11:20:51.225975 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1860/6032] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:20:51 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:20:51.247979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b7fd439-e6ed-4706-81b8-46b5bfa4d834 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d445d5e-e8d7-4a4c-9425-0f47fcc9002e", "device": "/dev/sdb"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:20:51.250529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b7fd439-e6ed-4706-81b8-46b5bfa4d834 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:20:51.252546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:51.259021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7fd439-e6ed-4706-81b8-46b5bfa4d834 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:51.259518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7fd439-e6ed-4706-81b8-46b5bfa4d834 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:51.259979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7fd439-e6ed-4706-81b8-46b5bfa4d834 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:51.260682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7fd439-e6ed-4706-81b8-46b5bfa4d834 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:20:51.261187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7fd439-e6ed-4706-81b8-46b5bfa4d834 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:20:51.261631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7fd439-e6ed-4706-81b8-46b5bfa4d834 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:20:51.332482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:20:51.491616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b7fd439-e6ed-4706-81b8-46b5bfa4d834 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "POST /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247434 Sep 10 11:20:51.492260 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4173/6033] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:20:51 2022] POST /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:21:00.838886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ed530f0a-26be-40f7-a1fe-15dc85afea60 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:00.841091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ed530f0a-26be-40f7-a1fe-15dc85afea60 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:00.843899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:00.849635 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed530f0a-26be-40f7-a1fe-15dc85afea60 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:00.850167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed530f0a-26be-40f7-a1fe-15dc85afea60 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:00.850604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed530f0a-26be-40f7-a1fe-15dc85afea60 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:00.851293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed530f0a-26be-40f7-a1fe-15dc85afea60 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:00.851743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed530f0a-26be-40f7-a1fe-15dc85afea60 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:00.852163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ed530f0a-26be-40f7-a1fe-15dc85afea60 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:00.905087 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ed530f0a-26be-40f7-a1fe-15dc85afea60 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1/action" status: 200 len: 24565 microversion: 2.1 time: 0.070019 Sep 10 11:21:00.905732 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1861/6034] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:21:00 2022] POST /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1/action => generated 24565 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:21:11.909916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=29 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:11.911827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:11.917707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bfd1214c-5891-4709-8b8c-d698d4c8834d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:11.918442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bfd1214c-5891-4709-8b8c-d698d4c8834d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:11.926953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfd1214c-5891-4709-8b8c-d698d4c8834d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:11.927464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfd1214c-5891-4709-8b8c-d698d4c8834d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:11.927922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfd1214c-5891-4709-8b8c-d698d4c8834d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:11.928642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfd1214c-5891-4709-8b8c-d698d4c8834d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:11.929142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfd1214c-5891-4709-8b8c-d698d4c8834d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:11.929593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfd1214c-5891-4709-8b8c-d698d4c8834d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:12.091027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bfd1214c-5891-4709-8b8c-d698d4c8834d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:12.100107 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bfd1214c-5891-4709-8b8c-d698d4c8834d tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1681 microversion: 2.1 time: 0.192991 Sep 10 11:21:12.101688 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4174/6035] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:11 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:12.205873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f0d21320-ae47-4507-a570-ec8c0c22d3d2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:12.208170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f0d21320-ae47-4507-a570-ec8c0c22d3d2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:12.211113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:12.211760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=16 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:12.219264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d21320-ae47-4507-a570-ec8c0c22d3d2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:12.220079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d21320-ae47-4507-a570-ec8c0c22d3d2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:12.220489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d21320-ae47-4507-a570-ec8c0c22d3d2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:12.221430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d21320-ae47-4507-a570-ec8c0c22d3d2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:12.221887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d21320-ae47-4507-a570-ec8c0c22d3d2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:12.222516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0d21320-ae47-4507-a570-ec8c0c22d3d2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:12.279744 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f0d21320-ae47-4507-a570-ec8c0c22d3d2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1/action" status: 200 len: 32635 microversion: 2.1 time: 0.077970 Sep 10 11:21:12.280335 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1862/6036] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:21:12 2022] POST /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1/action => generated 32635 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:21:12.444252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-70f49d6c-87f4-47a0-be81-a1b1f64e3fa7 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:12.444968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-70f49d6c-87f4-47a0-be81-a1b1f64e3fa7 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:12.451742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70f49d6c-87f4-47a0-be81-a1b1f64e3fa7 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:12.452243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70f49d6c-87f4-47a0-be81-a1b1f64e3fa7 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:12.452691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70f49d6c-87f4-47a0-be81-a1b1f64e3fa7 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:12.453434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70f49d6c-87f4-47a0-be81-a1b1f64e3fa7 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:12.453907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70f49d6c-87f4-47a0-be81-a1b1f64e3fa7 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:12.454345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-70f49d6c-87f4-47a0-be81-a1b1f64e3fa7 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:12.589390 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-70f49d6c-87f4-47a0-be81-a1b1f64e3fa7 tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1832 microversion: 2.1 time: 0.149233 Sep 10 11:21:12.589985 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4175/6037] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:12 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1832 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:12.622435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:12.624938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:12.632478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:12.632898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:12.633354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:12.634040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:12.634490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:12.634913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:12.659447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lazy-loading 'flavor' on Instance uuid 841e967f-3cdc-4551-89c4-37ad5f8e68f1 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:21:12.672257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Going to try to live migrate instance to another host {{(pid=128787) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 11:21:13.019407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b7d89188-eeab-4785-a7eb-5277210ba51e tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:13.019923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b7d89188-eeab-4785-a7eb-5277210ba51e tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:13.027015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d89188-eeab-4785-a7eb-5277210ba51e tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:13.027747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d89188-eeab-4785-a7eb-5277210ba51e tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:13.028363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d89188-eeab-4785-a7eb-5277210ba51e tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:13.029102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d89188-eeab-4785-a7eb-5277210ba51e tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:13.029576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d89188-eeab-4785-a7eb-5277210ba51e tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:13.030015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b7d89188-eeab-4785-a7eb-5277210ba51e tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:13.124149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-b7d89188-eeab-4785-a7eb-5277210ba51e tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lazy-loading 'services' on Instance uuid d43e2f02-0153-4933-9503-281a2495d252 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:21:13.206325 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b7d89188-eeab-4785-a7eb-5277210ba51e tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252/os-volume_attachments/2d445d5e-e8d7-4a4c-9425-0f47fcc9002e" status: 202 len: 0 microversion: 2.1 time: 0.191968 Sep 10 11:21:13.207114 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4176/6038] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:21:13 2022] DELETE /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252/os-volume_attachments/2d445d5e-e8d7-4a4c-9425-0f47fcc9002e => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:21:14.058870 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ac8c5152-1fab-4b05-aa9d-97afe34a204d tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1/action" status: 202 len: 0 microversion: 2.1 time: 1.440563 Sep 10 11:21:14.059531 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1863/6039] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:21:12 2022] POST /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1/action => generated 0 bytes in 1443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:21:14.070327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-029055a3-5226-4524-a975-6cb9d8c0d81b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:14.071042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-029055a3-5226-4524-a975-6cb9d8c0d81b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:14.077479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-029055a3-5226-4524-a975-6cb9d8c0d81b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:14.078169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-029055a3-5226-4524-a975-6cb9d8c0d81b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:14.078430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-029055a3-5226-4524-a975-6cb9d8c0d81b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:14.079131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-029055a3-5226-4524-a975-6cb9d8c0d81b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:14.079759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-029055a3-5226-4524-a975-6cb9d8c0d81b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:14.080304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-029055a3-5226-4524-a975-6cb9d8c0d81b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:14.243812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-029055a3-5226-4524-a975-6cb9d8c0d81b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:14.254970 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-029055a3-5226-4524-a975-6cb9d8c0d81b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1691 microversion: 2.1 time: 0.188361 Sep 10 11:21:14.256373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4177/6040] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:14 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1691 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:15.346424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-78a37e0f-55c6-4159-a4b1-9ea0e520b79a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:15.347041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-78a37e0f-55c6-4159-a4b1-9ea0e520b79a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:15.359959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a37e0f-55c6-4159-a4b1-9ea0e520b79a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:15.360459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a37e0f-55c6-4159-a4b1-9ea0e520b79a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:15.360898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a37e0f-55c6-4159-a4b1-9ea0e520b79a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:15.361630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a37e0f-55c6-4159-a4b1-9ea0e520b79a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:15.362085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a37e0f-55c6-4159-a4b1-9ea0e520b79a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:15.362506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78a37e0f-55c6-4159-a4b1-9ea0e520b79a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:15.578628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78a37e0f-55c6-4159-a4b1-9ea0e520b79a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:15.587565 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-78a37e0f-55c6-4159-a4b1-9ea0e520b79a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1681 microversion: 2.1 time: 0.310852 Sep 10 11:21:15.588243 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1864/6041] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:15 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1681 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:15.609890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8a4ca73b-4e8a-4167-9b49-980107cfc0ee tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:15.610526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8a4ca73b-4e8a-4167-9b49-980107cfc0ee tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:15.617531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a4ca73b-4e8a-4167-9b49-980107cfc0ee tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:15.618043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a4ca73b-4e8a-4167-9b49-980107cfc0ee tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:15.618496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a4ca73b-4e8a-4167-9b49-980107cfc0ee tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:15.619206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a4ca73b-4e8a-4167-9b49-980107cfc0ee tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:15.619678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a4ca73b-4e8a-4167-9b49-980107cfc0ee tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:15.620313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8a4ca73b-4e8a-4167-9b49-980107cfc0ee tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:15.839167 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8a4ca73b-4e8a-4167-9b49-980107cfc0ee tempest-TestNetworkAdvancedServerOps-41305365 tempest-TestNetworkAdvancedServerOps-41305365-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1832 microversion: 2.1 time: 0.232826 Sep 10 11:21:15.840016 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4178/6042] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:15 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1832 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:16.767842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8b337cf4-798d-4c9a-8686-a7d2e6eee739 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:16.768432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8b337cf4-798d-4c9a-8686-a7d2e6eee739 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:16.770046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a3cdeb92-824e-45cf-a96a-9bb6cab929ea req-4c1a0e4d-5fde-4e53-a6cd-a93820ab8c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841e967f-3cdc-4551-89c4-37ad5f8e68f1", "tag": "51d6ba43-a0a9-4d43-b8ab-4e4f37c2ab92"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:16.775862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b337cf4-798d-4c9a-8686-a7d2e6eee739 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:16.776496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b337cf4-798d-4c9a-8686-a7d2e6eee739 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:16.776937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b337cf4-798d-4c9a-8686-a7d2e6eee739 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:16.777866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b337cf4-798d-4c9a-8686-a7d2e6eee739 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:16.778628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b337cf4-798d-4c9a-8686-a7d2e6eee739 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:16.779059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b337cf4-798d-4c9a-8686-a7d2e6eee739 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:16.789085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a3cdeb92-824e-45cf-a96a-9bb6cab929ea req-4c1a0e4d-5fde-4e53-a6cd-a93820ab8c64 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:16.789585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a3cdeb92-824e-45cf-a96a-9bb6cab929ea req-4c1a0e4d-5fde-4e53-a6cd-a93820ab8c64 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:16.790030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a3cdeb92-824e-45cf-a96a-9bb6cab929ea req-4c1a0e4d-5fde-4e53-a6cd-a93820ab8c64 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:16.808925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8b337cf4-798d-4c9a-8686-a7d2e6eee739 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:21:16.812864 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a3cdeb92-824e-45cf-a96a-9bb6cab929ea req-4c1a0e4d-5fde-4e53-a6cd-a93820ab8c64 service nova] Creating event network-changed:51d6ba43-a0a9-4d43-b8ab-4e4f37c2ab92 for instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 on n-h1-856894-1 Sep 10 11:21:16.819179 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a3cdeb92-824e-45cf-a96a-9bb6cab929ea req-4c1a0e4d-5fde-4e53-a6cd-a93820ab8c64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053232 Sep 10 11:21:16.820424 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4179/6043] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:21:16.900500 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8b337cf4-798d-4c9a-8686-a7d2e6eee739 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "DELETE /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 204 len: 0 microversion: 2.1 time: 0.137414 Sep 10 11:21:16.905438 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1865/6044] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:21:16 2022] DELETE /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:21:16.910840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66e33996-ac34-41ac-8be6-c1c7d2b1147e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:16.911895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66e33996-ac34-41ac-8be6-c1c7d2b1147e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:16.919709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66e33996-ac34-41ac-8be6-c1c7d2b1147e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:16.920614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66e33996-ac34-41ac-8be6-c1c7d2b1147e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:16.921758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66e33996-ac34-41ac-8be6-c1c7d2b1147e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:16.923797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66e33996-ac34-41ac-8be6-c1c7d2b1147e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:16.924555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66e33996-ac34-41ac-8be6-c1c7d2b1147e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:16.926237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66e33996-ac34-41ac-8be6-c1c7d2b1147e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:17.079696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-66e33996-ac34-41ac-8be6-c1c7d2b1147e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:17.088744 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66e33996-ac34-41ac-8be6-c1c7d2b1147e tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1687 microversion: 2.1 time: 0.182446 Sep 10 11:21:17.089436 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4180/6045] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:16 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:21:18.115721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-88d6a2b3-f489-4dee-b1db-7efebad8f3d5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:18.117103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-88d6a2b3-f489-4dee-b1db-7efebad8f3d5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:18.125782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88d6a2b3-f489-4dee-b1db-7efebad8f3d5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:18.126717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88d6a2b3-f489-4dee-b1db-7efebad8f3d5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:18.127506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88d6a2b3-f489-4dee-b1db-7efebad8f3d5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:18.128231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88d6a2b3-f489-4dee-b1db-7efebad8f3d5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:18.128751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88d6a2b3-f489-4dee-b1db-7efebad8f3d5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:18.129240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88d6a2b3-f489-4dee-b1db-7efebad8f3d5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:18.269999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-88d6a2b3-f489-4dee-b1db-7efebad8f3d5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:18.278160 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-88d6a2b3-f489-4dee-b1db-7efebad8f3d5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1687 microversion: 2.1 time: 0.168751 Sep 10 11:21:18.278773 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1866/6046] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:18 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:18.604135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c072d516-5bf4-4b04-966d-d66a0b66327a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:18.604732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c072d516-5bf4-4b04-966d-d66a0b66327a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:18.611721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c072d516-5bf4-4b04-966d-d66a0b66327a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:18.612323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c072d516-5bf4-4b04-966d-d66a0b66327a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:18.612853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c072d516-5bf4-4b04-966d-d66a0b66327a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:18.613670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c072d516-5bf4-4b04-966d-d66a0b66327a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:18.614213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c072d516-5bf4-4b04-966d-d66a0b66327a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:18.614732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c072d516-5bf4-4b04-966d-d66a0b66327a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:18.640773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c072d516-5bf4-4b04-966d-d66a0b66327a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:21:18.733853 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c072d516-5bf4-4b04-966d-d66a0b66327a tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 204 len: 0 microversion: 2.1 time: 0.132974 Sep 10 11:21:18.737799 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4181/6047] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:21:18 2022] DELETE /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:21:18.743451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2fb8e3a6-6091-4251-a3fa-11bac61f840b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:18.744060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2fb8e3a6-6091-4251-a3fa-11bac61f840b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:18.749968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb8e3a6-6091-4251-a3fa-11bac61f840b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:18.750470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb8e3a6-6091-4251-a3fa-11bac61f840b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:18.750882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb8e3a6-6091-4251-a3fa-11bac61f840b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:18.751563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb8e3a6-6091-4251-a3fa-11bac61f840b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:18.752012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb8e3a6-6091-4251-a3fa-11bac61f840b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:18.752638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fb8e3a6-6091-4251-a3fa-11bac61f840b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:18.771347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6829c4d2-869f-4c37-ac81-c3e8e620e95b req-86f1e4f6-164a-4a60-b291-a92017d5cab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841e967f-3cdc-4551-89c4-37ad5f8e68f1", "name": "network-vif-deleted", "tag": "51d6ba43-a0a9-4d43-b8ab-4e4f37c2ab92"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:18.780800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6829c4d2-869f-4c37-ac81-c3e8e620e95b req-86f1e4f6-164a-4a60-b291-a92017d5cab5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:18.781333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6829c4d2-869f-4c37-ac81-c3e8e620e95b req-86f1e4f6-164a-4a60-b291-a92017d5cab5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:18.781786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6829c4d2-869f-4c37-ac81-c3e8e620e95b req-86f1e4f6-164a-4a60-b291-a92017d5cab5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:18.794082 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6829c4d2-869f-4c37-ac81-c3e8e620e95b req-86f1e4f6-164a-4a60-b291-a92017d5cab5 service nova] Creating event network-vif-deleted:51d6ba43-a0a9-4d43-b8ab-4e4f37c2ab92 for instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 on n-h1-856894-1 Sep 10 11:21:18.799089 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6829c4d2-869f-4c37-ac81-c3e8e620e95b req-86f1e4f6-164a-4a60-b291-a92017d5cab5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 Sep 10 11:21:18.799721 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4182/6048] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:21:18.892212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2fb8e3a6-6091-4251-a3fa-11bac61f840b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:18.899980 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2fb8e3a6-6091-4251-a3fa-11bac61f840b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1513 microversion: 2.1 time: 0.160839 Sep 10 11:21:18.900547 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1867/6049] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:18 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:21:19.303740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8065fb2-970a-463d-ab51-7ed49b0498c1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:19.304400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f8065fb2-970a-463d-ab51-7ed49b0498c1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:19.310615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8065fb2-970a-463d-ab51-7ed49b0498c1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:19.311110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8065fb2-970a-463d-ab51-7ed49b0498c1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:19.311556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8065fb2-970a-463d-ab51-7ed49b0498c1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:19.312258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8065fb2-970a-463d-ab51-7ed49b0498c1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:19.312724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8065fb2-970a-463d-ab51-7ed49b0498c1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:19.313188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8065fb2-970a-463d-ab51-7ed49b0498c1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:19.376547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f8065fb2-970a-463d-ab51-7ed49b0498c1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:19.384424 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8065fb2-970a-463d-ab51-7ed49b0498c1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1502 microversion: 2.1 time: 0.085774 Sep 10 11:21:19.384995 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4183/6050] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:19 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1502 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:19.923712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4329c0d9-b6a9-472d-bc90-f9fb522e8c9b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:19.925023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4329c0d9-b6a9-472d-bc90-f9fb522e8c9b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:19.932600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4329c0d9-b6a9-472d-bc90-f9fb522e8c9b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:19.933112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4329c0d9-b6a9-472d-bc90-f9fb522e8c9b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:19.933560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4329c0d9-b6a9-472d-bc90-f9fb522e8c9b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:19.934294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4329c0d9-b6a9-472d-bc90-f9fb522e8c9b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:19.934749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4329c0d9-b6a9-472d-bc90-f9fb522e8c9b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:19.935173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4329c0d9-b6a9-472d-bc90-f9fb522e8c9b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:20.064111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4329c0d9-b6a9-472d-bc90-f9fb522e8c9b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:20.072409 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4329c0d9-b6a9-472d-bc90-f9fb522e8c9b tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1513 microversion: 2.1 time: 0.152886 Sep 10 11:21:20.072989 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1868/6051] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:19 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:20.407286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:20.407914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:20.414826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:20.415323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:20.415775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:20.416470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:20.417224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:20.417664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:20.450377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:20.452191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:20.452652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:20.453138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lazy-loading 'fault' on Instance uuid 841e967f-3cdc-4551-89c4-37ad5f8e68f1 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:21:20.508039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:20.516195 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b5dbe2f6-4aba-4abb-b82d-501852df31e0 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 200 len: 1440 microversion: 2.1 time: 0.112714 Sep 10 11:21:20.529100 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4184/6052] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:20 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 1440 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:21.098586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dd00f37b-38bb-41e0-822f-6792a8f955d8 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:21.100530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dd00f37b-38bb-41e0-822f-6792a8f955d8 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:21.110523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd00f37b-38bb-41e0-822f-6792a8f955d8 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:21.111290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd00f37b-38bb-41e0-822f-6792a8f955d8 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:21.111951 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd00f37b-38bb-41e0-822f-6792a8f955d8 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:21.112873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd00f37b-38bb-41e0-822f-6792a8f955d8 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:21.113536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd00f37b-38bb-41e0-822f-6792a8f955d8 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:21.114203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd00f37b-38bb-41e0-822f-6792a8f955d8 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:21.195725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b8dabb35-5dcf-4740-ae26-d7bdaf2c17d9 req-8768ddac-021c-415d-bede-6f6f95480182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43e2f02-0153-4933-9503-281a2495d252", "name": "network-vif-deleted", "tag": "70aa8e8b-4002-4dec-811e-bb5a79f59b4b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:21.195937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dd00f37b-38bb-41e0-822f-6792a8f955d8 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb2a2204e764d5c9b0224af8399e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86e0403ece1466191df053f9cf2b959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:21.206078 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dd00f37b-38bb-41e0-822f-6792a8f955d8 tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 200 len: 1471 microversion: 2.1 time: 0.112813 Sep 10 11:21:21.206599 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1869/6053] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:21 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 1471 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:21.207078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b8dabb35-5dcf-4740-ae26-d7bdaf2c17d9 req-8768ddac-021c-415d-bede-6f6f95480182 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:21.207585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b8dabb35-5dcf-4740-ae26-d7bdaf2c17d9 req-8768ddac-021c-415d-bede-6f6f95480182 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:21.208036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b8dabb35-5dcf-4740-ae26-d7bdaf2c17d9 req-8768ddac-021c-415d-bede-6f6f95480182 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:21.220192 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b8dabb35-5dcf-4740-ae26-d7bdaf2c17d9 req-8768ddac-021c-415d-bede-6f6f95480182 service nova] Creating event network-vif-deleted:70aa8e8b-4002-4dec-811e-bb5a79f59b4b for instance d43e2f02-0153-4933-9503-281a2495d252 on n-h1-856894-1 Sep 10 11:21:21.225554 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b8dabb35-5dcf-4740-ae26-d7bdaf2c17d9 req-8768ddac-021c-415d-bede-6f6f95480182 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Sep 10 11:21:21.226474 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4185/6054] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:21:21.540427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:21.541385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: 841e967f-3cdc-4551-89c4-37ad5f8e68f1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:21.547875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:21.548360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:21.548797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:21.549508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:21.549960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:21.550384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:21.564299 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] HTTP exception thrown: Instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 could not be found. Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Request method failure captured: Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 HTTP/1.1 Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHH99mNjQ7cQbIBFm5xMEZ09SACFhVgG8u0OC8VbKtc7kt4xMCSUwnrA_oKblEW8JDocge6AO3VQeTn5dPDK01j3vyI7zzY9BdVnAyaSXPFZgxHuuzje-hF9HrWs8Iqjz9AuPu-m3EbiyaYPoNSXA2WnlKdjtcvfaTnrFqxqwvxBOec Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: aad1c11f4349492a8c53684e82676e2e Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad1c11f4349492a8c53684e82676e2e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: aad1c11f4349492a8c53684e82676e2e Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestNetworkAdvancedServerOps-1400270813-project Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 28049b2f9a484bf68b61b0769cef6616 Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1400270813-project Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 could not be found. Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '841e967f-3cdc-4551-89c4-37ad5f8e68f1'} Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 could not be found. Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 could not be found. Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:21:21.566293 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:21:21.573162 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:21:21.573162 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:21:21.573162 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:21:21.573162 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:21:21.573162 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:21:21.573162 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:21:21.573162 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 could not be found. Sep 10 11:21:21.573162 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:21:21.573162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Returning 404 to user: Instance 841e967f-3cdc-4551-89c4-37ad5f8e68f1 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:21:21.573162 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aee4af25-930e-4025-9543-e8d2b0ce132f tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1" status: 404 len: 111 microversion: 2.1 time: 0.032587 Sep 10 11:21:21.574061 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1870/6055] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:21 2022] GET /compute/v2.1/servers/841e967f-3cdc-4551-89c4-37ad5f8e68f1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:21:22.232222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:22.232951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] [instance: d43e2f02-0153-4933-9503-281a2495d252] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:22.239223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:22.240269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:22.240720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:22.241456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:22.241925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:22.242363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:22.255962 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] HTTP exception thrown: Instance d43e2f02-0153-4933-9503-281a2495d252 could not be found. Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Request method failure captured: Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 HTTP/1.1 Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHKJVWe-xFbKPgcUZ4QX5RfeglaqEw62QS79cS2mbuGwtFltRyPlFJq0R3QVp-mAobAXXX6l-Bf5il0BFgzOd4l-m1WR5O7Ob62KVPVxUSS_35TzuwHQGDa-5CAwkWtUYFOuW3CkleilE_djbwqCLW7BUuasNvRqk8Cne_dkcR4drBY Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: c86e0403ece1466191df053f9cf2b959 Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1558355024 Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c86e0403ece1466191df053f9cf2b959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c86e0403ece1466191df053f9cf2b959"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c86e0403ece1466191df053f9cf2b959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c86e0403ece1466191df053f9cf2b959", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-VolumesSnapshotTestJSON-1558355024 Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: c86e0403ece1466191df053f9cf2b959 Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1558355024 Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-VolumesSnapshotTestJSON-1558355024-project Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: bcb2a2204e764d5c9b0224af8399e81d Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-VolumesSnapshotTestJSON-1558355024-project Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance d43e2f02-0153-4933-9503-281a2495d252 could not be found. Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'd43e2f02-0153-4933-9503-281a2495d252'} Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43e2f02-0153-4933-9503-281a2495d252 could not be found. Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43e2f02-0153-4933-9503-281a2495d252 could not be found. Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:21:22.257654 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:21:22.262660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:21:22.262660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:21:22.262660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:21:22.262660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:21:22.262660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:21:22.262660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43e2f02-0153-4933-9503-281a2495d252 could not be found. Sep 10 11:21:22.262660 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:21:22.262660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] Returning 404 to user: Instance d43e2f02-0153-4933-9503-281a2495d252 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:21:22.262660 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0400a38d-29ea-4f3c-8df2-873b06c84c0d tempest-VolumesSnapshotTestJSON-1558355024 tempest-VolumesSnapshotTestJSON-1558355024-project] 10.222.0.20 "GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252" status: 404 len: 111 microversion: 2.1 time: 0.032734 Sep 10 11:21:22.262660 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4186/6056] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:22 2022] GET /compute/v2.1/servers/d43e2f02-0153-4933-9503-281a2495d252 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:21:25.089212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-83cc0735-6f8a-4bbb-ab0f-9370321851ca tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '.version_select at 0x7efcaebe1790>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:25.123783 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-83cc0735-6f8a-4bbb-ab0f-9370321851ca tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-857262576" status: 202 len: 0 microversion: 2.1 time: 0.040059 Sep 10 11:21:25.125139 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1871/6057] 10.222.0.20 () {58 vars in 1281 bytes} [Sat Sep 10 11:21:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-857262576 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:21:25.170770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b611bee1-fd78-4cbe-a858-8a525e4906b6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'create', calling method: .version_select at 0x7efcad2641f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1389410613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgUpVgmZDMvJZslcX2UwaiZ46a1eE74a0ubiK3or92f4SVQlyHz9spPtzUHPx0XcAi1/OJj4nhp6JneoP69r5Bapa1gWCqeaGctnc2WDTVETZgWujT+Y8dmBoIPujO93w=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:25.197840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b611bee1-fd78-4cbe-a858-8a525e4906b6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for project aad1c11f4349492a8c53684e82676e2e. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:21:25.204790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b611bee1-fd78-4cbe-a858-8a525e4906b6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for user 28049b2f9a484bf68b61b0769cef6616 and project aad1c11f4349492a8c53684e82676e2e. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:21:25.236133 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b611bee1-fd78-4cbe-a858-8a525e4906b6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.080925 Sep 10 11:21:25.237479 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4187/6058] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:21:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:21:31.699618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:31.704538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1627357241", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "9d18e0f8-f5b1-4879-a331-e72c6e84390a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1389410613", "security_groups": [{"name": "tempest-secgroup-smoke-1632038232"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:31.890065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] validate_networks() for [('9d18e0f8-f5b1-4879-a331-e72c6e84390a', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:21:32.580586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:21:32.581384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:21:32.582036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:21:32.582613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:21:32.584543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:21:32.596046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:32.596793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:32.597446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:32.598349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:32.599028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:32.599571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:32.621949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for project aad1c11f4349492a8c53684e82676e2e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:21:32.627628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Getting quotas for user 28049b2f9a484bf68b61b0769cef6616 and project aad1c11f4349492a8c53684e82676e2e. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:21:32.643530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:21:32.646915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:21:32.721775 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7e2910c6-5634-4867-b90f-f813f3a8fbde tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.023759 Sep 10 11:21:32.729241 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1872/6059] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:21:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:21:32.732199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:32.745808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-67b2762c-8e19-4700-8349-860337561827 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:32.746444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-67b2762c-8e19-4700-8349-860337561827 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:32.848562 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-67b2762c-8e19-4700-8349-860337561827 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:32.856110 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-67b2762c-8e19-4700-8349-860337561827 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1267 microversion: 2.1 time: 0.125923 Sep 10 11:21:32.873041 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4188/6060] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:32 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:33.896349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-208c6d90-95d5-4c99-8983-13806b1d4cd8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:33.896985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-208c6d90-95d5-4c99-8983-13806b1d4cd8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:33.909404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-208c6d90-95d5-4c99-8983-13806b1d4cd8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:33.912780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-208c6d90-95d5-4c99-8983-13806b1d4cd8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:33.913453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-208c6d90-95d5-4c99-8983-13806b1d4cd8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:33.914960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-208c6d90-95d5-4c99-8983-13806b1d4cd8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:33.917240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-208c6d90-95d5-4c99-8983-13806b1d4cd8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:33.917682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-208c6d90-95d5-4c99-8983-13806b1d4cd8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:34.041739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-208c6d90-95d5-4c99-8983-13806b1d4cd8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:34.058949 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-208c6d90-95d5-4c99-8983-13806b1d4cd8 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1319 microversion: 2.1 time: 0.178295 Sep 10 11:21:34.079489 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1873/6061] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:33 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:35.092192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32ee313e-86dd-427f-accf-986fd6fcd878 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:35.092868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-32ee313e-86dd-427f-accf-986fd6fcd878 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:35.115864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32ee313e-86dd-427f-accf-986fd6fcd878 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:35.116964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32ee313e-86dd-427f-accf-986fd6fcd878 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:35.117688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32ee313e-86dd-427f-accf-986fd6fcd878 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:35.118641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32ee313e-86dd-427f-accf-986fd6fcd878 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:35.119113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32ee313e-86dd-427f-accf-986fd6fcd878 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:35.119948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32ee313e-86dd-427f-accf-986fd6fcd878 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:35.379297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-32ee313e-86dd-427f-accf-986fd6fcd878 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:35.390877 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-32ee313e-86dd-427f-accf-986fd6fcd878 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1393 microversion: 2.1 time: 0.302856 Sep 10 11:21:35.395118 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4189/6062] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:35 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1393 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:35.988341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-2766c0a2-df81-4f7e-826f-23dafd1d1179 req-a7eabc30-4d84-48b3-b382-d40ad1c9f055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9007f41-297f-4ce8-93ca-ccfe1a0591e7", "tag": "0281e944-2b4e-4967-9888-c9c6e6700e70"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:36.011888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2766c0a2-df81-4f7e-826f-23dafd1d1179 req-a7eabc30-4d84-48b3-b382-d40ad1c9f055 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:36.012448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2766c0a2-df81-4f7e-826f-23dafd1d1179 req-a7eabc30-4d84-48b3-b382-d40ad1c9f055 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:36.012928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2766c0a2-df81-4f7e-826f-23dafd1d1179 req-a7eabc30-4d84-48b3-b382-d40ad1c9f055 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:36.027365 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-2766c0a2-df81-4f7e-826f-23dafd1d1179 req-a7eabc30-4d84-48b3-b382-d40ad1c9f055 service nova] Creating event network-changed:0281e944-2b4e-4967-9888-c9c6e6700e70 for instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 on n-h1-856894-1 Sep 10 11:21:36.032467 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-2766c0a2-df81-4f7e-826f-23dafd1d1179 req-a7eabc30-4d84-48b3-b382-d40ad1c9f055 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048415 Sep 10 11:21:36.033098 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1874/6063] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:21:36.420145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eeb757dc-2281-434e-bb6f-8b8e5f436e8a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:36.421515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eeb757dc-2281-434e-bb6f-8b8e5f436e8a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:36.430575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eeb757dc-2281-434e-bb6f-8b8e5f436e8a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:36.431215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eeb757dc-2281-434e-bb6f-8b8e5f436e8a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:36.433718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eeb757dc-2281-434e-bb6f-8b8e5f436e8a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:36.434517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eeb757dc-2281-434e-bb6f-8b8e5f436e8a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:36.434967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eeb757dc-2281-434e-bb6f-8b8e5f436e8a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:36.435422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eeb757dc-2281-434e-bb6f-8b8e5f436e8a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:36.596020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eeb757dc-2281-434e-bb6f-8b8e5f436e8a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:36.605153 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eeb757dc-2281-434e-bb6f-8b8e5f436e8a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1393 microversion: 2.1 time: 0.189095 Sep 10 11:21:36.605773 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4190/6064] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:36 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1393 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:37.629995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f6785adc-3d92-4082-b484-9612763b2e74 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:37.631107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f6785adc-3d92-4082-b484-9612763b2e74 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:37.637555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6785adc-3d92-4082-b484-9612763b2e74 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:37.638185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6785adc-3d92-4082-b484-9612763b2e74 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:37.638788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6785adc-3d92-4082-b484-9612763b2e74 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:37.639587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6785adc-3d92-4082-b484-9612763b2e74 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:37.640137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6785adc-3d92-4082-b484-9612763b2e74 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:37.640659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6785adc-3d92-4082-b484-9612763b2e74 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:37.796521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f6785adc-3d92-4082-b484-9612763b2e74 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:37.804715 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f6785adc-3d92-4082-b484-9612763b2e74 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1393 microversion: 2.1 time: 0.179921 Sep 10 11:21:37.805315 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1875/6065] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:37 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:38.827946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0881ff4a-dd39-4991-b8f5-0cf1d1a97aa2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:38.828736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0881ff4a-dd39-4991-b8f5-0cf1d1a97aa2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:38.835887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0881ff4a-dd39-4991-b8f5-0cf1d1a97aa2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:38.836339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0881ff4a-dd39-4991-b8f5-0cf1d1a97aa2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:38.836789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0881ff4a-dd39-4991-b8f5-0cf1d1a97aa2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:38.837522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0881ff4a-dd39-4991-b8f5-0cf1d1a97aa2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:38.837994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0881ff4a-dd39-4991-b8f5-0cf1d1a97aa2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:38.838430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0881ff4a-dd39-4991-b8f5-0cf1d1a97aa2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:38.980012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0881ff4a-dd39-4991-b8f5-0cf1d1a97aa2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:38.988366 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0881ff4a-dd39-4991-b8f5-0cf1d1a97aa2 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1393 microversion: 2.1 time: 0.164303 Sep 10 11:21:38.990191 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4191/6066] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:38 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:40.011094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7ee0d37e-b41b-45a5-b665-db7b89838a89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:40.011795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7ee0d37e-b41b-45a5-b665-db7b89838a89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:40.018770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee0d37e-b41b-45a5-b665-db7b89838a89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:40.019268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee0d37e-b41b-45a5-b665-db7b89838a89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:40.019733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee0d37e-b41b-45a5-b665-db7b89838a89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:40.020440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee0d37e-b41b-45a5-b665-db7b89838a89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:40.020903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee0d37e-b41b-45a5-b665-db7b89838a89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:40.021382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7ee0d37e-b41b-45a5-b665-db7b89838a89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:40.156466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7ee0d37e-b41b-45a5-b665-db7b89838a89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:40.165419 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7ee0d37e-b41b-45a5-b665-db7b89838a89 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1393 microversion: 2.1 time: 0.158206 Sep 10 11:21:40.166197 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1876/6067] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:40 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:41.189753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-81cd24b9-f84e-471b-a28d-cbb5855b9a71 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:41.190327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-81cd24b9-f84e-471b-a28d-cbb5855b9a71 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:41.198899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81cd24b9-f84e-471b-a28d-cbb5855b9a71 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:41.199409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81cd24b9-f84e-471b-a28d-cbb5855b9a71 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:41.199864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81cd24b9-f84e-471b-a28d-cbb5855b9a71 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:41.200584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81cd24b9-f84e-471b-a28d-cbb5855b9a71 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:41.201058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81cd24b9-f84e-471b-a28d-cbb5855b9a71 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:41.201532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81cd24b9-f84e-471b-a28d-cbb5855b9a71 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:41.339398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-81cd24b9-f84e-471b-a28d-cbb5855b9a71 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:41.347191 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-81cd24b9-f84e-471b-a28d-cbb5855b9a71 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1393 microversion: 2.1 time: 0.161416 Sep 10 11:21:41.347780 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4192/6068] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:41 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:41.895554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-d66d8dfe-01a9-46ea-acf5-b7a967b3e6f0 req-9b259b47-9f24-4c59-9afb-62d35c00f5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9007f41-297f-4ce8-93ca-ccfe1a0591e7", "name": "network-vif-plugged", "status": "completed", "tag": "0281e944-2b4e-4967-9888-c9c6e6700e70"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:41.905613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d66d8dfe-01a9-46ea-acf5-b7a967b3e6f0 req-9b259b47-9f24-4c59-9afb-62d35c00f5ec service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:41.906096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d66d8dfe-01a9-46ea-acf5-b7a967b3e6f0 req-9b259b47-9f24-4c59-9afb-62d35c00f5ec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:41.906530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d66d8dfe-01a9-46ea-acf5-b7a967b3e6f0 req-9b259b47-9f24-4c59-9afb-62d35c00f5ec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:41.918666 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-d66d8dfe-01a9-46ea-acf5-b7a967b3e6f0 req-9b259b47-9f24-4c59-9afb-62d35c00f5ec service nova] Creating event network-vif-plugged:0281e944-2b4e-4967-9888-c9c6e6700e70 for instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 on n-h1-856894-1 Sep 10 11:21:41.924515 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-d66d8dfe-01a9-46ea-acf5-b7a967b3e6f0 req-9b259b47-9f24-4c59-9afb-62d35c00f5ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102230 Sep 10 11:21:41.924978 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1877/6069] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:21:42.370206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d88863f-2095-4c4c-858d-a4bf94061103 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:42.370839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d88863f-2095-4c4c-858d-a4bf94061103 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:42.373643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:42.379729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d88863f-2095-4c4c-858d-a4bf94061103 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:42.380727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d88863f-2095-4c4c-858d-a4bf94061103 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:42.381202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d88863f-2095-4c4c-858d-a4bf94061103 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:42.381916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d88863f-2095-4c4c-858d-a4bf94061103 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:42.382389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d88863f-2095-4c4c-858d-a4bf94061103 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:42.382829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d88863f-2095-4c4c-858d-a4bf94061103 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:42.519614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d88863f-2095-4c4c-858d-a4bf94061103 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:42.528182 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d88863f-2095-4c4c-858d-a4bf94061103 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1393 microversion: 2.1 time: 0.162063 Sep 10 11:21:42.528773 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4193/6070] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:42 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:43.552021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b17e4bed-a1df-4b28-8403-8f0376d12a0b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:43.552745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b17e4bed-a1df-4b28-8403-8f0376d12a0b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:43.554681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:43.555497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:43.557183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:43.563756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b17e4bed-a1df-4b28-8403-8f0376d12a0b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:43.564240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b17e4bed-a1df-4b28-8403-8f0376d12a0b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:43.564679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b17e4bed-a1df-4b28-8403-8f0376d12a0b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:43.565407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b17e4bed-a1df-4b28-8403-8f0376d12a0b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:43.565861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b17e4bed-a1df-4b28-8403-8f0376d12a0b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:43.566294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b17e4bed-a1df-4b28-8403-8f0376d12a0b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:43.709318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b17e4bed-a1df-4b28-8403-8f0376d12a0b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:43.717054 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b17e4bed-a1df-4b28-8403-8f0376d12a0b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1564 microversion: 2.1 time: 0.169349 Sep 10 11:21:43.717643 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1878/6071] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:43 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:43.739492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f250163-e17c-44e2-a861-9ac9c8c75706 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:43.740122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f250163-e17c-44e2-a861-9ac9c8c75706 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:43.742068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:21:43.748491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f250163-e17c-44e2-a861-9ac9c8c75706 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:43.748991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f250163-e17c-44e2-a861-9ac9c8c75706 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:43.749497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f250163-e17c-44e2-a861-9ac9c8c75706 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:43.750256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f250163-e17c-44e2-a861-9ac9c8c75706 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:43.750730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f250163-e17c-44e2-a861-9ac9c8c75706 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:43.751170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f250163-e17c-44e2-a861-9ac9c8c75706 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:43.887701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f250163-e17c-44e2-a861-9ac9c8c75706 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:43.896344 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f250163-e17c-44e2-a861-9ac9c8c75706 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1564 microversion: 2.1 time: 0.160097 Sep 10 11:21:43.896961 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4194/6072] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:43 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:21:45.882036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b91fb464-6560-4fcf-ba47-3310d36daa68 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:21:45.883894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f4a5b611-ba04-46b4-b282-33ad50548fb0 req-0940b605-ced6-4256-b497-4485266863ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9007f41-297f-4ce8-93ca-ccfe1a0591e7", "tag": "0281e944-2b4e-4967-9888-c9c6e6700e70"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:21:45.885188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b91fb464-6560-4fcf-ba47-3310d36daa68 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:21:45.903532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b91fb464-6560-4fcf-ba47-3310d36daa68 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:45.904400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b91fb464-6560-4fcf-ba47-3310d36daa68 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:45.905455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b91fb464-6560-4fcf-ba47-3310d36daa68 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:45.906361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b91fb464-6560-4fcf-ba47-3310d36daa68 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:45.908339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f4a5b611-ba04-46b4-b282-33ad50548fb0 req-0940b605-ced6-4256-b497-4485266863ec service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:21:45.909037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b91fb464-6560-4fcf-ba47-3310d36daa68 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:45.910240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f4a5b611-ba04-46b4-b282-33ad50548fb0 req-0940b605-ced6-4256-b497-4485266863ec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:21:45.910452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b91fb464-6560-4fcf-ba47-3310d36daa68 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:45.912024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f4a5b611-ba04-46b4-b282-33ad50548fb0 req-0940b605-ced6-4256-b497-4485266863ec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:21:45.937719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f4a5b611-ba04-46b4-b282-33ad50548fb0 req-0940b605-ced6-4256-b497-4485266863ec service nova] Creating event network-changed:0281e944-2b4e-4967-9888-c9c6e6700e70 for instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 on n-h1-856894-1 Sep 10 11:21:45.950029 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f4a5b611-ba04-46b4-b282-33ad50548fb0 req-0940b605-ced6-4256-b497-4485266863ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075965 Sep 10 11:21:45.951233 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4195/6073] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:21:46.188849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b91fb464-6560-4fcf-ba47-3310d36daa68 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:21:46.199726 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b91fb464-6560-4fcf-ba47-3310d36daa68 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1564 microversion: 2.1 time: 0.324083 Sep 10 11:21:46.200326 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1879/6074] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:21:45 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1564 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:07.455266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=5 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:22:07.457193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=38 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:22:07.461879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-072450c3-c990-4412-919c-c60dff7d10c9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:22:07.464203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-072450c3-c990-4412-919c-c60dff7d10c9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:07.472060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072450c3-c990-4412-919c-c60dff7d10c9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:07.472566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072450c3-c990-4412-919c-c60dff7d10c9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:07.473023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072450c3-c990-4412-919c-c60dff7d10c9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:07.474541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072450c3-c990-4412-919c-c60dff7d10c9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:07.475021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072450c3-c990-4412-919c-c60dff7d10c9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:07.475499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-072450c3-c990-4412-919c-c60dff7d10c9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:07.544412 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-072450c3-c990-4412-919c-c60dff7d10c9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7/action" status: 200 len: 24566 microversion: 2.1 time: 0.090989 Sep 10 11:22:07.544995 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4196/6075] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:22:07 2022] POST /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7/action => generated 24566 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:22:18.593724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:22:18.596504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:18.598691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:22:18.599841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=36 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:22:18.606206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:18.606695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:18.607140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:18.607833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:18.608291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:18.608717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:18.685060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:22:18.685579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:22:18.686002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:22:18.686416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:22:18.686835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:22:18.750093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:18.755869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:18.756438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:18.756879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:18.757613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:18.758066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:18.758499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:18.785235 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-894d47d2-f610-4094-9509-f023e0bf0464 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7/action" status: 202 len: 1137 microversion: 2.1 time: 0.195608 Sep 10 11:22:18.785883 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1880/6076] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:22:18 2022] POST /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7/action => generated 1137 bytes in 197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 11:22:18.806941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cecf0341-4386-48d7-9843-f68dc81c769b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:18.807654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cecf0341-4386-48d7-9843-f68dc81c769b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:18.810669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:22:18.811894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:22:18.818890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cecf0341-4386-48d7-9843-f68dc81c769b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:18.819460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cecf0341-4386-48d7-9843-f68dc81c769b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:18.819965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cecf0341-4386-48d7-9843-f68dc81c769b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:18.820679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cecf0341-4386-48d7-9843-f68dc81c769b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:18.821172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cecf0341-4386-48d7-9843-f68dc81c769b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:18.821613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cecf0341-4386-48d7-9843-f68dc81c769b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:18.961830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cecf0341-4386-48d7-9843-f68dc81c769b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:18.969846 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cecf0341-4386-48d7-9843-f68dc81c769b tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.167361 Sep 10 11:22:18.970425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4197/6077] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:18 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:22:19.993634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2a88a91a-3211-4409-911d-a43a78196a93 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:19.994260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2a88a91a-3211-4409-911d-a43a78196a93 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:20.000999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a88a91a-3211-4409-911d-a43a78196a93 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:20.001520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a88a91a-3211-4409-911d-a43a78196a93 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:20.001966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a88a91a-3211-4409-911d-a43a78196a93 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:20.002661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a88a91a-3211-4409-911d-a43a78196a93 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:20.003118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a88a91a-3211-4409-911d-a43a78196a93 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:20.003550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2a88a91a-3211-4409-911d-a43a78196a93 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:20.137171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2a88a91a-3211-4409-911d-a43a78196a93 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:20.144948 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2a88a91a-3211-4409-911d-a43a78196a93 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.155933 Sep 10 11:22:20.145549 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1881/6078] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:19 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:21.168145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-afbb4326-1b55-4c9a-9176-c98842830c5a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:21.168821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-afbb4326-1b55-4c9a-9176-c98842830c5a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:21.176497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afbb4326-1b55-4c9a-9176-c98842830c5a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:21.176998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afbb4326-1b55-4c9a-9176-c98842830c5a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:21.177970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afbb4326-1b55-4c9a-9176-c98842830c5a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:21.178672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afbb4326-1b55-4c9a-9176-c98842830c5a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:21.179144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afbb4326-1b55-4c9a-9176-c98842830c5a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:21.179588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afbb4326-1b55-4c9a-9176-c98842830c5a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:21.313904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-afbb4326-1b55-4c9a-9176-c98842830c5a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:21.321825 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-afbb4326-1b55-4c9a-9176-c98842830c5a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.157934 Sep 10 11:22:21.322424 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4198/6079] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:21 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:22.345234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-27e77793-1384-480a-a2db-6495b6dd3094 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:22.345853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-27e77793-1384-480a-a2db-6495b6dd3094 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:22.352408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e77793-1384-480a-a2db-6495b6dd3094 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:22.352893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e77793-1384-480a-a2db-6495b6dd3094 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:22.353368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e77793-1384-480a-a2db-6495b6dd3094 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:22.354057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e77793-1384-480a-a2db-6495b6dd3094 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:22.354518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e77793-1384-480a-a2db-6495b6dd3094 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:22.354944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e77793-1384-480a-a2db-6495b6dd3094 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:22.483210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-27e77793-1384-480a-a2db-6495b6dd3094 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:22.491481 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-27e77793-1384-480a-a2db-6495b6dd3094 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.150403 Sep 10 11:22:22.492054 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1882/6080] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:22 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:23.515119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-836160e4-7022-465e-8735-6edf4b008183 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:23.515754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-836160e4-7022-465e-8735-6edf4b008183 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:23.523545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-836160e4-7022-465e-8735-6edf4b008183 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:23.524046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-836160e4-7022-465e-8735-6edf4b008183 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:23.524499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-836160e4-7022-465e-8735-6edf4b008183 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:23.525244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-836160e4-7022-465e-8735-6edf4b008183 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:23.525712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-836160e4-7022-465e-8735-6edf4b008183 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:23.526183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-836160e4-7022-465e-8735-6edf4b008183 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:23.666236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-836160e4-7022-465e-8735-6edf4b008183 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:23.674837 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-836160e4-7022-465e-8735-6edf4b008183 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.163596 Sep 10 11:22:23.675435 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4199/6081] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:23 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:24.697492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aac23987-ac07-4c5a-b7cd-ea1b98f771b1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:24.698105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-aac23987-ac07-4c5a-b7cd-ea1b98f771b1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:24.704863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aac23987-ac07-4c5a-b7cd-ea1b98f771b1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:24.705388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aac23987-ac07-4c5a-b7cd-ea1b98f771b1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:24.705818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aac23987-ac07-4c5a-b7cd-ea1b98f771b1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:24.706499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aac23987-ac07-4c5a-b7cd-ea1b98f771b1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:24.706949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aac23987-ac07-4c5a-b7cd-ea1b98f771b1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:24.707369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aac23987-ac07-4c5a-b7cd-ea1b98f771b1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:24.839796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-aac23987-ac07-4c5a-b7cd-ea1b98f771b1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:24.847480 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aac23987-ac07-4c5a-b7cd-ea1b98f771b1 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.153877 Sep 10 11:22:24.848042 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1883/6082] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:24 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:25.871730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-01087d19-9c06-4db5-906d-545c5739a893 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:25.872361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-01087d19-9c06-4db5-906d-545c5739a893 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:25.879346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01087d19-9c06-4db5-906d-545c5739a893 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:25.879853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01087d19-9c06-4db5-906d-545c5739a893 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:25.880366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01087d19-9c06-4db5-906d-545c5739a893 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:25.881119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01087d19-9c06-4db5-906d-545c5739a893 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:25.881602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01087d19-9c06-4db5-906d-545c5739a893 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:25.882048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01087d19-9c06-4db5-906d-545c5739a893 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:26.014184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-01087d19-9c06-4db5-906d-545c5739a893 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:26.022715 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-01087d19-9c06-4db5-906d-545c5739a893 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.154908 Sep 10 11:22:26.023301 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4200/6083] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:25 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:27.047018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-39f42fd8-c3f7-4cb6-b603-c824732f3393 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:27.047628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-39f42fd8-c3f7-4cb6-b603-c824732f3393 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:27.054955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39f42fd8-c3f7-4cb6-b603-c824732f3393 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:27.055440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39f42fd8-c3f7-4cb6-b603-c824732f3393 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:27.055876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39f42fd8-c3f7-4cb6-b603-c824732f3393 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:27.056559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39f42fd8-c3f7-4cb6-b603-c824732f3393 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:27.057012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39f42fd8-c3f7-4cb6-b603-c824732f3393 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:27.057460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39f42fd8-c3f7-4cb6-b603-c824732f3393 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:27.185716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-39f42fd8-c3f7-4cb6-b603-c824732f3393 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:27.194436 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-39f42fd8-c3f7-4cb6-b603-c824732f3393 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.151376 Sep 10 11:22:27.195011 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1884/6084] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:27 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:28.217325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23a6eb82-8c00-4dfc-8e59-f98058a4bf11 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:28.217964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23a6eb82-8c00-4dfc-8e59-f98058a4bf11 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:28.224905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23a6eb82-8c00-4dfc-8e59-f98058a4bf11 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:28.225445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23a6eb82-8c00-4dfc-8e59-f98058a4bf11 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:28.225905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23a6eb82-8c00-4dfc-8e59-f98058a4bf11 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:28.226637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23a6eb82-8c00-4dfc-8e59-f98058a4bf11 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:28.227111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23a6eb82-8c00-4dfc-8e59-f98058a4bf11 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:28.227557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23a6eb82-8c00-4dfc-8e59-f98058a4bf11 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:28.357108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23a6eb82-8c00-4dfc-8e59-f98058a4bf11 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:28.365151 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23a6eb82-8c00-4dfc-8e59-f98058a4bf11 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.151646 Sep 10 11:22:28.365774 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4201/6085] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:28 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:29.388911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ffa7cf7e-84b0-4548-8270-fd12f72a072a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:29.389487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ffa7cf7e-84b0-4548-8270-fd12f72a072a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:29.397286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffa7cf7e-84b0-4548-8270-fd12f72a072a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:29.397782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffa7cf7e-84b0-4548-8270-fd12f72a072a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:29.398224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffa7cf7e-84b0-4548-8270-fd12f72a072a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:29.398916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffa7cf7e-84b0-4548-8270-fd12f72a072a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:29.399370 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffa7cf7e-84b0-4548-8270-fd12f72a072a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:29.399797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffa7cf7e-84b0-4548-8270-fd12f72a072a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:29.534496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ffa7cf7e-84b0-4548-8270-fd12f72a072a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:29.542481 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ffa7cf7e-84b0-4548-8270-fd12f72a072a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.157305 Sep 10 11:22:29.543059 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1885/6086] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:29 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:30.565294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f2310b7-4340-4cdc-b682-63ce2416aa6a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:30.565935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f2310b7-4340-4cdc-b682-63ce2416aa6a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:30.573057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2310b7-4340-4cdc-b682-63ce2416aa6a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:30.573613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2310b7-4340-4cdc-b682-63ce2416aa6a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:30.574103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2310b7-4340-4cdc-b682-63ce2416aa6a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:30.574815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2310b7-4340-4cdc-b682-63ce2416aa6a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:30.575291 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2310b7-4340-4cdc-b682-63ce2416aa6a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:30.575736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2310b7-4340-4cdc-b682-63ce2416aa6a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:30.707954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f2310b7-4340-4cdc-b682-63ce2416aa6a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:30.716290 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f2310b7-4340-4cdc-b682-63ce2416aa6a tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.154984 Sep 10 11:22:30.716855 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4202/6087] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:30 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:31.740632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7e3f2b21-a0d7-4d05-9725-05431cda8d78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:31.741305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7e3f2b21-a0d7-4d05-9725-05431cda8d78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:31.748015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e3f2b21-a0d7-4d05-9725-05431cda8d78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:31.748507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e3f2b21-a0d7-4d05-9725-05431cda8d78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:31.748944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e3f2b21-a0d7-4d05-9725-05431cda8d78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:31.749761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e3f2b21-a0d7-4d05-9725-05431cda8d78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:31.750392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e3f2b21-a0d7-4d05-9725-05431cda8d78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:31.750659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7e3f2b21-a0d7-4d05-9725-05431cda8d78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:31.983274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7e3f2b21-a0d7-4d05-9725-05431cda8d78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:31.991644 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7e3f2b21-a0d7-4d05-9725-05431cda8d78 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.255742 Sep 10 11:22:31.992441 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1886/6088] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:31 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:33.014463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2dee128d-4985-4e7e-86b3-071e938290f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:33.015100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2dee128d-4985-4e7e-86b3-071e938290f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:33.022064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dee128d-4985-4e7e-86b3-071e938290f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:33.022571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dee128d-4985-4e7e-86b3-071e938290f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:33.023026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dee128d-4985-4e7e-86b3-071e938290f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:33.023734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dee128d-4985-4e7e-86b3-071e938290f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:33.024212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dee128d-4985-4e7e-86b3-071e938290f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:33.024655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dee128d-4985-4e7e-86b3-071e938290f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:33.153478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2dee128d-4985-4e7e-86b3-071e938290f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:33.161296 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2dee128d-4985-4e7e-86b3-071e938290f5 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.150696 Sep 10 11:22:33.161887 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4203/6089] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:33 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:34.185463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-01d315f9-c021-45ba-a32b-00c7eb86fc35 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:34.186074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-01d315f9-c021-45ba-a32b-00c7eb86fc35 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:34.192941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01d315f9-c021-45ba-a32b-00c7eb86fc35 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:34.193463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01d315f9-c021-45ba-a32b-00c7eb86fc35 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:34.193903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01d315f9-c021-45ba-a32b-00c7eb86fc35 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:34.194592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01d315f9-c021-45ba-a32b-00c7eb86fc35 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:34.195046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01d315f9-c021-45ba-a32b-00c7eb86fc35 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:34.195473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01d315f9-c021-45ba-a32b-00c7eb86fc35 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:34.329527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-01d315f9-c021-45ba-a32b-00c7eb86fc35 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:34.337819 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-01d315f9-c021-45ba-a32b-00c7eb86fc35 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.156312 Sep 10 11:22:34.338759 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1887/6090] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:34 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:35.363297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-24ac99b4-5465-49bb-9cb0-1ec9609ae25c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:35.363921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-24ac99b4-5465-49bb-9cb0-1ec9609ae25c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:35.370515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24ac99b4-5465-49bb-9cb0-1ec9609ae25c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:35.371010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24ac99b4-5465-49bb-9cb0-1ec9609ae25c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:35.371459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24ac99b4-5465-49bb-9cb0-1ec9609ae25c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:35.372151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24ac99b4-5465-49bb-9cb0-1ec9609ae25c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:35.372614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24ac99b4-5465-49bb-9cb0-1ec9609ae25c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:35.373052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-24ac99b4-5465-49bb-9cb0-1ec9609ae25c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:35.506108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-24ac99b4-5465-49bb-9cb0-1ec9609ae25c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:35.514307 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-24ac99b4-5465-49bb-9cb0-1ec9609ae25c tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1692 microversion: 2.1 time: 0.155074 Sep 10 11:22:35.514907 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4204/6091] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:35 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:36.543871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-82464cd1-e254-499f-bfb3-3b7f4fea52fd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:36.544490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-82464cd1-e254-499f-bfb3-3b7f4fea52fd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:36.554243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82464cd1-e254-499f-bfb3-3b7f4fea52fd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:36.554756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82464cd1-e254-499f-bfb3-3b7f4fea52fd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:36.555231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82464cd1-e254-499f-bfb3-3b7f4fea52fd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:36.555981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82464cd1-e254-499f-bfb3-3b7f4fea52fd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:36.556451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82464cd1-e254-499f-bfb3-3b7f4fea52fd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:36.556883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82464cd1-e254-499f-bfb3-3b7f4fea52fd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:36.741805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-82464cd1-e254-499f-bfb3-3b7f4fea52fd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:36.749605 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-82464cd1-e254-499f-bfb3-3b7f4fea52fd tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1698 microversion: 2.1 time: 0.209916 Sep 10 11:22:36.750187 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1888/6092] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:36 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1698 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:37.774253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60631893-6c85-40fe-a526-6e3f73299beb tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:22:37.774889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60631893-6c85-40fe-a526-6e3f73299beb tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:22:37.782124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60631893-6c85-40fe-a526-6e3f73299beb tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:37.782827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60631893-6c85-40fe-a526-6e3f73299beb tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:37.783356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60631893-6c85-40fe-a526-6e3f73299beb tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:37.784140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60631893-6c85-40fe-a526-6e3f73299beb tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:37.784706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60631893-6c85-40fe-a526-6e3f73299beb tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:37.785254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60631893-6c85-40fe-a526-6e3f73299beb tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:37.923034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60631893-6c85-40fe-a526-6e3f73299beb tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:22:37.931000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60631893-6c85-40fe-a526-6e3f73299beb tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1683 microversion: 2.1 time: 0.162078 Sep 10 11:22:37.931574 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4205/6093] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:22:37 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:22:40.136897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-705e9292-55eb-436b-b3f1-9ff51996141a req-4f4a79da-3654-48da-aee4-649c422d96e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9007f41-297f-4ce8-93ca-ccfe1a0591e7", "name": "network-vif-unplugged", "status": "completed", "tag": "0281e944-2b4e-4967-9888-c9c6e6700e70"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:22:40.149605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-705e9292-55eb-436b-b3f1-9ff51996141a req-4f4a79da-3654-48da-aee4-649c422d96e3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:40.150125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-705e9292-55eb-436b-b3f1-9ff51996141a req-4f4a79da-3654-48da-aee4-649c422d96e3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:40.150541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-705e9292-55eb-436b-b3f1-9ff51996141a req-4f4a79da-3654-48da-aee4-649c422d96e3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:40.162837 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-705e9292-55eb-436b-b3f1-9ff51996141a req-4f4a79da-3654-48da-aee4-649c422d96e3 service nova] Creating event network-vif-unplugged:0281e944-2b4e-4967-9888-c9c6e6700e70 for instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 on n-h1-856894-1 Sep 10 11:22:40.168372 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-705e9292-55eb-436b-b3f1-9ff51996141a req-4f4a79da-3654-48da-aee4-649c422d96e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035131 Sep 10 11:22:40.169589 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1889/6094] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:22:42.183490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-31473abf-7e7b-4ab0-b408-847e0fac1b42 req-aa604acc-abb6-45fd-83f3-be0a66e77d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9007f41-297f-4ce8-93ca-ccfe1a0591e7", "name": "network-vif-plugged", "status": "completed", "tag": "0281e944-2b4e-4967-9888-c9c6e6700e70"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:22:42.194120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-31473abf-7e7b-4ab0-b408-847e0fac1b42 req-aa604acc-abb6-45fd-83f3-be0a66e77d11 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:22:42.194610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-31473abf-7e7b-4ab0-b408-847e0fac1b42 req-aa604acc-abb6-45fd-83f3-be0a66e77d11 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:22:42.195053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-31473abf-7e7b-4ab0-b408-847e0fac1b42 req-aa604acc-abb6-45fd-83f3-be0a66e77d11 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:22:42.206400 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-31473abf-7e7b-4ab0-b408-847e0fac1b42 req-aa604acc-abb6-45fd-83f3-be0a66e77d11 service nova] Creating event network-vif-plugged:0281e944-2b4e-4967-9888-c9c6e6700e70 for instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 on n-h1-856894-1 Sep 10 11:22:42.212506 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-31473abf-7e7b-4ab0-b408-847e0fac1b42 req-aa604acc-abb6-45fd-83f3-be0a66e77d11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032588 Sep 10 11:22:42.213197 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4206/6095] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:23:02.137796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e068791e-e80f-4740-85d9-f949bd485de6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:23:02.140100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e068791e-e80f-4740-85d9-f949bd485de6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:02.142381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=24 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:02.143216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:02.151303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e068791e-e80f-4740-85d9-f949bd485de6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:02.151791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e068791e-e80f-4740-85d9-f949bd485de6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:02.152229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e068791e-e80f-4740-85d9-f949bd485de6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:02.152931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e068791e-e80f-4740-85d9-f949bd485de6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:02.153412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e068791e-e80f-4740-85d9-f949bd485de6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:02.153839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e068791e-e80f-4740-85d9-f949bd485de6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:02.216974 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e068791e-e80f-4740-85d9-f949bd485de6 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "POST /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7/action" status: 200 len: 24570 microversion: 2.1 time: 0.083534 Sep 10 11:23:02.217634 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1890/6096] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:23:02 2022] POST /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7/action => generated 24570 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:23:13.997688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1a84503-4132-45e3-a491-a6f3dc2074c3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:13.998316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1a84503-4132-45e3-a491-a6f3dc2074c3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:14.006983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-184e98b6-25f1-4985-bda0-fe4d31b1e066 req-36739637-1912-42c2-b348-a0c22cf1473c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9007f41-297f-4ce8-93ca-ccfe1a0591e7", "tag": "0281e944-2b4e-4967-9888-c9c6e6700e70"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:23:14.012825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:14.013499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:14.018813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=20 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:14.019571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=56 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:14.026776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1a84503-4132-45e3-a491-a6f3dc2074c3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:14.027289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1a84503-4132-45e3-a491-a6f3dc2074c3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:14.027747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1a84503-4132-45e3-a491-a6f3dc2074c3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:14.028471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1a84503-4132-45e3-a491-a6f3dc2074c3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:14.028943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1a84503-4132-45e3-a491-a6f3dc2074c3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:14.029418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1a84503-4132-45e3-a491-a6f3dc2074c3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:14.036096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-184e98b6-25f1-4985-bda0-fe4d31b1e066 req-36739637-1912-42c2-b348-a0c22cf1473c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:14.036586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-184e98b6-25f1-4985-bda0-fe4d31b1e066 req-36739637-1912-42c2-b348-a0c22cf1473c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:14.037021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-184e98b6-25f1-4985-bda0-fe4d31b1e066 req-36739637-1912-42c2-b348-a0c22cf1473c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:14.049216 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-184e98b6-25f1-4985-bda0-fe4d31b1e066 req-36739637-1912-42c2-b348-a0c22cf1473c service nova] Creating event network-changed:0281e944-2b4e-4967-9888-c9c6e6700e70 for instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 on n-h1-856894-1 Sep 10 11:23:14.054299 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-184e98b6-25f1-4985-bda0-fe4d31b1e066 req-36739637-1912-42c2-b348-a0c22cf1473c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051757 Sep 10 11:23:14.055103 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1891/6097] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:23:14.058813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1a84503-4132-45e3-a491-a6f3dc2074c3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:23:14.148005 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1a84503-4132-45e3-a491-a6f3dc2074c3 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 204 len: 0 microversion: 2.1 time: 0.154560 Sep 10 11:23:14.148991 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4207/6098] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:23:13 2022] DELETE /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:23:14.159219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-67ce103b-bd39-4f0e-bb4e-a554e821cc72 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:14.160719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-67ce103b-bd39-4f0e-bb4e-a554e821cc72 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:14.173013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ce103b-bd39-4f0e-bb4e-a554e821cc72 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:14.174078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ce103b-bd39-4f0e-bb4e-a554e821cc72 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:14.174534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ce103b-bd39-4f0e-bb4e-a554e821cc72 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:14.175303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ce103b-bd39-4f0e-bb4e-a554e821cc72 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:14.175764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ce103b-bd39-4f0e-bb4e-a554e821cc72 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:14.176197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67ce103b-bd39-4f0e-bb4e-a554e821cc72 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:14.336748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-67ce103b-bd39-4f0e-bb4e-a554e821cc72 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:14.344803 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-67ce103b-bd39-4f0e-bb4e-a554e821cc72 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1689 microversion: 2.1 time: 0.190976 Sep 10 11:23:14.345496 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1892/6099] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:14 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:15.370996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19d0a1a6-c549-48ba-90e1-bd1cad72d0ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:15.371728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-19d0a1a6-c549-48ba-90e1-bd1cad72d0ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:15.378527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19d0a1a6-c549-48ba-90e1-bd1cad72d0ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:15.379047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19d0a1a6-c549-48ba-90e1-bd1cad72d0ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:15.379512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19d0a1a6-c549-48ba-90e1-bd1cad72d0ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:15.380205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19d0a1a6-c549-48ba-90e1-bd1cad72d0ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:15.380685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19d0a1a6-c549-48ba-90e1-bd1cad72d0ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:15.381164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19d0a1a6-c549-48ba-90e1-bd1cad72d0ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:15.886796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19d0a1a6-c549-48ba-90e1-bd1cad72d0ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28049b2f9a484bf68b61b0769cef6616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad1c11f4349492a8c53684e82676e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:15.895501 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-19d0a1a6-c549-48ba-90e1-bd1cad72d0ad tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 200 len: 1689 microversion: 2.1 time: 0.528809 Sep 10 11:23:15.896378 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4208/6100] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:15 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 1689 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:15.971192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-6976fff6-b50e-4977-a968-47eecadd78c7 req-955ee95b-3d49-40cd-8281-0a781e956fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9007f41-297f-4ce8-93ca-ccfe1a0591e7", "name": "network-vif-deleted", "tag": "0281e944-2b4e-4967-9888-c9c6e6700e70"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:23:15.982842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6976fff6-b50e-4977-a968-47eecadd78c7 req-955ee95b-3d49-40cd-8281-0a781e956fd4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:15.983432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6976fff6-b50e-4977-a968-47eecadd78c7 req-955ee95b-3d49-40cd-8281-0a781e956fd4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:15.983956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6976fff6-b50e-4977-a968-47eecadd78c7 req-955ee95b-3d49-40cd-8281-0a781e956fd4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:15.998676 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-6976fff6-b50e-4977-a968-47eecadd78c7 req-955ee95b-3d49-40cd-8281-0a781e956fd4 service nova] Creating event network-vif-deleted:0281e944-2b4e-4967-9888-c9c6e6700e70 for instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 on n-h1-856894-1 Sep 10 11:23:16.003904 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-6976fff6-b50e-4977-a968-47eecadd78c7 req-955ee95b-3d49-40cd-8281-0a781e956fd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036558 Sep 10 11:23:16.004577 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1893/6101] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:23:16.919692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:16.920314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] [instance: b9007f41-297f-4ce8-93ca-ccfe1a0591e7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:16.926949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:16.927432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:16.927882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:16.928609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:16.929114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:16.929538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:16.943472 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] HTTP exception thrown: Instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 could not be found. Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Request method failure captured: Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 HTTP/1.1 Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHH99mNjQ7cQbIBFm5xMEZ09SACFhVgG8u0OC8VbKtc7kt4xMCSUwnrA_oKblEW8JDocge6AO3VQeTn5dPDK01j3vyI7zzY9BdVnAyaSXPFZgxHuuzje-hF9HrWs8Iqjz9AuPu-m3EbiyaYPoNSXA2WnlKdjtcvfaTnrFqxqwvxBOec Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: aad1c11f4349492a8c53684e82676e2e Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aad1c11f4349492a8c53684e82676e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aad1c11f4349492a8c53684e82676e2e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: aad1c11f4349492a8c53684e82676e2e Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1400270813 Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestNetworkAdvancedServerOps-1400270813-project Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 28049b2f9a484bf68b61b0769cef6616 Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1400270813-project Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 could not be found. Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'b9007f41-297f-4ce8-93ca-ccfe1a0591e7'} Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 could not be found. Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 could not be found. Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:23:16.945037 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 could not be found. Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Returning 404 to user: Instance b9007f41-297f-4ce8-93ca-ccfe1a0591e7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a22f396-a1ba-492b-a0ab-74dfac9570e9 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7" status: 404 len: 111 microversion: 2.1 time: 0.031033 Sep 10 11:23:16.950392 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4209/6102] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:16 2022] GET /compute/v2.1/servers/b9007f41-297f-4ce8-93ca-ccfe1a0591e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:23:19.884421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5018bc4d-1982-4d5b-919b-bf602200a466 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] Calling method '.version_select at 0x7efcade90550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:19.905800 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5018bc4d-1982-4d5b-919b-bf602200a466 tempest-TestNetworkAdvancedServerOps-1400270813 tempest-TestNetworkAdvancedServerOps-1400270813-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1389410613" status: 202 len: 0 microversion: 2.1 time: 0.026980 Sep 10 11:23:19.906685 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1894/6103] 10.222.0.20 () {58 vars in 1284 bytes} [Sat Sep 10 11:23:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1389410613 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:23:22.803039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-492a419b-2ffd-415a-aa47-c96bb722dc16 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Action: 'create', calling method: .version_select at 0x7efcad2b2c10>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1746464735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE82CRMMfNOyADTXCYNMzZr4YKPwBeI/OHi35d/fqLY2NZeWZeRAilzXN1cVDZEXaDuidlWJEH/TprwgL3ow6LaCpEOEtD4wvhvfJse0kyz0Zwff3OEsHGmKFXcga5RX9A=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:23:22.819203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-492a419b-2ffd-415a-aa47-c96bb722dc16 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Getting quotas for project 061d848620004929b582404ad433e631. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:23:22.824464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-492a419b-2ffd-415a-aa47-c96bb722dc16 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Getting quotas for user e7cbe668df7c4eadaf538a69da01cbbc and project 061d848620004929b582404ad433e631. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:23:22.848385 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-492a419b-2ffd-415a-aa47-c96bb722dc16 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.211222 Sep 10 11:23:22.849558 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4210/6104] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:23:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:23:28.378946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=10 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:28.385637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-323487326-access_point-1532232195", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "a762d385-2072-4723-a460-bd4ce3bc4c6f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1746464735", "security_groups": [{"name": "tempest-secgroup_access--1301852829"}, {"name": "tempest-secgroup_general--955592757"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:23:28.597658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] validate_networks() for [('a762d385-2072-4723-a460-bd4ce3bc4c6f', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:23:29.014041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:23:29.014670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:23:29.015144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:23:29.015656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:23:29.016081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:23:29.026756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:29.027245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:29.027689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:29.028428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:29.028889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:29.029341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:29.047531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Getting quotas for project 061d848620004929b582404ad433e631. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:23:29.052819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Getting quotas for user e7cbe668df7c4eadaf538a69da01cbbc and project 061d848620004929b582404ad433e631. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:23:29.065914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:23:29.068495 n-d-856894-1 devstack@n-api.service[128787]: WARNING nova.utils [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-323487326-access_point-1532232195 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-323487326-acc Sep 10 11:23:29.069371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:23:29.117560 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9831cc6e-c352-4ae9-8e48-71a472b53516 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.740441 Sep 10 11:23:29.118232 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1895/6105] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:23:28 2022] POST /compute/v2.1/servers => generated 457 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:23:29.127876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:29.133115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86fbed3c-2725-469a-9e6a-6870fb556794 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:29.133757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86fbed3c-2725-469a-9e6a-6870fb556794 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:29.198949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-86fbed3c-2725-469a-9e6a-6870fb556794 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:29.207411 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86fbed3c-2725-469a-9e6a-6870fb556794 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1294 microversion: 2.1 time: 0.081319 Sep 10 11:23:29.208010 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4211/6106] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:29 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:30.232035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3c6124f2-4e69-4807-883f-989fb1300b73 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:30.232681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3c6124f2-4e69-4807-883f-989fb1300b73 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:30.286060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c6124f2-4e69-4807-883f-989fb1300b73 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:30.294347 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3c6124f2-4e69-4807-883f-989fb1300b73 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1294 microversion: 2.1 time: 0.067171 Sep 10 11:23:30.294919 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1896/6107] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:30 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1294 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:31.317498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51ad5823-8e4d-4c32-963e-5d8e8c52054e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:31.318124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51ad5823-8e4d-4c32-963e-5d8e8c52054e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:31.388064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-51ad5823-8e4d-4c32-963e-5d8e8c52054e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:31.396413 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51ad5823-8e4d-4c32-963e-5d8e8c52054e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1294 microversion: 2.1 time: 0.082459 Sep 10 11:23:31.397001 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4212/6108] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:31 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:32.420140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a4e151cd-6b33-4e61-8d79-1cb920b61544 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:32.421172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a4e151cd-6b33-4e61-8d79-1cb920b61544 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:32.429506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4e151cd-6b33-4e61-8d79-1cb920b61544 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:32.430227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4e151cd-6b33-4e61-8d79-1cb920b61544 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:32.430663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4e151cd-6b33-4e61-8d79-1cb920b61544 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:32.431956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4e151cd-6b33-4e61-8d79-1cb920b61544 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:32.432743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4e151cd-6b33-4e61-8d79-1cb920b61544 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:32.433501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a4e151cd-6b33-4e61-8d79-1cb920b61544 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:32.512270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a4e151cd-6b33-4e61-8d79-1cb920b61544 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:32.521596 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a4e151cd-6b33-4e61-8d79-1cb920b61544 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1354 microversion: 2.1 time: 0.105042 Sep 10 11:23:32.522187 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1897/6109] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:32 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:33.544367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73763f70-103e-45b0-abb5-f108541d97f8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:33.545004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-73763f70-103e-45b0-abb5-f108541d97f8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:33.552426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73763f70-103e-45b0-abb5-f108541d97f8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:33.552936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73763f70-103e-45b0-abb5-f108541d97f8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:33.553413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73763f70-103e-45b0-abb5-f108541d97f8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:33.554141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73763f70-103e-45b0-abb5-f108541d97f8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:33.554607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73763f70-103e-45b0-abb5-f108541d97f8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:33.555046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-73763f70-103e-45b0-abb5-f108541d97f8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:33.707840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-73763f70-103e-45b0-abb5-f108541d97f8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:33.716057 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73763f70-103e-45b0-abb5-f108541d97f8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1471 microversion: 2.1 time: 0.175867 Sep 10 11:23:33.716678 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4213/6110] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:33 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:34.205153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-4b4e3782-f6b9-4942-946b-6d7c9667f902 req-a59ca31b-b164-45b0-9326-955de8dc7e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538", "tag": "1e80101e-ee0e-46a5-a184-c9d782a59588"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:23:34.215381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4b4e3782-f6b9-4942-946b-6d7c9667f902 req-a59ca31b-b164-45b0-9326-955de8dc7e96 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:34.215987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4b4e3782-f6b9-4942-946b-6d7c9667f902 req-a59ca31b-b164-45b0-9326-955de8dc7e96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:34.216485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4b4e3782-f6b9-4942-946b-6d7c9667f902 req-a59ca31b-b164-45b0-9326-955de8dc7e96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:34.228667 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-4b4e3782-f6b9-4942-946b-6d7c9667f902 req-a59ca31b-b164-45b0-9326-955de8dc7e96 service nova] Creating event network-changed:1e80101e-ee0e-46a5-a184-c9d782a59588 for instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 on n-h1-856894-1 Sep 10 11:23:34.233624 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-4b4e3782-f6b9-4942-946b-6d7c9667f902 req-a59ca31b-b164-45b0-9326-955de8dc7e96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104956 Sep 10 11:23:34.234379 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1898/6111] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:23:34.740238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-af89508d-7d41-4730-996d-cd3d7e369bf7 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:34.740883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-af89508d-7d41-4730-996d-cd3d7e369bf7 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:34.747581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af89508d-7d41-4730-996d-cd3d7e369bf7 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:34.748091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af89508d-7d41-4730-996d-cd3d7e369bf7 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:34.748551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af89508d-7d41-4730-996d-cd3d7e369bf7 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:34.749296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af89508d-7d41-4730-996d-cd3d7e369bf7 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:34.749773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af89508d-7d41-4730-996d-cd3d7e369bf7 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:34.750220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-af89508d-7d41-4730-996d-cd3d7e369bf7 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:34.894452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-af89508d-7d41-4730-996d-cd3d7e369bf7 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:34.902200 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-af89508d-7d41-4730-996d-cd3d7e369bf7 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1471 microversion: 2.1 time: 0.166737 Sep 10 11:23:34.902786 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4214/6112] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:34 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:35.927056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-99a6bc9c-dfc9-434d-8757-6b389850dfc4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:35.928315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-99a6bc9c-dfc9-434d-8757-6b389850dfc4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:35.938283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6bc9c-dfc9-434d-8757-6b389850dfc4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:35.938894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6bc9c-dfc9-434d-8757-6b389850dfc4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:35.939345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6bc9c-dfc9-434d-8757-6b389850dfc4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:35.940048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6bc9c-dfc9-434d-8757-6b389850dfc4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:35.940513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6bc9c-dfc9-434d-8757-6b389850dfc4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:35.940972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6bc9c-dfc9-434d-8757-6b389850dfc4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:36.078631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-99a6bc9c-dfc9-434d-8757-6b389850dfc4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:36.086428 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-99a6bc9c-dfc9-434d-8757-6b389850dfc4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1471 microversion: 2.1 time: 0.164461 Sep 10 11:23:36.087000 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1899/6113] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:35 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:37.109421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f480a40-e871-49b3-88b4-e4bd4075c338 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:37.110101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f480a40-e871-49b3-88b4-e4bd4075c338 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:37.117435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f480a40-e871-49b3-88b4-e4bd4075c338 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:37.117965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f480a40-e871-49b3-88b4-e4bd4075c338 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:37.118420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f480a40-e871-49b3-88b4-e4bd4075c338 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:37.119140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f480a40-e871-49b3-88b4-e4bd4075c338 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:37.119615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f480a40-e871-49b3-88b4-e4bd4075c338 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:37.120060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f480a40-e871-49b3-88b4-e4bd4075c338 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:37.261188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f480a40-e871-49b3-88b4-e4bd4075c338 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:37.269253 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f480a40-e871-49b3-88b4-e4bd4075c338 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1471 microversion: 2.1 time: 0.163834 Sep 10 11:23:37.269855 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4215/6114] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:37 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:38.293660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-da993bb9-63a4-4337-89ba-6c5b46d6a6e1 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:38.294282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-da993bb9-63a4-4337-89ba-6c5b46d6a6e1 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:38.301167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da993bb9-63a4-4337-89ba-6c5b46d6a6e1 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:38.301704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da993bb9-63a4-4337-89ba-6c5b46d6a6e1 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:38.302126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da993bb9-63a4-4337-89ba-6c5b46d6a6e1 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:38.302816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da993bb9-63a4-4337-89ba-6c5b46d6a6e1 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:38.303267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da993bb9-63a4-4337-89ba-6c5b46d6a6e1 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:38.303691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da993bb9-63a4-4337-89ba-6c5b46d6a6e1 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:38.450581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-da993bb9-63a4-4337-89ba-6c5b46d6a6e1 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:38.459562 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-da993bb9-63a4-4337-89ba-6c5b46d6a6e1 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1471 microversion: 2.1 time: 0.169544 Sep 10 11:23:38.460446 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1900/6115] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:38 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:39.485325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f6f0df80-7a63-44ae-95db-91db3fb9233a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:39.485919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f6f0df80-7a63-44ae-95db-91db3fb9233a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:39.493517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f0df80-7a63-44ae-95db-91db3fb9233a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:39.494023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f0df80-7a63-44ae-95db-91db3fb9233a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:39.494481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f0df80-7a63-44ae-95db-91db3fb9233a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:39.495190 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f0df80-7a63-44ae-95db-91db3fb9233a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:39.495664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f0df80-7a63-44ae-95db-91db3fb9233a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:39.496112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f6f0df80-7a63-44ae-95db-91db3fb9233a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:39.635486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f6f0df80-7a63-44ae-95db-91db3fb9233a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:39.643237 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f6f0df80-7a63-44ae-95db-91db3fb9233a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1471 microversion: 2.1 time: 0.162025 Sep 10 11:23:39.643859 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4216/6116] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:39 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:40.401853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-096c1402-54e6-44af-9bc3-bb90b534ebd1 req-dae87a29-8d20-4287-bbe1-934848c4ddd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538", "name": "network-vif-plugged", "status": "completed", "tag": "1e80101e-ee0e-46a5-a184-c9d782a59588"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:23:40.407047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:40.408854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:40.420183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-096c1402-54e6-44af-9bc3-bb90b534ebd1 req-dae87a29-8d20-4287-bbe1-934848c4ddd6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:40.420660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-096c1402-54e6-44af-9bc3-bb90b534ebd1 req-dae87a29-8d20-4287-bbe1-934848c4ddd6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:40.421161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-096c1402-54e6-44af-9bc3-bb90b534ebd1 req-dae87a29-8d20-4287-bbe1-934848c4ddd6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:40.432056 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-096c1402-54e6-44af-9bc3-bb90b534ebd1 req-dae87a29-8d20-4287-bbe1-934848c4ddd6 service nova] Creating event network-vif-plugged:1e80101e-ee0e-46a5-a184-c9d782a59588 for instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 on n-h1-856894-1 Sep 10 11:23:40.437722 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-096c1402-54e6-44af-9bc3-bb90b534ebd1 req-dae87a29-8d20-4287-bbe1-934848c4ddd6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039621 Sep 10 11:23:40.438540 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1901/6117] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:23:40.666322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-493dab26-e962-42b9-9cc7-047b72a5ab27 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:40.666952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-493dab26-e962-42b9-9cc7-047b72a5ab27 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:40.674201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-493dab26-e962-42b9-9cc7-047b72a5ab27 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:40.674702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-493dab26-e962-42b9-9cc7-047b72a5ab27 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:40.675154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-493dab26-e962-42b9-9cc7-047b72a5ab27 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:40.675869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-493dab26-e962-42b9-9cc7-047b72a5ab27 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:40.676371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-493dab26-e962-42b9-9cc7-047b72a5ab27 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:40.676823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-493dab26-e962-42b9-9cc7-047b72a5ab27 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:40.815608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-493dab26-e962-42b9-9cc7-047b72a5ab27 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:40.823370 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-493dab26-e962-42b9-9cc7-047b72a5ab27 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1471 microversion: 2.1 time: 0.160991 Sep 10 11:23:40.823953 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4217/6118] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:40 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:41.846567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-32a06e0a-a419-427e-a34f-4352e11d4adf tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:41.847300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-32a06e0a-a419-427e-a34f-4352e11d4adf tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:41.854893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32a06e0a-a419-427e-a34f-4352e11d4adf tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:41.855373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32a06e0a-a419-427e-a34f-4352e11d4adf tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:41.855805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32a06e0a-a419-427e-a34f-4352e11d4adf tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:41.856483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32a06e0a-a419-427e-a34f-4352e11d4adf tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:41.856932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32a06e0a-a419-427e-a34f-4352e11d4adf tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:41.857375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32a06e0a-a419-427e-a34f-4352e11d4adf tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:41.997600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-32a06e0a-a419-427e-a34f-4352e11d4adf tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:42.005599 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-32a06e0a-a419-427e-a34f-4352e11d4adf tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1643 microversion: 2.1 time: 0.163191 Sep 10 11:23:42.006172 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1902/6119] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:41 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1643 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:23:42.028038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5dbb694a-c2b8-4243-82ef-100a8e3b26de tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:42.028677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5dbb694a-c2b8-4243-82ef-100a8e3b26de tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:42.030595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:42.037418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dbb694a-c2b8-4243-82ef-100a8e3b26de tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:42.037931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dbb694a-c2b8-4243-82ef-100a8e3b26de tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:42.038392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dbb694a-c2b8-4243-82ef-100a8e3b26de tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:42.039107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dbb694a-c2b8-4243-82ef-100a8e3b26de tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:42.039584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dbb694a-c2b8-4243-82ef-100a8e3b26de tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:42.040034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5dbb694a-c2b8-4243-82ef-100a8e3b26de tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:42.180321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5dbb694a-c2b8-4243-82ef-100a8e3b26de tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:23:42.188321 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5dbb694a-c2b8-4243-82ef-100a8e3b26de tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1643 microversion: 2.1 time: 0.164162 Sep 10 11:23:42.188848 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4218/6120] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:42 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1643 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:23:42.210420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9c870871-e239-4d03-aac4-b6586a46b61f tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:23:42.211055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9c870871-e239-4d03-aac4-b6586a46b61f tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:23:42.217466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c870871-e239-4d03-aac4-b6586a46b61f tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:42.217961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c870871-e239-4d03-aac4-b6586a46b61f tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:42.218386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c870871-e239-4d03-aac4-b6586a46b61f tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:42.219076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c870871-e239-4d03-aac4-b6586a46b61f tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:42.219535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c870871-e239-4d03-aac4-b6586a46b61f tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:42.219973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c870871-e239-4d03-aac4-b6586a46b61f tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:42.456057 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9c870871-e239-4d03-aac4-b6586a46b61f tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1794 microversion: 2.1 time: 0.249610 Sep 10 11:23:42.456634 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1903/6121] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:23:42 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1794 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:23:44.028900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9a433593-f61b-49b3-9f40-3bd4b8ecf8b0 req-11cd5c43-eb5e-4bef-9f2e-416020a27d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538", "tag": "1e80101e-ee0e-46a5-a184-c9d782a59588"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:23:44.035496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:23:44.041564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9a433593-f61b-49b3-9f40-3bd4b8ecf8b0 req-11cd5c43-eb5e-4bef-9f2e-416020a27d28 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:23:44.042056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9a433593-f61b-49b3-9f40-3bd4b8ecf8b0 req-11cd5c43-eb5e-4bef-9f2e-416020a27d28 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:23:44.042892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9a433593-f61b-49b3-9f40-3bd4b8ecf8b0 req-11cd5c43-eb5e-4bef-9f2e-416020a27d28 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:23:44.059145 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9a433593-f61b-49b3-9f40-3bd4b8ecf8b0 req-11cd5c43-eb5e-4bef-9f2e-416020a27d28 service nova] Creating event network-changed:1e80101e-ee0e-46a5-a184-c9d782a59588 for instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 on n-h1-856894-1 Sep 10 11:23:44.064341 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9a433593-f61b-49b3-9f40-3bd4b8ecf8b0 req-11cd5c43-eb5e-4bef-9f2e-416020a27d28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039247 Sep 10 11:23:44.064971 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4219/6122] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:24:23.790410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-917300546", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "3299951e-b7eb-484b-9c5b-ebebad628589"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1746464735", "security_groups": []}, "os:scheduler_hints": {"different_host": ["521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538"]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:24:23.811805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:24:23.813029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=36 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:24:24.141300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] validate_networks() for [('3299951e-b7eb-484b-9c5b-ebebad628589', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:24:24.604034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:24:24.604467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:24:24.604947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:24:24.605387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:24:24.605805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:24:24.615860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:24.616358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:24.616798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:24.617742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:24.618211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:24.618642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:24.637011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Getting quotas for project 061d848620004929b582404ad433e631. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:24:24.642567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Getting quotas for user e7cbe668df7c4eadaf538a69da01cbbc and project 061d848620004929b582404ad433e631. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:24:24.655603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:24:24.658405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:24:24.712965 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-49bc20df-7e46-44cf-8886-98c73a759937 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.927902 Sep 10 11:24:24.714068 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1904/6123] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:24:23 2022] POST /compute/v2.1/servers => generated 361 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:24:24.726808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-09f19b4c-40ff-4b2e-b8d7-27408c259452 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:24.728292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-09f19b4c-40ff-4b2e-b8d7-27408c259452 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:24.736590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=38 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:24:24.895989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-09f19b4c-40ff-4b2e-b8d7-27408c259452 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:24.905341 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-09f19b4c-40ff-4b2e-b8d7-27408c259452 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1241 microversion: 2.1 time: 0.183908 Sep 10 11:24:24.906584 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4220/6124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:24 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1241 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:25.931596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dc8ec51f-80f6-4c1c-b60b-107802e99f26 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:25.932215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dc8ec51f-80f6-4c1c-b60b-107802e99f26 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:25.939352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8ec51f-80f6-4c1c-b60b-107802e99f26 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:25.940042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8ec51f-80f6-4c1c-b60b-107802e99f26 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:25.940491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8ec51f-80f6-4c1c-b60b-107802e99f26 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:25.941225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8ec51f-80f6-4c1c-b60b-107802e99f26 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:25.941684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8ec51f-80f6-4c1c-b60b-107802e99f26 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:25.942114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc8ec51f-80f6-4c1c-b60b-107802e99f26 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:26.009969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dc8ec51f-80f6-4c1c-b60b-107802e99f26 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:26.018592 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dc8ec51f-80f6-4c1c-b60b-107802e99f26 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1293 microversion: 2.1 time: 0.092855 Sep 10 11:24:26.019931 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1905/6125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:25 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:27.046535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0ae01983-a9c5-43bb-a76c-e134502e8880 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:27.047095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0ae01983-a9c5-43bb-a76c-e134502e8880 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:27.054916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ae01983-a9c5-43bb-a76c-e134502e8880 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:27.055414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ae01983-a9c5-43bb-a76c-e134502e8880 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:27.055866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ae01983-a9c5-43bb-a76c-e134502e8880 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:27.056572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ae01983-a9c5-43bb-a76c-e134502e8880 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:27.057036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ae01983-a9c5-43bb-a76c-e134502e8880 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:27.057498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ae01983-a9c5-43bb-a76c-e134502e8880 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:27.175716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0ae01983-a9c5-43bb-a76c-e134502e8880 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:27.183628 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0ae01983-a9c5-43bb-a76c-e134502e8880 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1299 microversion: 2.1 time: 0.141345 Sep 10 11:24:27.184214 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4221/6126] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:27 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:27.448882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7b50a572-84ff-4bd0-80dd-fd0d62918b79 req-70f145f7-0bd3-4046-bc45-7b74b78e1282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb0f61d-5861-4b7a-9380-0c1c8c72010e", "tag": "0a4cd089-efe3-4bb0-b284-2474dc81e641"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:24:27.466462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7b50a572-84ff-4bd0-80dd-fd0d62918b79 req-70f145f7-0bd3-4046-bc45-7b74b78e1282 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:27.467076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7b50a572-84ff-4bd0-80dd-fd0d62918b79 req-70f145f7-0bd3-4046-bc45-7b74b78e1282 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:27.467929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7b50a572-84ff-4bd0-80dd-fd0d62918b79 req-70f145f7-0bd3-4046-bc45-7b74b78e1282 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:27.482698 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7b50a572-84ff-4bd0-80dd-fd0d62918b79 req-70f145f7-0bd3-4046-bc45-7b74b78e1282 service nova] Creating event network-changed:0a4cd089-efe3-4bb0-b284-2474dc81e641 for instance bdb0f61d-5861-4b7a-9380-0c1c8c72010e on n-h2-856894-1 Sep 10 11:24:27.487941 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-7b50a572-84ff-4bd0-80dd-fd0d62918b79 req-70f145f7-0bd3-4046-bc45-7b74b78e1282 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044004 Sep 10 11:24:27.488575 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1906/6127] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:24:28.207973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c147527f-d6df-427d-b9d8-97cb6f71d521 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:28.208536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c147527f-d6df-427d-b9d8-97cb6f71d521 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:28.215450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c147527f-d6df-427d-b9d8-97cb6f71d521 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:28.215947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c147527f-d6df-427d-b9d8-97cb6f71d521 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:28.216398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c147527f-d6df-427d-b9d8-97cb6f71d521 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:28.217117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c147527f-d6df-427d-b9d8-97cb6f71d521 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:28.217585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c147527f-d6df-427d-b9d8-97cb6f71d521 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:28.218023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c147527f-d6df-427d-b9d8-97cb6f71d521 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:28.297989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c147527f-d6df-427d-b9d8-97cb6f71d521 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:28.306494 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c147527f-d6df-427d-b9d8-97cb6f71d521 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1299 microversion: 2.1 time: 0.102560 Sep 10 11:24:28.307076 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4222/6128] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:28 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:29.330444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-337f8dde-8901-404b-9fe8-b7d91bc54466 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:29.331250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-337f8dde-8901-404b-9fe8-b7d91bc54466 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:29.338532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337f8dde-8901-404b-9fe8-b7d91bc54466 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:29.339391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337f8dde-8901-404b-9fe8-b7d91bc54466 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:29.340159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337f8dde-8901-404b-9fe8-b7d91bc54466 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:29.340967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337f8dde-8901-404b-9fe8-b7d91bc54466 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:29.341458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337f8dde-8901-404b-9fe8-b7d91bc54466 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:29.341888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337f8dde-8901-404b-9fe8-b7d91bc54466 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:29.423628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-337f8dde-8901-404b-9fe8-b7d91bc54466 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:29.431896 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-337f8dde-8901-404b-9fe8-b7d91bc54466 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1299 microversion: 2.1 time: 0.106613 Sep 10 11:24:29.432481 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1907/6129] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:29 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:30.454935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ae9682a-5dd4-4705-ae51-4b5789fccac8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:30.455601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ae9682a-5dd4-4705-ae51-4b5789fccac8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:30.463321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ae9682a-5dd4-4705-ae51-4b5789fccac8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:30.463831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ae9682a-5dd4-4705-ae51-4b5789fccac8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:30.464292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ae9682a-5dd4-4705-ae51-4b5789fccac8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:30.465014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ae9682a-5dd4-4705-ae51-4b5789fccac8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:30.465643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ae9682a-5dd4-4705-ae51-4b5789fccac8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:30.466012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ae9682a-5dd4-4705-ae51-4b5789fccac8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:30.549851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5ae9682a-5dd4-4705-ae51-4b5789fccac8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:30.558243 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ae9682a-5dd4-4705-ae51-4b5789fccac8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1299 microversion: 2.1 time: 0.107305 Sep 10 11:24:30.558821 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4223/6130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:30 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:31.581449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d7229e2e-38af-42e8-9b5d-20ecb1e9281a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:31.582070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d7229e2e-38af-42e8-9b5d-20ecb1e9281a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:31.589585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7229e2e-38af-42e8-9b5d-20ecb1e9281a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:31.590071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7229e2e-38af-42e8-9b5d-20ecb1e9281a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:31.590504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7229e2e-38af-42e8-9b5d-20ecb1e9281a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:31.591193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7229e2e-38af-42e8-9b5d-20ecb1e9281a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:31.591646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7229e2e-38af-42e8-9b5d-20ecb1e9281a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:31.592075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7229e2e-38af-42e8-9b5d-20ecb1e9281a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:31.676648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d7229e2e-38af-42e8-9b5d-20ecb1e9281a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:31.684424 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d7229e2e-38af-42e8-9b5d-20ecb1e9281a tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1299 microversion: 2.1 time: 0.106925 Sep 10 11:24:31.684991 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1908/6131] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:31 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:32.559032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c8f49889-de4c-48a9-a84a-6f5c1242bc2d req-c64cd993-f9fa-470a-8bd4-11f21b7cc043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb0f61d-5861-4b7a-9380-0c1c8c72010e", "name": "network-vif-plugged", "status": "completed", "tag": "0a4cd089-efe3-4bb0-b284-2474dc81e641"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:24:32.569795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c8f49889-de4c-48a9-a84a-6f5c1242bc2d req-c64cd993-f9fa-470a-8bd4-11f21b7cc043 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:32.570295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c8f49889-de4c-48a9-a84a-6f5c1242bc2d req-c64cd993-f9fa-470a-8bd4-11f21b7cc043 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:32.570745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c8f49889-de4c-48a9-a84a-6f5c1242bc2d req-c64cd993-f9fa-470a-8bd4-11f21b7cc043 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:32.581936 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c8f49889-de4c-48a9-a84a-6f5c1242bc2d req-c64cd993-f9fa-470a-8bd4-11f21b7cc043 service nova] Creating event network-vif-plugged:0a4cd089-efe3-4bb0-b284-2474dc81e641 for instance bdb0f61d-5861-4b7a-9380-0c1c8c72010e on n-h2-856894-1 Sep 10 11:24:32.587319 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c8f49889-de4c-48a9-a84a-6f5c1242bc2d req-c64cd993-f9fa-470a-8bd4-11f21b7cc043 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032485 Sep 10 11:24:32.587926 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4224/6132] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:24:32.707176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7d7ef4e1-2589-4c47-92a9-2c4145f343f3 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:32.707792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7d7ef4e1-2589-4c47-92a9-2c4145f343f3 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:32.716932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d7ef4e1-2589-4c47-92a9-2c4145f343f3 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:32.717714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d7ef4e1-2589-4c47-92a9-2c4145f343f3 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:32.718393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d7ef4e1-2589-4c47-92a9-2c4145f343f3 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:32.719465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d7ef4e1-2589-4c47-92a9-2c4145f343f3 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:32.720173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d7ef4e1-2589-4c47-92a9-2c4145f343f3 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:32.720852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d7ef4e1-2589-4c47-92a9-2c4145f343f3 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:32.817204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7d7ef4e1-2589-4c47-92a9-2c4145f343f3 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:32.824962 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7d7ef4e1-2589-4c47-92a9-2c4145f343f3 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1299 microversion: 2.1 time: 0.121703 Sep 10 11:24:32.825566 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1909/6133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:32 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:33.849746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53c48b12-f414-4e53-a1b6-fe5fe504f02e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:33.850470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53c48b12-f414-4e53-a1b6-fe5fe504f02e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:33.857290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53c48b12-f414-4e53-a1b6-fe5fe504f02e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:33.857803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53c48b12-f414-4e53-a1b6-fe5fe504f02e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:33.858263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53c48b12-f414-4e53-a1b6-fe5fe504f02e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:33.859087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53c48b12-f414-4e53-a1b6-fe5fe504f02e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:33.859467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53c48b12-f414-4e53-a1b6-fe5fe504f02e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:33.859904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53c48b12-f414-4e53-a1b6-fe5fe504f02e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:33.947611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53c48b12-f414-4e53-a1b6-fe5fe504f02e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:33.955986 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53c48b12-f414-4e53-a1b6-fe5fe504f02e tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1299 microversion: 2.1 time: 0.111919 Sep 10 11:24:33.956579 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4225/6134] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:33 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:34.980458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e3248f8-35fc-4082-9909-7e418d27d25c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:34.981119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1e3248f8-35fc-4082-9909-7e418d27d25c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:34.983994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:24:34.984902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:24:34.991310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3248f8-35fc-4082-9909-7e418d27d25c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:34.991799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3248f8-35fc-4082-9909-7e418d27d25c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:34.992239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3248f8-35fc-4082-9909-7e418d27d25c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:34.992935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3248f8-35fc-4082-9909-7e418d27d25c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:34.993416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3248f8-35fc-4082-9909-7e418d27d25c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:34.993852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3248f8-35fc-4082-9909-7e418d27d25c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.091178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1e3248f8-35fc-4082-9909-7e418d27d25c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:35.099518 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1e3248f8-35fc-4082-9909-7e418d27d25c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1471 microversion: 2.1 time: 0.122533 Sep 10 11:24:35.100773 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1910/6135] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:34 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1471 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:35.122367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aab2eaaa-b964-4946-b6de-0fafe77377e8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:35.123010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aab2eaaa-b964-4946-b6de-0fafe77377e8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:35.125544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:24:35.131169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aab2eaaa-b964-4946-b6de-0fafe77377e8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:35.131671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aab2eaaa-b964-4946-b6de-0fafe77377e8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:35.132178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aab2eaaa-b964-4946-b6de-0fafe77377e8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.132898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aab2eaaa-b964-4946-b6de-0fafe77377e8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:35.133403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aab2eaaa-b964-4946-b6de-0fafe77377e8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:35.133848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aab2eaaa-b964-4946-b6de-0fafe77377e8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.218888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aab2eaaa-b964-4946-b6de-0fafe77377e8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:35.227507 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aab2eaaa-b964-4946-b6de-0fafe77377e8 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1471 microversion: 2.1 time: 0.109198 Sep 10 11:24:35.228089 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4226/6136] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:35 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1471 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:35.249060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94a33c5f-f97c-4bc0-9a38-23e7cc5d1000 tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:35.249713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-94a33c5f-f97c-4bc0-9a38-23e7cc5d1000 tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:35.255668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94a33c5f-f97c-4bc0-9a38-23e7cc5d1000 tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:35.256146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94a33c5f-f97c-4bc0-9a38-23e7cc5d1000 tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:35.256579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94a33c5f-f97c-4bc0-9a38-23e7cc5d1000 tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.257298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94a33c5f-f97c-4bc0-9a38-23e7cc5d1000 tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:35.257756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94a33c5f-f97c-4bc0-9a38-23e7cc5d1000 tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:35.258182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94a33c5f-f97c-4bc0-9a38-23e7cc5d1000 tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.340605 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-94a33c5f-f97c-4bc0-9a38-23e7cc5d1000 tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1622 microversion: 2.1 time: 0.095169 Sep 10 11:24:35.341221 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1911/6137] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:35 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1622 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:35.365968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a09622d4-9260-471b-9c51-c55c59e4d4bc tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:35.366693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a09622d4-9260-471b-9c51-c55c59e4d4bc tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:35.372874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a09622d4-9260-471b-9c51-c55c59e4d4bc tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:35.373574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a09622d4-9260-471b-9c51-c55c59e4d4bc tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:35.373963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a09622d4-9260-471b-9c51-c55c59e4d4bc tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.374759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a09622d4-9260-471b-9c51-c55c59e4d4bc tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:35.375111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a09622d4-9260-471b-9c51-c55c59e4d4bc tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:35.375606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a09622d4-9260-471b-9c51-c55c59e4d4bc tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.574234 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a09622d4-9260-471b-9c51-c55c59e4d4bc tempest-TestSecurityGroupsBasicOps-1102988253 tempest-TestSecurityGroupsBasicOps-1102988253-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1913 microversion: 2.1 time: 0.212369 Sep 10 11:24:35.574841 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4227/6138] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:35 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1913 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:35.645403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9a2d0bc8-5c05-4660-b180-d517e230d701 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:35.646573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9a2d0bc8-5c05-4660-b180-d517e230d701 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:35.652860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a2d0bc8-5c05-4660-b180-d517e230d701 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:35.653391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a2d0bc8-5c05-4660-b180-d517e230d701 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:35.653828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a2d0bc8-5c05-4660-b180-d517e230d701 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.654517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a2d0bc8-5c05-4660-b180-d517e230d701 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:35.654971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a2d0bc8-5c05-4660-b180-d517e230d701 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:35.655397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a2d0bc8-5c05-4660-b180-d517e230d701 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.683114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9a2d0bc8-5c05-4660-b180-d517e230d701 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:24:35.763634 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9a2d0bc8-5c05-4660-b180-d517e230d701 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 204 len: 0 microversion: 2.1 time: 0.121513 Sep 10 11:24:35.764433 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1912/6139] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:24:35 2022] DELETE /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:24:35.774072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5c19014e-0621-4e8e-8b4d-a5cce8234f7b tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:35.775122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5c19014e-0621-4e8e-8b4d-a5cce8234f7b tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:35.781206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c19014e-0621-4e8e-8b4d-a5cce8234f7b tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:35.781633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c19014e-0621-4e8e-8b4d-a5cce8234f7b tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:35.782059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c19014e-0621-4e8e-8b4d-a5cce8234f7b tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.782764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c19014e-0621-4e8e-8b4d-a5cce8234f7b tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:35.783227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c19014e-0621-4e8e-8b4d-a5cce8234f7b tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:35.783663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c19014e-0621-4e8e-8b4d-a5cce8234f7b tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:35.869263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5c19014e-0621-4e8e-8b4d-a5cce8234f7b tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:35.877052 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5c19014e-0621-4e8e-8b4d-a5cce8234f7b tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1477 microversion: 2.1 time: 0.108256 Sep 10 11:24:35.877651 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4228/6140] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:35 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1477 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:36.900888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-23ae9e50-45ae-45d7-8dde-1d2a8534c04f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:36.901618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-23ae9e50-45ae-45d7-8dde-1d2a8534c04f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:36.908402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23ae9e50-45ae-45d7-8dde-1d2a8534c04f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:36.908881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23ae9e50-45ae-45d7-8dde-1d2a8534c04f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:36.909346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23ae9e50-45ae-45d7-8dde-1d2a8534c04f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:36.910033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23ae9e50-45ae-45d7-8dde-1d2a8534c04f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:36.910480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23ae9e50-45ae-45d7-8dde-1d2a8534c04f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:36.910897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-23ae9e50-45ae-45d7-8dde-1d2a8534c04f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:37.018016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-23ae9e50-45ae-45d7-8dde-1d2a8534c04f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:37.025764 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-23ae9e50-45ae-45d7-8dde-1d2a8534c04f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1477 microversion: 2.1 time: 0.129134 Sep 10 11:24:37.026343 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1913/6141] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:36 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1477 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:37.608807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b45f772e-5035-4aa0-a099-a8a1104ef489 req-6c2cd4e9-4a49-4c1f-958c-126b1cfeeaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb0f61d-5861-4b7a-9380-0c1c8c72010e", "name": "network-vif-deleted", "tag": "0a4cd089-efe3-4bb0-b284-2474dc81e641"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:24:37.620629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b45f772e-5035-4aa0-a099-a8a1104ef489 req-6c2cd4e9-4a49-4c1f-958c-126b1cfeeaa2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:37.621175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b45f772e-5035-4aa0-a099-a8a1104ef489 req-6c2cd4e9-4a49-4c1f-958c-126b1cfeeaa2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:37.621662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b45f772e-5035-4aa0-a099-a8a1104ef489 req-6c2cd4e9-4a49-4c1f-958c-126b1cfeeaa2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:37.634515 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b45f772e-5035-4aa0-a099-a8a1104ef489 req-6c2cd4e9-4a49-4c1f-958c-126b1cfeeaa2 service nova] Creating event network-vif-deleted:0a4cd089-efe3-4bb0-b284-2474dc81e641 for instance bdb0f61d-5861-4b7a-9380-0c1c8c72010e on n-h2-856894-1 Sep 10 11:24:37.640098 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b45f772e-5035-4aa0-a099-a8a1104ef489 req-6c2cd4e9-4a49-4c1f-958c-126b1cfeeaa2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035129 Sep 10 11:24:37.640734 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4229/6142] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:24:38.049539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:38.050162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:38.058210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:38.058701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:38.059148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:38.059842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:38.060301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:38.060728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:38.094310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:38.094801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:38.095245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:38.095702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lazy-loading 'fault' on Instance uuid bdb0f61d-5861-4b7a-9380-0c1c8c72010e {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:24:38.146906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:38.154015 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ede2b5ad-d2e6-4e28-9da2-b1dedf0f19b4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 200 len: 1331 microversion: 2.1 time: 0.108297 Sep 10 11:24:38.154791 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1914/6143] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:38 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:39.176996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:39.177753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: bdb0f61d-5861-4b7a-9380-0c1c8c72010e] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:39.184810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:39.185360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:39.185818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:39.186523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:39.186996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:39.187437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:39.201192 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] HTTP exception thrown: Instance bdb0f61d-5861-4b7a-9380-0c1c8c72010e could not be found. Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Request method failure captured: Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e HTTP/1.1 Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHOpbvT_4CE5WL2c6sUPEu-zSzoAzh4L3C-0Es_EI22kZeOPR0Y7IEyWroPMMc64HUSEoUJP8TB0HhDfLRAc9purwsEKUqvrFTZgpj0CWsrZsd2x_PvpowB-0aho2LLL6t93E-IIaK3Tqdt_fvDKENsaeFZ4MJQg-bP1M37qbIrnTls Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 061d848620004929b582404ad433e631 Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-323487326 Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/061d848620004929b582404ad433e631"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/061d848620004929b582404ad433e631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/061d848620004929b582404ad433e631"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_061d848620004929b582404ad433e631", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestSecurityGroupsBasicOps-323487326 Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 061d848620004929b582404ad433e631 Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-323487326 Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestSecurityGroupsBasicOps-323487326-project Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e7cbe668df7c4eadaf538a69da01cbbc Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestSecurityGroupsBasicOps-323487326-project Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance bdb0f61d-5861-4b7a-9380-0c1c8c72010e could not be found. Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'bdb0f61d-5861-4b7a-9380-0c1c8c72010e'} Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb0f61d-5861-4b7a-9380-0c1c8c72010e could not be found. Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb0f61d-5861-4b7a-9380-0c1c8c72010e could not be found. Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:24:39.202869 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:24:39.208009 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:24:39.208009 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:24:39.208009 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:24:39.208009 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:24:39.208009 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:24:39.208009 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb0f61d-5861-4b7a-9380-0c1c8c72010e could not be found. Sep 10 11:24:39.208009 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:24:39.208009 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Returning 404 to user: Instance bdb0f61d-5861-4b7a-9380-0c1c8c72010e could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:24:39.208009 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56f69c50-5c82-4c1a-abe3-7eee0f074f6c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e" status: 404 len: 111 microversion: 2.1 time: 0.031626 Sep 10 11:24:39.208009 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4230/6144] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:39 2022] GET /compute/v2.1/servers/bdb0f61d-5861-4b7a-9380-0c1c8c72010e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:24:43.104861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3f9932f1-0ce4-492f-bf3a-4698035d7a0c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:43.105547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3f9932f1-0ce4-492f-bf3a-4698035d7a0c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:43.106631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-61cfd8ee-fe42-4b5f-93d1-7fb2e4fd511c req-981f04bb-3b8e-4b90-8d24-edb3a7f15bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538", "tag": "1e80101e-ee0e-46a5-a184-c9d782a59588"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:24:43.113439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f9932f1-0ce4-492f-bf3a-4698035d7a0c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:43.114214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f9932f1-0ce4-492f-bf3a-4698035d7a0c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:43.115465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f9932f1-0ce4-492f-bf3a-4698035d7a0c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:43.116246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f9932f1-0ce4-492f-bf3a-4698035d7a0c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:43.116697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f9932f1-0ce4-492f-bf3a-4698035d7a0c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:43.117325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3f9932f1-0ce4-492f-bf3a-4698035d7a0c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:43.118683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-61cfd8ee-fe42-4b5f-93d1-7fb2e4fd511c req-981f04bb-3b8e-4b90-8d24-edb3a7f15bb6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:43.119172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-61cfd8ee-fe42-4b5f-93d1-7fb2e4fd511c req-981f04bb-3b8e-4b90-8d24-edb3a7f15bb6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:43.119620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-61cfd8ee-fe42-4b5f-93d1-7fb2e4fd511c req-981f04bb-3b8e-4b90-8d24-edb3a7f15bb6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:43.131606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-61cfd8ee-fe42-4b5f-93d1-7fb2e4fd511c req-981f04bb-3b8e-4b90-8d24-edb3a7f15bb6 service nova] Creating event network-changed:1e80101e-ee0e-46a5-a184-c9d782a59588 for instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 on n-h1-856894-1 Sep 10 11:24:43.136818 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-61cfd8ee-fe42-4b5f-93d1-7fb2e4fd511c req-981f04bb-3b8e-4b90-8d24-edb3a7f15bb6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033907 Sep 10 11:24:43.137473 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4231/6145] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:24:43.150083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3f9932f1-0ce4-492f-bf3a-4698035d7a0c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:24:43.232638 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3f9932f1-0ce4-492f-bf3a-4698035d7a0c tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "DELETE /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 204 len: 0 microversion: 2.1 time: 0.131338 Sep 10 11:24:43.233759 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1915/6146] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:24:43 2022] DELETE /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:24:43.245090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19157f6d-1da5-43a4-9f27-b260b0aecd19 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:43.245824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-19157f6d-1da5-43a4-9f27-b260b0aecd19 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:43.252589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19157f6d-1da5-43a4-9f27-b260b0aecd19 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:43.253133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19157f6d-1da5-43a4-9f27-b260b0aecd19 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:43.253928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19157f6d-1da5-43a4-9f27-b260b0aecd19 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:43.254661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19157f6d-1da5-43a4-9f27-b260b0aecd19 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:43.255168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19157f6d-1da5-43a4-9f27-b260b0aecd19 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:43.255613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19157f6d-1da5-43a4-9f27-b260b0aecd19 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:43.403883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19157f6d-1da5-43a4-9f27-b260b0aecd19 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:43.412498 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-19157f6d-1da5-43a4-9f27-b260b0aecd19 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1768 microversion: 2.1 time: 0.172560 Sep 10 11:24:43.413145 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4232/6147] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:43 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1768 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:44.436419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aa4d68cf-d325-477f-b1e6-76757cf89d13 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:44.437141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-aa4d68cf-d325-477f-b1e6-76757cf89d13 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:44.444073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa4d68cf-d325-477f-b1e6-76757cf89d13 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:44.444548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa4d68cf-d325-477f-b1e6-76757cf89d13 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:44.444983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa4d68cf-d325-477f-b1e6-76757cf89d13 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:44.445719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa4d68cf-d325-477f-b1e6-76757cf89d13 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:44.446174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa4d68cf-d325-477f-b1e6-76757cf89d13 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:44.446596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa4d68cf-d325-477f-b1e6-76757cf89d13 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:44.689441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-aa4d68cf-d325-477f-b1e6-76757cf89d13 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7cbe668df7c4eadaf538a69da01cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061d848620004929b582404ad433e631', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:44.697709 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aa4d68cf-d325-477f-b1e6-76757cf89d13 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 200 len: 1768 microversion: 2.1 time: 0.265517 Sep 10 11:24:44.698571 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1916/6148] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:44 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 1768 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:45.022516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-d00987f3-1cad-47cc-af8f-af476bba548f req-4a2cf751-502b-430c-bfe5-a2fc2ce11475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538", "name": "network-vif-deleted", "tag": "1e80101e-ee0e-46a5-a184-c9d782a59588"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:24:45.032963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d00987f3-1cad-47cc-af8f-af476bba548f req-4a2cf751-502b-430c-bfe5-a2fc2ce11475 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:45.033502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d00987f3-1cad-47cc-af8f-af476bba548f req-4a2cf751-502b-430c-bfe5-a2fc2ce11475 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:45.033955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-d00987f3-1cad-47cc-af8f-af476bba548f req-4a2cf751-502b-430c-bfe5-a2fc2ce11475 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:45.046338 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-d00987f3-1cad-47cc-af8f-af476bba548f req-4a2cf751-502b-430c-bfe5-a2fc2ce11475 service nova] Creating event network-vif-deleted:1e80101e-ee0e-46a5-a184-c9d782a59588 for instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 on n-h1-856894-1 Sep 10 11:24:45.051103 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-d00987f3-1cad-47cc-af8f-af476bba548f req-4a2cf751-502b-430c-bfe5-a2fc2ce11475 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032951 Sep 10 11:24:45.051714 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4233/6149] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:24:45.723473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:45.725931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] [instance: 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:45.732966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:45.733491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:45.733927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:45.734656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:45.735112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:45.735535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:45.749271 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] HTTP exception thrown: Instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 could not be found. Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Request method failure captured: Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 HTTP/1.1 Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHOpbvT_4CE5WL2c6sUPEu-zSzoAzh4L3C-0Es_EI22kZeOPR0Y7IEyWroPMMc64HUSEoUJP8TB0HhDfLRAc9purwsEKUqvrFTZgpj0CWsrZsd2x_PvpowB-0aho2LLL6t93E-IIaK3Tqdt_fvDKENsaeFZ4MJQg-bP1M37qbIrnTls Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 061d848620004929b582404ad433e631 Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-323487326 Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/061d848620004929b582404ad433e631"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/061d848620004929b582404ad433e631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/061d848620004929b582404ad433e631"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_061d848620004929b582404ad433e631", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestSecurityGroupsBasicOps-323487326 Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 061d848620004929b582404ad433e631 Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-323487326 Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestSecurityGroupsBasicOps-323487326-project Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e7cbe668df7c4eadaf538a69da01cbbc Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestSecurityGroupsBasicOps-323487326-project Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 could not be found. Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538'} Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 could not be found. Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 could not be found. Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:24:45.750913 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:24:45.756933 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:24:45.756933 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:24:45.756933 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:24:45.756933 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:24:45.756933 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:24:45.756933 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 could not be found. Sep 10 11:24:45.756933 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:24:45.756933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Returning 404 to user: Instance 521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:24:45.756933 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-92965578-be86-471f-897c-3cd1038d68a4 tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538" status: 404 len: 111 microversion: 2.1 time: 0.032766 Sep 10 11:24:45.756933 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1917/6150] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:45 2022] GET /compute/v2.1/servers/521f2cbc-5b0c-4cdc-9e6e-7ad20f9d5538 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:24:49.096720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1bbb5686-2382-4844-b9b0-1f11f2b1960f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] Calling method '.version_select at 0x7efcad32e430>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:49.123111 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1bbb5686-2382-4844-b9b0-1f11f2b1960f tempest-TestSecurityGroupsBasicOps-323487326 tempest-TestSecurityGroupsBasicOps-323487326-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1746464735" status: 202 len: 0 microversion: 2.1 time: 0.031965 Sep 10 11:24:49.123731 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4234/6151] 10.222.0.20 () {58 vars in 1278 bytes} [Sat Sep 10 11:24:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1746464735 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:24:53.493313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1053792910", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "e43590a4-2531-494d-b8c1-472f47b0b204"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:24:53.551959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] validate_networks() for [('e43590a4-2531-494d-b8c1-472f47b0b204', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:24:53.913691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:24:53.914095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:24:53.914578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:24:53.914994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:24:53.915414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:24:53.917516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:24:53.927973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:53.928455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:53.928900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:53.929662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:53.930123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:53.930549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:53.937714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:24:53.951497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Getting quotas for project 7c8c0b4357304996b4d7e83353b13759. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:24:53.956819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Getting quotas for user 21a58fca265b49bea888fd1b8de151b8 and project 7c8c0b4357304996b4d7e83353b13759. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:24:53.969273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:24:53.971574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:24:54.017211 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ee0cd793-9d35-4008-a195-ec2a17f864fc tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646787 Sep 10 11:24:54.017868 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1918/6152] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:24:54.029963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-491be842-e0a8-4e13-8bab-fdba52991bcb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:54.030757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-491be842-e0a8-4e13-8bab-fdba52991bcb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:54.086426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-491be842-e0a8-4e13-8bab-fdba52991bcb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:54.093481 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-491be842-e0a8-4e13-8bab-fdba52991bcb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1215 microversion: 2.1 time: 0.068300 Sep 10 11:24:54.094065 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4235/6153] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:54 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:55.117342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-75e11d52-87c0-4720-8a9f-75d3c10f16e7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:55.118623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-75e11d52-87c0-4720-8a9f-75d3c10f16e7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:55.125859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75e11d52-87c0-4720-8a9f-75d3c10f16e7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:55.126658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75e11d52-87c0-4720-8a9f-75d3c10f16e7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:55.127193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75e11d52-87c0-4720-8a9f-75d3c10f16e7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:55.128197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75e11d52-87c0-4720-8a9f-75d3c10f16e7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:55.128732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75e11d52-87c0-4720-8a9f-75d3c10f16e7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:55.129269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-75e11d52-87c0-4720-8a9f-75d3c10f16e7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:55.233247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-75e11d52-87c0-4720-8a9f-75d3c10f16e7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:55.241685 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-75e11d52-87c0-4720-8a9f-75d3c10f16e7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1275 microversion: 2.1 time: 0.129222 Sep 10 11:24:55.242261 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1919/6154] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:55 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1275 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:56.265668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a9a7ca86-41ea-4d52-8fea-cb1810c32088 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:56.266347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a9a7ca86-41ea-4d52-8fea-cb1810c32088 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:56.269446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=58 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:24:56.270187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:24:56.277222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a7ca86-41ea-4d52-8fea-cb1810c32088 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:56.277739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a7ca86-41ea-4d52-8fea-cb1810c32088 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:56.278209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a7ca86-41ea-4d52-8fea-cb1810c32088 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:56.278927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a7ca86-41ea-4d52-8fea-cb1810c32088 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:56.279435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a7ca86-41ea-4d52-8fea-cb1810c32088 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:56.279881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a9a7ca86-41ea-4d52-8fea-cb1810c32088 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:56.485445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a9a7ca86-41ea-4d52-8fea-cb1810c32088 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:56.494088 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a9a7ca86-41ea-4d52-8fea-cb1810c32088 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1315 microversion: 2.1 time: 0.232336 Sep 10 11:24:56.494681 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4236/6155] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:56 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:56.561307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-a476ba7e-8f7f-4d2b-aa3b-9d2c63c862e1 req-1a7cebb1-173e-4403-8681-243bc6c4df9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec32ed8-8795-481b-8f8c-a702c15f5359", "tag": "ab760e0f-031d-4f01-9fce-9e02cd484576"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:24:56.572396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a476ba7e-8f7f-4d2b-aa3b-9d2c63c862e1 req-1a7cebb1-173e-4403-8681-243bc6c4df9e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:56.572884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a476ba7e-8f7f-4d2b-aa3b-9d2c63c862e1 req-1a7cebb1-173e-4403-8681-243bc6c4df9e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:56.573348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a476ba7e-8f7f-4d2b-aa3b-9d2c63c862e1 req-1a7cebb1-173e-4403-8681-243bc6c4df9e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:56.586967 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-a476ba7e-8f7f-4d2b-aa3b-9d2c63c862e1 req-1a7cebb1-173e-4403-8681-243bc6c4df9e service nova] Creating event network-changed:ab760e0f-031d-4f01-9fce-9e02cd484576 for instance 8ec32ed8-8795-481b-8f8c-a702c15f5359 on n-h2-856894-1 Sep 10 11:24:56.590930 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-a476ba7e-8f7f-4d2b-aa3b-9d2c63c862e1 req-1a7cebb1-173e-4403-8681-243bc6c4df9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033661 Sep 10 11:24:56.591714 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1920/6156] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:24:57.515763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c608b9cf-4386-45c5-8992-860e8f49eaa4 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:57.516410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c608b9cf-4386-45c5-8992-860e8f49eaa4 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:57.524096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c608b9cf-4386-45c5-8992-860e8f49eaa4 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:57.524604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c608b9cf-4386-45c5-8992-860e8f49eaa4 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:57.525061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c608b9cf-4386-45c5-8992-860e8f49eaa4 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:57.525799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c608b9cf-4386-45c5-8992-860e8f49eaa4 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:57.526275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c608b9cf-4386-45c5-8992-860e8f49eaa4 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:57.526726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c608b9cf-4386-45c5-8992-860e8f49eaa4 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:57.757355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c608b9cf-4386-45c5-8992-860e8f49eaa4 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:57.765094 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c608b9cf-4386-45c5-8992-860e8f49eaa4 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1315 microversion: 2.1 time: 0.253195 Sep 10 11:24:57.765696 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4237/6157] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:57 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:58.788686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fe252c1f-8a95-46fa-a61d-603691654a74 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:58.789420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fe252c1f-8a95-46fa-a61d-603691654a74 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:58.796814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe252c1f-8a95-46fa-a61d-603691654a74 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:58.797303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe252c1f-8a95-46fa-a61d-603691654a74 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:58.797747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe252c1f-8a95-46fa-a61d-603691654a74 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:58.798444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe252c1f-8a95-46fa-a61d-603691654a74 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:58.798934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe252c1f-8a95-46fa-a61d-603691654a74 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:58.799365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe252c1f-8a95-46fa-a61d-603691654a74 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:58.934061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe252c1f-8a95-46fa-a61d-603691654a74 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:24:58.941986 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fe252c1f-8a95-46fa-a61d-603691654a74 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1315 microversion: 2.1 time: 0.158158 Sep 10 11:24:58.942603 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1921/6158] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:58 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:24:59.964887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8af8258-4862-4ccd-89b8-8f04cc2d54d2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:24:59.965520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8af8258-4862-4ccd-89b8-8f04cc2d54d2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:24:59.972533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8af8258-4862-4ccd-89b8-8f04cc2d54d2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:59.973037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8af8258-4862-4ccd-89b8-8f04cc2d54d2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:59.973544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8af8258-4862-4ccd-89b8-8f04cc2d54d2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:24:59.974253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8af8258-4862-4ccd-89b8-8f04cc2d54d2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:24:59.974726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8af8258-4862-4ccd-89b8-8f04cc2d54d2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:24:59.975169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8af8258-4862-4ccd-89b8-8f04cc2d54d2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:00.101507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8af8258-4862-4ccd-89b8-8f04cc2d54d2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:00.109683 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8af8258-4862-4ccd-89b8-8f04cc2d54d2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1315 microversion: 2.1 time: 0.148957 Sep 10 11:25:00.110255 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4238/6159] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:24:59 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:01.132441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-00e078d4-d7b0-4e01-b5a7-9bbc441398cb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:01.133047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-00e078d4-d7b0-4e01-b5a7-9bbc441398cb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:01.139840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00e078d4-d7b0-4e01-b5a7-9bbc441398cb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:01.140320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00e078d4-d7b0-4e01-b5a7-9bbc441398cb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:01.140750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00e078d4-d7b0-4e01-b5a7-9bbc441398cb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:01.141468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00e078d4-d7b0-4e01-b5a7-9bbc441398cb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:01.141921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00e078d4-d7b0-4e01-b5a7-9bbc441398cb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:01.142347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-00e078d4-d7b0-4e01-b5a7-9bbc441398cb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:01.278386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-00e078d4-d7b0-4e01-b5a7-9bbc441398cb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:01.286519 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-00e078d4-d7b0-4e01-b5a7-9bbc441398cb tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1315 microversion: 2.1 time: 0.157544 Sep 10 11:25:01.287097 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1922/6160] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:01 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:02.310283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-45ea04ba-2595-438d-aee3-1e74d22050e2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:02.310962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-45ea04ba-2595-438d-aee3-1e74d22050e2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:02.318592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45ea04ba-2595-438d-aee3-1e74d22050e2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:02.319087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45ea04ba-2595-438d-aee3-1e74d22050e2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:02.319533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45ea04ba-2595-438d-aee3-1e74d22050e2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:02.320231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45ea04ba-2595-438d-aee3-1e74d22050e2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:02.320696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45ea04ba-2595-438d-aee3-1e74d22050e2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:02.321169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-45ea04ba-2595-438d-aee3-1e74d22050e2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:02.455648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-45ea04ba-2595-438d-aee3-1e74d22050e2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:02.463662 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-45ea04ba-2595-438d-aee3-1e74d22050e2 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1315 microversion: 2.1 time: 0.157349 Sep 10 11:25:02.464247 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4239/6161] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:02 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:02.541398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-93933502-4d5f-446b-9d49-f757978e22a1 req-b4b5a94f-f880-4279-ae23-2140d2368f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec32ed8-8795-481b-8f8c-a702c15f5359", "name": "network-vif-plugged", "status": "completed", "tag": "ab760e0f-031d-4f01-9fce-9e02cd484576"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:02.553234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-93933502-4d5f-446b-9d49-f757978e22a1 req-b4b5a94f-f880-4279-ae23-2140d2368f8f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:02.553746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-93933502-4d5f-446b-9d49-f757978e22a1 req-b4b5a94f-f880-4279-ae23-2140d2368f8f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:02.554199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-93933502-4d5f-446b-9d49-f757978e22a1 req-b4b5a94f-f880-4279-ae23-2140d2368f8f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:02.566231 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-93933502-4d5f-446b-9d49-f757978e22a1 req-b4b5a94f-f880-4279-ae23-2140d2368f8f service nova] Creating event network-vif-plugged:ab760e0f-031d-4f01-9fce-9e02cd484576 for instance 8ec32ed8-8795-481b-8f8c-a702c15f5359 on n-h2-856894-1 Sep 10 11:25:02.571063 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-93933502-4d5f-446b-9d49-f757978e22a1 req-b4b5a94f-f880-4279-ae23-2140d2368f8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033428 Sep 10 11:25:02.571659 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1923/6162] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:25:03.487888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8695a057-3a4f-4544-87a9-646d9d725eef tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:03.488531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8695a057-3a4f-4544-87a9-646d9d725eef tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:03.492444 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:25:03.492600 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 11:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 (ip 10.222.0.20) !!! Sep 10 11:25:03.503307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8695a057-3a4f-4544-87a9-646d9d725eef tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:03.503810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8695a057-3a4f-4544-87a9-646d9d725eef tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:03.504265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8695a057-3a4f-4544-87a9-646d9d725eef tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:03.505019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8695a057-3a4f-4544-87a9-646d9d725eef tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:03.505515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8695a057-3a4f-4544-87a9-646d9d725eef tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:03.505959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8695a057-3a4f-4544-87a9-646d9d725eef tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:03.635758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8695a057-3a4f-4544-87a9-646d9d725eef tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:03.643494 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8695a057-3a4f-4544-87a9-646d9d725eef tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1315 microversion: 2.1 time: 0.160042 Sep 10 11:25:03.644083 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4240/6163] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:03 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:04.786807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:04.787568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:04.791991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4525af57-281d-4cc7-aae0-8e7ff30bc41a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:04.792696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4525af57-281d-4cc7-aae0-8e7ff30bc41a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:04.800223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4525af57-281d-4cc7-aae0-8e7ff30bc41a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:04.800714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4525af57-281d-4cc7-aae0-8e7ff30bc41a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:04.801260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4525af57-281d-4cc7-aae0-8e7ff30bc41a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:04.801961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4525af57-281d-4cc7-aae0-8e7ff30bc41a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:04.802417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4525af57-281d-4cc7-aae0-8e7ff30bc41a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:04.802845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4525af57-281d-4cc7-aae0-8e7ff30bc41a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:04.937480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4525af57-281d-4cc7-aae0-8e7ff30bc41a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:04.946104 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4525af57-281d-4cc7-aae0-8e7ff30bc41a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1501 microversion: 2.1 time: 0.161100 Sep 10 11:25:04.946631 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1924/6164] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:04 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:04.969306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6142c0df-b948-4a3e-aa63-8fa9f7477d49 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:04.969946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6142c0df-b948-4a3e-aa63-8fa9f7477d49 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:04.972934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:04.978040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6142c0df-b948-4a3e-aa63-8fa9f7477d49 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:04.978543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6142c0df-b948-4a3e-aa63-8fa9f7477d49 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:04.978994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6142c0df-b948-4a3e-aa63-8fa9f7477d49 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:04.979700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6142c0df-b948-4a3e-aa63-8fa9f7477d49 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:04.980167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6142c0df-b948-4a3e-aa63-8fa9f7477d49 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:04.980604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6142c0df-b948-4a3e-aa63-8fa9f7477d49 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:05.115914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6142c0df-b948-4a3e-aa63-8fa9f7477d49 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:05.124209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6142c0df-b948-4a3e-aa63-8fa9f7477d49 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1501 microversion: 2.1 time: 0.158789 Sep 10 11:25:05.125127 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4241/6165] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:04 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:05.147364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6e71619c-21b2-49a8-8c8a-4a01b4dd2ad0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:05.148020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6e71619c-21b2-49a8-8c8a-4a01b4dd2ad0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:05.154600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e71619c-21b2-49a8-8c8a-4a01b4dd2ad0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:05.155404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e71619c-21b2-49a8-8c8a-4a01b4dd2ad0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:05.155850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e71619c-21b2-49a8-8c8a-4a01b4dd2ad0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:05.156948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e71619c-21b2-49a8-8c8a-4a01b4dd2ad0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:05.157184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e71619c-21b2-49a8-8c8a-4a01b4dd2ad0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:05.157807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e71619c-21b2-49a8-8c8a-4a01b4dd2ad0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:05.183107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-6e71619c-21b2-49a8-8c8a-4a01b4dd2ad0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lazy-loading 'flavor' on Instance uuid 8ec32ed8-8795-481b-8f8c-a702c15f5359 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:25:05.250305 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6e71619c-21b2-49a8-8c8a-4a01b4dd2ad0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "POST /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359/action" status: 202 len: 0 microversion: 2.1 time: 0.106710 Sep 10 11:25:05.253302 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1925/6166] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:25:05 2022] POST /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:25:05.259661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-48ff566c-9381-41d7-81d9-38ead6898743 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:05.260288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-48ff566c-9381-41d7-81d9-38ead6898743 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:05.266672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ff566c-9381-41d7-81d9-38ead6898743 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:05.267435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ff566c-9381-41d7-81d9-38ead6898743 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:05.267941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ff566c-9381-41d7-81d9-38ead6898743 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:05.268870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ff566c-9381-41d7-81d9-38ead6898743 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:05.269646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ff566c-9381-41d7-81d9-38ead6898743 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:05.270193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-48ff566c-9381-41d7-81d9-38ead6898743 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:05.412857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-48ff566c-9381-41d7-81d9-38ead6898743 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:05.420996 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-48ff566c-9381-41d7-81d9-38ead6898743 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1509 microversion: 2.1 time: 0.165224 Sep 10 11:25:05.421610 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4242/6167] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:05 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:06.447312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-15561ada-976b-4bb2-aa69-df8e92c13f2c tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:06.448013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-15561ada-976b-4bb2-aa69-df8e92c13f2c tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:06.454209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15561ada-976b-4bb2-aa69-df8e92c13f2c tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:06.454698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15561ada-976b-4bb2-aa69-df8e92c13f2c tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:06.455142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15561ada-976b-4bb2-aa69-df8e92c13f2c tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:06.455836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15561ada-976b-4bb2-aa69-df8e92c13f2c tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:06.456290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15561ada-976b-4bb2-aa69-df8e92c13f2c tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:06.456716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15561ada-976b-4bb2-aa69-df8e92c13f2c tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:06.588642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-15561ada-976b-4bb2-aa69-df8e92c13f2c tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:06.596446 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-15561ada-976b-4bb2-aa69-df8e92c13f2c tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1492 microversion: 2.1 time: 0.155677 Sep 10 11:25:06.597016 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1926/6168] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:06 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1492 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:06.619758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5cc17ee3-1a29-4972-a193-bfd3f7704868 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:06.620326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5cc17ee3-1a29-4972-a193-bfd3f7704868 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:06.627261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cc17ee3-1a29-4972-a193-bfd3f7704868 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:06.627768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cc17ee3-1a29-4972-a193-bfd3f7704868 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:06.628222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cc17ee3-1a29-4972-a193-bfd3f7704868 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:06.628932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cc17ee3-1a29-4972-a193-bfd3f7704868 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:06.630102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cc17ee3-1a29-4972-a193-bfd3f7704868 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:06.630559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5cc17ee3-1a29-4972-a193-bfd3f7704868 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:06.700423 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5cc17ee3-1a29-4972-a193-bfd3f7704868 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "POST /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359/action" status: 202 len: 0 microversion: 2.1 time: 0.084306 Sep 10 11:25:06.701037 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4243/6169] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:25:06 2022] POST /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:25:06.709258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3dcaa113-c42a-4c5e-8d3a-a0f9958c7513 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:06.709878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3dcaa113-c42a-4c5e-8d3a-a0f9958c7513 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:06.715971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dcaa113-c42a-4c5e-8d3a-a0f9958c7513 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:06.716464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dcaa113-c42a-4c5e-8d3a-a0f9958c7513 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:06.716909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dcaa113-c42a-4c5e-8d3a-a0f9958c7513 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:06.717637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dcaa113-c42a-4c5e-8d3a-a0f9958c7513 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:06.718100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dcaa113-c42a-4c5e-8d3a-a0f9958c7513 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:06.718531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dcaa113-c42a-4c5e-8d3a-a0f9958c7513 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:06.901483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3dcaa113-c42a-4c5e-8d3a-a0f9958c7513 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:06.909344 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3dcaa113-c42a-4c5e-8d3a-a0f9958c7513 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1498 microversion: 2.1 time: 0.203937 Sep 10 11:25:06.909915 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1927/6170] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:06 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1498 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:07.935013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-04aed127-3aa6-4aa1-b397-e50fa50eee04 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:07.935734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-04aed127-3aa6-4aa1-b397-e50fa50eee04 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:07.942551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04aed127-3aa6-4aa1-b397-e50fa50eee04 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:07.942997 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04aed127-3aa6-4aa1-b397-e50fa50eee04 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:07.943453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04aed127-3aa6-4aa1-b397-e50fa50eee04 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:07.944195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04aed127-3aa6-4aa1-b397-e50fa50eee04 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:07.944667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04aed127-3aa6-4aa1-b397-e50fa50eee04 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:07.945138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-04aed127-3aa6-4aa1-b397-e50fa50eee04 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:08.074701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-04aed127-3aa6-4aa1-b397-e50fa50eee04 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:08.082597 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-04aed127-3aa6-4aa1-b397-e50fa50eee04 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1501 microversion: 2.1 time: 0.152742 Sep 10 11:25:08.083238 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4244/6171] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:07 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:08.105444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96bfe82a-5612-4be5-af1a-6b153b0cd28a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:08.106014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-96bfe82a-5612-4be5-af1a-6b153b0cd28a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:08.112927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96bfe82a-5612-4be5-af1a-6b153b0cd28a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:08.113455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96bfe82a-5612-4be5-af1a-6b153b0cd28a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:08.114398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96bfe82a-5612-4be5-af1a-6b153b0cd28a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:08.115085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96bfe82a-5612-4be5-af1a-6b153b0cd28a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:08.115544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96bfe82a-5612-4be5-af1a-6b153b0cd28a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:08.115968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96bfe82a-5612-4be5-af1a-6b153b0cd28a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:08.139385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-96bfe82a-5612-4be5-af1a-6b153b0cd28a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lazy-loading 'flavor' on Instance uuid 8ec32ed8-8795-481b-8f8c-a702c15f5359 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:25:08.206169 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-96bfe82a-5612-4be5-af1a-6b153b0cd28a tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "POST /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359/action" status: 202 len: 0 microversion: 2.1 time: 0.104266 Sep 10 11:25:08.206762 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1928/6172] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:25:08 2022] POST /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:25:08.215254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-324e2ae0-a216-4a99-9feb-783b13b41b53 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:08.215920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-324e2ae0-a216-4a99-9feb-783b13b41b53 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:08.222472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-324e2ae0-a216-4a99-9feb-783b13b41b53 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:08.223274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-324e2ae0-a216-4a99-9feb-783b13b41b53 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:08.223867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-324e2ae0-a216-4a99-9feb-783b13b41b53 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:08.224540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-324e2ae0-a216-4a99-9feb-783b13b41b53 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:08.225118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-324e2ae0-a216-4a99-9feb-783b13b41b53 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:08.226043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-324e2ae0-a216-4a99-9feb-783b13b41b53 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:08.365914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-324e2ae0-a216-4a99-9feb-783b13b41b53 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:08.373940 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-324e2ae0-a216-4a99-9feb-783b13b41b53 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1509 microversion: 2.1 time: 0.162829 Sep 10 11:25:08.374525 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4245/6173] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:08 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:09.399454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-330bd77f-d5ed-463e-878b-f1a03d241cff tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:09.400151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-330bd77f-d5ed-463e-878b-f1a03d241cff tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:09.406380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-330bd77f-d5ed-463e-878b-f1a03d241cff tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:09.406856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-330bd77f-d5ed-463e-878b-f1a03d241cff tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:09.407287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-330bd77f-d5ed-463e-878b-f1a03d241cff tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:09.407965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-330bd77f-d5ed-463e-878b-f1a03d241cff tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:09.408413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-330bd77f-d5ed-463e-878b-f1a03d241cff tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:09.408830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-330bd77f-d5ed-463e-878b-f1a03d241cff tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:09.538479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-330bd77f-d5ed-463e-878b-f1a03d241cff tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:09.546671 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-330bd77f-d5ed-463e-878b-f1a03d241cff tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1492 microversion: 2.1 time: 0.152889 Sep 10 11:25:09.547240 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1929/6174] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:09 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1492 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:09.570047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0339d62f-bf9e-4d5b-a6af-6570e5600b4d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:09.570606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0339d62f-bf9e-4d5b-a6af-6570e5600b4d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:09.577521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0339d62f-bf9e-4d5b-a6af-6570e5600b4d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:09.578026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0339d62f-bf9e-4d5b-a6af-6570e5600b4d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:09.578483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0339d62f-bf9e-4d5b-a6af-6570e5600b4d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:09.579181 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0339d62f-bf9e-4d5b-a6af-6570e5600b4d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:09.579659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0339d62f-bf9e-4d5b-a6af-6570e5600b4d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:09.580101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0339d62f-bf9e-4d5b-a6af-6570e5600b4d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:09.644822 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0339d62f-bf9e-4d5b-a6af-6570e5600b4d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "POST /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359/action" status: 202 len: 0 microversion: 2.1 time: 0.079073 Sep 10 11:25:09.648418 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4246/6175] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:25:09 2022] POST /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:25:09.653960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0e644eb4-1212-4aad-9fb0-08cb7299564f tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:09.654612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0e644eb4-1212-4aad-9fb0-08cb7299564f tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:09.660824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e644eb4-1212-4aad-9fb0-08cb7299564f tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:09.661327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e644eb4-1212-4aad-9fb0-08cb7299564f tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:09.661855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e644eb4-1212-4aad-9fb0-08cb7299564f tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:09.662527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e644eb4-1212-4aad-9fb0-08cb7299564f tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:09.663028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e644eb4-1212-4aad-9fb0-08cb7299564f tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:09.663497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e644eb4-1212-4aad-9fb0-08cb7299564f tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:09.846536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0e644eb4-1212-4aad-9fb0-08cb7299564f tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:09.854814 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0e644eb4-1212-4aad-9fb0-08cb7299564f tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1498 microversion: 2.1 time: 0.204835 Sep 10 11:25:09.855372 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1930/6176] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:09 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1498 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:10.879770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-161f89fe-2775-4749-bc0e-3560a6cf1c8d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:10.880495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-161f89fe-2775-4749-bc0e-3560a6cf1c8d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:10.886842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-161f89fe-2775-4749-bc0e-3560a6cf1c8d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:10.887569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-161f89fe-2775-4749-bc0e-3560a6cf1c8d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:10.888045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-161f89fe-2775-4749-bc0e-3560a6cf1c8d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:10.889425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-161f89fe-2775-4749-bc0e-3560a6cf1c8d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:10.890108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-161f89fe-2775-4749-bc0e-3560a6cf1c8d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:10.890574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-161f89fe-2775-4749-bc0e-3560a6cf1c8d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:11.032407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-161f89fe-2775-4749-bc0e-3560a6cf1c8d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:11.040779 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-161f89fe-2775-4749-bc0e-3560a6cf1c8d tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1498 microversion: 2.1 time: 0.166289 Sep 10 11:25:11.041390 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4247/6177] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:10 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:12.065105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ac5cbe2-430f-4a18-aad3-b619457c4a0e tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:12.065756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ac5cbe2-430f-4a18-aad3-b619457c4a0e tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:12.073274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ac5cbe2-430f-4a18-aad3-b619457c4a0e tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:12.073755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ac5cbe2-430f-4a18-aad3-b619457c4a0e tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:12.074191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ac5cbe2-430f-4a18-aad3-b619457c4a0e tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:12.074872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ac5cbe2-430f-4a18-aad3-b619457c4a0e tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:12.075321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ac5cbe2-430f-4a18-aad3-b619457c4a0e tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:12.075740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ac5cbe2-430f-4a18-aad3-b619457c4a0e tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:12.202691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ac5cbe2-430f-4a18-aad3-b619457c4a0e tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:12.210429 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ac5cbe2-430f-4a18-aad3-b619457c4a0e tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1501 microversion: 2.1 time: 0.149217 Sep 10 11:25:12.210994 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1931/6178] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:12 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1501 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:12.233270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ea94fbd9-0dc7-4ed0-98d5-6ee359ed5cd0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:12.233790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea94fbd9-0dc7-4ed0-98d5-6ee359ed5cd0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:12.241832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea94fbd9-0dc7-4ed0-98d5-6ee359ed5cd0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:12.242377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea94fbd9-0dc7-4ed0-98d5-6ee359ed5cd0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:12.242890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea94fbd9-0dc7-4ed0-98d5-6ee359ed5cd0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:12.244314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea94fbd9-0dc7-4ed0-98d5-6ee359ed5cd0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:12.245118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea94fbd9-0dc7-4ed0-98d5-6ee359ed5cd0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:12.245595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ea94fbd9-0dc7-4ed0-98d5-6ee359ed5cd0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:12.270642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ea94fbd9-0dc7-4ed0-98d5-6ee359ed5cd0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:25:12.319010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:12.346058 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ea94fbd9-0dc7-4ed0-98d5-6ee359ed5cd0 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 204 len: 0 microversion: 2.1 time: 0.116739 Sep 10 11:25:12.346658 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4248/6179] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:25:12 2022] DELETE /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:25:12.355775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7add339b-fdbf-4b97-a09b-25bc05190cfa tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:12.356391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7add339b-fdbf-4b97-a09b-25bc05190cfa tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:12.362379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7add339b-fdbf-4b97-a09b-25bc05190cfa tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:12.362861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7add339b-fdbf-4b97-a09b-25bc05190cfa tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:12.363293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7add339b-fdbf-4b97-a09b-25bc05190cfa tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:12.364574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7add339b-fdbf-4b97-a09b-25bc05190cfa tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:12.365021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7add339b-fdbf-4b97-a09b-25bc05190cfa tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:12.365471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7add339b-fdbf-4b97-a09b-25bc05190cfa tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:12.491489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7add339b-fdbf-4b97-a09b-25bc05190cfa tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:12.499300 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7add339b-fdbf-4b97-a09b-25bc05190cfa tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1507 microversion: 2.1 time: 0.147566 Sep 10 11:25:12.499870 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1932/6180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:12 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:13.523315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f7957e29-f0d3-4b5f-9fc1-5f65bcd379c7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:13.524067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f7957e29-f0d3-4b5f-9fc1-5f65bcd379c7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:13.531012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7957e29-f0d3-4b5f-9fc1-5f65bcd379c7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:13.531517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7957e29-f0d3-4b5f-9fc1-5f65bcd379c7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:13.531971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7957e29-f0d3-4b5f-9fc1-5f65bcd379c7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:13.532672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7957e29-f0d3-4b5f-9fc1-5f65bcd379c7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:13.533169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7957e29-f0d3-4b5f-9fc1-5f65bcd379c7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:13.533611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f7957e29-f0d3-4b5f-9fc1-5f65bcd379c7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:13.666867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f7957e29-f0d3-4b5f-9fc1-5f65bcd379c7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:13.675137 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f7957e29-f0d3-4b5f-9fc1-5f65bcd379c7 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1507 microversion: 2.1 time: 0.156131 Sep 10 11:25:13.675722 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4249/6181] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:13 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:14.698943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8c3acf4d-6e08-4498-8d40-932c21b85d81 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:14.699673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8c3acf4d-6e08-4498-8d40-932c21b85d81 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:14.706593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c3acf4d-6e08-4498-8d40-932c21b85d81 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:14.707155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c3acf4d-6e08-4498-8d40-932c21b85d81 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:14.708564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c3acf4d-6e08-4498-8d40-932c21b85d81 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:14.709353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c3acf4d-6e08-4498-8d40-932c21b85d81 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:14.709813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c3acf4d-6e08-4498-8d40-932c21b85d81 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:14.710240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c3acf4d-6e08-4498-8d40-932c21b85d81 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:14.725409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:14.925324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8c3acf4d-6e08-4498-8d40-932c21b85d81 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a58fca265b49bea888fd1b8de151b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8c0b4357304996b4d7e83353b13759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:14.936698 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8c3acf4d-6e08-4498-8d40-932c21b85d81 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 200 len: 1507 microversion: 2.1 time: 0.241629 Sep 10 11:25:14.937316 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1933/6182] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:14 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:14.974111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-25268704-077a-471d-8ab9-1a3759e93e24 req-02c26960-4f8b-4e6e-b9dd-5a7040f17a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec32ed8-8795-481b-8f8c-a702c15f5359", "name": "network-vif-deleted", "tag": "ab760e0f-031d-4f01-9fce-9e02cd484576"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:14.983739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-25268704-077a-471d-8ab9-1a3759e93e24 req-02c26960-4f8b-4e6e-b9dd-5a7040f17a81 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:14.984228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-25268704-077a-471d-8ab9-1a3759e93e24 req-02c26960-4f8b-4e6e-b9dd-5a7040f17a81 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:14.984740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-25268704-077a-471d-8ab9-1a3759e93e24 req-02c26960-4f8b-4e6e-b9dd-5a7040f17a81 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:14.996589 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-25268704-077a-471d-8ab9-1a3759e93e24 req-02c26960-4f8b-4e6e-b9dd-5a7040f17a81 service nova] Creating event network-vif-deleted:ab760e0f-031d-4f01-9fce-9e02cd484576 for instance 8ec32ed8-8795-481b-8f8c-a702c15f5359 on n-h2-856894-1 Sep 10 11:25:15.001294 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-25268704-077a-471d-8ab9-1a3759e93e24 req-02c26960-4f8b-4e6e-b9dd-5a7040f17a81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109421 Sep 10 11:25:15.001895 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4250/6183] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:25:15.964728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:15.965289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] [instance: 8ec32ed8-8795-481b-8f8c-a702c15f5359] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:15.972188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:15.972668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:15.973169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:15.973854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:15.974312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:15.974734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:15.988036 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] HTTP exception thrown: Instance 8ec32ed8-8795-481b-8f8c-a702c15f5359 could not be found. Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Request method failure captured: Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 HTTP/1.1 Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHQEjJ2vyYePehc5ipzDQLEynvXkF4U89NsWH2YrdOELiWWGMMXMI_IvHAn6PpLb5GyrlEmbF8lMBtAeEfLHVEkmxYlaFS0zn6jinGXe2lBV3SUQbYhDu435COyzzd5EsjkuFdLjBiScJ4qKetE-X7XLYqnXQmwdiPtCn0_pnitiPHc Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 7c8c0b4357304996b4d7e83353b13759 Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestServerAdvancedOps-1031187366 Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c8c0b4357304996b4d7e83353b13759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c8c0b4357304996b4d7e83353b13759"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c8c0b4357304996b4d7e83353b13759"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c8c0b4357304996b4d7e83353b13759", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestServerAdvancedOps-1031187366 Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 7c8c0b4357304996b4d7e83353b13759 Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestServerAdvancedOps-1031187366 Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestServerAdvancedOps-1031187366-project Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 21a58fca265b49bea888fd1b8de151b8 Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestServerAdvancedOps-1031187366-project Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 8ec32ed8-8795-481b-8f8c-a702c15f5359 could not be found. Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '8ec32ed8-8795-481b-8f8c-a702c15f5359'} Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec32ed8-8795-481b-8f8c-a702c15f5359 could not be found. Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec32ed8-8795-481b-8f8c-a702c15f5359 could not be found. Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:25:15.989710 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:15.993129 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:15.993129 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:25:15.993129 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:25:15.993129 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:25:15.993129 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:25:15.993129 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec32ed8-8795-481b-8f8c-a702c15f5359 could not be found. Sep 10 11:25:15.993129 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:15.993129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] Returning 404 to user: Instance 8ec32ed8-8795-481b-8f8c-a702c15f5359 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:25:15.993129 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9fb6665b-f1e1-4269-8e7d-a9c970c885f9 tempest-TestServerAdvancedOps-1031187366 tempest-TestServerAdvancedOps-1031187366-project] 10.222.0.20 "GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359" status: 404 len: 111 microversion: 2.1 time: 0.030373 Sep 10 11:25:15.993129 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1934/6184] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:15 2022] GET /compute/v2.1/servers/8ec32ed8-8795-481b-8f8c-a702c15f5359 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:25:38.247760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:38.248565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:38.364246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-696201752", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:38.421000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] validate_networks() for None {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:25:38.715760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:25:38.716202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:25:38.716709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:25:38.717161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:25:38.717587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:25:38.726918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:38.727494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:38.727948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:38.728761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:38.729257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:38.729695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:38.747836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Getting quotas for project 0630252a744b451bbc95a6c1710d1909. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:25:38.753653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Getting quotas for user 7551ae3f87b14df9b045da7b49fcaa91 and project 0630252a744b451bbc95a6c1710d1909. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:25:38.767822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:25:38.770414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:25:38.818918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7fa02377-a4f1-409e-8c32-87d209efccc7 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573393 Sep 10 11:25:38.819581 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4251/6185] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:25:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:25:38.832214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-36bf7252-ae3d-45b3-aeb8-becc23a0dcaf tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:38.833908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-36bf7252-ae3d-45b3-aeb8-becc23a0dcaf tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:38.836197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:38.837510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=5 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:38.890389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-36bf7252-ae3d-45b3-aeb8-becc23a0dcaf tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:38.897998 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-36bf7252-ae3d-45b3-aeb8-becc23a0dcaf tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1221 microversion: 2.1 time: 0.069826 Sep 10 11:25:38.898574 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1935/6186] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:38 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1221 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:25:39.921768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbbf709c-8aa6-4e42-8596-82cc1420046e tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:39.922477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fbbf709c-8aa6-4e42-8596-82cc1420046e tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:39.930825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbbf709c-8aa6-4e42-8596-82cc1420046e tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:39.931336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbbf709c-8aa6-4e42-8596-82cc1420046e tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:39.931794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbbf709c-8aa6-4e42-8596-82cc1420046e tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:39.932506 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbbf709c-8aa6-4e42-8596-82cc1420046e tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:39.932983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbbf709c-8aa6-4e42-8596-82cc1420046e tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:39.933731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbbf709c-8aa6-4e42-8596-82cc1420046e tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:40.032691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbbf709c-8aa6-4e42-8596-82cc1420046e tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:40.040967 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbbf709c-8aa6-4e42-8596-82cc1420046e tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1279 microversion: 2.1 time: 0.123535 Sep 10 11:25:40.041622 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4252/6187] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:39 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1279 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:41.064397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1ad2ee41-e0d5-45fb-be83-7056c5618546 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:41.065166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1ad2ee41-e0d5-45fb-be83-7056c5618546 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:41.078833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ad2ee41-e0d5-45fb-be83-7056c5618546 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:41.079366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ad2ee41-e0d5-45fb-be83-7056c5618546 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:41.079810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ad2ee41-e0d5-45fb-be83-7056c5618546 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:41.080510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ad2ee41-e0d5-45fb-be83-7056c5618546 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:41.080967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ad2ee41-e0d5-45fb-be83-7056c5618546 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:41.081427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ad2ee41-e0d5-45fb-be83-7056c5618546 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:41.284110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1ad2ee41-e0d5-45fb-be83-7056c5618546 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:41.291996 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1ad2ee41-e0d5-45fb-be83-7056c5618546 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1321 microversion: 2.1 time: 0.231571 Sep 10 11:25:41.292595 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1936/6188] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:41 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:41.388116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-fcbf6f5a-35de-4f0c-95f7-e8e8e48002ed req-29907f2b-23ad-49e7-b8d3-f6fbea02ee69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed6d119-4382-4a98-96b0-beab9d592458", "tag": "56358975-0076-419b-9c46-01e437b93a86"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:41.402321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fcbf6f5a-35de-4f0c-95f7-e8e8e48002ed req-29907f2b-23ad-49e7-b8d3-f6fbea02ee69 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:41.403774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fcbf6f5a-35de-4f0c-95f7-e8e8e48002ed req-29907f2b-23ad-49e7-b8d3-f6fbea02ee69 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:41.404236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fcbf6f5a-35de-4f0c-95f7-e8e8e48002ed req-29907f2b-23ad-49e7-b8d3-f6fbea02ee69 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:41.420036 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-fcbf6f5a-35de-4f0c-95f7-e8e8e48002ed req-29907f2b-23ad-49e7-b8d3-f6fbea02ee69 service nova] Creating event network-changed:56358975-0076-419b-9c46-01e437b93a86 for instance 2ed6d119-4382-4a98-96b0-beab9d592458 on n-h1-856894-1 Sep 10 11:25:41.426151 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-fcbf6f5a-35de-4f0c-95f7-e8e8e48002ed req-29907f2b-23ad-49e7-b8d3-f6fbea02ee69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041779 Sep 10 11:25:41.426782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4253/6189] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:25:42.315006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-689da547-a7db-4884-b794-8e77da795b09 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:42.315655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-689da547-a7db-4884-b794-8e77da795b09 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:42.323029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-689da547-a7db-4884-b794-8e77da795b09 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:42.323513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-689da547-a7db-4884-b794-8e77da795b09 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:42.323954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-689da547-a7db-4884-b794-8e77da795b09 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:42.324641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-689da547-a7db-4884-b794-8e77da795b09 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:42.325110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-689da547-a7db-4884-b794-8e77da795b09 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:42.325543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-689da547-a7db-4884-b794-8e77da795b09 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:42.455241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-689da547-a7db-4884-b794-8e77da795b09 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:42.463515 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-689da547-a7db-4884-b794-8e77da795b09 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1321 microversion: 2.1 time: 0.152613 Sep 10 11:25:42.464180 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1937/6190] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:42 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:43.487669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93698cba-dfe0-4ff2-b40f-3427a03168db tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:43.488310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93698cba-dfe0-4ff2-b40f-3427a03168db tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:43.494600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93698cba-dfe0-4ff2-b40f-3427a03168db tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:43.495101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93698cba-dfe0-4ff2-b40f-3427a03168db tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:43.495556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93698cba-dfe0-4ff2-b40f-3427a03168db tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:43.496262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93698cba-dfe0-4ff2-b40f-3427a03168db tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:43.496735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93698cba-dfe0-4ff2-b40f-3427a03168db tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:43.497219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93698cba-dfe0-4ff2-b40f-3427a03168db tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:43.629292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93698cba-dfe0-4ff2-b40f-3427a03168db tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:43.637510 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93698cba-dfe0-4ff2-b40f-3427a03168db tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1321 microversion: 2.1 time: 0.155116 Sep 10 11:25:43.638092 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4254/6191] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:43 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:44.661630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ec15631-7bb2-468d-852a-9a243e041d70 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:44.662175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ec15631-7bb2-468d-852a-9a243e041d70 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:44.669413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ec15631-7bb2-468d-852a-9a243e041d70 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:44.669916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ec15631-7bb2-468d-852a-9a243e041d70 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:44.670357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ec15631-7bb2-468d-852a-9a243e041d70 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:44.671060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ec15631-7bb2-468d-852a-9a243e041d70 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:44.671519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ec15631-7bb2-468d-852a-9a243e041d70 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:44.671949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ec15631-7bb2-468d-852a-9a243e041d70 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:44.799205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ec15631-7bb2-468d-852a-9a243e041d70 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:44.806889 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ec15631-7bb2-468d-852a-9a243e041d70 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1321 microversion: 2.1 time: 0.149855 Sep 10 11:25:44.807467 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1938/6192] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:44 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:45.829484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ca5c6607-d0d8-4529-8f45-773348c11d8f tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:45.830138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ca5c6607-d0d8-4529-8f45-773348c11d8f tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:45.837005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5c6607-d0d8-4529-8f45-773348c11d8f tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:45.837536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5c6607-d0d8-4529-8f45-773348c11d8f tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:45.837992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5c6607-d0d8-4529-8f45-773348c11d8f tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:45.838699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5c6607-d0d8-4529-8f45-773348c11d8f tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:45.839174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5c6607-d0d8-4529-8f45-773348c11d8f tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:45.839616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ca5c6607-d0d8-4529-8f45-773348c11d8f tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:45.967520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ca5c6607-d0d8-4529-8f45-773348c11d8f tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:45.975696 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ca5c6607-d0d8-4529-8f45-773348c11d8f tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1321 microversion: 2.1 time: 0.150285 Sep 10 11:25:45.976269 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4255/6193] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:45 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:46.989322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-ac1c9a91-1bf5-4f7b-9267-5d2f00ff1e55 req-2afafdc6-ace7-4775-aa34-2e4ad47fa8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed6d119-4382-4a98-96b0-beab9d592458", "name": "network-vif-plugged", "status": "completed", "tag": "56358975-0076-419b-9c46-01e437b93a86"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:46.998928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-440b6202-88e1-4872-a510-6cbf7cc195e1 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:46.999574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ac1c9a91-1bf5-4f7b-9267-5d2f00ff1e55 req-2afafdc6-ace7-4775-aa34-2e4ad47fa8f1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:46.999684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-440b6202-88e1-4872-a510-6cbf7cc195e1 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:47.000248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ac1c9a91-1bf5-4f7b-9267-5d2f00ff1e55 req-2afafdc6-ace7-4775-aa34-2e4ad47fa8f1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:47.000871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ac1c9a91-1bf5-4f7b-9267-5d2f00ff1e55 req-2afafdc6-ace7-4775-aa34-2e4ad47fa8f1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:47.007081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440b6202-88e1-4872-a510-6cbf7cc195e1 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:47.007819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440b6202-88e1-4872-a510-6cbf7cc195e1 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:47.008283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440b6202-88e1-4872-a510-6cbf7cc195e1 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:47.009005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440b6202-88e1-4872-a510-6cbf7cc195e1 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:47.009512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440b6202-88e1-4872-a510-6cbf7cc195e1 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:47.009965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-440b6202-88e1-4872-a510-6cbf7cc195e1 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:47.015169 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-ac1c9a91-1bf5-4f7b-9267-5d2f00ff1e55 req-2afafdc6-ace7-4775-aa34-2e4ad47fa8f1 service nova] Creating event network-vif-plugged:56358975-0076-419b-9c46-01e437b93a86 for instance 2ed6d119-4382-4a98-96b0-beab9d592458 on n-h1-856894-1 Sep 10 11:25:47.019307 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-ac1c9a91-1bf5-4f7b-9267-5d2f00ff1e55 req-2afafdc6-ace7-4775-aa34-2e4ad47fa8f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034598 Sep 10 11:25:47.021001 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1939/6194] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:25:47.213567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-440b6202-88e1-4872-a510-6cbf7cc195e1 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:47.221265 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-440b6202-88e1-4872-a510-6cbf7cc195e1 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1321 microversion: 2.1 time: 0.226717 Sep 10 11:25:47.221847 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4256/6195] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:46 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:25:48.243928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9cf8a513-79dd-4e3e-929d-1755ccd89798 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:48.244623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9cf8a513-79dd-4e3e-929d-1755ccd89798 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:48.251718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cf8a513-79dd-4e3e-929d-1755ccd89798 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:48.252197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cf8a513-79dd-4e3e-929d-1755ccd89798 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:48.252632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cf8a513-79dd-4e3e-929d-1755ccd89798 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:48.253343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cf8a513-79dd-4e3e-929d-1755ccd89798 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:48.253794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cf8a513-79dd-4e3e-929d-1755ccd89798 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:48.254215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9cf8a513-79dd-4e3e-929d-1755ccd89798 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:48.388119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9cf8a513-79dd-4e3e-929d-1755ccd89798 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:48.395935 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9cf8a513-79dd-4e3e-929d-1755ccd89798 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1471 microversion: 2.1 time: 0.156839 Sep 10 11:25:48.396514 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1940/6196] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:48 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:48.470554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed14d8a6-37c9-45c9-96b7-77814f3e6b23 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Calling method '.version_select at 0x7efcad2c0d30>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:48.537050 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed14d8a6-37c9-45c9-96b7-77814f3e6b23 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/91cfa37f5d714fb181544494a2916d8f" status: 200 len: 371 microversion: 2.1 time: 0.119544 Sep 10 11:25:48.537650 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4257/6197] 10.222.0.20 () {58 vars in 1242 bytes} [Sat Sep 10 11:25:48 2022] GET /compute/v2.1/os-quota-sets/91cfa37f5d714fb181544494a2916d8f => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:25:48.549893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-efca6e9a-f6ba-4993-a5dd-573694088135 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-144716766", "id": 2105321876, "os-flavor-access:is_public": "True"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:48.567689 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-efca6e9a-f6ba-4993-a5dd-573694088135 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021472 Sep 10 11:25:48.568239 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1941/6198] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:25:48 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:25:48.580399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2105321876"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:48.583262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:48.589452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:48.589897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:48.590350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:48.591055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:48.591533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:48.591975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:48.735891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:48.774005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '19c18adfd5594363b550284e6f27ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cfa37f5d714fb181544494a2916d8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:48.780322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-144716766 {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:25:48.789025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:48.789558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:48.790020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:48.790774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:48.791307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:48.791751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:48.812344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Getting quotas for project 0630252a744b451bbc95a6c1710d1909. Resources: {'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:25:48.817495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Getting quotas for user 7551ae3f87b14df9b045da7b49fcaa91 and project 0630252a744b451bbc95a6c1710d1909. Resources: {'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:25:48.829542 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.compute.api [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] ram quota exceeded for 91cfa37f5d714fb181544494a2916d8f, tried to resize instance. Sep 10 11:25:48.830110 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Request method failure captured: Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458/action HTTP/1.1 Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 39 Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHQyx_eCreR4qVPKYz5eUDBjwM2VrCfIQN-bb1Bv80ccDxPL3cKvzPb_8HxhHq1ZRq2EXSycV7_0Li3USLyNE6ZJkvGDPGhsZ9JOAUgxHXkBTb5blvu5UZBkP9Y8fuqq6XtIsj0RoOhrznNg8RVylGcRc1JiKmbY4FNXrYxx_d5IGns Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 91cfa37f5d714fb181544494a2916d8f Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-862423672 Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,admin,reader Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,admin,reader Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91cfa37f5d714fb181544494a2916d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91cfa37f5d714fb181544494a2916d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91cfa37f5d714fb181544494a2916d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91cfa37f5d714fb181544494a2916d8f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersAdminNegativeTestJSON-862423672 Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 91cfa37f5d714fb181544494a2916d8f Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-862423672 Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersAdminNegativeTestJSON-862423672-project-admin Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 19c18adfd5594363b550284e6f27ae4a Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersAdminNegativeTestJSON-862423672-project-admin Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: {"resize": {"flavorRef": "2105321876"}} Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '2ed6d119-4382-4a98-96b0-beab9d592458', 'body': {'resize': {'flavorRef': '2105321876'}}} Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:25:48.832211 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:25:48.836620 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b8068a66-ce40-4419-8f6d-b2af4c3dc219 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458/action" status: 403 len: 118 microversion: 2.1 time: 0.257670 Sep 10 11:25:48.839363 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4258/6199] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:25:48 2022] POST /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458/action => generated 118 bytes in 262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:25:48.843140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-818aa8f9-5137-4c8c-8459-461c18834ef7 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:48.860348 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-818aa8f9-5137-4c8c-8459-461c18834ef7 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2105321876" status: 202 len: 0 microversion: 2.1 time: 0.021057 Sep 10 11:25:48.860896 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1942/6200] 10.222.0.20 () {58 vars in 1161 bytes} [Sat Sep 10 11:25:48 2022] DELETE /compute/v2.1/flavors/2105321876 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:25:48.868612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6294ffe3-224a-428c-b009-cabe711672d1 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:48.889703 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6294ffe3-224a-428c-b009-cabe711672d1 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024690 Sep 10 11:25:48.890276 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4259/6201] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 11:25:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:48.910612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a355977b-2810-4d0f-a6a7-5d19ec270aff tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Calling method '.version_select at 0x7efcaebacc10>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:48.918949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:48.987050 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a355977b-2810-4d0f-a6a7-5d19ec270aff tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/91cfa37f5d714fb181544494a2916d8f" status: 200 len: 371 microversion: 2.1 time: 0.080088 Sep 10 11:25:48.987628 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1943/6202] 10.222.0.20 () {58 vars in 1242 bytes} [Sat Sep 10 11:25:48 2022] GET /compute/v2.1/os-quota-sets/91cfa37f5d714fb181544494a2916d8f => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:25:48.999223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed4d7852-0426-4067-a97b-88fc4d0f38c2 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1448240097", "id": 643176980, "os-flavor-access:is_public": "True"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:49.017018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed4d7852-0426-4067-a97b-88fc4d0f38c2 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021520 Sep 10 11:25:49.017612 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4260/6203] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:25:48 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:25:49.029918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "643176980"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:49.032248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:49.038193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:49.038667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:49.039099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:49.039777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:49.040227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:49.040653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:49.126566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '19c18adfd5594363b550284e6f27ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cfa37f5d714fb181544494a2916d8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:49.132896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1448240097 {{(pid=128787) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:25:49.139434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:49.139907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:49.140336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:49.141050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:49.141523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:49.141938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:49.165054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Getting quotas for project 0630252a744b451bbc95a6c1710d1909. Resources: {'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:25:49.170831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Getting quotas for user 7551ae3f87b14df9b045da7b49fcaa91 and project 0630252a744b451bbc95a6c1710d1909. Resources: {'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:25:49.184793 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.compute.api [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] cores quota exceeded for 91cfa37f5d714fb181544494a2916d8f, tried to resize instance. Sep 10 11:25:49.185374 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Request method failure captured: Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458/action HTTP/1.1 Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 38 Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHQyx_eCreR4qVPKYz5eUDBjwM2VrCfIQN-bb1Bv80ccDxPL3cKvzPb_8HxhHq1ZRq2EXSycV7_0Li3USLyNE6ZJkvGDPGhsZ9JOAUgxHXkBTb5blvu5UZBkP9Y8fuqq6XtIsj0RoOhrznNg8RVylGcRc1JiKmbY4FNXrYxx_d5IGns Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 91cfa37f5d714fb181544494a2916d8f Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-862423672 Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,admin,reader Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,admin,reader Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91cfa37f5d714fb181544494a2916d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91cfa37f5d714fb181544494a2916d8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91cfa37f5d714fb181544494a2916d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91cfa37f5d714fb181544494a2916d8f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersAdminNegativeTestJSON-862423672 Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 91cfa37f5d714fb181544494a2916d8f Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-862423672 Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersAdminNegativeTestJSON-862423672-project-admin Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 19c18adfd5594363b550284e6f27ae4a Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersAdminNegativeTestJSON-862423672-project-admin Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: {"resize": {"flavorRef": "643176980"}} Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '2ed6d119-4382-4a98-96b0-beab9d592458', 'body': {'resize': {'flavorRef': '643176980'}}} Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:25:49.187441 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dd5236ed-2298-4c50-ad28-ab6ce2eb24ac tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458/action" status: 403 len: 113 microversion: 2.1 time: 0.162812 Sep 10 11:25:49.190981 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1944/6204] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:25:49 2022] POST /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458/action => generated 113 bytes in 164 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:25:49.198020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0aa8f8d7-1110-4b0e-96b9-516ca8ef93d2 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:49.215187 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0aa8f8d7-1110-4b0e-96b9-516ca8ef93d2 tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/643176980" status: 202 len: 0 microversion: 2.1 time: 0.020864 Sep 10 11:25:49.215738 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4261/6205] 10.222.0.20 () {58 vars in 1158 bytes} [Sat Sep 10 11:25:49 2022] DELETE /compute/v2.1/flavors/643176980 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:25:49.223869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b446cff3-221d-4521-9240-a66fa5ecffaa tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:49.243897 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b446cff3-221d-4521-9240-a66fa5ecffaa tempest-ServersAdminNegativeTestJSON-862423672 tempest-ServersAdminNegativeTestJSON-862423672-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023696 Sep 10 11:25:49.244466 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1945/6206] 10.222.0.20 () {58 vars in 1146 bytes} [Sat Sep 10 11:25:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:49.264905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9c43cf49-f100-46a8-b50d-903391539416 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:49.265456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c43cf49-f100-46a8-b50d-903391539416 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:49.272283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c43cf49-f100-46a8-b50d-903391539416 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:49.272792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c43cf49-f100-46a8-b50d-903391539416 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:49.273289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c43cf49-f100-46a8-b50d-903391539416 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:49.274116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c43cf49-f100-46a8-b50d-903391539416 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:49.274779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c43cf49-f100-46a8-b50d-903391539416 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:49.275226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9c43cf49-f100-46a8-b50d-903391539416 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:49.300361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9c43cf49-f100-46a8-b50d-903391539416 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:25:49.375796 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9c43cf49-f100-46a8-b50d-903391539416 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 204 len: 0 microversion: 2.1 time: 0.114443 Sep 10 11:25:49.376433 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4262/6207] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:25:49 2022] DELETE /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:25:49.386176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-999f41fb-5415-4d76-9bbc-24fccb4973df tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:49.387015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-999f41fb-5415-4d76-9bbc-24fccb4973df tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:49.393868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-999f41fb-5415-4d76-9bbc-24fccb4973df tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:49.394358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-999f41fb-5415-4d76-9bbc-24fccb4973df tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:49.394800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-999f41fb-5415-4d76-9bbc-24fccb4973df tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:49.395492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-999f41fb-5415-4d76-9bbc-24fccb4973df tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:49.395947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-999f41fb-5415-4d76-9bbc-24fccb4973df tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:49.396373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-999f41fb-5415-4d76-9bbc-24fccb4973df tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:49.525496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-999f41fb-5415-4d76-9bbc-24fccb4973df tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:49.533356 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-999f41fb-5415-4d76-9bbc-24fccb4973df tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1477 microversion: 2.1 time: 0.151543 Sep 10 11:25:49.533923 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1946/6208] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:49 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:25:50.556841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d58cb140-6053-471f-acca-fce5f57479a5 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:50.557619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d58cb140-6053-471f-acca-fce5f57479a5 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:50.564462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d58cb140-6053-471f-acca-fce5f57479a5 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:50.564972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d58cb140-6053-471f-acca-fce5f57479a5 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:50.565507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d58cb140-6053-471f-acca-fce5f57479a5 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:50.566213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d58cb140-6053-471f-acca-fce5f57479a5 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:50.566686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d58cb140-6053-471f-acca-fce5f57479a5 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:50.567616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d58cb140-6053-471f-acca-fce5f57479a5 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:50.770919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d58cb140-6053-471f-acca-fce5f57479a5 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7551ae3f87b14df9b045da7b49fcaa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0630252a744b451bbc95a6c1710d1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:50.778675 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d58cb140-6053-471f-acca-fce5f57479a5 tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 200 len: 1477 microversion: 2.1 time: 0.226285 Sep 10 11:25:50.779573 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4263/6209] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:50 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:25:51.140706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-2c45a738-ae56-42ac-8df7-536942b14c30 req-2157a841-9085-4921-8ef2-b1f0073a0ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed6d119-4382-4a98-96b0-beab9d592458", "name": "network-vif-deleted", "tag": "56358975-0076-419b-9c46-01e437b93a86"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:51.152287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2c45a738-ae56-42ac-8df7-536942b14c30 req-2157a841-9085-4921-8ef2-b1f0073a0ff9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:51.152899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2c45a738-ae56-42ac-8df7-536942b14c30 req-2157a841-9085-4921-8ef2-b1f0073a0ff9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:51.153564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2c45a738-ae56-42ac-8df7-536942b14c30 req-2157a841-9085-4921-8ef2-b1f0073a0ff9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:51.167048 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-2c45a738-ae56-42ac-8df7-536942b14c30 req-2157a841-9085-4921-8ef2-b1f0073a0ff9 service nova] Creating event network-vif-deleted:56358975-0076-419b-9c46-01e437b93a86 for instance 2ed6d119-4382-4a98-96b0-beab9d592458 on n-h1-856894-1 Sep 10 11:25:51.172887 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-2c45a738-ae56-42ac-8df7-536942b14c30 req-2157a841-9085-4921-8ef2-b1f0073a0ff9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035857 Sep 10 11:25:51.173955 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1947/6210] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:25:51.802448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:51.803072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] [instance: 2ed6d119-4382-4a98-96b0-beab9d592458] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:51.810145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:51.810642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:51.811092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:51.812074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:51.812542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:51.812980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:51.829801 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] HTTP exception thrown: Instance 2ed6d119-4382-4a98-96b0-beab9d592458 could not be found. Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Request method failure captured: Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 HTTP/1.1 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHQx-bpJ1exu5pkrEghG8TQvNU6G90chThvhlok7gjZbi37-z3TjMRZNpIW1Q7etNF5IyFeY7bZpnPhYvwj-pKYqZm84k9DUxvaIm3RNtSgDb4L6w2jBVo-7B3G-y5dK_0Msa-TJjO1UvybfGt88cJAwacbhNCFG_ecLGwVa2k2viN8 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 0630252a744b451bbc95a6c1710d1909 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-492209420 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0630252a744b451bbc95a6c1710d1909"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0630252a744b451bbc95a6c1710d1909"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0630252a744b451bbc95a6c1710d1909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0630252a744b451bbc95a6c1710d1909", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersAdminNegativeTestJSON-492209420 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 0630252a744b451bbc95a6c1710d1909 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-492209420 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersAdminNegativeTestJSON-492209420-project Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 7551ae3f87b14df9b045da7b49fcaa91 Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersAdminNegativeTestJSON-492209420-project Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 2ed6d119-4382-4a98-96b0-beab9d592458 could not be found. Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '2ed6d119-4382-4a98-96b0-beab9d592458'} Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed6d119-4382-4a98-96b0-beab9d592458 could not be found. Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed6d119-4382-4a98-96b0-beab9d592458 could not be found. Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:51.831371 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed6d119-4382-4a98-96b0-beab9d592458 could not be found. Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] Returning 404 to user: Instance 2ed6d119-4382-4a98-96b0-beab9d592458 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-885eff4a-2b9c-4f0e-8c7d-5c9d8ee1757b tempest-ServersAdminNegativeTestJSON-492209420 tempest-ServersAdminNegativeTestJSON-492209420-project] 10.222.0.20 "GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458" status: 404 len: 111 microversion: 2.1 time: 0.034515 Sep 10 11:25:51.835232 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4264/6211] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:51 2022] GET /compute/v2.1/servers/2ed6d119-4382-4a98-96b0-beab9d592458 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:25:58.335378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1728063642", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "fc4fbec4-5086-4e99-a5c7-defae140db5a"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:25:58.387590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] validate_networks() for [('fc4fbec4-5086-4e99-a5c7-defae140db5a', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:25:58.819664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:25:58.820160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:25:58.820811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:25:58.821717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:25:58.822388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:25:58.832501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:58.833729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:58.834204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:58.835083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:25:58.835540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:25:58.835965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:25:58.853714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Getting quotas for project 4f93f50077694fb8b159cef508bfc69d. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:25:58.859417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Getting quotas for user 137ab9a64bad4e6495da7088a4155073 and project 4f93f50077694fb8b159cef508bfc69d. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:25:58.872452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:25:58.874912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:25:58.922550 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-31ac56b1-5b5f-4feb-b580-3e803dec90ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705608 Sep 10 11:25:58.923372 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1948/6212] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:25:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:25:58.935078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1daaa1bc-c87e-42f3-b251-e9b591659b60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:25:58.935078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1daaa1bc-c87e-42f3-b251-e9b591659b60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:25:58.950885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:58.952586 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:25:59.011337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1daaa1bc-c87e-42f3-b251-e9b591659b60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:25:59.018412 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1daaa1bc-c87e-42f3-b251-e9b591659b60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1215 microversion: 2.1 time: 0.087768 Sep 10 11:25:59.018851 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4265/6213] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:25:58 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:00.044887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-470c099f-af0f-4bc0-b5c3-b23b205b2faf tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:00.046736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-470c099f-af0f-4bc0-b5c3-b23b205b2faf tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:00.057208 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-470c099f-af0f-4bc0-b5c3-b23b205b2faf tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:00.058073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-470c099f-af0f-4bc0-b5c3-b23b205b2faf tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:00.059193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-470c099f-af0f-4bc0-b5c3-b23b205b2faf tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:00.060320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-470c099f-af0f-4bc0-b5c3-b23b205b2faf tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:00.060977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-470c099f-af0f-4bc0-b5c3-b23b205b2faf tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:00.061633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-470c099f-af0f-4bc0-b5c3-b23b205b2faf tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:00.146633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-470c099f-af0f-4bc0-b5c3-b23b205b2faf tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:00.161231 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-470c099f-af0f-4bc0-b5c3-b23b205b2faf tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1275 microversion: 2.1 time: 0.122642 Sep 10 11:26:00.162825 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1949/6214] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:00 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:01.186413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef0f2dd9-9e8b-4768-826f-90d4340331d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:01.187046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef0f2dd9-9e8b-4768-826f-90d4340331d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:01.196184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0f2dd9-9e8b-4768-826f-90d4340331d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:01.196697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0f2dd9-9e8b-4768-826f-90d4340331d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:01.197184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0f2dd9-9e8b-4768-826f-90d4340331d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:01.198066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0f2dd9-9e8b-4768-826f-90d4340331d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:01.198599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0f2dd9-9e8b-4768-826f-90d4340331d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:01.198993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0f2dd9-9e8b-4768-826f-90d4340331d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:01.423493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef0f2dd9-9e8b-4768-826f-90d4340331d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:01.432659 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef0f2dd9-9e8b-4768-826f-90d4340331d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1315 microversion: 2.1 time: 0.250146 Sep 10 11:26:01.433784 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4266/6215] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:01 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:01.660121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-4106ac47-c3f1-4111-b301-1bc7b8dfd66d req-8007519f-7319-431a-8c70-b534d1025c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70350f46-35fa-41d4-8350-ebc5e16bdf57", "tag": "872c29ac-912f-47e6-9710-5b1ca6afa17e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:26:01.674275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4106ac47-c3f1-4111-b301-1bc7b8dfd66d req-8007519f-7319-431a-8c70-b534d1025c10 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:01.674759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4106ac47-c3f1-4111-b301-1bc7b8dfd66d req-8007519f-7319-431a-8c70-b534d1025c10 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:01.675195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-4106ac47-c3f1-4111-b301-1bc7b8dfd66d req-8007519f-7319-431a-8c70-b534d1025c10 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:01.688517 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-4106ac47-c3f1-4111-b301-1bc7b8dfd66d req-8007519f-7319-431a-8c70-b534d1025c10 service nova] Creating event network-changed:872c29ac-912f-47e6-9710-5b1ca6afa17e for instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 on n-h1-856894-1 Sep 10 11:26:01.694598 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-4106ac47-c3f1-4111-b301-1bc7b8dfd66d req-8007519f-7319-431a-8c70-b534d1025c10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040066 Sep 10 11:26:01.695213 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1950/6216] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:26:02.456055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a75d939-10ea-4f84-bffe-2317797ea995 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:02.456692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a75d939-10ea-4f84-bffe-2317797ea995 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:02.463675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a75d939-10ea-4f84-bffe-2317797ea995 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:02.464174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a75d939-10ea-4f84-bffe-2317797ea995 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:02.464630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a75d939-10ea-4f84-bffe-2317797ea995 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:02.465360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a75d939-10ea-4f84-bffe-2317797ea995 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:02.465833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a75d939-10ea-4f84-bffe-2317797ea995 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:02.466277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a75d939-10ea-4f84-bffe-2317797ea995 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:02.603995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3a75d939-10ea-4f84-bffe-2317797ea995 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:02.611805 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a75d939-10ea-4f84-bffe-2317797ea995 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1315 microversion: 2.1 time: 0.159707 Sep 10 11:26:02.612593 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4267/6217] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:02 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:03.636611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-25c302fd-fd65-41f1-8f24-578d4336c4d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:03.637359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-25c302fd-fd65-41f1-8f24-578d4336c4d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:03.643584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25c302fd-fd65-41f1-8f24-578d4336c4d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:03.644068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25c302fd-fd65-41f1-8f24-578d4336c4d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:03.644510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25c302fd-fd65-41f1-8f24-578d4336c4d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:03.645236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25c302fd-fd65-41f1-8f24-578d4336c4d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:03.645694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25c302fd-fd65-41f1-8f24-578d4336c4d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:03.646626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-25c302fd-fd65-41f1-8f24-578d4336c4d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:03.781642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-25c302fd-fd65-41f1-8f24-578d4336c4d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:03.790446 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-25c302fd-fd65-41f1-8f24-578d4336c4d3 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1315 microversion: 2.1 time: 0.158933 Sep 10 11:26:03.791015 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1951/6218] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:03 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:04.813049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a4c97c2c-e0d0-4446-af93-541e44e8cbc2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:04.813719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a4c97c2c-e0d0-4446-af93-541e44e8cbc2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:04.820412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4c97c2c-e0d0-4446-af93-541e44e8cbc2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:04.820909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4c97c2c-e0d0-4446-af93-541e44e8cbc2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:04.821391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4c97c2c-e0d0-4446-af93-541e44e8cbc2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:04.822084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4c97c2c-e0d0-4446-af93-541e44e8cbc2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:04.822552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4c97c2c-e0d0-4446-af93-541e44e8cbc2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:04.822987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a4c97c2c-e0d0-4446-af93-541e44e8cbc2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:04.950750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a4c97c2c-e0d0-4446-af93-541e44e8cbc2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:04.958606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a4c97c2c-e0d0-4446-af93-541e44e8cbc2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1315 microversion: 2.1 time: 0.149450 Sep 10 11:26:04.959188 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4268/6219] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:04 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:05.982051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-04a08496-7a7a-4137-bf89-00126eb0a693 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:05.982623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-04a08496-7a7a-4137-bf89-00126eb0a693 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:05.989515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a08496-7a7a-4137-bf89-00126eb0a693 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:05.990547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a08496-7a7a-4137-bf89-00126eb0a693 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:05.991019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a08496-7a7a-4137-bf89-00126eb0a693 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:05.991707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a08496-7a7a-4137-bf89-00126eb0a693 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:05.992166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a08496-7a7a-4137-bf89-00126eb0a693 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:05.992590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a08496-7a7a-4137-bf89-00126eb0a693 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:06.127308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-04a08496-7a7a-4137-bf89-00126eb0a693 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:06.135160 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-04a08496-7a7a-4137-bf89-00126eb0a693 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1315 microversion: 2.1 time: 0.157107 Sep 10 11:26:06.135735 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1952/6220] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:05 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:07.081797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-21ccf911-7766-4806-a63e-33e1021a0b06 req-e9039969-f1df-42ea-b192-f10523e29f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70350f46-35fa-41d4-8350-ebc5e16bdf57", "name": "network-vif-plugged", "status": "completed", "tag": "872c29ac-912f-47e6-9710-5b1ca6afa17e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:26:07.093463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-21ccf911-7766-4806-a63e-33e1021a0b06 req-e9039969-f1df-42ea-b192-f10523e29f37 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:07.093966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-21ccf911-7766-4806-a63e-33e1021a0b06 req-e9039969-f1df-42ea-b192-f10523e29f37 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:07.094427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-21ccf911-7766-4806-a63e-33e1021a0b06 req-e9039969-f1df-42ea-b192-f10523e29f37 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:07.106149 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-21ccf911-7766-4806-a63e-33e1021a0b06 req-e9039969-f1df-42ea-b192-f10523e29f37 service nova] Creating event network-vif-plugged:872c29ac-912f-47e6-9710-5b1ca6afa17e for instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 on n-h1-856894-1 Sep 10 11:26:07.111070 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-21ccf911-7766-4806-a63e-33e1021a0b06 req-e9039969-f1df-42ea-b192-f10523e29f37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033083 Sep 10 11:26:07.111846 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4269/6221] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:26:07.158622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c03e9a76-a77f-41f4-8a44-0e27103c57ec tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:07.159268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c03e9a76-a77f-41f4-8a44-0e27103c57ec tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:07.166804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c03e9a76-a77f-41f4-8a44-0e27103c57ec tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:07.167515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c03e9a76-a77f-41f4-8a44-0e27103c57ec tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:07.168166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c03e9a76-a77f-41f4-8a44-0e27103c57ec tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:07.169367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c03e9a76-a77f-41f4-8a44-0e27103c57ec tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:07.169834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c03e9a76-a77f-41f4-8a44-0e27103c57ec tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:07.170296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c03e9a76-a77f-41f4-8a44-0e27103c57ec tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:07.339750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c03e9a76-a77f-41f4-8a44-0e27103c57ec tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:07.347449 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c03e9a76-a77f-41f4-8a44-0e27103c57ec tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1315 microversion: 2.1 time: 0.193037 Sep 10 11:26:07.348022 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1953/6222] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:07 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:08.372189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2d64172-c07f-42cd-9601-83b16f5d0a54 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:08.373091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2d64172-c07f-42cd-9601-83b16f5d0a54 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:08.375156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:08.382050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2d64172-c07f-42cd-9601-83b16f5d0a54 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:08.382568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2d64172-c07f-42cd-9601-83b16f5d0a54 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:08.383023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2d64172-c07f-42cd-9601-83b16f5d0a54 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:08.383741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2d64172-c07f-42cd-9601-83b16f5d0a54 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:08.384205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2d64172-c07f-42cd-9601-83b16f5d0a54 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:08.384646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2d64172-c07f-42cd-9601-83b16f5d0a54 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:08.387909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:08.523569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f2d64172-c07f-42cd-9601-83b16f5d0a54 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:08.531763 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2d64172-c07f-42cd-9601-83b16f5d0a54 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1501 microversion: 2.1 time: 0.165190 Sep 10 11:26:08.532350 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4270/6223] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:08 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:08.554265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:26:08.556590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:08.563438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:08.563921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:08.564354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:08.565037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:08.565509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:08.565928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:08.639654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:08.645274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Old instance type m1.heat2, new instance type m1.heat {{(pid=128787) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:26:08.652283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:26:08.652703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:26:08.653202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:26:08.653617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:26:08.654025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:26:08.763254 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d7b35eda-4390-4000-97f7-9d8393a761be tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "POST /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57/action" status: 202 len: 0 microversion: 2.1 time: 0.212904 Sep 10 11:26:08.763912 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1954/6224] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:26:08 2022] POST /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:26:08.772176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e873a2de-e39a-4a70-bcd5-0488ecdfa889 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:08.772815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e873a2de-e39a-4a70-bcd5-0488ecdfa889 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:08.779061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e873a2de-e39a-4a70-bcd5-0488ecdfa889 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:08.779694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e873a2de-e39a-4a70-bcd5-0488ecdfa889 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:08.780220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e873a2de-e39a-4a70-bcd5-0488ecdfa889 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:08.780991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e873a2de-e39a-4a70-bcd5-0488ecdfa889 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:08.781557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e873a2de-e39a-4a70-bcd5-0488ecdfa889 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:08.782132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e873a2de-e39a-4a70-bcd5-0488ecdfa889 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:08.944677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e873a2de-e39a-4a70-bcd5-0488ecdfa889 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:08.952608 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e873a2de-e39a-4a70-bcd5-0488ecdfa889 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1510 microversion: 2.1 time: 0.184443 Sep 10 11:26:08.953220 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4271/6225] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:08 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:26:09.971806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=5 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:09.972576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:09.978045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4d20497b-2488-4429-84b7-b3ba1a2706a0 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:09.978683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4d20497b-2488-4429-84b7-b3ba1a2706a0 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:09.980440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:09.988032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d20497b-2488-4429-84b7-b3ba1a2706a0 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:09.988524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d20497b-2488-4429-84b7-b3ba1a2706a0 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:09.988966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d20497b-2488-4429-84b7-b3ba1a2706a0 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:09.989700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d20497b-2488-4429-84b7-b3ba1a2706a0 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:09.990160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d20497b-2488-4429-84b7-b3ba1a2706a0 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:09.990588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d20497b-2488-4429-84b7-b3ba1a2706a0 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:09.995080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:10.121816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4d20497b-2488-4429-84b7-b3ba1a2706a0 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:10.129598 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4d20497b-2488-4429-84b7-b3ba1a2706a0 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1510 microversion: 2.1 time: 0.158605 Sep 10 11:26:10.130176 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1955/6226] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:09 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:11.153229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ace7b08e-a64f-458c-80e9-ead318462224 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:11.153862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ace7b08e-a64f-458c-80e9-ead318462224 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:11.155785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:11.162782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace7b08e-a64f-458c-80e9-ead318462224 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:11.163284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace7b08e-a64f-458c-80e9-ead318462224 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:11.163741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace7b08e-a64f-458c-80e9-ead318462224 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:11.164453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace7b08e-a64f-458c-80e9-ead318462224 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:11.164925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace7b08e-a64f-458c-80e9-ead318462224 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:11.165398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ace7b08e-a64f-458c-80e9-ead318462224 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:11.295547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ace7b08e-a64f-458c-80e9-ead318462224 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:11.303380 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ace7b08e-a64f-458c-80e9-ead318462224 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.154153 Sep 10 11:26:11.303955 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4272/6227] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:11 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:12.326332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-12179628-1ff8-459e-b011-3175cee9c0d2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:12.326952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-12179628-1ff8-459e-b011-3175cee9c0d2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:12.333752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12179628-1ff8-459e-b011-3175cee9c0d2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:12.334241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12179628-1ff8-459e-b011-3175cee9c0d2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:12.334681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12179628-1ff8-459e-b011-3175cee9c0d2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:12.335368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12179628-1ff8-459e-b011-3175cee9c0d2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:12.335825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12179628-1ff8-459e-b011-3175cee9c0d2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:12.336252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-12179628-1ff8-459e-b011-3175cee9c0d2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:12.468217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-12179628-1ff8-459e-b011-3175cee9c0d2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:12.476382 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-12179628-1ff8-459e-b011-3175cee9c0d2 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.154017 Sep 10 11:26:12.476951 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1956/6228] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:12 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:13.500296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae45173c-078c-4077-89c5-e2a3296e8921 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:13.500961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ae45173c-078c-4077-89c5-e2a3296e8921 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:13.508533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae45173c-078c-4077-89c5-e2a3296e8921 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:13.509039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae45173c-078c-4077-89c5-e2a3296e8921 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:13.509520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae45173c-078c-4077-89c5-e2a3296e8921 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:13.510227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae45173c-078c-4077-89c5-e2a3296e8921 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:13.510704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae45173c-078c-4077-89c5-e2a3296e8921 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:13.511152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae45173c-078c-4077-89c5-e2a3296e8921 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:13.636634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae45173c-078c-4077-89c5-e2a3296e8921 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:13.644403 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae45173c-078c-4077-89c5-e2a3296e8921 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.148077 Sep 10 11:26:13.644989 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4273/6229] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:13 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:14.667178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-29efdd3b-0508-4a88-a08c-4ae5693c6532 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:14.667794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-29efdd3b-0508-4a88-a08c-4ae5693c6532 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:14.674948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29efdd3b-0508-4a88-a08c-4ae5693c6532 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:14.675435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29efdd3b-0508-4a88-a08c-4ae5693c6532 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:14.675873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29efdd3b-0508-4a88-a08c-4ae5693c6532 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:14.676560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29efdd3b-0508-4a88-a08c-4ae5693c6532 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:14.677016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29efdd3b-0508-4a88-a08c-4ae5693c6532 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:14.677477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29efdd3b-0508-4a88-a08c-4ae5693c6532 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:14.807200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-29efdd3b-0508-4a88-a08c-4ae5693c6532 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:14.814929 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-29efdd3b-0508-4a88-a08c-4ae5693c6532 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.151671 Sep 10 11:26:14.815494 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1957/6230] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:14 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:15.838434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e107a384-d353-44b8-ad14-1480681f54ea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:15.839061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e107a384-d353-44b8-ad14-1480681f54ea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:15.846022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e107a384-d353-44b8-ad14-1480681f54ea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:15.846520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e107a384-d353-44b8-ad14-1480681f54ea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:15.846972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e107a384-d353-44b8-ad14-1480681f54ea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:15.847668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e107a384-d353-44b8-ad14-1480681f54ea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:15.848134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e107a384-d353-44b8-ad14-1480681f54ea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:15.848571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e107a384-d353-44b8-ad14-1480681f54ea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:15.977445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e107a384-d353-44b8-ad14-1480681f54ea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:15.985266 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e107a384-d353-44b8-ad14-1480681f54ea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.151002 Sep 10 11:26:15.985846 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4274/6231] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:15 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:17.007805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9dfa26d7-116d-4114-bde1-5252e66c0aea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:17.008466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9dfa26d7-116d-4114-bde1-5252e66c0aea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:17.015636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dfa26d7-116d-4114-bde1-5252e66c0aea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:17.016131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dfa26d7-116d-4114-bde1-5252e66c0aea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:17.016570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dfa26d7-116d-4114-bde1-5252e66c0aea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:17.017295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dfa26d7-116d-4114-bde1-5252e66c0aea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:17.017756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dfa26d7-116d-4114-bde1-5252e66c0aea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:17.018184 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dfa26d7-116d-4114-bde1-5252e66c0aea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:17.144295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9dfa26d7-116d-4114-bde1-5252e66c0aea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:17.152975 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9dfa26d7-116d-4114-bde1-5252e66c0aea tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.148997 Sep 10 11:26:17.153523 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1958/6232] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:17 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:18.176721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8962ff9-23c4-4ff2-8e55-e0c398667598 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:18.177382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8962ff9-23c4-4ff2-8e55-e0c398667598 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:18.184625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8962ff9-23c4-4ff2-8e55-e0c398667598 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:18.185160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8962ff9-23c4-4ff2-8e55-e0c398667598 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:18.185853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8962ff9-23c4-4ff2-8e55-e0c398667598 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:18.187136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8962ff9-23c4-4ff2-8e55-e0c398667598 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:18.187942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8962ff9-23c4-4ff2-8e55-e0c398667598 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:18.188398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8962ff9-23c4-4ff2-8e55-e0c398667598 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:18.319719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8962ff9-23c4-4ff2-8e55-e0c398667598 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:18.327547 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8962ff9-23c4-4ff2-8e55-e0c398667598 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.154931 Sep 10 11:26:18.328073 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4275/6233] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:18 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:26:19.350157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b7052976-642a-4f04-8d0c-f678a3bdddb5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:19.350743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b7052976-642a-4f04-8d0c-f678a3bdddb5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:19.357611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7052976-642a-4f04-8d0c-f678a3bdddb5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:19.358102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7052976-642a-4f04-8d0c-f678a3bdddb5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:19.358542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7052976-642a-4f04-8d0c-f678a3bdddb5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:19.359239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7052976-642a-4f04-8d0c-f678a3bdddb5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:19.359700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7052976-642a-4f04-8d0c-f678a3bdddb5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:19.360125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b7052976-642a-4f04-8d0c-f678a3bdddb5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:19.486909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b7052976-642a-4f04-8d0c-f678a3bdddb5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:19.495060 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b7052976-642a-4f04-8d0c-f678a3bdddb5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.148886 Sep 10 11:26:19.495660 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1959/6234] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:19 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:20.518796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-09b33add-5114-4f26-98f1-2ec844120090 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:20.519451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-09b33add-5114-4f26-98f1-2ec844120090 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:20.526938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09b33add-5114-4f26-98f1-2ec844120090 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:20.527456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09b33add-5114-4f26-98f1-2ec844120090 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:20.527902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09b33add-5114-4f26-98f1-2ec844120090 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:20.528596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09b33add-5114-4f26-98f1-2ec844120090 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:20.529056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09b33add-5114-4f26-98f1-2ec844120090 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:20.529521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-09b33add-5114-4f26-98f1-2ec844120090 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:20.663158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-09b33add-5114-4f26-98f1-2ec844120090 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:20.671328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-09b33add-5114-4f26-98f1-2ec844120090 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.156397 Sep 10 11:26:20.671914 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4276/6235] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:20 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:21.694611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e405be5e-a40f-4050-a444-e5ab2bfa9376 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:21.695227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e405be5e-a40f-4050-a444-e5ab2bfa9376 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:21.702172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e405be5e-a40f-4050-a444-e5ab2bfa9376 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:21.702652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e405be5e-a40f-4050-a444-e5ab2bfa9376 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:21.703087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e405be5e-a40f-4050-a444-e5ab2bfa9376 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:21.703769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e405be5e-a40f-4050-a444-e5ab2bfa9376 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:21.704221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e405be5e-a40f-4050-a444-e5ab2bfa9376 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:21.704645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e405be5e-a40f-4050-a444-e5ab2bfa9376 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:21.835542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e405be5e-a40f-4050-a444-e5ab2bfa9376 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:21.843250 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e405be5e-a40f-4050-a444-e5ab2bfa9376 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.152557 Sep 10 11:26:21.843822 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1960/6236] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:21 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:22.865712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10950235-27ea-4636-8a1b-af70a1a2d1a9 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:22.866795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-10950235-27ea-4636-8a1b-af70a1a2d1a9 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:22.873806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10950235-27ea-4636-8a1b-af70a1a2d1a9 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:22.874302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10950235-27ea-4636-8a1b-af70a1a2d1a9 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:22.874746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10950235-27ea-4636-8a1b-af70a1a2d1a9 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:22.875438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10950235-27ea-4636-8a1b-af70a1a2d1a9 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:22.875902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10950235-27ea-4636-8a1b-af70a1a2d1a9 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:22.876340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10950235-27ea-4636-8a1b-af70a1a2d1a9 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:23.017812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-10950235-27ea-4636-8a1b-af70a1a2d1a9 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:23.026122 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10950235-27ea-4636-8a1b-af70a1a2d1a9 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.164476 Sep 10 11:26:23.026680 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4277/6237] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:22 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:24.049862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5a712f57-c20e-487b-be1c-2f54eb45073c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:24.050471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5a712f57-c20e-487b-be1c-2f54eb45073c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:24.053938 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:26:24.054088 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 11:26:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 (ip 10.222.0.20) !!! Sep 10 11:26:24.065202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a712f57-c20e-487b-be1c-2f54eb45073c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:24.065721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a712f57-c20e-487b-be1c-2f54eb45073c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:24.066153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a712f57-c20e-487b-be1c-2f54eb45073c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:24.066837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a712f57-c20e-487b-be1c-2f54eb45073c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:24.067292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a712f57-c20e-487b-be1c-2f54eb45073c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:24.067713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a712f57-c20e-487b-be1c-2f54eb45073c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:24.195063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5a712f57-c20e-487b-be1c-2f54eb45073c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:24.202727 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5a712f57-c20e-487b-be1c-2f54eb45073c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.156698 Sep 10 11:26:24.203305 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1961/6238] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:24 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:25.225349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e452e452-a8ca-4c71-a48a-bc5f5ec2707d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:25.226531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e452e452-a8ca-4c71-a48a-bc5f5ec2707d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:25.235227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e452e452-a8ca-4c71-a48a-bc5f5ec2707d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:25.235753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e452e452-a8ca-4c71-a48a-bc5f5ec2707d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:25.236195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e452e452-a8ca-4c71-a48a-bc5f5ec2707d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:25.236917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e452e452-a8ca-4c71-a48a-bc5f5ec2707d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:25.237408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e452e452-a8ca-4c71-a48a-bc5f5ec2707d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:25.237858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e452e452-a8ca-4c71-a48a-bc5f5ec2707d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:25.373431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e452e452-a8ca-4c71-a48a-bc5f5ec2707d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:25.381927 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e452e452-a8ca-4c71-a48a-bc5f5ec2707d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.159971 Sep 10 11:26:25.382516 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4278/6239] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:25 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:26.405028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f75239b1-66bd-4f6c-ae45-22a9d50dfb4e tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:26.405693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f75239b1-66bd-4f6c-ae45-22a9d50dfb4e tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:26.412490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f75239b1-66bd-4f6c-ae45-22a9d50dfb4e tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:26.412968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f75239b1-66bd-4f6c-ae45-22a9d50dfb4e tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:26.413432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f75239b1-66bd-4f6c-ae45-22a9d50dfb4e tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:26.414768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f75239b1-66bd-4f6c-ae45-22a9d50dfb4e tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:26.415217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f75239b1-66bd-4f6c-ae45-22a9d50dfb4e tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:26.415642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f75239b1-66bd-4f6c-ae45-22a9d50dfb4e tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:26.545435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f75239b1-66bd-4f6c-ae45-22a9d50dfb4e tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:26.553010 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f75239b1-66bd-4f6c-ae45-22a9d50dfb4e tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.151871 Sep 10 11:26:26.553607 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1962/6240] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:26 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:27.577064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c84ebaf2-6dce-4509-ad83-eaba4c75f4e4 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:27.577740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c84ebaf2-6dce-4509-ad83-eaba4c75f4e4 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:27.584512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84ebaf2-6dce-4509-ad83-eaba4c75f4e4 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:27.585007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84ebaf2-6dce-4509-ad83-eaba4c75f4e4 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:27.586139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84ebaf2-6dce-4509-ad83-eaba4c75f4e4 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:27.586842 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84ebaf2-6dce-4509-ad83-eaba4c75f4e4 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:27.587310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84ebaf2-6dce-4509-ad83-eaba4c75f4e4 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:27.587770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c84ebaf2-6dce-4509-ad83-eaba4c75f4e4 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:27.714806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c84ebaf2-6dce-4509-ad83-eaba4c75f4e4 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:27.722613 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c84ebaf2-6dce-4509-ad83-eaba4c75f4e4 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.149485 Sep 10 11:26:27.723190 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4279/6241] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:27 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:28.745584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bf5ccef7-bad7-4234-be2c-adb049297936 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:28.746198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bf5ccef7-bad7-4234-be2c-adb049297936 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:28.753164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf5ccef7-bad7-4234-be2c-adb049297936 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:28.753807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf5ccef7-bad7-4234-be2c-adb049297936 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:28.754244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf5ccef7-bad7-4234-be2c-adb049297936 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:28.754953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf5ccef7-bad7-4234-be2c-adb049297936 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:28.755401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf5ccef7-bad7-4234-be2c-adb049297936 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:28.755820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf5ccef7-bad7-4234-be2c-adb049297936 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:28.885607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bf5ccef7-bad7-4234-be2c-adb049297936 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:28.893284 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bf5ccef7-bad7-4234-be2c-adb049297936 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.151597 Sep 10 11:26:28.893863 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1963/6242] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:28 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:29.917088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05068473-a8f5-4656-8861-aff59c2ad745 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:29.917750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05068473-a8f5-4656-8861-aff59c2ad745 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:29.924956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05068473-a8f5-4656-8861-aff59c2ad745 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:29.925493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05068473-a8f5-4656-8861-aff59c2ad745 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:29.925954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05068473-a8f5-4656-8861-aff59c2ad745 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:29.926659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05068473-a8f5-4656-8861-aff59c2ad745 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:29.927132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05068473-a8f5-4656-8861-aff59c2ad745 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:29.927606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05068473-a8f5-4656-8861-aff59c2ad745 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:30.063431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05068473-a8f5-4656-8861-aff59c2ad745 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:30.071957 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05068473-a8f5-4656-8861-aff59c2ad745 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.158904 Sep 10 11:26:30.072552 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4280/6243] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:29 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:31.095095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-35b038f4-59de-4304-abe6-db93f02c27cd tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:31.095702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-35b038f4-59de-4304-abe6-db93f02c27cd tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:31.102522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35b038f4-59de-4304-abe6-db93f02c27cd tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:31.103001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35b038f4-59de-4304-abe6-db93f02c27cd tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:31.103435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35b038f4-59de-4304-abe6-db93f02c27cd tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:31.104116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35b038f4-59de-4304-abe6-db93f02c27cd tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:31.104564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35b038f4-59de-4304-abe6-db93f02c27cd tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:31.104984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35b038f4-59de-4304-abe6-db93f02c27cd tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:31.230452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-35b038f4-59de-4304-abe6-db93f02c27cd tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:31.238232 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-35b038f4-59de-4304-abe6-db93f02c27cd tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.147352 Sep 10 11:26:31.238806 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1964/6244] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:31 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:32.262378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a6ae2f4-e077-4744-8293-ff30aba86542 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:32.263045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a6ae2f4-e077-4744-8293-ff30aba86542 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:32.270018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a6ae2f4-e077-4744-8293-ff30aba86542 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:32.270520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a6ae2f4-e077-4744-8293-ff30aba86542 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:32.270972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a6ae2f4-e077-4744-8293-ff30aba86542 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:32.271674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a6ae2f4-e077-4744-8293-ff30aba86542 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:32.272145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a6ae2f4-e077-4744-8293-ff30aba86542 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:32.272585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a6ae2f4-e077-4744-8293-ff30aba86542 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:32.401609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5a6ae2f4-e077-4744-8293-ff30aba86542 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:32.409346 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a6ae2f4-e077-4744-8293-ff30aba86542 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.150841 Sep 10 11:26:32.409939 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4281/6245] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:32 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:33.433170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0f90ebbb-31c7-4fa2-bdde-756f1b239aa8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:33.433784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0f90ebbb-31c7-4fa2-bdde-756f1b239aa8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:33.440713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f90ebbb-31c7-4fa2-bdde-756f1b239aa8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:33.441240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f90ebbb-31c7-4fa2-bdde-756f1b239aa8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:33.441821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f90ebbb-31c7-4fa2-bdde-756f1b239aa8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:33.442516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f90ebbb-31c7-4fa2-bdde-756f1b239aa8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:33.442975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f90ebbb-31c7-4fa2-bdde-756f1b239aa8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:33.443401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f90ebbb-31c7-4fa2-bdde-756f1b239aa8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:33.569660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0f90ebbb-31c7-4fa2-bdde-756f1b239aa8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:33.577367 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0f90ebbb-31c7-4fa2-bdde-756f1b239aa8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.148824 Sep 10 11:26:33.577939 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1965/6246] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:33 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:34.599743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-39fb422a-9167-4936-8697-c287b84a987c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:34.600377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-39fb422a-9167-4936-8697-c287b84a987c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:34.607819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39fb422a-9167-4936-8697-c287b84a987c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:34.608324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39fb422a-9167-4936-8697-c287b84a987c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:34.608779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39fb422a-9167-4936-8697-c287b84a987c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:34.609514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39fb422a-9167-4936-8697-c287b84a987c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:34.609989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39fb422a-9167-4936-8697-c287b84a987c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:34.610466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-39fb422a-9167-4936-8697-c287b84a987c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:34.741313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-39fb422a-9167-4936-8697-c287b84a987c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:34.749757 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-39fb422a-9167-4936-8697-c287b84a987c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.153929 Sep 10 11:26:34.750342 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4282/6247] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:34 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:35.771804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9dca8f48-d0d2-414a-b627-499bc7f959d8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:35.772418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9dca8f48-d0d2-414a-b627-499bc7f959d8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:35.779761 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dca8f48-d0d2-414a-b627-499bc7f959d8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:35.780247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dca8f48-d0d2-414a-b627-499bc7f959d8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:35.780692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dca8f48-d0d2-414a-b627-499bc7f959d8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:35.781488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dca8f48-d0d2-414a-b627-499bc7f959d8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:35.781947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dca8f48-d0d2-414a-b627-499bc7f959d8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:35.782380 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9dca8f48-d0d2-414a-b627-499bc7f959d8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:36.250109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9dca8f48-d0d2-414a-b627-499bc7f959d8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:36.258379 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9dca8f48-d0d2-414a-b627-499bc7f959d8 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.489917 Sep 10 11:26:36.258976 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1966/6248] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:35 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:37.282297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-191f1b19-0959-4c0c-ab62-e0793cf0fa61 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:37.282926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-191f1b19-0959-4c0c-ab62-e0793cf0fa61 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:37.290924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-191f1b19-0959-4c0c-ab62-e0793cf0fa61 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:37.291475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-191f1b19-0959-4c0c-ab62-e0793cf0fa61 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:37.291927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-191f1b19-0959-4c0c-ab62-e0793cf0fa61 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:37.292694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-191f1b19-0959-4c0c-ab62-e0793cf0fa61 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:37.293212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-191f1b19-0959-4c0c-ab62-e0793cf0fa61 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:37.293654 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-191f1b19-0959-4c0c-ab62-e0793cf0fa61 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:37.428950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-191f1b19-0959-4c0c-ab62-e0793cf0fa61 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:37.437019 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-191f1b19-0959-4c0c-ab62-e0793cf0fa61 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1515 microversion: 2.1 time: 0.158678 Sep 10 11:26:37.437642 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4283/6249] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:37 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:38.213825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-3e564c5a-8ff9-4595-99bf-6e0a952c36fd req-6fc429be-2a1d-4bea-84ea-cd635b1234c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70350f46-35fa-41d4-8350-ebc5e16bdf57", "name": "network-vif-unplugged", "status": "completed", "tag": "872c29ac-912f-47e6-9710-5b1ca6afa17e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:26:38.224113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3e564c5a-8ff9-4595-99bf-6e0a952c36fd req-6fc429be-2a1d-4bea-84ea-cd635b1234c8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:38.224586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3e564c5a-8ff9-4595-99bf-6e0a952c36fd req-6fc429be-2a1d-4bea-84ea-cd635b1234c8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:38.225014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-3e564c5a-8ff9-4595-99bf-6e0a952c36fd req-6fc429be-2a1d-4bea-84ea-cd635b1234c8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:38.237231 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-3e564c5a-8ff9-4595-99bf-6e0a952c36fd req-6fc429be-2a1d-4bea-84ea-cd635b1234c8 service nova] Creating event network-vif-unplugged:872c29ac-912f-47e6-9710-5b1ca6afa17e for instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 on n-h2-856894-1 Sep 10 11:26:38.243626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-3e564c5a-8ff9-4595-99bf-6e0a952c36fd req-6fc429be-2a1d-4bea-84ea-cd635b1234c8 service nova] Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:26:38.254539 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-3e564c5a-8ff9-4595-99bf-6e0a952c36fd req-6fc429be-2a1d-4bea-84ea-cd635b1234c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044484 Sep 10 11:26:38.255321 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1967/6250] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:26:38.459881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ee8e7c2-2596-46b0-a2ea-3bccd8d6020b tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:38.460509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8ee8e7c2-2596-46b0-a2ea-3bccd8d6020b tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:38.463266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=28 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:38.468670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ee8e7c2-2596-46b0-a2ea-3bccd8d6020b tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:38.469223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ee8e7c2-2596-46b0-a2ea-3bccd8d6020b tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:38.469677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ee8e7c2-2596-46b0-a2ea-3bccd8d6020b tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:38.470393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ee8e7c2-2596-46b0-a2ea-3bccd8d6020b tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:38.471201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ee8e7c2-2596-46b0-a2ea-3bccd8d6020b tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:38.471330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8ee8e7c2-2596-46b0-a2ea-3bccd8d6020b tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:38.475846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=84 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:38.732679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8ee8e7c2-2596-46b0-a2ea-3bccd8d6020b tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:38.740621 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ee8e7c2-2596-46b0-a2ea-3bccd8d6020b tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1514 microversion: 2.1 time: 0.284662 Sep 10 11:26:38.741239 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4284/6251] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:38 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:39.765831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-82a05933-25ab-41a9-ac37-6da28b049b97 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:39.766512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-82a05933-25ab-41a9-ac37-6da28b049b97 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:39.772566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82a05933-25ab-41a9-ac37-6da28b049b97 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:39.773039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82a05933-25ab-41a9-ac37-6da28b049b97 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:39.773526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82a05933-25ab-41a9-ac37-6da28b049b97 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:39.774205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82a05933-25ab-41a9-ac37-6da28b049b97 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:39.774653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82a05933-25ab-41a9-ac37-6da28b049b97 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:39.775070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-82a05933-25ab-41a9-ac37-6da28b049b97 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:39.910076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-82a05933-25ab-41a9-ac37-6da28b049b97 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:39.918207 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-82a05933-25ab-41a9-ac37-6da28b049b97 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1512 microversion: 2.1 time: 0.157463 Sep 10 11:26:39.918780 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1968/6252] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:39 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:40.282147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-fa10c9d2-8ec8-409e-aeb1-947d556df93e req-6bf07b05-3f6c-428e-ac62-c4dfe4f7d663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70350f46-35fa-41d4-8350-ebc5e16bdf57", "tag": "872c29ac-912f-47e6-9710-5b1ca6afa17e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:26:40.293767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fa10c9d2-8ec8-409e-aeb1-947d556df93e req-6bf07b05-3f6c-428e-ac62-c4dfe4f7d663 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:40.294525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fa10c9d2-8ec8-409e-aeb1-947d556df93e req-6bf07b05-3f6c-428e-ac62-c4dfe4f7d663 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:40.294973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fa10c9d2-8ec8-409e-aeb1-947d556df93e req-6bf07b05-3f6c-428e-ac62-c4dfe4f7d663 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:40.306432 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-fa10c9d2-8ec8-409e-aeb1-947d556df93e req-6bf07b05-3f6c-428e-ac62-c4dfe4f7d663 service nova] Creating event network-changed:872c29ac-912f-47e6-9710-5b1ca6afa17e for instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 on n-h2-856894-1 Sep 10 11:26:40.312330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-fa10c9d2-8ec8-409e-aeb1-947d556df93e req-6bf07b05-3f6c-428e-ac62-c4dfe4f7d663 service nova] Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:26:40.323397 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-fa10c9d2-8ec8-409e-aeb1-947d556df93e req-6bf07b05-3f6c-428e-ac62-c4dfe4f7d663 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044941 Sep 10 11:26:40.324376 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4285/6253] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:26:40.942002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f518c049-19ac-4f59-8630-01bf3fba9dd7 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:40.943212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f518c049-19ac-4f59-8630-01bf3fba9dd7 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:40.946753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=28 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:40.953340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f518c049-19ac-4f59-8630-01bf3fba9dd7 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:40.954060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f518c049-19ac-4f59-8630-01bf3fba9dd7 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:40.954653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f518c049-19ac-4f59-8630-01bf3fba9dd7 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:40.956368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f518c049-19ac-4f59-8630-01bf3fba9dd7 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:40.956995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f518c049-19ac-4f59-8630-01bf3fba9dd7 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:40.957834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f518c049-19ac-4f59-8630-01bf3fba9dd7 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:40.966570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=82 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:41.126680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f518c049-19ac-4f59-8630-01bf3fba9dd7 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:41.135093 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f518c049-19ac-4f59-8630-01bf3fba9dd7 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1509 microversion: 2.1 time: 0.196959 Sep 10 11:26:41.135680 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1969/6254] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:40 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:41.158087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:41.158732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:41.165269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:41.165844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:41.166377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:41.167168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:41.167723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:41.168282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:41.197193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:26:41.249086 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.compute.api [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Found an unconfirmed migration during delete, id: 16, status: finished Sep 10 11:26:42.772673 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-682a0b32-1918-4cc4-bf44-2bd0b89ce77c tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 204 len: 0 microversion: 2.1 time: 1.618581 Sep 10 11:26:42.777088 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4286/6255] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:26:41 2022] DELETE /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 0 bytes in 1621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:26:42.782485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-42c66168-caac-4c10-b9ee-3abdf283e28d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:42.783123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-42c66168-caac-4c10-b9ee-3abdf283e28d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:42.791950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42c66168-caac-4c10-b9ee-3abdf283e28d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:42.792444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42c66168-caac-4c10-b9ee-3abdf283e28d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:42.792880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42c66168-caac-4c10-b9ee-3abdf283e28d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:42.793605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42c66168-caac-4c10-b9ee-3abdf283e28d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:42.794324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42c66168-caac-4c10-b9ee-3abdf283e28d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:42.794750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42c66168-caac-4c10-b9ee-3abdf283e28d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:42.923583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-42c66168-caac-4c10-b9ee-3abdf283e28d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:42.931305 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-42c66168-caac-4c10-b9ee-3abdf283e28d tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1501 microversion: 2.1 time: 0.153100 Sep 10 11:26:42.931879 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1970/6256] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:42 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:26:43.196080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-303ba85c-0e95-4206-b9f0-bf2ab7a89f8f req-04dc3a03-8e0f-48d2-813d-1394be683b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70350f46-35fa-41d4-8350-ebc5e16bdf57", "name": "network-vif-plugged", "status": "completed", "tag": "872c29ac-912f-47e6-9710-5b1ca6afa17e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:26:43.206154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-303ba85c-0e95-4206-b9f0-bf2ab7a89f8f req-04dc3a03-8e0f-48d2-813d-1394be683b65 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:43.206637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-303ba85c-0e95-4206-b9f0-bf2ab7a89f8f req-04dc3a03-8e0f-48d2-813d-1394be683b65 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:43.207080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-303ba85c-0e95-4206-b9f0-bf2ab7a89f8f req-04dc3a03-8e0f-48d2-813d-1394be683b65 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:43.217606 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-303ba85c-0e95-4206-b9f0-bf2ab7a89f8f req-04dc3a03-8e0f-48d2-813d-1394be683b65 service nova] Creating event network-vif-plugged:872c29ac-912f-47e6-9710-5b1ca6afa17e for instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 on n-h2-856894-1 Sep 10 11:26:43.223157 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-303ba85c-0e95-4206-b9f0-bf2ab7a89f8f req-04dc3a03-8e0f-48d2-813d-1394be683b65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099596 Sep 10 11:26:43.223734 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4287/6257] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:26:43.957378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7dc126bb-58cf-4bc4-bc1d-b8730721bd60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:43.957901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7dc126bb-58cf-4bc4-bc1d-b8730721bd60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:43.965575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc126bb-58cf-4bc4-bc1d-b8730721bd60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:43.966060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc126bb-58cf-4bc4-bc1d-b8730721bd60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:43.966492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc126bb-58cf-4bc4-bc1d-b8730721bd60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:43.967182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc126bb-58cf-4bc4-bc1d-b8730721bd60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:43.967744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc126bb-58cf-4bc4-bc1d-b8730721bd60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:43.968174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dc126bb-58cf-4bc4-bc1d-b8730721bd60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:44.095479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7dc126bb-58cf-4bc4-bc1d-b8730721bd60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:44.104025 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7dc126bb-58cf-4bc4-bc1d-b8730721bd60 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1501 microversion: 2.1 time: 0.152820 Sep 10 11:26:44.104611 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1971/6258] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:43 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:44.943074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c1f14c52-c601-44c6-9a42-a497dfd08df1 req-b50af54c-5b38-45c7-9943-0e2996adec5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70350f46-35fa-41d4-8350-ebc5e16bdf57", "name": "network-vif-deleted", "tag": "872c29ac-912f-47e6-9710-5b1ca6afa17e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:26:44.964895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c1f14c52-c601-44c6-9a42-a497dfd08df1 req-b50af54c-5b38-45c7-9943-0e2996adec5c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:44.965494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c1f14c52-c601-44c6-9a42-a497dfd08df1 req-b50af54c-5b38-45c7-9943-0e2996adec5c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:44.965942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c1f14c52-c601-44c6-9a42-a497dfd08df1 req-b50af54c-5b38-45c7-9943-0e2996adec5c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:44.979677 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c1f14c52-c601-44c6-9a42-a497dfd08df1 req-b50af54c-5b38-45c7-9943-0e2996adec5c service nova] Creating event network-vif-deleted:872c29ac-912f-47e6-9710-5b1ca6afa17e for instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 on n-h2-856894-1 Sep 10 11:26:44.985664 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c1f14c52-c601-44c6-9a42-a497dfd08df1 req-b50af54c-5b38-45c7-9943-0e2996adec5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047237 Sep 10 11:26:44.986444 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4288/6259] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:26:45.127895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:45.128512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:45.137209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:45.137707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:45.138190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:45.138906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:45.139348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:45.139806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:45.171769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:45.172176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:45.172613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:45.173061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lazy-loading 'fault' on Instance uuid 70350f46-35fa-41d4-8350-ebc5e16bdf57 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:26:45.213649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137ab9a64bad4e6495da7088a4155073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f93f50077694fb8b159cef508bfc69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:45.221374 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fb297aa9-4ccb-424e-a1ef-e9dfb39fd1ee tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 200 len: 1305 microversion: 2.1 time: 0.097552 Sep 10 11:26:45.221957 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1972/6260] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:45 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:46.245916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:46.246657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:46.252872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:46.253412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:46.253864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:46.254566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:46.255041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:46.255486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:46.268687 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] HTTP exception thrown: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Request method failure captured: Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 HTTP/1.1 Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHRGTY30kyH6GAP_6sJdBFHDP2zK2drhm0DlOKK3meQkXxkSUXuaaZ4oRsJ4KRZg0ugN0PDsFPcX5xEHCsnimnf4iAPfbSP9Vkp060T43B5ZEZT2RqvSiVCuUb8vufp4IPTuVJW6NWsNPhtmjM7pfJY9e0_KXIwGRPt5rId33Odd7rI Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 4f93f50077694fb8b159cef508bfc69d Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-699146998 Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f93f50077694fb8b159cef508bfc69d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4f93f50077694fb8b159cef508bfc69d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f93f50077694fb8b159cef508bfc69d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4f93f50077694fb8b159cef508bfc69d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-699146998 Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 4f93f50077694fb8b159cef508bfc69d Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-699146998 Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-699146998-project Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 137ab9a64bad4e6495da7088a4155073 Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-699146998-project Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '70350f46-35fa-41d4-8350-ebc5e16bdf57'} Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:26:46.270290 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.274411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:26:46.274411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:26:46.274411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:26:46.274411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:26:46.274411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:26:46.274411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.274411 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.274411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Returning 404 to user: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:26:46.274411 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1eb3ab1-e978-4e83-9027-42fe574949ad tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 404 len: 111 microversion: 2.1 time: 0.031000 Sep 10 11:26:46.274411 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4289/6261] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:46 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:26:46.287082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:46.287619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:46.295347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:46.295847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:46.296273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:46.296962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:46.297446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:46.297874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:46.313609 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] HTTP exception thrown: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Request method failure captured: Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 HTTP/1.1 Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHRGTY30kyH6GAP_6sJdBFHDP2zK2drhm0DlOKK3meQkXxkSUXuaaZ4oRsJ4KRZg0ugN0PDsFPcX5xEHCsnimnf4iAPfbSP9Vkp060T43B5ZEZT2RqvSiVCuUb8vufp4IPTuVJW6NWsNPhtmjM7pfJY9e0_KXIwGRPt5rId33Odd7rI Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 4f93f50077694fb8b159cef508bfc69d Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-DeleteServersTestJSON-699146998 Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f93f50077694fb8b159cef508bfc69d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4f93f50077694fb8b159cef508bfc69d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f93f50077694fb8b159cef508bfc69d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4f93f50077694fb8b159cef508bfc69d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-DeleteServersTestJSON-699146998 Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 4f93f50077694fb8b159cef508bfc69d Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-DeleteServersTestJSON-699146998 Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-DeleteServersTestJSON-699146998-project Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 137ab9a64bad4e6495da7088a4155073 Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-DeleteServersTestJSON-699146998-project Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '70350f46-35fa-41d4-8350-ebc5e16bdf57'} Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:26:46.315245 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Returning 404 to user: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1e16cf07-a834-4218-9bca-f65e3d29eed5 tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 404 len: 111 microversion: 2.1 time: 0.033436 Sep 10 11:26:46.319151 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1973/6262] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:26:46 2022] DELETE /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:26:46.325131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:46.325757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] [instance: 70350f46-35fa-41d4-8350-ebc5e16bdf57] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:46.331636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:46.332124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:46.332584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:46.333296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:46.333759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:46.334194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:46.347894 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] HTTP exception thrown: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Request method failure captured: Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 HTTP/1.1 Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHRGTY30kyH6GAP_6sJdBFHDP2zK2drhm0DlOKK3meQkXxkSUXuaaZ4oRsJ4KRZg0ugN0PDsFPcX5xEHCsnimnf4iAPfbSP9Vkp060T43B5ZEZT2RqvSiVCuUb8vufp4IPTuVJW6NWsNPhtmjM7pfJY9e0_KXIwGRPt5rId33Odd7rI Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 4f93f50077694fb8b159cef508bfc69d Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-DeleteServersTestJSON-699146998 Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f93f50077694fb8b159cef508bfc69d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4f93f50077694fb8b159cef508bfc69d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f93f50077694fb8b159cef508bfc69d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4f93f50077694fb8b159cef508bfc69d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-DeleteServersTestJSON-699146998 Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 4f93f50077694fb8b159cef508bfc69d Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-DeleteServersTestJSON-699146998 Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-DeleteServersTestJSON-699146998-project Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 137ab9a64bad4e6495da7088a4155073 Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-DeleteServersTestJSON-699146998-project Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '70350f46-35fa-41d4-8350-ebc5e16bdf57'} Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:26:46.349412 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.353928 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:26:46.353928 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:26:46.353928 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:26:46.353928 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:26:46.353928 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:26:46.353928 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. Sep 10 11:26:46.353928 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:26:46.353928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] Returning 404 to user: Instance 70350f46-35fa-41d4-8350-ebc5e16bdf57 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:26:46.353928 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-30da8a87-3750-4da2-8780-5730153ea2eb tempest-DeleteServersTestJSON-699146998 tempest-DeleteServersTestJSON-699146998-project] 10.222.0.20 "GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57" status: 404 len: 111 microversion: 2.1 time: 0.029548 Sep 10 11:26:46.353928 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4290/6263] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:46 2022] GET /compute/v2.1/servers/70350f46-35fa-41d4-8350-ebc5e16bdf57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:26:54.903311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-655223077", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "302beccb-88f7-4732-b8e9-29b1b2b586d6"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:26:54.965728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] validate_networks() for [('302beccb-88f7-4732-b8e9-29b1b2b586d6', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:26:55.402682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:26:55.403110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:26:55.403587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:26:55.404000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:26:55.404417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:26:55.413318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:55.413800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:55.414239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:55.414962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:55.415990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:55.416430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:55.433257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Getting quotas for project 5bd62f7c4ab2428eb24d7cd630df715c. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:26:55.438673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Getting quotas for user cbf5075ee52c4401bab568816670d5e6 and project 5bd62f7c4ab2428eb24d7cd630df715c. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:26:55.451677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:26:55.454012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:26:55.499867 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-63f25485-0de9-4028-b43b-bda28557cf10 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735456 Sep 10 11:26:55.500543 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1974/6264] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:26:55.512198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d661a2dc-4b3e-4212-a863-96590e466d31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:55.512830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d661a2dc-4b3e-4212-a863-96590e466d31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:55.568890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d661a2dc-4b3e-4212-a863-96590e466d31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:55.576432 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d661a2dc-4b3e-4212-a863-96590e466d31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1217 microversion: 2.1 time: 0.068664 Sep 10 11:26:55.577007 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4291/6265] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:55 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:56.600342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2ed3828b-6ab9-43d8-9855-5b17be604ba1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:56.601904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2ed3828b-6ab9-43d8-9855-5b17be604ba1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:56.611456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed3828b-6ab9-43d8-9855-5b17be604ba1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:56.612337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed3828b-6ab9-43d8-9855-5b17be604ba1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:56.613672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed3828b-6ab9-43d8-9855-5b17be604ba1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:56.614668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed3828b-6ab9-43d8-9855-5b17be604ba1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:56.615321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed3828b-6ab9-43d8-9855-5b17be604ba1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:56.615701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2ed3828b-6ab9-43d8-9855-5b17be604ba1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:56.801101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2ed3828b-6ab9-43d8-9855-5b17be604ba1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:56.809689 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2ed3828b-6ab9-43d8-9855-5b17be604ba1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1277 microversion: 2.1 time: 0.213789 Sep 10 11:26:56.810765 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1975/6266] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:56 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:57.832823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3bc944e6-e5ca-44f0-880a-b4b2b09b0929 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:57.833708 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3bc944e6-e5ca-44f0-880a-b4b2b09b0929 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:57.841948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:26:57.848776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc944e6-e5ca-44f0-880a-b4b2b09b0929 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:57.849418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc944e6-e5ca-44f0-880a-b4b2b09b0929 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:57.849953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc944e6-e5ca-44f0-880a-b4b2b09b0929 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:57.850907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc944e6-e5ca-44f0-880a-b4b2b09b0929 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:57.851566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc944e6-e5ca-44f0-880a-b4b2b09b0929 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:57.852153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3bc944e6-e5ca-44f0-880a-b4b2b09b0929 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:58.087281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3bc944e6-e5ca-44f0-880a-b4b2b09b0929 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:58.097556 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3bc944e6-e5ca-44f0-880a-b4b2b09b0929 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1317 microversion: 2.1 time: 0.268571 Sep 10 11:26:58.098493 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4292/6267] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:57 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:26:58.249550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-9384f0d9-7127-4a0d-8988-03521880faf6 req-3d21dfdb-c02b-4dcb-ac2a-210815b9d27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7520ab97-ab20-4aa1-919f-920faa66b7f8", "tag": "1b34338c-a372-4e88-a457-81fb32f6ac05"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:26:58.265063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9384f0d9-7127-4a0d-8988-03521880faf6 req-3d21dfdb-c02b-4dcb-ac2a-210815b9d27e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:58.265798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9384f0d9-7127-4a0d-8988-03521880faf6 req-3d21dfdb-c02b-4dcb-ac2a-210815b9d27e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:58.266410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9384f0d9-7127-4a0d-8988-03521880faf6 req-3d21dfdb-c02b-4dcb-ac2a-210815b9d27e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:58.279520 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-9384f0d9-7127-4a0d-8988-03521880faf6 req-3d21dfdb-c02b-4dcb-ac2a-210815b9d27e service nova] Creating event network-changed:1b34338c-a372-4e88-a457-81fb32f6ac05 for instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 on n-h2-856894-1 Sep 10 11:26:58.284936 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-9384f0d9-7127-4a0d-8988-03521880faf6 req-3d21dfdb-c02b-4dcb-ac2a-210815b9d27e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041242 Sep 10 11:26:58.285996 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1976/6268] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:26:59.121614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-84c622eb-8b61-4305-94b1-827d8bc53fd5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:26:59.122825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-84c622eb-8b61-4305-94b1-827d8bc53fd5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:26:59.130106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c622eb-8b61-4305-94b1-827d8bc53fd5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:59.130606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c622eb-8b61-4305-94b1-827d8bc53fd5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:59.131045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c622eb-8b61-4305-94b1-827d8bc53fd5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:59.131754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c622eb-8b61-4305-94b1-827d8bc53fd5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:26:59.132214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c622eb-8b61-4305-94b1-827d8bc53fd5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:26:59.132648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84c622eb-8b61-4305-94b1-827d8bc53fd5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:26:59.273224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-84c622eb-8b61-4305-94b1-827d8bc53fd5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:26:59.281231 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-84c622eb-8b61-4305-94b1-827d8bc53fd5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1317 microversion: 2.1 time: 0.164001 Sep 10 11:26:59.281819 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4293/6269] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:26:59 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:00.305530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4177ffd7-05f8-423e-8c50-434ac99dc5bb tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:00.306237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4177ffd7-05f8-423e-8c50-434ac99dc5bb tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:00.312759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4177ffd7-05f8-423e-8c50-434ac99dc5bb tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:00.313286 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4177ffd7-05f8-423e-8c50-434ac99dc5bb tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:00.313728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4177ffd7-05f8-423e-8c50-434ac99dc5bb tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:00.314437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4177ffd7-05f8-423e-8c50-434ac99dc5bb tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:00.314888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4177ffd7-05f8-423e-8c50-434ac99dc5bb tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:00.315317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4177ffd7-05f8-423e-8c50-434ac99dc5bb tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:00.497937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4177ffd7-05f8-423e-8c50-434ac99dc5bb tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:00.505820 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4177ffd7-05f8-423e-8c50-434ac99dc5bb tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1317 microversion: 2.1 time: 0.205519 Sep 10 11:27:00.506403 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1977/6270] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:00 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:01.530185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aa7b279b-9fed-4290-a13b-edad7a2eab8e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:01.531135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aa7b279b-9fed-4290-a13b-edad7a2eab8e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:01.538231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7b279b-9fed-4290-a13b-edad7a2eab8e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:01.538727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7b279b-9fed-4290-a13b-edad7a2eab8e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:01.539173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7b279b-9fed-4290-a13b-edad7a2eab8e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:01.539873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7b279b-9fed-4290-a13b-edad7a2eab8e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:01.540335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7b279b-9fed-4290-a13b-edad7a2eab8e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:01.540774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aa7b279b-9fed-4290-a13b-edad7a2eab8e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:01.671395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-aa7b279b-9fed-4290-a13b-edad7a2eab8e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:01.679234 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aa7b279b-9fed-4290-a13b-edad7a2eab8e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1317 microversion: 2.1 time: 0.153035 Sep 10 11:27:01.679809 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4294/6271] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:01 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:02.701777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8ab41419-2d07-40b4-ab3a-3ab496911909 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:02.702425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8ab41419-2d07-40b4-ab3a-3ab496911909 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:02.709126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ab41419-2d07-40b4-ab3a-3ab496911909 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:02.709613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ab41419-2d07-40b4-ab3a-3ab496911909 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:02.710047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ab41419-2d07-40b4-ab3a-3ab496911909 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:02.710725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ab41419-2d07-40b4-ab3a-3ab496911909 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:02.711172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ab41419-2d07-40b4-ab3a-3ab496911909 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:02.711591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8ab41419-2d07-40b4-ab3a-3ab496911909 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:02.838330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8ab41419-2d07-40b4-ab3a-3ab496911909 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:02.846202 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8ab41419-2d07-40b4-ab3a-3ab496911909 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1317 microversion: 2.1 time: 0.148319 Sep 10 11:27:02.846766 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1978/6272] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:02 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:03.224519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3cf83ee8-1f6c-4e47-9c17-031c45313a7f req-1b497e89-51e2-4878-8689-71961b15ee48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7520ab97-ab20-4aa1-919f-920faa66b7f8", "name": "network-vif-plugged", "status": "completed", "tag": "1b34338c-a372-4e88-a457-81fb32f6ac05"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:03.235208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3cf83ee8-1f6c-4e47-9c17-031c45313a7f req-1b497e89-51e2-4878-8689-71961b15ee48 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:03.235701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3cf83ee8-1f6c-4e47-9c17-031c45313a7f req-1b497e89-51e2-4878-8689-71961b15ee48 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:03.236146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3cf83ee8-1f6c-4e47-9c17-031c45313a7f req-1b497e89-51e2-4878-8689-71961b15ee48 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:03.247129 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3cf83ee8-1f6c-4e47-9c17-031c45313a7f req-1b497e89-51e2-4878-8689-71961b15ee48 service nova] Creating event network-vif-plugged:1b34338c-a372-4e88-a457-81fb32f6ac05 for instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 on n-h2-856894-1 Sep 10 11:27:03.251963 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3cf83ee8-1f6c-4e47-9c17-031c45313a7f req-1b497e89-51e2-4878-8689-71961b15ee48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031161 Sep 10 11:27:03.252559 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4295/6273] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:27:03.869935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-22dff568-5410-42ea-a853-6e3f1a9bfaa2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:03.870557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-22dff568-5410-42ea-a853-6e3f1a9bfaa2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:03.877460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22dff568-5410-42ea-a853-6e3f1a9bfaa2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:03.877945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22dff568-5410-42ea-a853-6e3f1a9bfaa2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:03.878377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22dff568-5410-42ea-a853-6e3f1a9bfaa2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:03.879059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22dff568-5410-42ea-a853-6e3f1a9bfaa2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:03.879512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22dff568-5410-42ea-a853-6e3f1a9bfaa2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:03.879941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-22dff568-5410-42ea-a853-6e3f1a9bfaa2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:04.009165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-22dff568-5410-42ea-a853-6e3f1a9bfaa2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:04.016769 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-22dff568-5410-42ea-a853-6e3f1a9bfaa2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1317 microversion: 2.1 time: 0.151371 Sep 10 11:27:04.017374 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1979/6274] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:03 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:05.040288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1204d330-6688-48b3-aff0-2fd474cd5245 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:05.041008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1204d330-6688-48b3-aff0-2fd474cd5245 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:05.047503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1204d330-6688-48b3-aff0-2fd474cd5245 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.047998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1204d330-6688-48b3-aff0-2fd474cd5245 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.048450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1204d330-6688-48b3-aff0-2fd474cd5245 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.049164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1204d330-6688-48b3-aff0-2fd474cd5245 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.049632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1204d330-6688-48b3-aff0-2fd474cd5245 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.050068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1204d330-6688-48b3-aff0-2fd474cd5245 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.179625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1204d330-6688-48b3-aff0-2fd474cd5245 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:05.188889 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1204d330-6688-48b3-aff0-2fd474cd5245 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1507 microversion: 2.1 time: 0.153619 Sep 10 11:27:05.189510 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4296/6275] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:05 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:05.212258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96c592da-64ee-461c-a8c3-4976d9c5f20c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:05.212877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-96c592da-64ee-461c-a8c3-4976d9c5f20c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:05.219675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c592da-64ee-461c-a8c3-4976d9c5f20c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.220161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c592da-64ee-461c-a8c3-4976d9c5f20c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.220598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c592da-64ee-461c-a8c3-4976d9c5f20c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.221319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c592da-64ee-461c-a8c3-4976d9c5f20c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.221775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c592da-64ee-461c-a8c3-4976d9c5f20c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.222202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c592da-64ee-461c-a8c3-4976d9c5f20c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.356128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-96c592da-64ee-461c-a8c3-4976d9c5f20c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:05.363919 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-96c592da-64ee-461c-a8c3-4976d9c5f20c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1507 microversion: 2.1 time: 0.155786 Sep 10 11:27:05.364505 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1980/6276] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:05 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:05.386325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2480eb3-cf21-4476-a00d-967829b21e44 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:05.388642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2480eb3-cf21-4476-a00d-967829b21e44 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:05.394603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2480eb3-cf21-4476-a00d-967829b21e44 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.395097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2480eb3-cf21-4476-a00d-967829b21e44 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.395543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2480eb3-cf21-4476-a00d-967829b21e44 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.396234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2480eb3-cf21-4476-a00d-967829b21e44 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.396697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2480eb3-cf21-4476-a00d-967829b21e44 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.397157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2480eb3-cf21-4476-a00d-967829b21e44 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.459873 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2480eb3-cf21-4476-a00d-967829b21e44 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "PUT /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1079 microversion: 2.1 time: 0.077537 Sep 10 11:27:05.460684 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4297/6277] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Sep 10 11:27:05 2022] PUT /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1079 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:27:05.479053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6c7164c0-634a-429c-8066-21eabdef04d2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:05.479674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6c7164c0-634a-429c-8066-21eabdef04d2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:05.481627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:05.482295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:05.488132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c7164c0-634a-429c-8066-21eabdef04d2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.488619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c7164c0-634a-429c-8066-21eabdef04d2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.489054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c7164c0-634a-429c-8066-21eabdef04d2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.489763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c7164c0-634a-429c-8066-21eabdef04d2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.490221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c7164c0-634a-429c-8066-21eabdef04d2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.490646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c7164c0-634a-429c-8066-21eabdef04d2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.615754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6c7164c0-634a-429c-8066-21eabdef04d2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:05.624091 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6c7164c0-634a-429c-8066-21eabdef04d2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1505 microversion: 2.1 time: 0.149329 Sep 10 11:27:05.624666 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1981/6278] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:05 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:05.645808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a6ae3a8d-d73f-44e9-8a93-906db18a917a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:05.646402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a6ae3a8d-d73f-44e9-8a93-906db18a917a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:05.648418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:05.654363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6ae3a8d-d73f-44e9-8a93-906db18a917a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.654860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6ae3a8d-d73f-44e9-8a93-906db18a917a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.655308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6ae3a8d-d73f-44e9-8a93-906db18a917a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.656026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6ae3a8d-d73f-44e9-8a93-906db18a917a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.656511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6ae3a8d-d73f-44e9-8a93-906db18a917a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.656943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6ae3a8d-d73f-44e9-8a93-906db18a917a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.790962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a6ae3a8d-d73f-44e9-8a93-906db18a917a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:05.799059 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a6ae3a8d-d73f-44e9-8a93-906db18a917a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1505 microversion: 2.1 time: 0.157242 Sep 10 11:27:05.799692 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4298/6279] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:05 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:05.820685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:05.823005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:05.829065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.829646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.830076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.830755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.831204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.831623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.860152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:05.865606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Old instance type m1.heat2, new instance type m1.heat {{(pid=128787) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:27:05.872252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:27:05.872674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:27:05.873172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:27:05.873584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:27:05.873992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:27:05.942399 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-41a9167a-f954-4efc-8063-b63db16fb228 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "POST /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8/action" status: 202 len: 0 microversion: 2.1 time: 0.125137 Sep 10 11:27:05.943417 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1982/6280] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:27:05 2022] POST /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:27:05.951944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42c8ec4d-ad64-4262-a235-c9330283f0a2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:05.952786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42c8ec4d-ad64-4262-a235-c9330283f0a2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:05.959065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c8ec4d-ad64-4262-a235-c9330283f0a2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.959563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c8ec4d-ad64-4262-a235-c9330283f0a2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.960010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c8ec4d-ad64-4262-a235-c9330283f0a2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:05.960713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c8ec4d-ad64-4262-a235-c9330283f0a2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:05.961202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c8ec4d-ad64-4262-a235-c9330283f0a2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:05.961639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c8ec4d-ad64-4262-a235-c9330283f0a2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:06.375956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-42c8ec4d-ad64-4262-a235-c9330283f0a2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:06.389414 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42c8ec4d-ad64-4262-a235-c9330283f0a2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1516 microversion: 2.1 time: 0.441746 Sep 10 11:27:06.390014 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4299/6281] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:05 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1516 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:27:07.412944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-619cc252-f7b8-46aa-b183-c105841e16dd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:07.413520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-619cc252-f7b8-46aa-b183-c105841e16dd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:07.421831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619cc252-f7b8-46aa-b183-c105841e16dd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:07.422324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619cc252-f7b8-46aa-b183-c105841e16dd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:07.422771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619cc252-f7b8-46aa-b183-c105841e16dd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:07.423467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619cc252-f7b8-46aa-b183-c105841e16dd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:07.423933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619cc252-f7b8-46aa-b183-c105841e16dd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:07.424368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-619cc252-f7b8-46aa-b183-c105841e16dd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:07.646093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-619cc252-f7b8-46aa-b183-c105841e16dd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:07.654431 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-619cc252-f7b8-46aa-b183-c105841e16dd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1516 microversion: 2.1 time: 0.245495 Sep 10 11:27:07.655011 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1983/6282] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:07 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:08.677394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e2267565-d53c-44ba-aea5-12b2960e424f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:08.678031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e2267565-d53c-44ba-aea5-12b2960e424f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:08.680744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:08.686368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2267565-d53c-44ba-aea5-12b2960e424f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:08.686876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2267565-d53c-44ba-aea5-12b2960e424f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:08.687329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2267565-d53c-44ba-aea5-12b2960e424f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:08.688108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2267565-d53c-44ba-aea5-12b2960e424f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:08.688582 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2267565-d53c-44ba-aea5-12b2960e424f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:08.689023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e2267565-d53c-44ba-aea5-12b2960e424f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:08.823504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e2267565-d53c-44ba-aea5-12b2960e424f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:08.831595 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e2267565-d53c-44ba-aea5-12b2960e424f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.158188 Sep 10 11:27:08.832173 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4300/6283] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:08 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:09.855803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f93a3d3e-ac77-4530-9f8a-9a404477496b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:09.856421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f93a3d3e-ac77-4530-9f8a-9a404477496b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:09.863253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f93a3d3e-ac77-4530-9f8a-9a404477496b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:09.863736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f93a3d3e-ac77-4530-9f8a-9a404477496b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:09.864172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f93a3d3e-ac77-4530-9f8a-9a404477496b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:09.864861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f93a3d3e-ac77-4530-9f8a-9a404477496b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:09.865348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f93a3d3e-ac77-4530-9f8a-9a404477496b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:09.865774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f93a3d3e-ac77-4530-9f8a-9a404477496b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:09.995083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f93a3d3e-ac77-4530-9f8a-9a404477496b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:10.002755 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f93a3d3e-ac77-4530-9f8a-9a404477496b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.151407 Sep 10 11:27:10.003325 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1984/6284] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:09 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:11.024926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f23d96e5-1c27-44bb-8d0a-1539bd86243d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:11.025598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f23d96e5-1c27-44bb-8d0a-1539bd86243d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:11.032490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f23d96e5-1c27-44bb-8d0a-1539bd86243d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:11.032995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f23d96e5-1c27-44bb-8d0a-1539bd86243d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:11.033481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f23d96e5-1c27-44bb-8d0a-1539bd86243d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:11.034196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f23d96e5-1c27-44bb-8d0a-1539bd86243d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:11.034670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f23d96e5-1c27-44bb-8d0a-1539bd86243d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:11.035111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f23d96e5-1c27-44bb-8d0a-1539bd86243d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:11.166073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f23d96e5-1c27-44bb-8d0a-1539bd86243d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:11.174381 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f23d96e5-1c27-44bb-8d0a-1539bd86243d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.153322 Sep 10 11:27:11.175020 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4301/6285] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:11 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:12.199369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ad0c40fd-fa1b-417b-ae25-5480aa4b2f43 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:12.199986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ad0c40fd-fa1b-417b-ae25-5480aa4b2f43 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:12.210144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:12.216082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0c40fd-fa1b-417b-ae25-5480aa4b2f43 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:12.216565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0c40fd-fa1b-417b-ae25-5480aa4b2f43 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:12.217000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0c40fd-fa1b-417b-ae25-5480aa4b2f43 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:12.217712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0c40fd-fa1b-417b-ae25-5480aa4b2f43 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:12.218161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0c40fd-fa1b-417b-ae25-5480aa4b2f43 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:12.218582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad0c40fd-fa1b-417b-ae25-5480aa4b2f43 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:12.223638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:12.355536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ad0c40fd-fa1b-417b-ae25-5480aa4b2f43 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:12.363203 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ad0c40fd-fa1b-417b-ae25-5480aa4b2f43 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.168931 Sep 10 11:27:12.363790 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1985/6286] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:12 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:13.388330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a33baa29-cb4d-4f05-be9e-89a3c2a1f10f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:13.388976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a33baa29-cb4d-4f05-be9e-89a3c2a1f10f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:13.395967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a33baa29-cb4d-4f05-be9e-89a3c2a1f10f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:13.396474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a33baa29-cb4d-4f05-be9e-89a3c2a1f10f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:13.396929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a33baa29-cb4d-4f05-be9e-89a3c2a1f10f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:13.397667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a33baa29-cb4d-4f05-be9e-89a3c2a1f10f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:13.398145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a33baa29-cb4d-4f05-be9e-89a3c2a1f10f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:13.398590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a33baa29-cb4d-4f05-be9e-89a3c2a1f10f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:13.528189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a33baa29-cb4d-4f05-be9e-89a3c2a1f10f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:13.535960 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a33baa29-cb4d-4f05-be9e-89a3c2a1f10f tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.152302 Sep 10 11:27:13.536533 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4302/6287] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:13 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:14.560400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a30aa49c-b0db-4a98-bbc7-95247d362af6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:14.561027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a30aa49c-b0db-4a98-bbc7-95247d362af6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:14.567936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a30aa49c-b0db-4a98-bbc7-95247d362af6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:14.568420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a30aa49c-b0db-4a98-bbc7-95247d362af6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:14.568856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a30aa49c-b0db-4a98-bbc7-95247d362af6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:14.569578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a30aa49c-b0db-4a98-bbc7-95247d362af6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:14.570030 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a30aa49c-b0db-4a98-bbc7-95247d362af6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:14.570455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a30aa49c-b0db-4a98-bbc7-95247d362af6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:14.700078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a30aa49c-b0db-4a98-bbc7-95247d362af6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:14.707804 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a30aa49c-b0db-4a98-bbc7-95247d362af6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.152067 Sep 10 11:27:14.708367 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1986/6288] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:14 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:15.731491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac0a6c67-1439-47ac-b597-78bc71400528 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:15.732133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac0a6c67-1439-47ac-b597-78bc71400528 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:15.739286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac0a6c67-1439-47ac-b597-78bc71400528 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:15.739803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac0a6c67-1439-47ac-b597-78bc71400528 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:15.740266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac0a6c67-1439-47ac-b597-78bc71400528 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:15.740991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac0a6c67-1439-47ac-b597-78bc71400528 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:15.741545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac0a6c67-1439-47ac-b597-78bc71400528 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:15.742001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac0a6c67-1439-47ac-b597-78bc71400528 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:15.880335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ac0a6c67-1439-47ac-b597-78bc71400528 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:15.890659 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac0a6c67-1439-47ac-b597-78bc71400528 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.163189 Sep 10 11:27:15.891247 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4303/6289] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:15 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:16.916763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2cf41fcf-cafc-4188-990a-774e8c2a5c4d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:16.917772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2cf41fcf-cafc-4188-990a-774e8c2a5c4d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:16.924606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cf41fcf-cafc-4188-990a-774e8c2a5c4d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:16.925120 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cf41fcf-cafc-4188-990a-774e8c2a5c4d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:16.925559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cf41fcf-cafc-4188-990a-774e8c2a5c4d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:16.926244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cf41fcf-cafc-4188-990a-774e8c2a5c4d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:16.926726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cf41fcf-cafc-4188-990a-774e8c2a5c4d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:16.927147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2cf41fcf-cafc-4188-990a-774e8c2a5c4d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:17.055955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2cf41fcf-cafc-4188-990a-774e8c2a5c4d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:17.063617 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2cf41fcf-cafc-4188-990a-774e8c2a5c4d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.150912 Sep 10 11:27:17.064188 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1987/6290] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:16 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:18.086942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e1a5900-a34e-4a06-bfee-eb780db72666 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:18.087587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e1a5900-a34e-4a06-bfee-eb780db72666 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:18.095047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e1a5900-a34e-4a06-bfee-eb780db72666 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:18.095632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e1a5900-a34e-4a06-bfee-eb780db72666 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:18.096092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e1a5900-a34e-4a06-bfee-eb780db72666 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:18.096801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e1a5900-a34e-4a06-bfee-eb780db72666 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:18.097312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e1a5900-a34e-4a06-bfee-eb780db72666 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:18.097754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e1a5900-a34e-4a06-bfee-eb780db72666 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:18.231964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e1a5900-a34e-4a06-bfee-eb780db72666 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:18.239775 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e1a5900-a34e-4a06-bfee-eb780db72666 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.156997 Sep 10 11:27:18.240353 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4304/6291] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:18 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:19.262268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4a41f391-9239-4942-9695-0bee56037d56 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:19.262910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4a41f391-9239-4942-9695-0bee56037d56 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:19.269335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a41f391-9239-4942-9695-0bee56037d56 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:19.269812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a41f391-9239-4942-9695-0bee56037d56 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:19.270243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a41f391-9239-4942-9695-0bee56037d56 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:19.270917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a41f391-9239-4942-9695-0bee56037d56 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:19.271360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a41f391-9239-4942-9695-0bee56037d56 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:19.271776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a41f391-9239-4942-9695-0bee56037d56 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:19.403257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4a41f391-9239-4942-9695-0bee56037d56 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:19.410967 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4a41f391-9239-4942-9695-0bee56037d56 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.152864 Sep 10 11:27:19.411544 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1988/6292] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:19 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:20.434173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-360e539b-abb3-4b8d-a4bc-801a5b27653c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:20.434813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-360e539b-abb3-4b8d-a4bc-801a5b27653c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:20.441753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-360e539b-abb3-4b8d-a4bc-801a5b27653c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:20.442259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-360e539b-abb3-4b8d-a4bc-801a5b27653c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:20.442714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-360e539b-abb3-4b8d-a4bc-801a5b27653c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:20.443419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-360e539b-abb3-4b8d-a4bc-801a5b27653c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:20.443897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-360e539b-abb3-4b8d-a4bc-801a5b27653c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:20.444342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-360e539b-abb3-4b8d-a4bc-801a5b27653c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:20.576525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-360e539b-abb3-4b8d-a4bc-801a5b27653c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:20.584360 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-360e539b-abb3-4b8d-a4bc-801a5b27653c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.154104 Sep 10 11:27:20.584974 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4305/6293] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:20 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:21.608417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dcf03654-55cb-40bf-a42f-5ed7661b3057 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:21.609028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dcf03654-55cb-40bf-a42f-5ed7661b3057 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:21.615490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf03654-55cb-40bf-a42f-5ed7661b3057 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:21.615970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf03654-55cb-40bf-a42f-5ed7661b3057 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:21.616402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf03654-55cb-40bf-a42f-5ed7661b3057 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:21.617095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf03654-55cb-40bf-a42f-5ed7661b3057 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:21.617547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf03654-55cb-40bf-a42f-5ed7661b3057 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:21.617967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcf03654-55cb-40bf-a42f-5ed7661b3057 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:21.748478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dcf03654-55cb-40bf-a42f-5ed7661b3057 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:21.756201 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dcf03654-55cb-40bf-a42f-5ed7661b3057 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.152514 Sep 10 11:27:21.756763 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1989/6294] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:21 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:22.779082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-69ddeb73-c6b1-4297-8e26-e1bafcf94c07 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:22.779723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-69ddeb73-c6b1-4297-8e26-e1bafcf94c07 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:22.786988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69ddeb73-c6b1-4297-8e26-e1bafcf94c07 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:22.787553 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69ddeb73-c6b1-4297-8e26-e1bafcf94c07 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:22.788270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69ddeb73-c6b1-4297-8e26-e1bafcf94c07 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:22.789115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69ddeb73-c6b1-4297-8e26-e1bafcf94c07 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:22.789817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69ddeb73-c6b1-4297-8e26-e1bafcf94c07 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:22.790400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-69ddeb73-c6b1-4297-8e26-e1bafcf94c07 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:22.920520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-69ddeb73-c6b1-4297-8e26-e1bafcf94c07 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:22.930668 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-69ddeb73-c6b1-4297-8e26-e1bafcf94c07 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.155163 Sep 10 11:27:22.931725 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4306/6295] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:22 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:23.955089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4dc5e7eb-c69b-46a1-b735-86c24d7a0f29 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:23.955774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4dc5e7eb-c69b-46a1-b735-86c24d7a0f29 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:23.962350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4dc5e7eb-c69b-46a1-b735-86c24d7a0f29 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:23.962886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4dc5e7eb-c69b-46a1-b735-86c24d7a0f29 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:23.963320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4dc5e7eb-c69b-46a1-b735-86c24d7a0f29 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:23.964000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4dc5e7eb-c69b-46a1-b735-86c24d7a0f29 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:23.964453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4dc5e7eb-c69b-46a1-b735-86c24d7a0f29 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:23.964871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4dc5e7eb-c69b-46a1-b735-86c24d7a0f29 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:24.092797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4dc5e7eb-c69b-46a1-b735-86c24d7a0f29 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:24.102308 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4dc5e7eb-c69b-46a1-b735-86c24d7a0f29 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.151186 Sep 10 11:27:24.102890 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1990/6296] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:23 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:25.125616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-92c7414c-6961-4200-8243-9f37516d661b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:25.126255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-92c7414c-6961-4200-8243-9f37516d661b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:25.133277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7414c-6961-4200-8243-9f37516d661b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:25.133784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7414c-6961-4200-8243-9f37516d661b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:25.134240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7414c-6961-4200-8243-9f37516d661b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:25.135591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7414c-6961-4200-8243-9f37516d661b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:25.136066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7414c-6961-4200-8243-9f37516d661b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:25.136513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7414c-6961-4200-8243-9f37516d661b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:25.269111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-92c7414c-6961-4200-8243-9f37516d661b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:25.277425 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-92c7414c-6961-4200-8243-9f37516d661b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.155733 Sep 10 11:27:25.278004 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4307/6297] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:25 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:26.299952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5144d279-782d-49a3-84c7-1b4d42792ab6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:26.300562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5144d279-782d-49a3-84c7-1b4d42792ab6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:26.307481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5144d279-782d-49a3-84c7-1b4d42792ab6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:26.307959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5144d279-782d-49a3-84c7-1b4d42792ab6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:26.308392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5144d279-782d-49a3-84c7-1b4d42792ab6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:26.309094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5144d279-782d-49a3-84c7-1b4d42792ab6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:26.309540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5144d279-782d-49a3-84c7-1b4d42792ab6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:26.309960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5144d279-782d-49a3-84c7-1b4d42792ab6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:26.437503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5144d279-782d-49a3-84c7-1b4d42792ab6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:26.445133 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5144d279-782d-49a3-84c7-1b4d42792ab6 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.149029 Sep 10 11:27:26.445709 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1991/6298] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:26 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:27.468306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8b22329-0c23-43f4-af29-af8078e46c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:27.468942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f8b22329-0c23-43f4-af29-af8078e46c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:27.476064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b22329-0c23-43f4-af29-af8078e46c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:27.476574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b22329-0c23-43f4-af29-af8078e46c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:27.477037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b22329-0c23-43f4-af29-af8078e46c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:27.477774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b22329-0c23-43f4-af29-af8078e46c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:27.478879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b22329-0c23-43f4-af29-af8078e46c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:27.479338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8b22329-0c23-43f4-af29-af8078e46c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:27.497133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:27.611820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f8b22329-0c23-43f4-af29-af8078e46c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:27.620147 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8b22329-0c23-43f4-af29-af8078e46c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.155692 Sep 10 11:27:27.620765 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4308/6299] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:27 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:28.643186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d8558bb8-35a4-4e3b-aa27-b73d8d416801 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:28.643992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d8558bb8-35a4-4e3b-aa27-b73d8d416801 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:28.651557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8558bb8-35a4-4e3b-aa27-b73d8d416801 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:28.652043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8558bb8-35a4-4e3b-aa27-b73d8d416801 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:28.652483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8558bb8-35a4-4e3b-aa27-b73d8d416801 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:28.653209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8558bb8-35a4-4e3b-aa27-b73d8d416801 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:28.653670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8558bb8-35a4-4e3b-aa27-b73d8d416801 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:28.654097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8558bb8-35a4-4e3b-aa27-b73d8d416801 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:28.782877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d8558bb8-35a4-4e3b-aa27-b73d8d416801 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:28.791455 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d8558bb8-35a4-4e3b-aa27-b73d8d416801 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.152130 Sep 10 11:27:28.792037 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1992/6300] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:28 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:29.814650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66cfaa8f-cd32-4b69-bbc3-d3ad4195c351 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:29.815316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66cfaa8f-cd32-4b69-bbc3-d3ad4195c351 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:29.822960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66cfaa8f-cd32-4b69-bbc3-d3ad4195c351 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:29.823465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66cfaa8f-cd32-4b69-bbc3-d3ad4195c351 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:29.823921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66cfaa8f-cd32-4b69-bbc3-d3ad4195c351 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:29.824630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66cfaa8f-cd32-4b69-bbc3-d3ad4195c351 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:29.825125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66cfaa8f-cd32-4b69-bbc3-d3ad4195c351 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:29.825576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66cfaa8f-cd32-4b69-bbc3-d3ad4195c351 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:29.954896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-66cfaa8f-cd32-4b69-bbc3-d3ad4195c351 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:29.962799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66cfaa8f-cd32-4b69-bbc3-d3ad4195c351 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.152118 Sep 10 11:27:29.963388 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4309/6301] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:29 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:30.985747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-655fe6e8-07b4-4209-bcf2-a784acb0dfc1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:30.986260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-655fe6e8-07b4-4209-bcf2-a784acb0dfc1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:30.993013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-655fe6e8-07b4-4209-bcf2-a784acb0dfc1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:30.993521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-655fe6e8-07b4-4209-bcf2-a784acb0dfc1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:30.994566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-655fe6e8-07b4-4209-bcf2-a784acb0dfc1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:30.995275 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-655fe6e8-07b4-4209-bcf2-a784acb0dfc1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:30.995731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-655fe6e8-07b4-4209-bcf2-a784acb0dfc1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:30.996155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-655fe6e8-07b4-4209-bcf2-a784acb0dfc1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:31.124419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-655fe6e8-07b4-4209-bcf2-a784acb0dfc1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:31.132271 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-655fe6e8-07b4-4209-bcf2-a784acb0dfc1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.150475 Sep 10 11:27:31.132849 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1993/6302] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:30 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:32.155617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e665034-73b5-4969-a4ce-3e25a713577a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:32.156278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e665034-73b5-4969-a4ce-3e25a713577a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:32.163252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e665034-73b5-4969-a4ce-3e25a713577a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:32.163752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e665034-73b5-4969-a4ce-3e25a713577a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:32.164203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e665034-73b5-4969-a4ce-3e25a713577a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:32.164903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e665034-73b5-4969-a4ce-3e25a713577a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:32.165393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e665034-73b5-4969-a4ce-3e25a713577a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:32.166485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e665034-73b5-4969-a4ce-3e25a713577a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:32.296121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e665034-73b5-4969-a4ce-3e25a713577a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:32.303938 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e665034-73b5-4969-a4ce-3e25a713577a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.152280 Sep 10 11:27:32.304536 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4310/6303] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:32 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:33.327285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e570fdb8-2247-45bb-980a-d7a13a876fae tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:33.327893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e570fdb8-2247-45bb-980a-d7a13a876fae tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:33.334845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e570fdb8-2247-45bb-980a-d7a13a876fae tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:33.335324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e570fdb8-2247-45bb-980a-d7a13a876fae tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:33.335758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e570fdb8-2247-45bb-980a-d7a13a876fae tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:33.336435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e570fdb8-2247-45bb-980a-d7a13a876fae tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:33.336883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e570fdb8-2247-45bb-980a-d7a13a876fae tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:33.337326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e570fdb8-2247-45bb-980a-d7a13a876fae tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:33.467140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e570fdb8-2247-45bb-980a-d7a13a876fae tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:33.475126 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e570fdb8-2247-45bb-980a-d7a13a876fae tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.151702 Sep 10 11:27:33.475703 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1994/6304] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:33 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:34.498937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bfdbea4a-7058-49b8-ad88-49a36434e8b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:34.499592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bfdbea4a-7058-49b8-ad88-49a36434e8b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:34.506732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfdbea4a-7058-49b8-ad88-49a36434e8b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:34.507227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfdbea4a-7058-49b8-ad88-49a36434e8b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:34.507678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfdbea4a-7058-49b8-ad88-49a36434e8b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:34.508376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfdbea4a-7058-49b8-ad88-49a36434e8b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:34.508846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfdbea4a-7058-49b8-ad88-49a36434e8b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:34.509738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfdbea4a-7058-49b8-ad88-49a36434e8b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:34.645993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bfdbea4a-7058-49b8-ad88-49a36434e8b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:34.654893 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bfdbea4a-7058-49b8-ad88-49a36434e8b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1521 microversion: 2.1 time: 0.160419 Sep 10 11:27:34.655493 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4311/6305] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:34 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:35.455304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-226d2ec2-0626-4a68-a70d-6cfa696c7b23 req-5882c9ad-635c-4467-9dfb-4f31b1c57f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7520ab97-ab20-4aa1-919f-920faa66b7f8", "name": "network-vif-unplugged", "status": "completed", "tag": "1b34338c-a372-4e88-a457-81fb32f6ac05"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:35.469057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-226d2ec2-0626-4a68-a70d-6cfa696c7b23 req-5882c9ad-635c-4467-9dfb-4f31b1c57f55 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:35.470028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-226d2ec2-0626-4a68-a70d-6cfa696c7b23 req-5882c9ad-635c-4467-9dfb-4f31b1c57f55 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:35.470696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-226d2ec2-0626-4a68-a70d-6cfa696c7b23 req-5882c9ad-635c-4467-9dfb-4f31b1c57f55 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:35.490932 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-226d2ec2-0626-4a68-a70d-6cfa696c7b23 req-5882c9ad-635c-4467-9dfb-4f31b1c57f55 service nova] Creating event network-vif-unplugged:1b34338c-a372-4e88-a457-81fb32f6ac05 for instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 on n-h1-856894-1 Sep 10 11:27:35.497722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-226d2ec2-0626-4a68-a70d-6cfa696c7b23 req-5882c9ad-635c-4467-9dfb-4f31b1c57f55 service nova] Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:27:35.508351 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-226d2ec2-0626-4a68-a70d-6cfa696c7b23 req-5882c9ad-635c-4467-9dfb-4f31b1c57f55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056835 Sep 10 11:27:35.508968 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1995/6306] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:27:35.680543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d666959c-edd2-426c-b7e2-03471476974c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:35.681399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d666959c-edd2-426c-b7e2-03471476974c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:35.688114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d666959c-edd2-426c-b7e2-03471476974c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:35.688628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d666959c-edd2-426c-b7e2-03471476974c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:35.689684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d666959c-edd2-426c-b7e2-03471476974c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:35.689867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d666959c-edd2-426c-b7e2-03471476974c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:35.690364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d666959c-edd2-426c-b7e2-03471476974c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:35.690751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d666959c-edd2-426c-b7e2-03471476974c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:35.928229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d666959c-edd2-426c-b7e2-03471476974c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:35.937655 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d666959c-edd2-426c-b7e2-03471476974c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1520 microversion: 2.1 time: 0.261495 Sep 10 11:27:35.938255 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4312/6307] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:35 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:36.962781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9a870bfb-291f-474f-a364-7c1eaef3d87d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:36.963479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9a870bfb-291f-474f-a364-7c1eaef3d87d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:36.969663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a870bfb-291f-474f-a364-7c1eaef3d87d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:36.970145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a870bfb-291f-474f-a364-7c1eaef3d87d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:36.970579 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a870bfb-291f-474f-a364-7c1eaef3d87d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:36.971263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a870bfb-291f-474f-a364-7c1eaef3d87d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:36.971717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a870bfb-291f-474f-a364-7c1eaef3d87d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:36.972142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9a870bfb-291f-474f-a364-7c1eaef3d87d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:37.100085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9a870bfb-291f-474f-a364-7c1eaef3d87d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:37.108363 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9a870bfb-291f-474f-a364-7c1eaef3d87d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1518 microversion: 2.1 time: 0.150705 Sep 10 11:27:37.108945 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1996/6308] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:36 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:37.529458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-cb8b5568-3df9-4536-8528-edd35107b9ca req-8d07f840-a61f-478d-8a4f-f4475f1cfa3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7520ab97-ab20-4aa1-919f-920faa66b7f8", "tag": "1b34338c-a372-4e88-a457-81fb32f6ac05"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:37.539961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cb8b5568-3df9-4536-8528-edd35107b9ca req-8d07f840-a61f-478d-8a4f-f4475f1cfa3d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:37.540398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cb8b5568-3df9-4536-8528-edd35107b9ca req-8d07f840-a61f-478d-8a4f-f4475f1cfa3d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:37.540851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cb8b5568-3df9-4536-8528-edd35107b9ca req-8d07f840-a61f-478d-8a4f-f4475f1cfa3d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:37.552699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-cb8b5568-3df9-4536-8528-edd35107b9ca req-8d07f840-a61f-478d-8a4f-f4475f1cfa3d service nova] Creating event network-changed:1b34338c-a372-4e88-a457-81fb32f6ac05 for instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 on n-h1-856894-1 Sep 10 11:27:37.558150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-cb8b5568-3df9-4536-8528-edd35107b9ca req-8d07f840-a61f-478d-8a4f-f4475f1cfa3d service nova] Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:27:37.568884 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-cb8b5568-3df9-4536-8528-edd35107b9ca req-8d07f840-a61f-478d-8a4f-f4475f1cfa3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043699 Sep 10 11:27:37.569424 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4313/6309] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:27:38.131842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b2499b54-f0b5-47ae-9ab6-106a15cd3c74 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:38.132603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b2499b54-f0b5-47ae-9ab6-106a15cd3c74 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:38.140139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2499b54-f0b5-47ae-9ab6-106a15cd3c74 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:38.140653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2499b54-f0b5-47ae-9ab6-106a15cd3c74 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:38.141112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2499b54-f0b5-47ae-9ab6-106a15cd3c74 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:38.141803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2499b54-f0b5-47ae-9ab6-106a15cd3c74 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:38.142259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2499b54-f0b5-47ae-9ab6-106a15cd3c74 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:38.142798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b2499b54-f0b5-47ae-9ab6-106a15cd3c74 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:38.670325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b2499b54-f0b5-47ae-9ab6-106a15cd3c74 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:38.678836 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b2499b54-f0b5-47ae-9ab6-106a15cd3c74 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1515 microversion: 2.1 time: 0.550818 Sep 10 11:27:38.679650 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1997/6310] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:38 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1515 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:38.702604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cd372438-8831-466a-be77-d315c325274a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:38.703262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cd372438-8831-466a-be77-d315c325274a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:38.705613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=28 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:38.711194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd372438-8831-466a-be77-d315c325274a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:38.711706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd372438-8831-466a-be77-d315c325274a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:38.712167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd372438-8831-466a-be77-d315c325274a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:38.713440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd372438-8831-466a-be77-d315c325274a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:38.713919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd372438-8831-466a-be77-d315c325274a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:38.714636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd372438-8831-466a-be77-d315c325274a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:38.781527 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cd372438-8831-466a-be77-d315c325274a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "POST /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8/action" status: 204 len: 0 microversion: 2.1 time: 0.083608 Sep 10 11:27:38.782594 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4314/6311] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:27:38 2022] POST /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:27:38.793318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cdc2638a-72b2-4854-a415-76d21fc774b2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:38.793940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cdc2638a-72b2-4854-a415-76d21fc774b2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:38.800321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdc2638a-72b2-4854-a415-76d21fc774b2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:38.800911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdc2638a-72b2-4854-a415-76d21fc774b2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:38.801510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdc2638a-72b2-4854-a415-76d21fc774b2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:38.802264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdc2638a-72b2-4854-a415-76d21fc774b2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:38.802922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdc2638a-72b2-4854-a415-76d21fc774b2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:38.803242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cdc2638a-72b2-4854-a415-76d21fc774b2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:39.126273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cdc2638a-72b2-4854-a415-76d21fc774b2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:39.134014 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cdc2638a-72b2-4854-a415-76d21fc774b2 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1515 microversion: 2.1 time: 0.346824 Sep 10 11:27:39.134640 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1998/6312] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:38 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1515 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:27:40.157700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-985c369c-541e-490b-9998-a51d4af129cd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:40.158426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-985c369c-541e-490b-9998-a51d4af129cd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:40.165629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985c369c-541e-490b-9998-a51d4af129cd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:40.166138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985c369c-541e-490b-9998-a51d4af129cd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:40.166594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985c369c-541e-490b-9998-a51d4af129cd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:40.167304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985c369c-541e-490b-9998-a51d4af129cd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:40.167774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985c369c-541e-490b-9998-a51d4af129cd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:40.168219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-985c369c-541e-490b-9998-a51d4af129cd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:40.302786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-985c369c-541e-490b-9998-a51d4af129cd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:40.311340 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-985c369c-541e-490b-9998-a51d4af129cd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1515 microversion: 2.1 time: 0.157855 Sep 10 11:27:40.311933 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4315/6313] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:40 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:41.336768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-da8612e9-e0c3-440d-9697-88ef8d052c06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:41.338026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-da8612e9-e0c3-440d-9697-88ef8d052c06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:41.344854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da8612e9-e0c3-440d-9697-88ef8d052c06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:41.345374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da8612e9-e0c3-440d-9697-88ef8d052c06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:41.345805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da8612e9-e0c3-440d-9697-88ef8d052c06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:41.346477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da8612e9-e0c3-440d-9697-88ef8d052c06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:41.346923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da8612e9-e0c3-440d-9697-88ef8d052c06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:41.347341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-da8612e9-e0c3-440d-9697-88ef8d052c06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:41.481324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-da8612e9-e0c3-440d-9697-88ef8d052c06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:41.489553 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-da8612e9-e0c3-440d-9697-88ef8d052c06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1507 microversion: 2.1 time: 0.156641 Sep 10 11:27:41.490147 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 1999/6314] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:41 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:41.511961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ffd89799-b86b-4077-b2b9-b6011aabd309 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:41.512598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ffd89799-b86b-4077-b2b9-b6011aabd309 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:41.519743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd89799-b86b-4077-b2b9-b6011aabd309 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:41.520456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd89799-b86b-4077-b2b9-b6011aabd309 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:41.520920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd89799-b86b-4077-b2b9-b6011aabd309 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:41.521670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd89799-b86b-4077-b2b9-b6011aabd309 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:41.522137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd89799-b86b-4077-b2b9-b6011aabd309 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:41.522580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ffd89799-b86b-4077-b2b9-b6011aabd309 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:41.582692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-6143d3fe-cd74-4501-8062-4cbcb151b201 req-88a9237b-fc0e-4d8a-955a-56346aa1c126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7520ab97-ab20-4aa1-919f-920faa66b7f8", "name": "network-vif-plugged", "status": "completed", "tag": "1b34338c-a372-4e88-a457-81fb32f6ac05"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:41.593231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6143d3fe-cd74-4501-8062-4cbcb151b201 req-88a9237b-fc0e-4d8a-955a-56346aa1c126 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:41.594099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6143d3fe-cd74-4501-8062-4cbcb151b201 req-88a9237b-fc0e-4d8a-955a-56346aa1c126 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:41.594498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-6143d3fe-cd74-4501-8062-4cbcb151b201 req-88a9237b-fc0e-4d8a-955a-56346aa1c126 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:41.606241 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-6143d3fe-cd74-4501-8062-4cbcb151b201 req-88a9237b-fc0e-4d8a-955a-56346aa1c126 service nova] Creating event network-vif-plugged:1b34338c-a372-4e88-a457-81fb32f6ac05 for instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 on n-h1-856894-1 Sep 10 11:27:41.611219 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-6143d3fe-cd74-4501-8062-4cbcb151b201 req-88a9237b-fc0e-4d8a-955a-56346aa1c126 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032256 Sep 10 11:27:41.612177 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2000/6315] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:27:41.660700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ffd89799-b86b-4077-b2b9-b6011aabd309 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:41.669836 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ffd89799-b86b-4077-b2b9-b6011aabd309 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1507 microversion: 2.1 time: 0.161931 Sep 10 11:27:41.671084 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4316/6316] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:41 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:41.698340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cd2e6963-f95e-45c5-85e7-79c3b27dbe5e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Action: 'create', calling method: .version_select at 0x7efcae5da160>, body: {"keypair": {"name": "tempest-keypair-2122603256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXQsA2lBxmqgacNpmdUrY5W6mM4a2mM69lv2V2Y8DAPBvY9BNKQosnS6HAPcopy5BsOFpbJtpBbiuBYNXKbTC1Loz1tBxNK/G9HjDponJaygA0aWjc3cxVh0iIN7Xlnxw=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:41.713891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-cd2e6963-f95e-45c5-85e7-79c3b27dbe5e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Getting quotas for project 5bd62f7c4ab2428eb24d7cd630df715c. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:27:41.719022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-cd2e6963-f95e-45c5-85e7-79c3b27dbe5e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Getting quotas for user cbf5075ee52c4401bab568816670d5e6 and project 5bd62f7c4ab2428eb24d7cd630df715c. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:27:41.747790 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cd2e6963-f95e-45c5-85e7-79c3b27dbe5e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054387 Sep 10 11:27:41.748399 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2001/6317] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:27:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:27:42.915277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38681e8c-b9da-4250-a895-f2b15b563d78 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:42.915914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38681e8c-b9da-4250-a895-f2b15b563d78 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:42.923188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38681e8c-b9da-4250-a895-f2b15b563d78 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:42.923689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38681e8c-b9da-4250-a895-f2b15b563d78 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:42.924142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38681e8c-b9da-4250-a895-f2b15b563d78 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:42.924843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38681e8c-b9da-4250-a895-f2b15b563d78 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:42.925342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38681e8c-b9da-4250-a895-f2b15b563d78 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:42.925784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38681e8c-b9da-4250-a895-f2b15b563d78 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:43.061843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38681e8c-b9da-4250-a895-f2b15b563d78 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:43.069696 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38681e8c-b9da-4250-a895-f2b15b563d78 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 200 len: 1507 microversion: 2.1 time: 0.158299 Sep 10 11:27:43.070225 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4317/6318] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:42 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:43.093650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4f550f2-d75d-4aaa-91ed-4efcc6af5c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:43.094273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b4f550f2-d75d-4aaa-91ed-4efcc6af5c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:43.096204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:43.102151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f550f2-d75d-4aaa-91ed-4efcc6af5c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:43.102638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f550f2-d75d-4aaa-91ed-4efcc6af5c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:43.103111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f550f2-d75d-4aaa-91ed-4efcc6af5c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:43.103804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f550f2-d75d-4aaa-91ed-4efcc6af5c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:43.104259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f550f2-d75d-4aaa-91ed-4efcc6af5c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:43.104685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f550f2-d75d-4aaa-91ed-4efcc6af5c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:43.107965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=90 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:43.130786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b4f550f2-d75d-4aaa-91ed-4efcc6af5c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:27:43.204668 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b4f550f2-d75d-4aaa-91ed-4efcc6af5c7c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 204 len: 0 microversion: 2.1 time: 0.115561 Sep 10 11:27:43.205283 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2002/6319] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:27:43 2022] DELETE /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:27:43.261762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2089014325", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "302beccb-88f7-4732-b8e9-29b1b2b586d6"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:43.314146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] validate_networks() for [('302beccb-88f7-4732-b8e9-29b1b2b586d6', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:27:43.695653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:27:43.696095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:27:43.696615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:27:43.697085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:27:43.697526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:27:43.706584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:43.707077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:43.707530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:43.708273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:43.708746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:43.709220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:43.725871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Getting quotas for project 5bd62f7c4ab2428eb24d7cd630df715c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:27:43.731636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Getting quotas for user cbf5075ee52c4401bab568816670d5e6 and project 5bd62f7c4ab2428eb24d7cd630df715c. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:27:43.744843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:27:43.747182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:27:43.792777 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-84df2fd0-2165-4623-ab81-8a316ceae5d3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535478 Sep 10 11:27:43.793488 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4318/6320] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:27:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:27:43.805295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-386bd44c-9c82-46df-8ef7-b37d4699f3ec tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:43.806555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-386bd44c-9c82-46df-8ef7-b37d4699f3ec tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:43.859237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-386bd44c-9c82-46df-8ef7-b37d4699f3ec tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:43.866219 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-386bd44c-9c82-46df-8ef7-b37d4699f3ec tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1218 microversion: 2.1 time: 0.065123 Sep 10 11:27:43.866987 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2003/6321] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:43 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:44.892934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-40f3e2ce-9ea8-47ff-b020-0e595859cc4e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:44.893619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-40f3e2ce-9ea8-47ff-b020-0e595859cc4e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:44.901425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f3e2ce-9ea8-47ff-b020-0e595859cc4e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:44.902191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f3e2ce-9ea8-47ff-b020-0e595859cc4e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:44.902658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f3e2ce-9ea8-47ff-b020-0e595859cc4e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:44.903388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f3e2ce-9ea8-47ff-b020-0e595859cc4e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:44.903869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f3e2ce-9ea8-47ff-b020-0e595859cc4e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:44.904479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-40f3e2ce-9ea8-47ff-b020-0e595859cc4e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:45.000274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-40f3e2ce-9ea8-47ff-b020-0e595859cc4e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:45.014837 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-40f3e2ce-9ea8-47ff-b020-0e595859cc4e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1278 microversion: 2.1 time: 0.128387 Sep 10 11:27:45.015790 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4319/6322] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:44 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1278 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:45.116045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-8f3c8f7f-31fc-4614-90ce-dd00bd2d05e9 req-00c87763-21c6-4208-8b3c-93391b56e818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7520ab97-ab20-4aa1-919f-920faa66b7f8", "name": "network-vif-deleted", "tag": "1b34338c-a372-4e88-a457-81fb32f6ac05"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:45.134975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8f3c8f7f-31fc-4614-90ce-dd00bd2d05e9 req-00c87763-21c6-4208-8b3c-93391b56e818 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:45.135467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8f3c8f7f-31fc-4614-90ce-dd00bd2d05e9 req-00c87763-21c6-4208-8b3c-93391b56e818 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:45.136809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8f3c8f7f-31fc-4614-90ce-dd00bd2d05e9 req-00c87763-21c6-4208-8b3c-93391b56e818 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:45.156279 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-8f3c8f7f-31fc-4614-90ce-dd00bd2d05e9 req-00c87763-21c6-4208-8b3c-93391b56e818 service nova] Creating event network-vif-deleted:1b34338c-a372-4e88-a457-81fb32f6ac05 for instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 on n-h1-856894-1 Sep 10 11:27:45.161633 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-8f3c8f7f-31fc-4614-90ce-dd00bd2d05e9 req-00c87763-21c6-4208-8b3c-93391b56e818 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051583 Sep 10 11:27:45.162558 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2004/6323] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:27:46.039722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0e835f8-01c4-41aa-b87d-492262bf2241 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:46.040497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0e835f8-01c4-41aa-b87d-492262bf2241 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:46.047824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0e835f8-01c4-41aa-b87d-492262bf2241 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:46.048340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0e835f8-01c4-41aa-b87d-492262bf2241 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:46.048795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0e835f8-01c4-41aa-b87d-492262bf2241 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:46.049536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0e835f8-01c4-41aa-b87d-492262bf2241 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:46.050014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0e835f8-01c4-41aa-b87d-492262bf2241 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:46.050460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0e835f8-01c4-41aa-b87d-492262bf2241 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:46.289483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0e835f8-01c4-41aa-b87d-492262bf2241 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:46.297497 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0e835f8-01c4-41aa-b87d-492262bf2241 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1318 microversion: 2.1 time: 0.261800 Sep 10 11:27:46.298089 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4320/6324] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:46 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:47.204738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-573be064-ba47-476c-be7a-a8904fca4e3a req-255de4f3-c4ad-421b-97d7-efa6429f33c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db839a3-2208-4cf5-a918-cbdfb65775c9", "tag": "b39449e8-1201-4bc6-a73e-60946c56aa6f"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:47.214733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-573be064-ba47-476c-be7a-a8904fca4e3a req-255de4f3-c4ad-421b-97d7-efa6429f33c9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:47.215206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-573be064-ba47-476c-be7a-a8904fca4e3a req-255de4f3-c4ad-421b-97d7-efa6429f33c9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:47.215634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-573be064-ba47-476c-be7a-a8904fca4e3a req-255de4f3-c4ad-421b-97d7-efa6429f33c9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:47.226322 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-573be064-ba47-476c-be7a-a8904fca4e3a req-255de4f3-c4ad-421b-97d7-efa6429f33c9 service nova] Creating event network-changed:b39449e8-1201-4bc6-a73e-60946c56aa6f for instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 on n-h2-856894-1 Sep 10 11:27:47.231667 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-573be064-ba47-476c-be7a-a8904fca4e3a req-255de4f3-c4ad-421b-97d7-efa6429f33c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031935 Sep 10 11:27:47.232239 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2005/6325] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:27:47.320683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3e957cbb-f0b3-48c9-abfb-bf0a0ddb5f8d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:47.321859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3e957cbb-f0b3-48c9-abfb-bf0a0ddb5f8d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:47.328808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e957cbb-f0b3-48c9-abfb-bf0a0ddb5f8d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:47.329351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e957cbb-f0b3-48c9-abfb-bf0a0ddb5f8d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:47.329807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e957cbb-f0b3-48c9-abfb-bf0a0ddb5f8d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:47.330514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e957cbb-f0b3-48c9-abfb-bf0a0ddb5f8d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:47.330987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e957cbb-f0b3-48c9-abfb-bf0a0ddb5f8d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:47.331429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3e957cbb-f0b3-48c9-abfb-bf0a0ddb5f8d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:47.458978 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3e957cbb-f0b3-48c9-abfb-bf0a0ddb5f8d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:47.467511 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3e957cbb-f0b3-48c9-abfb-bf0a0ddb5f8d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1318 microversion: 2.1 time: 0.150753 Sep 10 11:27:47.468092 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4321/6326] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:47 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:48.490790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-343bdb0a-2b4a-4f55-a59b-dc7b9329afb7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:48.491485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-343bdb0a-2b4a-4f55-a59b-dc7b9329afb7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:48.498204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-343bdb0a-2b4a-4f55-a59b-dc7b9329afb7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:48.498682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-343bdb0a-2b4a-4f55-a59b-dc7b9329afb7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:48.499112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-343bdb0a-2b4a-4f55-a59b-dc7b9329afb7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:48.499798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-343bdb0a-2b4a-4f55-a59b-dc7b9329afb7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:48.500295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-343bdb0a-2b4a-4f55-a59b-dc7b9329afb7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:48.500717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-343bdb0a-2b4a-4f55-a59b-dc7b9329afb7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:48.678675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-343bdb0a-2b4a-4f55-a59b-dc7b9329afb7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:48.686911 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-343bdb0a-2b4a-4f55-a59b-dc7b9329afb7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1318 microversion: 2.1 time: 0.201211 Sep 10 11:27:48.687490 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2006/6327] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:48 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:49.710379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e024941-8290-408b-b47d-2e430e61a94e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:49.711018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e024941-8290-408b-b47d-2e430e61a94e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:49.718117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e024941-8290-408b-b47d-2e430e61a94e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:49.718621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e024941-8290-408b-b47d-2e430e61a94e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:49.719081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e024941-8290-408b-b47d-2e430e61a94e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:49.719790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e024941-8290-408b-b47d-2e430e61a94e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:49.720307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e024941-8290-408b-b47d-2e430e61a94e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:49.720736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e024941-8290-408b-b47d-2e430e61a94e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:49.850216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e024941-8290-408b-b47d-2e430e61a94e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:49.858632 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e024941-8290-408b-b47d-2e430e61a94e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1318 microversion: 2.1 time: 0.152283 Sep 10 11:27:49.861716 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4322/6328] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:49 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:50.882216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e40bc439-9432-4d50-a387-56fb1918baf3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:50.882762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e40bc439-9432-4d50-a387-56fb1918baf3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:50.889217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e40bc439-9432-4d50-a387-56fb1918baf3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:50.889704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e40bc439-9432-4d50-a387-56fb1918baf3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:50.890143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e40bc439-9432-4d50-a387-56fb1918baf3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:50.890831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e40bc439-9432-4d50-a387-56fb1918baf3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:50.891289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e40bc439-9432-4d50-a387-56fb1918baf3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:50.891716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e40bc439-9432-4d50-a387-56fb1918baf3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:51.018207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e40bc439-9432-4d50-a387-56fb1918baf3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:51.028340 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e40bc439-9432-4d50-a387-56fb1918baf3 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1318 microversion: 2.1 time: 0.150072 Sep 10 11:27:51.028945 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2007/6329] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:50 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:51.533689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ac4da28d-20ee-4f8c-8866-789ad52c5639 req-4195fff2-7d9a-44f2-b4c6-9d79e9482abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db839a3-2208-4cf5-a918-cbdfb65775c9", "name": "network-vif-plugged", "status": "completed", "tag": "b39449e8-1201-4bc6-a73e-60946c56aa6f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:51.546450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ac4da28d-20ee-4f8c-8866-789ad52c5639 req-4195fff2-7d9a-44f2-b4c6-9d79e9482abc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:51.546952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ac4da28d-20ee-4f8c-8866-789ad52c5639 req-4195fff2-7d9a-44f2-b4c6-9d79e9482abc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:51.547401 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ac4da28d-20ee-4f8c-8866-789ad52c5639 req-4195fff2-7d9a-44f2-b4c6-9d79e9482abc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:51.558711 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ac4da28d-20ee-4f8c-8866-789ad52c5639 req-4195fff2-7d9a-44f2-b4c6-9d79e9482abc service nova] Creating event network-vif-plugged:b39449e8-1201-4bc6-a73e-60946c56aa6f for instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 on n-h2-856894-1 Sep 10 11:27:51.563615 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ac4da28d-20ee-4f8c-8866-789ad52c5639 req-4195fff2-7d9a-44f2-b4c6-9d79e9482abc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033761 Sep 10 11:27:51.564220 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4323/6330] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:27:52.066063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aa2396e6-576d-484e-92c5-3adcc7e2499e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:52.066679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-aa2396e6-576d-484e-92c5-3adcc7e2499e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:52.074098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa2396e6-576d-484e-92c5-3adcc7e2499e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:52.074581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa2396e6-576d-484e-92c5-3adcc7e2499e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:52.075019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa2396e6-576d-484e-92c5-3adcc7e2499e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:52.075698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa2396e6-576d-484e-92c5-3adcc7e2499e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:52.076149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa2396e6-576d-484e-92c5-3adcc7e2499e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:52.076570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aa2396e6-576d-484e-92c5-3adcc7e2499e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:52.212038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-aa2396e6-576d-484e-92c5-3adcc7e2499e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:52.219614 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aa2396e6-576d-484e-92c5-3adcc7e2499e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1318 microversion: 2.1 time: 0.157449 Sep 10 11:27:52.220182 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2008/6331] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:52 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:53.243457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5c012efe-4266-4e94-8452-3c8a6843644b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:53.244176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5c012efe-4266-4e94-8452-3c8a6843644b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:53.251239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c012efe-4266-4e94-8452-3c8a6843644b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:53.251740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c012efe-4266-4e94-8452-3c8a6843644b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:53.252193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c012efe-4266-4e94-8452-3c8a6843644b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:53.252901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c012efe-4266-4e94-8452-3c8a6843644b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:53.253395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c012efe-4266-4e94-8452-3c8a6843644b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:53.253841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c012efe-4266-4e94-8452-3c8a6843644b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:53.386488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5c012efe-4266-4e94-8452-3c8a6843644b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:53.394229 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5c012efe-4266-4e94-8452-3c8a6843644b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1507 microversion: 2.1 time: 0.155956 Sep 10 11:27:53.394806 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4324/6332] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:53 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:53.416368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cfafd365-1c80-42cf-a236-1d0e42e0882c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:53.417011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cfafd365-1c80-42cf-a236-1d0e42e0882c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:53.424143 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cfafd365-1c80-42cf-a236-1d0e42e0882c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:53.424628 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cfafd365-1c80-42cf-a236-1d0e42e0882c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:53.425088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cfafd365-1c80-42cf-a236-1d0e42e0882c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:53.425779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cfafd365-1c80-42cf-a236-1d0e42e0882c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:53.426270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cfafd365-1c80-42cf-a236-1d0e42e0882c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:53.426689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cfafd365-1c80-42cf-a236-1d0e42e0882c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:53.553563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cfafd365-1c80-42cf-a236-1d0e42e0882c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:53.561914 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cfafd365-1c80-42cf-a236-1d0e42e0882c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1507 microversion: 2.1 time: 0.149914 Sep 10 11:27:53.562486 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2009/6333] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:53 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:53.584070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:27:53.586482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:53.592521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:53.593028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:53.593527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:53.594241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:53.594720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:53.595177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:53.624384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:53.629939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Old instance type m1.heat2, new instance type m1.heat {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:27:53.631741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:53.638468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:27:53.638913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:27:53.639416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:27:53.639851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:27:53.640300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:27:53.705869 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d53625f5-2ecc-484c-bbab-eefa293039dc tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "POST /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9/action" status: 202 len: 0 microversion: 2.1 time: 0.125713 Sep 10 11:27:53.706551 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4325/6334] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:27:53 2022] POST /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:27:53.715248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-48e06ad0-8b05-4364-95dc-2847e41e5990 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:53.715866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-48e06ad0-8b05-4364-95dc-2847e41e5990 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:53.722012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e06ad0-8b05-4364-95dc-2847e41e5990 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:53.722500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e06ad0-8b05-4364-95dc-2847e41e5990 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:53.722936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e06ad0-8b05-4364-95dc-2847e41e5990 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:53.723759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e06ad0-8b05-4364-95dc-2847e41e5990 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:53.724153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e06ad0-8b05-4364-95dc-2847e41e5990 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:53.724558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-48e06ad0-8b05-4364-95dc-2847e41e5990 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:53.864067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:53.892138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-48e06ad0-8b05-4364-95dc-2847e41e5990 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:53.901477 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-48e06ad0-8b05-4364-95dc-2847e41e5990 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1514 microversion: 2.1 time: 0.190219 Sep 10 11:27:53.902660 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2010/6335] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:53 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:54.922418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:54.923436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:27:54.929045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c5ab11ae-1c4f-4810-bea9-288ec3928b06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:54.929785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c5ab11ae-1c4f-4810-bea9-288ec3928b06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:54.937632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5ab11ae-1c4f-4810-bea9-288ec3928b06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:54.938144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5ab11ae-1c4f-4810-bea9-288ec3928b06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:54.938605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5ab11ae-1c4f-4810-bea9-288ec3928b06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:54.939322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5ab11ae-1c4f-4810-bea9-288ec3928b06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:54.939801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5ab11ae-1c4f-4810-bea9-288ec3928b06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:54.940253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c5ab11ae-1c4f-4810-bea9-288ec3928b06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:55.157892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c5ab11ae-1c4f-4810-bea9-288ec3928b06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:55.166724 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c5ab11ae-1c4f-4810-bea9-288ec3928b06 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1514 microversion: 2.1 time: 0.245008 Sep 10 11:27:55.167643 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4326/6336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:54 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:56.191793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b029891d-19fe-4c26-bb04-1b7360272407 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:56.192445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b029891d-19fe-4c26-bb04-1b7360272407 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:56.199547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b029891d-19fe-4c26-bb04-1b7360272407 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:56.200026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b029891d-19fe-4c26-bb04-1b7360272407 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:56.200461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b029891d-19fe-4c26-bb04-1b7360272407 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:56.201168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b029891d-19fe-4c26-bb04-1b7360272407 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:56.201618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b029891d-19fe-4c26-bb04-1b7360272407 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:56.202038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b029891d-19fe-4c26-bb04-1b7360272407 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:56.329194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b029891d-19fe-4c26-bb04-1b7360272407 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:56.337765 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b029891d-19fe-4c26-bb04-1b7360272407 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.149249 Sep 10 11:27:56.338340 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2011/6337] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:56 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:57.360360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6aa65eb6-e3fd-4efd-86b0-cc032240a565 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:57.361001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6aa65eb6-e3fd-4efd-86b0-cc032240a565 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:57.368597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aa65eb6-e3fd-4efd-86b0-cc032240a565 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:57.369130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aa65eb6-e3fd-4efd-86b0-cc032240a565 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:57.369597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aa65eb6-e3fd-4efd-86b0-cc032240a565 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:57.370308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aa65eb6-e3fd-4efd-86b0-cc032240a565 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:57.370831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aa65eb6-e3fd-4efd-86b0-cc032240a565 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:57.371264 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6aa65eb6-e3fd-4efd-86b0-cc032240a565 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:57.502846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6aa65eb6-e3fd-4efd-86b0-cc032240a565 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:57.511409 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6aa65eb6-e3fd-4efd-86b0-cc032240a565 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.155014 Sep 10 11:27:57.511993 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4327/6338] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:57 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:58.534313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6d1f189c-d8f5-43b1-8a20-ac4f1bae9a68 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:58.534931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6d1f189c-d8f5-43b1-8a20-ac4f1bae9a68 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:58.541766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1f189c-d8f5-43b1-8a20-ac4f1bae9a68 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:58.542244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1f189c-d8f5-43b1-8a20-ac4f1bae9a68 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:58.542676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1f189c-d8f5-43b1-8a20-ac4f1bae9a68 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:58.543352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1f189c-d8f5-43b1-8a20-ac4f1bae9a68 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:58.543804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1f189c-d8f5-43b1-8a20-ac4f1bae9a68 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:58.544226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1f189c-d8f5-43b1-8a20-ac4f1bae9a68 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:58.670788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6d1f189c-d8f5-43b1-8a20-ac4f1bae9a68 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:58.678503 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6d1f189c-d8f5-43b1-8a20-ac4f1bae9a68 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.148186 Sep 10 11:27:58.679071 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2012/6339] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:58 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:27:59.704175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65bc27db-5eb3-4bcb-9918-73fa4989ebca tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:59.705171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65bc27db-5eb3-4bcb-9918-73fa4989ebca tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:27:59.711985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65bc27db-5eb3-4bcb-9918-73fa4989ebca tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:59.712499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65bc27db-5eb3-4bcb-9918-73fa4989ebca tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:59.712952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65bc27db-5eb3-4bcb-9918-73fa4989ebca tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:59.713721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65bc27db-5eb3-4bcb-9918-73fa4989ebca tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:59.714198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65bc27db-5eb3-4bcb-9918-73fa4989ebca tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:59.714641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65bc27db-5eb3-4bcb-9918-73fa4989ebca tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:59.849734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-65bc27db-5eb3-4bcb-9918-73fa4989ebca tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:27:59.857545 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65bc27db-5eb3-4bcb-9918-73fa4989ebca tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.157782 Sep 10 11:27:59.858136 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4328/6340] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:27:59 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:00.880769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3302201e-121b-4e9d-995d-472698d4d498 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:00.881318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3302201e-121b-4e9d-995d-472698d4d498 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:00.888706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3302201e-121b-4e9d-995d-472698d4d498 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:00.889222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3302201e-121b-4e9d-995d-472698d4d498 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:00.889662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3302201e-121b-4e9d-995d-472698d4d498 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:00.890344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3302201e-121b-4e9d-995d-472698d4d498 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:00.890795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3302201e-121b-4e9d-995d-472698d4d498 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:00.891221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3302201e-121b-4e9d-995d-472698d4d498 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:01.017589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3302201e-121b-4e9d-995d-472698d4d498 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:01.026164 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3302201e-121b-4e9d-995d-472698d4d498 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.149339 Sep 10 11:28:01.026742 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2013/6341] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:00 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:02.048918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-60a7d7ed-aee5-45a8-a7ce-c23c71490c31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:02.049587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-60a7d7ed-aee5-45a8-a7ce-c23c71490c31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:02.057554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60a7d7ed-aee5-45a8-a7ce-c23c71490c31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:02.058062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60a7d7ed-aee5-45a8-a7ce-c23c71490c31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:02.058522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60a7d7ed-aee5-45a8-a7ce-c23c71490c31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:02.059234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60a7d7ed-aee5-45a8-a7ce-c23c71490c31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:02.059712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60a7d7ed-aee5-45a8-a7ce-c23c71490c31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:02.060164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-60a7d7ed-aee5-45a8-a7ce-c23c71490c31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:02.194450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-60a7d7ed-aee5-45a8-a7ce-c23c71490c31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:02.202465 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-60a7d7ed-aee5-45a8-a7ce-c23c71490c31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.157749 Sep 10 11:28:02.203051 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4329/6342] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:02 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:03.225958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-27e20697-ce57-49b7-9f25-ecc28c21d64b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:03.226591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-27e20697-ce57-49b7-9f25-ecc28c21d64b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:03.234010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e20697-ce57-49b7-9f25-ecc28c21d64b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:03.234490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e20697-ce57-49b7-9f25-ecc28c21d64b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:03.234929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e20697-ce57-49b7-9f25-ecc28c21d64b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:03.235605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e20697-ce57-49b7-9f25-ecc28c21d64b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:03.236053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e20697-ce57-49b7-9f25-ecc28c21d64b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:03.236475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27e20697-ce57-49b7-9f25-ecc28c21d64b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:03.361976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-27e20697-ce57-49b7-9f25-ecc28c21d64b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:03.369708 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-27e20697-ce57-49b7-9f25-ecc28c21d64b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.147594 Sep 10 11:28:03.370287 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2014/6343] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:03 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:04.393551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7f14ad5a-1ce0-4ccb-87bc-ba7c3b17ba71 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:04.394198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7f14ad5a-1ce0-4ccb-87bc-ba7c3b17ba71 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:04.401273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f14ad5a-1ce0-4ccb-87bc-ba7c3b17ba71 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:04.401814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f14ad5a-1ce0-4ccb-87bc-ba7c3b17ba71 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:04.402275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f14ad5a-1ce0-4ccb-87bc-ba7c3b17ba71 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:04.403020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f14ad5a-1ce0-4ccb-87bc-ba7c3b17ba71 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:04.403500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f14ad5a-1ce0-4ccb-87bc-ba7c3b17ba71 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:04.403951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7f14ad5a-1ce0-4ccb-87bc-ba7c3b17ba71 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:04.532207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7f14ad5a-1ce0-4ccb-87bc-ba7c3b17ba71 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:04.540068 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7f14ad5a-1ce0-4ccb-87bc-ba7c3b17ba71 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.150798 Sep 10 11:28:04.541171 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4330/6344] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:04 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:05.563668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-56d2e81c-c5d3-4591-89e3-d5a48464c588 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:05.564232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-56d2e81c-c5d3-4591-89e3-d5a48464c588 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:05.571777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d2e81c-c5d3-4591-89e3-d5a48464c588 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:05.572743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d2e81c-c5d3-4591-89e3-d5a48464c588 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:05.573277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d2e81c-c5d3-4591-89e3-d5a48464c588 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:05.573956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d2e81c-c5d3-4591-89e3-d5a48464c588 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:05.574431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d2e81c-c5d3-4591-89e3-d5a48464c588 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:05.574850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56d2e81c-c5d3-4591-89e3-d5a48464c588 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:05.711131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-56d2e81c-c5d3-4591-89e3-d5a48464c588 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:05.718816 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-56d2e81c-c5d3-4591-89e3-d5a48464c588 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.159129 Sep 10 11:28:05.719396 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2015/6345] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:05 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:28:06.741863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-814d6f56-7424-4fd5-b2f7-d258d34e5c97 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:06.742494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-814d6f56-7424-4fd5-b2f7-d258d34e5c97 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:06.749224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-814d6f56-7424-4fd5-b2f7-d258d34e5c97 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:06.749733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-814d6f56-7424-4fd5-b2f7-d258d34e5c97 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:06.750191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-814d6f56-7424-4fd5-b2f7-d258d34e5c97 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:06.750951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-814d6f56-7424-4fd5-b2f7-d258d34e5c97 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:06.751376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-814d6f56-7424-4fd5-b2f7-d258d34e5c97 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:06.751824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-814d6f56-7424-4fd5-b2f7-d258d34e5c97 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:06.882719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-814d6f56-7424-4fd5-b2f7-d258d34e5c97 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:06.891098 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-814d6f56-7424-4fd5-b2f7-d258d34e5c97 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.153388 Sep 10 11:28:06.891682 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4331/6346] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:06 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:07.914400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ee48c464-9652-47d3-908f-50b511937701 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:07.915023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ee48c464-9652-47d3-908f-50b511937701 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:07.922844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee48c464-9652-47d3-908f-50b511937701 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:07.923334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee48c464-9652-47d3-908f-50b511937701 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:07.923774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee48c464-9652-47d3-908f-50b511937701 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:07.924463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee48c464-9652-47d3-908f-50b511937701 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:07.924919 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee48c464-9652-47d3-908f-50b511937701 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:07.925389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ee48c464-9652-47d3-908f-50b511937701 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:08.053967 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ee48c464-9652-47d3-908f-50b511937701 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:08.061664 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ee48c464-9652-47d3-908f-50b511937701 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.151122 Sep 10 11:28:08.062244 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2016/6347] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:07 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:09.084087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93602f7c-0290-49fd-bad2-d677bf446a99 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:09.084974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93602f7c-0290-49fd-bad2-d677bf446a99 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:09.088080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:09.096285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93602f7c-0290-49fd-bad2-d677bf446a99 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:09.096795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93602f7c-0290-49fd-bad2-d677bf446a99 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:09.097473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93602f7c-0290-49fd-bad2-d677bf446a99 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:09.098203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93602f7c-0290-49fd-bad2-d677bf446a99 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:09.098680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93602f7c-0290-49fd-bad2-d677bf446a99 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:09.099295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93602f7c-0290-49fd-bad2-d677bf446a99 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:09.231221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93602f7c-0290-49fd-bad2-d677bf446a99 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:09.238946 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93602f7c-0290-49fd-bad2-d677bf446a99 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.159007 Sep 10 11:28:09.239528 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4332/6348] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:09 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:10.263154 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-649ef843-e456-4b92-8702-8c142ec07bdd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:10.263762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-649ef843-e456-4b92-8702-8c142ec07bdd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:10.270603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649ef843-e456-4b92-8702-8c142ec07bdd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:10.271082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649ef843-e456-4b92-8702-8c142ec07bdd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:10.271512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649ef843-e456-4b92-8702-8c142ec07bdd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:10.272188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649ef843-e456-4b92-8702-8c142ec07bdd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:10.272633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649ef843-e456-4b92-8702-8c142ec07bdd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:10.273054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-649ef843-e456-4b92-8702-8c142ec07bdd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:10.399290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-649ef843-e456-4b92-8702-8c142ec07bdd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:10.406875 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-649ef843-e456-4b92-8702-8c142ec07bdd tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.148221 Sep 10 11:28:10.407446 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2017/6349] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:10 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:11.430764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-272194f6-a6b2-40e0-90f6-3003eceabd5a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:11.431399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-272194f6-a6b2-40e0-90f6-3003eceabd5a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:11.438984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-272194f6-a6b2-40e0-90f6-3003eceabd5a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:11.439527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-272194f6-a6b2-40e0-90f6-3003eceabd5a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:11.439985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-272194f6-a6b2-40e0-90f6-3003eceabd5a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:11.440696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-272194f6-a6b2-40e0-90f6-3003eceabd5a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:11.441218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-272194f6-a6b2-40e0-90f6-3003eceabd5a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:11.441669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-272194f6-a6b2-40e0-90f6-3003eceabd5a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:11.570481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-272194f6-a6b2-40e0-90f6-3003eceabd5a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:11.578235 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-272194f6-a6b2-40e0-90f6-3003eceabd5a tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.151524 Sep 10 11:28:11.578820 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4333/6350] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:11 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:12.601460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-54dbc15b-320e-46e6-8725-41d7d3d7f292 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:12.602095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-54dbc15b-320e-46e6-8725-41d7d3d7f292 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:12.609867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54dbc15b-320e-46e6-8725-41d7d3d7f292 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:12.610349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54dbc15b-320e-46e6-8725-41d7d3d7f292 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:12.610785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54dbc15b-320e-46e6-8725-41d7d3d7f292 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:12.611492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54dbc15b-320e-46e6-8725-41d7d3d7f292 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:12.611939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54dbc15b-320e-46e6-8725-41d7d3d7f292 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:12.612360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-54dbc15b-320e-46e6-8725-41d7d3d7f292 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:12.739077 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-54dbc15b-320e-46e6-8725-41d7d3d7f292 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:12.746726 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-54dbc15b-320e-46e6-8725-41d7d3d7f292 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.149104 Sep 10 11:28:12.747298 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2018/6351] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:12 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:13.769741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4553ed30-16f8-43c2-839b-07a09254b808 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:13.770369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4553ed30-16f8-43c2-839b-07a09254b808 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:13.777938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4553ed30-16f8-43c2-839b-07a09254b808 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:13.778436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4553ed30-16f8-43c2-839b-07a09254b808 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:13.778886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4553ed30-16f8-43c2-839b-07a09254b808 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:13.779588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4553ed30-16f8-43c2-839b-07a09254b808 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:13.780053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4553ed30-16f8-43c2-839b-07a09254b808 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:13.780494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4553ed30-16f8-43c2-839b-07a09254b808 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:13.915827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4553ed30-16f8-43c2-839b-07a09254b808 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:13.924738 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4553ed30-16f8-43c2-839b-07a09254b808 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.158886 Sep 10 11:28:13.925352 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4334/6352] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:13 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:14.948092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-940e116c-f165-4213-8ab2-e908251e6a17 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:14.948616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-940e116c-f165-4213-8ab2-e908251e6a17 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:14.951875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:14.957863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-940e116c-f165-4213-8ab2-e908251e6a17 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:14.958350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-940e116c-f165-4213-8ab2-e908251e6a17 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:14.958790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-940e116c-f165-4213-8ab2-e908251e6a17 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:14.959483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-940e116c-f165-4213-8ab2-e908251e6a17 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:14.959936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-940e116c-f165-4213-8ab2-e908251e6a17 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:14.960361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-940e116c-f165-4213-8ab2-e908251e6a17 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:14.963803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:15.091037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-940e116c-f165-4213-8ab2-e908251e6a17 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:15.098941 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-940e116c-f165-4213-8ab2-e908251e6a17 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.154835 Sep 10 11:28:15.099519 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2019/6353] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:14 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:16.121928 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed701862-318e-438a-b11e-362b116a112d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:16.122567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed701862-318e-438a-b11e-362b116a112d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:16.129640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed701862-318e-438a-b11e-362b116a112d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:16.130144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed701862-318e-438a-b11e-362b116a112d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:16.130605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed701862-318e-438a-b11e-362b116a112d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:16.131324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed701862-318e-438a-b11e-362b116a112d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:16.131800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed701862-318e-438a-b11e-362b116a112d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:16.132249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed701862-318e-438a-b11e-362b116a112d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:16.267835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ed701862-318e-438a-b11e-362b116a112d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:16.275769 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed701862-318e-438a-b11e-362b116a112d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.158107 Sep 10 11:28:16.276294 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4335/6354] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:16 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:17.298717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7c0b4590-6405-4f51-bbd2-60c716376953 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:17.299332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7c0b4590-6405-4f51-bbd2-60c716376953 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:17.306293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c0b4590-6405-4f51-bbd2-60c716376953 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:17.306780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c0b4590-6405-4f51-bbd2-60c716376953 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:17.307221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c0b4590-6405-4f51-bbd2-60c716376953 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:17.307909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c0b4590-6405-4f51-bbd2-60c716376953 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:17.308365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c0b4590-6405-4f51-bbd2-60c716376953 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:17.308790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7c0b4590-6405-4f51-bbd2-60c716376953 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:17.438978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7c0b4590-6405-4f51-bbd2-60c716376953 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:17.446879 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7c0b4590-6405-4f51-bbd2-60c716376953 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.152570 Sep 10 11:28:17.447468 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2020/6355] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:17 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:18.472004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8338cbd9-ac00-47ec-82bd-6ef10f15a445 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:18.472548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8338cbd9-ac00-47ec-82bd-6ef10f15a445 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:18.479642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8338cbd9-ac00-47ec-82bd-6ef10f15a445 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:18.480135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8338cbd9-ac00-47ec-82bd-6ef10f15a445 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:18.480581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8338cbd9-ac00-47ec-82bd-6ef10f15a445 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:18.481306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8338cbd9-ac00-47ec-82bd-6ef10f15a445 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:18.481773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8338cbd9-ac00-47ec-82bd-6ef10f15a445 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:18.482209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8338cbd9-ac00-47ec-82bd-6ef10f15a445 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:18.607789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8338cbd9-ac00-47ec-82bd-6ef10f15a445 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:18.615516 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8338cbd9-ac00-47ec-82bd-6ef10f15a445 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.147554 Sep 10 11:28:18.616092 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4336/6356] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:18 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:19.639189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-50b4b910-92fd-4078-b697-925af98eae87 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:19.639799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-50b4b910-92fd-4078-b697-925af98eae87 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:19.646419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b4b910-92fd-4078-b697-925af98eae87 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:19.646910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b4b910-92fd-4078-b697-925af98eae87 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:19.647328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b4b910-92fd-4078-b697-925af98eae87 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:19.648005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b4b910-92fd-4078-b697-925af98eae87 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:19.648453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b4b910-92fd-4078-b697-925af98eae87 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:19.648873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-50b4b910-92fd-4078-b697-925af98eae87 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:19.784343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-50b4b910-92fd-4078-b697-925af98eae87 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:19.792033 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-50b4b910-92fd-4078-b697-925af98eae87 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.157277 Sep 10 11:28:19.792612 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2021/6357] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:19 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:20.815737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-76b5ab99-3f5c-4689-acd5-295285cf04a7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:20.816368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-76b5ab99-3f5c-4689-acd5-295285cf04a7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:20.823328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b5ab99-3f5c-4689-acd5-295285cf04a7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:20.823836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b5ab99-3f5c-4689-acd5-295285cf04a7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:20.824294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b5ab99-3f5c-4689-acd5-295285cf04a7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:20.825005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b5ab99-3f5c-4689-acd5-295285cf04a7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:20.825508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b5ab99-3f5c-4689-acd5-295285cf04a7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:20.826010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-76b5ab99-3f5c-4689-acd5-295285cf04a7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:20.952442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-76b5ab99-3f5c-4689-acd5-295285cf04a7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:20.960243 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-76b5ab99-3f5c-4689-acd5-295285cf04a7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.148475 Sep 10 11:28:20.960824 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4337/6358] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:20 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:21.984240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7d0813fd-97b4-44d1-b016-e06492bde37c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:21.984770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7d0813fd-97b4-44d1-b016-e06492bde37c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:21.991439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d0813fd-97b4-44d1-b016-e06492bde37c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:21.991917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d0813fd-97b4-44d1-b016-e06492bde37c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:21.992345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d0813fd-97b4-44d1-b016-e06492bde37c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:21.993018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d0813fd-97b4-44d1-b016-e06492bde37c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:21.993487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d0813fd-97b4-44d1-b016-e06492bde37c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:21.993907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7d0813fd-97b4-44d1-b016-e06492bde37c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:22.134494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7d0813fd-97b4-44d1-b016-e06492bde37c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:22.142286 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7d0813fd-97b4-44d1-b016-e06492bde37c tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1519 microversion: 2.1 time: 0.162505 Sep 10 11:28:22.142863 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2022/6359] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:21 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:22.981245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-6daaef97-a4a9-4644-815e-19cc830a34b9 req-c671a294-c8b0-4bf2-80e7-3c48ea82f052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db839a3-2208-4cf5-a918-cbdfb65775c9", "name": "network-vif-unplugged", "status": "completed", "tag": "b39449e8-1201-4bc6-a73e-60946c56aa6f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:22.992106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6daaef97-a4a9-4644-815e-19cc830a34b9 req-c671a294-c8b0-4bf2-80e7-3c48ea82f052 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:22.992777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6daaef97-a4a9-4644-815e-19cc830a34b9 req-c671a294-c8b0-4bf2-80e7-3c48ea82f052 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:22.993337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-6daaef97-a4a9-4644-815e-19cc830a34b9 req-c671a294-c8b0-4bf2-80e7-3c48ea82f052 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:23.005982 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-6daaef97-a4a9-4644-815e-19cc830a34b9 req-c671a294-c8b0-4bf2-80e7-3c48ea82f052 service nova] Creating event network-vif-unplugged:b39449e8-1201-4bc6-a73e-60946c56aa6f for instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 on n-h1-856894-1 Sep 10 11:28:23.011473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-6daaef97-a4a9-4644-815e-19cc830a34b9 req-c671a294-c8b0-4bf2-80e7-3c48ea82f052 service nova] Instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:28:23.022819 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-6daaef97-a4a9-4644-815e-19cc830a34b9 req-c671a294-c8b0-4bf2-80e7-3c48ea82f052 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045624 Sep 10 11:28:23.023441 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4338/6360] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:28:23.165704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bc854175-68b8-4824-81e5-48bd323423d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:23.166412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bc854175-68b8-4824-81e5-48bd323423d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:23.174438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc854175-68b8-4824-81e5-48bd323423d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:23.174791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc854175-68b8-4824-81e5-48bd323423d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:23.175230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc854175-68b8-4824-81e5-48bd323423d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:23.175907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc854175-68b8-4824-81e5-48bd323423d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:23.176360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc854175-68b8-4824-81e5-48bd323423d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:23.176786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc854175-68b8-4824-81e5-48bd323423d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:23.413992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bc854175-68b8-4824-81e5-48bd323423d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:23.422901 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bc854175-68b8-4824-81e5-48bd323423d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1518 microversion: 2.1 time: 0.260961 Sep 10 11:28:23.423891 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2023/6361] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:23 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1518 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:24.448814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-832b3020-714c-498a-9817-15fa85dc0012 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:24.449606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-832b3020-714c-498a-9817-15fa85dc0012 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:24.455855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-832b3020-714c-498a-9817-15fa85dc0012 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:24.456367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-832b3020-714c-498a-9817-15fa85dc0012 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:24.456898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-832b3020-714c-498a-9817-15fa85dc0012 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:24.457644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-832b3020-714c-498a-9817-15fa85dc0012 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:24.458127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-832b3020-714c-498a-9817-15fa85dc0012 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:24.458579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-832b3020-714c-498a-9817-15fa85dc0012 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:24.462681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:24.606737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-832b3020-714c-498a-9817-15fa85dc0012 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:24.614526 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-832b3020-714c-498a-9817-15fa85dc0012 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1516 microversion: 2.1 time: 0.170984 Sep 10 11:28:24.615103 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4339/6362] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:24 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:25.051656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-564e71af-f8d3-4c7d-a637-fcddee648662 req-c385c922-3e9f-4f4d-841c-fc7c37d7797f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db839a3-2208-4cf5-a918-cbdfb65775c9", "tag": "b39449e8-1201-4bc6-a73e-60946c56aa6f"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:25.062425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-564e71af-f8d3-4c7d-a637-fcddee648662 req-c385c922-3e9f-4f4d-841c-fc7c37d7797f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:25.062894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-564e71af-f8d3-4c7d-a637-fcddee648662 req-c385c922-3e9f-4f4d-841c-fc7c37d7797f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:25.063335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-564e71af-f8d3-4c7d-a637-fcddee648662 req-c385c922-3e9f-4f4d-841c-fc7c37d7797f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:25.075316 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-564e71af-f8d3-4c7d-a637-fcddee648662 req-c385c922-3e9f-4f4d-841c-fc7c37d7797f service nova] Creating event network-changed:b39449e8-1201-4bc6-a73e-60946c56aa6f for instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 on n-h1-856894-1 Sep 10 11:28:25.080481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-564e71af-f8d3-4c7d-a637-fcddee648662 req-c385c922-3e9f-4f4d-841c-fc7c37d7797f service nova] Instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:28:25.091224 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-564e71af-f8d3-4c7d-a637-fcddee648662 req-c385c922-3e9f-4f4d-841c-fc7c37d7797f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043246 Sep 10 11:28:25.092008 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2024/6363] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:28:25.637861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ae99b7ef-b0a5-4878-8dcb-18252defdb31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:25.638702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ae99b7ef-b0a5-4878-8dcb-18252defdb31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:25.646455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae99b7ef-b0a5-4878-8dcb-18252defdb31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:25.646965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae99b7ef-b0a5-4878-8dcb-18252defdb31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:25.647426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae99b7ef-b0a5-4878-8dcb-18252defdb31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:25.648178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae99b7ef-b0a5-4878-8dcb-18252defdb31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:25.648676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae99b7ef-b0a5-4878-8dcb-18252defdb31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:25.649162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ae99b7ef-b0a5-4878-8dcb-18252defdb31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:25.965807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ae99b7ef-b0a5-4878-8dcb-18252defdb31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:25.973636 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ae99b7ef-b0a5-4878-8dcb-18252defdb31 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1513 microversion: 2.1 time: 0.340758 Sep 10 11:28:25.974230 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4340/6364] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:25 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1513 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:25.997393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e592787e-570d-4084-839c-36c15f8399b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:25.998024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e592787e-570d-4084-839c-36c15f8399b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:26.004222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e592787e-570d-4084-839c-36c15f8399b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:26.004715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e592787e-570d-4084-839c-36c15f8399b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:26.005180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e592787e-570d-4084-839c-36c15f8399b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:26.005885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e592787e-570d-4084-839c-36c15f8399b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:26.006346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e592787e-570d-4084-839c-36c15f8399b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:26.006776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e592787e-570d-4084-839c-36c15f8399b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:26.069225 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e592787e-570d-4084-839c-36c15f8399b0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "POST /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9/action" status: 204 len: 0 microversion: 2.1 time: 0.076661 Sep 10 11:28:26.069904 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2025/6365] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:28:25 2022] POST /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:28:26.079058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b62dfa27-23a9-40c8-9252-8385a756587e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:26.079783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b62dfa27-23a9-40c8-9252-8385a756587e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:26.087214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b62dfa27-23a9-40c8-9252-8385a756587e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:26.087930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b62dfa27-23a9-40c8-9252-8385a756587e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:26.088577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b62dfa27-23a9-40c8-9252-8385a756587e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:26.089518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b62dfa27-23a9-40c8-9252-8385a756587e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:26.090477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b62dfa27-23a9-40c8-9252-8385a756587e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:26.091085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b62dfa27-23a9-40c8-9252-8385a756587e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:26.457702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b62dfa27-23a9-40c8-9252-8385a756587e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:26.465734 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b62dfa27-23a9-40c8-9252-8385a756587e tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1513 microversion: 2.1 time: 0.391527 Sep 10 11:28:26.466328 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4341/6366] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:26 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1513 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:27.490003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-083e2af0-5346-4117-aeb5-342969065be1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:27.490624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-083e2af0-5346-4117-aeb5-342969065be1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:27.497556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-083e2af0-5346-4117-aeb5-342969065be1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:27.498044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-083e2af0-5346-4117-aeb5-342969065be1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:27.498487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-083e2af0-5346-4117-aeb5-342969065be1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:27.499169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-083e2af0-5346-4117-aeb5-342969065be1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:27.499624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-083e2af0-5346-4117-aeb5-342969065be1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:27.500050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-083e2af0-5346-4117-aeb5-342969065be1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:27.639947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-083e2af0-5346-4117-aeb5-342969065be1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:27.649990 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-083e2af0-5346-4117-aeb5-342969065be1 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1505 microversion: 2.1 time: 0.165106 Sep 10 11:28:27.653134 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2026/6367] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:27 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:27.680757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-77137979-3f43-439a-a215-956a3e235e2d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:27.683882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-77137979-3f43-439a-a215-956a3e235e2d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:27.695872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77137979-3f43-439a-a215-956a3e235e2d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:27.696391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77137979-3f43-439a-a215-956a3e235e2d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:27.696851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77137979-3f43-439a-a215-956a3e235e2d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:27.697598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77137979-3f43-439a-a215-956a3e235e2d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:27.698070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77137979-3f43-439a-a215-956a3e235e2d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:27.698517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-77137979-3f43-439a-a215-956a3e235e2d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:27.838041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-77137979-3f43-439a-a215-956a3e235e2d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:27.846650 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-77137979-3f43-439a-a215-956a3e235e2d tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1505 microversion: 2.1 time: 0.175350 Sep 10 11:28:27.847569 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4342/6368] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:27 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:27.868611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e9d1c491-d9c3-421c-b8e2-4c32542f8dc0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:27.869258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e9d1c491-d9c3-421c-b8e2-4c32542f8dc0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:27.875491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9d1c491-d9c3-421c-b8e2-4c32542f8dc0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:27.875988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9d1c491-d9c3-421c-b8e2-4c32542f8dc0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:27.876427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9d1c491-d9c3-421c-b8e2-4c32542f8dc0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:27.877290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9d1c491-d9c3-421c-b8e2-4c32542f8dc0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:27.877749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9d1c491-d9c3-421c-b8e2-4c32542f8dc0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:27.878177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e9d1c491-d9c3-421c-b8e2-4c32542f8dc0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:28.012496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e9d1c491-d9c3-421c-b8e2-4c32542f8dc0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:28.020488 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e9d1c491-d9c3-421c-b8e2-4c32542f8dc0 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1505 microversion: 2.1 time: 0.155748 Sep 10 11:28:28.021093 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2027/6369] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:27 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:28.043860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1901f0e0-18dc-4377-b63e-8a62994975d5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:28.044384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1901f0e0-18dc-4377-b63e-8a62994975d5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:28.050803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1901f0e0-18dc-4377-b63e-8a62994975d5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:28.051310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1901f0e0-18dc-4377-b63e-8a62994975d5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:28.051768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1901f0e0-18dc-4377-b63e-8a62994975d5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:28.052479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1901f0e0-18dc-4377-b63e-8a62994975d5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:28.052954 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1901f0e0-18dc-4377-b63e-8a62994975d5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:28.053430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1901f0e0-18dc-4377-b63e-8a62994975d5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:28.079107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1901f0e0-18dc-4377-b63e-8a62994975d5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:28:28.163955 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1901f0e0-18dc-4377-b63e-8a62994975d5 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 204 len: 0 microversion: 2.1 time: 0.123748 Sep 10 11:28:28.164812 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4343/6370] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:28:28 2022] DELETE /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:28:28.178278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:28.178787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:28.184809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:28.185334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:28.185775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:28.186467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:28.186923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:28.187346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:28.215305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:28:28.265006 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.compute.api [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Instance is already in deleting state, ignoring this request Sep 10 11:28:28.265877 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-593d3be7-51c2-4428-be38-f4380de6b40b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 204 len: 0 microversion: 2.1 time: 0.091483 Sep 10 11:28:28.266448 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2028/6371] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:28:28 2022] DELETE /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:28:28.275112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0ea702fe-e3fe-4a1c-b697-9cabe4004e0b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:28.275854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0ea702fe-e3fe-4a1c-b697-9cabe4004e0b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:28.282343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ea702fe-e3fe-4a1c-b697-9cabe4004e0b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:28.282849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ea702fe-e3fe-4a1c-b697-9cabe4004e0b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:28.283309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ea702fe-e3fe-4a1c-b697-9cabe4004e0b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:28.284020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ea702fe-e3fe-4a1c-b697-9cabe4004e0b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:28.284501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ea702fe-e3fe-4a1c-b697-9cabe4004e0b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:28.284952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0ea702fe-e3fe-4a1c-b697-9cabe4004e0b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:28.412904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0ea702fe-e3fe-4a1c-b697-9cabe4004e0b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:28.421184 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0ea702fe-e3fe-4a1c-b697-9cabe4004e0b tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1511 microversion: 2.1 time: 0.150312 Sep 10 11:28:28.421769 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4344/6372] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:28 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:29.443803 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-10080b8b-fcfd-43ad-be7a-341166e8ea83 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:29.444420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-10080b8b-fcfd-43ad-be7a-341166e8ea83 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:29.452035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10080b8b-fcfd-43ad-be7a-341166e8ea83 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:29.452526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10080b8b-fcfd-43ad-be7a-341166e8ea83 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:29.452961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10080b8b-fcfd-43ad-be7a-341166e8ea83 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:29.453688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10080b8b-fcfd-43ad-be7a-341166e8ea83 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:29.454137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10080b8b-fcfd-43ad-be7a-341166e8ea83 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:29.454557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-10080b8b-fcfd-43ad-be7a-341166e8ea83 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:29.679440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-10080b8b-fcfd-43ad-be7a-341166e8ea83 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf5075ee52c4401bab568816670d5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd62f7c4ab2428eb24d7cd630df715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:29.688552 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-10080b8b-fcfd-43ad-be7a-341166e8ea83 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 200 len: 1511 microversion: 2.1 time: 0.248650 Sep 10 11:28:29.696272 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2029/6373] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:29 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:29.951232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-90023d18-ebd9-46aa-8cf5-f12086df5505 req-95fdaebd-f9f7-49bd-b455-1be09c916a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db839a3-2208-4cf5-a918-cbdfb65775c9", "name": "network-vif-deleted", "tag": "b39449e8-1201-4bc6-a73e-60946c56aa6f"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:29.963650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-90023d18-ebd9-46aa-8cf5-f12086df5505 req-95fdaebd-f9f7-49bd-b455-1be09c916a83 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:29.964165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-90023d18-ebd9-46aa-8cf5-f12086df5505 req-95fdaebd-f9f7-49bd-b455-1be09c916a83 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:29.964598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-90023d18-ebd9-46aa-8cf5-f12086df5505 req-95fdaebd-f9f7-49bd-b455-1be09c916a83 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:29.979007 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-90023d18-ebd9-46aa-8cf5-f12086df5505 req-95fdaebd-f9f7-49bd-b455-1be09c916a83 service nova] Creating event network-vif-deleted:b39449e8-1201-4bc6-a73e-60946c56aa6f for instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 on n-h1-856894-1 Sep 10 11:28:29.984176 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-90023d18-ebd9-46aa-8cf5-f12086df5505 req-95fdaebd-f9f7-49bd-b455-1be09c916a83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037483 Sep 10 11:28:29.984800 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4345/6374] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:28:30.710923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:30.711545 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 8db839a3-2208-4cf5-a918-cbdfb65775c9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:30.718427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:30.718910 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:30.719345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:30.720097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:30.720551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:30.720973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:30.735210 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] HTTP exception thrown: Instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 could not be found. Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Request method failure captured: Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 HTTP/1.1 Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHR-XSsNg3XWoJhAw5Bllsq1eCYzdwySNpVg-z9FbKDWRwrojfuBrdnD5LHtoDbdhu5M8_b9bFTh_nuiDV-K5hSgWU3LgNARXEU4PGyYYn_8k_V6pCKBWHykOQJxvm-MV7TfOTcrBLzbQ12Ocvvo5Lvq4xhGN0r5HPUpiUYzDJukONQ Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 5bd62f7c4ab2428eb24d7cd630df715c Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerDiskConfigTestJSON-960226822 Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bd62f7c4ab2428eb24d7cd630df715c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bd62f7c4ab2428eb24d7cd630df715c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bd62f7c4ab2428eb24d7cd630df715c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bd62f7c4ab2428eb24d7cd630df715c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerDiskConfigTestJSON-960226822 Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 5bd62f7c4ab2428eb24d7cd630df715c Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-960226822 Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerDiskConfigTestJSON-960226822-project Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: cbf5075ee52c4401bab568816670d5e6 Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerDiskConfigTestJSON-960226822-project Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 could not be found. Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '8db839a3-2208-4cf5-a918-cbdfb65775c9'} Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 could not be found. Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 could not be found. Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:28:30.736856 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:28:30.741464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:28:30.741464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:28:30.741464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:28:30.741464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:28:30.741464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:28:30.741464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 could not be found. Sep 10 11:28:30.741464 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:28:30.741464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Returning 404 to user: Instance 8db839a3-2208-4cf5-a918-cbdfb65775c9 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:28:30.741464 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ffd7bc8-5ef0-443c-aa80-300cb30254ea tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9" status: 404 len: 111 microversion: 2.1 time: 0.031304 Sep 10 11:28:30.741464 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2030/6375] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:30 2022] GET /compute/v2.1/servers/8db839a3-2208-4cf5-a918-cbdfb65775c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:28:30.748305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-381fda18-0062-497e-b00b-d7c3b9d198ac tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '.version_select at 0x7efcb2bfc4c0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:30.769690 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-381fda18-0062-497e-b00b-d7c3b9d198ac tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122603256" status: 202 len: 0 microversion: 2.1 time: 0.026323 Sep 10 11:28:30.770278 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4346/6376] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 11:28:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122603256 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:28:31.645540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:31.646054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:31.651992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:31.653107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:31.653551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:31.654236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:31.654691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:31.655116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:31.668358 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] HTTP exception thrown: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Request method failure captured: Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 HTTP/1.1 Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHR-XSsNg3XWoJhAw5Bllsq1eCYzdwySNpVg-z9FbKDWRwrojfuBrdnD5LHtoDbdhu5M8_b9bFTh_nuiDV-K5hSgWU3LgNARXEU4PGyYYn_8k_V6pCKBWHykOQJxvm-MV7TfOTcrBLzbQ12Ocvvo5Lvq4xhGN0r5HPUpiUYzDJukONQ Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 5bd62f7c4ab2428eb24d7cd630df715c Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerDiskConfigTestJSON-960226822 Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bd62f7c4ab2428eb24d7cd630df715c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bd62f7c4ab2428eb24d7cd630df715c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bd62f7c4ab2428eb24d7cd630df715c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bd62f7c4ab2428eb24d7cd630df715c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerDiskConfigTestJSON-960226822 Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 5bd62f7c4ab2428eb24d7cd630df715c Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-960226822 Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerDiskConfigTestJSON-960226822-project Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: cbf5075ee52c4401bab568816670d5e6 Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerDiskConfigTestJSON-960226822-project Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '7520ab97-ab20-4aa1-919f-920faa66b7f8'} Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:28:31.669921 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Returning 404 to user: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1aa7747b-4506-427f-817a-f587bc0746d7 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 404 len: 111 microversion: 2.1 time: 0.029950 Sep 10 11:28:31.674123 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2031/6377] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:28:31 2022] DELETE /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:28:31.681327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:31.682097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] [instance: 7520ab97-ab20-4aa1-919f-920faa66b7f8] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:31.688914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:31.689453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:31.689926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:31.690643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:31.691125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:31.691578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:31.705467 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] HTTP exception thrown: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Request method failure captured: Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 HTTP/1.1 Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHR-XSsNg3XWoJhAw5Bllsq1eCYzdwySNpVg-z9FbKDWRwrojfuBrdnD5LHtoDbdhu5M8_b9bFTh_nuiDV-K5hSgWU3LgNARXEU4PGyYYn_8k_V6pCKBWHykOQJxvm-MV7TfOTcrBLzbQ12Ocvvo5Lvq4xhGN0r5HPUpiUYzDJukONQ Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 5bd62f7c4ab2428eb24d7cd630df715c Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerDiskConfigTestJSON-960226822 Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bd62f7c4ab2428eb24d7cd630df715c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bd62f7c4ab2428eb24d7cd630df715c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bd62f7c4ab2428eb24d7cd630df715c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bd62f7c4ab2428eb24d7cd630df715c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerDiskConfigTestJSON-960226822 Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 5bd62f7c4ab2428eb24d7cd630df715c Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-960226822 Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerDiskConfigTestJSON-960226822-project Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: cbf5075ee52c4401bab568816670d5e6 Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerDiskConfigTestJSON-960226822-project Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '7520ab97-ab20-4aa1-919f-920faa66b7f8'} Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:28:31.707132 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:28:31.710975 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:28:31.710975 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:28:31.710975 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:28:31.710975 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:28:31.710975 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:28:31.710975 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. Sep 10 11:28:31.710975 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:28:31.710975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] Returning 404 to user: Instance 7520ab97-ab20-4aa1-919f-920faa66b7f8 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:28:31.710975 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f0c8e6a-7a56-4cbd-85f3-d294427ce017 tempest-ServerDiskConfigTestJSON-960226822 tempest-ServerDiskConfigTestJSON-960226822-project] 10.222.0.20 "GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8" status: 404 len: 111 microversion: 2.1 time: 0.032257 Sep 10 11:28:31.710975 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4347/6378] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:31 2022] GET /compute/v2.1/servers/7520ab97-ab20-4aa1-919f-920faa66b7f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:28:39.859940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-203476f7-c8b8-4327-b994-330d408dfd96 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'create', calling method: .version_select at 0x7efcade2d040>, body: {"keypair": {"name": "tempest-keypair-1238555339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFxAhHTbJoz5AoL61/Q2r36a8rUMOD2piemuQzAu0HWEvxvlGkkt7H/VQ8Joo3ymzolAhwVA9SFi3OBAQpI2Wjq+eD/oChIh8Zha0guo/XZcEHG8mCQGI3SHMrVnPH2Dw=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:39.876345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-203476f7-c8b8-4327-b994-330d408dfd96 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:28:39.883151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-203476f7-c8b8-4327-b994-330d408dfd96 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for user 61a1365243a242b98c96ce078a850c09 and project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:28:39.911975 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-203476f7-c8b8-4327-b994-330d408dfd96 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172627 Sep 10 11:28:39.912604 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2032/6379] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:28:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:28:41.246293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-280419305", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95f13bd4-0756-4b44-9560-173cb6276b85"}], "security_groups": [{"name": "tempest-securitygroup--2045802151"}], "key_name": "tempest-keypair-1238555339", "user_data": "}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:41.258112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:41.365379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] validate_networks() for [('95f13bd4-0756-4b44-9560-173cb6276b85', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:28:41.696539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:41.748934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:28:41.749473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:28:41.750064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:28:41.750583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:28:41.751095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:28:41.760070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:41.760641 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:41.761123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:41.761974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:41.762502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:41.763117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:41.780596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:28:41.785894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for user 61a1365243a242b98c96ce078a850c09 and project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:28:41.798955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:28:41.801345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:28:41.851697 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4097ab5f-ecbb-4096-b057-823c67f83db0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.611507 Sep 10 11:28:41.859001 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4348/6380] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:28:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:28:41.864472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e23dcaf3-662d-406b-a079-a073e877e0f6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:41.865210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e23dcaf3-662d-406b-a079-a073e877e0f6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:41.868190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:41.959246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e23dcaf3-662d-406b-a079-a073e877e0f6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:41.967790 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e23dcaf3-662d-406b-a079-a073e877e0f6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1238 microversion: 2.1 time: 0.107298 Sep 10 11:28:41.981386 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2033/6381] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:41 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:42.993284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-168a3ecb-3433-4a72-8c40-3a38d0c3a486 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:42.994500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-168a3ecb-3433-4a72-8c40-3a38d0c3a486 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:43.007843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168a3ecb-3433-4a72-8c40-3a38d0c3a486 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:43.008592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168a3ecb-3433-4a72-8c40-3a38d0c3a486 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:43.009429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168a3ecb-3433-4a72-8c40-3a38d0c3a486 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:43.010995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168a3ecb-3433-4a72-8c40-3a38d0c3a486 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:43.012025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168a3ecb-3433-4a72-8c40-3a38d0c3a486 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:43.012635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-168a3ecb-3433-4a72-8c40-3a38d0c3a486 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:43.128532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-168a3ecb-3433-4a72-8c40-3a38d0c3a486 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:43.137040 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-168a3ecb-3433-4a72-8c40-3a38d0c3a486 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1290 microversion: 2.1 time: 0.149810 Sep 10 11:28:43.142308 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4349/6382] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:42 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1290 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:44.164931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c42786b0-58ef-4524-8718-89538539ec95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:44.165754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c42786b0-58ef-4524-8718-89538539ec95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:44.175056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42786b0-58ef-4524-8718-89538539ec95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:44.175555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42786b0-58ef-4524-8718-89538539ec95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:44.175997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42786b0-58ef-4524-8718-89538539ec95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:44.176702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42786b0-58ef-4524-8718-89538539ec95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:44.177198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42786b0-58ef-4524-8718-89538539ec95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:44.177732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42786b0-58ef-4524-8718-89538539ec95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:44.410687 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c42786b0-58ef-4524-8718-89538539ec95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:44.419024 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c42786b0-58ef-4524-8718-89538539ec95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1364 microversion: 2.1 time: 0.258065 Sep 10 11:28:44.419605 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2034/6383] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:44 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:44.579631 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1cf52e91-66b8-45f6-a9f3-6c4f877e809d req-0d8028c2-ee04-41bd-b1c5-59faf0a11ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24aec4ea-87cc-474b-ae4c-86246f388508", "tag": "85980453-f74c-4bff-b8af-016fca5a4be9"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:44.600536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1cf52e91-66b8-45f6-a9f3-6c4f877e809d req-0d8028c2-ee04-41bd-b1c5-59faf0a11ff1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:44.601046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1cf52e91-66b8-45f6-a9f3-6c4f877e809d req-0d8028c2-ee04-41bd-b1c5-59faf0a11ff1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:44.601524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1cf52e91-66b8-45f6-a9f3-6c4f877e809d req-0d8028c2-ee04-41bd-b1c5-59faf0a11ff1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:44.618527 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1cf52e91-66b8-45f6-a9f3-6c4f877e809d req-0d8028c2-ee04-41bd-b1c5-59faf0a11ff1 service nova] Creating event network-changed:85980453-f74c-4bff-b8af-016fca5a4be9 for instance 24aec4ea-87cc-474b-ae4c-86246f388508 on n-h1-856894-1 Sep 10 11:28:44.624427 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1cf52e91-66b8-45f6-a9f3-6c4f877e809d req-0d8028c2-ee04-41bd-b1c5-59faf0a11ff1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048992 Sep 10 11:28:44.625046 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4350/6384] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:28:45.442987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-db636d24-fd50-4d37-98fc-8cebf88df6e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:45.443595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-db636d24-fd50-4d37-98fc-8cebf88df6e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:45.446323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:45.452381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db636d24-fd50-4d37-98fc-8cebf88df6e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:45.452859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db636d24-fd50-4d37-98fc-8cebf88df6e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:45.453319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db636d24-fd50-4d37-98fc-8cebf88df6e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:45.453992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db636d24-fd50-4d37-98fc-8cebf88df6e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:45.454436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db636d24-fd50-4d37-98fc-8cebf88df6e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:45.454852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db636d24-fd50-4d37-98fc-8cebf88df6e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:45.580690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-db636d24-fd50-4d37-98fc-8cebf88df6e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:45.588339 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-db636d24-fd50-4d37-98fc-8cebf88df6e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1364 microversion: 2.1 time: 0.149262 Sep 10 11:28:45.588910 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2035/6385] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:45 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:46.611775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0184882-36cb-4266-93c6-8af8279e9ed5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:46.612486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0184882-36cb-4266-93c6-8af8279e9ed5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:46.618745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0184882-36cb-4266-93c6-8af8279e9ed5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:46.619243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0184882-36cb-4266-93c6-8af8279e9ed5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:46.619693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0184882-36cb-4266-93c6-8af8279e9ed5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:46.620427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0184882-36cb-4266-93c6-8af8279e9ed5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:46.620895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0184882-36cb-4266-93c6-8af8279e9ed5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:46.621360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0184882-36cb-4266-93c6-8af8279e9ed5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:46.758128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0184882-36cb-4266-93c6-8af8279e9ed5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:46.766390 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0184882-36cb-4266-93c6-8af8279e9ed5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1364 microversion: 2.1 time: 0.159875 Sep 10 11:28:46.766980 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4351/6386] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:46 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:47.789369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3c11667a-7bac-4050-9d02-81ba2c2b309f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:47.789990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3c11667a-7bac-4050-9d02-81ba2c2b309f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:47.798408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c11667a-7bac-4050-9d02-81ba2c2b309f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:47.798929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c11667a-7bac-4050-9d02-81ba2c2b309f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:47.799345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c11667a-7bac-4050-9d02-81ba2c2b309f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:47.800043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c11667a-7bac-4050-9d02-81ba2c2b309f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:47.800504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c11667a-7bac-4050-9d02-81ba2c2b309f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:47.800938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c11667a-7bac-4050-9d02-81ba2c2b309f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:47.934291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c11667a-7bac-4050-9d02-81ba2c2b309f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:47.942046 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3c11667a-7bac-4050-9d02-81ba2c2b309f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1364 microversion: 2.1 time: 0.156574 Sep 10 11:28:47.942568 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2036/6387] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:47 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:48.966203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b023d993-35a5-4336-9bc4-dfbc9e87efe5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:48.966766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b023d993-35a5-4336-9bc4-dfbc9e87efe5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:48.973772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b023d993-35a5-4336-9bc4-dfbc9e87efe5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:48.974273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b023d993-35a5-4336-9bc4-dfbc9e87efe5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:48.974724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b023d993-35a5-4336-9bc4-dfbc9e87efe5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:48.975423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b023d993-35a5-4336-9bc4-dfbc9e87efe5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:48.975894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b023d993-35a5-4336-9bc4-dfbc9e87efe5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:48.976334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b023d993-35a5-4336-9bc4-dfbc9e87efe5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:49.107907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b023d993-35a5-4336-9bc4-dfbc9e87efe5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:49.115863 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b023d993-35a5-4336-9bc4-dfbc9e87efe5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1364 microversion: 2.1 time: 0.153676 Sep 10 11:28:49.116456 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4352/6388] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:48 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:49.926716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-1f5b4b02-e8a5-40ab-b067-65630d243245 req-1d4b5671-4ada-498a-9965-5f3ecd1205ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24aec4ea-87cc-474b-ae4c-86246f388508", "name": "network-vif-plugged", "status": "completed", "tag": "85980453-f74c-4bff-b8af-016fca5a4be9"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:49.938360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1f5b4b02-e8a5-40ab-b067-65630d243245 req-1d4b5671-4ada-498a-9965-5f3ecd1205ca service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:49.939834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1f5b4b02-e8a5-40ab-b067-65630d243245 req-1d4b5671-4ada-498a-9965-5f3ecd1205ca service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:49.940268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-1f5b4b02-e8a5-40ab-b067-65630d243245 req-1d4b5671-4ada-498a-9965-5f3ecd1205ca service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:49.952107 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-1f5b4b02-e8a5-40ab-b067-65630d243245 req-1d4b5671-4ada-498a-9965-5f3ecd1205ca service nova] Creating event network-vif-plugged:85980453-f74c-4bff-b8af-016fca5a4be9 for instance 24aec4ea-87cc-474b-ae4c-86246f388508 on n-h1-856894-1 Sep 10 11:28:49.958230 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-1f5b4b02-e8a5-40ab-b067-65630d243245 req-1d4b5671-4ada-498a-9965-5f3ecd1205ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034853 Sep 10 11:28:49.958838 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2037/6389] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:28:50.138547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-51f59510-9dfc-4d05-b275-772032154421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:50.139192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-51f59510-9dfc-4d05-b275-772032154421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:50.146193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51f59510-9dfc-4d05-b275-772032154421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:50.146704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51f59510-9dfc-4d05-b275-772032154421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:50.147165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51f59510-9dfc-4d05-b275-772032154421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:50.147877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51f59510-9dfc-4d05-b275-772032154421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:50.148355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51f59510-9dfc-4d05-b275-772032154421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:50.148808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-51f59510-9dfc-4d05-b275-772032154421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:50.276392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-51f59510-9dfc-4d05-b275-772032154421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:50.284241 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-51f59510-9dfc-4d05-b275-772032154421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1364 microversion: 2.1 time: 0.150265 Sep 10 11:28:50.284827 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4353/6390] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:50 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:51.310972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-eb77fcc8-6e70-459a-915a-0026adfd5650 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:51.311669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-eb77fcc8-6e70-459a-915a-0026adfd5650 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:51.318265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eb77fcc8-6e70-459a-915a-0026adfd5650 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:51.318749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eb77fcc8-6e70-459a-915a-0026adfd5650 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:51.319185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eb77fcc8-6e70-459a-915a-0026adfd5650 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:51.319875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eb77fcc8-6e70-459a-915a-0026adfd5650 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:51.320328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eb77fcc8-6e70-459a-915a-0026adfd5650 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:51.320753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eb77fcc8-6e70-459a-915a-0026adfd5650 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:51.716013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-eb77fcc8-6e70-459a-915a-0026adfd5650 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:28:51.723645 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-eb77fcc8-6e70-459a-915a-0026adfd5650 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1550 microversion: 2.1 time: 0.417573 Sep 10 11:28:51.724216 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2038/6391] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:28:51 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1550 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:51.748008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f52db28-7155-4b0d-a7be-f62077bba930 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:51.748531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f52db28-7155-4b0d-a7be-f62077bba930 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:28:51.755533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f52db28-7155-4b0d-a7be-f62077bba930 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:51.756031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f52db28-7155-4b0d-a7be-f62077bba930 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:51.756486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f52db28-7155-4b0d-a7be-f62077bba930 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:51.757223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f52db28-7155-4b0d-a7be-f62077bba930 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:51.757799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f52db28-7155-4b0d-a7be-f62077bba930 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:51.758241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f52db28-7155-4b0d-a7be-f62077bba930 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:51.771957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:51.792134 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:51.835639 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f52db28-7155-4b0d-a7be-f62077bba930 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092246 Sep 10 11:28:51.836242 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4354/6392] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:28:51 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:28:52.884066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-2729288b-57f8-4998-b2c5-deeb7f683045 req-ffe0f2f8-8648-459b-95d2-207800657ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24aec4ea-87cc-474b-ae4c-86246f388508", "tag": "85980453-f74c-4bff-b8af-016fca5a4be9"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:52.889523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:52.895799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2729288b-57f8-4998-b2c5-deeb7f683045 req-ffe0f2f8-8648-459b-95d2-207800657ae7 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:28:52.896273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2729288b-57f8-4998-b2c5-deeb7f683045 req-ffe0f2f8-8648-459b-95d2-207800657ae7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:28:52.896701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2729288b-57f8-4998-b2c5-deeb7f683045 req-ffe0f2f8-8648-459b-95d2-207800657ae7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:28:52.907597 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-2729288b-57f8-4998-b2c5-deeb7f683045 req-ffe0f2f8-8648-459b-95d2-207800657ae7 service nova] Creating event network-changed:85980453-f74c-4bff-b8af-016fca5a4be9 for instance 24aec4ea-87cc-474b-ae4c-86246f388508 on n-h1-856894-1 Sep 10 11:28:52.912591 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-2729288b-57f8-4998-b2c5-deeb7f683045 req-ffe0f2f8-8648-459b-95d2-207800657ae7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032217 Sep 10 11:28:52.913415 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2039/6393] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:22.451910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:22.452670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=32 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:22.457060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b3a580a5-171b-45cd-a73f-ced89e3488d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:22.457712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b3a580a5-171b-45cd-a73f-ced89e3488d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:22.465884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a580a5-171b-45cd-a73f-ced89e3488d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:22.466388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a580a5-171b-45cd-a73f-ced89e3488d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:22.466844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a580a5-171b-45cd-a73f-ced89e3488d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:22.467554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a580a5-171b-45cd-a73f-ced89e3488d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:22.468030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a580a5-171b-45cd-a73f-ced89e3488d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:22.468474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b3a580a5-171b-45cd-a73f-ced89e3488d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:22.600801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b3a580a5-171b-45cd-a73f-ced89e3488d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:22.609444 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b3a580a5-171b-45cd-a73f-ced89e3488d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1668 microversion: 2.1 time: 0.159266 Sep 10 11:29:22.610033 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4355/6394] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:22 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:22.630365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=9 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:22.631289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=28 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:22.635551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7658e757-fe00-4a93-8732-69282c4da00a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:22.636250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7658e757-fe00-4a93-8732-69282c4da00a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:22.643164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7658e757-fe00-4a93-8732-69282c4da00a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:22.643649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7658e757-fe00-4a93-8732-69282c4da00a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:22.644087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7658e757-fe00-4a93-8732-69282c4da00a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:22.644771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7658e757-fe00-4a93-8732-69282c4da00a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:22.645264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7658e757-fe00-4a93-8732-69282c4da00a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:22.645693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7658e757-fe00-4a93-8732-69282c4da00a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:22.772788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7658e757-fe00-4a93-8732-69282c4da00a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:22.781112 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7658e757-fe00-4a93-8732-69282c4da00a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1668 microversion: 2.1 time: 0.152889 Sep 10 11:29:22.781686 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2040/6395] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:22 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:22.803497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f3e78abc-7638-49cb-95df-210ecd0dbb24 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:22.804130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f3e78abc-7638-49cb-95df-210ecd0dbb24 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:22.810177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e78abc-7638-49cb-95df-210ecd0dbb24 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:22.810681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e78abc-7638-49cb-95df-210ecd0dbb24 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:22.811145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e78abc-7638-49cb-95df-210ecd0dbb24 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:22.811848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e78abc-7638-49cb-95df-210ecd0dbb24 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:22.812324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e78abc-7638-49cb-95df-210ecd0dbb24 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:22.812772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f3e78abc-7638-49cb-95df-210ecd0dbb24 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:22.941574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f3e78abc-7638-49cb-95df-210ecd0dbb24 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:22.949894 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f3e78abc-7638-49cb-95df-210ecd0dbb24 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1668 microversion: 2.1 time: 0.149745 Sep 10 11:29:22.950476 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4356/6396] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:22 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:29:22.972721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:22.974898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:22.980847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:22.981428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:22.981864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:22.982548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:22.982991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:22.983409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:23.010575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:23.016785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Old instance type m1.heat2, new instance type m1.heat {{(pid=128787) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:29:23.023453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:29:23.023876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:29:23.024340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:29:23.024743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:29:23.025179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:29:23.088892 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6f4ccf9e-5c05-484d-93f5-ca05c289d43b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508/action" status: 202 len: 0 microversion: 2.1 time: 0.119895 Sep 10 11:29:23.089555 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2041/6397] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:29:22 2022] POST /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:29:23.098275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cfe8c50-cdc8-46f9-9c38-c0253f13b9b7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:23.098943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6cfe8c50-cdc8-46f9-9c38-c0253f13b9b7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:23.105060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cfe8c50-cdc8-46f9-9c38-c0253f13b9b7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:23.105615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cfe8c50-cdc8-46f9-9c38-c0253f13b9b7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:23.106108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cfe8c50-cdc8-46f9-9c38-c0253f13b9b7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:23.106821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cfe8c50-cdc8-46f9-9c38-c0253f13b9b7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:23.107298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cfe8c50-cdc8-46f9-9c38-c0253f13b9b7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:23.107744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cfe8c50-cdc8-46f9-9c38-c0253f13b9b7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:23.266163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6cfe8c50-cdc8-46f9-9c38-c0253f13b9b7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:23.274171 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cfe8c50-cdc8-46f9-9c38-c0253f13b9b7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1677 microversion: 2.1 time: 0.179793 Sep 10 11:29:23.275007 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4357/6398] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:23 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:24.298257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-810913c7-861f-4f61-8bad-f96a71d699d0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:24.298895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-810913c7-861f-4f61-8bad-f96a71d699d0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:24.307306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-810913c7-861f-4f61-8bad-f96a71d699d0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:24.307793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-810913c7-861f-4f61-8bad-f96a71d699d0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:24.308231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-810913c7-861f-4f61-8bad-f96a71d699d0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:24.309569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-810913c7-861f-4f61-8bad-f96a71d699d0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:24.310023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-810913c7-861f-4f61-8bad-f96a71d699d0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:24.310445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-810913c7-861f-4f61-8bad-f96a71d699d0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:24.510315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-810913c7-861f-4f61-8bad-f96a71d699d0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:24.518552 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-810913c7-861f-4f61-8bad-f96a71d699d0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1677 microversion: 2.1 time: 0.225086 Sep 10 11:29:24.519122 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2042/6399] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:24 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:25.542416 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8200dcb4-12da-4331-9e66-7f69787e44ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:25.543098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8200dcb4-12da-4331-9e66-7f69787e44ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:25.550531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8200dcb4-12da-4331-9e66-7f69787e44ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:25.551040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8200dcb4-12da-4331-9e66-7f69787e44ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:25.551529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8200dcb4-12da-4331-9e66-7f69787e44ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:25.552297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8200dcb4-12da-4331-9e66-7f69787e44ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:25.552796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8200dcb4-12da-4331-9e66-7f69787e44ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:25.553293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8200dcb4-12da-4331-9e66-7f69787e44ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:25.738987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8200dcb4-12da-4331-9e66-7f69787e44ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:25.747418 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8200dcb4-12da-4331-9e66-7f69787e44ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1682 microversion: 2.1 time: 0.209070 Sep 10 11:29:25.747999 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4358/6400] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:25 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:26.770601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f1ffd62-d6cd-409c-9d7c-59cbe4a710c3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:26.771216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7f1ffd62-d6cd-409c-9d7c-59cbe4a710c3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:26.778653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f1ffd62-d6cd-409c-9d7c-59cbe4a710c3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:26.779134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f1ffd62-d6cd-409c-9d7c-59cbe4a710c3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:26.779588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f1ffd62-d6cd-409c-9d7c-59cbe4a710c3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:26.780273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f1ffd62-d6cd-409c-9d7c-59cbe4a710c3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:26.780729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f1ffd62-d6cd-409c-9d7c-59cbe4a710c3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:26.781181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f1ffd62-d6cd-409c-9d7c-59cbe4a710c3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:26.909400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7f1ffd62-d6cd-409c-9d7c-59cbe4a710c3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:26.917063 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7f1ffd62-d6cd-409c-9d7c-59cbe4a710c3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1682 microversion: 2.1 time: 0.150350 Sep 10 11:29:26.917662 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2043/6401] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:26 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:27.939849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-20b02835-e779-4b93-b290-55b23e407690 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:27.940482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-20b02835-e779-4b93-b290-55b23e407690 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:27.947613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20b02835-e779-4b93-b290-55b23e407690 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:27.948041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20b02835-e779-4b93-b290-55b23e407690 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:27.948497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20b02835-e779-4b93-b290-55b23e407690 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:27.949240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20b02835-e779-4b93-b290-55b23e407690 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:27.949716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20b02835-e779-4b93-b290-55b23e407690 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:27.950159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20b02835-e779-4b93-b290-55b23e407690 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:28.083684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20b02835-e779-4b93-b290-55b23e407690 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:28.092759 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-20b02835-e779-4b93-b290-55b23e407690 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1682 microversion: 2.1 time: 0.156883 Sep 10 11:29:28.093413 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4359/6402] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:27 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:29.115465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c146d218-09ee-4db5-8f38-9c244c37bf27 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:29.116002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c146d218-09ee-4db5-8f38-9c244c37bf27 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:29.123584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c146d218-09ee-4db5-8f38-9c244c37bf27 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:29.124067 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c146d218-09ee-4db5-8f38-9c244c37bf27 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:29.124532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c146d218-09ee-4db5-8f38-9c244c37bf27 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:29.125320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c146d218-09ee-4db5-8f38-9c244c37bf27 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:29.125771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c146d218-09ee-4db5-8f38-9c244c37bf27 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:29.126221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c146d218-09ee-4db5-8f38-9c244c37bf27 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:29.253808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c146d218-09ee-4db5-8f38-9c244c37bf27 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:29.261502 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c146d218-09ee-4db5-8f38-9c244c37bf27 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1682 microversion: 2.1 time: 0.150002 Sep 10 11:29:29.262081 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2044/6403] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:29 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:30.283649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-87db7a49-201a-4045-b21a-58ede5a21209 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:30.284285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-87db7a49-201a-4045-b21a-58ede5a21209 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:30.291520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87db7a49-201a-4045-b21a-58ede5a21209 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:30.292029 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87db7a49-201a-4045-b21a-58ede5a21209 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:30.292486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87db7a49-201a-4045-b21a-58ede5a21209 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:30.293706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87db7a49-201a-4045-b21a-58ede5a21209 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:30.294183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87db7a49-201a-4045-b21a-58ede5a21209 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:30.294627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-87db7a49-201a-4045-b21a-58ede5a21209 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:30.425460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-87db7a49-201a-4045-b21a-58ede5a21209 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:30.433297 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-87db7a49-201a-4045-b21a-58ede5a21209 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1682 microversion: 2.1 time: 0.153545 Sep 10 11:29:30.434509 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4360/6404] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:30 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:31.456960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6970e0e8-a10b-4631-b094-60cf9f7e1d21 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:31.457597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6970e0e8-a10b-4631-b094-60cf9f7e1d21 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:31.464632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6970e0e8-a10b-4631-b094-60cf9f7e1d21 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:31.465188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6970e0e8-a10b-4631-b094-60cf9f7e1d21 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:31.465621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6970e0e8-a10b-4631-b094-60cf9f7e1d21 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:31.466300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6970e0e8-a10b-4631-b094-60cf9f7e1d21 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:31.466749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6970e0e8-a10b-4631-b094-60cf9f7e1d21 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:31.467171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6970e0e8-a10b-4631-b094-60cf9f7e1d21 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:31.592955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6970e0e8-a10b-4631-b094-60cf9f7e1d21 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:31.600678 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6970e0e8-a10b-4631-b094-60cf9f7e1d21 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1682 microversion: 2.1 time: 0.147601 Sep 10 11:29:31.601298 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2045/6405] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:31 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:32.624244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9b8a870-9d19-4200-a525-808bdb63d6fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:32.624884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b9b8a870-9d19-4200-a525-808bdb63d6fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:32.632024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9b8a870-9d19-4200-a525-808bdb63d6fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:32.632527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9b8a870-9d19-4200-a525-808bdb63d6fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:32.632986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9b8a870-9d19-4200-a525-808bdb63d6fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:32.633725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9b8a870-9d19-4200-a525-808bdb63d6fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:32.634219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9b8a870-9d19-4200-a525-808bdb63d6fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:32.634651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9b8a870-9d19-4200-a525-808bdb63d6fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:32.760805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9b8a870-9d19-4200-a525-808bdb63d6fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:32.769110 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b9b8a870-9d19-4200-a525-808bdb63d6fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1682 microversion: 2.1 time: 0.149397 Sep 10 11:29:32.769698 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4361/6406] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:32 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:33.797297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5b41279a-16ee-4e58-b99f-4c83a77f64c0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:33.798887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5b41279a-16ee-4e58-b99f-4c83a77f64c0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:33.807145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b41279a-16ee-4e58-b99f-4c83a77f64c0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:33.807632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b41279a-16ee-4e58-b99f-4c83a77f64c0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:33.808078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b41279a-16ee-4e58-b99f-4c83a77f64c0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:33.808806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b41279a-16ee-4e58-b99f-4c83a77f64c0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:33.809291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b41279a-16ee-4e58-b99f-4c83a77f64c0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:33.809773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5b41279a-16ee-4e58-b99f-4c83a77f64c0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:33.938708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5b41279a-16ee-4e58-b99f-4c83a77f64c0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:33.946398 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5b41279a-16ee-4e58-b99f-4c83a77f64c0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1682 microversion: 2.1 time: 0.155495 Sep 10 11:29:33.946914 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2046/6407] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:33 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:34.970031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b9c3c9e0-eceb-4900-b451-e3fa1f106f2c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:34.970564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b9c3c9e0-eceb-4900-b451-e3fa1f106f2c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:34.977434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c3c9e0-eceb-4900-b451-e3fa1f106f2c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:34.977940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c3c9e0-eceb-4900-b451-e3fa1f106f2c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:34.978395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c3c9e0-eceb-4900-b451-e3fa1f106f2c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:34.979099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c3c9e0-eceb-4900-b451-e3fa1f106f2c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:34.979573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c3c9e0-eceb-4900-b451-e3fa1f106f2c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:34.980027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b9c3c9e0-eceb-4900-b451-e3fa1f106f2c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:35.106800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b9c3c9e0-eceb-4900-b451-e3fa1f106f2c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:35.114846 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b9c3c9e0-eceb-4900-b451-e3fa1f106f2c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1682 microversion: 2.1 time: 0.148946 Sep 10 11:29:35.115467 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4362/6408] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:34 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:36.138931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d5d4a26-23c6-4880-a88f-38a336eec4f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:36.139551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2d5d4a26-23c6-4880-a88f-38a336eec4f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:36.146435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5d4a26-23c6-4880-a88f-38a336eec4f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:36.146921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5d4a26-23c6-4880-a88f-38a336eec4f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:36.147365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5d4a26-23c6-4880-a88f-38a336eec4f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:36.148053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5d4a26-23c6-4880-a88f-38a336eec4f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:36.148513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5d4a26-23c6-4880-a88f-38a336eec4f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:36.148942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d5d4a26-23c6-4880-a88f-38a336eec4f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:36.550858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d5d4a26-23c6-4880-a88f-38a336eec4f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:36.559244 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d5d4a26-23c6-4880-a88f-38a336eec4f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1682 microversion: 2.1 time: 0.424263 Sep 10 11:29:36.559817 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2047/6409] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:36 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1682 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:37.557246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7ffbe48b-cd22-4a12-a3c7-91d656405d4e req-0e70b1b4-0ba1-4e83-9e29-58512fb4f633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24aec4ea-87cc-474b-ae4c-86246f388508", "name": "network-vif-unplugged", "status": "completed", "tag": "85980453-f74c-4bff-b8af-016fca5a4be9"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:37.567961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ffbe48b-cd22-4a12-a3c7-91d656405d4e req-0e70b1b4-0ba1-4e83-9e29-58512fb4f633 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:37.568528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ffbe48b-cd22-4a12-a3c7-91d656405d4e req-0e70b1b4-0ba1-4e83-9e29-58512fb4f633 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:37.569178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7ffbe48b-cd22-4a12-a3c7-91d656405d4e req-0e70b1b4-0ba1-4e83-9e29-58512fb4f633 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:37.582639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-38f05dec-d4e5-41cc-9d51-19b98e682e43 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:37.583261 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-38f05dec-d4e5-41cc-9d51-19b98e682e43 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:37.585170 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7ffbe48b-cd22-4a12-a3c7-91d656405d4e req-0e70b1b4-0ba1-4e83-9e29-58512fb4f633 service nova] Creating event network-vif-unplugged:85980453-f74c-4bff-b8af-016fca5a4be9 for instance 24aec4ea-87cc-474b-ae4c-86246f388508 on n-h2-856894-1 Sep 10 11:29:37.590772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38f05dec-d4e5-41cc-9d51-19b98e682e43 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:37.591054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-7ffbe48b-cd22-4a12-a3c7-91d656405d4e req-0e70b1b4-0ba1-4e83-9e29-58512fb4f633 service nova] Instance 24aec4ea-87cc-474b-ae4c-86246f388508 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:29:37.591264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38f05dec-d4e5-41cc-9d51-19b98e682e43 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:37.591715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38f05dec-d4e5-41cc-9d51-19b98e682e43 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:37.592420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38f05dec-d4e5-41cc-9d51-19b98e682e43 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:37.592877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38f05dec-d4e5-41cc-9d51-19b98e682e43 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:37.593337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-38f05dec-d4e5-41cc-9d51-19b98e682e43 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:37.603616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7ffbe48b-cd22-4a12-a3c7-91d656405d4e req-0e70b1b4-0ba1-4e83-9e29-58512fb4f633 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049693 Sep 10 11:29:37.604099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4363/6410] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:37.883268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-38f05dec-d4e5-41cc-9d51-19b98e682e43 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:37.891245 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-38f05dec-d4e5-41cc-9d51-19b98e682e43 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1681 microversion: 2.1 time: 0.312403 Sep 10 11:29:37.891919 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2048/6411] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:37 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1681 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:29:38.915309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c8ef4c27-7fd0-4b05-badc-c2c8212028be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:38.916025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c8ef4c27-7fd0-4b05-badc-c2c8212028be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:38.923982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8ef4c27-7fd0-4b05-badc-c2c8212028be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:38.924484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8ef4c27-7fd0-4b05-badc-c2c8212028be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:38.924935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8ef4c27-7fd0-4b05-badc-c2c8212028be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:38.925670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8ef4c27-7fd0-4b05-badc-c2c8212028be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:38.926140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8ef4c27-7fd0-4b05-badc-c2c8212028be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:38.926598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c8ef4c27-7fd0-4b05-badc-c2c8212028be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:39.054726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c8ef4c27-7fd0-4b05-badc-c2c8212028be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:39.062557 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c8ef4c27-7fd0-4b05-badc-c2c8212028be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1679 microversion: 2.1 time: 0.151523 Sep 10 11:29:39.063145 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4364/6412] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:38 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:39.639303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-8375ace1-32af-4de9-ae9b-75ed067f2354 req-2622eb72-cf19-4149-be69-34b46dc8dab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24aec4ea-87cc-474b-ae4c-86246f388508", "tag": "85980453-f74c-4bff-b8af-016fca5a4be9"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:39.649610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8375ace1-32af-4de9-ae9b-75ed067f2354 req-2622eb72-cf19-4149-be69-34b46dc8dab4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:39.650081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8375ace1-32af-4de9-ae9b-75ed067f2354 req-2622eb72-cf19-4149-be69-34b46dc8dab4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:39.650503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-8375ace1-32af-4de9-ae9b-75ed067f2354 req-2622eb72-cf19-4149-be69-34b46dc8dab4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:39.665024 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-8375ace1-32af-4de9-ae9b-75ed067f2354 req-2622eb72-cf19-4149-be69-34b46dc8dab4 service nova] Creating event network-changed:85980453-f74c-4bff-b8af-016fca5a4be9 for instance 24aec4ea-87cc-474b-ae4c-86246f388508 on n-h2-856894-1 Sep 10 11:29:39.671227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-8375ace1-32af-4de9-ae9b-75ed067f2354 req-2622eb72-cf19-4149-be69-34b46dc8dab4 service nova] Instance 24aec4ea-87cc-474b-ae4c-86246f388508 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:29:39.682020 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-8375ace1-32af-4de9-ae9b-75ed067f2354 req-2622eb72-cf19-4149-be69-34b46dc8dab4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047098 Sep 10 11:29:39.682626 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2049/6413] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:40.086227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e20423e4-0aaa-4c13-9254-61b607e36c4c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:40.087572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e20423e4-0aaa-4c13-9254-61b607e36c4c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:40.095218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20423e4-0aaa-4c13-9254-61b607e36c4c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:40.096111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20423e4-0aaa-4c13-9254-61b607e36c4c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:40.096244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20423e4-0aaa-4c13-9254-61b607e36c4c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:40.096901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20423e4-0aaa-4c13-9254-61b607e36c4c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:40.097405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20423e4-0aaa-4c13-9254-61b607e36c4c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:40.097851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e20423e4-0aaa-4c13-9254-61b607e36c4c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:40.329205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e20423e4-0aaa-4c13-9254-61b607e36c4c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:40.337000 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e20423e4-0aaa-4c13-9254-61b607e36c4c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1679 microversion: 2.1 time: 0.254879 Sep 10 11:29:40.337613 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4365/6414] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:40 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:41.362518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8e409f91-8804-405f-9151-bb0a75a092bf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:41.363238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8e409f91-8804-405f-9151-bb0a75a092bf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:41.369362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e409f91-8804-405f-9151-bb0a75a092bf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:41.369838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e409f91-8804-405f-9151-bb0a75a092bf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:41.370324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e409f91-8804-405f-9151-bb0a75a092bf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:41.370999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e409f91-8804-405f-9151-bb0a75a092bf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:41.371449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e409f91-8804-405f-9151-bb0a75a092bf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:41.371868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8e409f91-8804-405f-9151-bb0a75a092bf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:41.562420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8e409f91-8804-405f-9151-bb0a75a092bf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:41.570766 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8e409f91-8804-405f-9151-bb0a75a092bf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1676 microversion: 2.1 time: 0.213285 Sep 10 11:29:41.571544 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2050/6415] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:41 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:41.593528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a650a5b3-a20a-41c2-9008-e089ddfd9692 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:41.594339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a650a5b3-a20a-41c2-9008-e089ddfd9692 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:41.601239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a650a5b3-a20a-41c2-9008-e089ddfd9692 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:41.601750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a650a5b3-a20a-41c2-9008-e089ddfd9692 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:41.602209 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a650a5b3-a20a-41c2-9008-e089ddfd9692 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:41.602926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a650a5b3-a20a-41c2-9008-e089ddfd9692 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:41.603399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a650a5b3-a20a-41c2-9008-e089ddfd9692 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:41.603846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a650a5b3-a20a-41c2-9008-e089ddfd9692 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:41.665691 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a650a5b3-a20a-41c2-9008-e089ddfd9692 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508/action" status: 204 len: 0 microversion: 2.1 time: 0.075896 Sep 10 11:29:41.666461 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4366/6416] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:29:41 2022] POST /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:29:41.675610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-008a5d70-ab58-48d2-b89a-ec42aa461664 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:41.676228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-008a5d70-ab58-48d2-b89a-ec42aa461664 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:41.683181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-008a5d70-ab58-48d2-b89a-ec42aa461664 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:41.683675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-008a5d70-ab58-48d2-b89a-ec42aa461664 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:41.684121 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-008a5d70-ab58-48d2-b89a-ec42aa461664 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:41.685547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-008a5d70-ab58-48d2-b89a-ec42aa461664 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:41.686029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-008a5d70-ab58-48d2-b89a-ec42aa461664 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:41.686475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-008a5d70-ab58-48d2-b89a-ec42aa461664 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:42.001357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-008a5d70-ab58-48d2-b89a-ec42aa461664 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:42.010156 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-008a5d70-ab58-48d2-b89a-ec42aa461664 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1676 microversion: 2.1 time: 0.338367 Sep 10 11:29:42.010916 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2051/6417] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:41 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1676 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:42.038045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1add2e93-eb67-41bc-917f-e2ad0e249767 req-ab3b6973-5776-4121-9803-e4dcaac04a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24aec4ea-87cc-474b-ae4c-86246f388508", "name": "network-vif-plugged", "status": "completed", "tag": "85980453-f74c-4bff-b8af-016fca5a4be9"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:42.051257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1add2e93-eb67-41bc-917f-e2ad0e249767 req-ab3b6973-5776-4121-9803-e4dcaac04a54 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:42.051800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1add2e93-eb67-41bc-917f-e2ad0e249767 req-ab3b6973-5776-4121-9803-e4dcaac04a54 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:42.052518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1add2e93-eb67-41bc-917f-e2ad0e249767 req-ab3b6973-5776-4121-9803-e4dcaac04a54 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:42.068937 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1add2e93-eb67-41bc-917f-e2ad0e249767 req-ab3b6973-5776-4121-9803-e4dcaac04a54 service nova] Creating event network-vif-plugged:85980453-f74c-4bff-b8af-016fca5a4be9 for instance 24aec4ea-87cc-474b-ae4c-86246f388508 on n-h2-856894-1 Sep 10 11:29:42.074588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-1add2e93-eb67-41bc-917f-e2ad0e249767 req-ab3b6973-5776-4121-9803-e4dcaac04a54 service nova] Instance 24aec4ea-87cc-474b-ae4c-86246f388508 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:29:42.086120 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1add2e93-eb67-41bc-917f-e2ad0e249767 req-ab3b6973-5776-4121-9803-e4dcaac04a54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052026 Sep 10 11:29:42.087106 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4367/6418] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:43.033011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-29168187-0796-4716-8021-e68439af5a58 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:43.033694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-29168187-0796-4716-8021-e68439af5a58 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:43.040534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29168187-0796-4716-8021-e68439af5a58 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:43.041023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29168187-0796-4716-8021-e68439af5a58 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:43.041496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29168187-0796-4716-8021-e68439af5a58 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:43.042186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29168187-0796-4716-8021-e68439af5a58 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:43.042648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29168187-0796-4716-8021-e68439af5a58 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:43.043073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29168187-0796-4716-8021-e68439af5a58 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:43.175046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-29168187-0796-4716-8021-e68439af5a58 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:43.184175 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-29168187-0796-4716-8021-e68439af5a58 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1676 microversion: 2.1 time: 0.155675 Sep 10 11:29:43.184906 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2052/6419] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:43 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:44.208233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0378188f-6a5a-45e7-9879-ac685430a6d9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:44.208958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0378188f-6a5a-45e7-9879-ac685430a6d9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:44.216306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0378188f-6a5a-45e7-9879-ac685430a6d9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:44.216809 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0378188f-6a5a-45e7-9879-ac685430a6d9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:44.217293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0378188f-6a5a-45e7-9879-ac685430a6d9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:44.218006 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0378188f-6a5a-45e7-9879-ac685430a6d9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:44.218483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0378188f-6a5a-45e7-9879-ac685430a6d9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:44.218930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0378188f-6a5a-45e7-9879-ac685430a6d9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:44.347169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0378188f-6a5a-45e7-9879-ac685430a6d9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:44.354982 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0378188f-6a5a-45e7-9879-ac685430a6d9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1668 microversion: 2.1 time: 0.151058 Sep 10 11:29:44.355588 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4368/6420] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:44 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:44.377449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-26b8e8dd-ea81-4aea-ae08-dfe776b6e9ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:44.378065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-26b8e8dd-ea81-4aea-ae08-dfe776b6e9ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:44.384884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-26b8e8dd-ea81-4aea-ae08-dfe776b6e9ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:44.385411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-26b8e8dd-ea81-4aea-ae08-dfe776b6e9ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:44.385850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-26b8e8dd-ea81-4aea-ae08-dfe776b6e9ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:44.386627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-26b8e8dd-ea81-4aea-ae08-dfe776b6e9ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:44.387085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-26b8e8dd-ea81-4aea-ae08-dfe776b6e9ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:44.387504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-26b8e8dd-ea81-4aea-ae08-dfe776b6e9ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:44.517553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-26b8e8dd-ea81-4aea-ae08-dfe776b6e9ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:44.525335 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-26b8e8dd-ea81-4aea-ae08-dfe776b6e9ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1668 microversion: 2.1 time: 0.151692 Sep 10 11:29:44.525903 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2053/6421] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:44 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:29:44.548278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7253f0a4-0c0a-464c-9ca4-69fe0d7005e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:44.548932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7253f0a4-0c0a-464c-9ca4-69fe0d7005e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:44.554955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7253f0a4-0c0a-464c-9ca4-69fe0d7005e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:44.555453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7253f0a4-0c0a-464c-9ca4-69fe0d7005e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:44.555906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7253f0a4-0c0a-464c-9ca4-69fe0d7005e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:44.556609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7253f0a4-0c0a-464c-9ca4-69fe0d7005e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:44.557093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7253f0a4-0c0a-464c-9ca4-69fe0d7005e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:44.557540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7253f0a4-0c0a-464c-9ca4-69fe0d7005e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:44.688603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7253f0a4-0c0a-464c-9ca4-69fe0d7005e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:44.696588 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7253f0a4-0c0a-464c-9ca4-69fe0d7005e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1668 microversion: 2.1 time: 0.152929 Sep 10 11:29:44.697197 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4369/6422] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:44 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:44.718933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-51304aba-3ea2-4dc5-b881-6b1983714691 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:44.719368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-51304aba-3ea2-4dc5-b881-6b1983714691 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:44.725961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51304aba-3ea2-4dc5-b881-6b1983714691 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:44.726439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51304aba-3ea2-4dc5-b881-6b1983714691 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:44.726872 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51304aba-3ea2-4dc5-b881-6b1983714691 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:44.727544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51304aba-3ea2-4dc5-b881-6b1983714691 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:44.727992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51304aba-3ea2-4dc5-b881-6b1983714691 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:44.728410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51304aba-3ea2-4dc5-b881-6b1983714691 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:44.752952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-51304aba-3ea2-4dc5-b881-6b1983714691 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:29:44.780098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:44.829933 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-51304aba-3ea2-4dc5-b881-6b1983714691 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 204 len: 0 microversion: 2.1 time: 0.114668 Sep 10 11:29:44.830531 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2054/6423] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:29:44 2022] DELETE /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:29:44.839406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d3ecc7ba-5f6a-4daa-9413-2900ef934478 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:44.840043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d3ecc7ba-5f6a-4daa-9413-2900ef934478 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:44.847038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ecc7ba-5f6a-4daa-9413-2900ef934478 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:44.847550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ecc7ba-5f6a-4daa-9413-2900ef934478 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:44.848039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ecc7ba-5f6a-4daa-9413-2900ef934478 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:44.849011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ecc7ba-5f6a-4daa-9413-2900ef934478 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:44.849517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ecc7ba-5f6a-4daa-9413-2900ef934478 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:44.849963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ecc7ba-5f6a-4daa-9413-2900ef934478 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:44.986848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d3ecc7ba-5f6a-4daa-9413-2900ef934478 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:44.994939 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d3ecc7ba-5f6a-4daa-9413-2900ef934478 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1674 microversion: 2.1 time: 0.159490 Sep 10 11:29:44.995524 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4370/6424] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:44 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:46.019109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e7e9023-3e7d-4c94-90d5-3bd2dbe48d2d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:46.019811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3e7e9023-3e7d-4c94-90d5-3bd2dbe48d2d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:46.028387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e7e9023-3e7d-4c94-90d5-3bd2dbe48d2d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:46.028884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e7e9023-3e7d-4c94-90d5-3bd2dbe48d2d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:46.029780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e7e9023-3e7d-4c94-90d5-3bd2dbe48d2d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:46.030125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e7e9023-3e7d-4c94-90d5-3bd2dbe48d2d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:46.030578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e7e9023-3e7d-4c94-90d5-3bd2dbe48d2d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:46.031006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e7e9023-3e7d-4c94-90d5-3bd2dbe48d2d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:46.160897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3e7e9023-3e7d-4c94-90d5-3bd2dbe48d2d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:46.168632 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3e7e9023-3e7d-4c94-90d5-3bd2dbe48d2d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1674 microversion: 2.1 time: 0.153874 Sep 10 11:29:46.169725 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2055/6425] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:46 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:47.194089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a24b4ec0-437f-4b63-8ebb-1da3a410b50d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:47.194736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a24b4ec0-437f-4b63-8ebb-1da3a410b50d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:47.201705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a24b4ec0-437f-4b63-8ebb-1da3a410b50d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:47.202561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a24b4ec0-437f-4b63-8ebb-1da3a410b50d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:47.203100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a24b4ec0-437f-4b63-8ebb-1da3a410b50d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:47.203909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a24b4ec0-437f-4b63-8ebb-1da3a410b50d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:47.204468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a24b4ec0-437f-4b63-8ebb-1da3a410b50d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:47.204984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a24b4ec0-437f-4b63-8ebb-1da3a410b50d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:47.209861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:47.306885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a24b4ec0-437f-4b63-8ebb-1da3a410b50d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:47.315185 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a24b4ec0-437f-4b63-8ebb-1da3a410b50d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 200 len: 1606 microversion: 2.1 time: 0.126042 Sep 10 11:29:47.315763 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4371/6426] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:47 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 1606 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:47.422021 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-cba785b3-e3ae-4dfa-89ea-73e915dcffe3 req-340913dd-5d26-4264-9e59-c895353e9300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24aec4ea-87cc-474b-ae4c-86246f388508", "name": "network-vif-deleted", "tag": "85980453-f74c-4bff-b8af-016fca5a4be9"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:47.433354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cba785b3-e3ae-4dfa-89ea-73e915dcffe3 req-340913dd-5d26-4264-9e59-c895353e9300 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:47.434475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cba785b3-e3ae-4dfa-89ea-73e915dcffe3 req-340913dd-5d26-4264-9e59-c895353e9300 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:47.435478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-cba785b3-e3ae-4dfa-89ea-73e915dcffe3 req-340913dd-5d26-4264-9e59-c895353e9300 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:47.447488 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-cba785b3-e3ae-4dfa-89ea-73e915dcffe3 req-340913dd-5d26-4264-9e59-c895353e9300 service nova] Creating event network-vif-deleted:85980453-f74c-4bff-b8af-016fca5a4be9 for instance 24aec4ea-87cc-474b-ae4c-86246f388508 on n-h2-856894-1 Sep 10 11:29:47.453813 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-cba785b3-e3ae-4dfa-89ea-73e915dcffe3 req-340913dd-5d26-4264-9e59-c895353e9300 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035605 Sep 10 11:29:47.454482 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2056/6427] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:29:48.339623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:48.340332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:48.348281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:48.348908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:48.349463 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:48.350256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:48.350741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:48.351191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:48.365317 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 HTTP/1.1 Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '24aec4ea-87cc-474b-ae4c-86246f388508'} Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:48.367027 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:29:48.371648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:48.371648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:48.371648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:48.371648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:29:48.371648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:29:48.371648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:29:48.371648 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:29:48.371648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:29:48.371648 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6976e5fc-4bae-4fba-ac47-d76ad6c9ed1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 404 len: 111 microversion: 2.1 time: 0.033054 Sep 10 11:29:48.371648 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4372/6428] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:48 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:29:48.384008 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:48.384709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:48.391822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:48.391968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:48.392363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:48.393057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:48.393563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:48.393989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:48.407900 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 HTTP/1.1 Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '24aec4ea-87cc-474b-ae4c-86246f388508'} Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:48.409592 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:29:48.414252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:48.414252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:48.414252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:48.414252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:29:48.414252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:29:48.414252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:29:48.414252 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:29:48.414252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:29:48.414252 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9f1634dc-6dda-4845-9317-489f6c47b815 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 404 len: 111 microversion: 2.1 time: 0.031228 Sep 10 11:29:48.415271 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2057/6429] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:48 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:29:48.459779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-422385313", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "95f13bd4-0756-4b44-9560-173cb6276b85"}], "security_groups": [{"name": "tempest-securitygroup--2045802151"}], "key_name": "tempest-keypair-1238555339", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:48.566492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] validate_networks() for [('95f13bd4-0756-4b44-9560-173cb6276b85', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:29:48.950982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:29:48.951423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:29:48.951933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:29:48.952355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:29:48.952779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:29:48.961759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:48.962250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:48.962695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:48.963435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:48.963898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:48.964334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:48.980821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:29:48.986595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for user 61a1365243a242b98c96ce078a850c09 and project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:29:48.999477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:29:49.001808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:29:49.049361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ed292e92-ad46-4f90-8ace-cd9bc1b6e229 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.593441 Sep 10 11:29:49.050018 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4373/6430] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:29:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:29:49.061904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8e9d50e6-630f-453c-985d-437475b4c0b6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:49.062513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8e9d50e6-630f-453c-985d-437475b4c0b6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:49.116189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8e9d50e6-630f-453c-985d-437475b4c0b6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:49.123852 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8e9d50e6-630f-453c-985d-437475b4c0b6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1238 microversion: 2.1 time: 0.066451 Sep 10 11:29:49.125029 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2058/6431] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:49 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:50.147846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-72649d27-01a6-4624-9e71-7ede15ebce64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:50.149242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-72649d27-01a6-4624-9e71-7ede15ebce64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:50.157662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72649d27-01a6-4624-9e71-7ede15ebce64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:50.158426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72649d27-01a6-4624-9e71-7ede15ebce64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:50.158888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72649d27-01a6-4624-9e71-7ede15ebce64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:50.159615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72649d27-01a6-4624-9e71-7ede15ebce64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:50.160094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72649d27-01a6-4624-9e71-7ede15ebce64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:50.160540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-72649d27-01a6-4624-9e71-7ede15ebce64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:50.234375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-72649d27-01a6-4624-9e71-7ede15ebce64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:50.242312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-72649d27-01a6-4624-9e71-7ede15ebce64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1298 microversion: 2.1 time: 0.098646 Sep 10 11:29:50.242904 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4374/6432] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:50 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:51.268049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4a3d75f-f08f-4028-98f6-aeb6773cf46f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:51.268691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b4a3d75f-f08f-4028-98f6-aeb6773cf46f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:51.276053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4a3d75f-f08f-4028-98f6-aeb6773cf46f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:51.276535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4a3d75f-f08f-4028-98f6-aeb6773cf46f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:51.276971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4a3d75f-f08f-4028-98f6-aeb6773cf46f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:51.277678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4a3d75f-f08f-4028-98f6-aeb6773cf46f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:51.278148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4a3d75f-f08f-4028-98f6-aeb6773cf46f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:51.279207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4a3d75f-f08f-4028-98f6-aeb6773cf46f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:51.497004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b4a3d75f-f08f-4028-98f6-aeb6773cf46f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:51.504887 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b4a3d75f-f08f-4028-98f6-aeb6773cf46f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1364 microversion: 2.1 time: 0.241203 Sep 10 11:29:51.505512 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2059/6433] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:51 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:51.663659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-ca97d3d6-d2d6-4582-a1f0-b6f0c396b219 req-54f653fb-98a5-4f41-9998-a538d3119bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f022a939-d6bc-4c18-846a-e0a72a85418f", "tag": "c746c6c7-0ba5-4d78-a68d-bbd3d4d31199"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:51.676547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ca97d3d6-d2d6-4582-a1f0-b6f0c396b219 req-54f653fb-98a5-4f41-9998-a538d3119bc7 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:51.677171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ca97d3d6-d2d6-4582-a1f0-b6f0c396b219 req-54f653fb-98a5-4f41-9998-a538d3119bc7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:51.677627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-ca97d3d6-d2d6-4582-a1f0-b6f0c396b219 req-54f653fb-98a5-4f41-9998-a538d3119bc7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:51.689948 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-ca97d3d6-d2d6-4582-a1f0-b6f0c396b219 req-54f653fb-98a5-4f41-9998-a538d3119bc7 service nova] Creating event network-changed:c746c6c7-0ba5-4d78-a68d-bbd3d4d31199 for instance f022a939-d6bc-4c18-846a-e0a72a85418f on n-h2-856894-1 Sep 10 11:29:51.695361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-ca97d3d6-d2d6-4582-a1f0-b6f0c396b219 req-54f653fb-98a5-4f41-9998-a538d3119bc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035791 Sep 10 11:29:51.696213 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4375/6434] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:52.530737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d83fb678-2658-44bf-a13a-b13238d68407 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:52.531354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d83fb678-2658-44bf-a13a-b13238d68407 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:52.537378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d83fb678-2658-44bf-a13a-b13238d68407 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:52.537863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d83fb678-2658-44bf-a13a-b13238d68407 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:52.538304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d83fb678-2658-44bf-a13a-b13238d68407 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:52.538991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d83fb678-2658-44bf-a13a-b13238d68407 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:52.539448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d83fb678-2658-44bf-a13a-b13238d68407 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:52.539875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d83fb678-2658-44bf-a13a-b13238d68407 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:52.666006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d83fb678-2658-44bf-a13a-b13238d68407 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:52.674879 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d83fb678-2658-44bf-a13a-b13238d68407 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1364 microversion: 2.1 time: 0.149744 Sep 10 11:29:52.675448 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2060/6435] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:52 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:53.698576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4a98c59a-ad7e-44ab-b58e-181b72a96825 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:53.699303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4a98c59a-ad7e-44ab-b58e-181b72a96825 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:53.701421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:53.706907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a98c59a-ad7e-44ab-b58e-181b72a96825 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:53.707415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a98c59a-ad7e-44ab-b58e-181b72a96825 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:53.707874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a98c59a-ad7e-44ab-b58e-181b72a96825 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:53.708584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a98c59a-ad7e-44ab-b58e-181b72a96825 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:53.709060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a98c59a-ad7e-44ab-b58e-181b72a96825 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:53.709526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4a98c59a-ad7e-44ab-b58e-181b72a96825 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:53.836503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4a98c59a-ad7e-44ab-b58e-181b72a96825 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:53.847567 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4a98c59a-ad7e-44ab-b58e-181b72a96825 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1364 microversion: 2.1 time: 0.154171 Sep 10 11:29:53.848163 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4376/6436] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:53 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:54.871004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3929accc-efc8-40cc-83b9-746625f2fdbe tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:54.871620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3929accc-efc8-40cc-83b9-746625f2fdbe tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:54.874613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:54.880557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3929accc-efc8-40cc-83b9-746625f2fdbe tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:54.881047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3929accc-efc8-40cc-83b9-746625f2fdbe tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:54.881517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3929accc-efc8-40cc-83b9-746625f2fdbe tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:54.882211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3929accc-efc8-40cc-83b9-746625f2fdbe tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:54.882672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3929accc-efc8-40cc-83b9-746625f2fdbe tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:54.883099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3929accc-efc8-40cc-83b9-746625f2fdbe tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:55.014630 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3929accc-efc8-40cc-83b9-746625f2fdbe tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:55.022335 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3929accc-efc8-40cc-83b9-746625f2fdbe tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1364 microversion: 2.1 time: 0.155250 Sep 10 11:29:55.022907 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2061/6437] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:54 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:56.046801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-11e0b72f-b9d3-41bf-98ce-3f6abf6a5d92 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:56.047445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-11e0b72f-b9d3-41bf-98ce-3f6abf6a5d92 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:56.054923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11e0b72f-b9d3-41bf-98ce-3f6abf6a5d92 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:56.055440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11e0b72f-b9d3-41bf-98ce-3f6abf6a5d92 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:56.055899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11e0b72f-b9d3-41bf-98ce-3f6abf6a5d92 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:56.056627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11e0b72f-b9d3-41bf-98ce-3f6abf6a5d92 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:56.057168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11e0b72f-b9d3-41bf-98ce-3f6abf6a5d92 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:56.057651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-11e0b72f-b9d3-41bf-98ce-3f6abf6a5d92 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:56.064877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-f6c1e81b-df25-417b-8ad7-83d5d437babb req-85e1c9d5-b846-4da5-b645-f183029619e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f022a939-d6bc-4c18-846a-e0a72a85418f", "name": "network-vif-plugged", "status": "completed", "tag": "c746c6c7-0ba5-4d78-a68d-bbd3d4d31199"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:56.075915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f6c1e81b-df25-417b-8ad7-83d5d437babb req-85e1c9d5-b846-4da5-b645-f183029619e0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:56.076473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f6c1e81b-df25-417b-8ad7-83d5d437babb req-85e1c9d5-b846-4da5-b645-f183029619e0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:56.077146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f6c1e81b-df25-417b-8ad7-83d5d437babb req-85e1c9d5-b846-4da5-b645-f183029619e0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:56.089468 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-f6c1e81b-df25-417b-8ad7-83d5d437babb req-85e1c9d5-b846-4da5-b645-f183029619e0 service nova] Creating event network-vif-plugged:c746c6c7-0ba5-4d78-a68d-bbd3d4d31199 for instance f022a939-d6bc-4c18-846a-e0a72a85418f on n-h2-856894-1 Sep 10 11:29:56.095263 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-f6c1e81b-df25-417b-8ad7-83d5d437babb req-85e1c9d5-b846-4da5-b645-f183029619e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034134 Sep 10 11:29:56.096040 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2062/6438] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:29:56.227744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-11e0b72f-b9d3-41bf-98ce-3f6abf6a5d92 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:56.236298 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-11e0b72f-b9d3-41bf-98ce-3f6abf6a5d92 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1364 microversion: 2.1 time: 0.194293 Sep 10 11:29:56.236895 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4377/6439] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:56 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:57.261435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-84c5ff06-8ccc-4545-9ae6-4cfb2ebb82e7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:57.262168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-84c5ff06-8ccc-4545-9ae6-4cfb2ebb82e7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:57.268574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-84c5ff06-8ccc-4545-9ae6-4cfb2ebb82e7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:57.269055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-84c5ff06-8ccc-4545-9ae6-4cfb2ebb82e7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:57.269511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-84c5ff06-8ccc-4545-9ae6-4cfb2ebb82e7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:57.270195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-84c5ff06-8ccc-4545-9ae6-4cfb2ebb82e7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:57.270649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-84c5ff06-8ccc-4545-9ae6-4cfb2ebb82e7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:57.271072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-84c5ff06-8ccc-4545-9ae6-4cfb2ebb82e7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:57.401363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-84c5ff06-8ccc-4545-9ae6-4cfb2ebb82e7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:57.409148 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-84c5ff06-8ccc-4545-9ae6-4cfb2ebb82e7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1364 microversion: 2.1 time: 0.152859 Sep 10 11:29:57.409721 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2063/6440] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:57 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:58.433308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-05282f38-e8c5-4bb5-a8da-db8336a10cc0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:58.433857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-05282f38-e8c5-4bb5-a8da-db8336a10cc0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:58.441448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05282f38-e8c5-4bb5-a8da-db8336a10cc0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:58.441992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05282f38-e8c5-4bb5-a8da-db8336a10cc0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:58.442449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05282f38-e8c5-4bb5-a8da-db8336a10cc0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:58.443164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05282f38-e8c5-4bb5-a8da-db8336a10cc0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:58.443639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05282f38-e8c5-4bb5-a8da-db8336a10cc0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:58.444086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-05282f38-e8c5-4bb5-a8da-db8336a10cc0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:58.575975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-05282f38-e8c5-4bb5-a8da-db8336a10cc0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:29:58.583981 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-05282f38-e8c5-4bb5-a8da-db8336a10cc0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1550 microversion: 2.1 time: 0.154714 Sep 10 11:29:58.584672 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4378/6441] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:29:58 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:58.608284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6ec3e17c-4a4b-491b-9197-8ee2da4415e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:58.608793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6ec3e17c-4a4b-491b-9197-8ee2da4415e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:29:58.615719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ec3e17c-4a4b-491b-9197-8ee2da4415e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:58.616207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ec3e17c-4a4b-491b-9197-8ee2da4415e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:58.616642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ec3e17c-4a4b-491b-9197-8ee2da4415e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:58.617354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ec3e17c-4a4b-491b-9197-8ee2da4415e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:58.617820 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ec3e17c-4a4b-491b-9197-8ee2da4415e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:58.618227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ec3e17c-4a4b-491b-9197-8ee2da4415e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:58.702738 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6ec3e17c-4a4b-491b-9197-8ee2da4415e1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099017 Sep 10 11:29:58.703366 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2064/6442] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:29:58 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:59.945081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9ebd8c23-fdbc-4b22-9e42-a8f6e6771084 req-6b12ca14-cd48-4e05-a5fa-d366e4c80856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f022a939-d6bc-4c18-846a-e0a72a85418f", "tag": "c746c6c7-0ba5-4d78-a68d-bbd3d4d31199"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:59.950097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:59.951356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:59.959128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9ebd8c23-fdbc-4b22-9e42-a8f6e6771084 req-6b12ca14-cd48-4e05-a5fa-d366e4c80856 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:29:59.959630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9ebd8c23-fdbc-4b22-9e42-a8f6e6771084 req-6b12ca14-cd48-4e05-a5fa-d366e4c80856 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:29:59.960086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9ebd8c23-fdbc-4b22-9e42-a8f6e6771084 req-6b12ca14-cd48-4e05-a5fa-d366e4c80856 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:29:59.971206 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9ebd8c23-fdbc-4b22-9e42-a8f6e6771084 req-6b12ca14-cd48-4e05-a5fa-d366e4c80856 service nova] Creating event network-changed:c746c6c7-0ba5-4d78-a68d-bbd3d4d31199 for instance f022a939-d6bc-4c18-846a-e0a72a85418f on n-h2-856894-1 Sep 10 11:29:59.976332 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9ebd8c23-fdbc-4b22-9e42-a8f6e6771084 req-6b12ca14-cd48-4e05-a5fa-d366e4c80856 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035038 Sep 10 11:29:59.976858 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4379/6443] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:30:33.125393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:30:33.127333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=7 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:30:33.127989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:30:33.132111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94ed6d56-5fe0-467e-b6bc-0de783e7ccae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:33.139976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94ed6d56-5fe0-467e-b6bc-0de783e7ccae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:33.140460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94ed6d56-5fe0-467e-b6bc-0de783e7ccae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:33.140894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-94ed6d56-5fe0-467e-b6bc-0de783e7ccae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:33.163065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-94ed6d56-5fe0-467e-b6bc-0de783e7ccae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Going to try to stop instance {{(pid=128787) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 11:30:33.204533 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-94ed6d56-5fe0-467e-b6bc-0de783e7ccae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f/action" status: 202 len: 0 microversion: 2.1 time: 0.079716 Sep 10 11:30:33.205158 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2065/6444] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:30:33 2022] POST /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:30:33.213030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:30:33.213924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=37 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:30:33.219858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07b14674-391b-4a4c-b287-cd3f3285109a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:33.221060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07b14674-391b-4a4c-b287-cd3f3285109a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:33.230216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07b14674-391b-4a4c-b287-cd3f3285109a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:33.230679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07b14674-391b-4a4c-b287-cd3f3285109a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:33.231140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07b14674-391b-4a4c-b287-cd3f3285109a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:33.232539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07b14674-391b-4a4c-b287-cd3f3285109a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:33.233022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07b14674-391b-4a4c-b287-cd3f3285109a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:33.233503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07b14674-391b-4a4c-b287-cd3f3285109a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:33.370302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-07b14674-391b-4a4c-b287-cd3f3285109a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:33.378196 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07b14674-391b-4a4c-b287-cd3f3285109a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.167709 Sep 10 11:30:33.378775 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4380/6445] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:33 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:34.401766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-74f27e93-f14f-4f83-8bd1-a7177b1107d5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:34.402489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-74f27e93-f14f-4f83-8bd1-a7177b1107d5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:34.409281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f27e93-f14f-4f83-8bd1-a7177b1107d5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:34.409766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f27e93-f14f-4f83-8bd1-a7177b1107d5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:34.410200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f27e93-f14f-4f83-8bd1-a7177b1107d5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:34.410883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f27e93-f14f-4f83-8bd1-a7177b1107d5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:34.411331 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f27e93-f14f-4f83-8bd1-a7177b1107d5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:34.411752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-74f27e93-f14f-4f83-8bd1-a7177b1107d5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:34.538439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-74f27e93-f14f-4f83-8bd1-a7177b1107d5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:34.546968 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-74f27e93-f14f-4f83-8bd1-a7177b1107d5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.150238 Sep 10 11:30:34.547546 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2066/6446] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:34 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:35.570107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90d38cd8-d2b2-4a5f-a57b-0d5b6c765344 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:35.570774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-90d38cd8-d2b2-4a5f-a57b-0d5b6c765344 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:35.577400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90d38cd8-d2b2-4a5f-a57b-0d5b6c765344 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:35.577907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90d38cd8-d2b2-4a5f-a57b-0d5b6c765344 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:35.578366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90d38cd8-d2b2-4a5f-a57b-0d5b6c765344 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:35.579073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90d38cd8-d2b2-4a5f-a57b-0d5b6c765344 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:35.579548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90d38cd8-d2b2-4a5f-a57b-0d5b6c765344 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:35.579996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90d38cd8-d2b2-4a5f-a57b-0d5b6c765344 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:35.711517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-90d38cd8-d2b2-4a5f-a57b-0d5b6c765344 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:35.719816 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90d38cd8-d2b2-4a5f-a57b-0d5b6c765344 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.153867 Sep 10 11:30:35.720391 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4381/6447] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:35 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:36.743528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-63140fdd-6d6b-46ff-a027-b53d25db87b1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:36.744148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-63140fdd-6d6b-46ff-a027-b53d25db87b1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:36.751073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63140fdd-6d6b-46ff-a027-b53d25db87b1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:36.752529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63140fdd-6d6b-46ff-a027-b53d25db87b1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:36.752973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63140fdd-6d6b-46ff-a027-b53d25db87b1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:36.753689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63140fdd-6d6b-46ff-a027-b53d25db87b1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:36.754149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63140fdd-6d6b-46ff-a027-b53d25db87b1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:36.754576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63140fdd-6d6b-46ff-a027-b53d25db87b1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:36.881408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-63140fdd-6d6b-46ff-a027-b53d25db87b1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:36.891591 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-63140fdd-6d6b-46ff-a027-b53d25db87b1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.151597 Sep 10 11:30:36.892575 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2067/6448] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:36 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:37.918053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1efba660-9ff4-4e12-afd0-98bda34aead1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:37.918684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1efba660-9ff4-4e12-afd0-98bda34aead1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:37.927127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1efba660-9ff4-4e12-afd0-98bda34aead1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:37.927635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1efba660-9ff4-4e12-afd0-98bda34aead1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:37.928093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1efba660-9ff4-4e12-afd0-98bda34aead1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:37.928804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1efba660-9ff4-4e12-afd0-98bda34aead1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:37.929297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1efba660-9ff4-4e12-afd0-98bda34aead1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:37.929742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1efba660-9ff4-4e12-afd0-98bda34aead1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:38.055164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1efba660-9ff4-4e12-afd0-98bda34aead1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:38.063370 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1efba660-9ff4-4e12-afd0-98bda34aead1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.149470 Sep 10 11:30:38.063984 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4382/6449] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:37 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:39.087228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a7c5d9a5-5c24-474a-8adc-eaf585d83f3b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:39.087843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a7c5d9a5-5c24-474a-8adc-eaf585d83f3b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:39.095365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7c5d9a5-5c24-474a-8adc-eaf585d83f3b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:39.095852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7c5d9a5-5c24-474a-8adc-eaf585d83f3b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:39.096298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7c5d9a5-5c24-474a-8adc-eaf585d83f3b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:39.096985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7c5d9a5-5c24-474a-8adc-eaf585d83f3b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:39.097465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7c5d9a5-5c24-474a-8adc-eaf585d83f3b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:39.097893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a7c5d9a5-5c24-474a-8adc-eaf585d83f3b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:39.229423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a7c5d9a5-5c24-474a-8adc-eaf585d83f3b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:39.237761 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a7c5d9a5-5c24-474a-8adc-eaf585d83f3b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.154430 Sep 10 11:30:39.238327 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2068/6450] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:39 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:40.260991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dff3ac38-1511-4aa8-8c5c-9fd18c650f37 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:40.261645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dff3ac38-1511-4aa8-8c5c-9fd18c650f37 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:40.269191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff3ac38-1511-4aa8-8c5c-9fd18c650f37 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:40.269716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff3ac38-1511-4aa8-8c5c-9fd18c650f37 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:40.270170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff3ac38-1511-4aa8-8c5c-9fd18c650f37 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:40.270872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff3ac38-1511-4aa8-8c5c-9fd18c650f37 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:40.271348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff3ac38-1511-4aa8-8c5c-9fd18c650f37 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:40.271788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dff3ac38-1511-4aa8-8c5c-9fd18c650f37 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:40.408776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dff3ac38-1511-4aa8-8c5c-9fd18c650f37 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:40.416710 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dff3ac38-1511-4aa8-8c5c-9fd18c650f37 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.159662 Sep 10 11:30:40.417318 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4383/6451] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:40 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:41.440205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d14997f9-f38b-424b-bd71-ab4fdacad270 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:41.440828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d14997f9-f38b-424b-bd71-ab4fdacad270 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:41.447654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d14997f9-f38b-424b-bd71-ab4fdacad270 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:41.448148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d14997f9-f38b-424b-bd71-ab4fdacad270 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:41.448590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d14997f9-f38b-424b-bd71-ab4fdacad270 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:41.449316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d14997f9-f38b-424b-bd71-ab4fdacad270 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:41.449778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d14997f9-f38b-424b-bd71-ab4fdacad270 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:41.450215 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d14997f9-f38b-424b-bd71-ab4fdacad270 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:41.680596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d14997f9-f38b-424b-bd71-ab4fdacad270 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:41.689597 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d14997f9-f38b-424b-bd71-ab4fdacad270 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.253201 Sep 10 11:30:41.700449 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2069/6452] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:41 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:42.713490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8d696de2-6da9-4dcf-aa6d-6057cc950aa5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:42.714132 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8d696de2-6da9-4dcf-aa6d-6057cc950aa5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:42.721136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d696de2-6da9-4dcf-aa6d-6057cc950aa5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:42.721644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d696de2-6da9-4dcf-aa6d-6057cc950aa5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:42.722101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d696de2-6da9-4dcf-aa6d-6057cc950aa5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:42.722812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d696de2-6da9-4dcf-aa6d-6057cc950aa5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:42.723290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d696de2-6da9-4dcf-aa6d-6057cc950aa5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:42.723736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d696de2-6da9-4dcf-aa6d-6057cc950aa5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:42.853882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8d696de2-6da9-4dcf-aa6d-6057cc950aa5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:42.862201 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8d696de2-6da9-4dcf-aa6d-6057cc950aa5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.152689 Sep 10 11:30:42.862783 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4384/6453] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:42 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:43.885917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4a482c96-0178-4c48-9bf7-223bc6a57595 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:43.886523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4a482c96-0178-4c48-9bf7-223bc6a57595 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:43.893584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a482c96-0178-4c48-9bf7-223bc6a57595 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:43.894061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a482c96-0178-4c48-9bf7-223bc6a57595 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:43.894497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a482c96-0178-4c48-9bf7-223bc6a57595 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:43.895170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a482c96-0178-4c48-9bf7-223bc6a57595 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:43.895618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a482c96-0178-4c48-9bf7-223bc6a57595 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:43.896035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4a482c96-0178-4c48-9bf7-223bc6a57595 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:44.027908 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4a482c96-0178-4c48-9bf7-223bc6a57595 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:44.036719 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4a482c96-0178-4c48-9bf7-223bc6a57595 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1655 microversion: 2.1 time: 0.154710 Sep 10 11:30:44.037332 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2070/6454] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:43 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:44.059908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:44.062185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:44.069520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:44.070016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:44.070464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:44.071157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:44.071626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:44.072066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:44.100765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:44.106235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:30:44.113168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:30:44.113610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:30:44.114094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:30:44.114537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:30:44.114950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:30:44.184160 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f04d4eca-72b4-48d2-a8a5-3f6fb28e9c86 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f/action" status: 202 len: 0 microversion: 2.1 time: 0.128105 Sep 10 11:30:44.185141 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4385/6455] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:30:44 2022] POST /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:30:44.193473 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-795b21f6-2157-4616-8546-30597ba2db8e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:44.194081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-795b21f6-2157-4616-8546-30597ba2db8e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:44.200012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-795b21f6-2157-4616-8546-30597ba2db8e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:44.200721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-795b21f6-2157-4616-8546-30597ba2db8e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:44.201725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-795b21f6-2157-4616-8546-30597ba2db8e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:44.202422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-795b21f6-2157-4616-8546-30597ba2db8e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:44.202875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-795b21f6-2157-4616-8546-30597ba2db8e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:44.203299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-795b21f6-2157-4616-8546-30597ba2db8e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:44.356015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-795b21f6-2157-4616-8546-30597ba2db8e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:44.367338 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-795b21f6-2157-4616-8546-30597ba2db8e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.177534 Sep 10 11:30:44.367984 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2071/6456] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:44 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:45.391184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6a3f59ab-3d75-421f-948a-14e2bdfc0108 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:45.391731 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6a3f59ab-3d75-421f-948a-14e2bdfc0108 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:45.401503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a3f59ab-3d75-421f-948a-14e2bdfc0108 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:45.402019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a3f59ab-3d75-421f-948a-14e2bdfc0108 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:45.402473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a3f59ab-3d75-421f-948a-14e2bdfc0108 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:45.403192 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a3f59ab-3d75-421f-948a-14e2bdfc0108 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:45.403664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a3f59ab-3d75-421f-948a-14e2bdfc0108 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:45.404519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6a3f59ab-3d75-421f-948a-14e2bdfc0108 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:45.614813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6a3f59ab-3d75-421f-948a-14e2bdfc0108 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:45.623004 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6a3f59ab-3d75-421f-948a-14e2bdfc0108 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1678 microversion: 2.1 time: 0.236440 Sep 10 11:30:45.623594 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4386/6457] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:45 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:46.646807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ad097ab5-4d1f-487f-9c22-fa65d1ca2f55 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:46.647410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ad097ab5-4d1f-487f-9c22-fa65d1ca2f55 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:46.654932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad097ab5-4d1f-487f-9c22-fa65d1ca2f55 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:46.655410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad097ab5-4d1f-487f-9c22-fa65d1ca2f55 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:46.655843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad097ab5-4d1f-487f-9c22-fa65d1ca2f55 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:46.656522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad097ab5-4d1f-487f-9c22-fa65d1ca2f55 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:46.656997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad097ab5-4d1f-487f-9c22-fa65d1ca2f55 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:46.657468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad097ab5-4d1f-487f-9c22-fa65d1ca2f55 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:46.784636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ad097ab5-4d1f-487f-9c22-fa65d1ca2f55 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:46.792343 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ad097ab5-4d1f-487f-9c22-fa65d1ca2f55 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1683 microversion: 2.1 time: 0.149456 Sep 10 11:30:46.792911 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2072/6458] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:46 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:47.817666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7c54499f-e89c-4f75-b73d-0cd39ab90f3c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:47.818302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7c54499f-e89c-4f75-b73d-0cd39ab90f3c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:47.825121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c54499f-e89c-4f75-b73d-0cd39ab90f3c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:47.825634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c54499f-e89c-4f75-b73d-0cd39ab90f3c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:47.826124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c54499f-e89c-4f75-b73d-0cd39ab90f3c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:47.826836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c54499f-e89c-4f75-b73d-0cd39ab90f3c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:47.827312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c54499f-e89c-4f75-b73d-0cd39ab90f3c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:47.827760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7c54499f-e89c-4f75-b73d-0cd39ab90f3c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:47.967709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7c54499f-e89c-4f75-b73d-0cd39ab90f3c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:47.975635 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7c54499f-e89c-4f75-b73d-0cd39ab90f3c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1683 microversion: 2.1 time: 0.161993 Sep 10 11:30:47.976224 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4387/6459] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:47 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:48.735587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-890a248a-44bd-44ed-ad4a-969f4a89632f req-b0663267-092d-499a-99ba-1b2f70aee768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f022a939-d6bc-4c18-846a-e0a72a85418f", "name": "network-vif-unplugged", "status": "completed", "tag": "c746c6c7-0ba5-4d78-a68d-bbd3d4d31199"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:48.745254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-890a248a-44bd-44ed-ad4a-969f4a89632f req-b0663267-092d-499a-99ba-1b2f70aee768 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:48.745728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-890a248a-44bd-44ed-ad4a-969f4a89632f req-b0663267-092d-499a-99ba-1b2f70aee768 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:48.746156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-890a248a-44bd-44ed-ad4a-969f4a89632f req-b0663267-092d-499a-99ba-1b2f70aee768 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:48.758154 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-890a248a-44bd-44ed-ad4a-969f4a89632f req-b0663267-092d-499a-99ba-1b2f70aee768 service nova] Creating event network-vif-unplugged:c746c6c7-0ba5-4d78-a68d-bbd3d4d31199 for instance f022a939-d6bc-4c18-846a-e0a72a85418f on n-h1-856894-1 Sep 10 11:30:48.763410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-890a248a-44bd-44ed-ad4a-969f4a89632f req-b0663267-092d-499a-99ba-1b2f70aee768 service nova] Instance f022a939-d6bc-4c18-846a-e0a72a85418f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:30:48.774671 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-890a248a-44bd-44ed-ad4a-969f4a89632f req-b0663267-092d-499a-99ba-1b2f70aee768 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108397 Sep 10 11:30:48.775406 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2073/6460] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:30:49.000454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef2f2fa8-f848-4c11-9eb1-37048ded1e90 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:49.001121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef2f2fa8-f848-4c11-9eb1-37048ded1e90 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:49.008278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2f2fa8-f848-4c11-9eb1-37048ded1e90 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:49.008791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2f2fa8-f848-4c11-9eb1-37048ded1e90 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:49.009279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2f2fa8-f848-4c11-9eb1-37048ded1e90 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:49.010017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2f2fa8-f848-4c11-9eb1-37048ded1e90 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:49.010484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2f2fa8-f848-4c11-9eb1-37048ded1e90 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:49.010921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef2f2fa8-f848-4c11-9eb1-37048ded1e90 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:49.219939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef2f2fa8-f848-4c11-9eb1-37048ded1e90 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:49.227914 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef2f2fa8-f848-4c11-9eb1-37048ded1e90 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1682 microversion: 2.1 time: 0.231989 Sep 10 11:30:49.228518 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4388/6461] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:48 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1682 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:50.252765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9df1502-bd00-4403-a5b0-9da991a2d6ba tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:50.253504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9df1502-bd00-4403-a5b0-9da991a2d6ba tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:50.259642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df1502-bd00-4403-a5b0-9da991a2d6ba tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:50.260126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df1502-bd00-4403-a5b0-9da991a2d6ba tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:50.260565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df1502-bd00-4403-a5b0-9da991a2d6ba tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:50.261300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df1502-bd00-4403-a5b0-9da991a2d6ba tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:50.261756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df1502-bd00-4403-a5b0-9da991a2d6ba tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:50.262181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9df1502-bd00-4403-a5b0-9da991a2d6ba tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:50.391454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9df1502-bd00-4403-a5b0-9da991a2d6ba tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:50.399128 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9df1502-bd00-4403-a5b0-9da991a2d6ba tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1680 microversion: 2.1 time: 0.151656 Sep 10 11:30:50.399700 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2074/6462] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:50 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:50.789269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-fda9c941-a84a-4220-8567-f4eba9d1b7bd req-f25e8acd-f08a-4dd1-9746-4a31e4e0ea6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f022a939-d6bc-4c18-846a-e0a72a85418f", "tag": "c746c6c7-0ba5-4d78-a68d-bbd3d4d31199"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:50.800234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fda9c941-a84a-4220-8567-f4eba9d1b7bd req-f25e8acd-f08a-4dd1-9746-4a31e4e0ea6f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:50.800727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fda9c941-a84a-4220-8567-f4eba9d1b7bd req-f25e8acd-f08a-4dd1-9746-4a31e4e0ea6f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:50.801211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fda9c941-a84a-4220-8567-f4eba9d1b7bd req-f25e8acd-f08a-4dd1-9746-4a31e4e0ea6f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:50.814054 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-fda9c941-a84a-4220-8567-f4eba9d1b7bd req-f25e8acd-f08a-4dd1-9746-4a31e4e0ea6f service nova] Creating event network-changed:c746c6c7-0ba5-4d78-a68d-bbd3d4d31199 for instance f022a939-d6bc-4c18-846a-e0a72a85418f on n-h1-856894-1 Sep 10 11:30:50.819479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-fda9c941-a84a-4220-8567-f4eba9d1b7bd req-f25e8acd-f08a-4dd1-9746-4a31e4e0ea6f service nova] Instance f022a939-d6bc-4c18-846a-e0a72a85418f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:30:50.833400 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-fda9c941-a84a-4220-8567-f4eba9d1b7bd req-f25e8acd-f08a-4dd1-9746-4a31e4e0ea6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047762 Sep 10 11:30:50.834596 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4389/6463] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:30:51.423868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4c5b41e2-5b8f-46c4-9795-3025630acff6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:51.424596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4c5b41e2-5b8f-46c4-9795-3025630acff6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:51.431340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c5b41e2-5b8f-46c4-9795-3025630acff6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:51.431833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c5b41e2-5b8f-46c4-9795-3025630acff6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:51.432273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c5b41e2-5b8f-46c4-9795-3025630acff6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:51.432976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c5b41e2-5b8f-46c4-9795-3025630acff6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:51.433459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c5b41e2-5b8f-46c4-9795-3025630acff6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:51.433884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4c5b41e2-5b8f-46c4-9795-3025630acff6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:51.808561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4c5b41e2-5b8f-46c4-9795-3025630acff6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:51.816324 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4c5b41e2-5b8f-46c4-9795-3025630acff6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1676 microversion: 2.1 time: 0.397098 Sep 10 11:30:51.816898 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2075/6464] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:51 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1676 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:51.839461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aee0050e-735e-4098-85f1-4262d1437cbf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:51.840102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aee0050e-735e-4098-85f1-4262d1437cbf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:51.847852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aee0050e-735e-4098-85f1-4262d1437cbf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:51.848539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aee0050e-735e-4098-85f1-4262d1437cbf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:51.848803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aee0050e-735e-4098-85f1-4262d1437cbf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:51.849538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aee0050e-735e-4098-85f1-4262d1437cbf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:51.850008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aee0050e-735e-4098-85f1-4262d1437cbf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:51.850454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aee0050e-735e-4098-85f1-4262d1437cbf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:51.912290 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aee0050e-735e-4098-85f1-4262d1437cbf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f/action" status: 204 len: 0 microversion: 2.1 time: 0.076600 Sep 10 11:30:51.913771 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4390/6465] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:30:51 2022] POST /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:30:51.923194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-011118ea-bdb1-4b12-9989-57d27cbead3d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:51.924115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-011118ea-bdb1-4b12-9989-57d27cbead3d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:51.932361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-011118ea-bdb1-4b12-9989-57d27cbead3d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:51.932961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-011118ea-bdb1-4b12-9989-57d27cbead3d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:51.933575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-011118ea-bdb1-4b12-9989-57d27cbead3d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:51.934344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-011118ea-bdb1-4b12-9989-57d27cbead3d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:51.934800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-011118ea-bdb1-4b12-9989-57d27cbead3d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:51.935714 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-011118ea-bdb1-4b12-9989-57d27cbead3d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:52.244896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-011118ea-bdb1-4b12-9989-57d27cbead3d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:52.253156 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-011118ea-bdb1-4b12-9989-57d27cbead3d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1676 microversion: 2.1 time: 0.335187 Sep 10 11:30:52.253736 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2076/6466] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:51 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1676 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:53.276945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bfed0a55-f794-432f-9843-36c94555e1dd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:53.277695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bfed0a55-f794-432f-9843-36c94555e1dd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:53.285723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfed0a55-f794-432f-9843-36c94555e1dd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:53.286237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfed0a55-f794-432f-9843-36c94555e1dd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:53.286698 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfed0a55-f794-432f-9843-36c94555e1dd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:53.287421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfed0a55-f794-432f-9843-36c94555e1dd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:53.287905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfed0a55-f794-432f-9843-36c94555e1dd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:53.288355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bfed0a55-f794-432f-9843-36c94555e1dd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:53.426611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bfed0a55-f794-432f-9843-36c94555e1dd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:53.435265 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bfed0a55-f794-432f-9843-36c94555e1dd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1676 microversion: 2.1 time: 0.162663 Sep 10 11:30:53.436335 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4391/6467] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:53 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:54.460158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-777b5426-4630-40b2-870d-1cfcbf6babc1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:54.460823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-777b5426-4630-40b2-870d-1cfcbf6babc1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:54.468625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777b5426-4630-40b2-870d-1cfcbf6babc1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:54.469442 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777b5426-4630-40b2-870d-1cfcbf6babc1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:54.469878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777b5426-4630-40b2-870d-1cfcbf6babc1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:54.470568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777b5426-4630-40b2-870d-1cfcbf6babc1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:54.471017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777b5426-4630-40b2-870d-1cfcbf6babc1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:54.471518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-777b5426-4630-40b2-870d-1cfcbf6babc1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:54.477688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-8852c4b0-ead6-40f6-8639-7c4e7ae1f7f6 req-d4f3e8b4-e593-49ed-99b0-e3facebbc0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f022a939-d6bc-4c18-846a-e0a72a85418f", "name": "network-vif-plugged", "status": "completed", "tag": "c746c6c7-0ba5-4d78-a68d-bbd3d4d31199"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:54.489348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8852c4b0-ead6-40f6-8639-7c4e7ae1f7f6 req-d4f3e8b4-e593-49ed-99b0-e3facebbc0d3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:54.489868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8852c4b0-ead6-40f6-8639-7c4e7ae1f7f6 req-d4f3e8b4-e593-49ed-99b0-e3facebbc0d3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:54.490318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-8852c4b0-ead6-40f6-8639-7c4e7ae1f7f6 req-d4f3e8b4-e593-49ed-99b0-e3facebbc0d3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:54.502892 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-8852c4b0-ead6-40f6-8639-7c4e7ae1f7f6 req-d4f3e8b4-e593-49ed-99b0-e3facebbc0d3 service nova] Creating event network-vif-plugged:c746c6c7-0ba5-4d78-a68d-bbd3d4d31199 for instance f022a939-d6bc-4c18-846a-e0a72a85418f on n-h1-856894-1 Sep 10 11:30:54.508067 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-8852c4b0-ead6-40f6-8639-7c4e7ae1f7f6 req-d4f3e8b4-e593-49ed-99b0-e3facebbc0d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034724 Sep 10 11:30:54.508841 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4392/6468] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:30:54.616072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-777b5426-4630-40b2-870d-1cfcbf6babc1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:54.624515 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-777b5426-4630-40b2-870d-1cfcbf6babc1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1655 microversion: 2.1 time: 0.168226 Sep 10 11:30:54.625094 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2077/6469] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:54 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:54.648047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-03b6ef21-3eeb-405f-803e-9b1f4fa2dc5c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:54.648761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-03b6ef21-3eeb-405f-803e-9b1f4fa2dc5c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:54.654965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03b6ef21-3eeb-405f-803e-9b1f4fa2dc5c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:54.655459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03b6ef21-3eeb-405f-803e-9b1f4fa2dc5c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:54.655911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03b6ef21-3eeb-405f-803e-9b1f4fa2dc5c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:54.656603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03b6ef21-3eeb-405f-803e-9b1f4fa2dc5c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:54.657097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03b6ef21-3eeb-405f-803e-9b1f4fa2dc5c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:54.657533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-03b6ef21-3eeb-405f-803e-9b1f4fa2dc5c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:54.788556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-03b6ef21-3eeb-405f-803e-9b1f4fa2dc5c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:54.797064 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-03b6ef21-3eeb-405f-803e-9b1f4fa2dc5c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1655 microversion: 2.1 time: 0.153209 Sep 10 11:30:54.797669 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4393/6470] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:54 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:54.820116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8d5984eb-be16-4f34-b755-35bad161722c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:54.826051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d5984eb-be16-4f34-b755-35bad161722c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:54.826537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d5984eb-be16-4f34-b755-35bad161722c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:54.826969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d5984eb-be16-4f34-b755-35bad161722c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:54.848060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8d5984eb-be16-4f34-b755-35bad161722c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Going to try to start instance {{(pid=128787) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 11:30:54.891179 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8d5984eb-be16-4f34-b755-35bad161722c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f/action" status: 202 len: 0 microversion: 2.1 time: 0.075109 Sep 10 11:30:54.891784 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2078/6471] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:30:54 2022] POST /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:30:54.901284 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-07a21430-1431-42e8-8c25-3d39436a945a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:54.902160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-07a21430-1431-42e8-8c25-3d39436a945a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:54.909114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a21430-1431-42e8-8c25-3d39436a945a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:54.909881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a21430-1431-42e8-8c25-3d39436a945a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:54.910501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a21430-1431-42e8-8c25-3d39436a945a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:54.911301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a21430-1431-42e8-8c25-3d39436a945a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:54.911772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a21430-1431-42e8-8c25-3d39436a945a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:54.912231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-07a21430-1431-42e8-8c25-3d39436a945a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:55.120343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-07a21430-1431-42e8-8c25-3d39436a945a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:55.128884 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-07a21430-1431-42e8-8c25-3d39436a945a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1664 microversion: 2.1 time: 0.232573 Sep 10 11:30:55.129527 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4394/6472] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:54 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1664 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:56.152314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8b776cde-4f79-44fd-abec-8b317fb2de07 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:56.153011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8b776cde-4f79-44fd-abec-8b317fb2de07 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:56.161433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b776cde-4f79-44fd-abec-8b317fb2de07 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:56.161912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b776cde-4f79-44fd-abec-8b317fb2de07 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:56.162346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b776cde-4f79-44fd-abec-8b317fb2de07 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:56.163028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b776cde-4f79-44fd-abec-8b317fb2de07 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:56.163476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b776cde-4f79-44fd-abec-8b317fb2de07 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:56.163895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b776cde-4f79-44fd-abec-8b317fb2de07 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:56.295376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8b776cde-4f79-44fd-abec-8b317fb2de07 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:56.299128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:30:56.304515 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8b776cde-4f79-44fd-abec-8b317fb2de07 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1668 microversion: 2.1 time: 0.156522 Sep 10 11:30:56.305102 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2079/6473] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:56 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:56.327452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6751eb10-ce66-4b9c-af4d-c61dac0c9a5f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:56.327965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6751eb10-ce66-4b9c-af4d-c61dac0c9a5f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:56.334815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6751eb10-ce66-4b9c-af4d-c61dac0c9a5f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:56.335313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6751eb10-ce66-4b9c-af4d-c61dac0c9a5f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:56.335769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6751eb10-ce66-4b9c-af4d-c61dac0c9a5f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:56.336464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6751eb10-ce66-4b9c-af4d-c61dac0c9a5f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:56.336934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6751eb10-ce66-4b9c-af4d-c61dac0c9a5f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:56.337762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6751eb10-ce66-4b9c-af4d-c61dac0c9a5f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:56.341812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:30:56.365583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6751eb10-ce66-4b9c-af4d-c61dac0c9a5f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:30:56.442592 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6751eb10-ce66-4b9c-af4d-c61dac0c9a5f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 204 len: 0 microversion: 2.1 time: 0.119251 Sep 10 11:30:56.443491 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4395/6474] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:30:56 2022] DELETE /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:30:56.452054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c84e3cb9-c02b-4e2b-9498-97216de0f753 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:56.452661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c84e3cb9-c02b-4e2b-9498-97216de0f753 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:56.460086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c84e3cb9-c02b-4e2b-9498-97216de0f753 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:56.460564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c84e3cb9-c02b-4e2b-9498-97216de0f753 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:56.460997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c84e3cb9-c02b-4e2b-9498-97216de0f753 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:56.461704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c84e3cb9-c02b-4e2b-9498-97216de0f753 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:56.462151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c84e3cb9-c02b-4e2b-9498-97216de0f753 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:56.462567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c84e3cb9-c02b-4e2b-9498-97216de0f753 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:56.590921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c84e3cb9-c02b-4e2b-9498-97216de0f753 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:56.598638 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c84e3cb9-c02b-4e2b-9498-97216de0f753 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1674 microversion: 2.1 time: 0.151103 Sep 10 11:30:56.599215 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2080/6475] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:56 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:57.622122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b35806d-6a02-4413-a536-64e595f731f2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:57.622849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b35806d-6a02-4413-a536-64e595f731f2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:57.630423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b35806d-6a02-4413-a536-64e595f731f2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:57.630929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b35806d-6a02-4413-a536-64e595f731f2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:57.631387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b35806d-6a02-4413-a536-64e595f731f2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:57.632098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b35806d-6a02-4413-a536-64e595f731f2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:57.632571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b35806d-6a02-4413-a536-64e595f731f2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:57.633015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b35806d-6a02-4413-a536-64e595f731f2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:57.792529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0b35806d-6a02-4413-a536-64e595f731f2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:57.801233 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b35806d-6a02-4413-a536-64e595f731f2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 200 len: 1674 microversion: 2.1 time: 0.183528 Sep 10 11:30:57.801826 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4396/6476] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:57 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:30:58.577817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-9ea222a0-119c-40be-b3ff-43acd1215bef req-375cfd35-c0f6-4ff4-8a9c-39438ea4aba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f022a939-d6bc-4c18-846a-e0a72a85418f", "name": "network-vif-deleted", "tag": "c746c6c7-0ba5-4d78-a68d-bbd3d4d31199"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:58.601117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9ea222a0-119c-40be-b3ff-43acd1215bef req-375cfd35-c0f6-4ff4-8a9c-39438ea4aba6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:58.601719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9ea222a0-119c-40be-b3ff-43acd1215bef req-375cfd35-c0f6-4ff4-8a9c-39438ea4aba6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:58.602142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-9ea222a0-119c-40be-b3ff-43acd1215bef req-375cfd35-c0f6-4ff4-8a9c-39438ea4aba6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:58.614665 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-9ea222a0-119c-40be-b3ff-43acd1215bef req-375cfd35-c0f6-4ff4-8a9c-39438ea4aba6 service nova] Creating event network-vif-deleted:c746c6c7-0ba5-4d78-a68d-bbd3d4d31199 for instance f022a939-d6bc-4c18-846a-e0a72a85418f on n-h1-856894-1 Sep 10 11:30:58.622626 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-9ea222a0-119c-40be-b3ff-43acd1215bef req-375cfd35-c0f6-4ff4-8a9c-39438ea4aba6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048499 Sep 10 11:30:58.628854 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2081/6477] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:30:58.825846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:58.827116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:58.834389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:58.835165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:58.835780 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:58.836714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:58.837302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:58.837819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:58.855352 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f HTTP/1.1 Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f022a939-d6bc-4c18-846a-e0a72a85418f'} Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:30:58.857432 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:30:58.861699 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:30:58.861699 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:30:58.861699 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:30:58.861699 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:30:58.861699 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:30:58.861699 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:30:58.861699 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:30:58.861699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:30:58.861699 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f5f58d89-ae2b-4095-9609-b679616ec28e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 404 len: 111 microversion: 2.1 time: 0.037273 Sep 10 11:30:58.861699 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4397/6478] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:58 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:30:58.874142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:58.874858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:58.881709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:58.882203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:58.882818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:58.883689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:58.884147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:58.884739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:58.904475 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f HTTP/1.1 Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f022a939-d6bc-4c18-846a-e0a72a85418f'} Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:30:58.908663 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:30:58.913878 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:30:58.913878 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:30:58.913878 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:30:58.913878 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:30:58.913878 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:30:58.913878 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:30:58.913878 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:30:58.913878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:30:58.913878 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c604ec6a-df01-493b-82d0-593eba3f2011 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 404 len: 111 microversion: 2.1 time: 0.044596 Sep 10 11:30:58.923161 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2082/6479] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:58 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:30:58.968525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1040566667", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "95f13bd4-0756-4b44-9560-173cb6276b85"}], "security_groups": [{"name": "tempest-securitygroup--2045802151"}], "key_name": "tempest-keypair-1238555339", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:59.080773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] validate_networks() for [('95f13bd4-0756-4b44-9560-173cb6276b85', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:30:59.555252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:30:59.555697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:30:59.556189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:30:59.556616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:30:59.557048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:30:59.568763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:59.569322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:59.570038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:59.570836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:30:59.571308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:30:59.571749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:30:59.591253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:30:59.596936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for user 61a1365243a242b98c96ce078a850c09 and project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:30:59.609891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:30:59.612516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:30:59.662364 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3789bd5e-2ad5-4998-9885-15c2ea266d26 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.697932 Sep 10 11:30:59.663273 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4398/6480] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:30:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:30:59.675859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-454bae87-467e-495c-add3-0f1f0c725615 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:59.677223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-454bae87-467e-495c-add3-0f1f0c725615 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:30:59.740253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-454bae87-467e-495c-add3-0f1f0c725615 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:30:59.751569 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-454bae87-467e-495c-add3-0f1f0c725615 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1239 microversion: 2.1 time: 0.080012 Sep 10 11:30:59.759789 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2083/6481] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:30:59 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:00.777343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cfd81711-9a09-471e-a3ae-b23ede089950 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:00.779059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cfd81711-9a09-471e-a3ae-b23ede089950 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:00.786591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfd81711-9a09-471e-a3ae-b23ede089950 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:00.787104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfd81711-9a09-471e-a3ae-b23ede089950 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:00.787557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfd81711-9a09-471e-a3ae-b23ede089950 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:00.788271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfd81711-9a09-471e-a3ae-b23ede089950 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:00.788748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfd81711-9a09-471e-a3ae-b23ede089950 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:00.789223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cfd81711-9a09-471e-a3ae-b23ede089950 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:00.872489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cfd81711-9a09-471e-a3ae-b23ede089950 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:00.880719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cfd81711-9a09-471e-a3ae-b23ede089950 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1309 microversion: 2.1 time: 0.108337 Sep 10 11:31:00.881338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4399/6482] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:00 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:01.904168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-375ea514-2b2b-42d7-b753-a0be96412acd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:01.904806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-375ea514-2b2b-42d7-b753-a0be96412acd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:01.911954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-375ea514-2b2b-42d7-b753-a0be96412acd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:01.912691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-375ea514-2b2b-42d7-b753-a0be96412acd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:01.913358 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-375ea514-2b2b-42d7-b753-a0be96412acd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:01.914273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-375ea514-2b2b-42d7-b753-a0be96412acd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:01.914915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-375ea514-2b2b-42d7-b753-a0be96412acd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:01.915611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-375ea514-2b2b-42d7-b753-a0be96412acd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:02.110405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-375ea514-2b2b-42d7-b753-a0be96412acd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:02.118146 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-375ea514-2b2b-42d7-b753-a0be96412acd tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1365 microversion: 2.1 time: 0.217973 Sep 10 11:31:02.118731 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2084/6483] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:01 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:02.505998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-81f74abc-b013-41b9-a170-6e43da1ba21a req-6950ad83-d8e1-4871-b2d1-77d68bf97f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90e7f62b-5cfd-4f3f-bc62-8e600123baa4", "tag": "c21d4ece-98c0-4754-a723-8f8457203744"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:31:02.517594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-81f74abc-b013-41b9-a170-6e43da1ba21a req-6950ad83-d8e1-4871-b2d1-77d68bf97f75 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:02.518094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-81f74abc-b013-41b9-a170-6e43da1ba21a req-6950ad83-d8e1-4871-b2d1-77d68bf97f75 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:02.518543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-81f74abc-b013-41b9-a170-6e43da1ba21a req-6950ad83-d8e1-4871-b2d1-77d68bf97f75 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:02.529935 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-81f74abc-b013-41b9-a170-6e43da1ba21a req-6950ad83-d8e1-4871-b2d1-77d68bf97f75 service nova] Creating event network-changed:c21d4ece-98c0-4754-a723-8f8457203744 for instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 on n-h1-856894-1 Sep 10 11:31:02.534902 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-81f74abc-b013-41b9-a170-6e43da1ba21a req-6950ad83-d8e1-4871-b2d1-77d68bf97f75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032738 Sep 10 11:31:02.535515 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4400/6484] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:31:03.142139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-58f61ad2-1d80-4151-9e1b-e08ef670c9fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:03.142749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-58f61ad2-1d80-4151-9e1b-e08ef670c9fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:03.145485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=43 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:03.151138 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f61ad2-1d80-4151-9e1b-e08ef670c9fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:03.151618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f61ad2-1d80-4151-9e1b-e08ef670c9fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:03.152051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f61ad2-1d80-4151-9e1b-e08ef670c9fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:03.152730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f61ad2-1d80-4151-9e1b-e08ef670c9fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:03.153206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f61ad2-1d80-4151-9e1b-e08ef670c9fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:03.153626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-58f61ad2-1d80-4151-9e1b-e08ef670c9fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:03.286133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-58f61ad2-1d80-4151-9e1b-e08ef670c9fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:03.294147 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-58f61ad2-1d80-4151-9e1b-e08ef670c9fb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1365 microversion: 2.1 time: 0.156384 Sep 10 11:31:03.294715 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2085/6485] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:03 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:04.319389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b36c59ea-5cff-44e7-85fd-acfd41bb368d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:04.320104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b36c59ea-5cff-44e7-85fd-acfd41bb368d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:04.322070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:04.327815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b36c59ea-5cff-44e7-85fd-acfd41bb368d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:04.328311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b36c59ea-5cff-44e7-85fd-acfd41bb368d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:04.328763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b36c59ea-5cff-44e7-85fd-acfd41bb368d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:04.329497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b36c59ea-5cff-44e7-85fd-acfd41bb368d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:04.329966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b36c59ea-5cff-44e7-85fd-acfd41bb368d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:04.330405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b36c59ea-5cff-44e7-85fd-acfd41bb368d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:04.463794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b36c59ea-5cff-44e7-85fd-acfd41bb368d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:04.471914 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b36c59ea-5cff-44e7-85fd-acfd41bb368d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1365 microversion: 2.1 time: 0.157655 Sep 10 11:31:04.472539 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4401/6486] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:04 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:05.495536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aaf6ba97-40fa-440c-86d0-722c5b6bf4ec tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:05.496149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-aaf6ba97-40fa-440c-86d0-722c5b6bf4ec tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:05.503091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aaf6ba97-40fa-440c-86d0-722c5b6bf4ec tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:05.503575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aaf6ba97-40fa-440c-86d0-722c5b6bf4ec tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:05.504012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aaf6ba97-40fa-440c-86d0-722c5b6bf4ec tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:05.504700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aaf6ba97-40fa-440c-86d0-722c5b6bf4ec tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:05.505185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aaf6ba97-40fa-440c-86d0-722c5b6bf4ec tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:05.505653 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aaf6ba97-40fa-440c-86d0-722c5b6bf4ec tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:05.631133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-aaf6ba97-40fa-440c-86d0-722c5b6bf4ec tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:05.638832 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aaf6ba97-40fa-440c-86d0-722c5b6bf4ec tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1365 microversion: 2.1 time: 0.147197 Sep 10 11:31:05.639410 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2086/6487] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:05 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:06.506541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-272f8090-a9ef-47e6-9160-78b92897e09e req-db8cc65f-2e86-4137-8241-50bc5b451a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90e7f62b-5cfd-4f3f-bc62-8e600123baa4", "name": "network-vif-plugged", "status": "completed", "tag": "c21d4ece-98c0-4754-a723-8f8457203744"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:31:06.519002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-272f8090-a9ef-47e6-9160-78b92897e09e req-db8cc65f-2e86-4137-8241-50bc5b451a82 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:06.519496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-272f8090-a9ef-47e6-9160-78b92897e09e req-db8cc65f-2e86-4137-8241-50bc5b451a82 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:06.519942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-272f8090-a9ef-47e6-9160-78b92897e09e req-db8cc65f-2e86-4137-8241-50bc5b451a82 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:06.531992 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-272f8090-a9ef-47e6-9160-78b92897e09e req-db8cc65f-2e86-4137-8241-50bc5b451a82 service nova] Creating event network-vif-plugged:c21d4ece-98c0-4754-a723-8f8457203744 for instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 on n-h1-856894-1 Sep 10 11:31:06.536969 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-272f8090-a9ef-47e6-9160-78b92897e09e req-db8cc65f-2e86-4137-8241-50bc5b451a82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034256 Sep 10 11:31:06.537606 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4402/6488] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:31:06.662403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-36fecd97-e29d-4547-81b7-354ad130a483 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:06.663032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-36fecd97-e29d-4547-81b7-354ad130a483 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:06.671281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fecd97-e29d-4547-81b7-354ad130a483 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:06.672042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fecd97-e29d-4547-81b7-354ad130a483 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:06.672484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fecd97-e29d-4547-81b7-354ad130a483 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:06.673237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fecd97-e29d-4547-81b7-354ad130a483 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:06.673694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fecd97-e29d-4547-81b7-354ad130a483 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:06.674117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fecd97-e29d-4547-81b7-354ad130a483 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:06.802009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-36fecd97-e29d-4547-81b7-354ad130a483 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:06.809858 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-36fecd97-e29d-4547-81b7-354ad130a483 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1365 microversion: 2.1 time: 0.151352 Sep 10 11:31:06.810430 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2087/6489] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:06 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:07.834982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4f5373ad-8a45-44be-8a6c-c9606e584675 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:07.835699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4f5373ad-8a45-44be-8a6c-c9606e584675 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:07.843563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5373ad-8a45-44be-8a6c-c9606e584675 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:07.844071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5373ad-8a45-44be-8a6c-c9606e584675 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:07.844526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5373ad-8a45-44be-8a6c-c9606e584675 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:07.845271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5373ad-8a45-44be-8a6c-c9606e584675 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:07.845749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5373ad-8a45-44be-8a6c-c9606e584675 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:07.846196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4f5373ad-8a45-44be-8a6c-c9606e584675 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:07.978004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4f5373ad-8a45-44be-8a6c-c9606e584675 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:07.986365 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4f5373ad-8a45-44be-8a6c-c9606e584675 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1551 microversion: 2.1 time: 0.155788 Sep 10 11:31:07.986947 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4403/6490] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:07 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:08.008968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d8a70e28-735f-4abe-b679-340a9adf23c4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:08.009517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d8a70e28-735f-4abe-b679-340a9adf23c4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:08.016685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8a70e28-735f-4abe-b679-340a9adf23c4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:08.017202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8a70e28-735f-4abe-b679-340a9adf23c4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:08.017631 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8a70e28-735f-4abe-b679-340a9adf23c4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:08.018307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8a70e28-735f-4abe-b679-340a9adf23c4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:08.018757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8a70e28-735f-4abe-b679-340a9adf23c4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:08.019175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d8a70e28-735f-4abe-b679-340a9adf23c4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:08.095331 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d8a70e28-735f-4abe-b679-340a9adf23c4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090341 Sep 10 11:31:08.095947 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2088/6491] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:31:08 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:31:08.988375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-56c97478-2b1e-4f7e-aa8d-81dfb382f374 req-e2ce9657-b903-4ba8-a2ac-b5a7ab8f5f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90e7f62b-5cfd-4f3f-bc62-8e600123baa4", "tag": "c21d4ece-98c0-4754-a723-8f8457203744"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:31:08.999321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-56c97478-2b1e-4f7e-aa8d-81dfb382f374 req-e2ce9657-b903-4ba8-a2ac-b5a7ab8f5f32 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:08.999813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-56c97478-2b1e-4f7e-aa8d-81dfb382f374 req-e2ce9657-b903-4ba8-a2ac-b5a7ab8f5f32 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:09.000265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-56c97478-2b1e-4f7e-aa8d-81dfb382f374 req-e2ce9657-b903-4ba8-a2ac-b5a7ab8f5f32 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:09.011363 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-56c97478-2b1e-4f7e-aa8d-81dfb382f374 req-e2ce9657-b903-4ba8-a2ac-b5a7ab8f5f32 service nova] Creating event network-changed:c21d4ece-98c0-4754-a723-8f8457203744 for instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 on n-h1-856894-1 Sep 10 11:31:09.016457 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-56c97478-2b1e-4f7e-aa8d-81dfb382f374 req-e2ce9657-b903-4ba8-a2ac-b5a7ab8f5f32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031849 Sep 10 11:31:09.017103 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4404/6492] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:31:39.256224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:39.257169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=7 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:39.257792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=38 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:39.258565 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:31:39.258693 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 11:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4/action (ip 10.222.0.20) !!! Sep 10 11:31:39.260134 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:31:39.260247 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 11:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4/action (ip 10.222.0.20) !!! Sep 10 11:31:39.265463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:31:39.267729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:39.278764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:39.279242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:39.279676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:39.280360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:39.280814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:39.281276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:39.309927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:39.315317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Old instance type m1.heat2, new instance type m1.heat {{(pid=128787) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:31:39.321801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:31:39.322221 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:31:39.322720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:31:39.323129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:31:39.323537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:31:39.386652 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-088bd057-7ebb-4703-a063-f91e9392f4a1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4/action" status: 202 len: 0 microversion: 2.1 time: 0.132083 Sep 10 11:31:39.387261 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2089/6493] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:31:39 2022] POST /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:31:39.392610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:39.394030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:39.395755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:39.396415 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:39.401405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-29021f9d-4b45-4074-b120-6f61dcf458ca tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:39.402130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-29021f9d-4b45-4074-b120-6f61dcf458ca tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:39.411309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29021f9d-4b45-4074-b120-6f61dcf458ca tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:39.411808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29021f9d-4b45-4074-b120-6f61dcf458ca tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:39.412256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29021f9d-4b45-4074-b120-6f61dcf458ca tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:39.412960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29021f9d-4b45-4074-b120-6f61dcf458ca tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:39.413452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29021f9d-4b45-4074-b120-6f61dcf458ca tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:39.413897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-29021f9d-4b45-4074-b120-6f61dcf458ca tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:39.579561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-29021f9d-4b45-4074-b120-6f61dcf458ca tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:39.588047 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-29021f9d-4b45-4074-b120-6f61dcf458ca tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1678 microversion: 2.1 time: 0.196378 Sep 10 11:31:39.588647 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4405/6494] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:39 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:40.611993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c8efab36-84c2-4508-ba62-0f96d8aaa189 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:40.612537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c8efab36-84c2-4508-ba62-0f96d8aaa189 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:40.619333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8efab36-84c2-4508-ba62-0f96d8aaa189 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:40.619816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8efab36-84c2-4508-ba62-0f96d8aaa189 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:40.620255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8efab36-84c2-4508-ba62-0f96d8aaa189 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:40.620941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8efab36-84c2-4508-ba62-0f96d8aaa189 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:40.621418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8efab36-84c2-4508-ba62-0f96d8aaa189 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:40.621843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8efab36-84c2-4508-ba62-0f96d8aaa189 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:40.760271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c8efab36-84c2-4508-ba62-0f96d8aaa189 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:40.768097 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c8efab36-84c2-4508-ba62-0f96d8aaa189 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1678 microversion: 2.1 time: 0.160891 Sep 10 11:31:40.769280 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2090/6495] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:40 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:41.791909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8988a561-40fb-4c47-9761-235b085515c2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:41.792547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8988a561-40fb-4c47-9761-235b085515c2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:41.799519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8988a561-40fb-4c47-9761-235b085515c2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:41.800023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8988a561-40fb-4c47-9761-235b085515c2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:41.800479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8988a561-40fb-4c47-9761-235b085515c2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:41.801236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8988a561-40fb-4c47-9761-235b085515c2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:41.801707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8988a561-40fb-4c47-9761-235b085515c2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:41.802154 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8988a561-40fb-4c47-9761-235b085515c2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:42.014849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8988a561-40fb-4c47-9761-235b085515c2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:42.023343 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8988a561-40fb-4c47-9761-235b085515c2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1683 microversion: 2.1 time: 0.235284 Sep 10 11:31:42.023944 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4406/6496] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:41 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1683 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:43.048050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-882033ee-e865-49bb-8731-41d459f72be8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:43.048685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-882033ee-e865-49bb-8731-41d459f72be8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:43.056037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-882033ee-e865-49bb-8731-41d459f72be8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:43.056517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-882033ee-e865-49bb-8731-41d459f72be8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:43.056946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-882033ee-e865-49bb-8731-41d459f72be8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:43.057644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-882033ee-e865-49bb-8731-41d459f72be8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:43.058092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-882033ee-e865-49bb-8731-41d459f72be8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:43.058508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-882033ee-e865-49bb-8731-41d459f72be8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:43.191794 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-882033ee-e865-49bb-8731-41d459f72be8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:43.199386 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-882033ee-e865-49bb-8731-41d459f72be8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1683 microversion: 2.1 time: 0.155488 Sep 10 11:31:43.199972 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2091/6497] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:43 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:44.222950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9e8e8edb-6e7e-40cf-bd19-6849e6cb040c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:44.223587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9e8e8edb-6e7e-40cf-bd19-6849e6cb040c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:44.230605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e8e8edb-6e7e-40cf-bd19-6849e6cb040c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:44.231109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e8e8edb-6e7e-40cf-bd19-6849e6cb040c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:44.231563 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e8e8edb-6e7e-40cf-bd19-6849e6cb040c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:44.232266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e8e8edb-6e7e-40cf-bd19-6849e6cb040c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:44.232740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e8e8edb-6e7e-40cf-bd19-6849e6cb040c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:44.233223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9e8e8edb-6e7e-40cf-bd19-6849e6cb040c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:44.359223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9e8e8edb-6e7e-40cf-bd19-6849e6cb040c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:44.367409 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9e8e8edb-6e7e-40cf-bd19-6849e6cb040c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1683 microversion: 2.1 time: 0.148320 Sep 10 11:31:44.368034 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4407/6498] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:44 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:45.391824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e8fb39df-1bb2-4e31-8189-6b6025ad7c1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:45.392432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e8fb39df-1bb2-4e31-8189-6b6025ad7c1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:45.399976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8fb39df-1bb2-4e31-8189-6b6025ad7c1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:45.400456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8fb39df-1bb2-4e31-8189-6b6025ad7c1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:45.400889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8fb39df-1bb2-4e31-8189-6b6025ad7c1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:45.401609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8fb39df-1bb2-4e31-8189-6b6025ad7c1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:45.402061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8fb39df-1bb2-4e31-8189-6b6025ad7c1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:45.402485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e8fb39df-1bb2-4e31-8189-6b6025ad7c1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:45.828353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e8fb39df-1bb2-4e31-8189-6b6025ad7c1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:45.836973 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e8fb39df-1bb2-4e31-8189-6b6025ad7c1d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1683 microversion: 2.1 time: 0.449054 Sep 10 11:31:45.837606 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2092/6499] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:45 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1683 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:31:46.860035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0816de25-5f6f-44ca-9e42-1aa89652ccd7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:46.860700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0816de25-5f6f-44ca-9e42-1aa89652ccd7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:46.867487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0816de25-5f6f-44ca-9e42-1aa89652ccd7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:46.868019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0816de25-5f6f-44ca-9e42-1aa89652ccd7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:46.868474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0816de25-5f6f-44ca-9e42-1aa89652ccd7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:46.869197 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0816de25-5f6f-44ca-9e42-1aa89652ccd7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:46.869670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0816de25-5f6f-44ca-9e42-1aa89652ccd7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:46.870111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0816de25-5f6f-44ca-9e42-1aa89652ccd7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:46.999849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0816de25-5f6f-44ca-9e42-1aa89652ccd7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:47.009594 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0816de25-5f6f-44ca-9e42-1aa89652ccd7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1683 microversion: 2.1 time: 0.153717 Sep 10 11:31:47.010180 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4408/6500] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:46 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:48.033247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3b4cac3b-2dce-4ab8-92d4-5e52e3ac1c0e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:48.033854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3b4cac3b-2dce-4ab8-92d4-5e52e3ac1c0e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:48.041265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4cac3b-2dce-4ab8-92d4-5e52e3ac1c0e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:48.041743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4cac3b-2dce-4ab8-92d4-5e52e3ac1c0e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:48.042174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4cac3b-2dce-4ab8-92d4-5e52e3ac1c0e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:48.042847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4cac3b-2dce-4ab8-92d4-5e52e3ac1c0e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:48.043296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4cac3b-2dce-4ab8-92d4-5e52e3ac1c0e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:48.043713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3b4cac3b-2dce-4ab8-92d4-5e52e3ac1c0e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:48.175754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3b4cac3b-2dce-4ab8-92d4-5e52e3ac1c0e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:48.184303 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3b4cac3b-2dce-4ab8-92d4-5e52e3ac1c0e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1683 microversion: 2.1 time: 0.154978 Sep 10 11:31:48.185558 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2093/6501] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:48 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:49.209109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-596b140d-f634-40ff-82aa-e9feb2511430 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:49.209788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-596b140d-f634-40ff-82aa-e9feb2511430 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:49.216903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-596b140d-f634-40ff-82aa-e9feb2511430 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:49.217437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-596b140d-f634-40ff-82aa-e9feb2511430 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:49.217895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-596b140d-f634-40ff-82aa-e9feb2511430 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:49.218606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-596b140d-f634-40ff-82aa-e9feb2511430 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:49.219080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-596b140d-f634-40ff-82aa-e9feb2511430 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:49.219527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-596b140d-f634-40ff-82aa-e9feb2511430 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:49.345338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-596b140d-f634-40ff-82aa-e9feb2511430 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:49.353753 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-596b140d-f634-40ff-82aa-e9feb2511430 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1683 microversion: 2.1 time: 0.149200 Sep 10 11:31:49.354338 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4409/6502] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:49 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:50.376664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-34646040-93fb-46e8-a31f-5ea2e90f2d06 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:50.377303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-34646040-93fb-46e8-a31f-5ea2e90f2d06 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:50.384045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34646040-93fb-46e8-a31f-5ea2e90f2d06 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:50.384523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34646040-93fb-46e8-a31f-5ea2e90f2d06 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:50.384955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34646040-93fb-46e8-a31f-5ea2e90f2d06 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:50.385657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34646040-93fb-46e8-a31f-5ea2e90f2d06 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:50.386107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34646040-93fb-46e8-a31f-5ea2e90f2d06 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:50.386523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-34646040-93fb-46e8-a31f-5ea2e90f2d06 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:50.511750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-34646040-93fb-46e8-a31f-5ea2e90f2d06 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:50.519314 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-34646040-93fb-46e8-a31f-5ea2e90f2d06 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1683 microversion: 2.1 time: 0.146559 Sep 10 11:31:50.519884 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2094/6503] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:50 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:51.543108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10798c37-ac26-432d-9360-b42948d8d036 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:51.543744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-10798c37-ac26-432d-9360-b42948d8d036 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:51.551193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10798c37-ac26-432d-9360-b42948d8d036 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:51.551695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10798c37-ac26-432d-9360-b42948d8d036 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:51.552151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10798c37-ac26-432d-9360-b42948d8d036 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:51.552859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10798c37-ac26-432d-9360-b42948d8d036 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:51.553366 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10798c37-ac26-432d-9360-b42948d8d036 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:51.553811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10798c37-ac26-432d-9360-b42948d8d036 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:51.683736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-10798c37-ac26-432d-9360-b42948d8d036 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:51.691750 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10798c37-ac26-432d-9360-b42948d8d036 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1683 microversion: 2.1 time: 0.152547 Sep 10 11:31:51.693179 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4410/6504] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:51 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:52.715057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fd233d51-158b-41ff-ae20-7899bce4dde3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:52.715667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fd233d51-158b-41ff-ae20-7899bce4dde3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:52.722492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd233d51-158b-41ff-ae20-7899bce4dde3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:52.722972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd233d51-158b-41ff-ae20-7899bce4dde3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:52.723402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd233d51-158b-41ff-ae20-7899bce4dde3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:52.724584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd233d51-158b-41ff-ae20-7899bce4dde3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:52.725037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd233d51-158b-41ff-ae20-7899bce4dde3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:52.725479 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fd233d51-158b-41ff-ae20-7899bce4dde3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:52.919897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fd233d51-158b-41ff-ae20-7899bce4dde3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:52.929905 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fd233d51-158b-41ff-ae20-7899bce4dde3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1683 microversion: 2.1 time: 0.218626 Sep 10 11:31:52.930707 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2095/6505] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:52 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1683 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:53.958839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22477b9c-d80d-4e24-907f-8b89eb78df81 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:53.959400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-22477b9c-d80d-4e24-907f-8b89eb78df81 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:53.966566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22477b9c-d80d-4e24-907f-8b89eb78df81 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:53.967072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22477b9c-d80d-4e24-907f-8b89eb78df81 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:53.967521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22477b9c-d80d-4e24-907f-8b89eb78df81 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:53.968234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22477b9c-d80d-4e24-907f-8b89eb78df81 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:53.968705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22477b9c-d80d-4e24-907f-8b89eb78df81 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:53.969170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22477b9c-d80d-4e24-907f-8b89eb78df81 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:54.135953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-22477b9c-d80d-4e24-907f-8b89eb78df81 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:54.143836 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-22477b9c-d80d-4e24-907f-8b89eb78df81 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1680 microversion: 2.1 time: 0.189116 Sep 10 11:31:54.144424 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4411/6506] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:53 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:55.167268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8d8bae63-6709-4e43-b2df-c1d7d1d1c007 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:55.167884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8d8bae63-6709-4e43-b2df-c1d7d1d1c007 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:55.174968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d8bae63-6709-4e43-b2df-c1d7d1d1c007 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:55.175447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d8bae63-6709-4e43-b2df-c1d7d1d1c007 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:55.175877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d8bae63-6709-4e43-b2df-c1d7d1d1c007 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:55.176556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d8bae63-6709-4e43-b2df-c1d7d1d1c007 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:55.177026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d8bae63-6709-4e43-b2df-c1d7d1d1c007 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:55.177478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8d8bae63-6709-4e43-b2df-c1d7d1d1c007 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:55.309996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8d8bae63-6709-4e43-b2df-c1d7d1d1c007 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:55.317763 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8d8bae63-6709-4e43-b2df-c1d7d1d1c007 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1677 microversion: 2.1 time: 0.154320 Sep 10 11:31:55.318280 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2096/6507] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:55 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:55.340393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:31:55.340941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:55.347827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:55.348337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:55.349417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:55.350152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:55.350603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:55.351038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:55.388727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:55.389255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:55.389704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:55.390438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:55.390907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:55.391371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:55.412442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:31:55.417578 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for user 61a1365243a242b98c96ce078a850c09 and project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:31:55.517243 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-85b85de3-0caf-45b6-97f4-02f5f9404155 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4/action" status: 202 len: 0 microversion: 2.1 time: 0.180520 Sep 10 11:31:55.517897 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4412/6508] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:31:55 2022] POST /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:31:55.526652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-df69cb71-77c6-47c4-98d2-c691f0d117db tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:55.527277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-df69cb71-77c6-47c4-98d2-c691f0d117db tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:55.533345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df69cb71-77c6-47c4-98d2-c691f0d117db tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:55.533841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df69cb71-77c6-47c4-98d2-c691f0d117db tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:55.534279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df69cb71-77c6-47c4-98d2-c691f0d117db tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:55.534976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df69cb71-77c6-47c4-98d2-c691f0d117db tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:55.535428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df69cb71-77c6-47c4-98d2-c691f0d117db tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:55.535853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-df69cb71-77c6-47c4-98d2-c691f0d117db tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:55.724043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-df69cb71-77c6-47c4-98d2-c691f0d117db tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:55.731728 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-df69cb71-77c6-47c4-98d2-c691f0d117db tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1676 microversion: 2.1 time: 0.208960 Sep 10 11:31:55.738789 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2097/6509] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:55 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:56.757106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0808ae9f-80b9-4147-8f75-407055876c0a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:56.757819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0808ae9f-80b9-4147-8f75-407055876c0a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:56.765216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0808ae9f-80b9-4147-8f75-407055876c0a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:56.765726 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0808ae9f-80b9-4147-8f75-407055876c0a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:56.766184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0808ae9f-80b9-4147-8f75-407055876c0a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:56.766896 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0808ae9f-80b9-4147-8f75-407055876c0a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:56.767364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0808ae9f-80b9-4147-8f75-407055876c0a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:56.767805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0808ae9f-80b9-4147-8f75-407055876c0a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:56.900537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0808ae9f-80b9-4147-8f75-407055876c0a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:56.908755 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0808ae9f-80b9-4147-8f75-407055876c0a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1676 microversion: 2.1 time: 0.157589 Sep 10 11:31:56.909370 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4413/6510] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:56 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:57.933565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2fd83f09-aa9f-4e43-94bf-c5e369eca58d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:57.934182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2fd83f09-aa9f-4e43-94bf-c5e369eca58d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:57.941201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd83f09-aa9f-4e43-94bf-c5e369eca58d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:57.941696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd83f09-aa9f-4e43-94bf-c5e369eca58d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:57.942136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd83f09-aa9f-4e43-94bf-c5e369eca58d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:57.942830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd83f09-aa9f-4e43-94bf-c5e369eca58d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:57.943917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd83f09-aa9f-4e43-94bf-c5e369eca58d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:57.944344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2fd83f09-aa9f-4e43-94bf-c5e369eca58d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:58.078531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2fd83f09-aa9f-4e43-94bf-c5e369eca58d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:58.086977 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2fd83f09-aa9f-4e43-94bf-c5e369eca58d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1676 microversion: 2.1 time: 0.157675 Sep 10 11:31:58.087805 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2098/6511] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:57 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:59.110297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:59.110940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:59.119248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:59.119771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:59.120232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:59.120957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:59.121513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:59.121961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:59.159070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:59.159198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:59.159609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:59.160073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:31:59.356844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:59.364824 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c169ccbe-3498-4554-b834-9619b2563fe1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1731 microversion: 2.1 time: 0.258716 Sep 10 11:31:59.365447 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4414/6512] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:59 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:59.399032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:59.399532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:31:59.406557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:59.407040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:59.407475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:59.408162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:59.408618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:59.409040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:59.440251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:31:59.440734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:31:59.441200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:31:59.441651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:31:59.555776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:31:59.563937 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0a291ae2-f50f-49fc-b263-41c7cefbcebf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1731 microversion: 2.1 time: 0.169381 Sep 10 11:31:59.564522 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2099/6513] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:31:59 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:00.587935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:00.588583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:00.595841 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:00.596354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:00.596810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:00.597554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:00.598030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:00.598474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:00.630560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:00.631060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:00.631515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:00.631981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:32:00.743020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:00.750944 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d2b1dc0f-15f3-4952-bd3b-0149cb5a77ce tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1731 microversion: 2.1 time: 0.167724 Sep 10 11:32:00.751547 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4415/6514] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:00 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:00.782306 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d94bb19a-b7ad-4dc7-97b2-c02b61bb2112 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:00.782809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d94bb19a-b7ad-4dc7-97b2-c02b61bb2112 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:00.790344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d94bb19a-b7ad-4dc7-97b2-c02b61bb2112 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:00.790835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d94bb19a-b7ad-4dc7-97b2-c02b61bb2112 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:00.791304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d94bb19a-b7ad-4dc7-97b2-c02b61bb2112 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:00.791991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d94bb19a-b7ad-4dc7-97b2-c02b61bb2112 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:00.792443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d94bb19a-b7ad-4dc7-97b2-c02b61bb2112 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:00.792865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d94bb19a-b7ad-4dc7-97b2-c02b61bb2112 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:00.818892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d94bb19a-b7ad-4dc7-97b2-c02b61bb2112 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:32:00.901855 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d94bb19a-b7ad-4dc7-97b2-c02b61bb2112 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 204 len: 0 microversion: 2.1 time: 0.123078 Sep 10 11:32:00.902488 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2100/6515] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:32:00 2022] DELETE /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:32:00.910900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:00.911539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:00.918709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:00.919212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:00.919668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:00.920372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:00.920844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:00.921320 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:00.952514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:00.953017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:00.953493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:00.953959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:32:01.149341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:01.157469 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cd353d99-4f51-4414-8a1f-5c9566971196 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 200 len: 1737 microversion: 2.1 time: 0.250374 Sep 10 11:32:01.157983 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4416/6516] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:00 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:01.853923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-64967fe6-bc2a-4556-955c-e76b0496d71d req-b1f13c94-f7b8-46a8-87d0-b0268ac2a7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90e7f62b-5cfd-4f3f-bc62-8e600123baa4", "name": "network-vif-deleted", "tag": "c21d4ece-98c0-4754-a723-8f8457203744"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:32:01.867273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-64967fe6-bc2a-4556-955c-e76b0496d71d req-b1f13c94-f7b8-46a8-87d0-b0268ac2a7cc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:01.867982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-64967fe6-bc2a-4556-955c-e76b0496d71d req-b1f13c94-f7b8-46a8-87d0-b0268ac2a7cc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:01.868597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-64967fe6-bc2a-4556-955c-e76b0496d71d req-b1f13c94-f7b8-46a8-87d0-b0268ac2a7cc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:01.881984 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-64967fe6-bc2a-4556-955c-e76b0496d71d req-b1f13c94-f7b8-46a8-87d0-b0268ac2a7cc service nova] Creating event network-vif-deleted:c21d4ece-98c0-4754-a723-8f8457203744 for instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 on n-h1-856894-1 Sep 10 11:32:01.888376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-64967fe6-bc2a-4556-955c-e76b0496d71d req-b1f13c94-f7b8-46a8-87d0-b0268ac2a7cc service nova] Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:32:01.895029 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-64967fe6-bc2a-4556-955c-e76b0496d71d req-b1f13c94-f7b8-46a8-87d0-b0268ac2a7cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045762 Sep 10 11:32:01.895639 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2101/6517] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:32:02.182263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:02.182897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:02.190491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:02.191191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:02.191653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:02.192397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:02.193053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:02.193561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:02.210365 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 HTTP/1.1 Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '90e7f62b-5cfd-4f3f-bc62-8e600123baa4'} Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:32:02.212608 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.217885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:32:02.217885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:32:02.217885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:32:02.217885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:32:02.217885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:32:02.217885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:32:02.217885 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.217885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:32:02.217885 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5ce76cbb-a4b6-4a5e-81cb-4ae81c542f7d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 404 len: 111 microversion: 2.1 time: 0.036383 Sep 10 11:32:02.217885 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4417/6518] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:02 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:32:02.224929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:02.225468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:02.232210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:02.232638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:02.233273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:02.233999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:02.234456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:02.234882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:02.249010 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 HTTP/1.1 Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '90e7f62b-5cfd-4f3f-bc62-8e600123baa4'} Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:32:02.250747 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8b9a8501-182f-4cdd-b2d9-ed7596a4efd6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 404 len: 111 microversion: 2.1 time: 0.031874 Sep 10 11:32:02.254941 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2102/6519] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:32:02 2022] DELETE /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:32:02.267243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd870419-4830-41eb-b2fa-487d6f470d9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:02.267948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bd870419-4830-41eb-b2fa-487d6f470d9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Failed to fetch instance by id None {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 11:32:02.268486 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-bd870419-4830-41eb-b2fa-487d6f470d9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance None could not be found. Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd870419-4830-41eb-b2fa-487d6f470d9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/None HTTP/1.1 Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance None could not be found. Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'None'} Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance None could not be found. Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance None could not be found. Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:32:02.270023 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance None could not be found. Sep 10 11:32:02.274912 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:32:02.274912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bd870419-4830-41eb-b2fa-487d6f470d9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance None could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:32:02.274912 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bd870419-4830-41eb-b2fa-487d6f470d9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/None" status: 404 len: 79 microversion: 2.1 time: 0.008407 Sep 10 11:32:02.280065 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4418/6520] 10.222.0.20 () {58 vars in 1140 bytes} [Sat Sep 10 11:32:02 2022] GET /compute/v2.1/servers/None => generated 79 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:32:02.321885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1126007818", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "95f13bd4-0756-4b44-9560-173cb6276b85"}], "security_groups": [{"name": "tempest-securitygroup--2045802151"}], "key_name": "tempest-keypair-1238555339", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:32:02.430218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] validate_networks() for [('95f13bd4-0756-4b44-9560-173cb6276b85', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:32:02.861975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:32:02.862565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:32:02.862857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:32:02.863265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:32:02.863874 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:32:02.874147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:02.874616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:02.875040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:02.875756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:02.876204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:02.876619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:02.884042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:02.896909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:32:02.902758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Getting quotas for user 61a1365243a242b98c96ce078a850c09 and project 6c49ee47ccdb435ca1a4e18f32eeb5c5. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:32:02.915856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:32:02.918212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:32:02.971714 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c1e2912b-6109-4987-8340-813f9d5212e0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.653645 Sep 10 11:32:02.972408 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2103/6521] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:32:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:32:02.984263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e672ed3b-a8bd-4296-af3b-892f8b435e08 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:02.984933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e672ed3b-a8bd-4296-af3b-892f8b435e08 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:03.045744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e672ed3b-a8bd-4296-af3b-892f8b435e08 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:03.053560 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e672ed3b-a8bd-4296-af3b-892f8b435e08 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1239 microversion: 2.1 time: 0.073225 Sep 10 11:32:03.054702 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4419/6522] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:02 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:04.079253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f9a3eb2d-9608-4b61-8375-4f6c48897eb1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:04.079891 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f9a3eb2d-9608-4b61-8375-4f6c48897eb1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:04.090147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9a3eb2d-9608-4b61-8375-4f6c48897eb1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:04.090900 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9a3eb2d-9608-4b61-8375-4f6c48897eb1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:04.091508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9a3eb2d-9608-4b61-8375-4f6c48897eb1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:04.092396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9a3eb2d-9608-4b61-8375-4f6c48897eb1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:04.092851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9a3eb2d-9608-4b61-8375-4f6c48897eb1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:04.093468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f9a3eb2d-9608-4b61-8375-4f6c48897eb1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:04.166478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f9a3eb2d-9608-4b61-8375-4f6c48897eb1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:04.174457 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f9a3eb2d-9608-4b61-8375-4f6c48897eb1 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1309 microversion: 2.1 time: 0.100096 Sep 10 11:32:04.175050 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2104/6523] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:04 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:05.198194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4af991a9-963a-493c-bf8d-3f58a5c305b2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:05.198939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4af991a9-963a-493c-bf8d-3f58a5c305b2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:05.206201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4af991a9-963a-493c-bf8d-3f58a5c305b2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:05.206956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4af991a9-963a-493c-bf8d-3f58a5c305b2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:05.207629 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4af991a9-963a-493c-bf8d-3f58a5c305b2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:05.208557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4af991a9-963a-493c-bf8d-3f58a5c305b2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:05.209194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4af991a9-963a-493c-bf8d-3f58a5c305b2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:05.209744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4af991a9-963a-493c-bf8d-3f58a5c305b2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:05.214574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:05.402611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:05.708426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4af991a9-963a-493c-bf8d-3f58a5c305b2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:05.716936 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4af991a9-963a-493c-bf8d-3f58a5c305b2 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1365 microversion: 2.1 time: 0.523256 Sep 10 11:32:05.717555 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4420/6524] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:05 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1365 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:05.820899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-a5984113-83db-4ed8-be0e-45b93b587444 req-37cb9f36-9791-4704-8182-c4301a1f0092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef5cd1b7-f799-416e-b126-47e9e0359180", "tag": "17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:32:05.831706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a5984113-83db-4ed8-be0e-45b93b587444 req-37cb9f36-9791-4704-8182-c4301a1f0092 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:05.832190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a5984113-83db-4ed8-be0e-45b93b587444 req-37cb9f36-9791-4704-8182-c4301a1f0092 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:05.832695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-a5984113-83db-4ed8-be0e-45b93b587444 req-37cb9f36-9791-4704-8182-c4301a1f0092 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:05.844935 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-a5984113-83db-4ed8-be0e-45b93b587444 req-37cb9f36-9791-4704-8182-c4301a1f0092 service nova] Creating event network-changed:17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab for instance ef5cd1b7-f799-416e-b126-47e9e0359180 on n-h2-856894-1 Sep 10 11:32:05.849717 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-a5984113-83db-4ed8-be0e-45b93b587444 req-37cb9f36-9791-4704-8182-c4301a1f0092 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033245 Sep 10 11:32:05.850321 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2105/6525] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:32:06.740716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-93e32133-a24f-49f5-ba6a-bde29254b3cb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:06.741398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-93e32133-a24f-49f5-ba6a-bde29254b3cb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:06.749085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93e32133-a24f-49f5-ba6a-bde29254b3cb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:06.749603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93e32133-a24f-49f5-ba6a-bde29254b3cb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:06.750062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93e32133-a24f-49f5-ba6a-bde29254b3cb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:06.750776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93e32133-a24f-49f5-ba6a-bde29254b3cb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:06.751248 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93e32133-a24f-49f5-ba6a-bde29254b3cb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:06.751695 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-93e32133-a24f-49f5-ba6a-bde29254b3cb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:06.888189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-93e32133-a24f-49f5-ba6a-bde29254b3cb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:06.896065 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-93e32133-a24f-49f5-ba6a-bde29254b3cb tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1365 microversion: 2.1 time: 0.159321 Sep 10 11:32:06.896652 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4421/6526] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:06 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:07.920944 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8a204cc2-e0b4-42d0-a2ba-74725d5db575 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:07.921597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8a204cc2-e0b4-42d0-a2ba-74725d5db575 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:07.927992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a204cc2-e0b4-42d0-a2ba-74725d5db575 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:07.928475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a204cc2-e0b4-42d0-a2ba-74725d5db575 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:07.928914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a204cc2-e0b4-42d0-a2ba-74725d5db575 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:07.930270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a204cc2-e0b4-42d0-a2ba-74725d5db575 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:07.930749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a204cc2-e0b4-42d0-a2ba-74725d5db575 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:07.931178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a204cc2-e0b4-42d0-a2ba-74725d5db575 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:08.059065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8a204cc2-e0b4-42d0-a2ba-74725d5db575 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:08.066630 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8a204cc2-e0b4-42d0-a2ba-74725d5db575 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1365 microversion: 2.1 time: 0.150769 Sep 10 11:32:08.067200 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2106/6527] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:07 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:09.090531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5aa92e0-625d-4fce-803e-aaefe5c0eb93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:09.091168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e5aa92e0-625d-4fce-803e-aaefe5c0eb93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:09.098207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5aa92e0-625d-4fce-803e-aaefe5c0eb93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:09.098709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5aa92e0-625d-4fce-803e-aaefe5c0eb93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:09.099166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5aa92e0-625d-4fce-803e-aaefe5c0eb93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:09.099872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5aa92e0-625d-4fce-803e-aaefe5c0eb93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:09.100345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5aa92e0-625d-4fce-803e-aaefe5c0eb93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:09.100790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5aa92e0-625d-4fce-803e-aaefe5c0eb93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:09.227959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e5aa92e0-625d-4fce-803e-aaefe5c0eb93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:09.235867 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e5aa92e0-625d-4fce-803e-aaefe5c0eb93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1365 microversion: 2.1 time: 0.149331 Sep 10 11:32:09.236454 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4422/6528] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:09 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:10.258954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c60932ec-2bf2-4a4b-881d-b23e1fd7ab0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:10.259598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c60932ec-2bf2-4a4b-881d-b23e1fd7ab0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:10.262456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:10.268092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c60932ec-2bf2-4a4b-881d-b23e1fd7ab0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:10.268582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c60932ec-2bf2-4a4b-881d-b23e1fd7ab0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:10.269010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c60932ec-2bf2-4a4b-881d-b23e1fd7ab0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:10.269715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c60932ec-2bf2-4a4b-881d-b23e1fd7ab0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:10.270164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c60932ec-2bf2-4a4b-881d-b23e1fd7ab0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:10.270583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c60932ec-2bf2-4a4b-881d-b23e1fd7ab0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:10.399813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c60932ec-2bf2-4a4b-881d-b23e1fd7ab0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:10.407416 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c60932ec-2bf2-4a4b-881d-b23e1fd7ab0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1365 microversion: 2.1 time: 0.152358 Sep 10 11:32:10.407983 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2107/6529] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:10 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:11.431119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cb698a64-9e8d-4cc3-a391-1705231136b4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:11.431760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cb698a64-9e8d-4cc3-a391-1705231136b4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:11.434571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:11.439973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb698a64-9e8d-4cc3-a391-1705231136b4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:11.440471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb698a64-9e8d-4cc3-a391-1705231136b4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:11.440931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb698a64-9e8d-4cc3-a391-1705231136b4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:11.441668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb698a64-9e8d-4cc3-a391-1705231136b4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:11.442142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb698a64-9e8d-4cc3-a391-1705231136b4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:11.442587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cb698a64-9e8d-4cc3-a391-1705231136b4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:11.570263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cb698a64-9e8d-4cc3-a391-1705231136b4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:11.578051 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cb698a64-9e8d-4cc3-a391-1705231136b4 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1365 microversion: 2.1 time: 0.150967 Sep 10 11:32:11.578638 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4423/6530] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:11 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:12.602172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0c937297-b363-49b0-b714-32b57b44b860 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:12.602810 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0c937297-b363-49b0-b714-32b57b44b860 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:12.609619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c937297-b363-49b0-b714-32b57b44b860 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:12.610100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c937297-b363-49b0-b714-32b57b44b860 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:12.610533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c937297-b363-49b0-b714-32b57b44b860 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:12.611217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c937297-b363-49b0-b714-32b57b44b860 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:12.611665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c937297-b363-49b0-b714-32b57b44b860 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:12.612087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0c937297-b363-49b0-b714-32b57b44b860 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:12.717740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-cf64c74d-9f25-4113-9888-dae88040bcb7 req-88f352f9-1f72-45f7-83cf-2e8d96ac8193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5cd1b7-f799-416e-b126-47e9e0359180", "name": "network-vif-plugged", "status": "completed", "tag": "17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:32:12.727785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf64c74d-9f25-4113-9888-dae88040bcb7 req-88f352f9-1f72-45f7-83cf-2e8d96ac8193 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:12.728282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf64c74d-9f25-4113-9888-dae88040bcb7 req-88f352f9-1f72-45f7-83cf-2e8d96ac8193 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:12.728728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf64c74d-9f25-4113-9888-dae88040bcb7 req-88f352f9-1f72-45f7-83cf-2e8d96ac8193 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:12.739776 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-cf64c74d-9f25-4113-9888-dae88040bcb7 req-88f352f9-1f72-45f7-83cf-2e8d96ac8193 service nova] Creating event network-vif-plugged:17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab for instance ef5cd1b7-f799-416e-b126-47e9e0359180 on n-h2-856894-1 Sep 10 11:32:12.744924 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-cf64c74d-9f25-4113-9888-dae88040bcb7 req-88f352f9-1f72-45f7-83cf-2e8d96ac8193 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130079 Sep 10 11:32:12.745565 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4424/6531] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:32:12.757194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0c937297-b363-49b0-b714-32b57b44b860 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:12.766571 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0c937297-b363-49b0-b714-32b57b44b860 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1365 microversion: 2.1 time: 0.168717 Sep 10 11:32:12.767164 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2108/6532] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:12 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:13.788314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:13.789262 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:32:13.789454 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 11:32:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 (ip 10.222.0.20) !!! Sep 10 11:32:13.796137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5e967647-48aa-468b-918f-464bcb244099 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:13.796858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5e967647-48aa-468b-918f-464bcb244099 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:13.805931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e967647-48aa-468b-918f-464bcb244099 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:13.806430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e967647-48aa-468b-918f-464bcb244099 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:13.806881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e967647-48aa-468b-918f-464bcb244099 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:13.807585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e967647-48aa-468b-918f-464bcb244099 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:13.808053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e967647-48aa-468b-918f-464bcb244099 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:13.808493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e967647-48aa-468b-918f-464bcb244099 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:13.940051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e967647-48aa-468b-918f-464bcb244099 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:13.947859 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5e967647-48aa-468b-918f-464bcb244099 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1365 microversion: 2.1 time: 0.160498 Sep 10 11:32:13.948450 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4425/6533] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:13 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:14.971246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9d7f339-9139-4c2e-a1b7-03c1d8600e9b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:14.971775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9d7f339-9139-4c2e-a1b7-03c1d8600e9b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:14.973593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:14.974512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:14.982547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d7f339-9139-4c2e-a1b7-03c1d8600e9b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:14.983078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d7f339-9139-4c2e-a1b7-03c1d8600e9b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:14.983524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d7f339-9139-4c2e-a1b7-03c1d8600e9b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:14.984232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d7f339-9139-4c2e-a1b7-03c1d8600e9b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:14.984690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d7f339-9139-4c2e-a1b7-03c1d8600e9b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:14.985213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d7f339-9139-4c2e-a1b7-03c1d8600e9b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:15.118498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9d7f339-9139-4c2e-a1b7-03c1d8600e9b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:15.126300 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9d7f339-9139-4c2e-a1b7-03c1d8600e9b tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1551 microversion: 2.1 time: 0.158982 Sep 10 11:32:15.126892 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2109/6534] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:14 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:15.149673 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c991c79-16c5-483c-8929-0c1e0662b0c7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:15.150191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c991c79-16c5-483c-8929-0c1e0662b0c7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:15.157230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c991c79-16c5-483c-8929-0c1e0662b0c7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:15.157732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c991c79-16c5-483c-8929-0c1e0662b0c7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:15.158189 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c991c79-16c5-483c-8929-0c1e0662b0c7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:15.158901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c991c79-16c5-483c-8929-0c1e0662b0c7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:15.159403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c991c79-16c5-483c-8929-0c1e0662b0c7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:15.159846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c991c79-16c5-483c-8929-0c1e0662b0c7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:15.241938 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c991c79-16c5-483c-8929-0c1e0662b0c7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096256 Sep 10 11:32:15.242577 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4426/6535] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:32:15 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:32:16.230627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-e34e71cf-6ecd-43e2-8db6-864659c8d44f req-8b3639d4-3394-4396-86ea-e063c4cce204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef5cd1b7-f799-416e-b126-47e9e0359180", "tag": "17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:32:16.245001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e34e71cf-6ecd-43e2-8db6-864659c8d44f req-8b3639d4-3394-4396-86ea-e063c4cce204 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:16.245522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e34e71cf-6ecd-43e2-8db6-864659c8d44f req-8b3639d4-3394-4396-86ea-e063c4cce204 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:16.245990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e34e71cf-6ecd-43e2-8db6-864659c8d44f req-8b3639d4-3394-4396-86ea-e063c4cce204 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:16.257335 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-e34e71cf-6ecd-43e2-8db6-864659c8d44f req-8b3639d4-3394-4396-86ea-e063c4cce204 service nova] Creating event network-changed:17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab for instance ef5cd1b7-f799-416e-b126-47e9e0359180 on n-h2-856894-1 Sep 10 11:32:16.263083 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-e34e71cf-6ecd-43e2-8db6-864659c8d44f req-8b3639d4-3394-4396-86ea-e063c4cce204 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085407 Sep 10 11:32:16.264114 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2110/6536] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:32:58.346853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:58.347646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=34 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:58.351565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6eb28b0f-a4ee-44c0-8cfc-47d02ae1da64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:32:58.352198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6eb28b0f-a4ee-44c0-8cfc-47d02ae1da64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:58.359012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb28b0f-a4ee-44c0-8cfc-47d02ae1da64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:58.359514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb28b0f-a4ee-44c0-8cfc-47d02ae1da64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:58.359967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb28b0f-a4ee-44c0-8cfc-47d02ae1da64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:58.360669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb28b0f-a4ee-44c0-8cfc-47d02ae1da64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:58.361162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb28b0f-a4ee-44c0-8cfc-47d02ae1da64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:58.361605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6eb28b0f-a4ee-44c0-8cfc-47d02ae1da64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:58.491899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6eb28b0f-a4ee-44c0-8cfc-47d02ae1da64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:32:58.500353 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6eb28b0f-a4ee-44c0-8cfc-47d02ae1da64 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1669 microversion: 2.1 time: 0.155619 Sep 10 11:32:58.500924 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4427/6537] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:32:58 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:32:58.521303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=7 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:58.522126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=34 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:32:58.528298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-337fc2e8-5a46-406c-9034-37f3eaa37a01 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de403b6b-921a-45fb-ba6b-a5b438a9d3e9"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:32:58.530757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-337fc2e8-5a46-406c-9034-37f3eaa37a01 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:32:58.538756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337fc2e8-5a46-406c-9034-37f3eaa37a01 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:58.539490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337fc2e8-5a46-406c-9034-37f3eaa37a01 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:58.539921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337fc2e8-5a46-406c-9034-37f3eaa37a01 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:58.540619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337fc2e8-5a46-406c-9034-37f3eaa37a01 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:32:58.541062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337fc2e8-5a46-406c-9034-37f3eaa37a01 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:32:58.541499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-337fc2e8-5a46-406c-9034-37f3eaa37a01 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:32:58.799280 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-337fc2e8-5a46-406c-9034-37f3eaa37a01 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279808 Sep 10 11:32:58.805480 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2111/6538] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:32:58 2022] POST /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:33:10.590530 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:33:10.593446 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:10.596018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:33:10.596694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:33:10.602328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:10.602829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:10.603278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:10.603980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:10.604453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:10.604895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:10.633605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:10.639007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Old instance type m1.heat2, new instance type m1.heat {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:33:10.646036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:33:10.646473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:33:10.646966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:33:10.647391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:33:10.647819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:33:10.710150 n-d-856894-1 devstack@n-api.service[128788]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [cbd28549-c4f9-4def-83aa-55236dae37b9] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 11:33:11.716058 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [cbd28549-c4f9-4def-83aa-55236dae37b9] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47730. Sep 10 11:33:11.719328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6d8953d4-6325-4fdc-bf32-fcad51c2edf6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "POST /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/action" status: 202 len: 0 microversion: 2.1 time: 1.132864 Sep 10 11:33:11.719944 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4428/6539] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:33:10 2022] POST /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:33:11.726309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:33:11.727111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:33:11.731580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b6f0ccd7-2255-4fd3-9f4b-e63a8d21105c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:11.732829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b6f0ccd7-2255-4fd3-9f4b-e63a8d21105c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:11.740365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6f0ccd7-2255-4fd3-9f4b-e63a8d21105c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:11.740884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6f0ccd7-2255-4fd3-9f4b-e63a8d21105c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:11.741357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6f0ccd7-2255-4fd3-9f4b-e63a8d21105c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:11.742096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6f0ccd7-2255-4fd3-9f4b-e63a8d21105c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:11.742557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6f0ccd7-2255-4fd3-9f4b-e63a8d21105c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:11.742987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b6f0ccd7-2255-4fd3-9f4b-e63a8d21105c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:11.898979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b6f0ccd7-2255-4fd3-9f4b-e63a8d21105c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:11.907833 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b6f0ccd7-2255-4fd3-9f4b-e63a8d21105c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1724 microversion: 2.1 time: 0.183490 Sep 10 11:33:11.908414 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2112/6540] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:11 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:12.932051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6f9d6b2b-3b66-4be8-92b8-655695f6b4d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:12.932679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6f9d6b2b-3b66-4be8-92b8-655695f6b4d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:12.943289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f9d6b2b-3b66-4be8-92b8-655695f6b4d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:12.943796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f9d6b2b-3b66-4be8-92b8-655695f6b4d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:12.944247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f9d6b2b-3b66-4be8-92b8-655695f6b4d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:12.944958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f9d6b2b-3b66-4be8-92b8-655695f6b4d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:12.945452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f9d6b2b-3b66-4be8-92b8-655695f6b4d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:12.945892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6f9d6b2b-3b66-4be8-92b8-655695f6b4d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:13.456218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6f9d6b2b-3b66-4be8-92b8-655695f6b4d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:13.464549 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6f9d6b2b-3b66-4be8-92b8-655695f6b4d7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1724 microversion: 2.1 time: 0.537443 Sep 10 11:33:13.465161 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4429/6541] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:12 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1724 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:14.488149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-27673b26-24e6-4e11-b49b-8f215b7f796c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:14.488764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-27673b26-24e6-4e11-b49b-8f215b7f796c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:14.497708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27673b26-24e6-4e11-b49b-8f215b7f796c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:14.498185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27673b26-24e6-4e11-b49b-8f215b7f796c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:14.498614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27673b26-24e6-4e11-b49b-8f215b7f796c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:14.499292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27673b26-24e6-4e11-b49b-8f215b7f796c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:14.499744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27673b26-24e6-4e11-b49b-8f215b7f796c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:14.500161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-27673b26-24e6-4e11-b49b-8f215b7f796c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:14.628124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-27673b26-24e6-4e11-b49b-8f215b7f796c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:14.636297 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-27673b26-24e6-4e11-b49b-8f215b7f796c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.152025 Sep 10 11:33:14.636862 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2113/6542] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:14 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:15.660445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f4f35ecf-04ed-44cb-bf51-8c6d505df2a9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:15.661000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f4f35ecf-04ed-44cb-bf51-8c6d505df2a9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:15.668058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4f35ecf-04ed-44cb-bf51-8c6d505df2a9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:15.668567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4f35ecf-04ed-44cb-bf51-8c6d505df2a9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:15.669024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4f35ecf-04ed-44cb-bf51-8c6d505df2a9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:15.670414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4f35ecf-04ed-44cb-bf51-8c6d505df2a9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:15.670889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4f35ecf-04ed-44cb-bf51-8c6d505df2a9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:15.671337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4f35ecf-04ed-44cb-bf51-8c6d505df2a9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:15.802220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f4f35ecf-04ed-44cb-bf51-8c6d505df2a9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:15.811096 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f4f35ecf-04ed-44cb-bf51-8c6d505df2a9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.154719 Sep 10 11:33:15.811685 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4430/6543] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:15 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:16.834756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cda39b45-93cc-46fd-b653-9bf4cf158882 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:16.835369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cda39b45-93cc-46fd-b653-9bf4cf158882 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:16.842441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cda39b45-93cc-46fd-b653-9bf4cf158882 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:16.842923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cda39b45-93cc-46fd-b653-9bf4cf158882 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:16.843362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cda39b45-93cc-46fd-b653-9bf4cf158882 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:16.844052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cda39b45-93cc-46fd-b653-9bf4cf158882 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:16.844507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cda39b45-93cc-46fd-b653-9bf4cf158882 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:16.844994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cda39b45-93cc-46fd-b653-9bf4cf158882 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:16.971616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cda39b45-93cc-46fd-b653-9bf4cf158882 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:16.979861 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cda39b45-93cc-46fd-b653-9bf4cf158882 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.149010 Sep 10 11:33:16.980430 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2114/6544] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:16 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:18.004398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-797bc66f-fa8c-4fb3-b232-904d01bed8ff tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:18.005061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-797bc66f-fa8c-4fb3-b232-904d01bed8ff tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:18.011622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-797bc66f-fa8c-4fb3-b232-904d01bed8ff tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:18.012126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-797bc66f-fa8c-4fb3-b232-904d01bed8ff tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:18.012583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-797bc66f-fa8c-4fb3-b232-904d01bed8ff tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:18.013917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-797bc66f-fa8c-4fb3-b232-904d01bed8ff tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:18.014392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-797bc66f-fa8c-4fb3-b232-904d01bed8ff tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:18.014835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-797bc66f-fa8c-4fb3-b232-904d01bed8ff tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:18.146835 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-797bc66f-fa8c-4fb3-b232-904d01bed8ff tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:18.155265 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-797bc66f-fa8c-4fb3-b232-904d01bed8ff tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.155029 Sep 10 11:33:18.155853 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4431/6545] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:17 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:19.179806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2e649dac-4ce3-4ac1-848b-785ce1f36e0d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:19.180449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2e649dac-4ce3-4ac1-848b-785ce1f36e0d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:19.187675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e649dac-4ce3-4ac1-848b-785ce1f36e0d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:19.188166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e649dac-4ce3-4ac1-848b-785ce1f36e0d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:19.188605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e649dac-4ce3-4ac1-848b-785ce1f36e0d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:19.189317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e649dac-4ce3-4ac1-848b-785ce1f36e0d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:19.189774 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e649dac-4ce3-4ac1-848b-785ce1f36e0d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:19.190199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2e649dac-4ce3-4ac1-848b-785ce1f36e0d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:19.315600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2e649dac-4ce3-4ac1-848b-785ce1f36e0d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:19.323730 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2e649dac-4ce3-4ac1-848b-785ce1f36e0d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.147855 Sep 10 11:33:19.324298 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2115/6546] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:19 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:20.346921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d3ec3ab6-fafd-4b3d-8f26-387c74ebc5c9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:20.347557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d3ec3ab6-fafd-4b3d-8f26-387c74ebc5c9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:20.354488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ec3ab6-fafd-4b3d-8f26-387c74ebc5c9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:20.354984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ec3ab6-fafd-4b3d-8f26-387c74ebc5c9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:20.355434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ec3ab6-fafd-4b3d-8f26-387c74ebc5c9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:20.356133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ec3ab6-fafd-4b3d-8f26-387c74ebc5c9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:20.356598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ec3ab6-fafd-4b3d-8f26-387c74ebc5c9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:20.357035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3ec3ab6-fafd-4b3d-8f26-387c74ebc5c9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:20.486810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d3ec3ab6-fafd-4b3d-8f26-387c74ebc5c9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:20.495171 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d3ec3ab6-fafd-4b3d-8f26-387c74ebc5c9 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.152257 Sep 10 11:33:20.495750 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4432/6547] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:20 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:21.519763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c88679ba-41df-4f1a-93fb-f340d67592cf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:21.520359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c88679ba-41df-4f1a-93fb-f340d67592cf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:21.527229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c88679ba-41df-4f1a-93fb-f340d67592cf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:21.527715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c88679ba-41df-4f1a-93fb-f340d67592cf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:21.528159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c88679ba-41df-4f1a-93fb-f340d67592cf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:21.528853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c88679ba-41df-4f1a-93fb-f340d67592cf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:21.529333 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c88679ba-41df-4f1a-93fb-f340d67592cf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:21.529762 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c88679ba-41df-4f1a-93fb-f340d67592cf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:21.661266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c88679ba-41df-4f1a-93fb-f340d67592cf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:21.669688 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c88679ba-41df-4f1a-93fb-f340d67592cf tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.154384 Sep 10 11:33:21.670266 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2116/6548] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:21 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:22.693214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b3783b0-7a7b-4998-ba33-46ac31c9a050 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:22.693861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b3783b0-7a7b-4998-ba33-46ac31c9a050 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:22.701003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3783b0-7a7b-4998-ba33-46ac31c9a050 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:22.701540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3783b0-7a7b-4998-ba33-46ac31c9a050 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:22.702504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3783b0-7a7b-4998-ba33-46ac31c9a050 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:22.703238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3783b0-7a7b-4998-ba33-46ac31c9a050 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:22.703716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3783b0-7a7b-4998-ba33-46ac31c9a050 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:22.704165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b3783b0-7a7b-4998-ba33-46ac31c9a050 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:22.831911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b3783b0-7a7b-4998-ba33-46ac31c9a050 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:22.840420 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b3783b0-7a7b-4998-ba33-46ac31c9a050 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.151279 Sep 10 11:33:22.841010 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4433/6549] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:22 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:23.864502 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-080a987c-0fb2-4339-8740-52bdee24582f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:23.865176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-080a987c-0fb2-4339-8740-52bdee24582f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:23.872032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-080a987c-0fb2-4339-8740-52bdee24582f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:23.872519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-080a987c-0fb2-4339-8740-52bdee24582f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:23.872959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-080a987c-0fb2-4339-8740-52bdee24582f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:23.873678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-080a987c-0fb2-4339-8740-52bdee24582f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:23.874128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-080a987c-0fb2-4339-8740-52bdee24582f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:23.874554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-080a987c-0fb2-4339-8740-52bdee24582f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:24.006629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-080a987c-0fb2-4339-8740-52bdee24582f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:24.014861 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-080a987c-0fb2-4339-8740-52bdee24582f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.154254 Sep 10 11:33:24.015445 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2117/6550] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:23 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:25.038368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95425d9b-c2a2-43ca-ab77-30bcd018d976 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:25.039000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95425d9b-c2a2-43ca-ab77-30bcd018d976 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:25.046543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95425d9b-c2a2-43ca-ab77-30bcd018d976 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:25.047052 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95425d9b-c2a2-43ca-ab77-30bcd018d976 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:25.047511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95425d9b-c2a2-43ca-ab77-30bcd018d976 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:25.048492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95425d9b-c2a2-43ca-ab77-30bcd018d976 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:25.048975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95425d9b-c2a2-43ca-ab77-30bcd018d976 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:25.049451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95425d9b-c2a2-43ca-ab77-30bcd018d976 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:25.180765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95425d9b-c2a2-43ca-ab77-30bcd018d976 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:25.190206 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95425d9b-c2a2-43ca-ab77-30bcd018d976 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.155698 Sep 10 11:33:25.190864 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4434/6551] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:25 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:26.213273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a2f9f009-d8f7-4c42-b814-2df55a7bcd72 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:26.213911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a2f9f009-d8f7-4c42-b814-2df55a7bcd72 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:26.220786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2f9f009-d8f7-4c42-b814-2df55a7bcd72 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:26.221300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2f9f009-d8f7-4c42-b814-2df55a7bcd72 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:26.221739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2f9f009-d8f7-4c42-b814-2df55a7bcd72 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:26.222422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2f9f009-d8f7-4c42-b814-2df55a7bcd72 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:26.222878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2f9f009-d8f7-4c42-b814-2df55a7bcd72 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:26.223303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a2f9f009-d8f7-4c42-b814-2df55a7bcd72 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:26.348251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a2f9f009-d8f7-4c42-b814-2df55a7bcd72 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:26.356597 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a2f9f009-d8f7-4c42-b814-2df55a7bcd72 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.147216 Sep 10 11:33:26.357215 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2118/6552] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:26 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:27.380195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad0c2be2-82dc-4b33-8eba-8b0f467835af tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:27.380732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ad0c2be2-82dc-4b33-8eba-8b0f467835af tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:27.387677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad0c2be2-82dc-4b33-8eba-8b0f467835af tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:27.388172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad0c2be2-82dc-4b33-8eba-8b0f467835af tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:27.388623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad0c2be2-82dc-4b33-8eba-8b0f467835af tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:27.389856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad0c2be2-82dc-4b33-8eba-8b0f467835af tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:27.390322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad0c2be2-82dc-4b33-8eba-8b0f467835af tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:27.390758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad0c2be2-82dc-4b33-8eba-8b0f467835af tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:27.526900 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ad0c2be2-82dc-4b33-8eba-8b0f467835af tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:27.535319 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad0c2be2-82dc-4b33-8eba-8b0f467835af tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.159212 Sep 10 11:33:27.535908 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4435/6553] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:27 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:28.559082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3e5877cd-5a07-4d9c-a767-440822bbc443 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:28.559703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3e5877cd-5a07-4d9c-a767-440822bbc443 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:28.567045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e5877cd-5a07-4d9c-a767-440822bbc443 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:28.567529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e5877cd-5a07-4d9c-a767-440822bbc443 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:28.567973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e5877cd-5a07-4d9c-a767-440822bbc443 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:28.568660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e5877cd-5a07-4d9c-a767-440822bbc443 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:28.569132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e5877cd-5a07-4d9c-a767-440822bbc443 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:28.569558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3e5877cd-5a07-4d9c-a767-440822bbc443 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:28.697043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3e5877cd-5a07-4d9c-a767-440822bbc443 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:28.705444 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3e5877cd-5a07-4d9c-a767-440822bbc443 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.150220 Sep 10 11:33:28.706016 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2119/6554] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:28 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:29.728575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2e1a9816-8807-4cce-92e6-faa621a990ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:29.729232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2e1a9816-8807-4cce-92e6-faa621a990ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:29.736561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e1a9816-8807-4cce-92e6-faa621a990ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:29.737055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e1a9816-8807-4cce-92e6-faa621a990ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:29.737531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e1a9816-8807-4cce-92e6-faa621a990ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:29.738245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e1a9816-8807-4cce-92e6-faa621a990ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:29.738699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e1a9816-8807-4cce-92e6-faa621a990ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:29.739138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2e1a9816-8807-4cce-92e6-faa621a990ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:29.878149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2e1a9816-8807-4cce-92e6-faa621a990ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:29.886616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2e1a9816-8807-4cce-92e6-faa621a990ae tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.161974 Sep 10 11:33:29.887201 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4436/6555] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:29 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:30.909738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f5a55f93-533b-4b08-a2e8-7a55c5524d56 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:30.910402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f5a55f93-533b-4b08-a2e8-7a55c5524d56 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:30.917480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a55f93-533b-4b08-a2e8-7a55c5524d56 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:30.917958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a55f93-533b-4b08-a2e8-7a55c5524d56 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:30.918386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a55f93-533b-4b08-a2e8-7a55c5524d56 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:30.919065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a55f93-533b-4b08-a2e8-7a55c5524d56 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:30.919515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a55f93-533b-4b08-a2e8-7a55c5524d56 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:30.919933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5a55f93-533b-4b08-a2e8-7a55c5524d56 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:31.048330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f5a55f93-533b-4b08-a2e8-7a55c5524d56 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:31.056462 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f5a55f93-533b-4b08-a2e8-7a55c5524d56 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.150786 Sep 10 11:33:31.057090 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2120/6556] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:30 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:32.081846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c3d44afa-5509-4060-b4f6-cea75a804e95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:32.082489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c3d44afa-5509-4060-b4f6-cea75a804e95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:32.089411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3d44afa-5509-4060-b4f6-cea75a804e95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:32.089917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3d44afa-5509-4060-b4f6-cea75a804e95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:32.090381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3d44afa-5509-4060-b4f6-cea75a804e95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:32.091080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3d44afa-5509-4060-b4f6-cea75a804e95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:32.091588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3d44afa-5509-4060-b4f6-cea75a804e95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:32.092033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c3d44afa-5509-4060-b4f6-cea75a804e95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:32.224729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c3d44afa-5509-4060-b4f6-cea75a804e95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:32.234002 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c3d44afa-5509-4060-b4f6-cea75a804e95 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.156178 Sep 10 11:33:32.234673 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4437/6557] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:32 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:33.257843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-aeea89bf-eef1-4ec2-8d70-3d609f6b076c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:33.258455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-aeea89bf-eef1-4ec2-8d70-3d609f6b076c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:33.265656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeea89bf-eef1-4ec2-8d70-3d609f6b076c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:33.266139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeea89bf-eef1-4ec2-8d70-3d609f6b076c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:33.266573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeea89bf-eef1-4ec2-8d70-3d609f6b076c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:33.267248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeea89bf-eef1-4ec2-8d70-3d609f6b076c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:33.267694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeea89bf-eef1-4ec2-8d70-3d609f6b076c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:33.268113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-aeea89bf-eef1-4ec2-8d70-3d609f6b076c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:33.394120 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-aeea89bf-eef1-4ec2-8d70-3d609f6b076c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:33.402699 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-aeea89bf-eef1-4ec2-8d70-3d609f6b076c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.148853 Sep 10 11:33:33.403278 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2121/6558] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:33 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:34.427246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3fa4ce99-d71c-433e-8faa-f5cb330934be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:34.427875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3fa4ce99-d71c-433e-8faa-f5cb330934be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:34.434844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa4ce99-d71c-433e-8faa-f5cb330934be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:34.435344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa4ce99-d71c-433e-8faa-f5cb330934be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:34.435794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa4ce99-d71c-433e-8faa-f5cb330934be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:34.436501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa4ce99-d71c-433e-8faa-f5cb330934be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:34.436971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa4ce99-d71c-433e-8faa-f5cb330934be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:34.437435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3fa4ce99-d71c-433e-8faa-f5cb330934be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:34.568076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3fa4ce99-d71c-433e-8faa-f5cb330934be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:34.576462 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3fa4ce99-d71c-433e-8faa-f5cb330934be tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.153435 Sep 10 11:33:34.577065 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4438/6559] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:34 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:35.599488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b1140745-822d-4f94-b3b0-3dadf3efb0ef tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:35.600106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b1140745-822d-4f94-b3b0-3dadf3efb0ef tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:35.607062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1140745-822d-4f94-b3b0-3dadf3efb0ef tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:35.607548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1140745-822d-4f94-b3b0-3dadf3efb0ef tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:35.608054 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1140745-822d-4f94-b3b0-3dadf3efb0ef tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:35.608746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1140745-822d-4f94-b3b0-3dadf3efb0ef tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:35.609242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1140745-822d-4f94-b3b0-3dadf3efb0ef tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:35.609668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b1140745-822d-4f94-b3b0-3dadf3efb0ef tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:35.739558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b1140745-822d-4f94-b3b0-3dadf3efb0ef tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:35.747866 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b1140745-822d-4f94-b3b0-3dadf3efb0ef tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.152289 Sep 10 11:33:35.748990 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2122/6560] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:35 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:36.772102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-12f7ff48-686a-462d-a9d4-b058b85ab88d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:36.772737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-12f7ff48-686a-462d-a9d4-b058b85ab88d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:36.779333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12f7ff48-686a-462d-a9d4-b058b85ab88d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:36.780336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12f7ff48-686a-462d-a9d4-b058b85ab88d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:36.780796 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12f7ff48-686a-462d-a9d4-b058b85ab88d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:36.781525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12f7ff48-686a-462d-a9d4-b058b85ab88d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:36.782000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12f7ff48-686a-462d-a9d4-b058b85ab88d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:36.782441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-12f7ff48-686a-462d-a9d4-b058b85ab88d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:36.911071 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-12f7ff48-686a-462d-a9d4-b058b85ab88d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:36.919393 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-12f7ff48-686a-462d-a9d4-b058b85ab88d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.151446 Sep 10 11:33:36.919972 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4439/6561] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:36 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:37.943565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-534c2eff-e94d-4449-a361-379783e8c88e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:37.944086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-534c2eff-e94d-4449-a361-379783e8c88e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:37.950948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-534c2eff-e94d-4449-a361-379783e8c88e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:37.951474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-534c2eff-e94d-4449-a361-379783e8c88e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:37.951907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-534c2eff-e94d-4449-a361-379783e8c88e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:37.952612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-534c2eff-e94d-4449-a361-379783e8c88e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:37.953066 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-534c2eff-e94d-4449-a361-379783e8c88e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:37.953510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-534c2eff-e94d-4449-a361-379783e8c88e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:38.084318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-534c2eff-e94d-4449-a361-379783e8c88e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:38.093188 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-534c2eff-e94d-4449-a361-379783e8c88e tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.153615 Sep 10 11:33:38.093770 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2123/6562] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:37 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:39.117107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63859906-ba42-4d9f-8770-b03dcf7af421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:39.117781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63859906-ba42-4d9f-8770-b03dcf7af421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:39.125268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63859906-ba42-4d9f-8770-b03dcf7af421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:39.125773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63859906-ba42-4d9f-8770-b03dcf7af421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:39.126231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63859906-ba42-4d9f-8770-b03dcf7af421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:39.126938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63859906-ba42-4d9f-8770-b03dcf7af421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:39.127412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63859906-ba42-4d9f-8770-b03dcf7af421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:39.127856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63859906-ba42-4d9f-8770-b03dcf7af421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:39.260531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63859906-ba42-4d9f-8770-b03dcf7af421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:39.269502 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63859906-ba42-4d9f-8770-b03dcf7af421 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.156314 Sep 10 11:33:39.270101 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4440/6563] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:39 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:40.345532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e68c0e86-cf26-4f05-9c53-dc22da28e2d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:40.346151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e68c0e86-cf26-4f05-9c53-dc22da28e2d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:40.352072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e68c0e86-cf26-4f05-9c53-dc22da28e2d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:40.352560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e68c0e86-cf26-4f05-9c53-dc22da28e2d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:40.352998 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e68c0e86-cf26-4f05-9c53-dc22da28e2d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:40.353711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e68c0e86-cf26-4f05-9c53-dc22da28e2d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:40.354170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e68c0e86-cf26-4f05-9c53-dc22da28e2d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:40.354593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e68c0e86-cf26-4f05-9c53-dc22da28e2d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:40.479681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e68c0e86-cf26-4f05-9c53-dc22da28e2d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:40.488103 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e68c0e86-cf26-4f05-9c53-dc22da28e2d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.199517 Sep 10 11:33:40.488683 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2124/6564] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:40 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:33:41.510945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80e158b0-07fe-456f-91fb-cd4c96bb0be7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:41.511581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80e158b0-07fe-456f-91fb-cd4c96bb0be7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:41.514384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=31 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:33:41.520383 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e158b0-07fe-456f-91fb-cd4c96bb0be7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:41.520891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e158b0-07fe-456f-91fb-cd4c96bb0be7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:41.521374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e158b0-07fe-456f-91fb-cd4c96bb0be7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:41.522086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e158b0-07fe-456f-91fb-cd4c96bb0be7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:41.522558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e158b0-07fe-456f-91fb-cd4c96bb0be7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:41.523002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80e158b0-07fe-456f-91fb-cd4c96bb0be7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:41.527172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:33:41.659483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-80e158b0-07fe-456f-91fb-cd4c96bb0be7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:41.668020 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80e158b0-07fe-456f-91fb-cd4c96bb0be7 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.160999 Sep 10 11:33:41.681094 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4441/6565] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:41 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:42.692916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-471a7850-4f5f-4446-b3f9-4937d17ce106 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:42.693573 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-471a7850-4f5f-4446-b3f9-4937d17ce106 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:42.696027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=27 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:33:42.701470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-471a7850-4f5f-4446-b3f9-4937d17ce106 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:42.701980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-471a7850-4f5f-4446-b3f9-4937d17ce106 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:42.702454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-471a7850-4f5f-4446-b3f9-4937d17ce106 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:42.703188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-471a7850-4f5f-4446-b3f9-4937d17ce106 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:42.703644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-471a7850-4f5f-4446-b3f9-4937d17ce106 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:42.704071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-471a7850-4f5f-4446-b3f9-4937d17ce106 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:42.710038 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=79 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:33:42.886963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-471a7850-4f5f-4446-b3f9-4937d17ce106 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:42.895877 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-471a7850-4f5f-4446-b3f9-4937d17ce106 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1729 microversion: 2.1 time: 0.208047 Sep 10 11:33:42.896447 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2125/6566] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:42 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:43.573856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3e6978ae-8b64-40ac-9d0b-2690e5ed992b req-f6205d79-9122-41f6-9586-a0e85a8550d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5cd1b7-f799-416e-b126-47e9e0359180", "name": "network-vif-unplugged", "status": "completed", "tag": "17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:33:43.585202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e6978ae-8b64-40ac-9d0b-2690e5ed992b req-f6205d79-9122-41f6-9586-a0e85a8550d3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:43.585716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e6978ae-8b64-40ac-9d0b-2690e5ed992b req-f6205d79-9122-41f6-9586-a0e85a8550d3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:43.586168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3e6978ae-8b64-40ac-9d0b-2690e5ed992b req-f6205d79-9122-41f6-9586-a0e85a8550d3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:43.599197 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3e6978ae-8b64-40ac-9d0b-2690e5ed992b req-f6205d79-9122-41f6-9586-a0e85a8550d3 service nova] Creating event network-vif-unplugged:17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab for instance ef5cd1b7-f799-416e-b126-47e9e0359180 on n-h1-856894-1 Sep 10 11:33:43.604875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-3e6978ae-8b64-40ac-9d0b-2690e5ed992b req-f6205d79-9122-41f6-9586-a0e85a8550d3 service nova] Instance ef5cd1b7-f799-416e-b126-47e9e0359180 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:33:43.616919 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3e6978ae-8b64-40ac-9d0b-2690e5ed992b req-f6205d79-9122-41f6-9586-a0e85a8550d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047268 Sep 10 11:33:43.617591 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4442/6567] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:33:43.919808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c38590b4-0e42-4343-a68c-6023a226ee0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:43.920425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c38590b4-0e42-4343-a68c-6023a226ee0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:43.928426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38590b4-0e42-4343-a68c-6023a226ee0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:43.928875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38590b4-0e42-4343-a68c-6023a226ee0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:43.929345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38590b4-0e42-4343-a68c-6023a226ee0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:43.930050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38590b4-0e42-4343-a68c-6023a226ee0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:43.930507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38590b4-0e42-4343-a68c-6023a226ee0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:43.930932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c38590b4-0e42-4343-a68c-6023a226ee0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:44.146815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c38590b4-0e42-4343-a68c-6023a226ee0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:44.155349 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c38590b4-0e42-4343-a68c-6023a226ee0f tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1728 microversion: 2.1 time: 0.239375 Sep 10 11:33:44.155929 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2126/6568] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:43 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:45.181194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-001cb420-a756-483c-bee4-b52696d4ddb6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:45.181875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-001cb420-a756-483c-bee4-b52696d4ddb6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:45.188580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001cb420-a756-483c-bee4-b52696d4ddb6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:45.192704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001cb420-a756-483c-bee4-b52696d4ddb6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:45.193222 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001cb420-a756-483c-bee4-b52696d4ddb6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:45.194369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001cb420-a756-483c-bee4-b52696d4ddb6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:45.195386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001cb420-a756-483c-bee4-b52696d4ddb6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:45.196252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-001cb420-a756-483c-bee4-b52696d4ddb6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:45.331158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-001cb420-a756-483c-bee4-b52696d4ddb6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:45.339635 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-001cb420-a756-483c-bee4-b52696d4ddb6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1726 microversion: 2.1 time: 0.164187 Sep 10 11:33:45.340227 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4443/6569] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:45 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:45.657246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-d6756f04-e100-4484-9f52-1dd62f3c51bf req-6080cea4-6587-423f-b2d2-7c436ab7e463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef5cd1b7-f799-416e-b126-47e9e0359180", "tag": "17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:33:45.667844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d6756f04-e100-4484-9f52-1dd62f3c51bf req-6080cea4-6587-423f-b2d2-7c436ab7e463 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:45.668323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d6756f04-e100-4484-9f52-1dd62f3c51bf req-6080cea4-6587-423f-b2d2-7c436ab7e463 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:45.668754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d6756f04-e100-4484-9f52-1dd62f3c51bf req-6080cea4-6587-423f-b2d2-7c436ab7e463 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:45.681536 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-d6756f04-e100-4484-9f52-1dd62f3c51bf req-6080cea4-6587-423f-b2d2-7c436ab7e463 service nova] Creating event network-changed:17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab for instance ef5cd1b7-f799-416e-b126-47e9e0359180 on n-h1-856894-1 Sep 10 11:33:45.686798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-d6756f04-e100-4484-9f52-1dd62f3c51bf req-6080cea4-6587-423f-b2d2-7c436ab7e463 service nova] Instance ef5cd1b7-f799-416e-b126-47e9e0359180 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:33:45.697828 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-d6756f04-e100-4484-9f52-1dd62f3c51bf req-6080cea4-6587-423f-b2d2-7c436ab7e463 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044763 Sep 10 11:33:45.698654 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2127/6570] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:33:46.364534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d1359290-be63-445a-8703-23847e73a9a8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:46.365227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d1359290-be63-445a-8703-23847e73a9a8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:46.371934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1359290-be63-445a-8703-23847e73a9a8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:46.372438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1359290-be63-445a-8703-23847e73a9a8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:46.372894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1359290-be63-445a-8703-23847e73a9a8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:46.373638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1359290-be63-445a-8703-23847e73a9a8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:46.374114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1359290-be63-445a-8703-23847e73a9a8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:46.374566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d1359290-be63-445a-8703-23847e73a9a8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:46.508607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d1359290-be63-445a-8703-23847e73a9a8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:46.517763 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d1359290-be63-445a-8703-23847e73a9a8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1726 microversion: 2.1 time: 0.157183 Sep 10 11:33:46.518373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4444/6571] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:46 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:47.543078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f590d40a-db4d-4b10-a0c9-e2c1f896fe9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:47.543782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f590d40a-db4d-4b10-a0c9-e2c1f896fe9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:47.551100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f590d40a-db4d-4b10-a0c9-e2c1f896fe9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:47.551644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f590d40a-db4d-4b10-a0c9-e2c1f896fe9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:47.552084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f590d40a-db4d-4b10-a0c9-e2c1f896fe9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:47.552833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f590d40a-db4d-4b10-a0c9-e2c1f896fe9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:47.553341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f590d40a-db4d-4b10-a0c9-e2c1f896fe9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:47.553765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f590d40a-db4d-4b10-a0c9-e2c1f896fe9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:47.702674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f590d40a-db4d-4b10-a0c9-e2c1f896fe9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:47.711887 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f590d40a-db4d-4b10-a0c9-e2c1f896fe9c tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1726 microversion: 2.1 time: 0.173813 Sep 10 11:33:47.712487 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2128/6572] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:47 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:48.735257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74a87119-e12b-468a-a7eb-7ec6749108f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:48.735889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74a87119-e12b-468a-a7eb-7ec6749108f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:48.742939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a87119-e12b-468a-a7eb-7ec6749108f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:48.743466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a87119-e12b-468a-a7eb-7ec6749108f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:48.743904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a87119-e12b-468a-a7eb-7ec6749108f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:48.744609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a87119-e12b-468a-a7eb-7ec6749108f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:48.745094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a87119-e12b-468a-a7eb-7ec6749108f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:48.745541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74a87119-e12b-468a-a7eb-7ec6749108f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:48.880512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74a87119-e12b-468a-a7eb-7ec6749108f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:48.889262 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74a87119-e12b-468a-a7eb-7ec6749108f8 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1726 microversion: 2.1 time: 0.158003 Sep 10 11:33:48.889869 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4445/6573] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:48 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:49.912684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:49.913256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:49.919614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:49.920088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:49.920520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:49.921732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:49.922185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:49.922602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:49.956663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:49.957185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:49.957620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:49.958056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid ef5cd1b7-f799-416e-b126-47e9e0359180 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:33:50.066856 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:50.075330 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9ff56c8d-f7bd-46c0-91dc-506a4da4b5de tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1777 microversion: 2.1 time: 0.166777 Sep 10 11:33:50.075907 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2129/6574] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:49 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1777 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:50.103310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:50.103953 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:50.111534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:50.112042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:50.112501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:50.113247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:50.113725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:50.114174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:50.145840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:50.146343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:50.146803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:50.147269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid ef5cd1b7-f799-416e-b126-47e9e0359180 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:33:50.252428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:50.260783 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b7cf1e7-52d0-483a-a2af-e43b35f4d663 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1777 microversion: 2.1 time: 0.161362 Sep 10 11:33:50.261433 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4446/6575] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:50 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1777 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:51.283948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:51.284584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:51.290983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:51.291463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:51.291893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:51.292566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:51.293010 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:51.293451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:51.328806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:51.329231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:51.329664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:51.330105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid ef5cd1b7-f799-416e-b126-47e9e0359180 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:33:51.438307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:51.446468 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c9395208-e8a7-4524-9e15-4f4448cd60d6 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1777 microversion: 2.1 time: 0.166650 Sep 10 11:33:51.447038 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2130/6576] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:51 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1777 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:51.468853 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-26562269-7663-4eb9-83ca-7becbe340afa tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:51.469468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26562269-7663-4eb9-83ca-7becbe340afa tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:51.476296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26562269-7663-4eb9-83ca-7becbe340afa tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:51.476795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26562269-7663-4eb9-83ca-7becbe340afa tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:51.477279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26562269-7663-4eb9-83ca-7becbe340afa tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:51.477975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26562269-7663-4eb9-83ca-7becbe340afa tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:51.478445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26562269-7663-4eb9-83ca-7becbe340afa tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:51.478878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-26562269-7663-4eb9-83ca-7becbe340afa tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:51.505356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-26562269-7663-4eb9-83ca-7becbe340afa tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:33:51.583387 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-26562269-7663-4eb9-83ca-7becbe340afa tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 204 len: 0 microversion: 2.1 time: 0.117975 Sep 10 11:33:51.583997 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4447/6577] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:33:51 2022] DELETE /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:33:51.593474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:51.594094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:51.599953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:51.600435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:51.600876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:51.601587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:51.602044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:51.602478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:51.634113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:51.634665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:51.635108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:51.635552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid ef5cd1b7-f799-416e-b126-47e9e0359180 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:33:51.741452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:51.749690 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-63337a77-a0e0-4042-911c-dfa71719d309 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1783 microversion: 2.1 time: 0.161366 Sep 10 11:33:51.750287 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2131/6578] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:51 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1783 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:33:52.775504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:52.776229 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:52.783054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:52.783556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:52.784012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:52.784720 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:52.785250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:52.785758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:52.823344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:52.823854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:52.824312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:52.824945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid ef5cd1b7-f799-416e-b126-47e9e0359180 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:33:52.880497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7d09816d-ff2d-4e47-b044-6821be3c8347 req-21e6845e-d6a3-40d1-88ba-d14284716d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5cd1b7-f799-416e-b126-47e9e0359180", "name": "network-vif-deleted", "tag": "17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:33:52.891548 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:52.894345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7d09816d-ff2d-4e47-b044-6821be3c8347 req-21e6845e-d6a3-40d1-88ba-d14284716d69 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:52.897812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7d09816d-ff2d-4e47-b044-6821be3c8347 req-21e6845e-d6a3-40d1-88ba-d14284716d69 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:52.898262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7d09816d-ff2d-4e47-b044-6821be3c8347 req-21e6845e-d6a3-40d1-88ba-d14284716d69 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:52.902170 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ff5bfdb8-0344-4d63-aa12-f2b570a8920d tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1715 microversion: 2.1 time: 0.132121 Sep 10 11:33:52.905137 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4448/6579] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:52 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1715 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:52.920233 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7d09816d-ff2d-4e47-b044-6821be3c8347 req-21e6845e-d6a3-40d1-88ba-d14284716d69 service nova] Creating event network-vif-deleted:17d1dac7-5a21-4fe6-adc9-e5b9bc4472ab for instance ef5cd1b7-f799-416e-b126-47e9e0359180 on n-h1-856894-1 Sep 10 11:33:52.927265 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:52.928803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:52.931637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-7d09816d-ff2d-4e47-b044-6821be3c8347 req-21e6845e-d6a3-40d1-88ba-d14284716d69 service nova] Instance ef5cd1b7-f799-416e-b126-47e9e0359180 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:33:52.937545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:52.941381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:52.941779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:52.942525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:52.942999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:52.943445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:52.945769 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-7d09816d-ff2d-4e47-b044-6821be3c8347 req-21e6845e-d6a3-40d1-88ba-d14284716d69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124586 Sep 10 11:33:52.946615 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2132/6580] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:33:52.972050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:33:53.028587 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.compute.api [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Instance is already in deleting state, ignoring this request Sep 10 11:33:53.029721 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-387d8794-25b9-48d4-9081-0f05c5496502 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 204 len: 0 microversion: 2.1 time: 0.107345 Sep 10 11:33:53.031139 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4449/6581] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:33:52 2022] DELETE /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:33:53.040182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:53.041246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:53.047877 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:53.048741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:53.049310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:53.050104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:53.050693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:53.051337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:53.086842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:53.087332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:53.087799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:53.088252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid ef5cd1b7-f799-416e-b126-47e9e0359180 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:33:53.135509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:53.143962 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ea84f814-072e-4473-9c4d-6e4233fe5e75 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1432 microversion: 2.1 time: 0.108031 Sep 10 11:33:53.144756 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2133/6582] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:53 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1432 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:54.167584 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:54.168138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:54.176477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:54.176982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:54.177470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:54.178207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:54.178678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:54.179121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:54.218166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:54.218670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:54.219135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:54.219602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lazy-loading 'fault' on Instance uuid ef5cd1b7-f799-416e-b126-47e9e0359180 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:33:54.260630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a1365243a242b98c96ce078a850c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49ee47ccdb435ca1a4e18f32eeb5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:33:54.269057 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3882942a-9097-4323-ac78-eb444de61902 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 200 len: 1432 microversion: 2.1 time: 0.105530 Sep 10 11:33:54.269675 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4450/6583] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:33:54 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 1432 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:33:54.353572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-43ed5219-a11d-45a5-859f-e188ba03b5e3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:54.355782 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-43ed5219-a11d-45a5-859f-e188ba03b5e3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:54.363162 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43ed5219-a11d-45a5-859f-e188ba03b5e3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:54.363651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43ed5219-a11d-45a5-859f-e188ba03b5e3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:54.364090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43ed5219-a11d-45a5-859f-e188ba03b5e3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:54.365158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43ed5219-a11d-45a5-859f-e188ba03b5e3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:54.365862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43ed5219-a11d-45a5-859f-e188ba03b5e3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:54.366285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-43ed5219-a11d-45a5-859f-e188ba03b5e3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:54.397464 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-43ed5219-a11d-45a5-859f-e188ba03b5e3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047766 Sep 10 11:33:54.398037 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2134/6584] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:33:54 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:33:55.409718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d20cab2-850a-474d-9c42-349020b8e641 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:55.411990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d20cab2-850a-474d-9c42-349020b8e641 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:55.419050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d20cab2-850a-474d-9c42-349020b8e641 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:55.419557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d20cab2-850a-474d-9c42-349020b8e641 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:55.420011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d20cab2-850a-474d-9c42-349020b8e641 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:55.420728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d20cab2-850a-474d-9c42-349020b8e641 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:55.421234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d20cab2-850a-474d-9c42-349020b8e641 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:55.421678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d20cab2-850a-474d-9c42-349020b8e641 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:55.453797 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d20cab2-850a-474d-9c42-349020b8e641 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048168 Sep 10 11:33:55.454391 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4451/6585] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:33:55 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:33:56.466405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-67a7428b-4f84-4a06-9283-4a7303ba370a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:56.469100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-67a7428b-4f84-4a06-9283-4a7303ba370a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:56.478059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a7428b-4f84-4a06-9283-4a7303ba370a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:56.478540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a7428b-4f84-4a06-9283-4a7303ba370a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:56.478966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a7428b-4f84-4a06-9283-4a7303ba370a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:56.479648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a7428b-4f84-4a06-9283-4a7303ba370a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:56.480094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a7428b-4f84-4a06-9283-4a7303ba370a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:56.480515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-67a7428b-4f84-4a06-9283-4a7303ba370a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:56.509283 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-67a7428b-4f84-4a06-9283-4a7303ba370a tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046856 Sep 10 11:33:56.509846 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2135/6586] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:33:56 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:33:57.521778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:33:57.523962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:33:57.533613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:57.534107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:57.534559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:57.535250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:33:57.535717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:33:57.536155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:33:57.549529 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments HTTP/1.1 Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': 'ef5cd1b7-f799-416e-b126-47e9e0359180'} Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:33:57.551350 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e3ae657d-6792-40aa-a2a3-26b36bd20de0 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035142 Sep 10 11:33:57.555670 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4452/6587] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:33:57 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:00.876731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:00.877269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:00.886922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:00.887411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:00.887844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:00.888542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:00.888989 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:00.889977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:00.904197 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 HTTP/1.1 Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'ef5cd1b7-f799-416e-b126-47e9e0359180'} Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:00.906606 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f4f6241c-981c-4e75-8f1d-86862825f2da tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 404 len: 111 microversion: 2.1 time: 0.035126 Sep 10 11:34:00.910036 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2136/6588] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:34:00 2022] DELETE /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:00.916757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:00.917414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: ef5cd1b7-f799-416e-b126-47e9e0359180] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:00.924929 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:00.925513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:00.925979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:00.926697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:00.927175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:00.927619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:00.942150 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 HTTP/1.1 Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'ef5cd1b7-f799-416e-b126-47e9e0359180'} Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:00.943693 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.948574 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:00.948574 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:00.948574 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:00.948574 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:00.948574 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:00.948574 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. Sep 10 11:34:00.948574 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.948574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance ef5cd1b7-f799-416e-b126-47e9e0359180 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:00.948574 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9545c215-8dbc-41c1-bcf9-c91533f34b39 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180" status: 404 len: 111 microversion: 2.1 time: 0.032310 Sep 10 11:34:00.948574 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4453/6589] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:00 2022] GET /compute/v2.1/servers/ef5cd1b7-f799-416e-b126-47e9e0359180 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:00.954526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:00.955019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:00.961003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:00.961519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:00.961952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:00.962636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:00.963089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:00.963510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:00.978148 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 HTTP/1.1 Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '90e7f62b-5cfd-4f3f-bc62-8e600123baa4'} Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:00.979712 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b4f5a5ee-becc-4398-b7b4-a92b09bd6a93 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 404 len: 111 microversion: 2.1 time: 0.031035 Sep 10 11:34:00.983489 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2137/6590] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:34:00 2022] DELETE /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:34:00.989952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:00.990579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 90e7f62b-5cfd-4f3f-bc62-8e600123baa4] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:00.998156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:00.998703 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:00.999157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:00.999872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:01.000344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:01.000782 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:01.015622 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 HTTP/1.1 Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '90e7f62b-5cfd-4f3f-bc62-8e600123baa4'} Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:01.017217 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.024538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.024538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:01.024538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:01.024538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:01.024538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:01.024538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. Sep 10 11:34:01.024538 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.024538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance 90e7f62b-5cfd-4f3f-bc62-8e600123baa4 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:01.024538 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6298c8fd-71be-4ef7-beee-e78968db94ad tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4" status: 404 len: 111 microversion: 2.1 time: 0.032664 Sep 10 11:34:01.024538 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4454/6591] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:00 2022] GET /compute/v2.1/servers/90e7f62b-5cfd-4f3f-bc62-8e600123baa4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:34:01.027490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:01.027988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:01.034634 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:01.035114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:01.035551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:01.036248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:01.036681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:01.037126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:01.052765 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f HTTP/1.1 Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': 'f022a939-d6bc-4c18-846a-e0a72a85418f'} Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:01.054350 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-faab9f83-2a3b-49e2-9266-e21b6d123fc3 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 404 len: 111 microversion: 2.1 time: 0.032089 Sep 10 11:34:01.061328 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2138/6592] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:34:01 2022] DELETE /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:01.067490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:01.068307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: f022a939-d6bc-4c18-846a-e0a72a85418f] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:01.074823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:01.075328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:01.075776 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:01.076490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:01.077472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:01.077911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:01.092130 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f HTTP/1.1 Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'f022a939-d6bc-4c18-846a-e0a72a85418f'} Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:01.094358 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.098727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.098727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:01.098727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:01.098727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:01.098727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:01.098727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. Sep 10 11:34:01.098727 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.098727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance f022a939-d6bc-4c18-846a-e0a72a85418f could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:01.098727 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-32f8f203-57f0-4bb2-b476-1b4864d64af5 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f" status: 404 len: 111 microversion: 2.1 time: 0.032245 Sep 10 11:34:01.098727 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4455/6593] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:01 2022] GET /compute/v2.1/servers/f022a939-d6bc-4c18-846a-e0a72a85418f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:01.104595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:01.105202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:01.111486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:01.112127 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:01.112646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:01.113462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:01.113987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:01.114476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:01.128232 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 HTTP/1.1 Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '24aec4ea-87cc-474b-ae4c-86246f388508'} Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:01.129815 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8bb33d0e-f86b-4325-bbd9-98a626bfd4dc tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 404 len: 111 microversion: 2.1 time: 0.030440 Sep 10 11:34:01.136682 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2139/6594] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:34:01 2022] DELETE /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:01.142477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:01.143183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] [instance: 24aec4ea-87cc-474b-ae4c-86246f388508] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:01.152112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:01.152794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:01.153550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:01.154351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:01.155559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:01.156067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:01.170568 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] HTTP exception thrown: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Request method failure captured: Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 HTTP/1.1 Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHTn46DP9mrDC6VKcsXK2ffeRdSWWGNyHWs13FPftuI3lPSl7jUxzrJLmnBEU1348nzaUpjR5uV7aa_hxm44IIoh6p2G_lHp-DpzH2TnDXvBvQ_5fgbLOGLUVygp1wPghs2NZyjPu8yt-XU36k9nTX_Gc3sd-irno68Pw92MAEEFYNw Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c49ee47ccdb435ca1a4e18f32eeb5c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c49ee47ccdb435ca1a4e18f32eeb5c5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 6c49ee47ccdb435ca1a4e18f32eeb5c5 Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServerActionsTestJSON-1017597651 Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 61a1365243a242b98c96ce078a850c09 Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServerActionsTestJSON-1017597651-project Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '24aec4ea-87cc-474b-ae4c-86246f388508'} Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:01.172220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.179748 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:01.179748 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:01.179748 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:01.179748 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:01.179748 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:01.179748 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. Sep 10 11:34:01.179748 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:01.179748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Returning 404 to user: Instance 24aec4ea-87cc-474b-ae4c-86246f388508 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:01.179748 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9bbdc9b3-6e74-44d1-b299-fef8811f9863 tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508" status: 404 len: 111 microversion: 2.1 time: 0.036979 Sep 10 11:34:01.179748 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4456/6595] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:01 2022] GET /compute/v2.1/servers/24aec4ea-87cc-474b-ae4c-86246f388508 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:01.184767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8148b301-e0b7-4fc8-9c68-08fa964136ab tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] Calling method '.version_select at 0x7efcadd06160>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:01.209285 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8148b301-e0b7-4fc8-9c68-08fa964136ab tempest-ServerActionsTestJSON-1017597651 tempest-ServerActionsTestJSON-1017597651-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238555339" status: 202 len: 0 microversion: 2.1 time: 0.028978 Sep 10 11:34:01.209770 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2140/6596] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Sep 10 11:34:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238555339 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:34:10.460833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-393316226", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "f61f80db-1ac7-425f-8e22-e707e21a2995"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:10.522110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] validate_networks() for [('f61f80db-1ac7-425f-8e22-e707e21a2995', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:34:11.015307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:34:11.015759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:34:11.016258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:34:11.016885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:34:11.017350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:34:11.032478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:11.032988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:11.033484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:11.034244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:11.034754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:11.035398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:11.057219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Getting quotas for project e1466ecf86ce49be9e524585ab52f701. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:34:11.062933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Getting quotas for user e72544df731346b2b973d124d03bca10 and project e1466ecf86ce49be9e524585ab52f701. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:34:11.078097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:34:11.080429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:34:11.127841 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0e0bdad8-6ecf-4144-8486-1fb40c58cbf5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804625 Sep 10 11:34:11.128519 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4457/6597] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:34:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:34:11.140229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-45e4d8c3-93f9-4205-854a-82efa0e6d502 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:11.141651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-45e4d8c3-93f9-4205-854a-82efa0e6d502 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:11.146835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=77 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:11.208598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-45e4d8c3-93f9-4205-854a-82efa0e6d502 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:11.220076 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-45e4d8c3-93f9-4205-854a-82efa0e6d502 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1216 microversion: 2.1 time: 0.083813 Sep 10 11:34:11.221023 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2141/6598] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:11 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:12.244524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0fcb1a73-1346-4ffb-b7e7-cd8dd35dcdfa tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:12.245357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0fcb1a73-1346-4ffb-b7e7-cd8dd35dcdfa tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:12.247500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:12.254779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fcb1a73-1346-4ffb-b7e7-cd8dd35dcdfa tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:12.255280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fcb1a73-1346-4ffb-b7e7-cd8dd35dcdfa tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:12.255938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fcb1a73-1346-4ffb-b7e7-cd8dd35dcdfa tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:12.256749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fcb1a73-1346-4ffb-b7e7-cd8dd35dcdfa tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:12.257146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fcb1a73-1346-4ffb-b7e7-cd8dd35dcdfa tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:12.257587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fcb1a73-1346-4ffb-b7e7-cd8dd35dcdfa tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:12.262844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:12.326936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0fcb1a73-1346-4ffb-b7e7-cd8dd35dcdfa tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:12.334898 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0fcb1a73-1346-4ffb-b7e7-cd8dd35dcdfa tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1268 microversion: 2.1 time: 0.095545 Sep 10 11:34:12.335481 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4458/6599] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:12 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1268 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:13.358420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-310b9ff8-171c-456a-a8c0-1a623c5135a5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:13.359279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-310b9ff8-171c-456a-a8c0-1a623c5135a5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:13.364512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:13.375312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-310b9ff8-171c-456a-a8c0-1a623c5135a5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:13.375844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-310b9ff8-171c-456a-a8c0-1a623c5135a5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:13.376291 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-310b9ff8-171c-456a-a8c0-1a623c5135a5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:13.377022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-310b9ff8-171c-456a-a8c0-1a623c5135a5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:13.377546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-310b9ff8-171c-456a-a8c0-1a623c5135a5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:13.377978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-310b9ff8-171c-456a-a8c0-1a623c5135a5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:13.474837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-310b9ff8-171c-456a-a8c0-1a623c5135a5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:13.484991 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-310b9ff8-171c-456a-a8c0-1a623c5135a5 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1276 microversion: 2.1 time: 0.130979 Sep 10 11:34:13.500525 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2142/6600] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:13 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:14.508115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e462b7ce-b5dd-4b1c-a5db-9ca4a8ffcbad tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:14.508758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e462b7ce-b5dd-4b1c-a5db-9ca4a8ffcbad tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:14.515610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e462b7ce-b5dd-4b1c-a5db-9ca4a8ffcbad tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:14.516122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e462b7ce-b5dd-4b1c-a5db-9ca4a8ffcbad tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:14.516588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e462b7ce-b5dd-4b1c-a5db-9ca4a8ffcbad tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:14.517333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e462b7ce-b5dd-4b1c-a5db-9ca4a8ffcbad tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:14.517814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e462b7ce-b5dd-4b1c-a5db-9ca4a8ffcbad tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:14.518263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e462b7ce-b5dd-4b1c-a5db-9ca4a8ffcbad tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:14.658379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e462b7ce-b5dd-4b1c-a5db-9ca4a8ffcbad tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:14.667213 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e462b7ce-b5dd-4b1c-a5db-9ca4a8ffcbad tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1316 microversion: 2.1 time: 0.163056 Sep 10 11:34:14.667954 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4459/6601] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:14 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:14.752807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-2b6cf435-3d8d-4a2d-a20f-626ac1fd3a0c req-740002b4-1fe6-40a8-9632-cac1cccf9d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68650ccc-7b70-46b2-b0c2-584b6b39e2a9", "tag": "5298521d-c597-4676-a393-0293cf03b579"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:14.763964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2b6cf435-3d8d-4a2d-a20f-626ac1fd3a0c req-740002b4-1fe6-40a8-9632-cac1cccf9d96 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:14.764526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2b6cf435-3d8d-4a2d-a20f-626ac1fd3a0c req-740002b4-1fe6-40a8-9632-cac1cccf9d96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:14.765199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-2b6cf435-3d8d-4a2d-a20f-626ac1fd3a0c req-740002b4-1fe6-40a8-9632-cac1cccf9d96 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:14.777809 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-2b6cf435-3d8d-4a2d-a20f-626ac1fd3a0c req-740002b4-1fe6-40a8-9632-cac1cccf9d96 service nova] Creating event network-changed:5298521d-c597-4676-a393-0293cf03b579 for instance 68650ccc-7b70-46b2-b0c2-584b6b39e2a9 on n-h1-856894-1 Sep 10 11:34:14.783341 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-2b6cf435-3d8d-4a2d-a20f-626ac1fd3a0c req-740002b4-1fe6-40a8-9632-cac1cccf9d96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034832 Sep 10 11:34:14.784252 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2143/6602] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:34:15.692982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42c5bac9-b965-43b0-833c-fb95d7a8c89e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:15.693648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42c5bac9-b965-43b0-833c-fb95d7a8c89e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:15.700566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c5bac9-b965-43b0-833c-fb95d7a8c89e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:15.701101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c5bac9-b965-43b0-833c-fb95d7a8c89e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:15.702121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c5bac9-b965-43b0-833c-fb95d7a8c89e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:15.702830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c5bac9-b965-43b0-833c-fb95d7a8c89e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:15.703305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c5bac9-b965-43b0-833c-fb95d7a8c89e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:15.703753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42c5bac9-b965-43b0-833c-fb95d7a8c89e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:15.837895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-42c5bac9-b965-43b0-833c-fb95d7a8c89e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:15.845737 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42c5bac9-b965-43b0-833c-fb95d7a8c89e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1316 microversion: 2.1 time: 0.156794 Sep 10 11:34:15.846319 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4460/6603] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:15 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:16.870764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-275c2d18-6b29-4481-9180-369893b6d1b2 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:16.871524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-275c2d18-6b29-4481-9180-369893b6d1b2 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:16.877677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-275c2d18-6b29-4481-9180-369893b6d1b2 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:16.878170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-275c2d18-6b29-4481-9180-369893b6d1b2 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:16.878604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-275c2d18-6b29-4481-9180-369893b6d1b2 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:16.879304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-275c2d18-6b29-4481-9180-369893b6d1b2 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:16.879760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-275c2d18-6b29-4481-9180-369893b6d1b2 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:16.880186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-275c2d18-6b29-4481-9180-369893b6d1b2 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:17.011896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-275c2d18-6b29-4481-9180-369893b6d1b2 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:17.020148 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-275c2d18-6b29-4481-9180-369893b6d1b2 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1316 microversion: 2.1 time: 0.154484 Sep 10 11:34:17.020940 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2144/6604] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:16 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:18.043916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bef58a3c-b6d7-4a17-b730-2ffe3f08f669 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:18.044575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bef58a3c-b6d7-4a17-b730-2ffe3f08f669 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:18.051937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bef58a3c-b6d7-4a17-b730-2ffe3f08f669 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:18.052434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bef58a3c-b6d7-4a17-b730-2ffe3f08f669 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:18.052882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bef58a3c-b6d7-4a17-b730-2ffe3f08f669 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:18.053609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bef58a3c-b6d7-4a17-b730-2ffe3f08f669 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:18.054079 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bef58a3c-b6d7-4a17-b730-2ffe3f08f669 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:18.054516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bef58a3c-b6d7-4a17-b730-2ffe3f08f669 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:18.194405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-bef58a3c-b6d7-4a17-b730-2ffe3f08f669 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:18.202801 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bef58a3c-b6d7-4a17-b730-2ffe3f08f669 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1316 microversion: 2.1 time: 0.163003 Sep 10 11:34:18.203384 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4461/6605] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:18 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:19.225898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-13d40f8e-c911-445d-9527-21503143ae97 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:19.226841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-13d40f8e-c911-445d-9527-21503143ae97 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:19.234006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d40f8e-c911-445d-9527-21503143ae97 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:19.234529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d40f8e-c911-445d-9527-21503143ae97 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:19.234968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d40f8e-c911-445d-9527-21503143ae97 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:19.235668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d40f8e-c911-445d-9527-21503143ae97 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:19.236171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d40f8e-c911-445d-9527-21503143ae97 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:19.236599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-13d40f8e-c911-445d-9527-21503143ae97 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:19.302990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a30d92e8-e928-48cc-84ed-8ef30394812e req-d8477f28-7125-4246-8f71-eb16e59be0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68650ccc-7b70-46b2-b0c2-584b6b39e2a9", "name": "network-vif-plugged", "status": "completed", "tag": "5298521d-c597-4676-a393-0293cf03b579"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:19.312627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a30d92e8-e928-48cc-84ed-8ef30394812e req-d8477f28-7125-4246-8f71-eb16e59be0c1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:19.313153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a30d92e8-e928-48cc-84ed-8ef30394812e req-d8477f28-7125-4246-8f71-eb16e59be0c1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:19.313635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a30d92e8-e928-48cc-84ed-8ef30394812e req-d8477f28-7125-4246-8f71-eb16e59be0c1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:19.324885 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a30d92e8-e928-48cc-84ed-8ef30394812e req-d8477f28-7125-4246-8f71-eb16e59be0c1 service nova] Creating event network-vif-plugged:5298521d-c597-4676-a393-0293cf03b579 for instance 68650ccc-7b70-46b2-b0c2-584b6b39e2a9 on n-h1-856894-1 Sep 10 11:34:19.330447 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a30d92e8-e928-48cc-84ed-8ef30394812e req-d8477f28-7125-4246-8f71-eb16e59be0c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091602 Sep 10 11:34:19.331267 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4462/6606] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:34:19.377003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-13d40f8e-c911-445d-9527-21503143ae97 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:19.385021 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-13d40f8e-c911-445d-9527-21503143ae97 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1316 microversion: 2.1 time: 0.163084 Sep 10 11:34:19.385625 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2145/6607] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:19 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:20.409998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-194c93ce-fe73-4f9f-9329-d52ff5faf722 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:20.410723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-194c93ce-fe73-4f9f-9329-d52ff5faf722 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:20.417724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-194c93ce-fe73-4f9f-9329-d52ff5faf722 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:20.418220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-194c93ce-fe73-4f9f-9329-d52ff5faf722 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:20.418669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-194c93ce-fe73-4f9f-9329-d52ff5faf722 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:20.419376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-194c93ce-fe73-4f9f-9329-d52ff5faf722 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:20.419844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-194c93ce-fe73-4f9f-9329-d52ff5faf722 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:20.420285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-194c93ce-fe73-4f9f-9329-d52ff5faf722 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:20.560172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-194c93ce-fe73-4f9f-9329-d52ff5faf722 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:20.568436 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-194c93ce-fe73-4f9f-9329-d52ff5faf722 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1316 microversion: 2.1 time: 0.164078 Sep 10 11:34:20.569019 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4463/6608] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:20 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:34:21.592403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ea17263b-b8b0-4ea4-bde6-a60cf86a46a7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:21.593017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ea17263b-b8b0-4ea4-bde6-a60cf86a46a7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:21.595694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:21.601020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea17263b-b8b0-4ea4-bde6-a60cf86a46a7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:21.601534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea17263b-b8b0-4ea4-bde6-a60cf86a46a7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:21.601969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea17263b-b8b0-4ea4-bde6-a60cf86a46a7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:21.602658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea17263b-b8b0-4ea4-bde6-a60cf86a46a7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:21.603113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea17263b-b8b0-4ea4-bde6-a60cf86a46a7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:21.603535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ea17263b-b8b0-4ea4-bde6-a60cf86a46a7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:21.734437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ea17263b-b8b0-4ea4-bde6-a60cf86a46a7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:21.742136 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ea17263b-b8b0-4ea4-bde6-a60cf86a46a7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1505 microversion: 2.1 time: 0.154148 Sep 10 11:34:21.742708 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2146/6609] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:21 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:21.803583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-974293944", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "f61f80db-1ac7-425f-8e22-e707e21a2995"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:21.812274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:21.813168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:21.860895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] validate_networks() for [('f61f80db-1ac7-425f-8e22-e707e21a2995', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:34:22.228196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:34:22.228643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:34:22.229176 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:34:22.229609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:34:22.230041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:34:22.238850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:22.239350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:22.239805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:22.240547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:22.241028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:22.241503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:22.258597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Getting quotas for project e1466ecf86ce49be9e524585ab52f701. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:34:22.264795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Getting quotas for user e72544df731346b2b973d124d03bca10 and project e1466ecf86ce49be9e524585ab52f701. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:34:22.276988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:34:22.279346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:34:22.324297 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-977e7664-913a-4af8-803e-d8ddb9bd240a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524530 Sep 10 11:34:22.324965 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4464/6610] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:34:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:34:22.336290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a2f9509e-d468-4604-bb6c-903cb21c6d87 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:22.336904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a2f9509e-d468-4604-bb6c-903cb21c6d87 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:22.387819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a2f9509e-d468-4604-bb6c-903cb21c6d87 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:22.395381 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a2f9509e-d468-4604-bb6c-903cb21c6d87 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1216 microversion: 2.1 time: 0.062850 Sep 10 11:34:22.395959 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2147/6611] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:22 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1216 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:23.419210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-dddd90c8-89c2-4ffe-86b3-484b9e89e06b tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:23.421085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-dddd90c8-89c2-4ffe-86b3-484b9e89e06b tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:23.429622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dddd90c8-89c2-4ffe-86b3-484b9e89e06b tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:23.430137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dddd90c8-89c2-4ffe-86b3-484b9e89e06b tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:23.430596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dddd90c8-89c2-4ffe-86b3-484b9e89e06b tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:23.431314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dddd90c8-89c2-4ffe-86b3-484b9e89e06b tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:23.431790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dddd90c8-89c2-4ffe-86b3-484b9e89e06b tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:23.432422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-dddd90c8-89c2-4ffe-86b3-484b9e89e06b tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:23.520783 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-dddd90c8-89c2-4ffe-86b3-484b9e89e06b tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:23.535331 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-dddd90c8-89c2-4ffe-86b3-484b9e89e06b tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1276 microversion: 2.1 time: 0.121170 Sep 10 11:34:23.535941 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4465/6612] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:23 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:24.558216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d1c6ae7a-40c2-4d7d-982f-6d6541529add tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:24.558839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d1c6ae7a-40c2-4d7d-982f-6d6541529add tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:24.569207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1c6ae7a-40c2-4d7d-982f-6d6541529add tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:24.569703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1c6ae7a-40c2-4d7d-982f-6d6541529add tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:24.570142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1c6ae7a-40c2-4d7d-982f-6d6541529add tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:24.570842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1c6ae7a-40c2-4d7d-982f-6d6541529add tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:24.571301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1c6ae7a-40c2-4d7d-982f-6d6541529add tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:24.571736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1c6ae7a-40c2-4d7d-982f-6d6541529add tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:24.832646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f1b2cfc2-802a-4b00-929c-69381ae6c446 req-b7495d18-ae33-45d9-a81a-08da7852394d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "126ac6d8-acaa-49f2-8aae-42c14277bb6b", "tag": "4168f717-e87e-4172-9af8-ecd16017186e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:24.843435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f1b2cfc2-802a-4b00-929c-69381ae6c446 req-b7495d18-ae33-45d9-a81a-08da7852394d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:24.851119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f1b2cfc2-802a-4b00-929c-69381ae6c446 req-b7495d18-ae33-45d9-a81a-08da7852394d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:24.851649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f1b2cfc2-802a-4b00-929c-69381ae6c446 req-b7495d18-ae33-45d9-a81a-08da7852394d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:24.868991 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f1b2cfc2-802a-4b00-929c-69381ae6c446 req-b7495d18-ae33-45d9-a81a-08da7852394d service nova] Creating event network-changed:4168f717-e87e-4172-9af8-ecd16017186e for instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b on n-h2-856894-1 Sep 10 11:34:24.875201 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f1b2cfc2-802a-4b00-929c-69381ae6c446 req-b7495d18-ae33-45d9-a81a-08da7852394d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046495 Sep 10 11:34:24.875836 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4466/6613] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:34:24.913494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d1c6ae7a-40c2-4d7d-982f-6d6541529add tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:24.921963 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d1c6ae7a-40c2-4d7d-982f-6d6541529add tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1316 microversion: 2.1 time: 0.367604 Sep 10 11:34:24.922545 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2148/6614] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:24 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:34:25.945836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-529e1b40-5ebe-4015-be57-efa8211794c7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:25.946466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-529e1b40-5ebe-4015-be57-efa8211794c7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:25.954219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-529e1b40-5ebe-4015-be57-efa8211794c7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:25.954717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-529e1b40-5ebe-4015-be57-efa8211794c7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:25.955170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-529e1b40-5ebe-4015-be57-efa8211794c7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:25.955870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-529e1b40-5ebe-4015-be57-efa8211794c7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:25.956338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-529e1b40-5ebe-4015-be57-efa8211794c7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:25.956778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-529e1b40-5ebe-4015-be57-efa8211794c7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:26.087966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-529e1b40-5ebe-4015-be57-efa8211794c7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:26.095650 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-529e1b40-5ebe-4015-be57-efa8211794c7 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1316 microversion: 2.1 time: 0.154267 Sep 10 11:34:26.096233 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4467/6615] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:25 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:27.118309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-db2ae3f5-680a-4594-a4ae-3313db5f690e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:27.118912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-db2ae3f5-680a-4594-a4ae-3313db5f690e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:27.126263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db2ae3f5-680a-4594-a4ae-3313db5f690e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:27.126740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db2ae3f5-680a-4594-a4ae-3313db5f690e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:27.127178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db2ae3f5-680a-4594-a4ae-3313db5f690e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:27.127873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db2ae3f5-680a-4594-a4ae-3313db5f690e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:27.128325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db2ae3f5-680a-4594-a4ae-3313db5f690e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:27.128933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-db2ae3f5-680a-4594-a4ae-3313db5f690e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:27.258044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-db2ae3f5-680a-4594-a4ae-3313db5f690e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:27.266456 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-db2ae3f5-680a-4594-a4ae-3313db5f690e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1316 microversion: 2.1 time: 0.151919 Sep 10 11:34:27.266970 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2149/6616] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:27 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:28.289815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1293f3ab-04c1-4f5d-a011-04a08af26966 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:28.290453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1293f3ab-04c1-4f5d-a011-04a08af26966 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:28.297555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1293f3ab-04c1-4f5d-a011-04a08af26966 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:28.298061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1293f3ab-04c1-4f5d-a011-04a08af26966 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:28.298767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1293f3ab-04c1-4f5d-a011-04a08af26966 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:28.299472 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1293f3ab-04c1-4f5d-a011-04a08af26966 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:28.299943 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1293f3ab-04c1-4f5d-a011-04a08af26966 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:28.300385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1293f3ab-04c1-4f5d-a011-04a08af26966 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:28.426531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1293f3ab-04c1-4f5d-a011-04a08af26966 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:28.434339 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1293f3ab-04c1-4f5d-a011-04a08af26966 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1316 microversion: 2.1 time: 0.148591 Sep 10 11:34:28.434922 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4468/6617] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:28 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:29.232614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-345785ba-96d2-4e6d-b026-aac85096b5ad req-6d646513-7041-45b3-b831-bc04ea21fb71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "126ac6d8-acaa-49f2-8aae-42c14277bb6b", "name": "network-vif-plugged", "status": "completed", "tag": "4168f717-e87e-4172-9af8-ecd16017186e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:29.243223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-345785ba-96d2-4e6d-b026-aac85096b5ad req-6d646513-7041-45b3-b831-bc04ea21fb71 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:29.243703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-345785ba-96d2-4e6d-b026-aac85096b5ad req-6d646513-7041-45b3-b831-bc04ea21fb71 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:29.244131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-345785ba-96d2-4e6d-b026-aac85096b5ad req-6d646513-7041-45b3-b831-bc04ea21fb71 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:29.255163 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-345785ba-96d2-4e6d-b026-aac85096b5ad req-6d646513-7041-45b3-b831-bc04ea21fb71 service nova] Creating event network-vif-plugged:4168f717-e87e-4172-9af8-ecd16017186e for instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b on n-h2-856894-1 Sep 10 11:34:29.260061 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-345785ba-96d2-4e6d-b026-aac85096b5ad req-6d646513-7041-45b3-b831-bc04ea21fb71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031193 Sep 10 11:34:29.260989 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2150/6618] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:34:29.457748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8565db7b-6ade-4bfb-9498-82389931349a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:29.458372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8565db7b-6ade-4bfb-9498-82389931349a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:29.465311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8565db7b-6ade-4bfb-9498-82389931349a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:29.465811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8565db7b-6ade-4bfb-9498-82389931349a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:29.466288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8565db7b-6ade-4bfb-9498-82389931349a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:29.466987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8565db7b-6ade-4bfb-9498-82389931349a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:29.467452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8565db7b-6ade-4bfb-9498-82389931349a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:29.467890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8565db7b-6ade-4bfb-9498-82389931349a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:29.594451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8565db7b-6ade-4bfb-9498-82389931349a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:29.602324 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8565db7b-6ade-4bfb-9498-82389931349a tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1316 microversion: 2.1 time: 0.148718 Sep 10 11:34:29.602911 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4469/6619] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:29 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:30.625822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b0fdd1d2-6f8b-47d7-ab20-3e586b6f6457 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:30.626526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b0fdd1d2-6f8b-47d7-ab20-3e586b6f6457 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:30.632651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0fdd1d2-6f8b-47d7-ab20-3e586b6f6457 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:30.633170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0fdd1d2-6f8b-47d7-ab20-3e586b6f6457 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:30.633607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0fdd1d2-6f8b-47d7-ab20-3e586b6f6457 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:30.634290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0fdd1d2-6f8b-47d7-ab20-3e586b6f6457 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:30.634743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0fdd1d2-6f8b-47d7-ab20-3e586b6f6457 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:30.635167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0fdd1d2-6f8b-47d7-ab20-3e586b6f6457 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:30.766929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b0fdd1d2-6f8b-47d7-ab20-3e586b6f6457 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:30.774699 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b0fdd1d2-6f8b-47d7-ab20-3e586b6f6457 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1505 microversion: 2.1 time: 0.153929 Sep 10 11:34:30.775454 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2151/6620] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:30 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:30.797340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0a8f4664-a668-483f-8981-b6f1ff364b0e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:30.797859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0a8f4664-a668-483f-8981-b6f1ff364b0e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:30.805147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a8f4664-a668-483f-8981-b6f1ff364b0e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:30.805653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a8f4664-a668-483f-8981-b6f1ff364b0e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:30.806108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a8f4664-a668-483f-8981-b6f1ff364b0e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:30.806843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a8f4664-a668-483f-8981-b6f1ff364b0e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:30.807316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a8f4664-a668-483f-8981-b6f1ff364b0e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:30.807762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0a8f4664-a668-483f-8981-b6f1ff364b0e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:30.833873 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0a8f4664-a668-483f-8981-b6f1ff364b0e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:34:30.908537 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0a8f4664-a668-483f-8981-b6f1ff364b0e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "DELETE /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 204 len: 0 microversion: 2.1 time: 0.114792 Sep 10 11:34:30.909138 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4470/6621] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:34:30 2022] DELETE /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:34:30.917707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-33f17050-a543-4c37-9550-eec51c2baf9c tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:30.918359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-33f17050-a543-4c37-9550-eec51c2baf9c tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:30.924799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f17050-a543-4c37-9550-eec51c2baf9c tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:30.925329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f17050-a543-4c37-9550-eec51c2baf9c tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:30.925768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f17050-a543-4c37-9550-eec51c2baf9c tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:30.926463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f17050-a543-4c37-9550-eec51c2baf9c tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:30.926924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f17050-a543-4c37-9550-eec51c2baf9c tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:30.927352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-33f17050-a543-4c37-9550-eec51c2baf9c tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:31.054889 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-33f17050-a543-4c37-9550-eec51c2baf9c tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:31.063030 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-33f17050-a543-4c37-9550-eec51c2baf9c tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1511 microversion: 2.1 time: 0.149205 Sep 10 11:34:31.063604 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2152/6622] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:30 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:32.088327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5860c4e4-8482-441b-adfb-da00ab588e81 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:32.089050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5860c4e4-8482-441b-adfb-da00ab588e81 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:32.096503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5860c4e4-8482-441b-adfb-da00ab588e81 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:32.097034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5860c4e4-8482-441b-adfb-da00ab588e81 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:32.097521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5860c4e4-8482-441b-adfb-da00ab588e81 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:32.098233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5860c4e4-8482-441b-adfb-da00ab588e81 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:32.098687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5860c4e4-8482-441b-adfb-da00ab588e81 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:32.099123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5860c4e4-8482-441b-adfb-da00ab588e81 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:32.233770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5860c4e4-8482-441b-adfb-da00ab588e81 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:32.241616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5860c4e4-8482-441b-adfb-da00ab588e81 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1511 microversion: 2.1 time: 0.157662 Sep 10 11:34:32.242193 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4471/6623] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:32 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:32.753567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-5fbb845f-1923-461c-9427-cc9d8bde8297 req-34033411-6221-429b-8b9b-d102751293ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "126ac6d8-acaa-49f2-8aae-42c14277bb6b", "name": "network-vif-deleted", "tag": "4168f717-e87e-4172-9af8-ecd16017186e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:32.768793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:32.771813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5fbb845f-1923-461c-9427-cc9d8bde8297 req-34033411-6221-429b-8b9b-d102751293ab service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:32.772330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5fbb845f-1923-461c-9427-cc9d8bde8297 req-34033411-6221-429b-8b9b-d102751293ab service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:32.772716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5fbb845f-1923-461c-9427-cc9d8bde8297 req-34033411-6221-429b-8b9b-d102751293ab service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:32.786493 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-5fbb845f-1923-461c-9427-cc9d8bde8297 req-34033411-6221-429b-8b9b-d102751293ab service nova] Creating event network-vif-deleted:4168f717-e87e-4172-9af8-ecd16017186e for instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b on n-h2-856894-1 Sep 10 11:34:32.793868 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-5fbb845f-1923-461c-9427-cc9d8bde8297 req-34033411-6221-429b-8b9b-d102751293ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051003 Sep 10 11:34:32.795013 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2153/6624] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:34:33.264206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:33.265087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:33.267155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:33.267962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:33.275389 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:33.275895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:33.276520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:33.277367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:33.277957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:33.278407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:33.315407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:33.315909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:33.316367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:33.316836 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lazy-loading 'fault' on Instance uuid 126ac6d8-acaa-49f2-8aae-42c14277bb6b {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:34:33.360769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:33.368211 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b11bb3a-90e2-4a1a-8e1d-d980a2d6b352 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 200 len: 1306 microversion: 2.1 time: 0.108396 Sep 10 11:34:33.368852 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4472/6625] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:33 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:34.392111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:34.392815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:34.399040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:34.399523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:34.399990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:34.400673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:34.401152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:34.401577 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:34.414693 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] HTTP exception thrown: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Request method failure captured: Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b HTTP/1.1 Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHYyclVOqnkusTu3fjveMd_YXi7vWXUhkRenlWQgULcSGlvmdCekE7y6fIfPaWt_-eHNwwBMmDoyCzNEwDocIwdCeuY4wQ2Z0UqmB1FqCxuzOUVl3Tn-v65ahRZlieGbBVb3OIKqg-7IiU6krvM3SLD53PvezItNzvaPrTahFow8kAk Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1466ecf86ce49be9e524585ab52f701", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e72544df731346b2b973d124d03bca10 Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '126ac6d8-acaa-49f2-8aae-42c14277bb6b'} Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:34.416288 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:34.421199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:34.421199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:34.421199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:34.421199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:34.421199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:34.421199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:34.421199 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:34.421199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Returning 404 to user: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:34.421199 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d1648fd4-ad46-4019-ab80-8d45bbcfb8bb tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 404 len: 111 microversion: 2.1 time: 0.030689 Sep 10 11:34:34.421199 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2154/6626] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:34 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:34.427682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66be1495-91e1-4ded-8b94-7c59e2ab3f80 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:34.428318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-66be1495-91e1-4ded-8b94-7c59e2ab3f80 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:34.436356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66be1495-91e1-4ded-8b94-7c59e2ab3f80 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:34.437055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66be1495-91e1-4ded-8b94-7c59e2ab3f80 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:34.437538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66be1495-91e1-4ded-8b94-7c59e2ab3f80 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:34.438252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66be1495-91e1-4ded-8b94-7c59e2ab3f80 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:34.438732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66be1495-91e1-4ded-8b94-7c59e2ab3f80 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:34.439218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-66be1495-91e1-4ded-8b94-7c59e2ab3f80 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:34.572627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-66be1495-91e1-4ded-8b94-7c59e2ab3f80 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:34.580440 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66be1495-91e1-4ded-8b94-7c59e2ab3f80 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1505 microversion: 2.1 time: 0.156917 Sep 10 11:34:34.581017 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4473/6627] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:34 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:34.602849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5721c565-2cd1-4df7-834e-103e893b060e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:34.605847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5721c565-2cd1-4df7-834e-103e893b060e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 0dca3e17-ceed-432f-816d-753b7c4c7ce8] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:34.611875 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-5721c565-2cd1-4df7-834e-103e893b060e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] HTTP exception thrown: Instance 0dca3e17-ceed-432f-816d-753b7c4c7ce8 could not be found. Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5721c565-2cd1-4df7-834e-103e893b060e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Request method failure captured: Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/0dca3e17-ceed-432f-816d-753b7c4c7ce8/action HTTP/1.1 Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 32 Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHYyclVOqnkusTu3fjveMd_YXi7vWXUhkRenlWQgULcSGlvmdCekE7y6fIfPaWt_-eHNwwBMmDoyCzNEwDocIwdCeuY4wQ2Z0UqmB1FqCxuzOUVl3Tn-v65ahRZlieGbBVb3OIKqg-7IiU6krvM3SLD53PvezItNzvaPrTahFow8kAk Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1466ecf86ce49be9e524585ab52f701", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e72544df731346b2b973d124d03bca10 Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: {"resize": {"flavorRef": "452"}} Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 0dca3e17-ceed-432f-816d-753b7c4c7ce8 could not be found. Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '0dca3e17-ceed-432f-816d-753b7c4c7ce8', 'body': {'resize': {'flavorRef': '452'}}} Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dca3e17-ceed-432f-816d-753b7c4c7ce8 could not be found. Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:34.613453 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dca3e17-ceed-432f-816d-753b7c4c7ce8 could not be found. Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dca3e17-ceed-432f-816d-753b7c4c7ce8 could not be found. Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5721c565-2cd1-4df7-834e-103e893b060e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Returning 404 to user: Instance 0dca3e17-ceed-432f-816d-753b7c4c7ce8 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5721c565-2cd1-4df7-834e-103e893b060e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "POST /compute/v2.1/servers/0dca3e17-ceed-432f-816d-753b7c4c7ce8/action" status: 404 len: 111 microversion: 2.1 time: 0.016129 Sep 10 11:34:34.617909 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2155/6628] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:34:34 2022] POST /compute/v2.1/servers/0dca3e17-ceed-432f-816d-753b7c4c7ce8/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:34.623956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e0d1444a-e64b-4f04-a982-c50b0b740558 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:34.624613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e0d1444a-e64b-4f04-a982-c50b0b740558 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:34.630520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1444a-e64b-4f04-a982-c50b0b740558 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:34.631014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1444a-e64b-4f04-a982-c50b0b740558 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:34.631461 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1444a-e64b-4f04-a982-c50b0b740558 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:34.632160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1444a-e64b-4f04-a982-c50b0b740558 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:34.632623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1444a-e64b-4f04-a982-c50b0b740558 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:34.633059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e0d1444a-e64b-4f04-a982-c50b0b740558 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:34.763508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e0d1444a-e64b-4f04-a982-c50b0b740558 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:34.765846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:34:34.773200 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e0d1444a-e64b-4f04-a982-c50b0b740558 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1505 microversion: 2.1 time: 0.153615 Sep 10 11:34:34.773799 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4474/6629] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:34 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:34.796433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-42aedd99-b31f-4442-8cb2-d621ac94c661 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:34.797039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-42aedd99-b31f-4442-8cb2-d621ac94c661 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:34.804074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42aedd99-b31f-4442-8cb2-d621ac94c661 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:34.804551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42aedd99-b31f-4442-8cb2-d621ac94c661 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:34.804983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42aedd99-b31f-4442-8cb2-d621ac94c661 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:34.805685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42aedd99-b31f-4442-8cb2-d621ac94c661 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:34.806136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42aedd99-b31f-4442-8cb2-d621ac94c661 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:34.806556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-42aedd99-b31f-4442-8cb2-d621ac94c661 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:34.936593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-42aedd99-b31f-4442-8cb2-d621ac94c661 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:34.944331 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-42aedd99-b31f-4442-8cb2-d621ac94c661 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1505 microversion: 2.1 time: 0.151779 Sep 10 11:34:34.944832 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2156/6630] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:34 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:34.967424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "f8cd953f-cc8b-474f-b370-7b2c09c37cc1"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:34.969883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:34.976893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:34.977431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:34.977894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:34.978603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:34.979081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:34.979528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.008312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:35.013890 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] HTTP exception thrown: Flavor f8cd953f-cc8b-474f-b370-7b2c09c37cc1 could not be found. Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Request method failure captured: Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: request: POST /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9/action HTTP/1.1 Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 65 Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHYyclVOqnkusTu3fjveMd_YXi7vWXUhkRenlWQgULcSGlvmdCekE7y6fIfPaWt_-eHNwwBMmDoyCzNEwDocIwdCeuY4wQ2Z0UqmB1FqCxuzOUVl3Tn-v65ahRZlieGbBVb3OIKqg-7IiU6krvM3SLD53PvezItNzvaPrTahFow8kAk Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1466ecf86ce49be9e524585ab52f701", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e72544df731346b2b973d124d03bca10 Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: {"resize": {"flavorRef": "f8cd953f-cc8b-474f-b370-7b2c09c37cc1"}} Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: exception: Flavor f8cd953f-cc8b-474f-b370-7b2c09c37cc1 could not be found. Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '68650ccc-7b70-46b2-b0c2-584b6b39e2a9', 'body': {'resize': {'flavorRef': 'f8cd953f-cc8b-474f-b370-7b2c09c37cc1'}}} Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:35.016215 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f8cd953f-cc8b-474f-b370-7b2c09c37cc1 could not be found. Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor f8cd953f-cc8b-474f-b370-7b2c09c37cc1 could not be found. Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f8cd953f-cc8b-474f-b370-7b2c09c37cc1 could not be found. Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Returning 400 to user: Flavor f8cd953f-cc8b-474f-b370-7b2c09c37cc1 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a9237fa-40e6-4ece-9ca4-9a2761beb4df tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "POST /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9/action" status: 400 len: 107 microversion: 2.1 time: 0.055150 Sep 10 11:34:35.020508 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4475/6631] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:34:34 2022] POST /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9/action => generated 107 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:34:35.026364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6424384e-ff03-40f1-ae21-f7e05842a81d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:35.026985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6424384e-ff03-40f1-ae21-f7e05842a81d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:35.033544 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6424384e-ff03-40f1-ae21-f7e05842a81d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.034025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6424384e-ff03-40f1-ae21-f7e05842a81d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.034465 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6424384e-ff03-40f1-ae21-f7e05842a81d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.035152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6424384e-ff03-40f1-ae21-f7e05842a81d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.035609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6424384e-ff03-40f1-ae21-f7e05842a81d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.036033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6424384e-ff03-40f1-ae21-f7e05842a81d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.167576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6424384e-ff03-40f1-ae21-f7e05842a81d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:35.179369 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6424384e-ff03-40f1-ae21-f7e05842a81d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1505 microversion: 2.1 time: 0.156776 Sep 10 11:34:35.179965 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2157/6632] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:35 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:35.203824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56adf4a3-d757-49eb-9262-c1e2c921e913 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:35.204405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56adf4a3-d757-49eb-9262-c1e2c921e913 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:35.214364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56adf4a3-d757-49eb-9262-c1e2c921e913 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.214876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56adf4a3-d757-49eb-9262-c1e2c921e913 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.215702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56adf4a3-d757-49eb-9262-c1e2c921e913 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.217490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56adf4a3-d757-49eb-9262-c1e2c921e913 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.217970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56adf4a3-d757-49eb-9262-c1e2c921e913 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.218419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56adf4a3-d757-49eb-9262-c1e2c921e913 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.347667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56adf4a3-d757-49eb-9262-c1e2c921e913 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:35.355630 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56adf4a3-d757-49eb-9262-c1e2c921e913 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1505 microversion: 2.1 time: 0.156656 Sep 10 11:34:35.356230 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4476/6633] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:35 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:35.378099 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0798be54-d42b-46be-a2a8-1e23b5ea5198 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0798be54-d42b-46be-a2a8-1e23b5ea5198 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Request method failure captured: Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: request: POST /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9/action HTTP/1.1 Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 29 Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHYyclVOqnkusTu3fjveMd_YXi7vWXUhkRenlWQgULcSGlvmdCekE7y6fIfPaWt_-eHNwwBMmDoyCzNEwDocIwdCeuY4wQ2Z0UqmB1FqCxuzOUVl3Tn-v65ahRZlieGbBVb3OIKqg-7IiU6krvM3SLD53PvezItNzvaPrTahFow8kAk Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1466ecf86ce49be9e524585ab52f701", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e72544df731346b2b973d124d03bca10 Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: {"resize": {"flavorRef": ""}} Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '68650ccc-7b70-46b2-b0c2-584b6b39e2a9', 'body': {'resize': {'flavorRef': ''}}} Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi '' Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.382016 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0798be54-d42b-46be-a2a8-1e23b5ea5198 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0798be54-d42b-46be-a2a8-1e23b5ea5198 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "POST /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9/action" status: 400 len: 113 microversion: 2.1 time: 0.009592 Sep 10 11:34:35.386197 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2158/6634] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:34:35 2022] POST /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 11:34:35.393226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5803830a-bbfd-4826-85c2-347bc1881e5e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:35.393876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5803830a-bbfd-4826-85c2-347bc1881e5e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:35.399915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5803830a-bbfd-4826-85c2-347bc1881e5e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.400418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5803830a-bbfd-4826-85c2-347bc1881e5e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.400870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5803830a-bbfd-4826-85c2-347bc1881e5e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.401604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5803830a-bbfd-4826-85c2-347bc1881e5e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.402080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5803830a-bbfd-4826-85c2-347bc1881e5e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.402522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5803830a-bbfd-4826-85c2-347bc1881e5e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.542379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5803830a-bbfd-4826-85c2-347bc1881e5e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:35.550556 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5803830a-bbfd-4826-85c2-347bc1881e5e tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1505 microversion: 2.1 time: 0.162114 Sep 10 11:34:35.551139 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4477/6635] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:35 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:35.579017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:35.579541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:35.586508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.586988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.587420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.588107 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.588560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.588987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.601963 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] HTTP exception thrown: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Request method failure captured: Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b HTTP/1.1 Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHYyclVOqnkusTu3fjveMd_YXi7vWXUhkRenlWQgULcSGlvmdCekE7y6fIfPaWt_-eHNwwBMmDoyCzNEwDocIwdCeuY4wQ2Z0UqmB1FqCxuzOUVl3Tn-v65ahRZlieGbBVb3OIKqg-7IiU6krvM3SLD53PvezItNzvaPrTahFow8kAk Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1466ecf86ce49be9e524585ab52f701", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e72544df731346b2b973d124d03bca10 Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '126ac6d8-acaa-49f2-8aae-42c14277bb6b'} Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:35.603495 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Returning 404 to user: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-19d2bc14-239f-4d5f-8e2e-f5d7031a9a53 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "DELETE /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 404 len: 111 microversion: 2.1 time: 0.031245 Sep 10 11:34:35.607565 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2159/6636] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:34:35 2022] DELETE /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:35.613449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:35.614088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 126ac6d8-acaa-49f2-8aae-42c14277bb6b] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:35.620030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.620532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.620986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.621733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.622203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.623218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.639734 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] HTTP exception thrown: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Request method failure captured: Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b HTTP/1.1 Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHYyclVOqnkusTu3fjveMd_YXi7vWXUhkRenlWQgULcSGlvmdCekE7y6fIfPaWt_-eHNwwBMmDoyCzNEwDocIwdCeuY4wQ2Z0UqmB1FqCxuzOUVl3Tn-v65ahRZlieGbBVb3OIKqg-7IiU6krvM3SLD53PvezItNzvaPrTahFow8kAk Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1466ecf86ce49be9e524585ab52f701", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e72544df731346b2b973d124d03bca10 Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '126ac6d8-acaa-49f2-8aae-42c14277bb6b'} Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:35.641330 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.646087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:35.646087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:35.646087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:35.646087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:35.646087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:35.646087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. Sep 10 11:34:35.646087 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:34:35.646087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Returning 404 to user: Instance 126ac6d8-acaa-49f2-8aae-42c14277bb6b could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:35.646087 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-efc07ab2-37c4-4b91-b322-42d983f49931 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b" status: 404 len: 111 microversion: 2.1 time: 0.033324 Sep 10 11:34:35.646087 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4478/6637] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:35 2022] GET /compute/v2.1/servers/126ac6d8-acaa-49f2-8aae-42c14277bb6b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:34:35.651182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-36fef958-84ed-4694-a127-230f665d5ee8 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:35.651685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-36fef958-84ed-4694-a127-230f665d5ee8 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:35.657613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fef958-84ed-4694-a127-230f665d5ee8 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.658092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fef958-84ed-4694-a127-230f665d5ee8 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.658530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fef958-84ed-4694-a127-230f665d5ee8 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.659209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fef958-84ed-4694-a127-230f665d5ee8 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.659656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fef958-84ed-4694-a127-230f665d5ee8 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.660076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-36fef958-84ed-4694-a127-230f665d5ee8 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.685556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-36fef958-84ed-4694-a127-230f665d5ee8 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:34:35.758994 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-36fef958-84ed-4694-a127-230f665d5ee8 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "DELETE /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 204 len: 0 microversion: 2.1 time: 0.111355 Sep 10 11:34:35.759617 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2160/6638] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:34:35 2022] DELETE /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:34:35.768815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fbd67b5e-de0d-41c8-bdb5-38adda42839d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:35.769490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fbd67b5e-de0d-41c8-bdb5-38adda42839d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:35.776161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbd67b5e-de0d-41c8-bdb5-38adda42839d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.776666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbd67b5e-de0d-41c8-bdb5-38adda42839d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.777185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbd67b5e-de0d-41c8-bdb5-38adda42839d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.777906 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbd67b5e-de0d-41c8-bdb5-38adda42839d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:35.778386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbd67b5e-de0d-41c8-bdb5-38adda42839d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:35.778832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fbd67b5e-de0d-41c8-bdb5-38adda42839d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:35.906511 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fbd67b5e-de0d-41c8-bdb5-38adda42839d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:35.914244 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fbd67b5e-de0d-41c8-bdb5-38adda42839d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1511 microversion: 2.1 time: 0.149361 Sep 10 11:34:35.914830 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4479/6639] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:35 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:34:36.938880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5c7b45f6-98ce-4232-ae78-632e0b744a57 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:36.939536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5c7b45f6-98ce-4232-ae78-632e0b744a57 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:36.946242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c7b45f6-98ce-4232-ae78-632e0b744a57 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:36.946729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c7b45f6-98ce-4232-ae78-632e0b744a57 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:36.947168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c7b45f6-98ce-4232-ae78-632e0b744a57 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:36.947858 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c7b45f6-98ce-4232-ae78-632e0b744a57 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:36.948315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c7b45f6-98ce-4232-ae78-632e0b744a57 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:36.948741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5c7b45f6-98ce-4232-ae78-632e0b744a57 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:37.081970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5c7b45f6-98ce-4232-ae78-632e0b744a57 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72544df731346b2b973d124d03bca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1466ecf86ce49be9e524585ab52f701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:34:37.089737 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5c7b45f6-98ce-4232-ae78-632e0b744a57 tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 200 len: 1511 microversion: 2.1 time: 0.155258 Sep 10 11:34:37.090314 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2161/6640] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:36 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:34:37.560927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c03a1609-3109-4ad2-b5c6-566d431a91c7 req-12c6fba9-808f-49ea-8e48-3c3ce5ea74b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68650ccc-7b70-46b2-b0c2-584b6b39e2a9", "name": "network-vif-deleted", "tag": "5298521d-c597-4676-a393-0293cf03b579"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:34:37.576298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c03a1609-3109-4ad2-b5c6-566d431a91c7 req-12c6fba9-808f-49ea-8e48-3c3ce5ea74b7 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:37.576801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c03a1609-3109-4ad2-b5c6-566d431a91c7 req-12c6fba9-808f-49ea-8e48-3c3ce5ea74b7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:37.577279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c03a1609-3109-4ad2-b5c6-566d431a91c7 req-12c6fba9-808f-49ea-8e48-3c3ce5ea74b7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:37.592830 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c03a1609-3109-4ad2-b5c6-566d431a91c7 req-12c6fba9-808f-49ea-8e48-3c3ce5ea74b7 service nova] Creating event network-vif-deleted:5298521d-c597-4676-a393-0293cf03b579 for instance 68650ccc-7b70-46b2-b0c2-584b6b39e2a9 on n-h1-856894-1 Sep 10 11:34:37.599154 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c03a1609-3109-4ad2-b5c6-566d431a91c7 req-12c6fba9-808f-49ea-8e48-3c3ce5ea74b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041931 Sep 10 11:34:37.600627 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4480/6641] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:34:38.113004 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:34:38.113654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] [instance: 68650ccc-7b70-46b2-b0c2-584b6b39e2a9] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:34:38.120415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:38.120925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:38.121398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:38.122089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:34:38.122567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:34:38.122993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:34:38.136103 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] HTTP exception thrown: Instance 68650ccc-7b70-46b2-b0c2-584b6b39e2a9 could not be found. Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Request method failure captured: Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 HTTP/1.1 Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHYyclVOqnkusTu3fjveMd_YXi7vWXUhkRenlWQgULcSGlvmdCekE7y6fIfPaWt_-eHNwwBMmDoyCzNEwDocIwdCeuY4wQ2Z0UqmB1FqCxuzOUVl3Tn-v65ahRZlieGbBVb3OIKqg-7IiU6krvM3SLD53PvezItNzvaPrTahFow8kAk Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e1466ecf86ce49be9e524585ab52f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e1466ecf86ce49be9e524585ab52f701", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: e1466ecf86ce49be9e524585ab52f701 Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-ServersNegativeTestJSON-926060025 Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e72544df731346b2b973d124d03bca10 Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-ServersNegativeTestJSON-926060025-project Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 68650ccc-7b70-46b2-b0c2-584b6b39e2a9 could not be found. Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '68650ccc-7b70-46b2-b0c2-584b6b39e2a9'} Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68650ccc-7b70-46b2-b0c2-584b6b39e2a9 could not be found. Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68650ccc-7b70-46b2-b0c2-584b6b39e2a9 could not be found. Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:34:38.137763 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:38.142429 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:34:38.142429 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:34:38.142429 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:34:38.142429 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:34:38.142429 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:34:38.142429 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68650ccc-7b70-46b2-b0c2-584b6b39e2a9 could not be found. Sep 10 11:34:38.142429 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:34:38.142429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] Returning 404 to user: Instance 68650ccc-7b70-46b2-b0c2-584b6b39e2a9 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:34:38.142429 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c7869689-54d8-446d-a9d9-2e10f766dd2d tempest-ServersNegativeTestJSON-926060025 tempest-ServersNegativeTestJSON-926060025-project] 10.222.0.20 "GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9" status: 404 len: 111 microversion: 2.1 time: 0.030605 Sep 10 11:34:38.142429 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2162/6642] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:34:38 2022] GET /compute/v2.1/servers/68650ccc-7b70-46b2-b0c2-584b6b39e2a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:35:08.738112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:08.738895 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=27 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:09.042205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3ccbc25c-5acf-4b61-b760-66dcf7aad663 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Action: 'create', calling method: .version_select at 0x7efcad3f3ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2023943203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjMWJNE4zY+eaWd6TDz2Np2n/1oEA6g+q6B/3zfxgpZpvavWTS64WW0COPNegdgdL/kos4YgDlATpf3mUVnin5g43b3vPoZmQYkkQ6f4s8T5QH04WvxIP1SLBFiD30QPg=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:09.059091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3ccbc25c-5acf-4b61-b760-66dcf7aad663 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for project af4a2e663a2d498a84167de9da44aab3. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:35:09.065566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-3ccbc25c-5acf-4b61-b760-66dcf7aad663 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for user e8b6f3ef572043bb8ec58db5503a546c and project af4a2e663a2d498a84167de9da44aab3. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:35:09.099808 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3ccbc25c-5acf-4b61-b760-66dcf7aad663 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.363965 Sep 10 11:35:09.111149 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4481/6643] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:35:08 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:09.161525 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-403377774", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2023943203", "networks": [{"uuid": "343eba61-d3c6-4c39-a19a-3c8f30658d43"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:09.173516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:09.175361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:09.176473 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:35:09.176689 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 11:35:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 11:35:09.238974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] validate_networks() for [('343eba61-d3c6-4c39-a19a-3c8f30658d43', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:35:09.782787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:35:09.783209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:35:09.783709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:35:09.784116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:35:09.784523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:35:09.794023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:09.794501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:09.794929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:09.795643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:09.796089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:09.796541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:09.816097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for project af4a2e663a2d498a84167de9da44aab3. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:35:09.821332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for user e8b6f3ef572043bb8ec58db5503a546c and project af4a2e663a2d498a84167de9da44aab3. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:35:09.835546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:35:09.837888 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:35:09.885421 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-86c0d93d-e84c-4602-af3f-a360461a0de2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732640 Sep 10 11:35:09.886078 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2163/6644] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:35:09.898505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5f49a1c9-bd68-4a8c-9cfd-71077cc696e2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:09.899253 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5f49a1c9-bd68-4a8c-9cfd-71077cc696e2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:09.958623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5f49a1c9-bd68-4a8c-9cfd-71077cc696e2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:09.966773 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5f49a1c9-bd68-4a8c-9cfd-71077cc696e2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1262 microversion: 2.1 time: 0.072947 Sep 10 11:35:09.967348 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4482/6645] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:09 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:10.990733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a3425dd8-887e-42e9-8083-cb462d91771e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:10.991402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a3425dd8-887e-42e9-8083-cb462d91771e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:10.999171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3425dd8-887e-42e9-8083-cb462d91771e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:10.999731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3425dd8-887e-42e9-8083-cb462d91771e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:11.000177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3425dd8-887e-42e9-8083-cb462d91771e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:11.001220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3425dd8-887e-42e9-8083-cb462d91771e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:11.001564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3425dd8-887e-42e9-8083-cb462d91771e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:11.001999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a3425dd8-887e-42e9-8083-cb462d91771e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:11.081063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a3425dd8-887e-42e9-8083-cb462d91771e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:11.092096 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a3425dd8-887e-42e9-8083-cb462d91771e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1322 microversion: 2.1 time: 0.106351 Sep 10 11:35:11.093599 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2164/6646] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:10 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1322 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:12.118362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-41c4e13a-230c-4b67-954c-7df77957f341 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:12.119279 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-41c4e13a-230c-4b67-954c-7df77957f341 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:12.129502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41c4e13a-230c-4b67-954c-7df77957f341 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:12.130026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41c4e13a-230c-4b67-954c-7df77957f341 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:12.130496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41c4e13a-230c-4b67-954c-7df77957f341 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:12.131221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41c4e13a-230c-4b67-954c-7df77957f341 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:12.131869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41c4e13a-230c-4b67-954c-7df77957f341 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:12.132484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-41c4e13a-230c-4b67-954c-7df77957f341 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:12.288406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-41c4e13a-230c-4b67-954c-7df77957f341 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:12.296711 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-41c4e13a-230c-4b67-954c-7df77957f341 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1362 microversion: 2.1 time: 0.182385 Sep 10 11:35:12.299088 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4483/6647] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:12 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:12.462098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-227c1b2f-6df7-40a9-be4e-ce640336c555 req-97428b53-e01e-4ce4-bdd9-9c3a22d0fc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "199d8f32-7081-4cde-a8a5-c9f9e2f3c883", "tag": "7e0d1e38-b14d-4551-bfc4-c7cef00c8a75"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:12.481890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-227c1b2f-6df7-40a9-be4e-ce640336c555 req-97428b53-e01e-4ce4-bdd9-9c3a22d0fc0b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:12.483253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-227c1b2f-6df7-40a9-be4e-ce640336c555 req-97428b53-e01e-4ce4-bdd9-9c3a22d0fc0b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:12.483763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-227c1b2f-6df7-40a9-be4e-ce640336c555 req-97428b53-e01e-4ce4-bdd9-9c3a22d0fc0b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:12.496402 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-227c1b2f-6df7-40a9-be4e-ce640336c555 req-97428b53-e01e-4ce4-bdd9-9c3a22d0fc0b service nova] Creating event network-changed:7e0d1e38-b14d-4551-bfc4-c7cef00c8a75 for instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 on n-h1-856894-1 Sep 10 11:35:12.507450 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-227c1b2f-6df7-40a9-be4e-ce640336c555 req-97428b53-e01e-4ce4-bdd9-9c3a22d0fc0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050158 Sep 10 11:35:12.510024 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2165/6648] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:13.321683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db9cd29d-49ae-4179-a128-c2bb51d9becd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:13.322319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db9cd29d-49ae-4179-a128-c2bb51d9becd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:13.329845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9cd29d-49ae-4179-a128-c2bb51d9becd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:13.330351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9cd29d-49ae-4179-a128-c2bb51d9becd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:13.330802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9cd29d-49ae-4179-a128-c2bb51d9becd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:13.331539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9cd29d-49ae-4179-a128-c2bb51d9becd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:13.332012 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9cd29d-49ae-4179-a128-c2bb51d9becd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:13.332457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db9cd29d-49ae-4179-a128-c2bb51d9becd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:13.459236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-db9cd29d-49ae-4179-a128-c2bb51d9becd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:13.467616 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db9cd29d-49ae-4179-a128-c2bb51d9becd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1362 microversion: 2.1 time: 0.149979 Sep 10 11:35:13.468202 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4484/6649] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:13 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:14.491607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-01b7c48a-7724-49e3-a864-a7539d1bb9b1 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:14.492959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-01b7c48a-7724-49e3-a864-a7539d1bb9b1 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:14.499377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01b7c48a-7724-49e3-a864-a7539d1bb9b1 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:14.499867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01b7c48a-7724-49e3-a864-a7539d1bb9b1 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:14.500300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01b7c48a-7724-49e3-a864-a7539d1bb9b1 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:14.500997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01b7c48a-7724-49e3-a864-a7539d1bb9b1 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:14.501506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01b7c48a-7724-49e3-a864-a7539d1bb9b1 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:14.501925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01b7c48a-7724-49e3-a864-a7539d1bb9b1 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:14.641148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-01b7c48a-7724-49e3-a864-a7539d1bb9b1 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:14.649123 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-01b7c48a-7724-49e3-a864-a7539d1bb9b1 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1362 microversion: 2.1 time: 0.162587 Sep 10 11:35:14.649722 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2166/6650] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:14 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:15.672233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-56032638-9821-4083-a284-93e763d03d81 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:15.675494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-56032638-9821-4083-a284-93e763d03d81 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:15.682911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56032638-9821-4083-a284-93e763d03d81 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:15.683421 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56032638-9821-4083-a284-93e763d03d81 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:15.683877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56032638-9821-4083-a284-93e763d03d81 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:15.684596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56032638-9821-4083-a284-93e763d03d81 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:15.685065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56032638-9821-4083-a284-93e763d03d81 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:15.685597 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-56032638-9821-4083-a284-93e763d03d81 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:15.818336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-56032638-9821-4083-a284-93e763d03d81 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:15.827145 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-56032638-9821-4083-a284-93e763d03d81 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1362 microversion: 2.1 time: 0.158859 Sep 10 11:35:15.828039 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4485/6651] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:15 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:16.850250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8c7ff4d5-b39e-46b9-91db-b12a771df80e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:16.850881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8c7ff4d5-b39e-46b9-91db-b12a771df80e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:16.857777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7ff4d5-b39e-46b9-91db-b12a771df80e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:16.858264 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7ff4d5-b39e-46b9-91db-b12a771df80e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:16.858702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7ff4d5-b39e-46b9-91db-b12a771df80e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:16.859388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7ff4d5-b39e-46b9-91db-b12a771df80e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:16.859841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7ff4d5-b39e-46b9-91db-b12a771df80e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:16.860266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8c7ff4d5-b39e-46b9-91db-b12a771df80e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:16.990433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8c7ff4d5-b39e-46b9-91db-b12a771df80e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:16.998683 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8c7ff4d5-b39e-46b9-91db-b12a771df80e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1362 microversion: 2.1 time: 0.152334 Sep 10 11:35:16.999259 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2167/6652] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:16 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:17.391482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-231de1b8-8467-434f-b92e-ff941a15580e req-1472725e-cde3-465b-ac6f-00253baf0204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "199d8f32-7081-4cde-a8a5-c9f9e2f3c883", "name": "network-vif-plugged", "status": "completed", "tag": "7e0d1e38-b14d-4551-bfc4-c7cef00c8a75"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:17.401655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-231de1b8-8467-434f-b92e-ff941a15580e req-1472725e-cde3-465b-ac6f-00253baf0204 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:17.402150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-231de1b8-8467-434f-b92e-ff941a15580e req-1472725e-cde3-465b-ac6f-00253baf0204 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:17.402663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-231de1b8-8467-434f-b92e-ff941a15580e req-1472725e-cde3-465b-ac6f-00253baf0204 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:17.414177 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-231de1b8-8467-434f-b92e-ff941a15580e req-1472725e-cde3-465b-ac6f-00253baf0204 service nova] Creating event network-vif-plugged:7e0d1e38-b14d-4551-bfc4-c7cef00c8a75 for instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 on n-h1-856894-1 Sep 10 11:35:17.419495 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-231de1b8-8467-434f-b92e-ff941a15580e req-1472725e-cde3-465b-ac6f-00253baf0204 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032361 Sep 10 11:35:17.420211 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4486/6653] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:18.020678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9f512266-1a2b-45ee-a016-c6f115da3c54 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:18.021332 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9f512266-1a2b-45ee-a016-c6f115da3c54 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:18.028239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f512266-1a2b-45ee-a016-c6f115da3c54 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:18.028737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f512266-1a2b-45ee-a016-c6f115da3c54 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:18.029206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f512266-1a2b-45ee-a016-c6f115da3c54 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:18.029894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f512266-1a2b-45ee-a016-c6f115da3c54 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:18.030347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f512266-1a2b-45ee-a016-c6f115da3c54 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:18.030769 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9f512266-1a2b-45ee-a016-c6f115da3c54 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:18.160932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9f512266-1a2b-45ee-a016-c6f115da3c54 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:18.168640 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9f512266-1a2b-45ee-a016-c6f115da3c54 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1362 microversion: 2.1 time: 0.151864 Sep 10 11:35:18.169215 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2168/6654] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:18 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:19.194336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ae47aa0-5502-4445-8099-a41daeeaa3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:19.195061 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7ae47aa0-5502-4445-8099-a41daeeaa3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:19.201892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ae47aa0-5502-4445-8099-a41daeeaa3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:19.202394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ae47aa0-5502-4445-8099-a41daeeaa3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:19.202849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ae47aa0-5502-4445-8099-a41daeeaa3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:19.203555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ae47aa0-5502-4445-8099-a41daeeaa3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:19.204028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ae47aa0-5502-4445-8099-a41daeeaa3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:19.204473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ae47aa0-5502-4445-8099-a41daeeaa3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:19.334683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7ae47aa0-5502-4445-8099-a41daeeaa3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:19.342490 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7ae47aa0-5502-4445-8099-a41daeeaa3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1553 microversion: 2.1 time: 0.153485 Sep 10 11:35:19.343087 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4487/6655] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:19 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:19.365094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3dc789bf-d190-4ef2-a0d7-1caada8b02f3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:19.365703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3dc789bf-d190-4ef2-a0d7-1caada8b02f3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:19.372088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dc789bf-d190-4ef2-a0d7-1caada8b02f3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:19.372567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dc789bf-d190-4ef2-a0d7-1caada8b02f3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:19.373001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dc789bf-d190-4ef2-a0d7-1caada8b02f3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:19.374317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dc789bf-d190-4ef2-a0d7-1caada8b02f3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:19.374767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dc789bf-d190-4ef2-a0d7-1caada8b02f3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:19.375188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3dc789bf-d190-4ef2-a0d7-1caada8b02f3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:19.504203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3dc789bf-d190-4ef2-a0d7-1caada8b02f3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:19.511817 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3dc789bf-d190-4ef2-a0d7-1caada8b02f3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1553 microversion: 2.1 time: 0.150679 Sep 10 11:35:19.512396 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2169/6656] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:19 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:21.187137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3a56341e-26b1-4f4a-bf41-7ce5250cc057 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "392e1ccd-cdaa-4aa9-9141-50b98cf01a07"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:21.190561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3a56341e-26b1-4f4a-bf41-7ce5250cc057 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:21.192564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:21.198797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a56341e-26b1-4f4a-bf41-7ce5250cc057 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:21.199300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a56341e-26b1-4f4a-bf41-7ce5250cc057 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:21.199755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a56341e-26b1-4f4a-bf41-7ce5250cc057 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:21.200467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a56341e-26b1-4f4a-bf41-7ce5250cc057 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:21.200946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a56341e-26b1-4f4a-bf41-7ce5250cc057 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:21.201418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3a56341e-26b1-4f4a-bf41-7ce5250cc057 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:21.442236 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3a56341e-26b1-4f4a-bf41-7ce5250cc057 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "POST /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258875 Sep 10 11:35:21.442909 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4488/6657] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:35:21 2022] POST /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:32.152046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-57f2b8ad-3193-4c2b-a754-68a13e435c22 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:32.152547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-57f2b8ad-3193-4c2b-a754-68a13e435c22 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:32.154509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:32.155324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:32.156711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:32.157395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=34 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:32.165037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57f2b8ad-3193-4c2b-a754-68a13e435c22 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:32.165557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57f2b8ad-3193-4c2b-a754-68a13e435c22 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:32.165995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57f2b8ad-3193-4c2b-a754-68a13e435c22 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:32.166685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57f2b8ad-3193-4c2b-a754-68a13e435c22 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:32.167140 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57f2b8ad-3193-4c2b-a754-68a13e435c22 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:32.167564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57f2b8ad-3193-4c2b-a754-68a13e435c22 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:32.247890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-57f2b8ad-3193-4c2b-a754-68a13e435c22 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lazy-loading 'services' on Instance uuid 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:35:32.319332 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-57f2b8ad-3193-4c2b-a754-68a13e435c22 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments/392e1ccd-cdaa-4aa9-9141-50b98cf01a07" status: 202 len: 0 microversion: 2.1 time: 0.171163 Sep 10 11:35:32.319958 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2170/6658] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:35:32 2022] DELETE /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments/392e1ccd-cdaa-4aa9-9141-50b98cf01a07 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:35:32.326376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:32.327278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:32.331516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d27100bb-bfdd-4f34-a91d-83f3b5eb2c2b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:32.333926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d27100bb-bfdd-4f34-a91d-83f3b5eb2c2b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:32.341745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d27100bb-bfdd-4f34-a91d-83f3b5eb2c2b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:32.342249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d27100bb-bfdd-4f34-a91d-83f3b5eb2c2b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:32.342697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d27100bb-bfdd-4f34-a91d-83f3b5eb2c2b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:32.343940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d27100bb-bfdd-4f34-a91d-83f3b5eb2c2b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:32.344405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d27100bb-bfdd-4f34-a91d-83f3b5eb2c2b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:32.344845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d27100bb-bfdd-4f34-a91d-83f3b5eb2c2b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:32.378004 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d27100bb-bfdd-4f34-a91d-83f3b5eb2c2b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053511 Sep 10 11:35:32.378711 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4489/6659] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:35:32 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:33.392842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b5faded6-d1a0-4220-94a0-9c94cabcd4cb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:33.395210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b5faded6-d1a0-4220-94a0-9c94cabcd4cb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:33.401453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5faded6-d1a0-4220-94a0-9c94cabcd4cb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:33.401935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5faded6-d1a0-4220-94a0-9c94cabcd4cb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:33.402368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5faded6-d1a0-4220-94a0-9c94cabcd4cb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:33.403051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5faded6-d1a0-4220-94a0-9c94cabcd4cb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:33.403496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5faded6-d1a0-4220-94a0-9c94cabcd4cb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:33.403921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b5faded6-d1a0-4220-94a0-9c94cabcd4cb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:33.435200 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b5faded6-d1a0-4220-94a0-9c94cabcd4cb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048080 Sep 10 11:35:33.435764 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2171/6660] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:35:33 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:34.448042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c4e2663-231f-4ec7-9861-8ee6f276fac8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:34.450263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c4e2663-231f-4ec7-9861-8ee6f276fac8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:34.458000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c4e2663-231f-4ec7-9861-8ee6f276fac8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:34.458503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c4e2663-231f-4ec7-9861-8ee6f276fac8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:34.458952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c4e2663-231f-4ec7-9861-8ee6f276fac8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:34.459658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c4e2663-231f-4ec7-9861-8ee6f276fac8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:34.460122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c4e2663-231f-4ec7-9861-8ee6f276fac8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:34.460568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c4e2663-231f-4ec7-9861-8ee6f276fac8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:34.495173 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c4e2663-231f-4ec7-9861-8ee6f276fac8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051145 Sep 10 11:35:34.495742 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4490/6661] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:35:34 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:35.508080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c244c80d-5c5d-4c0d-9f9c-dc5aab977af5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:35.510316 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c244c80d-5c5d-4c0d-9f9c-dc5aab977af5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:35.517778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c244c80d-5c5d-4c0d-9f9c-dc5aab977af5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:35.518261 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c244c80d-5c5d-4c0d-9f9c-dc5aab977af5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:35.518700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c244c80d-5c5d-4c0d-9f9c-dc5aab977af5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:35.519391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c244c80d-5c5d-4c0d-9f9c-dc5aab977af5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:35.519844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c244c80d-5c5d-4c0d-9f9c-dc5aab977af5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:35.520268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c244c80d-5c5d-4c0d-9f9c-dc5aab977af5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:35.549771 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c244c80d-5c5d-4c0d-9f9c-dc5aab977af5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 Sep 10 11:35:35.550325 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2172/6662] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:35:35 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:36.563130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22677203-90fb-444e-9541-a67065181922 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:36.565527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-22677203-90fb-444e-9541-a67065181922 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:36.572129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22677203-90fb-444e-9541-a67065181922 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:36.572642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22677203-90fb-444e-9541-a67065181922 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:36.573111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22677203-90fb-444e-9541-a67065181922 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:36.573832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22677203-90fb-444e-9541-a67065181922 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:36.574303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22677203-90fb-444e-9541-a67065181922 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:36.574744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22677203-90fb-444e-9541-a67065181922 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:36.606458 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-22677203-90fb-444e-9541-a67065181922 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Sep 10 11:35:36.607037 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4491/6663] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:35:36 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:37.618336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e0335ed9-931d-40f8-b370-06002b3e5c12 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:37.620494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e0335ed9-931d-40f8-b370-06002b3e5c12 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:37.627344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0335ed9-931d-40f8-b370-06002b3e5c12 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:37.627829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0335ed9-931d-40f8-b370-06002b3e5c12 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:37.628269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0335ed9-931d-40f8-b370-06002b3e5c12 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:37.628958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0335ed9-931d-40f8-b370-06002b3e5c12 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:37.629446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0335ed9-931d-40f8-b370-06002b3e5c12 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:37.629876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e0335ed9-931d-40f8-b370-06002b3e5c12 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:37.658845 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e0335ed9-931d-40f8-b370-06002b3e5c12 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044549 Sep 10 11:35:37.659409 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2173/6664] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:35:37 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:35:37.670143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:37.670644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:37.678437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:37.678937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:37.679398 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:37.680108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:37.680579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:37.681027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:37.759166 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] HTTP exception thrown: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 is not attached to volume 392e1ccd-cdaa-4aa9-9141-50b98cf01a07 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Request method failure captured: Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments/392e1ccd-cdaa-4aa9-9141-50b98cf01a07 HTTP/1.1 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHZnm5goWMFB8CvabpcZIDM38cWmdVT1lmQ9CxJee_2ewLloaqEgrWbp7CL63sKPQkryNPdolOyMvL1Kw3GmqvfuK4x_o57ltfupOuKxXhXANIAhbs7TEzA59cVA6B0MhiTxeTd5VAj99LVrQpbF_VyrZ9E8G9Ukrh-Z8ef7zLQHYCE Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_af4a2e663a2d498a84167de9da44aab3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e8b6f3ef572043bb8ec58db5503a546c Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 is not attached to volume 392e1ccd-cdaa-4aa9-9141-50b98cf01a07 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '199d8f32-7081-4cde-a8a5-c9f9e2f3c883', 'id': '392e1ccd-cdaa-4aa9-9141-50b98cf01a07'} Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 392e1ccd-cdaa-4aa9-9141-50b98cf01a07. Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 is not attached to volume 392e1ccd-cdaa-4aa9-9141-50b98cf01a07 Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:35:37.779784 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:35:37.784663 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:35:37.784663 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:35:37.784663 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 is not attached to volume 392e1ccd-cdaa-4aa9-9141-50b98cf01a07 Sep 10 11:35:37.784663 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:35:37.784663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Returning 404 to user: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 is not attached to volume 392e1ccd-cdaa-4aa9-9141-50b98cf01a07 {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:35:37.784663 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a983c4b-bd15-4ab9-a257-e918ea8c503e tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments/392e1ccd-cdaa-4aa9-9141-50b98cf01a07" status: 404 len: 154 microversion: 2.1 time: 0.115836 Sep 10 11:35:37.784663 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4492/6665] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:35:37 2022] DELETE /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883/os-volume_attachments/392e1ccd-cdaa-4aa9-9141-50b98cf01a07 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:35:41.138426 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cf7e424a-704a-4159-bf67-0fa611381c19 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:41.138957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cf7e424a-704a-4159-bf67-0fa611381c19 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:41.145710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7e424a-704a-4159-bf67-0fa611381c19 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:41.146176 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7e424a-704a-4159-bf67-0fa611381c19 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:41.146609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7e424a-704a-4159-bf67-0fa611381c19 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:41.147290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7e424a-704a-4159-bf67-0fa611381c19 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:41.147773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7e424a-704a-4159-bf67-0fa611381c19 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:41.148195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf7e424a-704a-4159-bf67-0fa611381c19 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:41.173792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cf7e424a-704a-4159-bf67-0fa611381c19 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:35:41.251531 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cf7e424a-704a-4159-bf67-0fa611381c19 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 204 len: 0 microversion: 2.1 time: 0.116844 Sep 10 11:35:41.252188 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2174/6666] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:35:41 2022] DELETE /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:35:41.260454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-961cb374-9ae1-4aa1-9dfa-ec65691d6528 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:41.261019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-961cb374-9ae1-4aa1-9dfa-ec65691d6528 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:41.268570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-961cb374-9ae1-4aa1-9dfa-ec65691d6528 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:41.269081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-961cb374-9ae1-4aa1-9dfa-ec65691d6528 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:41.269550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-961cb374-9ae1-4aa1-9dfa-ec65691d6528 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:41.270257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-961cb374-9ae1-4aa1-9dfa-ec65691d6528 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:41.270721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-961cb374-9ae1-4aa1-9dfa-ec65691d6528 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:41.271158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-961cb374-9ae1-4aa1-9dfa-ec65691d6528 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:41.403793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-961cb374-9ae1-4aa1-9dfa-ec65691d6528 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:41.412368 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-961cb374-9ae1-4aa1-9dfa-ec65691d6528 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1559 microversion: 2.1 time: 0.155927 Sep 10 11:35:41.412956 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4493/6667] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:41 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:42.436347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1698f97c-d7a8-4527-980a-bba852648079 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:42.437049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1698f97c-d7a8-4527-980a-bba852648079 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:42.443943 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1698f97c-d7a8-4527-980a-bba852648079 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:42.444361 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1698f97c-d7a8-4527-980a-bba852648079 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:42.444795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1698f97c-d7a8-4527-980a-bba852648079 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:42.445506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1698f97c-d7a8-4527-980a-bba852648079 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:42.445958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1698f97c-d7a8-4527-980a-bba852648079 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:42.446378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1698f97c-d7a8-4527-980a-bba852648079 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:42.576513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1698f97c-d7a8-4527-980a-bba852648079 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:42.584756 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1698f97c-d7a8-4527-980a-bba852648079 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1559 microversion: 2.1 time: 0.152733 Sep 10 11:35:42.585362 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2175/6668] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:42 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:43.544413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0eb3fd95-733c-4e38-8639-7b3be8cf48a9 req-fde829c8-0fe3-43d8-bbda-911d58054192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "199d8f32-7081-4cde-a8a5-c9f9e2f3c883", "name": "network-vif-deleted", "tag": "7e0d1e38-b14d-4551-bfc4-c7cef00c8a75"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:43.555982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0eb3fd95-733c-4e38-8639-7b3be8cf48a9 req-fde829c8-0fe3-43d8-bbda-911d58054192 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:43.556478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0eb3fd95-733c-4e38-8639-7b3be8cf48a9 req-fde829c8-0fe3-43d8-bbda-911d58054192 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:43.556935 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0eb3fd95-733c-4e38-8639-7b3be8cf48a9 req-fde829c8-0fe3-43d8-bbda-911d58054192 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:43.570112 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0eb3fd95-733c-4e38-8639-7b3be8cf48a9 req-fde829c8-0fe3-43d8-bbda-911d58054192 service nova] Creating event network-vif-deleted:7e0d1e38-b14d-4551-bfc4-c7cef00c8a75 for instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 on n-h1-856894-1 Sep 10 11:35:43.575231 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0eb3fd95-733c-4e38-8639-7b3be8cf48a9 req-fde829c8-0fe3-43d8-bbda-911d58054192 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034676 Sep 10 11:35:43.575855 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4494/6669] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:43.608384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:43.609744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:43.617954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:43.619454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:43.619993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:43.620792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:43.621360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:43.622334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:43.661586 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:43.662090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:43.662534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:43.663001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lazy-loading 'fault' on Instance uuid 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:35:43.717198 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:43.725178 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-99a6941a-5ea7-476d-96d8-40cc4244f9c5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 200 len: 1352 microversion: 2.1 time: 0.121107 Sep 10 11:35:43.725764 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2176/6670] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:43 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 1352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:44.753020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:44.753777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 199d8f32-7081-4cde-a8a5-c9f9e2f3c883] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:44.760325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:44.760827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:44.761314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:44.762026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:44.762500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:44.762942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:44.776364 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] HTTP exception thrown: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 could not be found. Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Request method failure captured: Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 HTTP/1.1 Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHZnm5goWMFB8CvabpcZIDM38cWmdVT1lmQ9CxJee_2ewLloaqEgrWbp7CL63sKPQkryNPdolOyMvL1Kw3GmqvfuK4x_o57ltfupOuKxXhXANIAhbs7TEzA59cVA6B0MhiTxeTd5VAj99LVrQpbF_VyrZ9E8G9Ukrh-Z8ef7zLQHYCE Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_af4a2e663a2d498a84167de9da44aab3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e8b6f3ef572043bb8ec58db5503a546c Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 could not be found. Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '199d8f32-7081-4cde-a8a5-c9f9e2f3c883'} Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 could not be found. Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 could not be found. Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:35:44.778036 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:35:44.782740 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:35:44.782740 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:35:44.782740 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:35:44.782740 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:35:44.782740 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:35:44.782740 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 could not be found. Sep 10 11:35:44.782740 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:35:44.782740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Returning 404 to user: Instance 199d8f32-7081-4cde-a8a5-c9f9e2f3c883 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:35:44.782740 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14145986-c976-4f26-8483-0aacea872d2a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883" status: 404 len: 111 microversion: 2.1 time: 0.032251 Sep 10 11:35:44.782740 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4495/6671] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:44 2022] GET /compute/v2.1/servers/199d8f32-7081-4cde-a8a5-c9f9e2f3c883 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:35:44.788097 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d383849d-b716-4945-a79b-c8d3e092487d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '.version_select at 0x7efcad964550>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:44.808738 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d383849d-b716-4945-a79b-c8d3e092487d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2023943203" status: 202 len: 0 microversion: 2.1 time: 0.024423 Sep 10 11:35:44.809357 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2177/6672] 10.222.0.20 () {58 vars in 1278 bytes} [Sat Sep 10 11:35:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2023943203 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:35:44.830306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-66c495ff-d252-4cb3-83b8-012a943bb15b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Action: 'create', calling method: .version_select at 0x7efcae281040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-441251188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnkwT6SHKXqWmcpcq3DZSMpD7KafU3cKIs6Qc1ztdCgXTQD7hFEzg5gxGHjCfkcWMKYfBxuVEzFr+nZzhcT/aDnudf9FE6/HK3Wf65l5lVsNbWXHJj45qDe22pc1NRL7g=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:44.845965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-66c495ff-d252-4cb3-83b8-012a943bb15b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for project af4a2e663a2d498a84167de9da44aab3. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:35:44.851088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-66c495ff-d252-4cb3-83b8-012a943bb15b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for user e8b6f3ef572043bb8ec58db5503a546c and project af4a2e663a2d498a84167de9da44aab3. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:35:44.874575 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-66c495ff-d252-4cb3-83b8-012a943bb15b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048256 Sep 10 11:35:44.875170 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4496/6673] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:35:44 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:35:44.925341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-405610302", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-441251188", "networks": [{"uuid": "343eba61-d3c6-4c39-a19a-3c8f30658d43"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:44.977785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] validate_networks() for [('343eba61-d3c6-4c39-a19a-3c8f30658d43', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:35:45.342087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:35:45.342512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:35:45.343506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:35:45.343912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:35:45.344318 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:35:45.353084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:45.353576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:45.354003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:45.354720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:45.355168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:45.355587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:45.372960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for project af4a2e663a2d498a84167de9da44aab3. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:35:45.378413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for user e8b6f3ef572043bb8ec58db5503a546c and project af4a2e663a2d498a84167de9da44aab3. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:35:45.391660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:35:45.394416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:35:45.441841 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-adc7a6c8-d7d5-469d-8602-bf9853e8bdef tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520627 Sep 10 11:35:45.442528 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2178/6674] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:35:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:35:45.454169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4593599a-8c1c-434d-ad2f-1b1a0b8b7910 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:45.454795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4593599a-8c1c-434d-ad2f-1b1a0b8b7910 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:45.508849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4593599a-8c1c-434d-ad2f-1b1a0b8b7910 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:45.517609 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4593599a-8c1c-434d-ad2f-1b1a0b8b7910 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1261 microversion: 2.1 time: 0.067870 Sep 10 11:35:45.518187 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4497/6675] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:45 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1261 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:46.540560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3ae85024-e2b7-4dd9-8700-e62da670e9d4 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:46.541986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3ae85024-e2b7-4dd9-8700-e62da670e9d4 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:46.549848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ae85024-e2b7-4dd9-8700-e62da670e9d4 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:46.550348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ae85024-e2b7-4dd9-8700-e62da670e9d4 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:46.550786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ae85024-e2b7-4dd9-8700-e62da670e9d4 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:46.551624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ae85024-e2b7-4dd9-8700-e62da670e9d4 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:46.552104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ae85024-e2b7-4dd9-8700-e62da670e9d4 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:46.552683 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3ae85024-e2b7-4dd9-8700-e62da670e9d4 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:46.621595 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3ae85024-e2b7-4dd9-8700-e62da670e9d4 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:46.629683 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3ae85024-e2b7-4dd9-8700-e62da670e9d4 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1331 microversion: 2.1 time: 0.093774 Sep 10 11:35:46.630264 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2179/6676] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:46 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:47.654387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6b5c5860-c697-480b-a6bd-d7f84411d8c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:47.655040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6b5c5860-c697-480b-a6bd-d7f84411d8c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:47.662046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b5c5860-c697-480b-a6bd-d7f84411d8c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:47.662592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b5c5860-c697-480b-a6bd-d7f84411d8c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:47.663050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b5c5860-c697-480b-a6bd-d7f84411d8c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:47.663849 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b5c5860-c697-480b-a6bd-d7f84411d8c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:47.669091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b5c5860-c697-480b-a6bd-d7f84411d8c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:47.669091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b5c5860-c697-480b-a6bd-d7f84411d8c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:47.778704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-c00aed4f-45b0-4d64-8dcc-97bbc7ea73a6 req-90c9cee1-d71e-41ca-a029-9f955fba984b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db6ecc8-4c6f-4f65-9108-e782b039150a", "tag": "92e76aa6-7eea-41e2-9b95-7a03468ffb1d"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:47.793384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c00aed4f-45b0-4d64-8dcc-97bbc7ea73a6 req-90c9cee1-d71e-41ca-a029-9f955fba984b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:47.793865 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c00aed4f-45b0-4d64-8dcc-97bbc7ea73a6 req-90c9cee1-d71e-41ca-a029-9f955fba984b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:47.794294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c00aed4f-45b0-4d64-8dcc-97bbc7ea73a6 req-90c9cee1-d71e-41ca-a029-9f955fba984b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:47.806676 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-c00aed4f-45b0-4d64-8dcc-97bbc7ea73a6 req-90c9cee1-d71e-41ca-a029-9f955fba984b service nova] Creating event network-changed:92e76aa6-7eea-41e2-9b95-7a03468ffb1d for instance 2db6ecc8-4c6f-4f65-9108-e782b039150a on n-h1-856894-1 Sep 10 11:35:47.811016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6b5c5860-c697-480b-a6bd-d7f84411d8c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:47.811531 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-c00aed4f-45b0-4d64-8dcc-97bbc7ea73a6 req-90c9cee1-d71e-41ca-a029-9f955fba984b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036770 Sep 10 11:35:47.812331 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2180/6677] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:35:47.820162 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6b5c5860-c697-480b-a6bd-d7f84411d8c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1361 microversion: 2.1 time: 0.169909 Sep 10 11:35:47.820940 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4498/6678] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:47 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:48.845638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ad47b55a-4193-4557-a7d1-364ed9632405 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:48.846362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ad47b55a-4193-4557-a7d1-364ed9632405 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:48.852436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad47b55a-4193-4557-a7d1-364ed9632405 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:48.852911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad47b55a-4193-4557-a7d1-364ed9632405 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:48.853374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad47b55a-4193-4557-a7d1-364ed9632405 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:48.854057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad47b55a-4193-4557-a7d1-364ed9632405 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:48.854504 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad47b55a-4193-4557-a7d1-364ed9632405 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:48.854921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ad47b55a-4193-4557-a7d1-364ed9632405 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:48.980335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ad47b55a-4193-4557-a7d1-364ed9632405 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:48.996090 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ad47b55a-4193-4557-a7d1-364ed9632405 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1361 microversion: 2.1 time: 0.155997 Sep 10 11:35:48.996691 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2181/6679] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:48 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:50.019118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e6c0186d-4204-49df-96f8-74de91b1129b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:50.019662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e6c0186d-4204-49df-96f8-74de91b1129b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:50.026605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c0186d-4204-49df-96f8-74de91b1129b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:50.027100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c0186d-4204-49df-96f8-74de91b1129b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:50.027549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c0186d-4204-49df-96f8-74de91b1129b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:50.028249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c0186d-4204-49df-96f8-74de91b1129b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:50.028714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c0186d-4204-49df-96f8-74de91b1129b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:50.029180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e6c0186d-4204-49df-96f8-74de91b1129b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:50.158810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e6c0186d-4204-49df-96f8-74de91b1129b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:50.166684 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e6c0186d-4204-49df-96f8-74de91b1129b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1361 microversion: 2.1 time: 0.151629 Sep 10 11:35:50.167264 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4499/6680] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:50 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:51.190808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ef007832-c77d-4d51-a1ff-3af02fed8a04 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:51.191434 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ef007832-c77d-4d51-a1ff-3af02fed8a04 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:51.197985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef007832-c77d-4d51-a1ff-3af02fed8a04 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:51.198474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef007832-c77d-4d51-a1ff-3af02fed8a04 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:51.198911 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef007832-c77d-4d51-a1ff-3af02fed8a04 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:51.199598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef007832-c77d-4d51-a1ff-3af02fed8a04 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:51.200053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef007832-c77d-4d51-a1ff-3af02fed8a04 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:51.200485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ef007832-c77d-4d51-a1ff-3af02fed8a04 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:51.325748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ef007832-c77d-4d51-a1ff-3af02fed8a04 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:51.334186 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ef007832-c77d-4d51-a1ff-3af02fed8a04 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1361 microversion: 2.1 time: 0.147974 Sep 10 11:35:51.334758 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2182/6681] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:51 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:51.545037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-4fe21a5e-dd89-436b-8940-40020078de47 req-f45e3906-7d74-43b4-8b09-316e0a25f103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db6ecc8-4c6f-4f65-9108-e782b039150a", "name": "network-vif-plugged", "status": "completed", "tag": "92e76aa6-7eea-41e2-9b95-7a03468ffb1d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:51.557407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4fe21a5e-dd89-436b-8940-40020078de47 req-f45e3906-7d74-43b4-8b09-316e0a25f103 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:51.558116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4fe21a5e-dd89-436b-8940-40020078de47 req-f45e3906-7d74-43b4-8b09-316e0a25f103 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:51.558573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-4fe21a5e-dd89-436b-8940-40020078de47 req-f45e3906-7d74-43b4-8b09-316e0a25f103 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:51.571377 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-4fe21a5e-dd89-436b-8940-40020078de47 req-f45e3906-7d74-43b4-8b09-316e0a25f103 service nova] Creating event network-vif-plugged:92e76aa6-7eea-41e2-9b95-7a03468ffb1d for instance 2db6ecc8-4c6f-4f65-9108-e782b039150a on n-h1-856894-1 Sep 10 11:35:51.576527 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-4fe21a5e-dd89-436b-8940-40020078de47 req-f45e3906-7d74-43b4-8b09-316e0a25f103 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035231 Sep 10 11:35:51.577735 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4500/6682] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:35:52.357119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-87ffd201-ce6e-4e5b-954f-5e831a5d3c9a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:52.357735 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-87ffd201-ce6e-4e5b-954f-5e831a5d3c9a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:52.364437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87ffd201-ce6e-4e5b-954f-5e831a5d3c9a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:52.364916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87ffd201-ce6e-4e5b-954f-5e831a5d3c9a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:52.365377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87ffd201-ce6e-4e5b-954f-5e831a5d3c9a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:52.366058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87ffd201-ce6e-4e5b-954f-5e831a5d3c9a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:52.366507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87ffd201-ce6e-4e5b-954f-5e831a5d3c9a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:52.366929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-87ffd201-ce6e-4e5b-954f-5e831a5d3c9a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:52.499926 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-87ffd201-ce6e-4e5b-954f-5e831a5d3c9a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:52.507492 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-87ffd201-ce6e-4e5b-954f-5e831a5d3c9a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1361 microversion: 2.1 time: 0.154620 Sep 10 11:35:52.508091 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2183/6683] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:52 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:53.531140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-10af94b7-925a-495e-9316-b1753895c25c tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:53.531854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-10af94b7-925a-495e-9316-b1753895c25c tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:53.539356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10af94b7-925a-495e-9316-b1753895c25c tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:53.539851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10af94b7-925a-495e-9316-b1753895c25c tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:53.540299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10af94b7-925a-495e-9316-b1753895c25c tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:53.540998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10af94b7-925a-495e-9316-b1753895c25c tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:53.541500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10af94b7-925a-495e-9316-b1753895c25c tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:53.542167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-10af94b7-925a-495e-9316-b1753895c25c tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:53.670579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-10af94b7-925a-495e-9316-b1753895c25c tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:53.679316 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-10af94b7-925a-495e-9316-b1753895c25c tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1552 microversion: 2.1 time: 0.152946 Sep 10 11:35:53.680172 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4501/6684] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:53 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:53.701507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c9bcd8e2-809b-4065-a6db-c556c3665faa tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:35:53.702615 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c9bcd8e2-809b-4065-a6db-c556c3665faa tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:53.709342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9bcd8e2-809b-4065-a6db-c556c3665faa tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:53.709824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9bcd8e2-809b-4065-a6db-c556c3665faa tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:53.710253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9bcd8e2-809b-4065-a6db-c556c3665faa tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:53.710932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9bcd8e2-809b-4065-a6db-c556c3665faa tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:53.711378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9bcd8e2-809b-4065-a6db-c556c3665faa tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:53.711796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c9bcd8e2-809b-4065-a6db-c556c3665faa tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:53.839337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c9bcd8e2-809b-4065-a6db-c556c3665faa tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:35:53.847727 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c9bcd8e2-809b-4065-a6db-c556c3665faa tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1552 microversion: 2.1 time: 0.150088 Sep 10 11:35:53.848302 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2184/6685] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:35:53 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:35:55.334829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c67901c5-0491-48e6-b8e1-ae44c2f0fede tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52547366-bacc-480a-86b0-a2771537fc4a"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:35:55.337275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c67901c5-0491-48e6-b8e1-ae44c2f0fede tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:35:55.344042 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c67901c5-0491-48e6-b8e1-ae44c2f0fede tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:55.344537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c67901c5-0491-48e6-b8e1-ae44c2f0fede tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:55.344987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c67901c5-0491-48e6-b8e1-ae44c2f0fede tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:55.345711 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c67901c5-0491-48e6-b8e1-ae44c2f0fede tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:35:55.346177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c67901c5-0491-48e6-b8e1-ae44c2f0fede tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:35:55.346613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c67901c5-0491-48e6-b8e1-ae44c2f0fede tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:35:55.514422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:35:55.580640 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c67901c5-0491-48e6-b8e1-ae44c2f0fede tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "POST /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249661 Sep 10 11:35:55.581364 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4502/6686] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:35:55 2022] POST /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:06.290098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e1aad20c-fd65-4cc9-8a87-78bf47b2f91a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:06.290627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e1aad20c-fd65-4cc9-8a87-78bf47b2f91a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:06.293410 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:06.294256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:06.294779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:06.295404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:06.302830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1aad20c-fd65-4cc9-8a87-78bf47b2f91a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:06.303314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1aad20c-fd65-4cc9-8a87-78bf47b2f91a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:06.303751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1aad20c-fd65-4cc9-8a87-78bf47b2f91a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:06.304436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1aad20c-fd65-4cc9-8a87-78bf47b2f91a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:06.304895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1aad20c-fd65-4cc9-8a87-78bf47b2f91a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:06.305350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e1aad20c-fd65-4cc9-8a87-78bf47b2f91a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:06.386147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-e1aad20c-fd65-4cc9-8a87-78bf47b2f91a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lazy-loading 'services' on Instance uuid 2db6ecc8-4c6f-4f65-9108-e782b039150a {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:36:06.455401 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e1aad20c-fd65-4cc9-8a87-78bf47b2f91a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments/52547366-bacc-480a-86b0-a2771537fc4a" status: 202 len: 0 microversion: 2.1 time: 0.169002 Sep 10 11:36:06.456026 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2185/6687] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:36:06 2022] DELETE /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments/52547366-bacc-480a-86b0-a2771537fc4a => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:36:06.462466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:06.463314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:06.470546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9b327248-66df-4ae9-96e7-5f5a18680e99 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:06.474109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9b327248-66df-4ae9-96e7-5f5a18680e99 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:06.482580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b327248-66df-4ae9-96e7-5f5a18680e99 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:06.483224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b327248-66df-4ae9-96e7-5f5a18680e99 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:06.483678 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b327248-66df-4ae9-96e7-5f5a18680e99 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:06.484865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b327248-66df-4ae9-96e7-5f5a18680e99 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:06.485371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b327248-66df-4ae9-96e7-5f5a18680e99 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:06.485815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9b327248-66df-4ae9-96e7-5f5a18680e99 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:06.518970 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9b327248-66df-4ae9-96e7-5f5a18680e99 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058433 Sep 10 11:36:06.519693 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4503/6688] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:06 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:07.533575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-379ec11e-a42f-4650-8be7-026e6b9d270d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:07.535894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-379ec11e-a42f-4650-8be7-026e6b9d270d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:07.542245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-379ec11e-a42f-4650-8be7-026e6b9d270d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:07.542732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-379ec11e-a42f-4650-8be7-026e6b9d270d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:07.543166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-379ec11e-a42f-4650-8be7-026e6b9d270d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:07.543857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-379ec11e-a42f-4650-8be7-026e6b9d270d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:07.544303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-379ec11e-a42f-4650-8be7-026e6b9d270d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:07.544721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-379ec11e-a42f-4650-8be7-026e6b9d270d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:07.575047 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-379ec11e-a42f-4650-8be7-026e6b9d270d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047148 Sep 10 11:36:07.575615 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2186/6689] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:07 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:08.587772 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-364d1a2b-b2ab-4e16-aa1f-15ac85ae09a8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:08.589989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-364d1a2b-b2ab-4e16-aa1f-15ac85ae09a8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:08.596815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-364d1a2b-b2ab-4e16-aa1f-15ac85ae09a8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:08.597374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-364d1a2b-b2ab-4e16-aa1f-15ac85ae09a8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:08.597828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-364d1a2b-b2ab-4e16-aa1f-15ac85ae09a8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:08.598525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-364d1a2b-b2ab-4e16-aa1f-15ac85ae09a8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:08.598991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-364d1a2b-b2ab-4e16-aa1f-15ac85ae09a8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:08.599428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-364d1a2b-b2ab-4e16-aa1f-15ac85ae09a8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:08.630175 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-364d1a2b-b2ab-4e16-aa1f-15ac85ae09a8 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046531 Sep 10 11:36:08.630756 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4504/6690] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:08 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:36:09.642600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f34e19a3-77f5-4e20-bb38-efc7e2f7a499 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:09.644870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f34e19a3-77f5-4e20-bb38-efc7e2f7a499 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:09.651692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f34e19a3-77f5-4e20-bb38-efc7e2f7a499 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:09.652173 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f34e19a3-77f5-4e20-bb38-efc7e2f7a499 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:09.652613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f34e19a3-77f5-4e20-bb38-efc7e2f7a499 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:09.653350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f34e19a3-77f5-4e20-bb38-efc7e2f7a499 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:09.653802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f34e19a3-77f5-4e20-bb38-efc7e2f7a499 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:09.654224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f34e19a3-77f5-4e20-bb38-efc7e2f7a499 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:09.684973 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f34e19a3-77f5-4e20-bb38-efc7e2f7a499 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046332 Sep 10 11:36:09.688513 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2187/6691] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:09 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:10.698912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-aeb8df1d-60da-442e-9f1e-aacf3bce8585 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:10.701289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-aeb8df1d-60da-442e-9f1e-aacf3bce8585 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:10.709148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb8df1d-60da-442e-9f1e-aacf3bce8585 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:10.709658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb8df1d-60da-442e-9f1e-aacf3bce8585 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:10.710112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb8df1d-60da-442e-9f1e-aacf3bce8585 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:10.710831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb8df1d-60da-442e-9f1e-aacf3bce8585 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:10.711300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb8df1d-60da-442e-9f1e-aacf3bce8585 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:10.711739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-aeb8df1d-60da-442e-9f1e-aacf3bce8585 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:10.743598 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-aeb8df1d-60da-442e-9f1e-aacf3bce8585 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048792 Sep 10 11:36:10.744211 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4505/6692] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:10 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:11.756175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-318debac-bda1-464a-b02c-61a7795d135b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:11.758390 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-318debac-bda1-464a-b02c-61a7795d135b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:11.765062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-318debac-bda1-464a-b02c-61a7795d135b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:11.765570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-318debac-bda1-464a-b02c-61a7795d135b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:11.766003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-318debac-bda1-464a-b02c-61a7795d135b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:11.767179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-318debac-bda1-464a-b02c-61a7795d135b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:11.767624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-318debac-bda1-464a-b02c-61a7795d135b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:11.768043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-318debac-bda1-464a-b02c-61a7795d135b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:11.796652 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-318debac-bda1-464a-b02c-61a7795d135b tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044496 Sep 10 11:36:11.797221 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2188/6693] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:11 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 11:36:11.808100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:11.808610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:11.818778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:11.819299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:11.820459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:11.821210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:11.821686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:11.822128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:11.903232 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] HTTP exception thrown: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a is not attached to volume 52547366-bacc-480a-86b0-a2771537fc4a Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Request method failure captured: Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments/52547366-bacc-480a-86b0-a2771537fc4a HTTP/1.1 Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHZnm5goWMFB8CvabpcZIDM38cWmdVT1lmQ9CxJee_2ewLloaqEgrWbp7CL63sKPQkryNPdolOyMvL1Kw3GmqvfuK4x_o57ltfupOuKxXhXANIAhbs7TEzA59cVA6B0MhiTxeTd5VAj99LVrQpbF_VyrZ9E8G9Ukrh-Z8ef7zLQHYCE Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_af4a2e663a2d498a84167de9da44aab3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e8b6f3ef572043bb8ec58db5503a546c Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a is not attached to volume 52547366-bacc-480a-86b0-a2771537fc4a Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '2db6ecc8-4c6f-4f65-9108-e782b039150a', 'id': '52547366-bacc-480a-86b0-a2771537fc4a'} Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 52547366-bacc-480a-86b0-a2771537fc4a. Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a is not attached to volume 52547366-bacc-480a-86b0-a2771537fc4a Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:36:11.904890 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:36:11.910220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:36:11.910220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:36:11.910220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a is not attached to volume 52547366-bacc-480a-86b0-a2771537fc4a Sep 10 11:36:11.910220 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:36:11.910220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Returning 404 to user: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a is not attached to volume 52547366-bacc-480a-86b0-a2771537fc4a {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:36:11.910220 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-570f1b0b-843f-4c9b-bb27-e73477cbeec5 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments/52547366-bacc-480a-86b0-a2771537fc4a" status: 404 len: 154 microversion: 2.1 time: 0.102430 Sep 10 11:36:11.910220 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4506/6694] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:36:11 2022] DELETE /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a/os-volume_attachments/52547366-bacc-480a-86b0-a2771537fc4a => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:36:15.262237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9e4808f5-f74e-4bf6-8d81-a4b74f329f24 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:15.262748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9e4808f5-f74e-4bf6-8d81-a4b74f329f24 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:15.269929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e4808f5-f74e-4bf6-8d81-a4b74f329f24 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:15.270411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e4808f5-f74e-4bf6-8d81-a4b74f329f24 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:15.270845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e4808f5-f74e-4bf6-8d81-a4b74f329f24 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:15.271532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e4808f5-f74e-4bf6-8d81-a4b74f329f24 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:15.271981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e4808f5-f74e-4bf6-8d81-a4b74f329f24 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:15.272402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9e4808f5-f74e-4bf6-8d81-a4b74f329f24 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:15.301201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9e4808f5-f74e-4bf6-8d81-a4b74f329f24 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:36:15.620896 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9e4808f5-f74e-4bf6-8d81-a4b74f329f24 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 204 len: 0 microversion: 2.1 time: 0.362144 Sep 10 11:36:15.624900 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2189/6695] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:36:15 2022] DELETE /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:36:15.630858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5b98d4ef-93c5-4173-9117-611fc5fe1a79 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:15.631538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5b98d4ef-93c5-4173-9117-611fc5fe1a79 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:15.639113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b98d4ef-93c5-4173-9117-611fc5fe1a79 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:15.639619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b98d4ef-93c5-4173-9117-611fc5fe1a79 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:15.640081 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b98d4ef-93c5-4173-9117-611fc5fe1a79 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:15.640792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b98d4ef-93c5-4173-9117-611fc5fe1a79 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:15.641293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b98d4ef-93c5-4173-9117-611fc5fe1a79 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:15.641768 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5b98d4ef-93c5-4173-9117-611fc5fe1a79 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:16.076386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5b98d4ef-93c5-4173-9117-611fc5fe1a79 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:16.084287 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5b98d4ef-93c5-4173-9117-611fc5fe1a79 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1558 microversion: 2.1 time: 0.457381 Sep 10 11:36:16.084867 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4507/6696] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:15 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1558 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:17.108571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-877cd8cf-4cff-4ad0-9940-4f69082009c3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:17.109293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-877cd8cf-4cff-4ad0-9940-4f69082009c3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:17.116359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-877cd8cf-4cff-4ad0-9940-4f69082009c3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:17.116847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-877cd8cf-4cff-4ad0-9940-4f69082009c3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:17.117326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-877cd8cf-4cff-4ad0-9940-4f69082009c3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:17.118023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-877cd8cf-4cff-4ad0-9940-4f69082009c3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:17.118482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-877cd8cf-4cff-4ad0-9940-4f69082009c3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:17.118927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-877cd8cf-4cff-4ad0-9940-4f69082009c3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:17.246344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-877cd8cf-4cff-4ad0-9940-4f69082009c3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:17.254665 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-877cd8cf-4cff-4ad0-9940-4f69082009c3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 200 len: 1558 microversion: 2.1 time: 0.150254 Sep 10 11:36:17.255237 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2190/6697] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:17 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:17.662938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-51b1a784-145c-4f85-8c64-880bb57f865f req-611a3a4e-45fe-4410-bd91-891ea9ffe32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db6ecc8-4c6f-4f65-9108-e782b039150a", "name": "network-vif-deleted", "tag": "92e76aa6-7eea-41e2-9b95-7a03468ffb1d"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:36:17.674844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-51b1a784-145c-4f85-8c64-880bb57f865f req-611a3a4e-45fe-4410-bd91-891ea9ffe32f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:17.675357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-51b1a784-145c-4f85-8c64-880bb57f865f req-611a3a4e-45fe-4410-bd91-891ea9ffe32f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:17.676077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-51b1a784-145c-4f85-8c64-880bb57f865f req-611a3a4e-45fe-4410-bd91-891ea9ffe32f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:17.691950 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-51b1a784-145c-4f85-8c64-880bb57f865f req-611a3a4e-45fe-4410-bd91-891ea9ffe32f service nova] Creating event network-vif-deleted:92e76aa6-7eea-41e2-9b95-7a03468ffb1d for instance 2db6ecc8-4c6f-4f65-9108-e782b039150a on n-h1-856894-1 Sep 10 11:36:17.700267 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-51b1a784-145c-4f85-8c64-880bb57f865f req-611a3a4e-45fe-4410-bd91-891ea9ffe32f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041024 Sep 10 11:36:17.701218 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4508/6698] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:18.277484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:18.278096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 2db6ecc8-4c6f-4f65-9108-e782b039150a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:18.285351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:18.285834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:18.286266 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:18.286946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:18.287400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:18.287823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:18.301981 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] HTTP exception thrown: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a could not be found. Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Request method failure captured: Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a HTTP/1.1 Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHZnm5goWMFB8CvabpcZIDM38cWmdVT1lmQ9CxJee_2ewLloaqEgrWbp7CL63sKPQkryNPdolOyMvL1Kw3GmqvfuK4x_o57ltfupOuKxXhXANIAhbs7TEzA59cVA6B0MhiTxeTd5VAj99LVrQpbF_VyrZ9E8G9Ukrh-Z8ef7zLQHYCE Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_af4a2e663a2d498a84167de9da44aab3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e8b6f3ef572043bb8ec58db5503a546c Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a could not be found. Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '2db6ecc8-4c6f-4f65-9108-e782b039150a'} Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a could not be found. Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a could not be found. Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:36:18.303596 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:18.308179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:18.308179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:36:18.308179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:36:18.308179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:36:18.308179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:36:18.308179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a could not be found. Sep 10 11:36:18.308179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:18.308179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Returning 404 to user: Instance 2db6ecc8-4c6f-4f65-9108-e782b039150a could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:36:18.308179 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fbf5d7a0-821f-4e28-8ad9-beb8908a1ca3 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a" status: 404 len: 111 microversion: 2.1 time: 0.031416 Sep 10 11:36:18.308179 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2191/6699] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:18 2022] GET /compute/v2.1/servers/2db6ecc8-4c6f-4f65-9108-e782b039150a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:36:18.314365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-47012c55-cb9c-437f-9181-740c0bb11e0f tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '.version_select at 0x7efcad25b3a0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:18.334209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-47012c55-cb9c-437f-9181-740c0bb11e0f tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-441251188" status: 202 len: 0 microversion: 2.1 time: 0.024024 Sep 10 11:36:18.334798 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4509/6700] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:36:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-441251188 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:36:18.351505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9891a8c3-e202-4afb-bb52-ed41bd9b3345 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Action: 'create', calling method: .version_select at 0x7efcadbee040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-992282344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtwMQix0jqGoOqRRR/PN2qiDpQ6iySV4T1HDDREOMqjz5RjWHkzn/A+mMcjJhHKIrKsdGKwPfwOzVwWAJVhMoHr92zVSIvcwUDvMWsbZ4xd3SFGa1zVTlS7navvwskrGg=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:36:18.367360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-9891a8c3-e202-4afb-bb52-ed41bd9b3345 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for project af4a2e663a2d498a84167de9da44aab3. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:36:18.372923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-9891a8c3-e202-4afb-bb52-ed41bd9b3345 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for user e8b6f3ef572043bb8ec58db5503a546c and project af4a2e663a2d498a84167de9da44aab3. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:36:18.395745 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9891a8c3-e202-4afb-bb52-ed41bd9b3345 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048134 Sep 10 11:36:18.396323 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2192/6701] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:36:18 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:18.446309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1659415544", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-992282344", "networks": [{"uuid": "343eba61-d3c6-4c39-a19a-3c8f30658d43"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:36:18.499740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] validate_networks() for [('343eba61-d3c6-4c39-a19a-3c8f30658d43', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:36:18.868609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:36:18.869216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:36:18.869588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:36:18.870021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:36:18.870459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:36:18.879892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:18.880400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:18.880859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:18.881658 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:18.882140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:18.882590 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:18.900669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for project af4a2e663a2d498a84167de9da44aab3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:36:18.905980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Getting quotas for user e8b6f3ef572043bb8ec58db5503a546c and project af4a2e663a2d498a84167de9da44aab3. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:36:18.918322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:36:18.920722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:36:18.968622 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-86a57f23-02ce-439f-aa06-ed2378b10a01 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526188 Sep 10 11:36:18.969416 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4510/6702] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:36:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:36:18.980597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-23c89a09-0860-42ab-baa2-43fcb426df0d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:18.981238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-23c89a09-0860-42ab-baa2-43fcb426df0d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:19.034969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-23c89a09-0860-42ab-baa2-43fcb426df0d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:19.041896 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-23c89a09-0860-42ab-baa2-43fcb426df0d tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1262 microversion: 2.1 time: 0.065449 Sep 10 11:36:19.042659 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2193/6703] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:18 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1262 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:20.065371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2349b1d7-97a2-467f-8fc2-bb4376623d13 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:20.066130 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2349b1d7-97a2-467f-8fc2-bb4376623d13 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:20.072392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2349b1d7-97a2-467f-8fc2-bb4376623d13 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:20.072905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2349b1d7-97a2-467f-8fc2-bb4376623d13 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:20.073409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2349b1d7-97a2-467f-8fc2-bb4376623d13 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:20.074125 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2349b1d7-97a2-467f-8fc2-bb4376623d13 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:20.074602 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2349b1d7-97a2-467f-8fc2-bb4376623d13 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:20.075047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2349b1d7-97a2-467f-8fc2-bb4376623d13 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:20.138625 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2349b1d7-97a2-467f-8fc2-bb4376623d13 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:20.146937 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2349b1d7-97a2-467f-8fc2-bb4376623d13 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1320 microversion: 2.1 time: 0.086691 Sep 10 11:36:20.147525 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4511/6704] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:20 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1320 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:21.171016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-73b7fb57-deb6-4e17-9cda-1edda06377ad tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:21.171760 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-73b7fb57-deb6-4e17-9cda-1edda06377ad tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:21.179330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73b7fb57-deb6-4e17-9cda-1edda06377ad tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:21.179806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73b7fb57-deb6-4e17-9cda-1edda06377ad tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:21.180239 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73b7fb57-deb6-4e17-9cda-1edda06377ad tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:21.180921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73b7fb57-deb6-4e17-9cda-1edda06377ad tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:21.181391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73b7fb57-deb6-4e17-9cda-1edda06377ad tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:21.181837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-73b7fb57-deb6-4e17-9cda-1edda06377ad tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:21.249827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b9127172-a92a-4dff-a6e7-d222b8d7da6a req-e7a9f383-b7cd-498b-b079-d844bd1f0784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49aded8f-4895-459c-81f4-1d2eb66f9619", "tag": "3e9f4321-eb05-4fc1-b080-a184c49b0bb6"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:36:21.262363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b9127172-a92a-4dff-a6e7-d222b8d7da6a req-e7a9f383-b7cd-498b-b079-d844bd1f0784 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:21.263234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b9127172-a92a-4dff-a6e7-d222b8d7da6a req-e7a9f383-b7cd-498b-b079-d844bd1f0784 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:21.264008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b9127172-a92a-4dff-a6e7-d222b8d7da6a req-e7a9f383-b7cd-498b-b079-d844bd1f0784 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:21.276736 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b9127172-a92a-4dff-a6e7-d222b8d7da6a req-e7a9f383-b7cd-498b-b079-d844bd1f0784 service nova] Creating event network-changed:3e9f4321-eb05-4fc1-b080-a184c49b0bb6 for instance 49aded8f-4895-459c-81f4-1d2eb66f9619 on n-h1-856894-1 Sep 10 11:36:21.282303 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b9127172-a92a-4dff-a6e7-d222b8d7da6a req-e7a9f383-b7cd-498b-b079-d844bd1f0784 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037614 Sep 10 11:36:21.283470 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4512/6705] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:21.332047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-73b7fb57-deb6-4e17-9cda-1edda06377ad tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:21.340165 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-73b7fb57-deb6-4e17-9cda-1edda06377ad tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1362 microversion: 2.1 time: 0.172939 Sep 10 11:36:21.340746 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2194/6706] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:21 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:22.365891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-21e86a3a-f0f5-4661-bcde-4d0b91cf9fa6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:22.366610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-21e86a3a-f0f5-4661-bcde-4d0b91cf9fa6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:22.372911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e86a3a-f0f5-4661-bcde-4d0b91cf9fa6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:22.373440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e86a3a-f0f5-4661-bcde-4d0b91cf9fa6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:22.373894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e86a3a-f0f5-4661-bcde-4d0b91cf9fa6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:22.374596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e86a3a-f0f5-4661-bcde-4d0b91cf9fa6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:22.375064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e86a3a-f0f5-4661-bcde-4d0b91cf9fa6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:22.375505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-21e86a3a-f0f5-4661-bcde-4d0b91cf9fa6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:22.511661 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-21e86a3a-f0f5-4661-bcde-4d0b91cf9fa6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:22.519651 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-21e86a3a-f0f5-4661-bcde-4d0b91cf9fa6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1362 microversion: 2.1 time: 0.159905 Sep 10 11:36:22.520231 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4513/6707] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:22 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:23.542793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3004892f-ce52-4008-afb5-9da305c1b1a2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:23.543400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3004892f-ce52-4008-afb5-9da305c1b1a2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:23.550494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3004892f-ce52-4008-afb5-9da305c1b1a2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:23.550979 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3004892f-ce52-4008-afb5-9da305c1b1a2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:23.551418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3004892f-ce52-4008-afb5-9da305c1b1a2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:23.552106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3004892f-ce52-4008-afb5-9da305c1b1a2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:23.552561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3004892f-ce52-4008-afb5-9da305c1b1a2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:23.552991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3004892f-ce52-4008-afb5-9da305c1b1a2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:23.683314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3004892f-ce52-4008-afb5-9da305c1b1a2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:23.691927 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3004892f-ce52-4008-afb5-9da305c1b1a2 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1362 microversion: 2.1 time: 0.152977 Sep 10 11:36:23.705096 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2195/6708] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:23 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:24.715315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-087c003d-9802-4d8b-b378-a7b1b38634c0 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:24.715947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-087c003d-9802-4d8b-b378-a7b1b38634c0 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:24.723568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-087c003d-9802-4d8b-b378-a7b1b38634c0 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:24.724026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-087c003d-9802-4d8b-b378-a7b1b38634c0 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:24.724474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-087c003d-9802-4d8b-b378-a7b1b38634c0 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:24.725206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-087c003d-9802-4d8b-b378-a7b1b38634c0 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:24.725671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-087c003d-9802-4d8b-b378-a7b1b38634c0 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:24.726108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-087c003d-9802-4d8b-b378-a7b1b38634c0 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:24.856635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-087c003d-9802-4d8b-b378-a7b1b38634c0 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:24.864597 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-087c003d-9802-4d8b-b378-a7b1b38634c0 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1362 microversion: 2.1 time: 0.153188 Sep 10 11:36:24.865220 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4514/6709] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:24 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:25.756081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-f04e81fc-5f26-45c6-a51f-cb18ee57220d req-1b258b8e-8b75-4830-aa93-9fa0e710b1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aded8f-4895-459c-81f4-1d2eb66f9619", "name": "network-vif-plugged", "status": "completed", "tag": "3e9f4321-eb05-4fc1-b080-a184c49b0bb6"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:36:25.767234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f04e81fc-5f26-45c6-a51f-cb18ee57220d req-1b258b8e-8b75-4830-aa93-9fa0e710b1c6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:25.767878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f04e81fc-5f26-45c6-a51f-cb18ee57220d req-1b258b8e-8b75-4830-aa93-9fa0e710b1c6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:25.768412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-f04e81fc-5f26-45c6-a51f-cb18ee57220d req-1b258b8e-8b75-4830-aa93-9fa0e710b1c6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:25.779774 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-f04e81fc-5f26-45c6-a51f-cb18ee57220d req-1b258b8e-8b75-4830-aa93-9fa0e710b1c6 service nova] Creating event network-vif-plugged:3e9f4321-eb05-4fc1-b080-a184c49b0bb6 for instance 49aded8f-4895-459c-81f4-1d2eb66f9619 on n-h1-856894-1 Sep 10 11:36:25.785147 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-f04e81fc-5f26-45c6-a51f-cb18ee57220d req-1b258b8e-8b75-4830-aa93-9fa0e710b1c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032808 Sep 10 11:36:25.785744 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2196/6710] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:25.888108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cc19f148-0ce9-4c0f-a204-54b23ac38635 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:25.889064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cc19f148-0ce9-4c0f-a204-54b23ac38635 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:25.896236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc19f148-0ce9-4c0f-a204-54b23ac38635 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:25.896735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc19f148-0ce9-4c0f-a204-54b23ac38635 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:25.897208 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc19f148-0ce9-4c0f-a204-54b23ac38635 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:25.897913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc19f148-0ce9-4c0f-a204-54b23ac38635 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:25.898381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc19f148-0ce9-4c0f-a204-54b23ac38635 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:25.898850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cc19f148-0ce9-4c0f-a204-54b23ac38635 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:26.033544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cc19f148-0ce9-4c0f-a204-54b23ac38635 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:26.041312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cc19f148-0ce9-4c0f-a204-54b23ac38635 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1362 microversion: 2.1 time: 0.157516 Sep 10 11:36:26.041895 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4515/6711] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:25 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:27.065523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ff282755-d96b-471d-9b2e-55c153ef4e48 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:27.066231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ff282755-d96b-471d-9b2e-55c153ef4e48 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:27.072669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff282755-d96b-471d-9b2e-55c153ef4e48 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:27.073181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff282755-d96b-471d-9b2e-55c153ef4e48 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:27.073652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff282755-d96b-471d-9b2e-55c153ef4e48 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:27.074369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff282755-d96b-471d-9b2e-55c153ef4e48 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:27.074853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff282755-d96b-471d-9b2e-55c153ef4e48 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:27.075279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff282755-d96b-471d-9b2e-55c153ef4e48 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:27.209257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ff282755-d96b-471d-9b2e-55c153ef4e48 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:27.216885 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ff282755-d96b-471d-9b2e-55c153ef4e48 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1554 microversion: 2.1 time: 0.156548 Sep 10 11:36:27.217483 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2197/6712] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:27 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:27.239998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-81e55938-64ab-4f67-a137-4b4cb432f009 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:27.240634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-81e55938-64ab-4f67-a137-4b4cb432f009 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:27.247608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81e55938-64ab-4f67-a137-4b4cb432f009 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:27.248107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81e55938-64ab-4f67-a137-4b4cb432f009 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:27.248567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81e55938-64ab-4f67-a137-4b4cb432f009 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:27.249303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81e55938-64ab-4f67-a137-4b4cb432f009 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:27.249778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81e55938-64ab-4f67-a137-4b4cb432f009 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:27.250220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81e55938-64ab-4f67-a137-4b4cb432f009 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:27.384198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-81e55938-64ab-4f67-a137-4b4cb432f009 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:27.392562 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-81e55938-64ab-4f67-a137-4b4cb432f009 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1554 microversion: 2.1 time: 0.156540 Sep 10 11:36:27.393188 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4516/6713] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:27 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:28.882814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5ffcf74e-46c5-4625-9deb-d9f0ce155cea tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a015725a-2aec-4f30-811a-94b1f0aba66d"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:36:28.885137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5ffcf74e-46c5-4625-9deb-d9f0ce155cea tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:28.892365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ffcf74e-46c5-4625-9deb-d9f0ce155cea tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:28.892843 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ffcf74e-46c5-4625-9deb-d9f0ce155cea tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:28.893304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ffcf74e-46c5-4625-9deb-d9f0ce155cea tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:28.893988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ffcf74e-46c5-4625-9deb-d9f0ce155cea tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:28.894438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ffcf74e-46c5-4625-9deb-d9f0ce155cea tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:28.894862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5ffcf74e-46c5-4625-9deb-d9f0ce155cea tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:29.040396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:29.130271 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5ffcf74e-46c5-4625-9deb-d9f0ce155cea tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "POST /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251238 Sep 10 11:36:29.133151 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2198/6714] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:36:28 2022] POST /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:39.841392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ac5bfe98-cbae-4696-b2f3-0cdf52087cbd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:39.841958 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ac5bfe98-cbae-4696-b2f3-0cdf52087cbd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:39.844572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:39.845270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:39.846324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:39.847146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=66 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:39.854326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac5bfe98-cbae-4696-b2f3-0cdf52087cbd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:39.854831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac5bfe98-cbae-4696-b2f3-0cdf52087cbd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:39.855280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac5bfe98-cbae-4696-b2f3-0cdf52087cbd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:39.855981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac5bfe98-cbae-4696-b2f3-0cdf52087cbd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:39.856449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac5bfe98-cbae-4696-b2f3-0cdf52087cbd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:39.856889 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ac5bfe98-cbae-4696-b2f3-0cdf52087cbd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:39.941048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-ac5bfe98-cbae-4696-b2f3-0cdf52087cbd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lazy-loading 'services' on Instance uuid 49aded8f-4895-459c-81f4-1d2eb66f9619 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:36:40.011286 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ac5bfe98-cbae-4696-b2f3-0cdf52087cbd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments/a015725a-2aec-4f30-811a-94b1f0aba66d" status: 202 len: 0 microversion: 2.1 time: 0.173308 Sep 10 11:36:40.011883 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4517/6715] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:36:39 2022] DELETE /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments/a015725a-2aec-4f30-811a-94b1f0aba66d => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:36:40.019115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:40.020163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:40.024669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-06f4af2d-4c4a-46fa-b8bf-29b6432e6200 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:40.027055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-06f4af2d-4c4a-46fa-b8bf-29b6432e6200 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:40.036443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06f4af2d-4c4a-46fa-b8bf-29b6432e6200 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:40.036957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06f4af2d-4c4a-46fa-b8bf-29b6432e6200 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:40.037448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06f4af2d-4c4a-46fa-b8bf-29b6432e6200 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:40.038158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06f4af2d-4c4a-46fa-b8bf-29b6432e6200 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:40.038613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06f4af2d-4c4a-46fa-b8bf-29b6432e6200 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:40.039039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-06f4af2d-4c4a-46fa-b8bf-29b6432e6200 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:40.071276 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-06f4af2d-4c4a-46fa-b8bf-29b6432e6200 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054620 Sep 10 11:36:40.071838 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2199/6716] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:40 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:36:41.084740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9294aff0-81d3-4761-8663-bcd48e292472 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:41.087964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9294aff0-81d3-4761-8663-bcd48e292472 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:41.095732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9294aff0-81d3-4761-8663-bcd48e292472 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:41.096335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9294aff0-81d3-4761-8663-bcd48e292472 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:41.096732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9294aff0-81d3-4761-8663-bcd48e292472 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:41.097630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9294aff0-81d3-4761-8663-bcd48e292472 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:41.098085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9294aff0-81d3-4761-8663-bcd48e292472 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:41.098529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9294aff0-81d3-4761-8663-bcd48e292472 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:41.130253 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9294aff0-81d3-4761-8663-bcd48e292472 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049930 Sep 10 11:36:41.130839 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4518/6717] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:41 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:42.142745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-92348d16-c7d8-4333-911c-8d16b351fbe6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:42.145031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-92348d16-c7d8-4333-911c-8d16b351fbe6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:42.152098 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92348d16-c7d8-4333-911c-8d16b351fbe6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:42.152609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92348d16-c7d8-4333-911c-8d16b351fbe6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:42.153039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92348d16-c7d8-4333-911c-8d16b351fbe6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:42.153759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92348d16-c7d8-4333-911c-8d16b351fbe6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:42.154224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92348d16-c7d8-4333-911c-8d16b351fbe6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:42.154648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92348d16-c7d8-4333-911c-8d16b351fbe6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:42.185239 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-92348d16-c7d8-4333-911c-8d16b351fbe6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046440 Sep 10 11:36:42.185943 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2200/6718] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:42 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:43.198116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bc599550-7ec6-4167-8141-bd2279352f82 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:43.200296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bc599550-7ec6-4167-8141-bd2279352f82 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:43.207426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc599550-7ec6-4167-8141-bd2279352f82 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:43.207936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc599550-7ec6-4167-8141-bd2279352f82 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:43.208397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc599550-7ec6-4167-8141-bd2279352f82 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:43.209145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc599550-7ec6-4167-8141-bd2279352f82 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:43.209622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc599550-7ec6-4167-8141-bd2279352f82 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:43.210070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bc599550-7ec6-4167-8141-bd2279352f82 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:43.240455 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bc599550-7ec6-4167-8141-bd2279352f82 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046441 Sep 10 11:36:43.241033 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4519/6719] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:43 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:44.253322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6390a725-2228-4906-87ad-d5c3971787cd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:44.255512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6390a725-2228-4906-87ad-d5c3971787cd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:44.262516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6390a725-2228-4906-87ad-d5c3971787cd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:44.262999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6390a725-2228-4906-87ad-d5c3971787cd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:44.263436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6390a725-2228-4906-87ad-d5c3971787cd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:44.264133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6390a725-2228-4906-87ad-d5c3971787cd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:44.264587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6390a725-2228-4906-87ad-d5c3971787cd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:44.265009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6390a725-2228-4906-87ad-d5c3971787cd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:44.295092 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6390a725-2228-4906-87ad-d5c3971787cd tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046179 Sep 10 11:36:44.300010 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2201/6720] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:44 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:45.307144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-290e26ab-a198-41f0-a863-c714076e546a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:45.309378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-290e26ab-a198-41f0-a863-c714076e546a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:45.316749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-290e26ab-a198-41f0-a863-c714076e546a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:45.317278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-290e26ab-a198-41f0-a863-c714076e546a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:45.317759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-290e26ab-a198-41f0-a863-c714076e546a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:45.318454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-290e26ab-a198-41f0-a863-c714076e546a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:45.318918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-290e26ab-a198-41f0-a863-c714076e546a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:45.319356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-290e26ab-a198-41f0-a863-c714076e546a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:45.348632 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-290e26ab-a198-41f0-a863-c714076e546a tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045429 Sep 10 11:36:45.349144 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4520/6721] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:36:45 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:36:45.359642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:45.360124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:45.367315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:45.367796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:45.368225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:45.368901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:45.369386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:45.369806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:45.447503 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] HTTP exception thrown: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 is not attached to volume a015725a-2aec-4f30-811a-94b1f0aba66d Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Request method failure captured: Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments/a015725a-2aec-4f30-811a-94b1f0aba66d HTTP/1.1 Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHZnm5goWMFB8CvabpcZIDM38cWmdVT1lmQ9CxJee_2ewLloaqEgrWbp7CL63sKPQkryNPdolOyMvL1Kw3GmqvfuK4x_o57ltfupOuKxXhXANIAhbs7TEzA59cVA6B0MhiTxeTd5VAj99LVrQpbF_VyrZ9E8G9Ukrh-Z8ef7zLQHYCE Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_af4a2e663a2d498a84167de9da44aab3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e8b6f3ef572043bb8ec58db5503a546c Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 is not attached to volume a015725a-2aec-4f30-811a-94b1f0aba66d Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'server_id': '49aded8f-4895-459c-81f4-1d2eb66f9619', 'id': 'a015725a-2aec-4f30-811a-94b1f0aba66d'} Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a015725a-2aec-4f30-811a-94b1f0aba66d. Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 is not attached to volume a015725a-2aec-4f30-811a-94b1f0aba66d Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:36:45.449440 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:36:45.453642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:36:45.453642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:36:45.453642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 is not attached to volume a015725a-2aec-4f30-811a-94b1f0aba66d Sep 10 11:36:45.453642 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:45.453642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Returning 404 to user: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 is not attached to volume a015725a-2aec-4f30-811a-94b1f0aba66d {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:36:45.453642 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ba7da735-116c-46ec-96c3-7a6fdbb649eb tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments/a015725a-2aec-4f30-811a-94b1f0aba66d" status: 404 len: 154 microversion: 2.1 time: 0.095207 Sep 10 11:36:45.453642 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2202/6722] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:36:45 2022] DELETE /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619/os-volume_attachments/a015725a-2aec-4f30-811a-94b1f0aba66d => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:36:48.802194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e39dbfcb-46a4-4fae-abf6-b10c31d143b7 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:48.802704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e39dbfcb-46a4-4fae-abf6-b10c31d143b7 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:48.809611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e39dbfcb-46a4-4fae-abf6-b10c31d143b7 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:48.810117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e39dbfcb-46a4-4fae-abf6-b10c31d143b7 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:48.810594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e39dbfcb-46a4-4fae-abf6-b10c31d143b7 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:48.811299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e39dbfcb-46a4-4fae-abf6-b10c31d143b7 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:48.811771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e39dbfcb-46a4-4fae-abf6-b10c31d143b7 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:48.812216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e39dbfcb-46a4-4fae-abf6-b10c31d143b7 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:48.840321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e39dbfcb-46a4-4fae-abf6-b10c31d143b7 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:36:48.925409 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e39dbfcb-46a4-4fae-abf6-b10c31d143b7 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 204 len: 0 microversion: 2.1 time: 0.126357 Sep 10 11:36:48.926283 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4521/6723] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:36:48 2022] DELETE /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:36:48.934276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-744cb141-909a-4028-aad0-ff75161bc3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:48.934913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-744cb141-909a-4028-aad0-ff75161bc3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:48.944701 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-744cb141-909a-4028-aad0-ff75161bc3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:48.945225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-744cb141-909a-4028-aad0-ff75161bc3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:48.945671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-744cb141-909a-4028-aad0-ff75161bc3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:48.946374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-744cb141-909a-4028-aad0-ff75161bc3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:48.946834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-744cb141-909a-4028-aad0-ff75161bc3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:48.947267 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-744cb141-909a-4028-aad0-ff75161bc3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:49.077535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-744cb141-909a-4028-aad0-ff75161bc3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:49.086227 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-744cb141-909a-4028-aad0-ff75161bc3c6 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1560 microversion: 2.1 time: 0.155929 Sep 10 11:36:49.086820 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2203/6724] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:48 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:36:50.110608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7740815f-210f-460b-88ce-a71dee47c368 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:50.111334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7740815f-210f-460b-88ce-a71dee47c368 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:50.118471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7740815f-210f-460b-88ce-a71dee47c368 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:50.118982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7740815f-210f-460b-88ce-a71dee47c368 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:50.119438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7740815f-210f-460b-88ce-a71dee47c368 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:50.120144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7740815f-210f-460b-88ce-a71dee47c368 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:50.120617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7740815f-210f-460b-88ce-a71dee47c368 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:50.121063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7740815f-210f-460b-88ce-a71dee47c368 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:50.253508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7740815f-210f-460b-88ce-a71dee47c368 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:50.261505 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7740815f-210f-460b-88ce-a71dee47c368 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1560 microversion: 2.1 time: 0.155245 Sep 10 11:36:50.262100 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4522/6725] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:50 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:50.912661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-01fc003c-4204-4198-a446-23baf561e81a req-68538767-3085-4665-b851-ffa95dc719b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aded8f-4895-459c-81f4-1d2eb66f9619", "name": "network-vif-deleted", "tag": "3e9f4321-eb05-4fc1-b080-a184c49b0bb6"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:36:50.926447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-01fc003c-4204-4198-a446-23baf561e81a req-68538767-3085-4665-b851-ffa95dc719b6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:50.927199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-01fc003c-4204-4198-a446-23baf561e81a req-68538767-3085-4665-b851-ffa95dc719b6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:50.927620 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-01fc003c-4204-4198-a446-23baf561e81a req-68538767-3085-4665-b851-ffa95dc719b6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:50.940072 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-01fc003c-4204-4198-a446-23baf561e81a req-68538767-3085-4665-b851-ffa95dc719b6 service nova] Creating event network-vif-deleted:3e9f4321-eb05-4fc1-b080-a184c49b0bb6 for instance 49aded8f-4895-459c-81f4-1d2eb66f9619 on n-h1-856894-1 Sep 10 11:36:50.944987 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-01fc003c-4204-4198-a446-23baf561e81a req-68538767-3085-4665-b851-ffa95dc719b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035976 Sep 10 11:36:50.945645 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2204/6726] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:51.285982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:51.286617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:51.293741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:51.294247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:51.294704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:51.295418 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:51.295891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:51.296342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:51.328632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:51.329674 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:51.330128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:51.330603 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lazy-loading 'fault' on Instance uuid 49aded8f-4895-459c-81f4-1d2eb66f9619 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:36:51.375494 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b6f3ef572043bb8ec58db5503a546c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4a2e663a2d498a84167de9da44aab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:36:51.384782 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb5c3fa8-bcee-46a5-996a-228e16e11d05 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 200 len: 1352 microversion: 2.1 time: 0.103299 Sep 10 11:36:51.385429 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4523/6727] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:51 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:52.410249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:52.410939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] [instance: 49aded8f-4895-459c-81f4-1d2eb66f9619] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:36:52.417191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:52.417672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:52.418106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:52.418788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:52.419235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:52.419678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:52.432839 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] HTTP exception thrown: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 could not be found. Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Request method failure captured: Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 HTTP/1.1 Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHZnm5goWMFB8CvabpcZIDM38cWmdVT1lmQ9CxJee_2ewLloaqEgrWbp7CL63sKPQkryNPdolOyMvL1Kw3GmqvfuK4x_o57ltfupOuKxXhXANIAhbs7TEzA59cVA6B0MhiTxeTd5VAj99LVrQpbF_VyrZ9E8G9Ukrh-Z8ef7zLQHYCE Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/af4a2e663a2d498a84167de9da44aab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_af4a2e663a2d498a84167de9da44aab3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: af4a2e663a2d498a84167de9da44aab3 Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-533532553 Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e8b6f3ef572043bb8ec58db5503a546c Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestEncryptedCinderVolumes-533532553-project Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 could not be found. Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '49aded8f-4895-459c-81f4-1d2eb66f9619'} Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 could not be found. Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 could not be found. Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:36:52.434457 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:52.438999 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:36:52.438999 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:36:52.438999 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:36:52.438999 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:36:52.438999 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:36:52.438999 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 could not be found. Sep 10 11:36:52.438999 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:36:52.438999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Returning 404 to user: Instance 49aded8f-4895-459c-81f4-1d2eb66f9619 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:36:52.438999 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-985dce94-d575-4321-8885-a6af9fbf22c9 tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619" status: 404 len: 111 microversion: 2.1 time: 0.031322 Sep 10 11:36:52.438999 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2205/6728] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:36:52 2022] GET /compute/v2.1/servers/49aded8f-4895-459c-81f4-1d2eb66f9619 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:36:52.444412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-df66d021-ca25-491e-8f2b-d760648ef06f tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] Calling method '.version_select at 0x7efcae3dc0d0>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:52.464492 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-df66d021-ca25-491e-8f2b-d760648ef06f tempest-TestEncryptedCinderVolumes-533532553 tempest-TestEncryptedCinderVolumes-533532553-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-992282344" status: 202 len: 0 microversion: 2.1 time: 0.023893 Sep 10 11:36:52.465078 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4524/6729] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Sep 10 11:36:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-992282344 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:37:19.488454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9268f69c-6063-4b77-ba7b-9e6d103c6282 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'create', calling method: .version_select at 0x7efcaf3d2dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1425333217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxlc/B3/MP7hUKOpQhPGroOeNOZVb7gNMT9MdVRErv4hOIBOnBP6M6VBZZl784R1SYMyfob0fsLYH5txkd/wqeKviCUsZm5BwLjSpEWOdQhcueeeDKZGlxp9HRtyOjZMA=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:19.494527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=14 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:19.495178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=34 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:19.508040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-9268f69c-6063-4b77-ba7b-9e6d103c6282 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Getting quotas for project 13c189fe896c4eb2b4969669c0ab289f. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:37:19.512996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-9268f69c-6063-4b77-ba7b-9e6d103c6282 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Getting quotas for user 24e1861b8d914f4e956a9552de25d88b and project 13c189fe896c4eb2b4969669c0ab289f. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:37:19.536392 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9268f69c-6063-4b77-ba7b-9e6d103c6282 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052034 Sep 10 11:37:19.536987 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2206/6730] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:37:19 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:19.588212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-812833650", "imageRef": "b70d9654-a884-49da-830f-5431af2baf9d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1425333217", "networks": [{"uuid": "dc884717-85d5-411f-a53f-2c6591dbd738"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:19.597961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:19.598623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:19.749718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] validate_networks() for [('dc884717-85d5-411f-a53f-2c6591dbd738', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:37:20.118447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:37:20.118888 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:37:20.119376 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:37:20.119803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:37:20.120274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:37:20.129195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:20.129688 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:20.130135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:20.130865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:20.131327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:20.131760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:20.149313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Getting quotas for project 13c189fe896c4eb2b4969669c0ab289f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:37:20.154620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Getting quotas for user 24e1861b8d914f4e956a9552de25d88b and project 13c189fe896c4eb2b4969669c0ab289f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:37:20.167444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:37:20.169749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b70d9654-a884-49da-830f-5431af2baf9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:37:20.215345 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-db6677dc-42e1-4272-90bf-15c287e61200 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631326 Sep 10 11:37:20.216401 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4525/6731] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:37:20.227106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e5ad8acf-e3c5-4de5-be8e-b32d96bd5bf7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:20.227719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e5ad8acf-e3c5-4de5-be8e-b32d96bd5bf7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:20.284269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e5ad8acf-e3c5-4de5-be8e-b32d96bd5bf7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:20.292135 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e5ad8acf-e3c5-4de5-be8e-b32d96bd5bf7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1258 microversion: 2.1 time: 0.068923 Sep 10 11:37:20.292780 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2207/6732] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:20 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:21.321329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-000b63e1-856c-49f1-a219-25637fcc29dc tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:21.321976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-000b63e1-856c-49f1-a219-25637fcc29dc tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:21.329272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-000b63e1-856c-49f1-a219-25637fcc29dc tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:21.329791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-000b63e1-856c-49f1-a219-25637fcc29dc tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:21.330252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-000b63e1-856c-49f1-a219-25637fcc29dc tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:21.330965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-000b63e1-856c-49f1-a219-25637fcc29dc tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:21.331449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-000b63e1-856c-49f1-a219-25637fcc29dc tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:21.331898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-000b63e1-856c-49f1-a219-25637fcc29dc tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:21.402515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-000b63e1-856c-49f1-a219-25637fcc29dc tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:21.411128 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-000b63e1-856c-49f1-a219-25637fcc29dc tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1316 microversion: 2.1 time: 0.094833 Sep 10 11:37:21.421657 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4526/6733] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:21 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:22.435946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ffde7d5e-25a0-46d0-b649-64f03f0a0230 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:22.436570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ffde7d5e-25a0-46d0-b649-64f03f0a0230 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:22.443235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffde7d5e-25a0-46d0-b649-64f03f0a0230 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:22.443729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffde7d5e-25a0-46d0-b649-64f03f0a0230 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:22.445376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffde7d5e-25a0-46d0-b649-64f03f0a0230 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:22.446157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffde7d5e-25a0-46d0-b649-64f03f0a0230 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:22.446636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffde7d5e-25a0-46d0-b649-64f03f0a0230 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:22.447079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ffde7d5e-25a0-46d0-b649-64f03f0a0230 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:22.590388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ffde7d5e-25a0-46d0-b649-64f03f0a0230 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:22.603167 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ffde7d5e-25a0-46d0-b649-64f03f0a0230 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.171190 Sep 10 11:37:22.604596 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2208/6734] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:22 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:23.627358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1a6b649-ab25-4d38-a9f6-15aa5010e5ea tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:23.628159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1a6b649-ab25-4d38-a9f6-15aa5010e5ea tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:23.637194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1a6b649-ab25-4d38-a9f6-15aa5010e5ea tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:23.637707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1a6b649-ab25-4d38-a9f6-15aa5010e5ea tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:23.638160 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1a6b649-ab25-4d38-a9f6-15aa5010e5ea tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:23.638876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1a6b649-ab25-4d38-a9f6-15aa5010e5ea tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:23.639342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1a6b649-ab25-4d38-a9f6-15aa5010e5ea tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:23.639781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1a6b649-ab25-4d38-a9f6-15aa5010e5ea tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:23.790738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1a6b649-ab25-4d38-a9f6-15aa5010e5ea tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:23.800328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1a6b649-ab25-4d38-a9f6-15aa5010e5ea tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.177207 Sep 10 11:37:23.801098 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4527/6735] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:23 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:24.823818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-37648cdb-1351-44f9-988d-1c4dbc395a60 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:24.824421 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-37648cdb-1351-44f9-988d-1c4dbc395a60 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:24.832108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37648cdb-1351-44f9-988d-1c4dbc395a60 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:24.832610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37648cdb-1351-44f9-988d-1c4dbc395a60 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:24.833037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37648cdb-1351-44f9-988d-1c4dbc395a60 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:24.833790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37648cdb-1351-44f9-988d-1c4dbc395a60 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:24.834253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37648cdb-1351-44f9-988d-1c4dbc395a60 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:24.834698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-37648cdb-1351-44f9-988d-1c4dbc395a60 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:24.981185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-37648cdb-1351-44f9-988d-1c4dbc395a60 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:24.989435 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-37648cdb-1351-44f9-988d-1c4dbc395a60 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.169463 Sep 10 11:37:24.990027 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2209/6736] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:24 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:26.013635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8e3656fd-b243-49a0-bd88-8e181104b0fd tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:26.014319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8e3656fd-b243-49a0-bd88-8e181104b0fd tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:26.022541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e3656fd-b243-49a0-bd88-8e181104b0fd tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:26.023055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e3656fd-b243-49a0-bd88-8e181104b0fd tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:26.023512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e3656fd-b243-49a0-bd88-8e181104b0fd tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:26.024245 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e3656fd-b243-49a0-bd88-8e181104b0fd tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:26.024716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e3656fd-b243-49a0-bd88-8e181104b0fd tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:26.025188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8e3656fd-b243-49a0-bd88-8e181104b0fd tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:26.170643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8e3656fd-b243-49a0-bd88-8e181104b0fd tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:26.179600 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8e3656fd-b243-49a0-bd88-8e181104b0fd tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.170370 Sep 10 11:37:26.180553 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4528/6737] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:26 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:27.202151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c57a303f-2071-441c-893d-534bba5e5f07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:27.202817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c57a303f-2071-441c-893d-534bba5e5f07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:27.209925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c57a303f-2071-441c-893d-534bba5e5f07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:27.210423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c57a303f-2071-441c-893d-534bba5e5f07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:27.210869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c57a303f-2071-441c-893d-534bba5e5f07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:27.211583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c57a303f-2071-441c-893d-534bba5e5f07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:27.212043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c57a303f-2071-441c-893d-534bba5e5f07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:27.212515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c57a303f-2071-441c-893d-534bba5e5f07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:27.352262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c57a303f-2071-441c-893d-534bba5e5f07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:27.360447 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c57a303f-2071-441c-893d-534bba5e5f07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.162247 Sep 10 11:37:27.361265 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2210/6738] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:27 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:28.383998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a27cd064-2585-4d75-aa2b-c4642b8eef12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:28.385161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a27cd064-2585-4d75-aa2b-c4642b8eef12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:28.392799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27cd064-2585-4d75-aa2b-c4642b8eef12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:28.393327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27cd064-2585-4d75-aa2b-c4642b8eef12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:28.393784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27cd064-2585-4d75-aa2b-c4642b8eef12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:28.394502 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27cd064-2585-4d75-aa2b-c4642b8eef12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:28.394974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27cd064-2585-4d75-aa2b-c4642b8eef12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:28.395420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a27cd064-2585-4d75-aa2b-c4642b8eef12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:28.539471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a27cd064-2585-4d75-aa2b-c4642b8eef12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:28.548582 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a27cd064-2585-4d75-aa2b-c4642b8eef12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.169254 Sep 10 11:37:28.549327 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4529/6739] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:28 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:29.580664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f1febb06-2881-432f-adc4-ea836c2b0c76 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:29.581289 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f1febb06-2881-432f-adc4-ea836c2b0c76 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:29.588596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1febb06-2881-432f-adc4-ea836c2b0c76 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:29.590019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1febb06-2881-432f-adc4-ea836c2b0c76 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:29.590019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1febb06-2881-432f-adc4-ea836c2b0c76 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:29.590245 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1febb06-2881-432f-adc4-ea836c2b0c76 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:29.590700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1febb06-2881-432f-adc4-ea836c2b0c76 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:29.591126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f1febb06-2881-432f-adc4-ea836c2b0c76 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:29.728132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f1febb06-2881-432f-adc4-ea836c2b0c76 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:29.736663 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f1febb06-2881-432f-adc4-ea836c2b0c76 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.160659 Sep 10 11:37:29.737280 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2211/6740] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:29 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:29.935063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-896ad1bf-40f9-439a-84cf-e7b4ec5c5c1c req-d8f24c2f-d653-4715-ad00-68674a7b0af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9507c3-69b8-41c4-b70f-46d09f80e673", "tag": "5b20adfe-4471-449e-b5f9-d1eec14b4ffc"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:29.946964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-896ad1bf-40f9-439a-84cf-e7b4ec5c5c1c req-d8f24c2f-d653-4715-ad00-68674a7b0af1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:29.947718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-896ad1bf-40f9-439a-84cf-e7b4ec5c5c1c req-d8f24c2f-d653-4715-ad00-68674a7b0af1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:29.948328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-896ad1bf-40f9-439a-84cf-e7b4ec5c5c1c req-d8f24c2f-d653-4715-ad00-68674a7b0af1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:29.959862 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-896ad1bf-40f9-439a-84cf-e7b4ec5c5c1c req-d8f24c2f-d653-4715-ad00-68674a7b0af1 service nova] Creating event network-changed:5b20adfe-4471-449e-b5f9-d1eec14b4ffc for instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 on n-h1-856894-1 Sep 10 11:37:29.964886 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-896ad1bf-40f9-439a-84cf-e7b4ec5c5c1c req-d8f24c2f-d653-4715-ad00-68674a7b0af1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033630 Sep 10 11:37:29.965534 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4530/6741] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:37:30.760122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-633a9464-51fd-492c-b962-821425490779 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:30.760776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-633a9464-51fd-492c-b962-821425490779 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:30.762703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:30.769684 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-633a9464-51fd-492c-b962-821425490779 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:30.770168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-633a9464-51fd-492c-b962-821425490779 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:30.770608 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-633a9464-51fd-492c-b962-821425490779 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:30.771327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-633a9464-51fd-492c-b962-821425490779 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:30.771786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-633a9464-51fd-492c-b962-821425490779 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:30.772218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-633a9464-51fd-492c-b962-821425490779 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:30.905369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-633a9464-51fd-492c-b962-821425490779 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:30.913781 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-633a9464-51fd-492c-b962-821425490779 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.157549 Sep 10 11:37:30.914356 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2212/6742] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:30 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:31.934652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:31.935434 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:31.940881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab0572bf-b9be-4bdb-bdfb-d591924d6ede tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:31.941653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab0572bf-b9be-4bdb-bdfb-d591924d6ede tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:31.948542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0572bf-b9be-4bdb-bdfb-d591924d6ede tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:31.952077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0572bf-b9be-4bdb-bdfb-d591924d6ede tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:31.952550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0572bf-b9be-4bdb-bdfb-d591924d6ede tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:31.953827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0572bf-b9be-4bdb-bdfb-d591924d6ede tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:31.954309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0572bf-b9be-4bdb-bdfb-d591924d6ede tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:31.954762 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab0572bf-b9be-4bdb-bdfb-d591924d6ede tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:32.087172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ab0572bf-b9be-4bdb-bdfb-d591924d6ede tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:32.095741 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab0572bf-b9be-4bdb-bdfb-d591924d6ede tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.162028 Sep 10 11:37:32.096426 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4531/6743] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:31 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:33.117532 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-604c6957-e613-4851-858f-100b4c496528 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:33.118150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-604c6957-e613-4851-858f-100b4c496528 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:33.125376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-604c6957-e613-4851-858f-100b4c496528 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:33.125870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-604c6957-e613-4851-858f-100b4c496528 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:33.126342 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-604c6957-e613-4851-858f-100b4c496528 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:33.127037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-604c6957-e613-4851-858f-100b4c496528 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:33.127500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-604c6957-e613-4851-858f-100b4c496528 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:33.127931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-604c6957-e613-4851-858f-100b4c496528 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:33.253739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-604c6957-e613-4851-858f-100b4c496528 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:33.261700 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-604c6957-e613-4851-858f-100b4c496528 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.148016 Sep 10 11:37:33.262281 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2213/6744] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:33 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:34.078852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-730f32eb-8f15-4df6-a7b8-295bc5dbe22d req-dc0e9e2a-2a56-4cb1-adeb-3a4437585fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9507c3-69b8-41c4-b70f-46d09f80e673", "name": "network-vif-plugged", "status": "completed", "tag": "5b20adfe-4471-449e-b5f9-d1eec14b4ffc"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:34.089164 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-730f32eb-8f15-4df6-a7b8-295bc5dbe22d req-dc0e9e2a-2a56-4cb1-adeb-3a4437585fd7 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:34.089620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-730f32eb-8f15-4df6-a7b8-295bc5dbe22d req-dc0e9e2a-2a56-4cb1-adeb-3a4437585fd7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:34.090172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-730f32eb-8f15-4df6-a7b8-295bc5dbe22d req-dc0e9e2a-2a56-4cb1-adeb-3a4437585fd7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:34.102332 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-730f32eb-8f15-4df6-a7b8-295bc5dbe22d req-dc0e9e2a-2a56-4cb1-adeb-3a4437585fd7 service nova] Creating event network-vif-plugged:5b20adfe-4471-449e-b5f9-d1eec14b4ffc for instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 on n-h1-856894-1 Sep 10 11:37:34.107198 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-730f32eb-8f15-4df6-a7b8-295bc5dbe22d req-dc0e9e2a-2a56-4cb1-adeb-3a4437585fd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032666 Sep 10 11:37:34.107805 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4532/6745] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:37:34.284000 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d9592aa-fec9-47f4-8467-b1bd04c074fb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:34.284693 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2d9592aa-fec9-47f4-8467-b1bd04c074fb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:34.291454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d9592aa-fec9-47f4-8467-b1bd04c074fb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:34.291936 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d9592aa-fec9-47f4-8467-b1bd04c074fb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:34.292392 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d9592aa-fec9-47f4-8467-b1bd04c074fb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:34.293109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d9592aa-fec9-47f4-8467-b1bd04c074fb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:34.293568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d9592aa-fec9-47f4-8467-b1bd04c074fb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:34.293995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d9592aa-fec9-47f4-8467-b1bd04c074fb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:34.422941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d9592aa-fec9-47f4-8467-b1bd04c074fb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:34.430908 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d9592aa-fec9-47f4-8467-b1bd04c074fb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1358 microversion: 2.1 time: 0.150902 Sep 10 11:37:34.431486 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2214/6746] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:34 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:35.455015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-19b0b89d-22b4-4790-b7df-0f087fbac698 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:35.455686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-19b0b89d-22b4-4790-b7df-0f087fbac698 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:35.461812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19b0b89d-22b4-4790-b7df-0f087fbac698 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:35.462309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19b0b89d-22b4-4790-b7df-0f087fbac698 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:35.462758 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19b0b89d-22b4-4790-b7df-0f087fbac698 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:35.463452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19b0b89d-22b4-4790-b7df-0f087fbac698 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:35.463921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19b0b89d-22b4-4790-b7df-0f087fbac698 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:35.464360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-19b0b89d-22b4-4790-b7df-0f087fbac698 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:35.594136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-19b0b89d-22b4-4790-b7df-0f087fbac698 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:35.602032 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-19b0b89d-22b4-4790-b7df-0f087fbac698 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1548 microversion: 2.1 time: 0.152309 Sep 10 11:37:35.602612 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4533/6747] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:35 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:35.625254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6e731dd5-8e06-4c23-b862-9082f20f7e6f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:35.625879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6e731dd5-8e06-4c23-b862-9082f20f7e6f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:35.632660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e731dd5-8e06-4c23-b862-9082f20f7e6f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:35.633180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e731dd5-8e06-4c23-b862-9082f20f7e6f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:35.633623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e731dd5-8e06-4c23-b862-9082f20f7e6f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:35.634311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e731dd5-8e06-4c23-b862-9082f20f7e6f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:35.634768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e731dd5-8e06-4c23-b862-9082f20f7e6f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:35.635196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e731dd5-8e06-4c23-b862-9082f20f7e6f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:35.768524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6e731dd5-8e06-4c23-b862-9082f20f7e6f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:35.781698 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6e731dd5-8e06-4c23-b862-9082f20f7e6f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1548 microversion: 2.1 time: 0.159127 Sep 10 11:37:35.782336 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2215/6748] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:35 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:35.803659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:35.808393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:35.809224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Searching by: {'deleted': False, 'project_id': '13c189fe896c4eb2b4969669c0ab289f'} {{(pid=128788) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:37:35.814429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:35.814916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:35.815362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:35.816093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:35.816595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:35.817034 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:35.844405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.multi_cell_list [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:37:35.871434 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4757a042-053c-483c-bfce-38c66f5b4a05 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.071803 Sep 10 11:37:35.872059 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4534/6749] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 11:37:35 2022] GET /compute/v2.1/servers => generated 342 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:35.883551 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a47b9396-d91e-4a72-a6a6-59519814a41f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:35.884163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a47b9396-d91e-4a72-a6a6-59519814a41f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:35.889932 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a47b9396-d91e-4a72-a6a6-59519814a41f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:35.890941 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a47b9396-d91e-4a72-a6a6-59519814a41f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:35.891377 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a47b9396-d91e-4a72-a6a6-59519814a41f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:35.892055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a47b9396-d91e-4a72-a6a6-59519814a41f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:35.892538 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a47b9396-d91e-4a72-a6a6-59519814a41f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:35.893364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a47b9396-d91e-4a72-a6a6-59519814a41f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:36.023686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a47b9396-d91e-4a72-a6a6-59519814a41f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:36.031559 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a47b9396-d91e-4a72-a6a6-59519814a41f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1548 microversion: 2.1 time: 0.151816 Sep 10 11:37:36.032136 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2216/6750] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:35 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:37:37.572800 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a6a3c309-5077-438b-93cd-ef14507f99d1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d471fc5-d496-4698-9273-10c5cbc8a2e9"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:37.576312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a6a3c309-5077-438b-93cd-ef14507f99d1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:37.584839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6a3c309-5077-438b-93cd-ef14507f99d1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:37.585377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6a3c309-5077-438b-93cd-ef14507f99d1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:37.585833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6a3c309-5077-438b-93cd-ef14507f99d1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:37.586540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6a3c309-5077-438b-93cd-ef14507f99d1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:37.587013 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6a3c309-5077-438b-93cd-ef14507f99d1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:37.587489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a6a3c309-5077-438b-93cd-ef14507f99d1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:37.821332 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a6a3c309-5077-438b-93cd-ef14507f99d1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252553 Sep 10 11:37:37.822015 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4535/6751] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:37:37 2022] POST /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:51.054985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-17df92b6-0a6c-4b64-9b11-a0bc3099ced6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:51.055603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-17df92b6-0a6c-4b64-9b11-a0bc3099ced6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:51.057842 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:51.058489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=54 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:51.064697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17df92b6-0a6c-4b64-9b11-a0bc3099ced6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:51.065209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17df92b6-0a6c-4b64-9b11-a0bc3099ced6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:51.065647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17df92b6-0a6c-4b64-9b11-a0bc3099ced6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:51.066365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17df92b6-0a6c-4b64-9b11-a0bc3099ced6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:51.066818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17df92b6-0a6c-4b64-9b11-a0bc3099ced6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:51.067268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17df92b6-0a6c-4b64-9b11-a0bc3099ced6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:51.198181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-17df92b6-0a6c-4b64-9b11-a0bc3099ced6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:51.206522 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-17df92b6-0a6c-4b64-9b11-a0bc3099ced6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1594 microversion: 2.1 time: 0.155840 Sep 10 11:37:51.207037 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2217/6752] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:51 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:52.867923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:52.868692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:52.869437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:52.939851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-890f35cc-67e1-4cf3-8a8f-189186ddb235 req-67274b41-2c2b-4f47-a88e-41da94d9c492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9507c3-69b8-41c4-b70f-46d09f80e673", "tag": "5b20adfe-4471-449e-b5f9-d1eec14b4ffc"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:52.951440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-890f35cc-67e1-4cf3-8a8f-189186ddb235 req-67274b41-2c2b-4f47-a88e-41da94d9c492 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:52.952002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-890f35cc-67e1-4cf3-8a8f-189186ddb235 req-67274b41-2c2b-4f47-a88e-41da94d9c492 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:52.952478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-890f35cc-67e1-4cf3-8a8f-189186ddb235 req-67274b41-2c2b-4f47-a88e-41da94d9c492 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:52.964885 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-890f35cc-67e1-4cf3-8a8f-189186ddb235 req-67274b41-2c2b-4f47-a88e-41da94d9c492 service nova] Creating event network-changed:5b20adfe-4471-449e-b5f9-d1eec14b4ffc for instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 on n-h1-856894-1 Sep 10 11:37:52.973317 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-890f35cc-67e1-4cf3-8a8f-189186ddb235 req-67274b41-2c2b-4f47-a88e-41da94d9c492 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110320 Sep 10 11:37:52.974382 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4536/6753] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:53.908191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d6c5a42c-a8dd-419c-8ed8-49ec70ca9a7e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1138199530"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:53.908759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d6c5a42c-a8dd-419c-8ed8-49ec70ca9a7e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:53.916835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6c5a42c-a8dd-419c-8ed8-49ec70ca9a7e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:53.917459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6c5a42c-a8dd-419c-8ed8-49ec70ca9a7e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:53.918136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6c5a42c-a8dd-419c-8ed8-49ec70ca9a7e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:53.919100 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6c5a42c-a8dd-419c-8ed8-49ec70ca9a7e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:53.919636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6c5a42c-a8dd-419c-8ed8-49ec70ca9a7e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:53.920093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6c5a42c-a8dd-419c-8ed8-49ec70ca9a7e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:54.069025 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.network.security_group_api [None req-d6c5a42c-a8dd-419c-8ed8-49ec70ca9a7e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Adding security group 78ffbdc3-5ba7-4660-a27c-b75f99bd81db to port 5b20adfe-4471-449e-b5f9-d1eec14b4ffc Sep 10 11:37:54.383149 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d6c5a42c-a8dd-419c-8ed8-49ec70ca9a7e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/action" status: 202 len: 0 microversion: 2.1 time: 0.479493 Sep 10 11:37:54.384382 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2218/6754] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:37:53 2022] POST /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:37:54.394103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d5b1ad0-ab0a-4fba-95f4-c44a2f6ac7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:54.395120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d5b1ad0-ab0a-4fba-95f4-c44a2f6ac7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:54.402639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d5b1ad0-ab0a-4fba-95f4-c44a2f6ac7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:54.403288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d5b1ad0-ab0a-4fba-95f4-c44a2f6ac7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:54.404086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d5b1ad0-ab0a-4fba-95f4-c44a2f6ac7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:54.405093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d5b1ad0-ab0a-4fba-95f4-c44a2f6ac7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:54.405833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d5b1ad0-ab0a-4fba-95f4-c44a2f6ac7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:54.406558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d5b1ad0-ab0a-4fba-95f4-c44a2f6ac7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:54.557308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d5b1ad0-ab0a-4fba-95f4-c44a2f6ac7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:54.566050 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d5b1ad0-ab0a-4fba-95f4-c44a2f6ac7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1760 microversion: 2.1 time: 0.177043 Sep 10 11:37:54.566642 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4537/6755] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:54 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1760 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:54.990315 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-31fbaa18-02eb-46ef-b67b-368f8abc1186 req-836d9839-ea75-4ea9-88f6-b23ac4b632f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9507c3-69b8-41c4-b70f-46d09f80e673", "tag": "5b20adfe-4471-449e-b5f9-d1eec14b4ffc"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:54.999812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-31fbaa18-02eb-46ef-b67b-368f8abc1186 req-836d9839-ea75-4ea9-88f6-b23ac4b632f2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:55.000778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-31fbaa18-02eb-46ef-b67b-368f8abc1186 req-836d9839-ea75-4ea9-88f6-b23ac4b632f2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:55.001249 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-31fbaa18-02eb-46ef-b67b-368f8abc1186 req-836d9839-ea75-4ea9-88f6-b23ac4b632f2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:55.012273 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-31fbaa18-02eb-46ef-b67b-368f8abc1186 req-836d9839-ea75-4ea9-88f6-b23ac4b632f2 service nova] Creating event network-changed:5b20adfe-4471-449e-b5f9-d1eec14b4ffc for instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 on n-h1-856894-1 Sep 10 11:37:55.018116 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-31fbaa18-02eb-46ef-b67b-368f8abc1186 req-836d9839-ea75-4ea9-88f6-b23ac4b632f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032568 Sep 10 11:37:55.018698 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2219/6756] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:39:32.620343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:32.621235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=8 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:32.622711 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:39:32.622873 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 11:39:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/action (ip 10.222.0.20) !!! Sep 10 11:39:32.627257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23fd5b84-6330-4d3a-8519-463353465269 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:32.629632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23fd5b84-6330-4d3a-8519-463353465269 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:32.638382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23fd5b84-6330-4d3a-8519-463353465269 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:32.638887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23fd5b84-6330-4d3a-8519-463353465269 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:32.639341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23fd5b84-6330-4d3a-8519-463353465269 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:32.640056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23fd5b84-6330-4d3a-8519-463353465269 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:32.640531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23fd5b84-6330-4d3a-8519-463353465269 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:32.640980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23fd5b84-6330-4d3a-8519-463353465269 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:32.714650 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23fd5b84-6330-4d3a-8519-463353465269 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/action" status: 202 len: 0 microversion: 2.1 time: 0.096065 Sep 10 11:39:32.718432 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4538/6757] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:39:32 2022] POST /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:32.723367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:32.724805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=12 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:32.725973 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:39:32.726263 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 11:39:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 (ip 10.222.0.20) !!! Sep 10 11:39:32.732352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1655a018-8ae7-4bd4-950d-95e3b9a8e79c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:32.733095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1655a018-8ae7-4bd4-950d-95e3b9a8e79c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:32.741164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1655a018-8ae7-4bd4-950d-95e3b9a8e79c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:32.741647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1655a018-8ae7-4bd4-950d-95e3b9a8e79c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:32.742095 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1655a018-8ae7-4bd4-950d-95e3b9a8e79c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:32.742800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1655a018-8ae7-4bd4-950d-95e3b9a8e79c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:32.743262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1655a018-8ae7-4bd4-950d-95e3b9a8e79c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:32.743695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1655a018-8ae7-4bd4-950d-95e3b9a8e79c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:33.263752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1655a018-8ae7-4bd4-950d-95e3b9a8e79c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:33.272233 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1655a018-8ae7-4bd4-950d-95e3b9a8e79c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1762 microversion: 2.1 time: 0.552247 Sep 10 11:39:33.272820 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2220/6758] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:32 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1762 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:34.296427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6bb854e-fb85-4ce0-9ca5-2df994c355d7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:34.297198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d6bb854e-fb85-4ce0-9ca5-2df994c355d7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:34.304683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6bb854e-fb85-4ce0-9ca5-2df994c355d7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:34.305212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6bb854e-fb85-4ce0-9ca5-2df994c355d7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:34.305663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6bb854e-fb85-4ce0-9ca5-2df994c355d7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:34.306359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6bb854e-fb85-4ce0-9ca5-2df994c355d7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:34.306827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6bb854e-fb85-4ce0-9ca5-2df994c355d7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:34.307262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d6bb854e-fb85-4ce0-9ca5-2df994c355d7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:34.450431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d6bb854e-fb85-4ce0-9ca5-2df994c355d7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:34.459595 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6bb854e-fb85-4ce0-9ca5-2df994c355d7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1760 microversion: 2.1 time: 0.167687 Sep 10 11:39:34.460182 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4539/6759] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:34 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:47.426431 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:47.427468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:47.432139 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5a31a08f-01d7-4d84-8413-93331e890b8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1138199530"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:47.432675 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5a31a08f-01d7-4d84-8413-93331e890b8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:47.439281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a31a08f-01d7-4d84-8413-93331e890b8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:47.439759 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a31a08f-01d7-4d84-8413-93331e890b8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:47.440835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a31a08f-01d7-4d84-8413-93331e890b8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:47.441610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a31a08f-01d7-4d84-8413-93331e890b8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:47.442065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a31a08f-01d7-4d84-8413-93331e890b8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:47.442486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5a31a08f-01d7-4d84-8413-93331e890b8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:47.570838 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.network.security_group_api [None req-5a31a08f-01d7-4d84-8413-93331e890b8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Removing security group 78ffbdc3-5ba7-4660-a27c-b75f99bd81db from port 5b20adfe-4471-449e-b5f9-d1eec14b4ffc Sep 10 11:40:47.891599 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5a31a08f-01d7-4d84-8413-93331e890b8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/action" status: 202 len: 0 microversion: 2.1 time: 0.467101 Sep 10 11:40:47.892010 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2221/6760] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:40:47 2022] POST /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:40:47.902258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:47.903459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:47.907541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-78ddfaa0-7643-4fa0-91e7-3feb47adc9e2 req-1b756ab5-f826-426e-b8ab-02f93790987a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9507c3-69b8-41c4-b70f-46d09f80e673", "tag": "5b20adfe-4471-449e-b5f9-d1eec14b4ffc"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:47.931795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-78ddfaa0-7643-4fa0-91e7-3feb47adc9e2 req-1b756ab5-f826-426e-b8ab-02f93790987a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:47.932397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-78ddfaa0-7643-4fa0-91e7-3feb47adc9e2 req-1b756ab5-f826-426e-b8ab-02f93790987a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:47.933286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-78ddfaa0-7643-4fa0-91e7-3feb47adc9e2 req-1b756ab5-f826-426e-b8ab-02f93790987a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:47.962594 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-78ddfaa0-7643-4fa0-91e7-3feb47adc9e2 req-1b756ab5-f826-426e-b8ab-02f93790987a service nova] Creating event network-changed:5b20adfe-4471-449e-b5f9-d1eec14b4ffc for instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 on n-h1-856894-1 Sep 10 11:40:47.970798 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-78ddfaa0-7643-4fa0-91e7-3feb47adc9e2 req-1b756ab5-f826-426e-b8ab-02f93790987a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070465 Sep 10 11:40:47.973476 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4540/6761] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:49.388956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4050513c-d866-40b8-b89b-18287aa914e0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:49.390637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4050513c-d866-40b8-b89b-18287aa914e0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:49.398358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4050513c-d866-40b8-b89b-18287aa914e0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:49.399261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4050513c-d866-40b8-b89b-18287aa914e0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:49.399952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4050513c-d866-40b8-b89b-18287aa914e0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:49.400787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4050513c-d866-40b8-b89b-18287aa914e0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:49.401518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4050513c-d866-40b8-b89b-18287aa914e0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:49.402202 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4050513c-d866-40b8-b89b-18287aa914e0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:49.431719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-edc4b716-fc3b-4876-84e0-8e2d549ee474 req-405fd90c-0215-41de-8742-a02077261e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9507c3-69b8-41c4-b70f-46d09f80e673", "tag": "5b20adfe-4471-449e-b5f9-d1eec14b4ffc"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:49.442307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-edc4b716-fc3b-4876-84e0-8e2d549ee474 req-405fd90c-0215-41de-8742-a02077261e5f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:49.442792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-edc4b716-fc3b-4876-84e0-8e2d549ee474 req-405fd90c-0215-41de-8742-a02077261e5f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:49.443227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-edc4b716-fc3b-4876-84e0-8e2d549ee474 req-405fd90c-0215-41de-8742-a02077261e5f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:49.455532 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-edc4b716-fc3b-4876-84e0-8e2d549ee474 req-405fd90c-0215-41de-8742-a02077261e5f service nova] Creating event network-changed:5b20adfe-4471-449e-b5f9-d1eec14b4ffc for instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 on n-h1-856894-1 Sep 10 11:40:49.461287 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-edc4b716-fc3b-4876-84e0-8e2d549ee474 req-405fd90c-0215-41de-8742-a02077261e5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119956 Sep 10 11:40:49.461896 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2222/6762] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:49.499577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-4050513c-d866-40b8-b89b-18287aa914e0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lazy-loading 'services' on Instance uuid 3f9507c3-69b8-41c4-b70f-46d09f80e673 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:49.576624 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4050513c-d866-40b8-b89b-18287aa914e0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments/2d471fc5-d496-4698-9273-10c5cbc8a2e9" status: 202 len: 0 microversion: 2.1 time: 0.193717 Sep 10 11:40:49.580962 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4541/6763] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:40:49 2022] DELETE /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments/2d471fc5-d496-4698-9273-10c5cbc8a2e9 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:40:49.587124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-269ecc5b-015f-4cba-893e-5860e39a6e10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:49.590322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-269ecc5b-015f-4cba-893e-5860e39a6e10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:49.599012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-269ecc5b-015f-4cba-893e-5860e39a6e10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:49.599787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-269ecc5b-015f-4cba-893e-5860e39a6e10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:49.600435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-269ecc5b-015f-4cba-893e-5860e39a6e10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:49.601255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-269ecc5b-015f-4cba-893e-5860e39a6e10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:49.601718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-269ecc5b-015f-4cba-893e-5860e39a6e10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:49.602161 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-269ecc5b-015f-4cba-893e-5860e39a6e10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:49.642117 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-269ecc5b-015f-4cba-893e-5860e39a6e10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059309 Sep 10 11:40:49.643790 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2223/6764] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:40:49 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:50.657460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eaf9ac39-1fc9-4cc5-b802-fb26ce46a7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:50.660294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eaf9ac39-1fc9-4cc5-b802-fb26ce46a7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:50.666734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaf9ac39-1fc9-4cc5-b802-fb26ce46a7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:50.667237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaf9ac39-1fc9-4cc5-b802-fb26ce46a7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:50.667686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaf9ac39-1fc9-4cc5-b802-fb26ce46a7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:50.668393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaf9ac39-1fc9-4cc5-b802-fb26ce46a7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:50.668860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaf9ac39-1fc9-4cc5-b802-fb26ce46a7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:50.669324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eaf9ac39-1fc9-4cc5-b802-fb26ce46a7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:50.699906 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eaf9ac39-1fc9-4cc5-b802-fb26ce46a7df tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047704 Sep 10 11:40:50.700486 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4542/6765] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:40:50 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:51.712849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4b6f0c06-d88a-4284-88a6-79db241478f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:51.715072 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4b6f0c06-d88a-4284-88a6-79db241478f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:51.721672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b6f0c06-d88a-4284-88a6-79db241478f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:51.722156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b6f0c06-d88a-4284-88a6-79db241478f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:51.722599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b6f0c06-d88a-4284-88a6-79db241478f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:51.723295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b6f0c06-d88a-4284-88a6-79db241478f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:51.723753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b6f0c06-d88a-4284-88a6-79db241478f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:51.724181 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b6f0c06-d88a-4284-88a6-79db241478f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:51.753519 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4b6f0c06-d88a-4284-88a6-79db241478f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Sep 10 11:40:51.754092 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2224/6766] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:40:51 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:52.766337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1813c2b-6674-4cea-ae1c-3756d7679718 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:52.769024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1813c2b-6674-4cea-ae1c-3756d7679718 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:52.775921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1813c2b-6674-4cea-ae1c-3756d7679718 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:52.776422 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1813c2b-6674-4cea-ae1c-3756d7679718 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:52.776874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1813c2b-6674-4cea-ae1c-3756d7679718 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:52.777613 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1813c2b-6674-4cea-ae1c-3756d7679718 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:52.778085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1813c2b-6674-4cea-ae1c-3756d7679718 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:52.778546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1813c2b-6674-4cea-ae1c-3756d7679718 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:52.808123 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1813c2b-6674-4cea-ae1c-3756d7679718 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 Sep 10 11:40:52.808694 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4543/6767] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:40:52 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:53.820025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a07a1724-b8b7-4f9d-863f-5550ce614558 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:53.822260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a07a1724-b8b7-4f9d-863f-5550ce614558 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:53.828958 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a07a1724-b8b7-4f9d-863f-5550ce614558 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:53.829471 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a07a1724-b8b7-4f9d-863f-5550ce614558 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:53.829903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a07a1724-b8b7-4f9d-863f-5550ce614558 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:53.830592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a07a1724-b8b7-4f9d-863f-5550ce614558 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:53.831042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a07a1724-b8b7-4f9d-863f-5550ce614558 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:53.831467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a07a1724-b8b7-4f9d-863f-5550ce614558 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:53.865511 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a07a1724-b8b7-4f9d-863f-5550ce614558 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049441 Sep 10 11:40:53.866109 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2225/6768] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:40:53 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:54.877792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-65105575-b28c-4a41-890d-1ad6457121d4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:54.880471 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-65105575-b28c-4a41-890d-1ad6457121d4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:54.887572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65105575-b28c-4a41-890d-1ad6457121d4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.888072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65105575-b28c-4a41-890d-1ad6457121d4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.888522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65105575-b28c-4a41-890d-1ad6457121d4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.889259 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65105575-b28c-4a41-890d-1ad6457121d4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.889727 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65105575-b28c-4a41-890d-1ad6457121d4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.890166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-65105575-b28c-4a41-890d-1ad6457121d4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.919572 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-65105575-b28c-4a41-890d-1ad6457121d4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045792 Sep 10 11:40:54.920245 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4544/6769] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:40:54 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:54.931484 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:54.932019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:54.938968 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.939480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.939920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.940625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.941617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.942371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:55.018398 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] HTTP exception thrown: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 is not attached to volume 2d471fc5-d496-4698-9273-10c5cbc8a2e9 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Request method failure captured: Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: request: DELETE /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments/2d471fc5-d496-4698-9273-10c5cbc8a2e9 HTTP/1.1 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHbg4-o7-xNnDPzuHipfa71iwCEYnlWSdKxhqugzl4s4mUlITW39lwx35cFX55ln8xgxhXgN4LuHlndosOh3Ff6h_SEDY5we5gHCChFnvxdwaaTRFBP_aHa3IxL6T_Nx1osnfXp5cQRWMnJUsQXqWwFZ4HqGDAAPOXP-iXwLu7Imiw0 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 13c189fe896c4eb2b4969669c0ab289f Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13c189fe896c4eb2b4969669c0ab289f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 13c189fe896c4eb2b4969669c0ab289f Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestMinimumBasicScenario-2014934730-project Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 24e1861b8d914f4e956a9552de25d88b Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestMinimumBasicScenario-2014934730-project Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 is not attached to volume 2d471fc5-d496-4698-9273-10c5cbc8a2e9 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'server_id': '3f9507c3-69b8-41c4-b70f-46d09f80e673', 'id': '2d471fc5-d496-4698-9273-10c5cbc8a2e9'} Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2d471fc5-d496-4698-9273-10c5cbc8a2e9. Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 is not attached to volume 2d471fc5-d496-4698-9273-10c5cbc8a2e9 Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:40:55.020728 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:40:55.024744 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:40:55.024744 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:40:55.024744 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 is not attached to volume 2d471fc5-d496-4698-9273-10c5cbc8a2e9 Sep 10 11:40:55.024744 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:40:55.024744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Returning 404 to user: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 is not attached to volume 2d471fc5-d496-4698-9273-10c5cbc8a2e9 {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:40:55.024744 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-85f6ec48-24b3-4ee0-bc8a-71a564c0a1c6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments/2d471fc5-d496-4698-9273-10c5cbc8a2e9" status: 404 len: 154 microversion: 2.1 time: 0.094989 Sep 10 11:40:55.024744 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2226/6770] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:40:54 2022] DELETE /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673/os-volume_attachments/2d471fc5-d496-4698-9273-10c5cbc8a2e9 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:40:58.272427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e50c204e-5946-438d-a8d5-17182f55faf5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:58.273018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e50c204e-5946-438d-a8d5-17182f55faf5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:58.280350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e50c204e-5946-438d-a8d5-17182f55faf5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:58.280861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e50c204e-5946-438d-a8d5-17182f55faf5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:58.281340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e50c204e-5946-438d-a8d5-17182f55faf5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:58.282088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e50c204e-5946-438d-a8d5-17182f55faf5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:58.282556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e50c204e-5946-438d-a8d5-17182f55faf5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:58.282989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e50c204e-5946-438d-a8d5-17182f55faf5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:58.311500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e50c204e-5946-438d-a8d5-17182f55faf5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:40:58.393642 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e50c204e-5946-438d-a8d5-17182f55faf5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 204 len: 0 microversion: 2.1 time: 0.125417 Sep 10 11:40:58.398087 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4545/6771] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:40:58 2022] DELETE /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:40:58.403663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-51cc33ad-aa95-4326-b9a4-20054e43ed3d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:58.404285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-51cc33ad-aa95-4326-b9a4-20054e43ed3d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:58.414988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51cc33ad-aa95-4326-b9a4-20054e43ed3d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:58.415483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51cc33ad-aa95-4326-b9a4-20054e43ed3d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:58.415929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51cc33ad-aa95-4326-b9a4-20054e43ed3d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:58.416657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51cc33ad-aa95-4326-b9a4-20054e43ed3d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:58.417135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51cc33ad-aa95-4326-b9a4-20054e43ed3d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:58.417568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-51cc33ad-aa95-4326-b9a4-20054e43ed3d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:58.548063 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-51cc33ad-aa95-4326-b9a4-20054e43ed3d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:58.557107 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-51cc33ad-aa95-4326-b9a4-20054e43ed3d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1554 microversion: 2.1 time: 0.157298 Sep 10 11:40:58.557919 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2227/6772] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:58 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:59.580606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-92c7fa8d-7154-42c5-8d8c-f3cc97e796c7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:59.581365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-92c7fa8d-7154-42c5-8d8c-f3cc97e796c7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:59.589844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7fa8d-7154-42c5-8d8c-f3cc97e796c7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:59.590355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7fa8d-7154-42c5-8d8c-f3cc97e796c7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:59.590812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7fa8d-7154-42c5-8d8c-f3cc97e796c7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:59.591526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7fa8d-7154-42c5-8d8c-f3cc97e796c7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:59.592008 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7fa8d-7154-42c5-8d8c-f3cc97e796c7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:59.592452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-92c7fa8d-7154-42c5-8d8c-f3cc97e796c7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:59.729473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-92c7fa8d-7154-42c5-8d8c-f3cc97e796c7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:59.739858 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-92c7fa8d-7154-42c5-8d8c-f3cc97e796c7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1554 microversion: 2.1 time: 0.163627 Sep 10 11:40:59.740459 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4546/6773] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:59 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:00.408508 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-7ac3815e-606d-410a-81e9-758ccaefea29 req-576dffe4-1b94-4d34-bd20-0c923cd484b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9507c3-69b8-41c4-b70f-46d09f80e673", "name": "network-vif-deleted", "tag": "5b20adfe-4471-449e-b5f9-d1eec14b4ffc"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:00.419960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7ac3815e-606d-410a-81e9-758ccaefea29 req-576dffe4-1b94-4d34-bd20-0c923cd484b2 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.420453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7ac3815e-606d-410a-81e9-758ccaefea29 req-576dffe4-1b94-4d34-bd20-0c923cd484b2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.420893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-7ac3815e-606d-410a-81e9-758ccaefea29 req-576dffe4-1b94-4d34-bd20-0c923cd484b2 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:00.433869 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-7ac3815e-606d-410a-81e9-758ccaefea29 req-576dffe4-1b94-4d34-bd20-0c923cd484b2 service nova] Creating event network-vif-deleted:5b20adfe-4471-449e-b5f9-d1eec14b4ffc for instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 on n-h1-856894-1 Sep 10 11:41:00.438799 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-7ac3815e-606d-410a-81e9-758ccaefea29 req-576dffe4-1b94-4d34-bd20-0c923cd484b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034043 Sep 10 11:41:00.439434 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2228/6774] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:00.763784 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:00.765150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:00.773035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.774054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.774722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:00.775620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.776104 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.776763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:00.814133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.814649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.815113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:00.815795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lazy-loading 'fault' on Instance uuid 3f9507c3-69b8-41c4-b70f-46d09f80e673 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:00.863273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:00.871478 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c9f0094a-1a61-44b8-b832-767a043ccfb7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 200 len: 1348 microversion: 2.1 time: 0.111802 Sep 10 11:41:00.872081 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4547/6775] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:00 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 1348 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:01.896948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:01.897679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 3f9507c3-69b8-41c4-b70f-46d09f80e673] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:01.903812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:01.904298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:01.904738 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:01.905461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:01.905920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:01.906347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:01.919800 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] HTTP exception thrown: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 could not be found. Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Request method failure captured: Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 HTTP/1.1 Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHbg4-o7-xNnDPzuHipfa71iwCEYnlWSdKxhqugzl4s4mUlITW39lwx35cFX55ln8xgxhXgN4LuHlndosOh3Ff6h_SEDY5we5gHCChFnvxdwaaTRFBP_aHa3IxL6T_Nx1osnfXp5cQRWMnJUsQXqWwFZ4HqGDAAPOXP-iXwLu7Imiw0 Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 13c189fe896c4eb2b4969669c0ab289f Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13c189fe896c4eb2b4969669c0ab289f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 13c189fe896c4eb2b4969669c0ab289f Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestMinimumBasicScenario-2014934730-project Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 24e1861b8d914f4e956a9552de25d88b Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestMinimumBasicScenario-2014934730-project Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 could not be found. Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '3f9507c3-69b8-41c4-b70f-46d09f80e673'} Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 could not be found. Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 could not be found. Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:01.921418 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:41:01.926352 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:01.926352 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:01.926352 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:01.926352 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:01.926352 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:01.926352 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 could not be found. Sep 10 11:41:01.926352 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:41:01.926352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Returning 404 to user: Instance 3f9507c3-69b8-41c4-b70f-46d09f80e673 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:01.926352 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-39da2b9c-97ab-4241-8295-da57fb5c3bc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673" status: 404 len: 111 microversion: 2.1 time: 0.030951 Sep 10 11:41:01.926352 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2229/6776] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:01 2022] GET /compute/v2.1/servers/3f9507c3-69b8-41c4-b70f-46d09f80e673 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:01.932294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cd04314f-2646-4fa3-aa66-f7dfa9842414 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '.version_select at 0x7efcae2c3e50>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:01.955597 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cd04314f-2646-4fa3-aa66-f7dfa9842414 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1425333217" status: 202 len: 0 microversion: 2.1 time: 0.026990 Sep 10 11:41:01.956116 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4548/6777] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 11:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1425333217 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:41:10.948966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9c63ac21-9060-4166-8ba4-03f6253a7716 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'create', calling method: .version_select at 0x7efcaef8fee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1959421004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF0CPGTYqg4oK/CeGjWwtjsAzpDeaQ0egWPIdtBzXZnG/CXLqPgty8/+6eelZDWC0ehalZfxAky8LO8NYeLuXfgG9IouxSQmWkFLX3QgTmBiNwuQWWQaUiYZ3dJ9+3//w=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:10.965734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-9c63ac21-9060-4166-8ba4-03f6253a7716 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Getting quotas for project 13c189fe896c4eb2b4969669c0ab289f. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:10.971582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-9c63ac21-9060-4166-8ba4-03f6253a7716 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Getting quotas for user 24e1861b8d914f4e956a9552de25d88b and project 13c189fe896c4eb2b4969669c0ab289f. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:10.984559 n-d-856894-1 devstack@n-api.service[128787]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9c63ac21-9060-4166-8ba4-03f6253a7716 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [52076f28-0219-4f7b-8a07-5c9f47b363fb] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 11:41:11.911490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=40 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:11.995735 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [None req-9c63ac21-9060-4166-8ba4-03f6253a7716 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [52076f28-0219-4f7b-8a07-5c9f47b363fb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49424. Sep 10 11:41:12.010426 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9c63ac21-9060-4166-8ba4-03f6253a7716 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.065359 Sep 10 11:41:12.011042 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2230/6778] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:41:10 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:12.058952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:12.059719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:12.064467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-854109217", "imageRef": "d618db4c-6a19-41e4-afb6-82d63c75234e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1959421004", "networks": [{"uuid": "dc884717-85d5-411f-a53f-2c6591dbd738"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:12.118100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] validate_networks() for [('dc884717-85d5-411f-a53f-2c6591dbd738', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:41:12.557513 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:41:12.558359 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:41:12.559020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:41:12.559445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:41:12.559872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:41:12.569462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.569959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.570406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:12.571146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.571615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.572058 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:12.591141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Getting quotas for project 13c189fe896c4eb2b4969669c0ab289f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:12.596379 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Getting quotas for user 24e1861b8d914f4e956a9552de25d88b and project 13c189fe896c4eb2b4969669c0ab289f. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:12.608660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:41:12.610950 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d618db4c-6a19-41e4-afb6-82d63c75234e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:41:12.639400 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:41:12.639617 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 11:41:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 10 11:41:12.661319 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d54c11cd-2e39-4ba9-8fc3-e34f143f926c tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604218 Sep 10 11:41:12.661977 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4549/6779] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:41:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:41:12.672824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-39b7e670-6fc4-42cb-af5c-2a15b3ea8c12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:12.673466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-39b7e670-6fc4-42cb-af5c-2a15b3ea8c12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:12.730954 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-39b7e670-6fc4-42cb-af5c-2a15b3ea8c12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:12.738922 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-39b7e670-6fc4-42cb-af5c-2a15b3ea8c12 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1258 microversion: 2.1 time: 0.069432 Sep 10 11:41:12.739494 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2231/6780] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:12 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:13.764769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3cff1005-3054-49f7-abb4-688acefb4f62 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:13.765436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3cff1005-3054-49f7-abb4-688acefb4f62 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:13.773431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cff1005-3054-49f7-abb4-688acefb4f62 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:13.774011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cff1005-3054-49f7-abb4-688acefb4f62 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:13.775220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cff1005-3054-49f7-abb4-688acefb4f62 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.776615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cff1005-3054-49f7-abb4-688acefb4f62 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:13.777288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cff1005-3054-49f7-abb4-688acefb4f62 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:13.777923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3cff1005-3054-49f7-abb4-688acefb4f62 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.846959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3cff1005-3054-49f7-abb4-688acefb4f62 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:13.857126 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3cff1005-3054-49f7-abb4-688acefb4f62 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1318 microversion: 2.1 time: 0.098576 Sep 10 11:41:13.857769 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4550/6781] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:13 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:14.881045 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f6ea8f7e-332c-4ac8-adef-91a5593c205b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:14.882262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f6ea8f7e-332c-4ac8-adef-91a5593c205b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:14.891499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6ea8f7e-332c-4ac8-adef-91a5593c205b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:14.892285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6ea8f7e-332c-4ac8-adef-91a5593c205b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:14.892726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6ea8f7e-332c-4ac8-adef-91a5593c205b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:14.893462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6ea8f7e-332c-4ac8-adef-91a5593c205b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:14.893917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6ea8f7e-332c-4ac8-adef-91a5593c205b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:14.894876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6ea8f7e-332c-4ac8-adef-91a5593c205b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.058441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f6ea8f7e-332c-4ac8-adef-91a5593c205b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:15.066861 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f6ea8f7e-332c-4ac8-adef-91a5593c205b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.189732 Sep 10 11:41:15.067451 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2232/6782] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:14 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:16.091224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2438492b-0109-46db-89ad-9fcdef2a79a7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:16.091878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2438492b-0109-46db-89ad-9fcdef2a79a7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:16.106919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2438492b-0109-46db-89ad-9fcdef2a79a7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.107861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2438492b-0109-46db-89ad-9fcdef2a79a7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.108351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2438492b-0109-46db-89ad-9fcdef2a79a7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.109101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2438492b-0109-46db-89ad-9fcdef2a79a7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.109599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2438492b-0109-46db-89ad-9fcdef2a79a7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.110055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2438492b-0109-46db-89ad-9fcdef2a79a7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.258163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2438492b-0109-46db-89ad-9fcdef2a79a7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:16.266544 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2438492b-0109-46db-89ad-9fcdef2a79a7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.179992 Sep 10 11:41:16.267260 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4551/6783] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:16 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:17.290197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c1f96c15-6c61-45ed-b6d4-522386474aed tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:17.290902 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c1f96c15-6c61-45ed-b6d4-522386474aed tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:17.298454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f96c15-6c61-45ed-b6d4-522386474aed tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.299204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f96c15-6c61-45ed-b6d4-522386474aed tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.299838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f96c15-6c61-45ed-b6d4-522386474aed tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.301102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f96c15-6c61-45ed-b6d4-522386474aed tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.301565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f96c15-6c61-45ed-b6d4-522386474aed tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.301996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1f96c15-6c61-45ed-b6d4-522386474aed tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.439719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c1f96c15-6c61-45ed-b6d4-522386474aed tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:17.447658 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c1f96c15-6c61-45ed-b6d4-522386474aed tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.161468 Sep 10 11:41:17.448236 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2233/6784] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:17 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:18.472319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-726c8d7a-b735-4d27-a343-697b48097b10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:18.472886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-726c8d7a-b735-4d27-a343-697b48097b10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:18.480757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726c8d7a-b735-4d27-a343-697b48097b10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.481306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726c8d7a-b735-4d27-a343-697b48097b10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.481770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726c8d7a-b735-4d27-a343-697b48097b10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.482492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726c8d7a-b735-4d27-a343-697b48097b10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.482964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726c8d7a-b735-4d27-a343-697b48097b10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.483411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-726c8d7a-b735-4d27-a343-697b48097b10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.622285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-726c8d7a-b735-4d27-a343-697b48097b10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:18.630394 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-726c8d7a-b735-4d27-a343-697b48097b10 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.162540 Sep 10 11:41:18.631174 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4552/6785] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:18 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:19.654357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-24025912-ee84-421c-8633-3e410835b213 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.655044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-24025912-ee84-421c-8633-3e410835b213 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:19.657488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:19.662866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24025912-ee84-421c-8633-3e410835b213 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.663366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24025912-ee84-421c-8633-3e410835b213 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.663807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24025912-ee84-421c-8633-3e410835b213 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.664522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24025912-ee84-421c-8633-3e410835b213 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.672747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24025912-ee84-421c-8633-3e410835b213 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.673374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-24025912-ee84-421c-8633-3e410835b213 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.828082 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-24025912-ee84-421c-8633-3e410835b213 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:19.842955 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-24025912-ee84-421c-8633-3e410835b213 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.192266 Sep 10 11:41:19.851383 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2234/6786] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:19 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:41:20.866396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e5be78f1-b5ab-49a5-84df-0e02cae252d6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:20.867707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e5be78f1-b5ab-49a5-84df-0e02cae252d6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:20.874826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5be78f1-b5ab-49a5-84df-0e02cae252d6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.875498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5be78f1-b5ab-49a5-84df-0e02cae252d6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.876148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5be78f1-b5ab-49a5-84df-0e02cae252d6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.876910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5be78f1-b5ab-49a5-84df-0e02cae252d6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.877581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5be78f1-b5ab-49a5-84df-0e02cae252d6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.878028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e5be78f1-b5ab-49a5-84df-0e02cae252d6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:21.016565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e5be78f1-b5ab-49a5-84df-0e02cae252d6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:21.025334 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e5be78f1-b5ab-49a5-84df-0e02cae252d6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.163386 Sep 10 11:41:21.025942 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4553/6787] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:20 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:22.048486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-546306ac-a44e-4215-b6dd-d8b70bcbe7ad tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:22.049148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-546306ac-a44e-4215-b6dd-d8b70bcbe7ad tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:22.056130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-546306ac-a44e-4215-b6dd-d8b70bcbe7ad tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:22.056716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-546306ac-a44e-4215-b6dd-d8b70bcbe7ad tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:22.057241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-546306ac-a44e-4215-b6dd-d8b70bcbe7ad tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:22.057973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-546306ac-a44e-4215-b6dd-d8b70bcbe7ad tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:22.058459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-546306ac-a44e-4215-b6dd-d8b70bcbe7ad tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:22.058909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-546306ac-a44e-4215-b6dd-d8b70bcbe7ad tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:22.190875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-546306ac-a44e-4215-b6dd-d8b70bcbe7ad tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:22.199168 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-546306ac-a44e-4215-b6dd-d8b70bcbe7ad tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.154970 Sep 10 11:41:22.199754 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2235/6788] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:22 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:23.151785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-69401a47-f9b3-4b1c-8fe5-0fc717b370cf req-3d207bda-07a2-4900-beb2-cf526c882f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2b21d2-3add-42cb-be62-a14cf8e92f6a", "tag": "ae6d4284-100a-465f-b357-190ebc353362"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:23.157820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:23.158689 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:23.166407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-69401a47-f9b3-4b1c-8fe5-0fc717b370cf req-3d207bda-07a2-4900-beb2-cf526c882f2f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:23.166903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-69401a47-f9b3-4b1c-8fe5-0fc717b370cf req-3d207bda-07a2-4900-beb2-cf526c882f2f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:23.167537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-69401a47-f9b3-4b1c-8fe5-0fc717b370cf req-3d207bda-07a2-4900-beb2-cf526c882f2f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:23.179559 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-69401a47-f9b3-4b1c-8fe5-0fc717b370cf req-3d207bda-07a2-4900-beb2-cf526c882f2f service nova] Creating event network-changed:ae6d4284-100a-465f-b357-190ebc353362 for instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a on n-h2-856894-1 Sep 10 11:41:23.184473 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-69401a47-f9b3-4b1c-8fe5-0fc717b370cf req-3d207bda-07a2-4900-beb2-cf526c882f2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036433 Sep 10 11:41:23.185113 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4554/6789] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:23.221804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8a2aaef1-9d49-42e9-8591-0ed0299ddfe2 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:23.222424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8a2aaef1-9d49-42e9-8591-0ed0299ddfe2 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:23.225384 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:23.236846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a2aaef1-9d49-42e9-8591-0ed0299ddfe2 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:23.237369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a2aaef1-9d49-42e9-8591-0ed0299ddfe2 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:23.237847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a2aaef1-9d49-42e9-8591-0ed0299ddfe2 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:23.238560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a2aaef1-9d49-42e9-8591-0ed0299ddfe2 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:23.239521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a2aaef1-9d49-42e9-8591-0ed0299ddfe2 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:23.239950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a2aaef1-9d49-42e9-8591-0ed0299ddfe2 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:23.437457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8a2aaef1-9d49-42e9-8591-0ed0299ddfe2 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:23.446069 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8a2aaef1-9d49-42e9-8591-0ed0299ddfe2 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.228117 Sep 10 11:41:23.446663 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2236/6790] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:23 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:24.470728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a06c9882-7c69-4ff3-be9d-6133d688d8db tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:24.471451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a06c9882-7c69-4ff3-be9d-6133d688d8db tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:24.477765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a06c9882-7c69-4ff3-be9d-6133d688d8db tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:24.478268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a06c9882-7c69-4ff3-be9d-6133d688d8db tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:24.478721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a06c9882-7c69-4ff3-be9d-6133d688d8db tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:24.479426 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a06c9882-7c69-4ff3-be9d-6133d688d8db tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:24.479898 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a06c9882-7c69-4ff3-be9d-6133d688d8db tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:24.480342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a06c9882-7c69-4ff3-be9d-6133d688d8db tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:24.648519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a06c9882-7c69-4ff3-be9d-6133d688d8db tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:24.656612 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a06c9882-7c69-4ff3-be9d-6133d688d8db tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.191123 Sep 10 11:41:24.657269 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4555/6791] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:24 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:25.680374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5cd6bc2f-de6c-44cf-9db6-b8f80910fca4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:25.680987 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5cd6bc2f-de6c-44cf-9db6-b8f80910fca4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:25.687903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cd6bc2f-de6c-44cf-9db6-b8f80910fca4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:25.688389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cd6bc2f-de6c-44cf-9db6-b8f80910fca4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:25.688825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cd6bc2f-de6c-44cf-9db6-b8f80910fca4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:25.689550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cd6bc2f-de6c-44cf-9db6-b8f80910fca4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:25.690009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cd6bc2f-de6c-44cf-9db6-b8f80910fca4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:25.690437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cd6bc2f-de6c-44cf-9db6-b8f80910fca4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:25.816085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5cd6bc2f-de6c-44cf-9db6-b8f80910fca4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:25.823754 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5cd6bc2f-de6c-44cf-9db6-b8f80910fca4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.148115 Sep 10 11:41:25.824331 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2237/6792] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:25 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:26.846417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a8ffdea7-dac7-4464-8218-e2f72722db02 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:26.847044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a8ffdea7-dac7-4464-8218-e2f72722db02 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:26.854103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ffdea7-dac7-4464-8218-e2f72722db02 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.854979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ffdea7-dac7-4464-8218-e2f72722db02 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.855778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ffdea7-dac7-4464-8218-e2f72722db02 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:26.857043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ffdea7-dac7-4464-8218-e2f72722db02 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.857917 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ffdea7-dac7-4464-8218-e2f72722db02 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.858722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a8ffdea7-dac7-4464-8218-e2f72722db02 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:27.005850 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a8ffdea7-dac7-4464-8218-e2f72722db02 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:27.013838 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a8ffdea7-dac7-4464-8218-e2f72722db02 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.171349 Sep 10 11:41:27.014512 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4556/6793] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:26 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:28.036490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cf5c406d-b7c2-4f60-9523-3da260bc4b8b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:28.037132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cf5c406d-b7c2-4f60-9523-3da260bc4b8b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:28.045325 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf5c406d-b7c2-4f60-9523-3da260bc4b8b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:28.045818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf5c406d-b7c2-4f60-9523-3da260bc4b8b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:28.046258 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf5c406d-b7c2-4f60-9523-3da260bc4b8b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:28.046953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf5c406d-b7c2-4f60-9523-3da260bc4b8b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:28.047407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf5c406d-b7c2-4f60-9523-3da260bc4b8b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:28.047830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cf5c406d-b7c2-4f60-9523-3da260bc4b8b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:28.179049 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cf5c406d-b7c2-4f60-9523-3da260bc4b8b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:28.187321 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cf5c406d-b7c2-4f60-9523-3da260bc4b8b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.154714 Sep 10 11:41:28.187913 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2238/6794] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:28 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:29.107493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a58e5d17-a4b3-4acf-a27c-fc4211b6cc87 req-cafe3aac-b9e9-4895-ae9b-aa1465365ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2b21d2-3add-42cb-be62-a14cf8e92f6a", "name": "network-vif-plugged", "status": "completed", "tag": "ae6d4284-100a-465f-b357-190ebc353362"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:29.117814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a58e5d17-a4b3-4acf-a27c-fc4211b6cc87 req-cafe3aac-b9e9-4895-ae9b-aa1465365ce8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:29.118307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a58e5d17-a4b3-4acf-a27c-fc4211b6cc87 req-cafe3aac-b9e9-4895-ae9b-aa1465365ce8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:29.118752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a58e5d17-a4b3-4acf-a27c-fc4211b6cc87 req-cafe3aac-b9e9-4895-ae9b-aa1465365ce8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:29.130622 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a58e5d17-a4b3-4acf-a27c-fc4211b6cc87 req-cafe3aac-b9e9-4895-ae9b-aa1465365ce8 service nova] Creating event network-vif-plugged:ae6d4284-100a-465f-b357-190ebc353362 for instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a on n-h2-856894-1 Sep 10 11:41:29.136115 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a58e5d17-a4b3-4acf-a27c-fc4211b6cc87 req-cafe3aac-b9e9-4895-ae9b-aa1465365ce8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092028 Sep 10 11:41:29.136728 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4557/6795] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:29.211557 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e2b0375a-5fff-4a49-95b2-b594e1e13fc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:29.212096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e2b0375a-5fff-4a49-95b2-b594e1e13fc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:29.219115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b0375a-5fff-4a49-95b2-b594e1e13fc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:29.219604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b0375a-5fff-4a49-95b2-b594e1e13fc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:29.220051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b0375a-5fff-4a49-95b2-b594e1e13fc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:29.220751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b0375a-5fff-4a49-95b2-b594e1e13fc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:29.221311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b0375a-5fff-4a49-95b2-b594e1e13fc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:29.221741 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e2b0375a-5fff-4a49-95b2-b594e1e13fc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:29.379394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e2b0375a-5fff-4a49-95b2-b594e1e13fc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:29.387081 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e2b0375a-5fff-4a49-95b2-b594e1e13fc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.179582 Sep 10 11:41:29.387658 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2239/6796] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:29 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:30.411354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-25ae05a1-a01d-46de-abc5-df68032104ba tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:30.412080 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-25ae05a1-a01d-46de-abc5-df68032104ba tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:30.418269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25ae05a1-a01d-46de-abc5-df68032104ba tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:30.418770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25ae05a1-a01d-46de-abc5-df68032104ba tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:30.419223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25ae05a1-a01d-46de-abc5-df68032104ba tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:30.419989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25ae05a1-a01d-46de-abc5-df68032104ba tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:30.420470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25ae05a1-a01d-46de-abc5-df68032104ba tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:30.420918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25ae05a1-a01d-46de-abc5-df68032104ba tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:30.594607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25ae05a1-a01d-46de-abc5-df68032104ba tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:30.602562 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-25ae05a1-a01d-46de-abc5-df68032104ba tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1358 microversion: 2.1 time: 0.196496 Sep 10 11:41:30.603139 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4558/6797] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:30 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:31.627263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-80199682-c804-42fe-adb0-5d08d389245e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:31.627887 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-80199682-c804-42fe-adb0-5d08d389245e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:31.635330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80199682-c804-42fe-adb0-5d08d389245e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:31.635825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80199682-c804-42fe-adb0-5d08d389245e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:31.636272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80199682-c804-42fe-adb0-5d08d389245e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:31.636974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80199682-c804-42fe-adb0-5d08d389245e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:31.637459 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80199682-c804-42fe-adb0-5d08d389245e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:31.637892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-80199682-c804-42fe-adb0-5d08d389245e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:31.770385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-80199682-c804-42fe-adb0-5d08d389245e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:31.778183 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-80199682-c804-42fe-adb0-5d08d389245e tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1549 microversion: 2.1 time: 0.154937 Sep 10 11:41:31.778757 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2240/6798] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:31 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:31.804299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4583e082-1f86-4f14-bbf8-2979dfcf87d5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:31.804940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4583e082-1f86-4f14-bbf8-2979dfcf87d5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:31.812084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4583e082-1f86-4f14-bbf8-2979dfcf87d5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:31.812592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4583e082-1f86-4f14-bbf8-2979dfcf87d5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:31.813051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4583e082-1f86-4f14-bbf8-2979dfcf87d5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:31.813792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4583e082-1f86-4f14-bbf8-2979dfcf87d5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:31.814270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4583e082-1f86-4f14-bbf8-2979dfcf87d5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:31.814725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4583e082-1f86-4f14-bbf8-2979dfcf87d5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:31.954616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4583e082-1f86-4f14-bbf8-2979dfcf87d5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:31.963187 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4583e082-1f86-4f14-bbf8-2979dfcf87d5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1549 microversion: 2.1 time: 0.163150 Sep 10 11:41:31.963796 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4559/6799] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:31 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:31.987363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:31.992713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:31.993520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Searching by: {'deleted': False, 'project_id': '13c189fe896c4eb2b4969669c0ab289f'} {{(pid=128787) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:41:31.998924 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:31.999414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:31.999855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:32.000590 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:32.001048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:32.001499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:32.026071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.multi_cell_list [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:41:32.058083 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ecdf8138-3ea5-4f74-a34a-e85a45ae173b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.074580 Sep 10 11:41:32.058681 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2241/6800] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Sep 10 11:41:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:32.071114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec9f4905-383d-4b48-81e6-acf7aad3a87f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:32.071752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec9f4905-383d-4b48-81e6-acf7aad3a87f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:32.080131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec9f4905-383d-4b48-81e6-acf7aad3a87f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:32.080728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec9f4905-383d-4b48-81e6-acf7aad3a87f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:32.081223 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec9f4905-383d-4b48-81e6-acf7aad3a87f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:32.082261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec9f4905-383d-4b48-81e6-acf7aad3a87f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:32.082769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec9f4905-383d-4b48-81e6-acf7aad3a87f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:32.083220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec9f4905-383d-4b48-81e6-acf7aad3a87f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:32.227298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec9f4905-383d-4b48-81e6-acf7aad3a87f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:32.235296 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec9f4905-383d-4b48-81e6-acf7aad3a87f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1549 microversion: 2.1 time: 0.168757 Sep 10 11:41:32.235888 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4560/6801] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:32 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:33.775845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-af8b96e3-7e18-4185-8c5f-8a69069909f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d49b6539-dd86-4316-ae2b-c8f702c927ee"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:33.778218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-af8b96e3-7e18-4185-8c5f-8a69069909f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:33.784953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af8b96e3-7e18-4185-8c5f-8a69069909f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:33.786126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af8b96e3-7e18-4185-8c5f-8a69069909f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:33.786561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af8b96e3-7e18-4185-8c5f-8a69069909f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:33.787241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af8b96e3-7e18-4185-8c5f-8a69069909f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:33.787692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af8b96e3-7e18-4185-8c5f-8a69069909f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:33.788116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-af8b96e3-7e18-4185-8c5f-8a69069909f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:34.024423 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-af8b96e3-7e18-4185-8c5f-8a69069909f7 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252354 Sep 10 11:41:34.025087 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2242/6802] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Sep 10 11:41:33 2022] POST /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:44.791281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-79f9d685-3afb-422c-9393-76f2bbd00ced tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:44.791946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-79f9d685-3afb-422c-9393-76f2bbd00ced tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:44.794754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:44.795440 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=60 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:44.801826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f9d685-3afb-422c-9393-76f2bbd00ced tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:44.802332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f9d685-3afb-422c-9393-76f2bbd00ced tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:44.803048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f9d685-3afb-422c-9393-76f2bbd00ced tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:44.803805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f9d685-3afb-422c-9393-76f2bbd00ced tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:44.804360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f9d685-3afb-422c-9393-76f2bbd00ced tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:44.804816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-79f9d685-3afb-422c-9393-76f2bbd00ced tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:44.940989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-79f9d685-3afb-422c-9393-76f2bbd00ced tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:44.949446 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-79f9d685-3afb-422c-9393-76f2bbd00ced tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1595 microversion: 2.1 time: 0.162598 Sep 10 11:41:44.950035 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4561/6803] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:44 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1595 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:46.800462 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:46.801371 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=17 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:46.801994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:46.807443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-11d8a680-3ef7-4c97-9237-b950785c147b req-2a0ef4b9-897e-40b4-af34-95a8fc00725a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2b21d2-3add-42cb-be62-a14cf8e92f6a", "tag": "ae6d4284-100a-465f-b357-190ebc353362"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:46.817801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-11d8a680-3ef7-4c97-9237-b950785c147b req-2a0ef4b9-897e-40b4-af34-95a8fc00725a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:46.817801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-11d8a680-3ef7-4c97-9237-b950785c147b req-2a0ef4b9-897e-40b4-af34-95a8fc00725a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:46.818199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-11d8a680-3ef7-4c97-9237-b950785c147b req-2a0ef4b9-897e-40b4-af34-95a8fc00725a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:46.832420 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-11d8a680-3ef7-4c97-9237-b950785c147b req-2a0ef4b9-897e-40b4-af34-95a8fc00725a service nova] Creating event network-changed:ae6d4284-100a-465f-b357-190ebc353362 for instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a on n-h2-856894-1 Sep 10 11:41:46.837818 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-11d8a680-3ef7-4c97-9237-b950785c147b req-2a0ef4b9-897e-40b4-af34-95a8fc00725a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038996 Sep 10 11:41:46.838634 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2243/6804] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:47.793097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ab718d33-64a6-434e-b8ef-cbe6b2ecfcd6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-946591279"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:47.794219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ab718d33-64a6-434e-b8ef-cbe6b2ecfcd6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:47.800948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab718d33-64a6-434e-b8ef-cbe6b2ecfcd6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:47.801492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab718d33-64a6-434e-b8ef-cbe6b2ecfcd6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:47.801949 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab718d33-64a6-434e-b8ef-cbe6b2ecfcd6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:47.802909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab718d33-64a6-434e-b8ef-cbe6b2ecfcd6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:47.803388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab718d33-64a6-434e-b8ef-cbe6b2ecfcd6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:47.804360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ab718d33-64a6-434e-b8ef-cbe6b2ecfcd6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:47.938114 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.network.security_group_api [None req-ab718d33-64a6-434e-b8ef-cbe6b2ecfcd6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Adding security group 165bbe62-28c9-428b-8449-c6f0bc6a239c to port ae6d4284-100a-465f-b357-190ebc353362 Sep 10 11:41:48.250785 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ab718d33-64a6-434e-b8ef-cbe6b2ecfcd6 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/action" status: 202 len: 0 microversion: 2.1 time: 0.461982 Sep 10 11:41:48.252775 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4562/6805] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:41:47 2022] POST /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:41:48.263116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-01855104-ccb5-407b-a6bf-efffb6456407 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:48.264248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-01855104-ccb5-407b-a6bf-efffb6456407 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:48.281869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01855104-ccb5-407b-a6bf-efffb6456407 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:48.283948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01855104-ccb5-407b-a6bf-efffb6456407 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:48.284562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01855104-ccb5-407b-a6bf-efffb6456407 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:48.286441 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01855104-ccb5-407b-a6bf-efffb6456407 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:48.289561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01855104-ccb5-407b-a6bf-efffb6456407 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:48.290383 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01855104-ccb5-407b-a6bf-efffb6456407 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:48.439947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-01855104-ccb5-407b-a6bf-efffb6456407 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:48.448318 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-01855104-ccb5-407b-a6bf-efffb6456407 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1760 microversion: 2.1 time: 0.190809 Sep 10 11:41:48.448903 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2244/6806] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:48 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1760 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:48.853419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f3aea71e-c422-4878-ae91-a1dcb8353267 req-46a466ec-80d3-4e73-8669-d60f5ed9d325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2b21d2-3add-42cb-be62-a14cf8e92f6a", "tag": "ae6d4284-100a-465f-b357-190ebc353362"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:48.864116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f3aea71e-c422-4878-ae91-a1dcb8353267 req-46a466ec-80d3-4e73-8669-d60f5ed9d325 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:48.864640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f3aea71e-c422-4878-ae91-a1dcb8353267 req-46a466ec-80d3-4e73-8669-d60f5ed9d325 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:48.865111 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f3aea71e-c422-4878-ae91-a1dcb8353267 req-46a466ec-80d3-4e73-8669-d60f5ed9d325 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:48.876189 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f3aea71e-c422-4878-ae91-a1dcb8353267 req-46a466ec-80d3-4e73-8669-d60f5ed9d325 service nova] Creating event network-changed:ae6d4284-100a-465f-b357-190ebc353362 for instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a on n-h2-856894-1 Sep 10 11:41:48.882749 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f3aea71e-c422-4878-ae91-a1dcb8353267 req-46a466ec-80d3-4e73-8669-d60f5ed9d325 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034057 Sep 10 11:41:48.883349 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4563/6807] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:05.497773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c5f7e1df-7868-43e8-a080-c904015dc6c3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:05.500113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c5f7e1df-7868-43e8-a080-c904015dc6c3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:05.502669 n-d-856894-1 devstack@n-api.service[128787]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2d8a82b-a259-4271-b6a0-0b311d4f5a8a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 11:42:05.503506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:05.504158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=8 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:05.510606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5f7e1df-7868-43e8-a080-c904015dc6c3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:05.511087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5f7e1df-7868-43e8-a080-c904015dc6c3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:05.511519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5f7e1df-7868-43e8-a080-c904015dc6c3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:05.512203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5f7e1df-7868-43e8-a080-c904015dc6c3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:05.512654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5f7e1df-7868-43e8-a080-c904015dc6c3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:05.513096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c5f7e1df-7868-43e8-a080-c904015dc6c3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:05.582194 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c5f7e1df-7868-43e8-a080-c904015dc6c3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/action" status: 202 len: 0 microversion: 2.1 time: 0.088201 Sep 10 11:42:05.585997 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2245/6808] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:42:05 2022] POST /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:05.590979 n-d-856894-1 devstack@n-api.service[128788]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff958037-a840-4114-b8eb-6b314978ef69] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 11:42:05.591846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:05.592604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:05.597745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c12e14fe-9139-4f3e-aff0-feaa5c58406f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:05.598495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c12e14fe-9139-4f3e-aff0-feaa5c58406f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:05.607070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12e14fe-9139-4f3e-aff0-feaa5c58406f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:05.607572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12e14fe-9139-4f3e-aff0-feaa5c58406f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:05.608031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12e14fe-9139-4f3e-aff0-feaa5c58406f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:05.609331 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12e14fe-9139-4f3e-aff0-feaa5c58406f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:05.609823 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12e14fe-9139-4f3e-aff0-feaa5c58406f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:05.610459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c12e14fe-9139-4f3e-aff0-feaa5c58406f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:05.854004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c12e14fe-9139-4f3e-aff0-feaa5c58406f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:05.862928 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c12e14fe-9139-4f3e-aff0-feaa5c58406f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1752 microversion: 2.1 time: 0.274211 Sep 10 11:42:05.863671 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4564/6809] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:05 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1752 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:06.888947 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-99a6ea48-3e6e-4205-881a-7ddc32c0ca3b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:06.889681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-99a6ea48-3e6e-4205-881a-7ddc32c0ca3b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:06.896461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6ea48-3e6e-4205-881a-7ddc32c0ca3b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:06.896882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6ea48-3e6e-4205-881a-7ddc32c0ca3b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:06.897343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6ea48-3e6e-4205-881a-7ddc32c0ca3b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:06.898026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6ea48-3e6e-4205-881a-7ddc32c0ca3b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:06.898474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6ea48-3e6e-4205-881a-7ddc32c0ca3b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:06.898892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-99a6ea48-3e6e-4205-881a-7ddc32c0ca3b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:06.904169 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2d8a82b-a259-4271-b6a0-0b311d4f5a8a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49618. Sep 10 11:42:07.052529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-99a6ea48-3e6e-4205-881a-7ddc32c0ca3b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:07.061784 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-99a6ea48-3e6e-4205-881a-7ddc32c0ca3b tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1757 microversion: 2.1 time: 0.178500 Sep 10 11:42:07.062349 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2246/6810] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:06 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:08.085495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f4948a5a-2ecd-4e9d-9abe-f59fc2c7a7bb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:08.086120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f4948a5a-2ecd-4e9d-9abe-f59fc2c7a7bb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:08.095675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4948a5a-2ecd-4e9d-9abe-f59fc2c7a7bb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.096185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4948a5a-2ecd-4e9d-9abe-f59fc2c7a7bb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.096643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4948a5a-2ecd-4e9d-9abe-f59fc2c7a7bb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.097393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4948a5a-2ecd-4e9d-9abe-f59fc2c7a7bb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.097872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4948a5a-2ecd-4e9d-9abe-f59fc2c7a7bb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.098319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f4948a5a-2ecd-4e9d-9abe-f59fc2c7a7bb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.104384 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff958037-a840-4114-b8eb-6b314978ef69] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49622. Sep 10 11:42:08.240514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f4948a5a-2ecd-4e9d-9abe-f59fc2c7a7bb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:08.249521 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f4948a5a-2ecd-4e9d-9abe-f59fc2c7a7bb tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1757 microversion: 2.1 time: 0.168204 Sep 10 11:42:08.250109 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4565/6811] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:08 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:09.273928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4da4ed35-8dfb-46e6-8ff5-5018b1dda827 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:09.274580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4da4ed35-8dfb-46e6-8ff5-5018b1dda827 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:09.281474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4da4ed35-8dfb-46e6-8ff5-5018b1dda827 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:09.281909 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4da4ed35-8dfb-46e6-8ff5-5018b1dda827 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:09.282347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4da4ed35-8dfb-46e6-8ff5-5018b1dda827 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:09.283036 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4da4ed35-8dfb-46e6-8ff5-5018b1dda827 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:09.283493 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4da4ed35-8dfb-46e6-8ff5-5018b1dda827 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:09.283918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4da4ed35-8dfb-46e6-8ff5-5018b1dda827 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:09.424940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4da4ed35-8dfb-46e6-8ff5-5018b1dda827 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:09.435816 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4da4ed35-8dfb-46e6-8ff5-5018b1dda827 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1757 microversion: 2.1 time: 0.166448 Sep 10 11:42:09.436380 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2247/6812] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:09 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:10.506332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a78f121f-58af-47ab-9309-c4633635e671 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:10.506973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a78f121f-58af-47ab-9309-c4633635e671 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:10.513623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78f121f-58af-47ab-9309-c4633635e671 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:10.514143 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78f121f-58af-47ab-9309-c4633635e671 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:10.514588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78f121f-58af-47ab-9309-c4633635e671 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:10.515292 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78f121f-58af-47ab-9309-c4633635e671 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:10.515767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78f121f-58af-47ab-9309-c4633635e671 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:10.516210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a78f121f-58af-47ab-9309-c4633635e671 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:10.661147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a78f121f-58af-47ab-9309-c4633635e671 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:10.669756 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a78f121f-58af-47ab-9309-c4633635e671 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1757 microversion: 2.1 time: 0.214123 Sep 10 11:42:10.670346 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4566/6813] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:10 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:11.694246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-95f5060d-df07-43ab-9ba5-f2220b65dcf1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:11.695518 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-95f5060d-df07-43ab-9ba5-f2220b65dcf1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:11.702403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95f5060d-df07-43ab-9ba5-f2220b65dcf1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.702918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95f5060d-df07-43ab-9ba5-f2220b65dcf1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.703344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95f5060d-df07-43ab-9ba5-f2220b65dcf1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.704046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95f5060d-df07-43ab-9ba5-f2220b65dcf1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.704509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95f5060d-df07-43ab-9ba5-f2220b65dcf1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.704939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95f5060d-df07-43ab-9ba5-f2220b65dcf1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.844917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-95f5060d-df07-43ab-9ba5-f2220b65dcf1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:11.853397 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-95f5060d-df07-43ab-9ba5-f2220b65dcf1 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1757 microversion: 2.1 time: 0.163106 Sep 10 11:42:11.853982 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2248/6814] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:11 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:12.877397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4db896b3-e4ad-4297-a769-5f4a9919fb09 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:12.878025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4db896b3-e4ad-4297-a769-5f4a9919fb09 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:12.885367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4db896b3-e4ad-4297-a769-5f4a9919fb09 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:12.885865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4db896b3-e4ad-4297-a769-5f4a9919fb09 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:12.886319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4db896b3-e4ad-4297-a769-5f4a9919fb09 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:12.887026 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4db896b3-e4ad-4297-a769-5f4a9919fb09 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:12.887492 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4db896b3-e4ad-4297-a769-5f4a9919fb09 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:12.887931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4db896b3-e4ad-4297-a769-5f4a9919fb09 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:13.031194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4db896b3-e4ad-4297-a769-5f4a9919fb09 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:13.039715 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4db896b3-e4ad-4297-a769-5f4a9919fb09 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1757 microversion: 2.1 time: 0.166311 Sep 10 11:42:13.040293 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4567/6815] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:12 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:14.063209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-95ebe80e-3dae-489d-8cc9-4a2bf6eb54e4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:14.063863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-95ebe80e-3dae-489d-8cc9-4a2bf6eb54e4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:14.070787 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95ebe80e-3dae-489d-8cc9-4a2bf6eb54e4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:14.071270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95ebe80e-3dae-489d-8cc9-4a2bf6eb54e4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:14.071708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95ebe80e-3dae-489d-8cc9-4a2bf6eb54e4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:14.072398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95ebe80e-3dae-489d-8cc9-4a2bf6eb54e4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:14.072851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95ebe80e-3dae-489d-8cc9-4a2bf6eb54e4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:14.073303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-95ebe80e-3dae-489d-8cc9-4a2bf6eb54e4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:14.212972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-95ebe80e-3dae-489d-8cc9-4a2bf6eb54e4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:14.221265 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-95ebe80e-3dae-489d-8cc9-4a2bf6eb54e4 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1757 microversion: 2.1 time: 0.162005 Sep 10 11:42:14.221829 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2249/6816] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:14 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:15.244495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-95b5c2d8-d2dc-4b1d-a094-9b7689cdab54 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:15.245165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-95b5c2d8-d2dc-4b1d-a094-9b7689cdab54 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:15.252410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95b5c2d8-d2dc-4b1d-a094-9b7689cdab54 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:15.252915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95b5c2d8-d2dc-4b1d-a094-9b7689cdab54 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:15.253508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95b5c2d8-d2dc-4b1d-a094-9b7689cdab54 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:15.254216 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95b5c2d8-d2dc-4b1d-a094-9b7689cdab54 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:15.254691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95b5c2d8-d2dc-4b1d-a094-9b7689cdab54 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:15.255133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-95b5c2d8-d2dc-4b1d-a094-9b7689cdab54 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:15.407925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-95b5c2d8-d2dc-4b1d-a094-9b7689cdab54 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:15.416252 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-95b5c2d8-d2dc-4b1d-a094-9b7689cdab54 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1757 microversion: 2.1 time: 0.175763 Sep 10 11:42:15.416854 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4568/6817] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:15 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:16.439956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-29af0cfb-8a78-462c-89cf-aed90c568f9d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:16.440496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-29af0cfb-8a78-462c-89cf-aed90c568f9d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:16.447455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29af0cfb-8a78-462c-89cf-aed90c568f9d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:16.447940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29af0cfb-8a78-462c-89cf-aed90c568f9d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:16.448387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29af0cfb-8a78-462c-89cf-aed90c568f9d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:16.449131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29af0cfb-8a78-462c-89cf-aed90c568f9d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:16.449588 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29af0cfb-8a78-462c-89cf-aed90c568f9d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:16.450018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-29af0cfb-8a78-462c-89cf-aed90c568f9d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:16.588795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-29af0cfb-8a78-462c-89cf-aed90c568f9d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:16.597129 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-29af0cfb-8a78-462c-89cf-aed90c568f9d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1757 microversion: 2.1 time: 0.161155 Sep 10 11:42:16.597704 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2250/6818] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:16 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:17.620621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-452f2d8d-f2c4-41bf-9fbd-5aec8464531f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:17.621280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-452f2d8d-f2c4-41bf-9fbd-5aec8464531f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:17.628060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-452f2d8d-f2c4-41bf-9fbd-5aec8464531f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:17.628845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-452f2d8d-f2c4-41bf-9fbd-5aec8464531f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:17.629323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-452f2d8d-f2c4-41bf-9fbd-5aec8464531f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:17.630027 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-452f2d8d-f2c4-41bf-9fbd-5aec8464531f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:17.630496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-452f2d8d-f2c4-41bf-9fbd-5aec8464531f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:17.630939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-452f2d8d-f2c4-41bf-9fbd-5aec8464531f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:17.769589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-452f2d8d-f2c4-41bf-9fbd-5aec8464531f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:17.778723 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-452f2d8d-f2c4-41bf-9fbd-5aec8464531f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1760 microversion: 2.1 time: 0.162553 Sep 10 11:42:17.779301 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4569/6819] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:17 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:50.313642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0d7e38ea-556d-4036-8bbc-de7863719f36 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-946591279"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:50.314241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0d7e38ea-556d-4036-8bbc-de7863719f36 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:50.316226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=12 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:50.316917 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:50.323552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d7e38ea-556d-4036-8bbc-de7863719f36 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:50.324041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d7e38ea-556d-4036-8bbc-de7863719f36 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:50.324483 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d7e38ea-556d-4036-8bbc-de7863719f36 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:50.325197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d7e38ea-556d-4036-8bbc-de7863719f36 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:50.325650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d7e38ea-556d-4036-8bbc-de7863719f36 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:50.326109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d7e38ea-556d-4036-8bbc-de7863719f36 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:50.458889 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.network.security_group_api [None req-0d7e38ea-556d-4036-8bbc-de7863719f36 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Removing security group 165bbe62-28c9-428b-8449-c6f0bc6a239c from port ae6d4284-100a-465f-b357-190ebc353362 Sep 10 11:42:50.753249 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0d7e38ea-556d-4036-8bbc-de7863719f36 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "POST /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/action" status: 202 len: 0 microversion: 2.1 time: 0.443517 Sep 10 11:42:50.754075 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2251/6820] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:42:50 2022] POST /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:50.763336 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a2c4015a-4529-4cc0-b567-f00089ea2e1d req-13b41f16-5870-40c3-abac-ef9d957627b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2b21d2-3add-42cb-be62-a14cf8e92f6a", "tag": "ae6d4284-100a-465f-b357-190ebc353362"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:50.768541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:50.769451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=36 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:50.776908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a2c4015a-4529-4cc0-b567-f00089ea2e1d req-13b41f16-5870-40c3-abac-ef9d957627b1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:50.777435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a2c4015a-4529-4cc0-b567-f00089ea2e1d req-13b41f16-5870-40c3-abac-ef9d957627b1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:50.777874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a2c4015a-4529-4cc0-b567-f00089ea2e1d req-13b41f16-5870-40c3-abac-ef9d957627b1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:50.791517 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a2c4015a-4529-4cc0-b567-f00089ea2e1d req-13b41f16-5870-40c3-abac-ef9d957627b1 service nova] Creating event network-changed:ae6d4284-100a-465f-b357-190ebc353362 for instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a on n-h2-856894-1 Sep 10 11:42:50.797312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a2c4015a-4529-4cc0-b567-f00089ea2e1d req-13b41f16-5870-40c3-abac-ef9d957627b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038846 Sep 10 11:42:50.798273 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4570/6821] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:52.576227 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ae8a8ffa-5507-4cc4-b4fa-f9d3d1e652a0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:52.577118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ae8a8ffa-5507-4cc4-b4fa-f9d3d1e652a0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:52.579769 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9580f096-8310-43c7-a3cd-3180493c3d20 req-376712d4-6bdb-49d6-bab9-2d3a57319d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2b21d2-3add-42cb-be62-a14cf8e92f6a", "tag": "ae6d4284-100a-465f-b357-190ebc353362"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:52.584966 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae8a8ffa-5507-4cc4-b4fa-f9d3d1e652a0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.585448 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae8a8ffa-5507-4cc4-b4fa-f9d3d1e652a0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.585892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae8a8ffa-5507-4cc4-b4fa-f9d3d1e652a0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.586946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae8a8ffa-5507-4cc4-b4fa-f9d3d1e652a0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.588091 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae8a8ffa-5507-4cc4-b4fa-f9d3d1e652a0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.588526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ae8a8ffa-5507-4cc4-b4fa-f9d3d1e652a0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.595752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9580f096-8310-43c7-a3cd-3180493c3d20 req-376712d4-6bdb-49d6-bab9-2d3a57319d47 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.596498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9580f096-8310-43c7-a3cd-3180493c3d20 req-376712d4-6bdb-49d6-bab9-2d3a57319d47 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.597263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9580f096-8310-43c7-a3cd-3180493c3d20 req-376712d4-6bdb-49d6-bab9-2d3a57319d47 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.612635 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9580f096-8310-43c7-a3cd-3180493c3d20 req-376712d4-6bdb-49d6-bab9-2d3a57319d47 service nova] Creating event network-changed:ae6d4284-100a-465f-b357-190ebc353362 for instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a on n-h2-856894-1 Sep 10 11:42:52.618512 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9580f096-8310-43c7-a3cd-3180493c3d20 req-376712d4-6bdb-49d6-bab9-2d3a57319d47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043300 Sep 10 11:42:52.623340 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4571/6822] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:42:52.681576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-ae8a8ffa-5507-4cc4-b4fa-f9d3d1e652a0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lazy-loading 'services' on Instance uuid 6d2b21d2-3add-42cb-be62-a14cf8e92f6a {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:42:52.758891 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ae8a8ffa-5507-4cc4-b4fa-f9d3d1e652a0 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments/d49b6539-dd86-4316-ae2b-c8f702c927ee" status: 202 len: 0 microversion: 2.1 time: 0.187029 Sep 10 11:42:52.763369 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2252/6823] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:42:52 2022] DELETE /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments/d49b6539-dd86-4316-ae2b-c8f702c927ee => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:52.771203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9998989d-a21d-41f7-85a6-4564500aa6ce tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:52.774459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9998989d-a21d-41f7-85a6-4564500aa6ce tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:52.787031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9998989d-a21d-41f7-85a6-4564500aa6ce tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.787559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9998989d-a21d-41f7-85a6-4564500aa6ce tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.788000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9998989d-a21d-41f7-85a6-4564500aa6ce tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.789119 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9998989d-a21d-41f7-85a6-4564500aa6ce tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.789757 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9998989d-a21d-41f7-85a6-4564500aa6ce tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.790220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9998989d-a21d-41f7-85a6-4564500aa6ce tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.824367 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9998989d-a21d-41f7-85a6-4564500aa6ce tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058974 Sep 10 11:42:52.825167 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4572/6824] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:42:52 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:53.839423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fc4d4327-ad68-4511-afca-dca112a8ed07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:53.842707 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fc4d4327-ad68-4511-afca-dca112a8ed07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:53.849288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc4d4327-ad68-4511-afca-dca112a8ed07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:53.849893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc4d4327-ad68-4511-afca-dca112a8ed07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:53.850453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc4d4327-ad68-4511-afca-dca112a8ed07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:53.851256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc4d4327-ad68-4511-afca-dca112a8ed07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:53.851815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc4d4327-ad68-4511-afca-dca112a8ed07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:53.852346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc4d4327-ad68-4511-afca-dca112a8ed07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:53.886060 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fc4d4327-ad68-4511-afca-dca112a8ed07 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052350 Sep 10 11:42:53.886923 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2253/6825] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:42:53 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:54.899117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e72a4329-fdcb-4dec-93ef-691795d8ffa8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:54.901388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e72a4329-fdcb-4dec-93ef-691795d8ffa8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:54.908501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e72a4329-fdcb-4dec-93ef-691795d8ffa8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:54.909088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e72a4329-fdcb-4dec-93ef-691795d8ffa8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:54.909592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e72a4329-fdcb-4dec-93ef-691795d8ffa8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:54.910316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e72a4329-fdcb-4dec-93ef-691795d8ffa8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:54.910793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e72a4329-fdcb-4dec-93ef-691795d8ffa8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:54.911237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e72a4329-fdcb-4dec-93ef-691795d8ffa8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:54.944555 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e72a4329-fdcb-4dec-93ef-691795d8ffa8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049408 Sep 10 11:42:54.945104 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4573/6826] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:42:54 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:55.957574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b4bb8db7-f1b7-4d20-b5e7-5bf167054e20 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:55.959829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b4bb8db7-f1b7-4d20-b5e7-5bf167054e20 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:55.962709 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:42:55.962845 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 11:42:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments (ip 10.222.0.20) !!! Sep 10 11:42:55.969296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4bb8db7-f1b7-4d20-b5e7-5bf167054e20 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:55.969786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4bb8db7-f1b7-4d20-b5e7-5bf167054e20 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:55.970225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4bb8db7-f1b7-4d20-b5e7-5bf167054e20 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:55.970931 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4bb8db7-f1b7-4d20-b5e7-5bf167054e20 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:55.971391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4bb8db7-f1b7-4d20-b5e7-5bf167054e20 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:55.971819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b4bb8db7-f1b7-4d20-b5e7-5bf167054e20 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:56.001937 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b4bb8db7-f1b7-4d20-b5e7-5bf167054e20 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048398 Sep 10 11:42:56.002504 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2254/6827] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:42:55 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:57.014539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-27659a7b-76c8-4336-b191-41b3c169bd75 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:57.016716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-27659a7b-76c8-4336-b191-41b3c169bd75 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:57.023662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27659a7b-76c8-4336-b191-41b3c169bd75 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:57.024157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27659a7b-76c8-4336-b191-41b3c169bd75 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:57.024612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27659a7b-76c8-4336-b191-41b3c169bd75 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:57.025338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27659a7b-76c8-4336-b191-41b3c169bd75 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:57.025807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27659a7b-76c8-4336-b191-41b3c169bd75 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:57.026247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-27659a7b-76c8-4336-b191-41b3c169bd75 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:57.055806 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-27659a7b-76c8-4336-b191-41b3c169bd75 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Sep 10 11:42:57.057300 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4574/6828] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:42:57 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:58.068873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5149250e-7aaa-4026-b24e-282043150dd5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:58.071113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5149250e-7aaa-4026-b24e-282043150dd5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:58.078592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5149250e-7aaa-4026-b24e-282043150dd5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:58.079083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5149250e-7aaa-4026-b24e-282043150dd5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:58.079520 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5149250e-7aaa-4026-b24e-282043150dd5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:58.080207 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5149250e-7aaa-4026-b24e-282043150dd5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:58.080664 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5149250e-7aaa-4026-b24e-282043150dd5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:58.081106 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5149250e-7aaa-4026-b24e-282043150dd5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:58.109462 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5149250e-7aaa-4026-b24e-282043150dd5 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044529 Sep 10 11:42:58.110018 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2255/6829] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Sep 10 11:42:58 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:42:58.121122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:58.121605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:58.128387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:58.128894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:58.129394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:58.130100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:58.130573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:58.131017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:58.320729 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] HTTP exception thrown: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a is not attached to volume d49b6539-dd86-4316-ae2b-c8f702c927ee Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Request method failure captured: Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: request: DELETE /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments/d49b6539-dd86-4316-ae2b-c8f702c927ee HTTP/1.1 Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHbg4-o7-xNnDPzuHipfa71iwCEYnlWSdKxhqugzl4s4mUlITW39lwx35cFX55ln8xgxhXgN4LuHlndosOh3Ff6h_SEDY5we5gHCChFnvxdwaaTRFBP_aHa3IxL6T_Nx1osnfXp5cQRWMnJUsQXqWwFZ4HqGDAAPOXP-iXwLu7Imiw0 Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 13c189fe896c4eb2b4969669c0ab289f Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13c189fe896c4eb2b4969669c0ab289f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 13c189fe896c4eb2b4969669c0ab289f Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestMinimumBasicScenario-2014934730-project Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 24e1861b8d914f4e956a9552de25d88b Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestMinimumBasicScenario-2014934730-project Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a is not attached to volume d49b6539-dd86-4316-ae2b-c8f702c927ee Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'server_id': '6d2b21d2-3add-42cb-be62-a14cf8e92f6a', 'id': 'd49b6539-dd86-4316-ae2b-c8f702c927ee'} Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d49b6539-dd86-4316-ae2b-c8f702c927ee. Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a is not attached to volume d49b6539-dd86-4316-ae2b-c8f702c927ee Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:58.323033 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:58.327557 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:42:58.327557 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:42:58.327557 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a is not attached to volume d49b6539-dd86-4316-ae2b-c8f702c927ee Sep 10 11:42:58.327557 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:42:58.327557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Returning 404 to user: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a is not attached to volume d49b6539-dd86-4316-ae2b-c8f702c927ee {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:58.327557 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-80a7ff14-ad1b-44bc-b3b3-6b297af48df8 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments/d49b6539-dd86-4316-ae2b-c8f702c927ee" status: 404 len: 154 microversion: 2.1 time: 0.207958 Sep 10 11:42:58.327557 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4575/6830] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Sep 10 11:42:58 2022] DELETE /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a/os-volume_attachments/d49b6539-dd86-4316-ae2b-c8f702c927ee => generated 154 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:01.576443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ccd5ce20-bfab-4e37-9038-20a56edecc94 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:01.577020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ccd5ce20-bfab-4e37-9038-20a56edecc94 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:01.584665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccd5ce20-bfab-4e37-9038-20a56edecc94 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.585204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccd5ce20-bfab-4e37-9038-20a56edecc94 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.585801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccd5ce20-bfab-4e37-9038-20a56edecc94 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.586560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccd5ce20-bfab-4e37-9038-20a56edecc94 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.587025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccd5ce20-bfab-4e37-9038-20a56edecc94 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.587474 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ccd5ce20-bfab-4e37-9038-20a56edecc94 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.614726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ccd5ce20-bfab-4e37-9038-20a56edecc94 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:43:01.696031 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ccd5ce20-bfab-4e37-9038-20a56edecc94 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 204 len: 0 microversion: 2.1 time: 0.123025 Sep 10 11:43:01.696818 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2256/6831] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:43:01 2022] DELETE /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:43:01.705811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-314c7916-6487-4665-bd02-be0e8d9af54d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:01.707123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-314c7916-6487-4665-bd02-be0e8d9af54d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:01.714989 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314c7916-6487-4665-bd02-be0e8d9af54d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.715489 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314c7916-6487-4665-bd02-be0e8d9af54d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.715936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314c7916-6487-4665-bd02-be0e8d9af54d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.716639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314c7916-6487-4665-bd02-be0e8d9af54d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.717128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314c7916-6487-4665-bd02-be0e8d9af54d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.717568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-314c7916-6487-4665-bd02-be0e8d9af54d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.855859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-314c7916-6487-4665-bd02-be0e8d9af54d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:01.864198 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-314c7916-6487-4665-bd02-be0e8d9af54d tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1555 microversion: 2.1 time: 0.163185 Sep 10 11:43:01.877092 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4576/6832] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:01 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:02.888191 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b0529edb-5860-4b4d-9871-f1a58102fb64 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:02.888818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b0529edb-5860-4b4d-9871-f1a58102fb64 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:02.895772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0529edb-5860-4b4d-9871-f1a58102fb64 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:02.896259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0529edb-5860-4b4d-9871-f1a58102fb64 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:02.896704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0529edb-5860-4b4d-9871-f1a58102fb64 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:02.897438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0529edb-5860-4b4d-9871-f1a58102fb64 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:02.897897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0529edb-5860-4b4d-9871-f1a58102fb64 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:02.898327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b0529edb-5860-4b4d-9871-f1a58102fb64 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:03.024812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b0529edb-5860-4b4d-9871-f1a58102fb64 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:03.032705 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b0529edb-5860-4b4d-9871-f1a58102fb64 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1555 microversion: 2.1 time: 0.149737 Sep 10 11:43:03.033314 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2257/6833] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:02 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:04.057747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1ec993fd-5d15-4214-9f9b-ee3fcbec3cc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:04.058722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1ec993fd-5d15-4214-9f9b-ee3fcbec3cc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:04.066003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ec993fd-5d15-4214-9f9b-ee3fcbec3cc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:04.066670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ec993fd-5d15-4214-9f9b-ee3fcbec3cc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:04.067351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ec993fd-5d15-4214-9f9b-ee3fcbec3cc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:04.068547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ec993fd-5d15-4214-9f9b-ee3fcbec3cc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:04.069157 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ec993fd-5d15-4214-9f9b-ee3fcbec3cc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:04.069697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ec993fd-5d15-4214-9f9b-ee3fcbec3cc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:04.107936 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3d6e5bcb-88b8-4283-b3ff-7b157a8e3b8e req-b77c54e7-0f61-4736-abc6-5ccf3f58f9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2b21d2-3add-42cb-be62-a14cf8e92f6a", "name": "network-vif-deleted", "tag": "ae6d4284-100a-465f-b357-190ebc353362"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:04.117907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d6e5bcb-88b8-4283-b3ff-7b157a8e3b8e req-b77c54e7-0f61-4736-abc6-5ccf3f58f9cd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:04.119232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d6e5bcb-88b8-4283-b3ff-7b157a8e3b8e req-b77c54e7-0f61-4736-abc6-5ccf3f58f9cd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:04.119861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d6e5bcb-88b8-4283-b3ff-7b157a8e3b8e req-b77c54e7-0f61-4736-abc6-5ccf3f58f9cd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:04.133850 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3d6e5bcb-88b8-4283-b3ff-7b157a8e3b8e req-b77c54e7-0f61-4736-abc6-5ccf3f58f9cd service nova] Creating event network-vif-deleted:ae6d4284-100a-465f-b357-190ebc353362 for instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a on n-h2-856894-1 Sep 10 11:43:04.140073 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3d6e5bcb-88b8-4283-b3ff-7b157a8e3b8e req-b77c54e7-0f61-4736-abc6-5ccf3f58f9cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120018 Sep 10 11:43:04.140679 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4577/6834] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:04.143665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1ec993fd-5d15-4214-9f9b-ee3fcbec3cc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e1861b8d914f4e956a9552de25d88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c189fe896c4eb2b4969669c0ab289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:04.153062 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1ec993fd-5d15-4214-9f9b-ee3fcbec3cc3 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 200 len: 1343 microversion: 2.1 time: 0.100690 Sep 10 11:43:04.153735 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2258/6835] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:04 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 1343 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:05.177451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:05.178180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] [instance: 6d2b21d2-3add-42cb-be62-a14cf8e92f6a] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:05.184913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:05.185457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:05.185923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:05.186640 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:05.187122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:05.187574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:05.203642 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] HTTP exception thrown: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a could not be found. Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Request method failure captured: Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a HTTP/1.1 Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHbg4-o7-xNnDPzuHipfa71iwCEYnlWSdKxhqugzl4s4mUlITW39lwx35cFX55ln8xgxhXgN4LuHlndosOh3Ff6h_SEDY5we5gHCChFnvxdwaaTRFBP_aHa3IxL6T_Nx1osnfXp5cQRWMnJUsQXqWwFZ4HqGDAAPOXP-iXwLu7Imiw0 Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 13c189fe896c4eb2b4969669c0ab289f Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/13c189fe896c4eb2b4969669c0ab289f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_13c189fe896c4eb2b4969669c0ab289f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 13c189fe896c4eb2b4969669c0ab289f Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2014934730 Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestMinimumBasicScenario-2014934730-project Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 24e1861b8d914f4e956a9552de25d88b Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestMinimumBasicScenario-2014934730-project Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a could not be found. Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '6d2b21d2-3add-42cb-be62-a14cf8e92f6a'} Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a could not be found. Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a could not be found. Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:05.205351 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:43:05.210031 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:05.210031 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:05.210031 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:05.210031 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:05.210031 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:05.210031 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a could not be found. Sep 10 11:43:05.210031 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:43:05.210031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Returning 404 to user: Instance 6d2b21d2-3add-42cb-be62-a14cf8e92f6a could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:05.210031 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-bbb82c81-b69c-462d-a118-517f3b0b7717 tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a" status: 404 len: 111 microversion: 2.1 time: 0.034631 Sep 10 11:43:05.210031 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4578/6836] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:05 2022] GET /compute/v2.1/servers/6d2b21d2-3add-42cb-be62-a14cf8e92f6a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:05.216151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-26a0be08-0cbf-480d-8631-9e8008efcd8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] Calling method '.version_select at 0x7efcaddeb5e0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:05.236698 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-26a0be08-0cbf-480d-8631-9e8008efcd8f tempest-TestMinimumBasicScenario-2014934730 tempest-TestMinimumBasicScenario-2014934730-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1959421004" status: 202 len: 0 microversion: 2.1 time: 0.024959 Sep 10 11:43:05.237372 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2259/6837] 10.222.0.20 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1959421004 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:14.055763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-477f9195-9b67-41ae-8fc8-bc5f09e71595 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'create', calling method: .version_select at 0x7efcaece90d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1566023785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNO7aO0LwjTkoG6CTn+8d8xEsyqfxHrBRDIjaV9sl873mIe80nUZ1LlUld+CMr2Mdf8GDiIKFN3MmuRbsna7T+WtVKtircKCzoXIYkijfZPlaheo1DGb8DsPq1od1WlWvQ=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:14.071025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-477f9195-9b67-41ae-8fc8-bc5f09e71595 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:43:14.076574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-477f9195-9b67-41ae-8fc8-bc5f09e71595 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for user e085bc75f0c54299a24a5252d0a26dc0 and project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:43:14.100712 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-477f9195-9b67-41ae-8fc8-bc5f09e71595 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.206404 Sep 10 11:43:14.101373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4579/6838] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:43:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:43:19.835186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:19.835992 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:19.840720 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1259441762", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "3791177b-1740-436e-b238-0f78bffed097"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1566023785", "security_groups": [{"name": "tempest-secgroup-smoke-1509543029"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:19.976656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] validate_networks() for [('3791177b-1740-436e-b238-0f78bffed097', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:43:20.447658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:43:20.448166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:43:20.448836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:43:20.449429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:43:20.450013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:43:20.459169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:20.459811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:20.460259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:20.460988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:20.461475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:20.461904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:20.479896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:43:20.485277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for user e085bc75f0c54299a24a5252d0a26dc0 and project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:43:20.499521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:43:20.501907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:43:20.551839 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-32e396e3-6546-46b6-ac13-f4fc2a23ba76 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718974 Sep 10 11:43:20.552670 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2260/6839] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:43:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:43:20.561948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=38 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:20.566564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d6ce2133-04fa-439d-b25b-f4287908b753 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:20.567399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d6ce2133-04fa-439d-b25b-f4287908b753 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:20.632019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d6ce2133-04fa-439d-b25b-f4287908b753 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:20.645402 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d6ce2133-04fa-439d-b25b-f4287908b753 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1267 microversion: 2.1 time: 0.084918 Sep 10 11:43:20.646491 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4580/6840] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:20 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:21.670003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f63e5190-2927-452a-bdce-cd0f0e274d40 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:21.670616 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f63e5190-2927-452a-bdce-cd0f0e274d40 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:21.678600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f63e5190-2927-452a-bdce-cd0f0e274d40 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:21.679338 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f63e5190-2927-452a-bdce-cd0f0e274d40 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:21.679780 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f63e5190-2927-452a-bdce-cd0f0e274d40 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:21.680472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f63e5190-2927-452a-bdce-cd0f0e274d40 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:21.680925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f63e5190-2927-452a-bdce-cd0f0e274d40 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:21.681403 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f63e5190-2927-452a-bdce-cd0f0e274d40 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:21.756930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f63e5190-2927-452a-bdce-cd0f0e274d40 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:21.766410 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f63e5190-2927-452a-bdce-cd0f0e274d40 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1319 microversion: 2.1 time: 0.101727 Sep 10 11:43:21.766995 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2261/6841] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:21 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1319 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:22.795504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-059091f9-806b-47eb-8f1d-2e8c58bb67b1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:22.797053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-059091f9-806b-47eb-8f1d-2e8c58bb67b1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:22.801235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:22.810337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-059091f9-806b-47eb-8f1d-2e8c58bb67b1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:22.810901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-059091f9-806b-47eb-8f1d-2e8c58bb67b1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:22.811557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-059091f9-806b-47eb-8f1d-2e8c58bb67b1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:22.812302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-059091f9-806b-47eb-8f1d-2e8c58bb67b1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:22.812786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-059091f9-806b-47eb-8f1d-2e8c58bb67b1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:22.813322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-059091f9-806b-47eb-8f1d-2e8c58bb67b1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:22.958381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-059091f9-806b-47eb-8f1d-2e8c58bb67b1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:22.966931 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-059091f9-806b-47eb-8f1d-2e8c58bb67b1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1393 microversion: 2.1 time: 0.179360 Sep 10 11:43:22.967540 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4581/6842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:22 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:23.318524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-057a1462-532b-4200-bf80-56c25a3ed53d req-8fd1d9d7-15ed-412e-bee8-e74f3995f38c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4954c23-dab7-4f39-ab4e-7595667baff7", "tag": "1c022d52-1921-453e-b157-fb46d60e2cca"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:23.335899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-057a1462-532b-4200-bf80-56c25a3ed53d req-8fd1d9d7-15ed-412e-bee8-e74f3995f38c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:23.336489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-057a1462-532b-4200-bf80-56c25a3ed53d req-8fd1d9d7-15ed-412e-bee8-e74f3995f38c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:23.336976 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-057a1462-532b-4200-bf80-56c25a3ed53d req-8fd1d9d7-15ed-412e-bee8-e74f3995f38c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:23.349614 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-057a1462-532b-4200-bf80-56c25a3ed53d req-8fd1d9d7-15ed-412e-bee8-e74f3995f38c service nova] Creating event network-changed:1c022d52-1921-453e-b157-fb46d60e2cca for instance b4954c23-dab7-4f39-ab4e-7595667baff7 on n-h1-856894-1 Sep 10 11:43:23.355032 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-057a1462-532b-4200-bf80-56c25a3ed53d req-8fd1d9d7-15ed-412e-bee8-e74f3995f38c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044578 Sep 10 11:43:23.355843 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2262/6843] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:23.989763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-3986637c-6834-4787-b26f-582a95d8d8d8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:23.990309 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-3986637c-6834-4787-b26f-582a95d8d8d8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:23.997251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3986637c-6834-4787-b26f-582a95d8d8d8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:23.997749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3986637c-6834-4787-b26f-582a95d8d8d8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:23.998201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3986637c-6834-4787-b26f-582a95d8d8d8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:23.998923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3986637c-6834-4787-b26f-582a95d8d8d8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:23.999392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3986637c-6834-4787-b26f-582a95d8d8d8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:23.999827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-3986637c-6834-4787-b26f-582a95d8d8d8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:24.127512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-3986637c-6834-4787-b26f-582a95d8d8d8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:24.135810 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-3986637c-6834-4787-b26f-582a95d8d8d8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1393 microversion: 2.1 time: 0.149610 Sep 10 11:43:24.136400 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4582/6844] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:23 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:25.160402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6a100323-6a42-40ab-9148-c16a3fc3ac90 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:25.161018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6a100323-6a42-40ab-9148-c16a3fc3ac90 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:25.167130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a100323-6a42-40ab-9148-c16a3fc3ac90 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:25.167605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a100323-6a42-40ab-9148-c16a3fc3ac90 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:25.168037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a100323-6a42-40ab-9148-c16a3fc3ac90 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:25.168727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a100323-6a42-40ab-9148-c16a3fc3ac90 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:25.169194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a100323-6a42-40ab-9148-c16a3fc3ac90 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:25.169613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6a100323-6a42-40ab-9148-c16a3fc3ac90 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:25.314201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6a100323-6a42-40ab-9148-c16a3fc3ac90 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:25.322395 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6a100323-6a42-40ab-9148-c16a3fc3ac90 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1393 microversion: 2.1 time: 0.167256 Sep 10 11:43:25.323604 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2263/6845] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:25 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:26.345764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e835f4e0-2ad9-4682-8794-84e52589a47d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:26.346396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e835f4e0-2ad9-4682-8794-84e52589a47d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:26.353338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e835f4e0-2ad9-4682-8794-84e52589a47d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:26.353847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e835f4e0-2ad9-4682-8794-84e52589a47d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:26.354305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e835f4e0-2ad9-4682-8794-84e52589a47d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:26.355021 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e835f4e0-2ad9-4682-8794-84e52589a47d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:26.355498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e835f4e0-2ad9-4682-8794-84e52589a47d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:26.355946 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e835f4e0-2ad9-4682-8794-84e52589a47d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:26.485065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e835f4e0-2ad9-4682-8794-84e52589a47d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:26.492794 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e835f4e0-2ad9-4682-8794-84e52589a47d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1393 microversion: 2.1 time: 0.151051 Sep 10 11:43:26.493410 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4583/6846] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:26 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:27.516025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1e3095f7-51cb-40f8-85d4-5d666d2a48b9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:27.516636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1e3095f7-51cb-40f8-85d4-5d666d2a48b9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:27.523423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3095f7-51cb-40f8-85d4-5d666d2a48b9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:27.523905 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3095f7-51cb-40f8-85d4-5d666d2a48b9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:27.524340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3095f7-51cb-40f8-85d4-5d666d2a48b9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:27.525016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3095f7-51cb-40f8-85d4-5d666d2a48b9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:27.526102 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3095f7-51cb-40f8-85d4-5d666d2a48b9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:27.526534 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1e3095f7-51cb-40f8-85d4-5d666d2a48b9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:27.663730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1e3095f7-51cb-40f8-85d4-5d666d2a48b9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:27.673452 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1e3095f7-51cb-40f8-85d4-5d666d2a48b9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1393 microversion: 2.1 time: 0.161191 Sep 10 11:43:27.674237 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2264/6847] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:27 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:28.696392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-baf87622-7d0f-4a45-8585-5a3305937306 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:28.697037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-baf87622-7d0f-4a45-8585-5a3305937306 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:28.703987 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baf87622-7d0f-4a45-8585-5a3305937306 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:28.704495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baf87622-7d0f-4a45-8585-5a3305937306 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:28.704955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baf87622-7d0f-4a45-8585-5a3305937306 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:28.705707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baf87622-7d0f-4a45-8585-5a3305937306 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:28.706173 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baf87622-7d0f-4a45-8585-5a3305937306 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:28.706621 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-baf87622-7d0f-4a45-8585-5a3305937306 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:28.835277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-baf87622-7d0f-4a45-8585-5a3305937306 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:28.843542 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-baf87622-7d0f-4a45-8585-5a3305937306 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1393 microversion: 2.1 time: 0.151112 Sep 10 11:43:28.844129 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4584/6848] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:28 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:29.772048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-38a1e07a-4dc8-42d3-bccb-0684e20853f8 req-f5d3f8f6-d1f5-406f-8f1b-afe5e7dc0afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4954c23-dab7-4f39-ab4e-7595667baff7", "name": "network-vif-plugged", "status": "completed", "tag": "1c022d52-1921-453e-b157-fb46d60e2cca"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:29.782678 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-38a1e07a-4dc8-42d3-bccb-0684e20853f8 req-f5d3f8f6-d1f5-406f-8f1b-afe5e7dc0afb service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:29.783110 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-38a1e07a-4dc8-42d3-bccb-0684e20853f8 req-f5d3f8f6-d1f5-406f-8f1b-afe5e7dc0afb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:29.783546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-38a1e07a-4dc8-42d3-bccb-0684e20853f8 req-f5d3f8f6-d1f5-406f-8f1b-afe5e7dc0afb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:29.794910 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-38a1e07a-4dc8-42d3-bccb-0684e20853f8 req-f5d3f8f6-d1f5-406f-8f1b-afe5e7dc0afb service nova] Creating event network-vif-plugged:1c022d52-1921-453e-b157-fb46d60e2cca for instance b4954c23-dab7-4f39-ab4e-7595667baff7 on n-h1-856894-1 Sep 10 11:43:29.799883 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-38a1e07a-4dc8-42d3-bccb-0684e20853f8 req-f5d3f8f6-d1f5-406f-8f1b-afe5e7dc0afb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031635 Sep 10 11:43:29.800495 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2265/6849] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:29.866919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b013f006-04f2-449b-9692-fc531338a28c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:29.867634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b013f006-04f2-449b-9692-fc531338a28c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:29.875103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b013f006-04f2-449b-9692-fc531338a28c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:29.875647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b013f006-04f2-449b-9692-fc531338a28c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:29.876106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b013f006-04f2-449b-9692-fc531338a28c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:29.876825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b013f006-04f2-449b-9692-fc531338a28c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:29.877344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b013f006-04f2-449b-9692-fc531338a28c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:29.877792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b013f006-04f2-449b-9692-fc531338a28c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:30.008604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b013f006-04f2-449b-9692-fc531338a28c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:30.016767 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b013f006-04f2-449b-9692-fc531338a28c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1393 microversion: 2.1 time: 0.153885 Sep 10 11:43:30.017408 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4585/6850] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:29 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:31.037999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:31.038938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:31.045600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-63b574c4-9fe2-4503-9782-cede2bb18816 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:31.046469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-63b574c4-9fe2-4503-9782-cede2bb18816 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:31.055497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63b574c4-9fe2-4503-9782-cede2bb18816 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:31.056211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63b574c4-9fe2-4503-9782-cede2bb18816 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:31.056638 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63b574c4-9fe2-4503-9782-cede2bb18816 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:31.057895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63b574c4-9fe2-4503-9782-cede2bb18816 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:31.058554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63b574c4-9fe2-4503-9782-cede2bb18816 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:31.058982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-63b574c4-9fe2-4503-9782-cede2bb18816 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:31.201323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-63b574c4-9fe2-4503-9782-cede2bb18816 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:31.209389 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-63b574c4-9fe2-4503-9782-cede2bb18816 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1565 microversion: 2.1 time: 0.172404 Sep 10 11:43:31.209966 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2266/6851] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:31 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:31.231255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4e524e69-777a-417e-b457-024b7b85c645 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:31.231883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4e524e69-777a-417e-b457-024b7b85c645 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:31.233760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:31.240495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e524e69-777a-417e-b457-024b7b85c645 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:31.240992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e524e69-777a-417e-b457-024b7b85c645 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:31.241465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e524e69-777a-417e-b457-024b7b85c645 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:31.242168 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e524e69-777a-417e-b457-024b7b85c645 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:31.242637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e524e69-777a-417e-b457-024b7b85c645 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:31.243101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4e524e69-777a-417e-b457-024b7b85c645 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:31.379178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4e524e69-777a-417e-b457-024b7b85c645 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:31.387702 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4e524e69-777a-417e-b457-024b7b85c645 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1565 microversion: 2.1 time: 0.160329 Sep 10 11:43:31.388297 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4586/6852] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:31 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:33.278396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-747d45df-92e7-4dcb-9a1d-d52e567f5194 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:33.279019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-747d45df-92e7-4dcb-9a1d-d52e567f5194 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:33.283410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9fa720e1-4205-4d6a-a08c-76d93d16713a req-2c4efa58-6fb1-4170-8d75-fa751d056861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4954c23-dab7-4f39-ab4e-7595667baff7", "tag": "1c022d52-1921-453e-b157-fb46d60e2cca"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:33.291959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747d45df-92e7-4dcb-9a1d-d52e567f5194 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:33.292807 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747d45df-92e7-4dcb-9a1d-d52e567f5194 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:33.293515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747d45df-92e7-4dcb-9a1d-d52e567f5194 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:33.294464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747d45df-92e7-4dcb-9a1d-d52e567f5194 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:33.294966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9fa720e1-4205-4d6a-a08c-76d93d16713a req-2c4efa58-6fb1-4170-8d75-fa751d056861 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:33.295406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747d45df-92e7-4dcb-9a1d-d52e567f5194 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:33.295526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9fa720e1-4205-4d6a-a08c-76d93d16713a req-2c4efa58-6fb1-4170-8d75-fa751d056861 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:33.295908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9fa720e1-4205-4d6a-a08c-76d93d16713a req-2c4efa58-6fb1-4170-8d75-fa751d056861 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:33.296853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-747d45df-92e7-4dcb-9a1d-d52e567f5194 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:33.308450 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9fa720e1-4205-4d6a-a08c-76d93d16713a req-2c4efa58-6fb1-4170-8d75-fa751d056861 service nova] Creating event network-changed:1c022d52-1921-453e-b157-fb46d60e2cca for instance b4954c23-dab7-4f39-ab4e-7595667baff7 on n-h1-856894-1 Sep 10 11:43:33.314213 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9fa720e1-4205-4d6a-a08c-76d93d16713a req-2c4efa58-6fb1-4170-8d75-fa751d056861 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035990 Sep 10 11:43:33.315444 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4587/6853] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:43:33.442918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-747d45df-92e7-4dcb-9a1d-d52e567f5194 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:33.451430 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-747d45df-92e7-4dcb-9a1d-d52e567f5194 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1565 microversion: 2.1 time: 0.177172 Sep 10 11:43:33.452162 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2267/6854] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:33 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:56.708147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=13 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:56.708914 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=38 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:56.713493 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d23898ea-1725-4f97-963d-8f8d0086e238 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:56.715765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d23898ea-1725-4f97-963d-8f8d0086e238 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:56.722766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23898ea-1725-4f97-963d-8f8d0086e238 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:56.723266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23898ea-1725-4f97-963d-8f8d0086e238 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:56.723745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23898ea-1725-4f97-963d-8f8d0086e238 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:56.724455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23898ea-1725-4f97-963d-8f8d0086e238 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:56.724932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23898ea-1725-4f97-963d-8f8d0086e238 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:56.725406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d23898ea-1725-4f97-963d-8f8d0086e238 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:56.775537 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d23898ea-1725-4f97-963d-8f8d0086e238 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7/action" status: 200 len: 24572 microversion: 2.1 time: 0.069241 Sep 10 11:43:56.776180 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4588/6855] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:43:56 2022] POST /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7/action => generated 24572 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:44:03.176514 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5cfa8903-b86c-4d31-9cfd-31531cb780bc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:03.177661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5cfa8903-b86c-4d31-9cfd-31531cb780bc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:03.180108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:03.180770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=36 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:03.187189 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cfa8903-b86c-4d31-9cfd-31531cb780bc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:03.187679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cfa8903-b86c-4d31-9cfd-31531cb780bc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:03.188118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cfa8903-b86c-4d31-9cfd-31531cb780bc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:03.188815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cfa8903-b86c-4d31-9cfd-31531cb780bc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:03.189298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cfa8903-b86c-4d31-9cfd-31531cb780bc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:03.189726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cfa8903-b86c-4d31-9cfd-31531cb780bc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:03.257909 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5cfa8903-b86c-4d31-9cfd-31531cb780bc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7/action" status: 202 len: 0 microversion: 2.1 time: 0.085283 Sep 10 11:44:03.259327 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2268/6856] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:44:03 2022] POST /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:03.268790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f37080b5-7518-4bfc-94d8-e3071b7e3ba5 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:03.269937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f37080b5-7518-4bfc-94d8-e3071b7e3ba5 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:03.277752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f37080b5-7518-4bfc-94d8-e3071b7e3ba5 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:03.278303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f37080b5-7518-4bfc-94d8-e3071b7e3ba5 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:03.278730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f37080b5-7518-4bfc-94d8-e3071b7e3ba5 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:03.279448 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f37080b5-7518-4bfc-94d8-e3071b7e3ba5 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:03.279925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f37080b5-7518-4bfc-94d8-e3071b7e3ba5 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:03.280374 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f37080b5-7518-4bfc-94d8-e3071b7e3ba5 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:03.419992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f37080b5-7518-4bfc-94d8-e3071b7e3ba5 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:03.428302 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f37080b5-7518-4bfc-94d8-e3071b7e3ba5 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1689 microversion: 2.1 time: 0.163810 Sep 10 11:44:03.428890 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4589/6857] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:03 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:04.455497 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-41710ff2-4166-473a-8687-344a9c15d602 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:04.456203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-41710ff2-4166-473a-8687-344a9c15d602 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:04.462470 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41710ff2-4166-473a-8687-344a9c15d602 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.462956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41710ff2-4166-473a-8687-344a9c15d602 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.463404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41710ff2-4166-473a-8687-344a9c15d602 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.464093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41710ff2-4166-473a-8687-344a9c15d602 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.464556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41710ff2-4166-473a-8687-344a9c15d602 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.464986 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-41710ff2-4166-473a-8687-344a9c15d602 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.600324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-41710ff2-4166-473a-8687-344a9c15d602 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:04.608701 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-41710ff2-4166-473a-8687-344a9c15d602 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1669 microversion: 2.1 time: 0.158697 Sep 10 11:44:04.609218 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2269/6858] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:04 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:05.709834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e58f1435-aa5c-41ed-a6b2-b9be007651f0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:05.712047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e58f1435-aa5c-41ed-a6b2-b9be007651f0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:05.719921 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e58f1435-aa5c-41ed-a6b2-b9be007651f0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:05.720423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e58f1435-aa5c-41ed-a6b2-b9be007651f0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:05.720880 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e58f1435-aa5c-41ed-a6b2-b9be007651f0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:05.721626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e58f1435-aa5c-41ed-a6b2-b9be007651f0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:05.722101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e58f1435-aa5c-41ed-a6b2-b9be007651f0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:05.722544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e58f1435-aa5c-41ed-a6b2-b9be007651f0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:05.771658 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e58f1435-aa5c-41ed-a6b2-b9be007651f0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7/action" status: 200 len: 32638 microversion: 2.1 time: 0.065661 Sep 10 11:44:05.772317 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4590/6859] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:44:05 2022] POST /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7/action => generated 32638 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:44:05.783770 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9691958d-65fe-436b-9f1d-639a3ff04606 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:05.784308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9691958d-65fe-436b-9f1d-639a3ff04606 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:05.791119 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9691958d-65fe-436b-9f1d-639a3ff04606 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:05.791602 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9691958d-65fe-436b-9f1d-639a3ff04606 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:05.792037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9691958d-65fe-436b-9f1d-639a3ff04606 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:05.792718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9691958d-65fe-436b-9f1d-639a3ff04606 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:05.793200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9691958d-65fe-436b-9f1d-639a3ff04606 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:05.793622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9691958d-65fe-436b-9f1d-639a3ff04606 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:05.859167 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9691958d-65fe-436b-9f1d-639a3ff04606 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7/action" status: 202 len: 0 microversion: 2.1 time: 0.079006 Sep 10 11:44:05.859838 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2270/6860] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:44:05 2022] POST /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:05.869435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8b7f6e2b-6f11-4d59-90d0-72dc0bcb628f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:05.870162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8b7f6e2b-6f11-4d59-90d0-72dc0bcb628f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:05.878200 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7f6e2b-6f11-4d59-90d0-72dc0bcb628f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:05.878719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7f6e2b-6f11-4d59-90d0-72dc0bcb628f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:05.879206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7f6e2b-6f11-4d59-90d0-72dc0bcb628f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:05.879932 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7f6e2b-6f11-4d59-90d0-72dc0bcb628f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:05.880408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7f6e2b-6f11-4d59-90d0-72dc0bcb628f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:05.880856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8b7f6e2b-6f11-4d59-90d0-72dc0bcb628f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:06.018344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8b7f6e2b-6f11-4d59-90d0-72dc0bcb628f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:06.026483 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8b7f6e2b-6f11-4d59-90d0-72dc0bcb628f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1676 microversion: 2.1 time: 0.161981 Sep 10 11:44:06.027253 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4591/6861] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:05 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:44:07.051897 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-035be847-a8e9-461f-b8a4-49ad4e5daf19 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:07.052592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-035be847-a8e9-461f-b8a4-49ad4e5daf19 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:07.059117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-035be847-a8e9-461f-b8a4-49ad4e5daf19 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:07.059609 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-035be847-a8e9-461f-b8a4-49ad4e5daf19 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:07.060031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-035be847-a8e9-461f-b8a4-49ad4e5daf19 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:07.060708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-035be847-a8e9-461f-b8a4-49ad4e5daf19 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:07.061182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-035be847-a8e9-461f-b8a4-49ad4e5daf19 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:07.061601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-035be847-a8e9-461f-b8a4-49ad4e5daf19 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:07.190806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-035be847-a8e9-461f-b8a4-49ad4e5daf19 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:07.198727 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-035be847-a8e9-461f-b8a4-49ad4e5daf19 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1684 microversion: 2.1 time: 0.151895 Sep 10 11:44:07.199557 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2271/6862] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:07 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:07.294875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6ee3bcc9-3b5f-444a-ade7-8bc4ab528b7f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:07.297136 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6ee3bcc9-3b5f-444a-ade7-8bc4ab528b7f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:07.305215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee3bcc9-3b5f-444a-ade7-8bc4ab528b7f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:07.305660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee3bcc9-3b5f-444a-ade7-8bc4ab528b7f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:07.306117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee3bcc9-3b5f-444a-ade7-8bc4ab528b7f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:07.306824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee3bcc9-3b5f-444a-ade7-8bc4ab528b7f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:07.307297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee3bcc9-3b5f-444a-ade7-8bc4ab528b7f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:07.307742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6ee3bcc9-3b5f-444a-ade7-8bc4ab528b7f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:07.357324 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6ee3bcc9-3b5f-444a-ade7-8bc4ab528b7f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7/action" status: 200 len: 36073 microversion: 2.1 time: 0.066852 Sep 10 11:44:07.357975 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4592/6863] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:44:07 2022] POST /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7/action => generated 36073 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:44:08.406433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bc866c09-d484-4a4b-a24f-9fb08f5e49c3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:08.407645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bc866c09-d484-4a4b-a24f-9fb08f5e49c3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:08.408975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-f46f158c-2284-411a-9bfb-34b92151c400 req-0e011d7f-1b4e-44e1-9da3-8dd1e4e4c3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4954c23-dab7-4f39-ab4e-7595667baff7", "tag": "1c022d52-1921-453e-b157-fb46d60e2cca"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:08.415381 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc866c09-d484-4a4b-a24f-9fb08f5e49c3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:08.416262 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc866c09-d484-4a4b-a24f-9fb08f5e49c3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:08.416776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc866c09-d484-4a4b-a24f-9fb08f5e49c3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:08.417594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc866c09-d484-4a4b-a24f-9fb08f5e49c3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:08.418749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc866c09-d484-4a4b-a24f-9fb08f5e49c3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:08.419349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bc866c09-d484-4a4b-a24f-9fb08f5e49c3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:08.420912 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f46f158c-2284-411a-9bfb-34b92151c400 req-0e011d7f-1b4e-44e1-9da3-8dd1e4e4c3ec service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:08.421551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f46f158c-2284-411a-9bfb-34b92151c400 req-0e011d7f-1b4e-44e1-9da3-8dd1e4e4c3ec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:08.422235 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-f46f158c-2284-411a-9bfb-34b92151c400 req-0e011d7f-1b4e-44e1-9da3-8dd1e4e4c3ec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:08.438454 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-f46f158c-2284-411a-9bfb-34b92151c400 req-0e011d7f-1b4e-44e1-9da3-8dd1e4e4c3ec service nova] Creating event network-changed:1c022d52-1921-453e-b157-fb46d60e2cca for instance b4954c23-dab7-4f39-ab4e-7595667baff7 on n-h1-856894-1 Sep 10 11:44:08.443710 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-f46f158c-2284-411a-9bfb-34b92151c400 req-0e011d7f-1b4e-44e1-9da3-8dd1e4e4c3ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039066 Sep 10 11:44:08.444845 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4593/6864] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:44:08.448449 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bc866c09-d484-4a4b-a24f-9fb08f5e49c3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:44:08.535910 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bc866c09-d484-4a4b-a24f-9fb08f5e49c3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 204 len: 0 microversion: 2.1 time: 0.133396 Sep 10 11:44:08.536932 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2272/6865] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:44:08 2022] DELETE /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:44:08.562354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e21be90a-727c-41be-b996-039ee0638da8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:08.564469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e21be90a-727c-41be-b996-039ee0638da8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:08.571300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21be90a-727c-41be-b996-039ee0638da8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:08.571918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21be90a-727c-41be-b996-039ee0638da8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:08.572456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21be90a-727c-41be-b996-039ee0638da8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:08.573813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21be90a-727c-41be-b996-039ee0638da8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:08.574504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21be90a-727c-41be-b996-039ee0638da8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:08.574974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e21be90a-727c-41be-b996-039ee0638da8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:08.722069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e21be90a-727c-41be-b996-039ee0638da8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:08.729929 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e21be90a-727c-41be-b996-039ee0638da8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1690 microversion: 2.1 time: 0.184509 Sep 10 11:44:08.730656 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4594/6866] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:08 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1690 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:09.755784 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4b93ea68-fd3b-421c-ab17-d919c51d12a8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:09.756481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4b93ea68-fd3b-421c-ab17-d919c51d12a8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:09.763765 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b93ea68-fd3b-421c-ab17-d919c51d12a8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:09.764246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b93ea68-fd3b-421c-ab17-d919c51d12a8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:09.764680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b93ea68-fd3b-421c-ab17-d919c51d12a8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:09.765396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b93ea68-fd3b-421c-ab17-d919c51d12a8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:09.765848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b93ea68-fd3b-421c-ab17-d919c51d12a8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:09.766268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b93ea68-fd3b-421c-ab17-d919c51d12a8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:09.902960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4b93ea68-fd3b-421c-ab17-d919c51d12a8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:09.910802 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4b93ea68-fd3b-421c-ab17-d919c51d12a8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1690 microversion: 2.1 time: 0.159313 Sep 10 11:44:09.911375 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2273/6867] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:09 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:10.594619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-68a4df73-b168-4b98-a054-5d12ab28d5f8 req-6552d828-dadd-4b9d-8d10-a8d81d60988f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4954c23-dab7-4f39-ab4e-7595667baff7", "name": "network-vif-deleted", "tag": "1c022d52-1921-453e-b157-fb46d60e2cca"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:10.608435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-68a4df73-b168-4b98-a054-5d12ab28d5f8 req-6552d828-dadd-4b9d-8d10-a8d81d60988f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:10.609191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-68a4df73-b168-4b98-a054-5d12ab28d5f8 req-6552d828-dadd-4b9d-8d10-a8d81d60988f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:10.609901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-68a4df73-b168-4b98-a054-5d12ab28d5f8 req-6552d828-dadd-4b9d-8d10-a8d81d60988f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:10.623797 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-68a4df73-b168-4b98-a054-5d12ab28d5f8 req-6552d828-dadd-4b9d-8d10-a8d81d60988f service nova] Creating event network-vif-deleted:1c022d52-1921-453e-b157-fb46d60e2cca for instance b4954c23-dab7-4f39-ab4e-7595667baff7 on n-h1-856894-1 Sep 10 11:44:10.628705 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-68a4df73-b168-4b98-a054-5d12ab28d5f8 req-6552d828-dadd-4b9d-8d10-a8d81d60988f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038489 Sep 10 11:44:10.629351 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4595/6868] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:10.934822 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:10.935430 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:10.942655 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:10.943150 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:10.943591 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:10.944301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:10.944763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:10.945363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:10.979659 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:10.980246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:10.981406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:10.981925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lazy-loading 'fault' on Instance uuid b4954c23-dab7-4f39-ab4e-7595667baff7 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:44:11.030790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:11.038649 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8a151b25-9546-4290-8796-0b92c3b0b7a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 200 len: 1357 microversion: 2.1 time: 0.108249 Sep 10 11:44:11.039435 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2274/6869] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:10 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 1357 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:12.065456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:12.066184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: b4954c23-dab7-4f39-ab4e-7595667baff7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:12.072832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:12.073395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:12.073858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:12.074571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:12.075045 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:12.075488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:12.088895 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] HTTP exception thrown: Instance b4954c23-dab7-4f39-ab4e-7595667baff7 could not be found. Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Request method failure captured: Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 HTTP/1.1 Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHhRyltnowTOB2igHay_0zljRnORjtCrqWTIMoFWA849Bp0w1HZKNF3ywind08ohEU6rRGOqTJ5W4r6nubhdqDgB4vAjNmUKmMdSQK12yO6639vPMn2vRvSSntI0B-Oxm3ks9hZX6oTyyXyRHnzbHZoORrizqS1OtvpDVt0FLCF7W0A Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9972c52da6144ebcaa81a0fde66ca255 Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9972c52da6144ebcaa81a0fde66ca255", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9972c52da6144ebcaa81a0fde66ca255 Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestNetworkAdvancedServerOps-344189195-project Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e085bc75f0c54299a24a5252d0a26dc0 Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestNetworkAdvancedServerOps-344189195-project Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance b4954c23-dab7-4f39-ab4e-7595667baff7 could not be found. Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': 'b4954c23-dab7-4f39-ab4e-7595667baff7'} Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4954c23-dab7-4f39-ab4e-7595667baff7 could not be found. Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4954c23-dab7-4f39-ab4e-7595667baff7 could not be found. Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:44:12.090598 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4954c23-dab7-4f39-ab4e-7595667baff7 could not be found. Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Returning 404 to user: Instance b4954c23-dab7-4f39-ab4e-7595667baff7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f538ee44-da72-4137-86ec-6dd4175fbdab tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7" status: 404 len: 111 microversion: 2.1 time: 0.031848 Sep 10 11:44:12.094724 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4596/6870] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:12 2022] GET /compute/v2.1/servers/b4954c23-dab7-4f39-ab4e-7595667baff7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:44:15.395024 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9429c6a8-acdf-43df-928e-7cf97b57f8ef tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '.version_select at 0x7efcad97be50>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:15.418328 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9429c6a8-acdf-43df-928e-7cf97b57f8ef tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1566023785" status: 202 len: 0 microversion: 2.1 time: 0.027133 Sep 10 11:44:15.419093 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2275/6871] 10.222.0.20 () {58 vars in 1284 bytes} [Sat Sep 10 11:44:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1566023785 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:15.443151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b34f45a7-cdda-4bec-ac98-8b9062075514 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'create', calling method: .version_select at 0x7efcad3f3ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1834619649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtyVpccKv5QYobMFGdAlozxbGcR4s8N18G6QnxxngcE14w8socJnazsAh8fXEHbqau7YfVLQunZtMWN9zJAaHJv3q7f2+mRYr9dkPQ4tTYA+BHiuSclP9SRIRyLdXszSw=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:15.459885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b34f45a7-cdda-4bec-ac98-8b9062075514 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:15.465965 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-b34f45a7-cdda-4bec-ac98-8b9062075514 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for user e085bc75f0c54299a24a5252d0a26dc0 and project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:15.494620 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b34f45a7-cdda-4bec-ac98-8b9062075514 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055063 Sep 10 11:44:15.496384 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4597/6872] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:44:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:20.882467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1256621657", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "1d5a005f-7fa9-4034-a569-dc7f4da7aef3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1834619649", "security_groups": [{"name": "tempest-secgroup-smoke-2099633644"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:20.992751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] validate_networks() for [('1d5a005f-7fa9-4034-a569-dc7f4da7aef3', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:44:21.036158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:21.478343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:44:21.478934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:44:21.479730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:44:21.481336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:44:21.482197 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:44:21.492206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:21.492928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:21.493420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:21.494151 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:21.494744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:21.495172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:21.519385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:21.525611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for user e085bc75f0c54299a24a5252d0a26dc0 and project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:21.541915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:44:21.559718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:44:21.618248 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-efef903a-e896-42ba-b38c-71baf0c9a244 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.739807 Sep 10 11:44:21.626685 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2276/6873] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:44:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:44:21.633287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ed773b9-a7a8-430d-bd9f-d74464a488c0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:21.635501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8ed773b9-a7a8-430d-bd9f-d74464a488c0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:21.756675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8ed773b9-a7a8-430d-bd9f-d74464a488c0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:21.764491 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ed773b9-a7a8-430d-bd9f-d74464a488c0 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1267 microversion: 2.1 time: 0.136846 Sep 10 11:44:21.766462 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4598/6874] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:21 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:22.790387 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6761bea2-6add-4101-9fc5-a245b5b48f1e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:22.791105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6761bea2-6add-4101-9fc5-a245b5b48f1e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:22.800177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6761bea2-6add-4101-9fc5-a245b5b48f1e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:22.800862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6761bea2-6add-4101-9fc5-a245b5b48f1e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:22.801500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6761bea2-6add-4101-9fc5-a245b5b48f1e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:22.802308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6761bea2-6add-4101-9fc5-a245b5b48f1e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:22.803031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6761bea2-6add-4101-9fc5-a245b5b48f1e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:22.803691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6761bea2-6add-4101-9fc5-a245b5b48f1e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:22.896001 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6761bea2-6add-4101-9fc5-a245b5b48f1e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:22.909638 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6761bea2-6add-4101-9fc5-a245b5b48f1e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1327 microversion: 2.1 time: 0.122854 Sep 10 11:44:22.921178 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2277/6875] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:22 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:23.936243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d9f80614-a4fb-411d-9b49-c9252835becf tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:23.937519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d9f80614-a4fb-411d-9b49-c9252835becf tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:23.943405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=36 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:23.946933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9f80614-a4fb-411d-9b49-c9252835becf tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:23.947555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9f80614-a4fb-411d-9b49-c9252835becf tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:23.948196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9f80614-a4fb-411d-9b49-c9252835becf tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:23.949397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9f80614-a4fb-411d-9b49-c9252835becf tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:23.950327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9f80614-a4fb-411d-9b49-c9252835becf tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:23.951300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d9f80614-a4fb-411d-9b49-c9252835becf tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:24.185937 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d9f80614-a4fb-411d-9b49-c9252835becf tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:24.194559 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d9f80614-a4fb-411d-9b49-c9252835becf tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1393 microversion: 2.1 time: 0.263961 Sep 10 11:44:24.202439 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4599/6876] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:23 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1393 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:24.512222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-e736312a-eac0-4a95-a88d-ef4ecda28e15 req-2ff9d61b-1f9f-4a5c-ae79-c0f743e1beec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236a3b4b-d40b-4630-bc91-c411af524f23", "tag": "85f4b6c5-6695-4f09-9d25-923db2271d76"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:24.525192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e736312a-eac0-4a95-a88d-ef4ecda28e15 req-2ff9d61b-1f9f-4a5c-ae79-c0f743e1beec service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:24.525667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e736312a-eac0-4a95-a88d-ef4ecda28e15 req-2ff9d61b-1f9f-4a5c-ae79-c0f743e1beec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:24.526096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e736312a-eac0-4a95-a88d-ef4ecda28e15 req-2ff9d61b-1f9f-4a5c-ae79-c0f743e1beec service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:24.540059 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-e736312a-eac0-4a95-a88d-ef4ecda28e15 req-2ff9d61b-1f9f-4a5c-ae79-c0f743e1beec service nova] Creating event network-changed:85f4b6c5-6695-4f09-9d25-923db2271d76 for instance 236a3b4b-d40b-4630-bc91-c411af524f23 on n-h2-856894-1 Sep 10 11:44:24.545547 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-e736312a-eac0-4a95-a88d-ef4ecda28e15 req-2ff9d61b-1f9f-4a5c-ae79-c0f743e1beec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037615 Sep 10 11:44:24.546151 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2278/6877] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:44:25.218857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-923cbd62-b25c-48d7-90ec-41cb90f7321e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:25.219491 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-923cbd62-b25c-48d7-90ec-41cb90f7321e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:25.226346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-923cbd62-b25c-48d7-90ec-41cb90f7321e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:25.226848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-923cbd62-b25c-48d7-90ec-41cb90f7321e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:25.227301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-923cbd62-b25c-48d7-90ec-41cb90f7321e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:25.228003 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-923cbd62-b25c-48d7-90ec-41cb90f7321e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:25.228475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-923cbd62-b25c-48d7-90ec-41cb90f7321e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:25.228911 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-923cbd62-b25c-48d7-90ec-41cb90f7321e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:25.362961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-923cbd62-b25c-48d7-90ec-41cb90f7321e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:25.371549 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-923cbd62-b25c-48d7-90ec-41cb90f7321e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1393 microversion: 2.1 time: 0.156047 Sep 10 11:44:25.372132 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4600/6878] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:25 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:26.395834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-461a885a-3b78-466c-ba21-6bfdc88f738c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:26.395834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-461a885a-3b78-466c-ba21-6bfdc88f738c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:26.402949 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-461a885a-3b78-466c-ba21-6bfdc88f738c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:26.403435 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-461a885a-3b78-466c-ba21-6bfdc88f738c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:26.403876 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-461a885a-3b78-466c-ba21-6bfdc88f738c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:26.404571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-461a885a-3b78-466c-ba21-6bfdc88f738c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:26.405297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-461a885a-3b78-466c-ba21-6bfdc88f738c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:26.405730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-461a885a-3b78-466c-ba21-6bfdc88f738c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:26.536171 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-461a885a-3b78-466c-ba21-6bfdc88f738c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:26.544494 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-461a885a-3b78-466c-ba21-6bfdc88f738c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1393 microversion: 2.1 time: 0.153671 Sep 10 11:44:26.545092 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2279/6879] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:26 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:27.567670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-456377a9-eeed-49e6-abc1-96ef7547c918 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:27.568297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-456377a9-eeed-49e6-abc1-96ef7547c918 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:27.571316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:27.577966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-456377a9-eeed-49e6-abc1-96ef7547c918 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:27.578632 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-456377a9-eeed-49e6-abc1-96ef7547c918 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:27.579122 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-456377a9-eeed-49e6-abc1-96ef7547c918 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:27.579824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-456377a9-eeed-49e6-abc1-96ef7547c918 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:27.580295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-456377a9-eeed-49e6-abc1-96ef7547c918 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:27.580734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-456377a9-eeed-49e6-abc1-96ef7547c918 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:27.717226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-456377a9-eeed-49e6-abc1-96ef7547c918 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:27.725151 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-456377a9-eeed-49e6-abc1-96ef7547c918 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1393 microversion: 2.1 time: 0.161469 Sep 10 11:44:27.725744 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4601/6880] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:27 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:28.748255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-78897e07-fa4f-47ed-8415-746b37305e29 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:28.748871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-78897e07-fa4f-47ed-8415-746b37305e29 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:28.755708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78897e07-fa4f-47ed-8415-746b37305e29 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:28.756193 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78897e07-fa4f-47ed-8415-746b37305e29 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:28.756646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78897e07-fa4f-47ed-8415-746b37305e29 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:28.757353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78897e07-fa4f-47ed-8415-746b37305e29 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:28.757815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78897e07-fa4f-47ed-8415-746b37305e29 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:28.758247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-78897e07-fa4f-47ed-8415-746b37305e29 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:28.892625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-78897e07-fa4f-47ed-8415-746b37305e29 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:28.900408 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-78897e07-fa4f-47ed-8415-746b37305e29 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1393 microversion: 2.1 time: 0.156087 Sep 10 11:44:28.901005 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2280/6881] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:28 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:29.838412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c492fbca-520f-4eb4-a006-c0d229d73637 req-23265e9d-b4a6-4b56-a134-4fd272148a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236a3b4b-d40b-4630-bc91-c411af524f23", "name": "network-vif-plugged", "status": "completed", "tag": "85f4b6c5-6695-4f09-9d25-923db2271d76"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:29.854599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c492fbca-520f-4eb4-a006-c0d229d73637 req-23265e9d-b4a6-4b56-a134-4fd272148a4c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:29.855109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c492fbca-520f-4eb4-a006-c0d229d73637 req-23265e9d-b4a6-4b56-a134-4fd272148a4c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:29.855555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c492fbca-520f-4eb4-a006-c0d229d73637 req-23265e9d-b4a6-4b56-a134-4fd272148a4c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:29.874920 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c492fbca-520f-4eb4-a006-c0d229d73637 req-23265e9d-b4a6-4b56-a134-4fd272148a4c service nova] Creating event network-vif-plugged:85f4b6c5-6695-4f09-9d25-923db2271d76 for instance 236a3b4b-d40b-4630-bc91-c411af524f23 on n-h2-856894-1 Sep 10 11:44:29.880799 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c492fbca-520f-4eb4-a006-c0d229d73637 req-23265e9d-b4a6-4b56-a134-4fd272148a4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046085 Sep 10 11:44:29.881480 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4602/6882] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:29.922783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-17e7fbb9-f815-46bc-9a92-b625ed0775e6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:29.923485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-17e7fbb9-f815-46bc-9a92-b625ed0775e6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:29.931812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17e7fbb9-f815-46bc-9a92-b625ed0775e6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:29.932513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17e7fbb9-f815-46bc-9a92-b625ed0775e6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:29.932950 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17e7fbb9-f815-46bc-9a92-b625ed0775e6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:29.933727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17e7fbb9-f815-46bc-9a92-b625ed0775e6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:29.934124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17e7fbb9-f815-46bc-9a92-b625ed0775e6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:29.934548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17e7fbb9-f815-46bc-9a92-b625ed0775e6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:30.116605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-17e7fbb9-f815-46bc-9a92-b625ed0775e6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:30.124380 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-17e7fbb9-f815-46bc-9a92-b625ed0775e6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1393 microversion: 2.1 time: 0.205604 Sep 10 11:44:30.124955 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2281/6883] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:29 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1393 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:31.148591 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1e2cdad-c994-482f-b8d4-10076d44b8a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:31.149353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1e2cdad-c994-482f-b8d4-10076d44b8a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:31.158329 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1e2cdad-c994-482f-b8d4-10076d44b8a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:31.158829 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1e2cdad-c994-482f-b8d4-10076d44b8a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:31.159281 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1e2cdad-c994-482f-b8d4-10076d44b8a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:31.159992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1e2cdad-c994-482f-b8d4-10076d44b8a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:31.160459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1e2cdad-c994-482f-b8d4-10076d44b8a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:31.160894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1e2cdad-c994-482f-b8d4-10076d44b8a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:31.304069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1e2cdad-c994-482f-b8d4-10076d44b8a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:31.312753 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1e2cdad-c994-482f-b8d4-10076d44b8a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1393 microversion: 2.1 time: 0.169019 Sep 10 11:44:31.313367 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4603/6884] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:31 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:32.335930 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ec9ead51-4eb9-4c70-a162-e85a8677e4dc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:32.336570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ec9ead51-4eb9-4c70-a162-e85a8677e4dc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:32.339362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:32.340029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:32.346399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec9ead51-4eb9-4c70-a162-e85a8677e4dc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:32.346884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec9ead51-4eb9-4c70-a162-e85a8677e4dc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:32.347322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec9ead51-4eb9-4c70-a162-e85a8677e4dc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:32.348055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec9ead51-4eb9-4c70-a162-e85a8677e4dc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:32.348461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec9ead51-4eb9-4c70-a162-e85a8677e4dc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:32.348885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ec9ead51-4eb9-4c70-a162-e85a8677e4dc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:32.567079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ec9ead51-4eb9-4c70-a162-e85a8677e4dc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:32.575306 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ec9ead51-4eb9-4c70-a162-e85a8677e4dc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1565 microversion: 2.1 time: 0.243359 Sep 10 11:44:32.575878 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2282/6885] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:32 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1565 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:32.597187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0719a87b-70eb-4740-98aa-95c2c9e1760b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:32.597826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0719a87b-70eb-4740-98aa-95c2c9e1760b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:32.599922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:32.606129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719a87b-70eb-4740-98aa-95c2c9e1760b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:32.606639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719a87b-70eb-4740-98aa-95c2c9e1760b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:32.607097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719a87b-70eb-4740-98aa-95c2c9e1760b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:32.607830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719a87b-70eb-4740-98aa-95c2c9e1760b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:32.608304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719a87b-70eb-4740-98aa-95c2c9e1760b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:32.608749 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0719a87b-70eb-4740-98aa-95c2c9e1760b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:32.738701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0719a87b-70eb-4740-98aa-95c2c9e1760b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:32.747555 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0719a87b-70eb-4740-98aa-95c2c9e1760b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1565 microversion: 2.1 time: 0.154181 Sep 10 11:44:32.748498 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4604/6886] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:32 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:34.631826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-314dfc17-26c8-4402-a916-ac405041d5ad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:34.632424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-314dfc17-26c8-4402-a916-ac405041d5ad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:34.637126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-febaaac8-f77b-49d9-a328-838993bf0039 req-649130d3-fce7-4133-b2ad-c435545bd5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236a3b4b-d40b-4630-bc91-c411af524f23", "tag": "85f4b6c5-6695-4f09-9d25-923db2271d76"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:34.637613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:34.642547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-314dfc17-26c8-4402-a916-ac405041d5ad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:34.643043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-314dfc17-26c8-4402-a916-ac405041d5ad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:34.643706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-314dfc17-26c8-4402-a916-ac405041d5ad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:34.644417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-314dfc17-26c8-4402-a916-ac405041d5ad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:34.645050 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-314dfc17-26c8-4402-a916-ac405041d5ad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:34.645505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-314dfc17-26c8-4402-a916-ac405041d5ad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:34.647046 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:44:34.647209 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 11:44:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 10 11:44:34.651196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-febaaac8-f77b-49d9-a328-838993bf0039 req-649130d3-fce7-4133-b2ad-c435545bd5ef service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:34.651748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-febaaac8-f77b-49d9-a328-838993bf0039 req-649130d3-fce7-4133-b2ad-c435545bd5ef service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:34.652939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-febaaac8-f77b-49d9-a328-838993bf0039 req-649130d3-fce7-4133-b2ad-c435545bd5ef service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:34.675576 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-febaaac8-f77b-49d9-a328-838993bf0039 req-649130d3-fce7-4133-b2ad-c435545bd5ef service nova] Creating event network-changed:85f4b6c5-6695-4f09-9d25-923db2271d76 for instance 236a3b4b-d40b-4630-bc91-c411af524f23 on n-h2-856894-1 Sep 10 11:44:34.682148 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-febaaac8-f77b-49d9-a328-838993bf0039 req-649130d3-fce7-4133-b2ad-c435545bd5ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049703 Sep 10 11:44:34.683934 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4605/6887] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:44:34.890255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-314dfc17-26c8-4402-a916-ac405041d5ad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:34.899213 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-314dfc17-26c8-4402-a916-ac405041d5ad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1565 microversion: 2.1 time: 0.272027 Sep 10 11:44:34.900061 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2283/6888] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:34 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1565 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:58.148833 n-d-856894-1 devstack@n-api.service[128788]: ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: timed out (retrying in 1.0 seconds): socket.timeout: timed out Sep 10 11:44:58.149655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=9 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:58.150377 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=34 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:58.155243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7af07fc3-e51e-40dd-8567-b8c608dc3bd9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:58.157552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7af07fc3-e51e-40dd-8567-b8c608dc3bd9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:58.164409 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af07fc3-e51e-40dd-8567-b8c608dc3bd9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:58.164905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af07fc3-e51e-40dd-8567-b8c608dc3bd9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:58.165384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af07fc3-e51e-40dd-8567-b8c608dc3bd9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:58.166084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af07fc3-e51e-40dd-8567-b8c608dc3bd9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:58.166551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af07fc3-e51e-40dd-8567-b8c608dc3bd9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:58.166988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7af07fc3-e51e-40dd-8567-b8c608dc3bd9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:58.219166 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7af07fc3-e51e-40dd-8567-b8c608dc3bd9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23/action" status: 200 len: 24568 microversion: 2.1 time: 0.072316 Sep 10 11:44:58.220099 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4606/6889] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:44:58 2022] POST /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23/action => generated 24568 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:45:09.007961 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-17990179-f34f-49e7-9798-328c580d4a46 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:09.010273 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-17990179-f34f-49e7-9798-328c580d4a46 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:09.012547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:09.013214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=40 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:09.019343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17990179-f34f-49e7-9798-328c580d4a46 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:09.019824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17990179-f34f-49e7-9798-328c580d4a46 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:09.020257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17990179-f34f-49e7-9798-328c580d4a46 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:09.020942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17990179-f34f-49e7-9798-328c580d4a46 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:09.021432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17990179-f34f-49e7-9798-328c580d4a46 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:09.021854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-17990179-f34f-49e7-9798-328c580d4a46 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:09.092629 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-17990179-f34f-49e7-9798-328c580d4a46 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23/action" status: 202 len: 0 microversion: 2.1 time: 0.088823 Sep 10 11:45:09.093302 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2284/6890] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:45:09 2022] POST /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:45:09.102305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e7884b8a-4d9a-4e18-bf7d-c77329890964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:09.103025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e7884b8a-4d9a-4e18-bf7d-c77329890964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:09.105765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:09.107097 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:09.116787 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7884b8a-4d9a-4e18-bf7d-c77329890964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:09.117318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7884b8a-4d9a-4e18-bf7d-c77329890964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:09.117774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7884b8a-4d9a-4e18-bf7d-c77329890964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:09.118488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7884b8a-4d9a-4e18-bf7d-c77329890964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:09.118960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7884b8a-4d9a-4e18-bf7d-c77329890964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:09.119402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e7884b8a-4d9a-4e18-bf7d-c77329890964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:09.352067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e7884b8a-4d9a-4e18-bf7d-c77329890964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:09.360493 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e7884b8a-4d9a-4e18-bf7d-c77329890964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1675 microversion: 2.1 time: 0.262558 Sep 10 11:45:09.361309 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4607/6891] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:09 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1675 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:10.385007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8fd20c67-cf41-46b7-97e0-ed675ddb150b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:10.385730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8fd20c67-cf41-46b7-97e0-ed675ddb150b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:10.391940 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8fd20c67-cf41-46b7-97e0-ed675ddb150b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:10.392418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8fd20c67-cf41-46b7-97e0-ed675ddb150b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:10.392855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8fd20c67-cf41-46b7-97e0-ed675ddb150b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:10.393564 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8fd20c67-cf41-46b7-97e0-ed675ddb150b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:10.394016 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8fd20c67-cf41-46b7-97e0-ed675ddb150b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:10.394439 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8fd20c67-cf41-46b7-97e0-ed675ddb150b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:10.524347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8fd20c67-cf41-46b7-97e0-ed675ddb150b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:10.532844 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8fd20c67-cf41-46b7-97e0-ed675ddb150b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1680 microversion: 2.1 time: 0.153049 Sep 10 11:45:10.533460 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2285/6892] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:10 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:11.558068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-44766340-4dae-4b6b-8b1a-8135c0f38b44 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:11.558704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-44766340-4dae-4b6b-8b1a-8135c0f38b44 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:11.566135 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44766340-4dae-4b6b-8b1a-8135c0f38b44 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:11.566642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44766340-4dae-4b6b-8b1a-8135c0f38b44 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:11.567096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44766340-4dae-4b6b-8b1a-8135c0f38b44 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:11.567802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44766340-4dae-4b6b-8b1a-8135c0f38b44 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:11.568277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44766340-4dae-4b6b-8b1a-8135c0f38b44 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:11.568723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-44766340-4dae-4b6b-8b1a-8135c0f38b44 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:11.701725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-44766340-4dae-4b6b-8b1a-8135c0f38b44 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:11.709541 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-44766340-4dae-4b6b-8b1a-8135c0f38b44 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1680 microversion: 2.1 time: 0.155666 Sep 10 11:45:11.710124 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4608/6893] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:11 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:12.731955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-04a15bd0-9746-4a8b-bbb7-db107a711195 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:12.732576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-04a15bd0-9746-4a8b-bbb7-db107a711195 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:12.739501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a15bd0-9746-4a8b-bbb7-db107a711195 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:12.739964 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a15bd0-9746-4a8b-bbb7-db107a711195 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:12.740401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a15bd0-9746-4a8b-bbb7-db107a711195 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:12.741094 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a15bd0-9746-4a8b-bbb7-db107a711195 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:12.741561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a15bd0-9746-4a8b-bbb7-db107a711195 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:12.741980 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-04a15bd0-9746-4a8b-bbb7-db107a711195 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:12.873755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-04a15bd0-9746-4a8b-bbb7-db107a711195 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:12.886721 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-04a15bd0-9746-4a8b-bbb7-db107a711195 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1680 microversion: 2.1 time: 0.158152 Sep 10 11:45:12.886932 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2286/6894] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:12 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:13.910178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-01ed7047-a489-4e36-8538-f1d4a73c0ab3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:13.910806 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-01ed7047-a489-4e36-8538-f1d4a73c0ab3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:13.917719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed7047-a489-4e36-8538-f1d4a73c0ab3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:13.918246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed7047-a489-4e36-8538-f1d4a73c0ab3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:13.918697 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed7047-a489-4e36-8538-f1d4a73c0ab3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:13.919394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed7047-a489-4e36-8538-f1d4a73c0ab3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:13.919860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed7047-a489-4e36-8538-f1d4a73c0ab3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:13.920299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-01ed7047-a489-4e36-8538-f1d4a73c0ab3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:14.055241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-01ed7047-a489-4e36-8538-f1d4a73c0ab3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:14.063636 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-01ed7047-a489-4e36-8538-f1d4a73c0ab3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1680 microversion: 2.1 time: 0.157356 Sep 10 11:45:14.064230 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4609/6895] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:13 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:15.086414 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d1aeb24a-8113-4b6d-886c-fca490292549 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:15.087027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d1aeb24a-8113-4b6d-886c-fca490292549 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:15.094604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1aeb24a-8113-4b6d-886c-fca490292549 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:15.095085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1aeb24a-8113-4b6d-886c-fca490292549 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:15.095523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1aeb24a-8113-4b6d-886c-fca490292549 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:15.096210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1aeb24a-8113-4b6d-886c-fca490292549 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:15.096667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1aeb24a-8113-4b6d-886c-fca490292549 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:15.097114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d1aeb24a-8113-4b6d-886c-fca490292549 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:15.226013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d1aeb24a-8113-4b6d-886c-fca490292549 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:15.233711 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d1aeb24a-8113-4b6d-886c-fca490292549 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1680 microversion: 2.1 time: 0.151248 Sep 10 11:45:15.234282 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2287/6896] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:15 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:16.257030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-848bbe6f-488e-4e31-ba97-237e9ee6a98b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:16.257680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-848bbe6f-488e-4e31-ba97-237e9ee6a98b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:16.265150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848bbe6f-488e-4e31-ba97-237e9ee6a98b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:16.265644 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848bbe6f-488e-4e31-ba97-237e9ee6a98b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:16.266116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848bbe6f-488e-4e31-ba97-237e9ee6a98b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:16.266802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848bbe6f-488e-4e31-ba97-237e9ee6a98b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:16.267273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848bbe6f-488e-4e31-ba97-237e9ee6a98b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:16.267714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-848bbe6f-488e-4e31-ba97-237e9ee6a98b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:16.398664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-848bbe6f-488e-4e31-ba97-237e9ee6a98b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:16.406933 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-848bbe6f-488e-4e31-ba97-237e9ee6a98b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1680 microversion: 2.1 time: 0.153803 Sep 10 11:45:16.407513 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4610/6897] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:16 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:17.430320 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1ea12577-b43f-4240-a695-33cf877a9f94 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:17.430860 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1ea12577-b43f-4240-a695-33cf877a9f94 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:17.437756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea12577-b43f-4240-a695-33cf877a9f94 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:17.438247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea12577-b43f-4240-a695-33cf877a9f94 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:17.438685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea12577-b43f-4240-a695-33cf877a9f94 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:17.439375 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea12577-b43f-4240-a695-33cf877a9f94 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:17.439829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea12577-b43f-4240-a695-33cf877a9f94 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:17.440254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1ea12577-b43f-4240-a695-33cf877a9f94 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:17.570863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1ea12577-b43f-4240-a695-33cf877a9f94 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:17.578682 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1ea12577-b43f-4240-a695-33cf877a9f94 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1680 microversion: 2.1 time: 0.152629 Sep 10 11:45:17.579254 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2288/6898] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:17 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:18.602273 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-25296fac-2cd5-47b6-9753-358c983f256d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:18.602897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-25296fac-2cd5-47b6-9753-358c983f256d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:18.610322 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25296fac-2cd5-47b6-9753-358c983f256d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:18.610820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25296fac-2cd5-47b6-9753-358c983f256d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:18.611272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25296fac-2cd5-47b6-9753-358c983f256d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:18.611975 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25296fac-2cd5-47b6-9753-358c983f256d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:18.612445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25296fac-2cd5-47b6-9753-358c983f256d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:18.612883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-25296fac-2cd5-47b6-9753-358c983f256d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:18.744187 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-25296fac-2cd5-47b6-9753-358c983f256d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:18.752600 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-25296fac-2cd5-47b6-9753-358c983f256d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1680 microversion: 2.1 time: 0.154221 Sep 10 11:45:18.753209 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4611/6899] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:18 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:19.775957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3533e2cf-57ec-468a-9da8-3b50f44d3ec6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:19.776576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3533e2cf-57ec-468a-9da8-3b50f44d3ec6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:19.783605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3533e2cf-57ec-468a-9da8-3b50f44d3ec6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:19.784090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3533e2cf-57ec-468a-9da8-3b50f44d3ec6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:19.784531 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3533e2cf-57ec-468a-9da8-3b50f44d3ec6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:19.785243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3533e2cf-57ec-468a-9da8-3b50f44d3ec6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:19.785703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3533e2cf-57ec-468a-9da8-3b50f44d3ec6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:19.786130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3533e2cf-57ec-468a-9da8-3b50f44d3ec6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:19.919477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3533e2cf-57ec-468a-9da8-3b50f44d3ec6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:19.927284 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3533e2cf-57ec-468a-9da8-3b50f44d3ec6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1680 microversion: 2.1 time: 0.155298 Sep 10 11:45:19.927858 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2289/6900] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:19 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:20.951545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-22a2c655-30a5-4d78-a32b-7259c2e46b26 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:20.952096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-22a2c655-30a5-4d78-a32b-7259c2e46b26 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:20.959051 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22a2c655-30a5-4d78-a32b-7259c2e46b26 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:20.959549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22a2c655-30a5-4d78-a32b-7259c2e46b26 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:20.960035 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22a2c655-30a5-4d78-a32b-7259c2e46b26 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:20.960732 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22a2c655-30a5-4d78-a32b-7259c2e46b26 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:20.961231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22a2c655-30a5-4d78-a32b-7259c2e46b26 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:20.961690 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-22a2c655-30a5-4d78-a32b-7259c2e46b26 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:21.095137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-22a2c655-30a5-4d78-a32b-7259c2e46b26 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:21.102950 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-22a2c655-30a5-4d78-a32b-7259c2e46b26 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1683 microversion: 2.1 time: 0.155479 Sep 10 11:45:21.103524 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4612/6901] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:20 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:47.302225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1abaa3bc-44a0-473c-bd19-cd053865df3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:47.304485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1abaa3bc-44a0-473c-bd19-cd053865df3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:47.307230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=12 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:47.307898 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:47.313907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1abaa3bc-44a0-473c-bd19-cd053865df3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:47.314379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1abaa3bc-44a0-473c-bd19-cd053865df3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:47.314817 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1abaa3bc-44a0-473c-bd19-cd053865df3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:47.315510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1abaa3bc-44a0-473c-bd19-cd053865df3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:47.315963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1abaa3bc-44a0-473c-bd19-cd053865df3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:47.316389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1abaa3bc-44a0-473c-bd19-cd053865df3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:47.374115 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1abaa3bc-44a0-473c-bd19-cd053865df3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23/action" status: 200 len: 68952 microversion: 2.1 time: 0.075779 Sep 10 11:45:47.374801 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2290/6902] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:45:47 2022] POST /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23/action => generated 68952 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:45:54.394255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b89f5baf-f63a-4f8f-8eb5-fb052da6f7f8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:54.394820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b89f5baf-f63a-4f8f-8eb5-fb052da6f7f8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:54.401167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:54.402556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=36 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:54.410523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b89f5baf-f63a-4f8f-8eb5-fb052da6f7f8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.411407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b89f5baf-f63a-4f8f-8eb5-fb052da6f7f8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.412120 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b89f5baf-f63a-4f8f-8eb5-fb052da6f7f8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.413356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b89f5baf-f63a-4f8f-8eb5-fb052da6f7f8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.414105 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b89f5baf-f63a-4f8f-8eb5-fb052da6f7f8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.414799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b89f5baf-f63a-4f8f-8eb5-fb052da6f7f8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.453861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b89f5baf-f63a-4f8f-8eb5-fb052da6f7f8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Going to try to terminate instance {{(pid=128788) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:45:54.458942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-d6a5d51e-0355-4043-a116-89a5a1d66265 req-bf3f11b5-b29d-4321-81cc-f740f43865ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236a3b4b-d40b-4630-bc91-c411af524f23", "tag": "85f4b6c5-6695-4f09-9d25-923db2271d76"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:54.470397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d6a5d51e-0355-4043-a116-89a5a1d66265 req-bf3f11b5-b29d-4321-81cc-f740f43865ff service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.470627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d6a5d51e-0355-4043-a116-89a5a1d66265 req-bf3f11b5-b29d-4321-81cc-f740f43865ff service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.471048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d6a5d51e-0355-4043-a116-89a5a1d66265 req-bf3f11b5-b29d-4321-81cc-f740f43865ff service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.482804 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-d6a5d51e-0355-4043-a116-89a5a1d66265 req-bf3f11b5-b29d-4321-81cc-f740f43865ff service nova] Creating event network-changed:85f4b6c5-6695-4f09-9d25-923db2271d76 for instance 236a3b4b-d40b-4630-bc91-c411af524f23 on n-h2-856894-1 Sep 10 11:45:54.487946 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-d6a5d51e-0355-4043-a116-89a5a1d66265 req-bf3f11b5-b29d-4321-81cc-f740f43865ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097975 Sep 10 11:45:54.488937 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2291/6903] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:45:54.542059 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b89f5baf-f63a-4f8f-8eb5-fb052da6f7f8 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 204 len: 0 microversion: 2.1 time: 0.154390 Sep 10 11:45:54.543071 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4613/6904] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:45:54 2022] DELETE /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:45:54.552673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-726930e0-f1e8-4e10-aaaf-2abd72adfd04 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:54.553422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-726930e0-f1e8-4e10-aaaf-2abd72adfd04 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:54.561974 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-726930e0-f1e8-4e10-aaaf-2abd72adfd04 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.562594 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-726930e0-f1e8-4e10-aaaf-2abd72adfd04 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.563044 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-726930e0-f1e8-4e10-aaaf-2abd72adfd04 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.563755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-726930e0-f1e8-4e10-aaaf-2abd72adfd04 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.564223 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-726930e0-f1e8-4e10-aaaf-2abd72adfd04 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.565363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-726930e0-f1e8-4e10-aaaf-2abd72adfd04 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.701804 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-726930e0-f1e8-4e10-aaaf-2abd72adfd04 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:54.709943 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-726930e0-f1e8-4e10-aaaf-2abd72adfd04 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1689 microversion: 2.1 time: 0.161861 Sep 10 11:45:54.710528 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2292/6905] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:54 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:55.734384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c765f47-16f0-4093-9462-9095422e0f50 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:55.735138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c765f47-16f0-4093-9462-9095422e0f50 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:55.742055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c765f47-16f0-4093-9462-9095422e0f50 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:55.742554 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c765f47-16f0-4093-9462-9095422e0f50 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:55.743005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c765f47-16f0-4093-9462-9095422e0f50 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:55.743705 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c765f47-16f0-4093-9462-9095422e0f50 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:55.744171 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c765f47-16f0-4093-9462-9095422e0f50 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:55.744609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c765f47-16f0-4093-9462-9095422e0f50 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:55.877407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c765f47-16f0-4093-9462-9095422e0f50 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:55.885292 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c765f47-16f0-4093-9462-9095422e0f50 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1689 microversion: 2.1 time: 0.155323 Sep 10 11:45:55.885853 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4614/6906] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:55 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:56.694437 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-b40bb5a6-1ba7-432b-bd70-c6eb37841373 req-594fae4d-a921-4d14-9e45-b7da5e47d141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236a3b4b-d40b-4630-bc91-c411af524f23", "name": "network-vif-deleted", "tag": "85f4b6c5-6695-4f09-9d25-923db2271d76"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:56.706313 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b40bb5a6-1ba7-432b-bd70-c6eb37841373 req-594fae4d-a921-4d14-9e45-b7da5e47d141 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:56.706815 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b40bb5a6-1ba7-432b-bd70-c6eb37841373 req-594fae4d-a921-4d14-9e45-b7da5e47d141 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:56.707235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-b40bb5a6-1ba7-432b-bd70-c6eb37841373 req-594fae4d-a921-4d14-9e45-b7da5e47d141 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:56.722322 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-b40bb5a6-1ba7-432b-bd70-c6eb37841373 req-594fae4d-a921-4d14-9e45-b7da5e47d141 service nova] Creating event network-vif-deleted:85f4b6c5-6695-4f09-9d25-923db2271d76 for instance 236a3b4b-d40b-4630-bc91-c411af524f23 on n-h2-856894-1 Sep 10 11:45:56.727214 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-b40bb5a6-1ba7-432b-bd70-c6eb37841373 req-594fae4d-a921-4d14-9e45-b7da5e47d141 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036669 Sep 10 11:45:56.728031 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2293/6907] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:56.908904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:56.909504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:56.916364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:56.916884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:56.917394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:56.918114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:56.918596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:56.919063 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:56.953232 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:56.953742 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:56.954205 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:56.954677 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lazy-loading 'fault' on Instance uuid 236a3b4b-d40b-4630-bc91-c411af524f23 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:45:57.000152 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:57.008610 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8526d577-45fa-4281-8633-74853e093464 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 200 len: 1357 microversion: 2.1 time: 0.103719 Sep 10 11:45:57.009235 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4615/6908] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:56 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:58.033844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:58.034549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 236a3b4b-d40b-4630-bc91-c411af524f23] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:58.040672 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:58.041180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:58.041619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:58.042301 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:58.042753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:58.043174 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:58.057187 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] HTTP exception thrown: Instance 236a3b4b-d40b-4630-bc91-c411af524f23 could not be found. Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Request method failure captured: Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 HTTP/1.1 Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHhRyltnowTOB2igHay_0zljRnORjtCrqWTIMoFWA849Bp0w1HZKNF3ywind08ohEU6rRGOqTJ5W4r6nubhdqDgB4vAjNmUKmMdSQK12yO6639vPMn2vRvSSntI0B-Oxm3ks9hZX6oTyyXyRHnzbHZoORrizqS1OtvpDVt0FLCF7W0A Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 9972c52da6144ebcaa81a0fde66ca255 Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9972c52da6144ebcaa81a0fde66ca255", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 9972c52da6144ebcaa81a0fde66ca255 Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestNetworkAdvancedServerOps-344189195-project Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e085bc75f0c54299a24a5252d0a26dc0 Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestNetworkAdvancedServerOps-344189195-project Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 236a3b4b-d40b-4630-bc91-c411af524f23 could not be found. Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '236a3b4b-d40b-4630-bc91-c411af524f23'} Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 236a3b4b-d40b-4630-bc91-c411af524f23 could not be found. Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 236a3b4b-d40b-4630-bc91-c411af524f23 could not be found. Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:45:58.058779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 236a3b4b-d40b-4630-bc91-c411af524f23 could not be found. Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Returning 404 to user: Instance 236a3b4b-d40b-4630-bc91-c411af524f23 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-96daea1b-262d-443a-9088-c5a3184e0c9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23" status: 404 len: 111 microversion: 2.1 time: 0.032317 Sep 10 11:45:58.063607 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2294/6909] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:58 2022] GET /compute/v2.1/servers/236a3b4b-d40b-4630-bc91-c411af524f23 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:46:01.324286 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8ffdd02a-48e7-48d2-a4cd-88831290c976 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '.version_select at 0x7efcae300700>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:01.345571 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8ffdd02a-48e7-48d2-a4cd-88831290c976 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1834619649" status: 202 len: 0 microversion: 2.1 time: 0.025126 Sep 10 11:46:01.346190 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4616/6910] 10.222.0.20 () {58 vars in 1284 bytes} [Sat Sep 10 11:46:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1834619649 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:46:01.366725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c75902d2-13be-4812-9f94-7e3f7e9d4798 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'create', calling method: .version_select at 0x7efcaebc5790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-651969165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOu1CDKUFaWHsBp1rLturW8wrFNXepht1KkA5lTxIj8mkiteJA25KkU29fvoU26Rw+3eGksHeT7ODRkB/4ZxQAmfKvnJ6gr9UkNRGYm81y6vd6MEdTCBB9o+hCp7nU66mA=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:01.383407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-c75902d2-13be-4812-9f94-7e3f7e9d4798 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:46:01.389849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-c75902d2-13be-4812-9f94-7e3f7e9d4798 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for user e085bc75f0c54299a24a5252d0a26dc0 and project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:46:01.413178 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c75902d2-13be-4812-9f94-7e3f7e9d4798 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050374 Sep 10 11:46:01.413775 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2295/6911] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:46:01 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:06.847191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1111198283", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "2fd39ddf-754f-4dd3-a052-970b310338b7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-651969165", "security_groups": [{"name": "tempest-secgroup-smoke-42695829"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:06.973746 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] validate_networks() for [('2fd39ddf-754f-4dd3-a052-970b310338b7', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:46:07.005277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:07.408453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:46:07.409011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:46:07.409533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:46:07.409964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:46:07.410391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:46:07.419480 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:07.420535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:07.420986 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:07.421765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:07.422233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:07.422672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:07.443070 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:46:07.450203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for user e085bc75f0c54299a24a5252d0a26dc0 and project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:46:07.465361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:46:07.470392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:46:07.529869 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6c28b43a-df86-46ab-a379-b661337a744d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.687603 Sep 10 11:46:07.530449 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4617/6912] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:46:06 2022] POST /compute/v2.1/servers => generated 404 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:46:07.542886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2584fa11-388a-4ad5-9529-fd34b5281be3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:07.543515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2584fa11-388a-4ad5-9529-fd34b5281be3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:07.604199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2584fa11-388a-4ad5-9529-fd34b5281be3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:07.612072 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2584fa11-388a-4ad5-9529-fd34b5281be3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1266 microversion: 2.1 time: 0.074051 Sep 10 11:46:07.613227 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2296/6913] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:07 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:08.638221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37bfc51a-d22d-408f-8264-b892ea9fee38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:08.640118 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-37bfc51a-d22d-408f-8264-b892ea9fee38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:08.648456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37bfc51a-d22d-408f-8264-b892ea9fee38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:08.649280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37bfc51a-d22d-408f-8264-b892ea9fee38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:08.650866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37bfc51a-d22d-408f-8264-b892ea9fee38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:08.651966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37bfc51a-d22d-408f-8264-b892ea9fee38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:08.652660 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37bfc51a-d22d-408f-8264-b892ea9fee38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:08.653159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37bfc51a-d22d-408f-8264-b892ea9fee38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:08.740049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-37bfc51a-d22d-408f-8264-b892ea9fee38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:08.753282 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-37bfc51a-d22d-408f-8264-b892ea9fee38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1336 microversion: 2.1 time: 0.120367 Sep 10 11:46:08.754054 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4618/6914] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:08 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1336 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:09.776500 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e7737855-dd8a-4840-9453-48a865ca8030 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:09.777260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e7737855-dd8a-4840-9453-48a865ca8030 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:09.785309 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=16 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:09.788219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7737855-dd8a-4840-9453-48a865ca8030 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:09.788744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7737855-dd8a-4840-9453-48a865ca8030 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:09.789975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7737855-dd8a-4840-9453-48a865ca8030 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:09.790734 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7737855-dd8a-4840-9453-48a865ca8030 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:09.791188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7737855-dd8a-4840-9453-48a865ca8030 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:09.791786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e7737855-dd8a-4840-9453-48a865ca8030 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:10.022501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e7737855-dd8a-4840-9453-48a865ca8030 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:10.031646 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e7737855-dd8a-4840-9453-48a865ca8030 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1390 microversion: 2.1 time: 0.259407 Sep 10 11:46:10.032234 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2297/6915] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:09 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1390 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:10.194455 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9e3c5c62-0e22-4695-bebb-2ca3e1cc000d req-7700160c-9bfe-4d09-ada4-52a4ce1a27e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f939bbe-f87f-49c5-a0be-e9f3778885f7", "tag": "d7844c38-c9c4-43f8-aab0-4183763ca95b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:10.212538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9e3c5c62-0e22-4695-bebb-2ca3e1cc000d req-7700160c-9bfe-4d09-ada4-52a4ce1a27e0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:10.213391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9e3c5c62-0e22-4695-bebb-2ca3e1cc000d req-7700160c-9bfe-4d09-ada4-52a4ce1a27e0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:10.214115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9e3c5c62-0e22-4695-bebb-2ca3e1cc000d req-7700160c-9bfe-4d09-ada4-52a4ce1a27e0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:10.227002 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9e3c5c62-0e22-4695-bebb-2ca3e1cc000d req-7700160c-9bfe-4d09-ada4-52a4ce1a27e0 service nova] Creating event network-changed:d7844c38-c9c4-43f8-aab0-4183763ca95b for instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 on n-h1-856894-1 Sep 10 11:46:10.232729 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9e3c5c62-0e22-4695-bebb-2ca3e1cc000d req-7700160c-9bfe-4d09-ada4-52a4ce1a27e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042504 Sep 10 11:46:10.233656 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4619/6916] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:11.055643 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dcdadab3-873b-467b-9392-78cd802e7c3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:11.056269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dcdadab3-873b-467b-9392-78cd802e7c3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:11.063721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcdadab3-873b-467b-9392-78cd802e7c3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:11.064209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcdadab3-873b-467b-9392-78cd802e7c3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:11.064648 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcdadab3-873b-467b-9392-78cd802e7c3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:11.065372 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcdadab3-873b-467b-9392-78cd802e7c3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:11.065828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcdadab3-873b-467b-9392-78cd802e7c3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:11.066253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dcdadab3-873b-467b-9392-78cd802e7c3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:11.205812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dcdadab3-873b-467b-9392-78cd802e7c3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:11.213673 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dcdadab3-873b-467b-9392-78cd802e7c3b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1390 microversion: 2.1 time: 0.162181 Sep 10 11:46:11.214288 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2298/6917] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:11 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:12.237368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7bf7a72d-93c4-48d3-95dd-e35d7624188d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:12.238084 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7bf7a72d-93c4-48d3-95dd-e35d7624188d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:12.244360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bf7a72d-93c4-48d3-95dd-e35d7624188d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:12.244862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bf7a72d-93c4-48d3-95dd-e35d7624188d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:12.245356 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bf7a72d-93c4-48d3-95dd-e35d7624188d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:12.246095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bf7a72d-93c4-48d3-95dd-e35d7624188d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:12.246571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bf7a72d-93c4-48d3-95dd-e35d7624188d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:12.247019 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bf7a72d-93c4-48d3-95dd-e35d7624188d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:12.377392 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7bf7a72d-93c4-48d3-95dd-e35d7624188d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:12.385245 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7bf7a72d-93c4-48d3-95dd-e35d7624188d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1390 microversion: 2.1 time: 0.153175 Sep 10 11:46:12.385828 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4620/6918] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:12 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:13.409244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ff11faae-9c78-460a-87e9-fcf7d8523263 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:13.409766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ff11faae-9c78-460a-87e9-fcf7d8523263 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:13.416560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff11faae-9c78-460a-87e9-fcf7d8523263 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:13.417048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff11faae-9c78-460a-87e9-fcf7d8523263 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:13.417516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff11faae-9c78-460a-87e9-fcf7d8523263 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:13.418205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff11faae-9c78-460a-87e9-fcf7d8523263 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:13.418663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff11faae-9c78-460a-87e9-fcf7d8523263 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:13.419090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ff11faae-9c78-460a-87e9-fcf7d8523263 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:13.546254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ff11faae-9c78-460a-87e9-fcf7d8523263 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:13.553885 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ff11faae-9c78-460a-87e9-fcf7d8523263 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1390 microversion: 2.1 time: 0.148697 Sep 10 11:46:13.554452 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2299/6919] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:13 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:14.578050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-453707d4-b655-4db2-b7fa-03a987671e24 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:14.578683 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-453707d4-b655-4db2-b7fa-03a987671e24 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:14.585729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-453707d4-b655-4db2-b7fa-03a987671e24 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:14.586267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-453707d4-b655-4db2-b7fa-03a987671e24 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:14.586730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-453707d4-b655-4db2-b7fa-03a987671e24 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:14.587503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-453707d4-b655-4db2-b7fa-03a987671e24 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:14.587979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-453707d4-b655-4db2-b7fa-03a987671e24 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:14.588420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-453707d4-b655-4db2-b7fa-03a987671e24 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:14.733238 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-453707d4-b655-4db2-b7fa-03a987671e24 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:14.741039 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-453707d4-b655-4db2-b7fa-03a987671e24 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1390 microversion: 2.1 time: 0.167636 Sep 10 11:46:14.741648 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4621/6920] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:14 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:15.764078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9731733d-59e3-4658-89fa-2cfcc1437bc7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:15.764699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9731733d-59e3-4658-89fa-2cfcc1437bc7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:15.771994 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9731733d-59e3-4658-89fa-2cfcc1437bc7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:15.772477 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9731733d-59e3-4658-89fa-2cfcc1437bc7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:15.772922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9731733d-59e3-4658-89fa-2cfcc1437bc7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:15.773651 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9731733d-59e3-4658-89fa-2cfcc1437bc7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:15.774112 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9731733d-59e3-4658-89fa-2cfcc1437bc7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:15.774543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9731733d-59e3-4658-89fa-2cfcc1437bc7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:15.905452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9731733d-59e3-4658-89fa-2cfcc1437bc7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:15.913188 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9731733d-59e3-4658-89fa-2cfcc1437bc7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1390 microversion: 2.1 time: 0.152987 Sep 10 11:46:15.913758 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2300/6921] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:15 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:16.586738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5bfce383-61dc-4670-ae59-4aa45b24fc1a req-aa1fa9e8-2ce5-445e-867c-7c741c0e5249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f939bbe-f87f-49c5-a0be-e9f3778885f7", "name": "network-vif-plugged", "status": "completed", "tag": "d7844c38-c9c4-43f8-aab0-4183763ca95b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:16.600560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5bfce383-61dc-4670-ae59-4aa45b24fc1a req-aa1fa9e8-2ce5-445e-867c-7c741c0e5249 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:16.601121 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5bfce383-61dc-4670-ae59-4aa45b24fc1a req-aa1fa9e8-2ce5-445e-867c-7c741c0e5249 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:16.601662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5bfce383-61dc-4670-ae59-4aa45b24fc1a req-aa1fa9e8-2ce5-445e-867c-7c741c0e5249 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:16.613378 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-5bfce383-61dc-4670-ae59-4aa45b24fc1a req-aa1fa9e8-2ce5-445e-867c-7c741c0e5249 service nova] Creating event network-vif-plugged:d7844c38-c9c4-43f8-aab0-4183763ca95b for instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 on n-h1-856894-1 Sep 10 11:46:16.618341 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5bfce383-61dc-4670-ae59-4aa45b24fc1a req-aa1fa9e8-2ce5-445e-867c-7c741c0e5249 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035622 Sep 10 11:46:16.619470 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4622/6922] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:16.935800 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fc667b89-935f-4cb8-b649-592503bfdb8d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:16.936416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fc667b89-935f-4cb8-b649-592503bfdb8d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:16.943319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc667b89-935f-4cb8-b649-592503bfdb8d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:16.943742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc667b89-935f-4cb8-b649-592503bfdb8d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:16.944183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc667b89-935f-4cb8-b649-592503bfdb8d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:16.944870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc667b89-935f-4cb8-b649-592503bfdb8d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:16.945355 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc667b89-935f-4cb8-b649-592503bfdb8d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:16.945785 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fc667b89-935f-4cb8-b649-592503bfdb8d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:17.076457 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fc667b89-935f-4cb8-b649-592503bfdb8d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:17.084101 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fc667b89-935f-4cb8-b649-592503bfdb8d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1390 microversion: 2.1 time: 0.152764 Sep 10 11:46:17.084692 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2301/6923] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:16 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:18.105091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:18.105894 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:18.111973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-afa8d666-7217-44a8-b495-ea1893c11050 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:18.112686 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-afa8d666-7217-44a8-b495-ea1893c11050 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:18.119846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afa8d666-7217-44a8-b495-ea1893c11050 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:18.120341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afa8d666-7217-44a8-b495-ea1893c11050 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:18.120791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afa8d666-7217-44a8-b495-ea1893c11050 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:18.121519 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afa8d666-7217-44a8-b495-ea1893c11050 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:18.121982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afa8d666-7217-44a8-b495-ea1893c11050 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:18.122462 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-afa8d666-7217-44a8-b495-ea1893c11050 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:18.258572 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-afa8d666-7217-44a8-b495-ea1893c11050 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:18.267326 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-afa8d666-7217-44a8-b495-ea1893c11050 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1562 microversion: 2.1 time: 0.163187 Sep 10 11:46:18.267926 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4623/6924] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:18 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:18.289791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-724205ac-32b8-48c8-96ec-7f0dae03e401 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:18.290404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-724205ac-32b8-48c8-96ec-7f0dae03e401 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:18.292230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:18.293935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:18.299999 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-724205ac-32b8-48c8-96ec-7f0dae03e401 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:18.300481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-724205ac-32b8-48c8-96ec-7f0dae03e401 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:18.300923 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-724205ac-32b8-48c8-96ec-7f0dae03e401 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:18.301637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-724205ac-32b8-48c8-96ec-7f0dae03e401 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:18.302086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-724205ac-32b8-48c8-96ec-7f0dae03e401 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:18.302507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-724205ac-32b8-48c8-96ec-7f0dae03e401 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:18.433792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-724205ac-32b8-48c8-96ec-7f0dae03e401 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:18.441564 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-724205ac-32b8-48c8-96ec-7f0dae03e401 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1562 microversion: 2.1 time: 0.155614 Sep 10 11:46:18.442142 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2302/6925] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:18 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:20.327311 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-85815796-df4b-4af1-9122-abd93a56e14a req-81f342ef-f7af-4013-859f-c295ceff0cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f939bbe-f87f-49c5-a0be-e9f3778885f7", "tag": "d7844c38-c9c4-43f8-aab0-4183763ca95b"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:20.329551 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5d17b786-e3aa-4ad3-bab5-26e530c879eb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:20.330196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5d17b786-e3aa-4ad3-bab5-26e530c879eb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:20.337461 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-85815796-df4b-4af1-9122-abd93a56e14a req-81f342ef-f7af-4013-859f-c295ceff0cf7 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:20.337685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d17b786-e3aa-4ad3-bab5-26e530c879eb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:20.338084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-85815796-df4b-4af1-9122-abd93a56e14a req-81f342ef-f7af-4013-859f-c295ceff0cf7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:20.338213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d17b786-e3aa-4ad3-bab5-26e530c879eb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:20.338612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d17b786-e3aa-4ad3-bab5-26e530c879eb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:20.338721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-85815796-df4b-4af1-9122-abd93a56e14a req-81f342ef-f7af-4013-859f-c295ceff0cf7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:20.339338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d17b786-e3aa-4ad3-bab5-26e530c879eb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:20.339825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d17b786-e3aa-4ad3-bab5-26e530c879eb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:20.340276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5d17b786-e3aa-4ad3-bab5-26e530c879eb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:20.351976 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-85815796-df4b-4af1-9122-abd93a56e14a req-81f342ef-f7af-4013-859f-c295ceff0cf7 service nova] Creating event network-changed:d7844c38-c9c4-43f8-aab0-4183763ca95b for instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 on n-h1-856894-1 Sep 10 11:46:20.358212 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-85815796-df4b-4af1-9122-abd93a56e14a req-81f342ef-f7af-4013-859f-c295ceff0cf7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033764 Sep 10 11:46:20.359087 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2303/6926] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:20.560487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5d17b786-e3aa-4ad3-bab5-26e530c879eb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:20.569182 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5d17b786-e3aa-4ad3-bab5-26e530c879eb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1562 microversion: 2.1 time: 0.249280 Sep 10 11:46:20.569786 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4624/6927] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:20 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1562 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:42.122847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f040c181-88ee-4614-9a60-305f495e43fb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:42.125205 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f040c181-88ee-4614-9a60-305f495e43fb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:42.127637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:42.128276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=38 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:42.134692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f040c181-88ee-4614-9a60-305f495e43fb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:42.135175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f040c181-88ee-4614-9a60-305f495e43fb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:42.135606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f040c181-88ee-4614-9a60-305f495e43fb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.136292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f040c181-88ee-4614-9a60-305f495e43fb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:42.136743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f040c181-88ee-4614-9a60-305f495e43fb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:42.137194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f040c181-88ee-4614-9a60-305f495e43fb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.188979 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f040c181-88ee-4614-9a60-305f495e43fb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7/action" status: 200 len: 24566 microversion: 2.1 time: 0.070692 Sep 10 11:46:42.189665 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2304/6928] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:46:42 2022] POST /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7/action => generated 24566 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:46:53.144406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:53.146801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:53.149175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:53.149863 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=36 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:53.156833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.157368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.157830 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.158550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.159028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.159486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.243204 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:53.250000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Old instance type m1.heat2, new instance type m1.heat {{(pid=128788) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:46:53.256739 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:46:53.257214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:46:53.257712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:46:53.258142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:46:53.258576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:46:53.321781 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d809c66-7473-4381-bb57-2affb8d90c66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7/action" status: 202 len: 0 microversion: 2.1 time: 0.181868 Sep 10 11:46:53.322421 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4625/6929] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:46:53 2022] POST /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:46:53.331711 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-273adbc6-247d-49c0-8c10-e83e3f04cdf1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:53.332420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-273adbc6-247d-49c0-8c10-e83e3f04cdf1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:53.335751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:53.336415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:53.342582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-273adbc6-247d-49c0-8c10-e83e3f04cdf1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.343069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-273adbc6-247d-49c0-8c10-e83e3f04cdf1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.344229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-273adbc6-247d-49c0-8c10-e83e3f04cdf1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.344912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-273adbc6-247d-49c0-8c10-e83e3f04cdf1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.345396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-273adbc6-247d-49c0-8c10-e83e3f04cdf1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.346028 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-273adbc6-247d-49c0-8c10-e83e3f04cdf1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.486228 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-273adbc6-247d-49c0-8c10-e83e3f04cdf1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:53.494119 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-273adbc6-247d-49c0-8c10-e83e3f04cdf1 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1690 microversion: 2.1 time: 0.166690 Sep 10 11:46:53.494693 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2305/6930] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:53 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:54.520064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c2f86c35-b32d-4044-a865-b51a1c09b31a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:54.520763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c2f86c35-b32d-4044-a865-b51a1c09b31a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:54.528142 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2f86c35-b32d-4044-a865-b51a1c09b31a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.528653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2f86c35-b32d-4044-a865-b51a1c09b31a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.529163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2f86c35-b32d-4044-a865-b51a1c09b31a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.530083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2f86c35-b32d-4044-a865-b51a1c09b31a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.530432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2f86c35-b32d-4044-a865-b51a1c09b31a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.530881 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c2f86c35-b32d-4044-a865-b51a1c09b31a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.668450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c2f86c35-b32d-4044-a865-b51a1c09b31a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:54.679353 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c2f86c35-b32d-4044-a865-b51a1c09b31a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1690 microversion: 2.1 time: 0.163528 Sep 10 11:46:54.680150 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4626/6931] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:54 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:55.704436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e693918f-2cec-4447-85d0-09c44e1e82af tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:55.705040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e693918f-2cec-4447-85d0-09c44e1e82af tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:55.711882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e693918f-2cec-4447-85d0-09c44e1e82af tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:55.712362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e693918f-2cec-4447-85d0-09c44e1e82af tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:55.712797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e693918f-2cec-4447-85d0-09c44e1e82af tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:55.713507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e693918f-2cec-4447-85d0-09c44e1e82af tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:55.713959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e693918f-2cec-4447-85d0-09c44e1e82af tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:55.714382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e693918f-2cec-4447-85d0-09c44e1e82af tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:55.845360 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e693918f-2cec-4447-85d0-09c44e1e82af tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:55.853192 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e693918f-2cec-4447-85d0-09c44e1e82af tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.153269 Sep 10 11:46:55.853762 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2306/6932] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:55 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:56.876736 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5c6a435b-0a20-4534-86aa-9122aaaec608 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:56.877743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5c6a435b-0a20-4534-86aa-9122aaaec608 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:56.884541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c6a435b-0a20-4534-86aa-9122aaaec608 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:56.885037 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c6a435b-0a20-4534-86aa-9122aaaec608 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:56.885515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c6a435b-0a20-4534-86aa-9122aaaec608 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:56.886212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c6a435b-0a20-4534-86aa-9122aaaec608 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:56.886679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c6a435b-0a20-4534-86aa-9122aaaec608 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:56.887116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5c6a435b-0a20-4534-86aa-9122aaaec608 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:57.019754 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5c6a435b-0a20-4534-86aa-9122aaaec608 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:57.027780 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5c6a435b-0a20-4534-86aa-9122aaaec608 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.155000 Sep 10 11:46:57.028408 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4627/6933] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:56 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:58.052002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cc649435-2c94-48de-a67c-12490a8b3a28 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:58.052585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cc649435-2c94-48de-a67c-12490a8b3a28 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:58.059862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc649435-2c94-48de-a67c-12490a8b3a28 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.060354 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc649435-2c94-48de-a67c-12490a8b3a28 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.060797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc649435-2c94-48de-a67c-12490a8b3a28 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.061521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc649435-2c94-48de-a67c-12490a8b3a28 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.062051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc649435-2c94-48de-a67c-12490a8b3a28 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.062480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cc649435-2c94-48de-a67c-12490a8b3a28 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.192476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cc649435-2c94-48de-a67c-12490a8b3a28 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:58.200309 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cc649435-2c94-48de-a67c-12490a8b3a28 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.152453 Sep 10 11:46:58.200887 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2307/6934] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:58 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:59.224227 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ee58955a-4ded-4310-94c9-de70296bb0e3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:59.224852 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ee58955a-4ded-4310-94c9-de70296bb0e3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:59.231931 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee58955a-4ded-4310-94c9-de70296bb0e3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:59.232428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee58955a-4ded-4310-94c9-de70296bb0e3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:59.232885 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee58955a-4ded-4310-94c9-de70296bb0e3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:59.233614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee58955a-4ded-4310-94c9-de70296bb0e3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:59.234088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee58955a-4ded-4310-94c9-de70296bb0e3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:59.234524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ee58955a-4ded-4310-94c9-de70296bb0e3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:59.382728 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ee58955a-4ded-4310-94c9-de70296bb0e3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:59.390739 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ee58955a-4ded-4310-94c9-de70296bb0e3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.170453 Sep 10 11:46:59.391305 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4628/6935] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:59 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:00.414073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-970baf7e-f9be-44d4-93f1-52737b6a3f55 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:00.414772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-970baf7e-f9be-44d4-93f1-52737b6a3f55 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:00.421654 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-970baf7e-f9be-44d4-93f1-52737b6a3f55 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:00.422145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-970baf7e-f9be-44d4-93f1-52737b6a3f55 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:00.422581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-970baf7e-f9be-44d4-93f1-52737b6a3f55 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.423269 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-970baf7e-f9be-44d4-93f1-52737b6a3f55 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:00.423723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-970baf7e-f9be-44d4-93f1-52737b6a3f55 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:00.424149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-970baf7e-f9be-44d4-93f1-52737b6a3f55 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.555490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-970baf7e-f9be-44d4-93f1-52737b6a3f55 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:00.563880 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-970baf7e-f9be-44d4-93f1-52737b6a3f55 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.153748 Sep 10 11:47:00.564493 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2308/6936] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:00 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:01.587465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d3f538a9-dac5-49c8-b7b6-135e18bdf964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:01.588093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d3f538a9-dac5-49c8-b7b6-135e18bdf964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:01.595589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3f538a9-dac5-49c8-b7b6-135e18bdf964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.596090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3f538a9-dac5-49c8-b7b6-135e18bdf964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.596541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3f538a9-dac5-49c8-b7b6-135e18bdf964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.597283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3f538a9-dac5-49c8-b7b6-135e18bdf964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.597755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3f538a9-dac5-49c8-b7b6-135e18bdf964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.598199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d3f538a9-dac5-49c8-b7b6-135e18bdf964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.729282 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d3f538a9-dac5-49c8-b7b6-135e18bdf964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:01.737930 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d3f538a9-dac5-49c8-b7b6-135e18bdf964 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.154443 Sep 10 11:47:01.738513 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4629/6937] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:01 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:02.761494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7f9e3c6e-4120-4be4-87ae-0603fe49c6a2 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:02.762087 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7f9e3c6e-4120-4be4-87ae-0603fe49c6a2 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:02.769043 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f9e3c6e-4120-4be4-87ae-0603fe49c6a2 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.769561 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f9e3c6e-4120-4be4-87ae-0603fe49c6a2 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.769993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f9e3c6e-4120-4be4-87ae-0603fe49c6a2 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.770682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f9e3c6e-4120-4be4-87ae-0603fe49c6a2 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.771135 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f9e3c6e-4120-4be4-87ae-0603fe49c6a2 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.771558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7f9e3c6e-4120-4be4-87ae-0603fe49c6a2 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.907541 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7f9e3c6e-4120-4be4-87ae-0603fe49c6a2 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:02.915317 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7f9e3c6e-4120-4be4-87ae-0603fe49c6a2 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.157829 Sep 10 11:47:02.915880 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2309/6938] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:02 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:03.940614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5e357b8e-0e41-4bc8-81c9-d4916ccdad23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:03.941306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5e357b8e-0e41-4bc8-81c9-d4916ccdad23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:03.948405 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e357b8e-0e41-4bc8-81c9-d4916ccdad23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:03.948856 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e357b8e-0e41-4bc8-81c9-d4916ccdad23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:03.949340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e357b8e-0e41-4bc8-81c9-d4916ccdad23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:03.950046 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e357b8e-0e41-4bc8-81c9-d4916ccdad23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:03.950516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e357b8e-0e41-4bc8-81c9-d4916ccdad23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:03.950957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5e357b8e-0e41-4bc8-81c9-d4916ccdad23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:04.081638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5e357b8e-0e41-4bc8-81c9-d4916ccdad23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:04.089638 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5e357b8e-0e41-4bc8-81c9-d4916ccdad23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.153615 Sep 10 11:47:04.090220 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4630/6939] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:03 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:05.113170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c89681bc-64e6-4e39-adfc-fe7321c6b33c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:05.113811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c89681bc-64e6-4e39-adfc-fe7321c6b33c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:05.120740 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89681bc-64e6-4e39-adfc-fe7321c6b33c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.121254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89681bc-64e6-4e39-adfc-fe7321c6b33c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.121692 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89681bc-64e6-4e39-adfc-fe7321c6b33c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.122378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89681bc-64e6-4e39-adfc-fe7321c6b33c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.122830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89681bc-64e6-4e39-adfc-fe7321c6b33c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.123253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c89681bc-64e6-4e39-adfc-fe7321c6b33c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.260598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c89681bc-64e6-4e39-adfc-fe7321c6b33c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.268861 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c89681bc-64e6-4e39-adfc-fe7321c6b33c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.159714 Sep 10 11:47:05.269459 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2310/6940] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:05 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:06.291766 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6cd6a774-2d6c-4fa0-81fc-f8646b007882 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:06.292394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6cd6a774-2d6c-4fa0-81fc-f8646b007882 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:06.299344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cd6a774-2d6c-4fa0-81fc-f8646b007882 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.299847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cd6a774-2d6c-4fa0-81fc-f8646b007882 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.300327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cd6a774-2d6c-4fa0-81fc-f8646b007882 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.301048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cd6a774-2d6c-4fa0-81fc-f8646b007882 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.301523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cd6a774-2d6c-4fa0-81fc-f8646b007882 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.301962 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6cd6a774-2d6c-4fa0-81fc-f8646b007882 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.436668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6cd6a774-2d6c-4fa0-81fc-f8646b007882 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:06.445128 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6cd6a774-2d6c-4fa0-81fc-f8646b007882 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.157267 Sep 10 11:47:06.445721 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4631/6941] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:06 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:07.469141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a803d6d0-a789-4480-9a5b-32b61ef3bc2e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:07.470149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a803d6d0-a789-4480-9a5b-32b61ef3bc2e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:07.476742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a803d6d0-a789-4480-9a5b-32b61ef3bc2e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:07.477271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a803d6d0-a789-4480-9a5b-32b61ef3bc2e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:07.477715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a803d6d0-a789-4480-9a5b-32b61ef3bc2e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:07.478404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a803d6d0-a789-4480-9a5b-32b61ef3bc2e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:07.478861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a803d6d0-a789-4480-9a5b-32b61ef3bc2e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:07.479296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a803d6d0-a789-4480-9a5b-32b61ef3bc2e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:07.607388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a803d6d0-a789-4480-9a5b-32b61ef3bc2e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:07.615105 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a803d6d0-a789-4480-9a5b-32b61ef3bc2e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.150082 Sep 10 11:47:07.615684 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2311/6942] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:07 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:08.638357 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8028f410-8272-4827-8a04-99dfc1416d11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:08.638988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8028f410-8272-4827-8a04-99dfc1416d11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:08.646241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8028f410-8272-4827-8a04-99dfc1416d11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.646741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8028f410-8272-4827-8a04-99dfc1416d11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.647198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8028f410-8272-4827-8a04-99dfc1416d11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.647901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8028f410-8272-4827-8a04-99dfc1416d11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.648371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8028f410-8272-4827-8a04-99dfc1416d11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.648812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8028f410-8272-4827-8a04-99dfc1416d11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.784033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8028f410-8272-4827-8a04-99dfc1416d11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:08.793280 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8028f410-8272-4827-8a04-99dfc1416d11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.158966 Sep 10 11:47:08.793868 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4632/6943] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:08 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:09.816540 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c42f724b-8b6f-4e1c-a1ab-cba11276e27b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:09.817194 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c42f724b-8b6f-4e1c-a1ab-cba11276e27b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:09.824065 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42f724b-8b6f-4e1c-a1ab-cba11276e27b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:09.824554 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42f724b-8b6f-4e1c-a1ab-cba11276e27b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:09.824995 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42f724b-8b6f-4e1c-a1ab-cba11276e27b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:09.825708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42f724b-8b6f-4e1c-a1ab-cba11276e27b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:09.826200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42f724b-8b6f-4e1c-a1ab-cba11276e27b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:09.826626 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c42f724b-8b6f-4e1c-a1ab-cba11276e27b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:09.959988 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c42f724b-8b6f-4e1c-a1ab-cba11276e27b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:09.967727 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c42f724b-8b6f-4e1c-a1ab-cba11276e27b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.155149 Sep 10 11:47:09.968302 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2312/6944] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:09 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:10.991763 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7ffccd81-a1c0-41ac-b61d-d3913e67ae56 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:10.992396 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7ffccd81-a1c0-41ac-b61d-d3913e67ae56 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:10.999298 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ffccd81-a1c0-41ac-b61d-d3913e67ae56 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.999804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ffccd81-a1c0-41ac-b61d-d3913e67ae56 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:11.000257 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ffccd81-a1c0-41ac-b61d-d3913e67ae56 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:11.000959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ffccd81-a1c0-41ac-b61d-d3913e67ae56 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:11.001456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ffccd81-a1c0-41ac-b61d-d3913e67ae56 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:11.001901 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7ffccd81-a1c0-41ac-b61d-d3913e67ae56 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:11.134882 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7ffccd81-a1c0-41ac-b61d-d3913e67ae56 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:11.143343 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7ffccd81-a1c0-41ac-b61d-d3913e67ae56 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.155548 Sep 10 11:47:11.143931 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4633/6945] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:10 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:12.166393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bafa9aa0-c76e-4f5d-8c36-8727c217b5c6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:12.167017 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bafa9aa0-c76e-4f5d-8c36-8727c217b5c6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:12.174451 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bafa9aa0-c76e-4f5d-8c36-8727c217b5c6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.174937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bafa9aa0-c76e-4f5d-8c36-8727c217b5c6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.175382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bafa9aa0-c76e-4f5d-8c36-8727c217b5c6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.176105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bafa9aa0-c76e-4f5d-8c36-8727c217b5c6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.176566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bafa9aa0-c76e-4f5d-8c36-8727c217b5c6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.176993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bafa9aa0-c76e-4f5d-8c36-8727c217b5c6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.354751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bafa9aa0-c76e-4f5d-8c36-8727c217b5c6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:12.363577 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bafa9aa0-c76e-4f5d-8c36-8727c217b5c6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1695 microversion: 2.1 time: 0.201077 Sep 10 11:47:12.364170 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2313/6946] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:12 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:12.928905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-03dceb19-3705-4ba4-ab80-e36daaa25c09 req-b6a4c35f-79c1-4b22-8116-f16fff75f94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f939bbe-f87f-49c5-a0be-e9f3778885f7", "name": "network-vif-unplugged", "status": "completed", "tag": "d7844c38-c9c4-43f8-aab0-4183763ca95b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:12.941262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-03dceb19-3705-4ba4-ab80-e36daaa25c09 req-b6a4c35f-79c1-4b22-8116-f16fff75f94e service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.941760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-03dceb19-3705-4ba4-ab80-e36daaa25c09 req-b6a4c35f-79c1-4b22-8116-f16fff75f94e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.942249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-03dceb19-3705-4ba4-ab80-e36daaa25c09 req-b6a4c35f-79c1-4b22-8116-f16fff75f94e service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.955470 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-03dceb19-3705-4ba4-ab80-e36daaa25c09 req-b6a4c35f-79c1-4b22-8116-f16fff75f94e service nova] Creating event network-vif-unplugged:d7844c38-c9c4-43f8-aab0-4183763ca95b for instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 on n-h2-856894-1 Sep 10 11:47:12.961230 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [req-03dceb19-3705-4ba4-ab80-e36daaa25c09 req-b6a4c35f-79c1-4b22-8116-f16fff75f94e service nova] Instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128788) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:47:12.973923 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-03dceb19-3705-4ba4-ab80-e36daaa25c09 req-b6a4c35f-79c1-4b22-8116-f16fff75f94e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048507 Sep 10 11:47:12.974543 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4634/6947] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:13.388204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1f42d591-7f1b-4031-ba3b-74aef8e5b19c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:13.388828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1f42d591-7f1b-4031-ba3b-74aef8e5b19c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:13.396469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f42d591-7f1b-4031-ba3b-74aef8e5b19c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:13.396948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f42d591-7f1b-4031-ba3b-74aef8e5b19c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:13.397423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f42d591-7f1b-4031-ba3b-74aef8e5b19c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:13.398290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f42d591-7f1b-4031-ba3b-74aef8e5b19c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:13.398791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f42d591-7f1b-4031-ba3b-74aef8e5b19c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:13.399217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1f42d591-7f1b-4031-ba3b-74aef8e5b19c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:13.543792 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1f42d591-7f1b-4031-ba3b-74aef8e5b19c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:13.552107 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1f42d591-7f1b-4031-ba3b-74aef8e5b19c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1694 microversion: 2.1 time: 0.168170 Sep 10 11:47:13.552692 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2314/6948] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:13 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:14.576712 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f2b91418-14ee-43b8-b923-52d19a557253 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:14.577450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f2b91418-14ee-43b8-b923-52d19a557253 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:14.585560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2b91418-14ee-43b8-b923-52d19a557253 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:14.586064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2b91418-14ee-43b8-b923-52d19a557253 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:14.586521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2b91418-14ee-43b8-b923-52d19a557253 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:14.587249 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2b91418-14ee-43b8-b923-52d19a557253 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:14.587744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2b91418-14ee-43b8-b923-52d19a557253 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:14.588185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f2b91418-14ee-43b8-b923-52d19a557253 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:14.726023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f2b91418-14ee-43b8-b923-52d19a557253 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:14.739381 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f2b91418-14ee-43b8-b923-52d19a557253 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1692 microversion: 2.1 time: 0.166757 Sep 10 11:47:14.739997 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4635/6949] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:14 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:15.003981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-872acb10-9062-428c-b3f9-b9c579a8570d req-a38d26b2-d26c-4500-9ee8-22a026f5897f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f939bbe-f87f-49c5-a0be-e9f3778885f7", "tag": "d7844c38-c9c4-43f8-aab0-4183763ca95b"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:15.014789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-872acb10-9062-428c-b3f9-b9c579a8570d req-a38d26b2-d26c-4500-9ee8-22a026f5897f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.015272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-872acb10-9062-428c-b3f9-b9c579a8570d req-a38d26b2-d26c-4500-9ee8-22a026f5897f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.015702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-872acb10-9062-428c-b3f9-b9c579a8570d req-a38d26b2-d26c-4500-9ee8-22a026f5897f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.027065 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-872acb10-9062-428c-b3f9-b9c579a8570d req-a38d26b2-d26c-4500-9ee8-22a026f5897f service nova] Creating event network-changed:d7844c38-c9c4-43f8-aab0-4183763ca95b for instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 on n-h2-856894-1 Sep 10 11:47:15.032396 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [req-872acb10-9062-428c-b3f9-b9c579a8570d req-a38d26b2-d26c-4500-9ee8-22a026f5897f service nova] Instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856894-1', 'n-h1-856894-1'} {{(pid=128787) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:47:15.042935 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-872acb10-9062-428c-b3f9-b9c579a8570d req-a38d26b2-d26c-4500-9ee8-22a026f5897f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043247 Sep 10 11:47:15.043589 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2315/6950] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:15.764016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-71746368-591f-4ec8-b77f-672f652cec68 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:15.764918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-71746368-591f-4ec8-b77f-672f652cec68 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:15.772126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71746368-591f-4ec8-b77f-672f652cec68 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.772630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71746368-591f-4ec8-b77f-672f652cec68 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.773107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71746368-591f-4ec8-b77f-672f652cec68 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.773821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71746368-591f-4ec8-b77f-672f652cec68 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.774288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71746368-591f-4ec8-b77f-672f652cec68 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.774729 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-71746368-591f-4ec8-b77f-672f652cec68 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.911325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-71746368-591f-4ec8-b77f-672f652cec68 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:15.919134 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-71746368-591f-4ec8-b77f-672f652cec68 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1689 microversion: 2.1 time: 0.159171 Sep 10 11:47:15.919726 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4636/6951] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:15 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:15.942362 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5f902360-f172-47fb-add2-8e9b77d781ea tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:15.942990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5f902360-f172-47fb-add2-8e9b77d781ea tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:15.949088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f902360-f172-47fb-add2-8e9b77d781ea tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.949593 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f902360-f172-47fb-add2-8e9b77d781ea tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.950035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f902360-f172-47fb-add2-8e9b77d781ea tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.950721 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f902360-f172-47fb-add2-8e9b77d781ea tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.951179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f902360-f172-47fb-add2-8e9b77d781ea tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.951604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5f902360-f172-47fb-add2-8e9b77d781ea tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.007417 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5f902360-f172-47fb-add2-8e9b77d781ea tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7/action" status: 204 len: 0 microversion: 2.1 time: 0.069249 Sep 10 11:47:16.008126 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2316/6952] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:47:15 2022] POST /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:47:16.016899 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42682e55-afc0-4ff2-bc79-b380ee947492 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:16.017599 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42682e55-afc0-4ff2-bc79-b380ee947492 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:16.023628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42682e55-afc0-4ff2-bc79-b380ee947492 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.024183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42682e55-afc0-4ff2-bc79-b380ee947492 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.024564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42682e55-afc0-4ff2-bc79-b380ee947492 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.025303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42682e55-afc0-4ff2-bc79-b380ee947492 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.025903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42682e55-afc0-4ff2-bc79-b380ee947492 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.026348 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42682e55-afc0-4ff2-bc79-b380ee947492 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.235773 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-42682e55-afc0-4ff2-bc79-b380ee947492 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:16.243927 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42682e55-afc0-4ff2-bc79-b380ee947492 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1689 microversion: 2.1 time: 0.231660 Sep 10 11:47:16.244517 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4637/6953] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:16 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1689 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:16.269704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-552390bd-3306-4751-81ec-a588d7e94216 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:16.270589 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-552390bd-3306-4751-81ec-a588d7e94216 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:16.276791 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-552390bd-3306-4751-81ec-a588d7e94216 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.277783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-552390bd-3306-4751-81ec-a588d7e94216 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.278242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-552390bd-3306-4751-81ec-a588d7e94216 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.279182 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-552390bd-3306-4751-81ec-a588d7e94216 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.279645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-552390bd-3306-4751-81ec-a588d7e94216 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.280073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-552390bd-3306-4751-81ec-a588d7e94216 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.490879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-552390bd-3306-4751-81ec-a588d7e94216 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:16.498585 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-552390bd-3306-4751-81ec-a588d7e94216 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1689 microversion: 2.1 time: 0.236040 Sep 10 11:47:16.499334 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2317/6954] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:16 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1689 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:17.523127 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-81f6059b-97b6-44e2-a3f3-f6f528925f78 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:17.523760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-81f6059b-97b6-44e2-a3f3-f6f528925f78 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:17.530817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81f6059b-97b6-44e2-a3f3-f6f528925f78 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:17.531326 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81f6059b-97b6-44e2-a3f3-f6f528925f78 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:17.531786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81f6059b-97b6-44e2-a3f3-f6f528925f78 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:17.533133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81f6059b-97b6-44e2-a3f3-f6f528925f78 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:17.533610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81f6059b-97b6-44e2-a3f3-f6f528925f78 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:17.534059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-81f6059b-97b6-44e2-a3f3-f6f528925f78 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:17.667300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-81f6059b-97b6-44e2-a3f3-f6f528925f78 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:17.675196 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-81f6059b-97b6-44e2-a3f3-f6f528925f78 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1681 microversion: 2.1 time: 0.155999 Sep 10 11:47:17.675782 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4638/6955] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:17 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:18.821733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-e8f09ea3-9de5-456b-8c50-530b9b2739c0 req-51053916-5f66-40f3-9bf6-a9152b62f51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f939bbe-f87f-49c5-a0be-e9f3778885f7", "name": "network-vif-plugged", "status": "completed", "tag": "d7844c38-c9c4-43f8-aab0-4183763ca95b"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:18.832164 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e8f09ea3-9de5-456b-8c50-530b9b2739c0 req-51053916-5f66-40f3-9bf6-a9152b62f51b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:18.832742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e8f09ea3-9de5-456b-8c50-530b9b2739c0 req-51053916-5f66-40f3-9bf6-a9152b62f51b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:18.833706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-e8f09ea3-9de5-456b-8c50-530b9b2739c0 req-51053916-5f66-40f3-9bf6-a9152b62f51b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:18.844708 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-e8f09ea3-9de5-456b-8c50-530b9b2739c0 req-51053916-5f66-40f3-9bf6-a9152b62f51b service nova] Creating event network-vif-plugged:d7844c38-c9c4-43f8-aab0-4183763ca95b for instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 on n-h2-856894-1 Sep 10 11:47:18.851274 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-e8f09ea3-9de5-456b-8c50-530b9b2739c0 req-51053916-5f66-40f3-9bf6-a9152b62f51b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088573 Sep 10 11:47:18.851860 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2318/6956] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:41.861313 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7bfc858e-a861-4da9-900c-ebe93636b3ff tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:41.863576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7bfc858e-a861-4da9-900c-ebe93636b3ff tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:41.867140 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=32 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:41.867945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:41.873920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bfc858e-a861-4da9-900c-ebe93636b3ff tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:41.874419 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bfc858e-a861-4da9-900c-ebe93636b3ff tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:41.874869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bfc858e-a861-4da9-900c-ebe93636b3ff tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:41.875580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bfc858e-a861-4da9-900c-ebe93636b3ff tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:41.876048 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bfc858e-a861-4da9-900c-ebe93636b3ff tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:41.876532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7bfc858e-a861-4da9-900c-ebe93636b3ff tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:41.930111 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7bfc858e-a861-4da9-900c-ebe93636b3ff tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7/action" status: 200 len: 24576 microversion: 2.1 time: 0.072707 Sep 10 11:47:41.930766 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4639/6957] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:47:41 2022] POST /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7/action => generated 24576 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:47:49.248120 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b851185b-cea7-4977-bb07-2db8f4c970d9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:49.248859 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b851185b-cea7-4977-bb07-2db8f4c970d9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:49.250715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-e07dbfa9-c444-4ac1-82e5-3fa623204f5f req-2785d980-6700-46e3-908f-e21e306424d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f939bbe-f87f-49c5-a0be-e9f3778885f7", "tag": "d7844c38-c9c4-43f8-aab0-4183763ca95b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:49.252809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=28 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:49.253812 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:49.257963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b851185b-cea7-4977-bb07-2db8f4c970d9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:49.258458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b851185b-cea7-4977-bb07-2db8f4c970d9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:49.258933 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b851185b-cea7-4977-bb07-2db8f4c970d9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:49.259870 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b851185b-cea7-4977-bb07-2db8f4c970d9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:49.260329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b851185b-cea7-4977-bb07-2db8f4c970d9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:49.260969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b851185b-cea7-4977-bb07-2db8f4c970d9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:49.262583 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e07dbfa9-c444-4ac1-82e5-3fa623204f5f req-2785d980-6700-46e3-908f-e21e306424d0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:49.263077 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e07dbfa9-c444-4ac1-82e5-3fa623204f5f req-2785d980-6700-46e3-908f-e21e306424d0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:49.263523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-e07dbfa9-c444-4ac1-82e5-3fa623204f5f req-2785d980-6700-46e3-908f-e21e306424d0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:49.276677 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-e07dbfa9-c444-4ac1-82e5-3fa623204f5f req-2785d980-6700-46e3-908f-e21e306424d0 service nova] Creating event network-changed:d7844c38-c9c4-43f8-aab0-4183763ca95b for instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 on n-h2-856894-1 Sep 10 11:47:49.281988 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-e07dbfa9-c444-4ac1-82e5-3fa623204f5f req-2785d980-6700-46e3-908f-e21e306424d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035909 Sep 10 11:47:49.283575 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4640/6958] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:49.297853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b851185b-cea7-4977-bb07-2db8f4c970d9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:47:49.382387 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b851185b-cea7-4977-bb07-2db8f4c970d9 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 204 len: 0 microversion: 2.1 time: 0.138398 Sep 10 11:47:49.383710 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2319/6959] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:47:49 2022] DELETE /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:47:49.394438 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6204d271-6b9c-495d-bf0e-f48b76d0652e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:49.395598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6204d271-6b9c-495d-bf0e-f48b76d0652e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:49.403110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6204d271-6b9c-495d-bf0e-f48b76d0652e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:49.404002 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6204d271-6b9c-495d-bf0e-f48b76d0652e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:49.404876 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6204d271-6b9c-495d-bf0e-f48b76d0652e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:49.405647 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6204d271-6b9c-495d-bf0e-f48b76d0652e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:49.406199 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6204d271-6b9c-495d-bf0e-f48b76d0652e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:49.406925 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6204d271-6b9c-495d-bf0e-f48b76d0652e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:49.548542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6204d271-6b9c-495d-bf0e-f48b76d0652e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:49.556711 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6204d271-6b9c-495d-bf0e-f48b76d0652e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1687 microversion: 2.1 time: 0.168190 Sep 10 11:47:49.557560 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4641/6960] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:49 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:50.581217 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e3d5d54d-6038-4bb2-9e11-66277a950968 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:50.581922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e3d5d54d-6038-4bb2-9e11-66277a950968 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:50.589627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3d5d54d-6038-4bb2-9e11-66277a950968 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:50.590116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3d5d54d-6038-4bb2-9e11-66277a950968 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:50.590552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3d5d54d-6038-4bb2-9e11-66277a950968 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:50.591246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3d5d54d-6038-4bb2-9e11-66277a950968 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:50.591694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3d5d54d-6038-4bb2-9e11-66277a950968 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:50.592114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e3d5d54d-6038-4bb2-9e11-66277a950968 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:50.726587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e3d5d54d-6038-4bb2-9e11-66277a950968 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:50.734476 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e3d5d54d-6038-4bb2-9e11-66277a950968 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 200 len: 1687 microversion: 2.1 time: 0.158178 Sep 10 11:47:50.735062 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2320/6961] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:50 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:51.314905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-99e13411-e60a-49c6-9bb2-3d307e2ebf64 req-390470d9-b4cb-4ad2-9559-233cf245af1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f939bbe-f87f-49c5-a0be-e9f3778885f7", "name": "network-vif-deleted", "tag": "d7844c38-c9c4-43f8-aab0-4183763ca95b"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:51.326567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-99e13411-e60a-49c6-9bb2-3d307e2ebf64 req-390470d9-b4cb-4ad2-9559-233cf245af1d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:51.327149 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-99e13411-e60a-49c6-9bb2-3d307e2ebf64 req-390470d9-b4cb-4ad2-9559-233cf245af1d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:51.327813 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-99e13411-e60a-49c6-9bb2-3d307e2ebf64 req-390470d9-b4cb-4ad2-9559-233cf245af1d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:51.342192 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-99e13411-e60a-49c6-9bb2-3d307e2ebf64 req-390470d9-b4cb-4ad2-9559-233cf245af1d service nova] Creating event network-vif-deleted:d7844c38-c9c4-43f8-aab0-4183763ca95b for instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 on n-h2-856894-1 Sep 10 11:47:51.347447 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-99e13411-e60a-49c6-9bb2-3d307e2ebf64 req-390470d9-b4cb-4ad2-9559-233cf245af1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036324 Sep 10 11:47:51.348073 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4642/6962] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:51.758031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:51.758645 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 5f939bbe-f87f-49c5-a0be-e9f3778885f7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:51.765601 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:51.766090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:51.766526 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:51.767213 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:51.767667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:51.768093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:51.781758 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] HTTP exception thrown: Instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 could not be found. Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Request method failure captured: Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 HTTP/1.1 Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHhRyltnowTOB2igHay_0zljRnORjtCrqWTIMoFWA849Bp0w1HZKNF3ywind08ohEU6rRGOqTJ5W4r6nubhdqDgB4vAjNmUKmMdSQK12yO6639vPMn2vRvSSntI0B-Oxm3ks9hZX6oTyyXyRHnzbHZoORrizqS1OtvpDVt0FLCF7W0A Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 9972c52da6144ebcaa81a0fde66ca255 Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9972c52da6144ebcaa81a0fde66ca255", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 9972c52da6144ebcaa81a0fde66ca255 Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestNetworkAdvancedServerOps-344189195-project Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e085bc75f0c54299a24a5252d0a26dc0 Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestNetworkAdvancedServerOps-344189195-project Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 could not be found. Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '5f939bbe-f87f-49c5-a0be-e9f3778885f7'} Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 could not be found. Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 could not be found. Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:47:51.783394 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 could not be found. Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Returning 404 to user: Instance 5f939bbe-f87f-49c5-a0be-e9f3778885f7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9de1660-6fd0-4cea-adbf-5646aaacc502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7" status: 404 len: 111 microversion: 2.1 time: 0.030654 Sep 10 11:47:51.789179 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2321/6963] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:51 2022] GET /compute/v2.1/servers/5f939bbe-f87f-49c5-a0be-e9f3778885f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:47:55.043793 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b91fcdf8-0a90-42fc-951b-7c5ab8206c38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '.version_select at 0x7efcb2ce5280>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:55.065152 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b91fcdf8-0a90-42fc-951b-7c5ab8206c38 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-651969165" status: 202 len: 0 microversion: 2.1 time: 0.025412 Sep 10 11:47:55.066369 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4643/6964] 10.222.0.20 () {58 vars in 1281 bytes} [Sat Sep 10 11:47:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-651969165 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:47:55.091818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-051d85e7-3ffe-4d9d-a112-a16e61dcfa13 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'create', calling method: .version_select at 0x7efcae676940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1063940620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjkXqsUIfaSoLC0LO5mvErBoaM+3ABOeeA6wm1MhOSISlc42kXQBiJ1A6iKqH257S+kZng3I5hwwcLPzpKvcrKjX9cWE39eEE5a5QU8hPY1e19kLyQAb1weNpaLoiJ3vw=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:55.112610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-051d85e7-3ffe-4d9d-a112-a16e61dcfa13 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:55.117920 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-051d85e7-3ffe-4d9d-a112-a16e61dcfa13 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for user e085bc75f0c54299a24a5252d0a26dc0 and project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:55.141586 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-051d85e7-3ffe-4d9d-a112-a16e61dcfa13 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053457 Sep 10 11:47:55.142207 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2322/6965] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:47:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:00.591840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1115811557", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "11cc8caa-4a69-468a-be64-1a1981a08c20"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1063940620", "security_groups": [{"name": "tempest-secgroup-smoke-592228464"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:00.845791 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] validate_networks() for [('11cc8caa-4a69-468a-be64-1a1981a08c20', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:48:01.310691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:48:01.311224 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:48:01.311799 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:48:01.312308 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:48:01.312816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:48:01.331817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:01.332343 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:01.332955 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:01.333817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:01.334315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:01.334755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:01.335789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=14 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:01.379979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:48:01.388743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for user e085bc75f0c54299a24a5252d0a26dc0 and project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:48:01.405145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:48:01.407934 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:48:01.466271 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d855e22-046e-4a60-a4eb-916105ab9016 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.878491 Sep 10 11:48:01.473703 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4644/6966] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:48:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:48:01.481276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2aee6419-7ac7-4c1f-94e8-e5854b2001fa tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:01.481808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2aee6419-7ac7-4c1f-94e8-e5854b2001fa tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:01.556855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2aee6419-7ac7-4c1f-94e8-e5854b2001fa tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:01.565478 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2aee6419-7ac7-4c1f-94e8-e5854b2001fa tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1267 microversion: 2.1 time: 0.090293 Sep 10 11:48:01.567090 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2323/6967] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:01 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:02.591191 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2dfa6ae4-0d36-4338-b3c2-2fb0b7e22d98 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:02.592537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2dfa6ae4-0d36-4338-b3c2-2fb0b7e22d98 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:02.600771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfa6ae4-0d36-4338-b3c2-2fb0b7e22d98 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.601617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfa6ae4-0d36-4338-b3c2-2fb0b7e22d98 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.602256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfa6ae4-0d36-4338-b3c2-2fb0b7e22d98 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:02.603156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfa6ae4-0d36-4338-b3c2-2fb0b7e22d98 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.603789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfa6ae4-0d36-4338-b3c2-2fb0b7e22d98 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.604394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2dfa6ae4-0d36-4338-b3c2-2fb0b7e22d98 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:02.699560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2dfa6ae4-0d36-4338-b3c2-2fb0b7e22d98 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:02.708361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2dfa6ae4-0d36-4338-b3c2-2fb0b7e22d98 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1327 microversion: 2.1 time: 0.122632 Sep 10 11:48:02.725497 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4645/6968] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:02 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1327 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:03.743069 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5cead748-3c22-4587-8761-867adf0145de tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:03.747340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5cead748-3c22-4587-8761-867adf0145de tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:03.749582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:03.765849 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cead748-3c22-4587-8761-867adf0145de tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:03.766351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cead748-3c22-4587-8761-867adf0145de tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:03.767051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cead748-3c22-4587-8761-867adf0145de tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:03.767984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cead748-3c22-4587-8761-867adf0145de tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:03.769584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cead748-3c22-4587-8761-867adf0145de tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:03.770020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5cead748-3c22-4587-8761-867adf0145de tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:04.128566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5cead748-3c22-4587-8761-867adf0145de tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:04.136570 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5cead748-3c22-4587-8761-867adf0145de tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1392 microversion: 2.1 time: 0.405129 Sep 10 11:48:04.137092 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2324/6969] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:03 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1392 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:04.564031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2c1306d2-8a91-410e-8690-7c30d2597e91 req-22922a7a-e0a3-49f0-9560-d11ae7631c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99dbed2e-1efd-45af-a454-760555c40465", "tag": "774e2f9b-c115-4819-bcff-9549f283e710"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:04.573903 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2c1306d2-8a91-410e-8690-7c30d2597e91 req-22922a7a-e0a3-49f0-9560-d11ae7631c12 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:04.575117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2c1306d2-8a91-410e-8690-7c30d2597e91 req-22922a7a-e0a3-49f0-9560-d11ae7631c12 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:04.575646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2c1306d2-8a91-410e-8690-7c30d2597e91 req-22922a7a-e0a3-49f0-9560-d11ae7631c12 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:04.588673 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2c1306d2-8a91-410e-8690-7c30d2597e91 req-22922a7a-e0a3-49f0-9560-d11ae7631c12 service nova] Creating event network-changed:774e2f9b-c115-4819-bcff-9549f283e710 for instance 99dbed2e-1efd-45af-a454-760555c40465 on n-h1-856894-1 Sep 10 11:48:04.593758 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2c1306d2-8a91-410e-8690-7c30d2597e91 req-22922a7a-e0a3-49f0-9560-d11ae7631c12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093486 Sep 10 11:48:04.594416 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4646/6970] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:05.160211 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9fa98180-d25e-4ec2-9a39-3ea64a749502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:05.160823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9fa98180-d25e-4ec2-9a39-3ea64a749502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:05.167767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fa98180-d25e-4ec2-9a39-3ea64a749502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:05.168250 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fa98180-d25e-4ec2-9a39-3ea64a749502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:05.168688 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fa98180-d25e-4ec2-9a39-3ea64a749502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:05.169460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fa98180-d25e-4ec2-9a39-3ea64a749502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:05.169916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fa98180-d25e-4ec2-9a39-3ea64a749502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:05.170343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9fa98180-d25e-4ec2-9a39-3ea64a749502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:05.303867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-9fa98180-d25e-4ec2-9a39-3ea64a749502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:05.312059 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9fa98180-d25e-4ec2-9a39-3ea64a749502 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1392 microversion: 2.1 time: 0.155842 Sep 10 11:48:05.312725 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2325/6971] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:05 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:06.336078 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-37cbb324-c159-4b85-9a58-62b1142c1992 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:06.336748 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-37cbb324-c159-4b85-9a58-62b1142c1992 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:06.343817 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37cbb324-c159-4b85-9a58-62b1142c1992 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:06.344318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37cbb324-c159-4b85-9a58-62b1142c1992 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:06.344774 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37cbb324-c159-4b85-9a58-62b1142c1992 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:06.345576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37cbb324-c159-4b85-9a58-62b1142c1992 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:06.346050 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37cbb324-c159-4b85-9a58-62b1142c1992 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:06.346495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-37cbb324-c159-4b85-9a58-62b1142c1992 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:06.475676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-37cbb324-c159-4b85-9a58-62b1142c1992 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:06.483397 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-37cbb324-c159-4b85-9a58-62b1142c1992 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1392 microversion: 2.1 time: 0.151777 Sep 10 11:48:06.483984 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4647/6972] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:06 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:07.507241 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f58cd918-5deb-439f-b845-cca61fd81387 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:07.507863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f58cd918-5deb-439f-b845-cca61fd81387 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:07.514388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f58cd918-5deb-439f-b845-cca61fd81387 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:07.514881 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f58cd918-5deb-439f-b845-cca61fd81387 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:07.515319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f58cd918-5deb-439f-b845-cca61fd81387 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:07.516018 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f58cd918-5deb-439f-b845-cca61fd81387 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:07.516476 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f58cd918-5deb-439f-b845-cca61fd81387 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:07.516903 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f58cd918-5deb-439f-b845-cca61fd81387 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:07.651587 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f58cd918-5deb-439f-b845-cca61fd81387 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:07.659335 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f58cd918-5deb-439f-b845-cca61fd81387 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1392 microversion: 2.1 time: 0.156784 Sep 10 11:48:07.659908 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2326/6973] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:07 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:08.682500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-23146f08-6d06-4340-a6ca-fa7c4be6505f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:08.683172 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-23146f08-6d06-4340-a6ca-fa7c4be6505f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:08.689974 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23146f08-6d06-4340-a6ca-fa7c4be6505f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:08.690982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23146f08-6d06-4340-a6ca-fa7c4be6505f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:08.691445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23146f08-6d06-4340-a6ca-fa7c4be6505f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:08.692157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23146f08-6d06-4340-a6ca-fa7c4be6505f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:08.693053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23146f08-6d06-4340-a6ca-fa7c4be6505f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:08.693053 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-23146f08-6d06-4340-a6ca-fa7c4be6505f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:08.827539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-23146f08-6d06-4340-a6ca-fa7c4be6505f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:08.835919 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-23146f08-6d06-4340-a6ca-fa7c4be6505f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1392 microversion: 2.1 time: 0.157631 Sep 10 11:48:08.836504 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4648/6974] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:08 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:09.162802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-41b0e666-86a7-4858-b42d-9bb79742962a req-546220d9-bbea-4e7d-ad2b-d0e76c6b9ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99dbed2e-1efd-45af-a454-760555c40465", "name": "network-vif-plugged", "status": "completed", "tag": "774e2f9b-c115-4819-bcff-9549f283e710"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:09.173395 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-41b0e666-86a7-4858-b42d-9bb79742962a req-546220d9-bbea-4e7d-ad2b-d0e76c6b9ca9 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:09.173875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-41b0e666-86a7-4858-b42d-9bb79742962a req-546220d9-bbea-4e7d-ad2b-d0e76c6b9ca9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:09.174305 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-41b0e666-86a7-4858-b42d-9bb79742962a req-546220d9-bbea-4e7d-ad2b-d0e76c6b9ca9 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:09.186113 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-41b0e666-86a7-4858-b42d-9bb79742962a req-546220d9-bbea-4e7d-ad2b-d0e76c6b9ca9 service nova] Creating event network-vif-plugged:774e2f9b-c115-4819-bcff-9549f283e710 for instance 99dbed2e-1efd-45af-a454-760555c40465 on n-h1-856894-1 Sep 10 11:48:09.191644 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-41b0e666-86a7-4858-b42d-9bb79742962a req-546220d9-bbea-4e7d-ad2b-d0e76c6b9ca9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032555 Sep 10 11:48:09.192239 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2327/6975] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:09.858980 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ebeb9479-d0a0-41b0-9f3a-b7851b07e2b7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:09.859612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ebeb9479-d0a0-41b0-9f3a-b7851b07e2b7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:09.875730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebeb9479-d0a0-41b0-9f3a-b7851b07e2b7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:09.876242 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebeb9479-d0a0-41b0-9f3a-b7851b07e2b7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:09.876706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebeb9479-d0a0-41b0-9f3a-b7851b07e2b7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:09.877456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebeb9479-d0a0-41b0-9f3a-b7851b07e2b7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:09.878210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebeb9479-d0a0-41b0-9f3a-b7851b07e2b7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:09.878659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ebeb9479-d0a0-41b0-9f3a-b7851b07e2b7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:10.008822 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ebeb9479-d0a0-41b0-9f3a-b7851b07e2b7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:10.016672 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ebeb9479-d0a0-41b0-9f3a-b7851b07e2b7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1392 microversion: 2.1 time: 0.161627 Sep 10 11:48:10.017289 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4649/6976] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:09 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:11.042169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0b56818e-2314-40e9-ad23-f0f0471dcd00 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:11.042875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0b56818e-2314-40e9-ad23-f0f0471dcd00 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:11.049003 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b56818e-2314-40e9-ad23-f0f0471dcd00 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:11.049516 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b56818e-2314-40e9-ad23-f0f0471dcd00 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:11.050553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b56818e-2314-40e9-ad23-f0f0471dcd00 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:11.051230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b56818e-2314-40e9-ad23-f0f0471dcd00 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:11.051681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b56818e-2314-40e9-ad23-f0f0471dcd00 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:11.052104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0b56818e-2314-40e9-ad23-f0f0471dcd00 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:11.184284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0b56818e-2314-40e9-ad23-f0f0471dcd00 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:11.192046 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0b56818e-2314-40e9-ad23-f0f0471dcd00 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1563 microversion: 2.1 time: 0.154974 Sep 10 11:48:11.192610 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2328/6977] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:11 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:11.215000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-713be06d-b0a7-4159-b08a-5284e334ca54 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:11.215635 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-713be06d-b0a7-4159-b08a-5284e334ca54 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:11.223161 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713be06d-b0a7-4159-b08a-5284e334ca54 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:11.223663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713be06d-b0a7-4159-b08a-5284e334ca54 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:11.224109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713be06d-b0a7-4159-b08a-5284e334ca54 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:11.224810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713be06d-b0a7-4159-b08a-5284e334ca54 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:11.225299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713be06d-b0a7-4159-b08a-5284e334ca54 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:11.225738 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-713be06d-b0a7-4159-b08a-5284e334ca54 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:11.362099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-713be06d-b0a7-4159-b08a-5284e334ca54 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:11.364468 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:11.371462 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-713be06d-b0a7-4159-b08a-5284e334ca54 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1563 microversion: 2.1 time: 0.160378 Sep 10 11:48:11.372054 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4650/6978] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:11 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:12.932828 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:12.934667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7dade600-6740-4dd2-b71b-6849e86a5e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:12.935819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7dade600-6740-4dd2-b71b-6849e86a5e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:12.939402 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:12.940167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-7f19545e-97a9-4ca1-8f99-9eed8f870eed req-0b6e097d-ec59-4ea4-a52b-94555992455c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99dbed2e-1efd-45af-a454-760555c40465", "tag": "774e2f9b-c115-4819-bcff-9549f283e710"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:12.944535 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dade600-6740-4dd2-b71b-6849e86a5e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:12.945034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dade600-6740-4dd2-b71b-6849e86a5e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:12.945499 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dade600-6740-4dd2-b71b-6849e86a5e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:12.946195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dade600-6740-4dd2-b71b-6849e86a5e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:12.946454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:12.946819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dade600-6740-4dd2-b71b-6849e86a5e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:12.947600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7dade600-6740-4dd2-b71b-6849e86a5e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:12.953316 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7f19545e-97a9-4ca1-8f99-9eed8f870eed req-0b6e097d-ec59-4ea4-a52b-94555992455c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:12.954057 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7f19545e-97a9-4ca1-8f99-9eed8f870eed req-0b6e097d-ec59-4ea4-a52b-94555992455c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:12.954638 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-7f19545e-97a9-4ca1-8f99-9eed8f870eed req-0b6e097d-ec59-4ea4-a52b-94555992455c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:12.968828 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-7f19545e-97a9-4ca1-8f99-9eed8f870eed req-0b6e097d-ec59-4ea4-a52b-94555992455c service nova] Creating event network-changed:774e2f9b-c115-4819-bcff-9549f283e710 for instance 99dbed2e-1efd-45af-a454-760555c40465 on n-h1-856894-1 Sep 10 11:48:12.976127 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-7f19545e-97a9-4ca1-8f99-9eed8f870eed req-0b6e097d-ec59-4ea4-a52b-94555992455c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043927 Sep 10 11:48:12.977797 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4651/6979] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:48:13.171771 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7dade600-6740-4dd2-b71b-6849e86a5e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:13.182814 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7dade600-6740-4dd2-b71b-6849e86a5e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1563 microversion: 2.1 time: 0.252784 Sep 10 11:48:13.200536 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2329/6980] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:12 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:34.815642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8d9a503e-3a00-415b-a382-3658bb2ab222 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:34.818533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8d9a503e-3a00-415b-a382-3658bb2ab222 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:34.821520 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=36 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:34.829117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9a503e-3a00-415b-a382-3658bb2ab222 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:34.829803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9a503e-3a00-415b-a382-3658bb2ab222 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:34.830269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9a503e-3a00-415b-a382-3658bb2ab222 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:34.830985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9a503e-3a00-415b-a382-3658bb2ab222 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:34.831465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9a503e-3a00-415b-a382-3658bb2ab222 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:34.832490 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8d9a503e-3a00-415b-a382-3658bb2ab222 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:34.888950 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8d9a503e-3a00-415b-a382-3658bb2ab222 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465/action" status: 200 len: 24566 microversion: 2.1 time: 0.077666 Sep 10 11:48:34.889652 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4652/6981] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:48:34 2022] POST /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465/action => generated 24566 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:48:45.609317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4d5fb73a-270d-4e38-a701-526c2b0306cb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:45.611485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:45.612192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=32 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:45.619159 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d5fb73a-270d-4e38-a701-526c2b0306cb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:45.619639 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d5fb73a-270d-4e38-a701-526c2b0306cb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:45.620070 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4d5fb73a-270d-4e38-a701-526c2b0306cb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:45.646854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4d5fb73a-270d-4e38-a701-526c2b0306cb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Going to try to stop instance {{(pid=128787) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 11:48:45.688650 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4d5fb73a-270d-4e38-a701-526c2b0306cb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465/action" status: 202 len: 0 microversion: 2.1 time: 0.083226 Sep 10 11:48:45.689321 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2330/6982] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:48:45 2022] POST /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:48:45.698427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ef0996ef-229f-4a4f-adb4-9738a7a76cad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:45.699148 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ef0996ef-229f-4a4f-adb4-9738a7a76cad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:45.701851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:45.702535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:45.709546 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0996ef-229f-4a4f-adb4-9738a7a76cad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:45.710056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0996ef-229f-4a4f-adb4-9738a7a76cad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:45.710517 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0996ef-229f-4a4f-adb4-9738a7a76cad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:45.711262 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0996ef-229f-4a4f-adb4-9738a7a76cad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:45.711737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0996ef-229f-4a4f-adb4-9738a7a76cad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:45.712184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ef0996ef-229f-4a4f-adb4-9738a7a76cad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:45.850040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ef0996ef-229f-4a4f-adb4-9738a7a76cad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:45.858207 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ef0996ef-229f-4a4f-adb4-9738a7a76cad tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1691 microversion: 2.1 time: 0.164040 Sep 10 11:48:45.858789 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4653/6983] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:45 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:46.883335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3cd84a77-13b0-442c-b87f-b47e2e007f23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:46.884023 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3cd84a77-13b0-442c-b87f-b47e2e007f23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:46.891210 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cd84a77-13b0-442c-b87f-b47e2e007f23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:46.891696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cd84a77-13b0-442c-b87f-b47e2e007f23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:46.892131 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cd84a77-13b0-442c-b87f-b47e2e007f23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:46.892814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cd84a77-13b0-442c-b87f-b47e2e007f23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:46.893303 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cd84a77-13b0-442c-b87f-b47e2e007f23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:46.893725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3cd84a77-13b0-442c-b87f-b47e2e007f23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:47.022517 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3cd84a77-13b0-442c-b87f-b47e2e007f23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:47.030170 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3cd84a77-13b0-442c-b87f-b47e2e007f23 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1691 microversion: 2.1 time: 0.151960 Sep 10 11:48:47.030735 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2331/6984] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:46 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:48.054036 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4270aa8a-7840-4ade-bf9a-c10e77f17993 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:48.054699 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4270aa8a-7840-4ade-bf9a-c10e77f17993 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:48.061838 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4270aa8a-7840-4ade-bf9a-c10e77f17993 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:48.062665 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4270aa8a-7840-4ade-bf9a-c10e77f17993 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:48.063124 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4270aa8a-7840-4ade-bf9a-c10e77f17993 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:48.063821 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4270aa8a-7840-4ade-bf9a-c10e77f17993 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:48.064285 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4270aa8a-7840-4ade-bf9a-c10e77f17993 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:48.064722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4270aa8a-7840-4ade-bf9a-c10e77f17993 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:48.193117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4270aa8a-7840-4ade-bf9a-c10e77f17993 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:48.200918 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4270aa8a-7840-4ade-bf9a-c10e77f17993 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1691 microversion: 2.1 time: 0.150965 Sep 10 11:48:48.201527 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4654/6985] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:48 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:49.229192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8361e7b4-fc1f-4379-972c-c9d4270a303e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:49.229892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8361e7b4-fc1f-4379-972c-c9d4270a303e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:49.237282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8361e7b4-fc1f-4379-972c-c9d4270a303e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:49.237776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8361e7b4-fc1f-4379-972c-c9d4270a303e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:49.238238 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8361e7b4-fc1f-4379-972c-c9d4270a303e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:49.239467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8361e7b4-fc1f-4379-972c-c9d4270a303e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:49.239922 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8361e7b4-fc1f-4379-972c-c9d4270a303e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:49.240345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8361e7b4-fc1f-4379-972c-c9d4270a303e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:49.371075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8361e7b4-fc1f-4379-972c-c9d4270a303e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:49.379307 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8361e7b4-fc1f-4379-972c-c9d4270a303e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1691 microversion: 2.1 time: 0.154176 Sep 10 11:48:49.379886 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2332/6986] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:49 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:50.403335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-554352a8-0967-4946-82e1-416101a98b86 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:50.403861 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-554352a8-0967-4946-82e1-416101a98b86 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:50.410752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-554352a8-0967-4946-82e1-416101a98b86 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:50.411247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-554352a8-0967-4946-82e1-416101a98b86 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:50.411696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-554352a8-0967-4946-82e1-416101a98b86 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:50.412394 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-554352a8-0967-4946-82e1-416101a98b86 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:50.412860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-554352a8-0967-4946-82e1-416101a98b86 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:50.413328 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-554352a8-0967-4946-82e1-416101a98b86 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:50.542157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-554352a8-0967-4946-82e1-416101a98b86 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:50.550278 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-554352a8-0967-4946-82e1-416101a98b86 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1691 microversion: 2.1 time: 0.150961 Sep 10 11:48:50.551466 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4655/6987] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:50 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:51.574802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b560381f-4de0-4eb8-bfa9-36694773af2d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:51.575422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b560381f-4de0-4eb8-bfa9-36694773af2d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:51.582547 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b560381f-4de0-4eb8-bfa9-36694773af2d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:51.583046 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b560381f-4de0-4eb8-bfa9-36694773af2d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:51.583486 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b560381f-4de0-4eb8-bfa9-36694773af2d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:51.584183 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b560381f-4de0-4eb8-bfa9-36694773af2d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:51.584629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b560381f-4de0-4eb8-bfa9-36694773af2d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:51.585061 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b560381f-4de0-4eb8-bfa9-36694773af2d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:51.718821 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b560381f-4de0-4eb8-bfa9-36694773af2d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:51.726823 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b560381f-4de0-4eb8-bfa9-36694773af2d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1691 microversion: 2.1 time: 0.156126 Sep 10 11:48:51.727406 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2333/6988] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:51 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:52.749904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2255fbec-f5fb-4a48-8b54-eb5fad01293f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:52.750540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2255fbec-f5fb-4a48-8b54-eb5fad01293f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:52.757941 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2255fbec-f5fb-4a48-8b54-eb5fad01293f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.758444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2255fbec-f5fb-4a48-8b54-eb5fad01293f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.758902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2255fbec-f5fb-4a48-8b54-eb5fad01293f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.759607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2255fbec-f5fb-4a48-8b54-eb5fad01293f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.760082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2255fbec-f5fb-4a48-8b54-eb5fad01293f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.760524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2255fbec-f5fb-4a48-8b54-eb5fad01293f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.888381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2255fbec-f5fb-4a48-8b54-eb5fad01293f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:52.897030 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2255fbec-f5fb-4a48-8b54-eb5fad01293f tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1691 microversion: 2.1 time: 0.151161 Sep 10 11:48:52.897643 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4656/6989] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:52 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:53.919773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4585c172-bbe5-4682-9206-8ded59f86cfb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:53.920386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4585c172-bbe5-4682-9206-8ded59f86cfb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:53.927277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4585c172-bbe5-4682-9206-8ded59f86cfb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:53.927768 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4585c172-bbe5-4682-9206-8ded59f86cfb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:53.928206 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4585c172-bbe5-4682-9206-8ded59f86cfb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:53.928895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4585c172-bbe5-4682-9206-8ded59f86cfb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:53.929379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4585c172-bbe5-4682-9206-8ded59f86cfb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:53.929808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4585c172-bbe5-4682-9206-8ded59f86cfb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:54.058830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4585c172-bbe5-4682-9206-8ded59f86cfb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:54.066538 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4585c172-bbe5-4682-9206-8ded59f86cfb tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1691 microversion: 2.1 time: 0.150676 Sep 10 11:48:54.067119 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2334/6990] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:53 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:55.089464 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2b744458-a34b-41fa-a77b-ef2dd5cfa3a3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:55.090123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2b744458-a34b-41fa-a77b-ef2dd5cfa3a3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:55.097004 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b744458-a34b-41fa-a77b-ef2dd5cfa3a3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:55.098032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b744458-a34b-41fa-a77b-ef2dd5cfa3a3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:55.098482 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b744458-a34b-41fa-a77b-ef2dd5cfa3a3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:55.099183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b744458-a34b-41fa-a77b-ef2dd5cfa3a3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:55.099653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b744458-a34b-41fa-a77b-ef2dd5cfa3a3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:55.100090 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2b744458-a34b-41fa-a77b-ef2dd5cfa3a3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:55.236310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2b744458-a34b-41fa-a77b-ef2dd5cfa3a3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:55.244865 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2b744458-a34b-41fa-a77b-ef2dd5cfa3a3 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1691 microversion: 2.1 time: 0.159405 Sep 10 11:48:55.245472 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4657/6991] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:55 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:56.267363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-eff849f8-27d0-4f4f-9993-b7afeb2e7a6b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:56.267985 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-eff849f8-27d0-4f4f-9993-b7afeb2e7a6b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:56.275169 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff849f8-27d0-4f4f-9993-b7afeb2e7a6b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:56.275658 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff849f8-27d0-4f4f-9993-b7afeb2e7a6b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:56.276105 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff849f8-27d0-4f4f-9993-b7afeb2e7a6b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:56.276798 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff849f8-27d0-4f4f-9993-b7afeb2e7a6b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:56.277292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff849f8-27d0-4f4f-9993-b7afeb2e7a6b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:56.277725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-eff849f8-27d0-4f4f-9993-b7afeb2e7a6b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:56.406606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-eff849f8-27d0-4f4f-9993-b7afeb2e7a6b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:56.414394 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-eff849f8-27d0-4f4f-9993-b7afeb2e7a6b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1668 microversion: 2.1 time: 0.151026 Sep 10 11:48:56.414979 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2335/6992] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:56 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:57.511897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-016306a1-102f-4fe3-9811-4947bd8c6cce tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:57.514207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-016306a1-102f-4fe3-9811-4947bd8c6cce tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:57.521261 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-016306a1-102f-4fe3-9811-4947bd8c6cce tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.521761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-016306a1-102f-4fe3-9811-4947bd8c6cce tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.522214 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-016306a1-102f-4fe3-9811-4947bd8c6cce tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.523596 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-016306a1-102f-4fe3-9811-4947bd8c6cce tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.524087 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-016306a1-102f-4fe3-9811-4947bd8c6cce tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.524539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-016306a1-102f-4fe3-9811-4947bd8c6cce tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.574819 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-016306a1-102f-4fe3-9811-4947bd8c6cce tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465/action" status: 200 len: 38394 microversion: 2.1 time: 0.066763 Sep 10 11:48:57.575456 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4658/6993] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:48:57 2022] POST /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465/action => generated 38394 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:48:57.587857 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5230536f-378e-42f8-9209-406de5a562ac tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:57.594754 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5230536f-378e-42f8-9209-406de5a562ac tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.595235 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5230536f-378e-42f8-9209-406de5a562ac tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.595668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5230536f-378e-42f8-9209-406de5a562ac tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.620447 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5230536f-378e-42f8-9209-406de5a562ac tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Going to try to start instance {{(pid=128787) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 11:48:57.661028 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5230536f-378e-42f8-9209-406de5a562ac tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465/action" status: 202 len: 0 microversion: 2.1 time: 0.076962 Sep 10 11:48:57.661655 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2336/6994] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:48:57 2022] POST /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:48:57.670741 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a75025da-e518-41fe-b8a7-0ba5abd4eb66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:57.671501 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a75025da-e518-41fe-b8a7-0ba5abd4eb66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:57.679304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75025da-e518-41fe-b8a7-0ba5abd4eb66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.679846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75025da-e518-41fe-b8a7-0ba5abd4eb66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.680303 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75025da-e518-41fe-b8a7-0ba5abd4eb66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.681030 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75025da-e518-41fe-b8a7-0ba5abd4eb66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.681534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75025da-e518-41fe-b8a7-0ba5abd4eb66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.682100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a75025da-e518-41fe-b8a7-0ba5abd4eb66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.904995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a75025da-e518-41fe-b8a7-0ba5abd4eb66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:57.912875 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a75025da-e518-41fe-b8a7-0ba5abd4eb66 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1677 microversion: 2.1 time: 0.246545 Sep 10 11:48:57.913499 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4659/6995] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:57 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:58.938424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6c79af49-b9ce-4d56-b3e9-6a6db0075e4a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:58.939020 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6c79af49-b9ce-4d56-b3e9-6a6db0075e4a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:58.946679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c79af49-b9ce-4d56-b3e9-6a6db0075e4a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.947166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c79af49-b9ce-4d56-b3e9-6a6db0075e4a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.947613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c79af49-b9ce-4d56-b3e9-6a6db0075e4a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.948348 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c79af49-b9ce-4d56-b3e9-6a6db0075e4a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.948811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c79af49-b9ce-4d56-b3e9-6a6db0075e4a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.949285 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c79af49-b9ce-4d56-b3e9-6a6db0075e4a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:59.089663 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6c79af49-b9ce-4d56-b3e9-6a6db0075e4a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:59.098011 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6c79af49-b9ce-4d56-b3e9-6a6db0075e4a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1681 microversion: 2.1 time: 0.163843 Sep 10 11:48:59.098619 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2337/6996] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:58 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:23.296315 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f8634a91-5d26-487c-b63e-c15a521a8c0e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:23.298564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f8634a91-5d26-487c-b63e-c15a521a8c0e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:23.301855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=14 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:23.302715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=40 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:23.309094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8634a91-5d26-487c-b63e-c15a521a8c0e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:23.309618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8634a91-5d26-487c-b63e-c15a521a8c0e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:23.310083 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8634a91-5d26-487c-b63e-c15a521a8c0e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:23.310801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8634a91-5d26-487c-b63e-c15a521a8c0e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:23.311277 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8634a91-5d26-487c-b63e-c15a521a8c0e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:23.311761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f8634a91-5d26-487c-b63e-c15a521a8c0e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:23.365964 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f8634a91-5d26-487c-b63e-c15a521a8c0e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465/action" status: 200 len: 62953 microversion: 2.1 time: 0.073523 Sep 10 11:49:23.366673 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4660/6997] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:49:23 2022] POST /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465/action => generated 62953 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:49:30.358689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8b9ed22e-8d14-4191-8cf2-d270b8d8a8d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:30.359253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8b9ed22e-8d14-4191-8cf2-d270b8d8a8d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:30.360779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-cf4cc488-8121-400c-ac9c-c48eec676184 req-ad41d477-6bef-416a-b52f-149cf75f41bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99dbed2e-1efd-45af-a454-760555c40465", "tag": "774e2f9b-c115-4819-bcff-9549f283e710"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:30.364033 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=16 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:30.364671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:30.369885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9ed22e-8d14-4191-8cf2-d270b8d8a8d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.370376 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9ed22e-8d14-4191-8cf2-d270b8d8a8d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.371042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9ed22e-8d14-4191-8cf2-d270b8d8a8d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.371818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9ed22e-8d14-4191-8cf2-d270b8d8a8d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.372411 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9ed22e-8d14-4191-8cf2-d270b8d8a8d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.372840 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8b9ed22e-8d14-4191-8cf2-d270b8d8a8d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.373833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf4cc488-8121-400c-ac9c-c48eec676184 req-ad41d477-6bef-416a-b52f-149cf75f41bc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.374390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf4cc488-8121-400c-ac9c-c48eec676184 req-ad41d477-6bef-416a-b52f-149cf75f41bc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.375180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf4cc488-8121-400c-ac9c-c48eec676184 req-ad41d477-6bef-416a-b52f-149cf75f41bc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.389669 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-cf4cc488-8121-400c-ac9c-c48eec676184 req-ad41d477-6bef-416a-b52f-149cf75f41bc service nova] Creating event network-changed:774e2f9b-c115-4819-bcff-9549f283e710 for instance 99dbed2e-1efd-45af-a454-760555c40465 on n-h1-856894-1 Sep 10 11:49:30.394961 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-cf4cc488-8121-400c-ac9c-c48eec676184 req-ad41d477-6bef-416a-b52f-149cf75f41bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038199 Sep 10 11:49:30.395867 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4661/6998] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:49:30.402233 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8b9ed22e-8d14-4191-8cf2-d270b8d8a8d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:30.491735 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8b9ed22e-8d14-4191-8cf2-d270b8d8a8d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 204 len: 0 microversion: 2.1 time: 0.137028 Sep 10 11:49:30.497165 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2338/6999] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:30 2022] DELETE /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:30.502730 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0c1c5a73-9fe1-4d7c-b8b3-9dccc20a7be7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:30.503681 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0c1c5a73-9fe1-4d7c-b8b3-9dccc20a7be7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:30.511213 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c1c5a73-9fe1-4d7c-b8b3-9dccc20a7be7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.511725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c1c5a73-9fe1-4d7c-b8b3-9dccc20a7be7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.512183 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c1c5a73-9fe1-4d7c-b8b3-9dccc20a7be7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.512933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c1c5a73-9fe1-4d7c-b8b3-9dccc20a7be7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.513437 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c1c5a73-9fe1-4d7c-b8b3-9dccc20a7be7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.513884 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0c1c5a73-9fe1-4d7c-b8b3-9dccc20a7be7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.668715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0c1c5a73-9fe1-4d7c-b8b3-9dccc20a7be7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:30.678075 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0c1c5a73-9fe1-4d7c-b8b3-9dccc20a7be7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1687 microversion: 2.1 time: 0.180005 Sep 10 11:49:30.678858 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4662/7000] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:30 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:31.703268 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-025c4fe9-2bac-45dc-8be2-98f656dda894 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:31.703973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-025c4fe9-2bac-45dc-8be2-98f656dda894 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:31.710952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-025c4fe9-2bac-45dc-8be2-98f656dda894 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:31.711537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-025c4fe9-2bac-45dc-8be2-98f656dda894 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:31.711984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-025c4fe9-2bac-45dc-8be2-98f656dda894 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:31.712671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-025c4fe9-2bac-45dc-8be2-98f656dda894 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:31.713200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-025c4fe9-2bac-45dc-8be2-98f656dda894 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:31.713625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-025c4fe9-2bac-45dc-8be2-98f656dda894 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:31.879871 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-025c4fe9-2bac-45dc-8be2-98f656dda894 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:31.887748 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-025c4fe9-2bac-45dc-8be2-98f656dda894 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 200 len: 1687 microversion: 2.1 time: 0.188792 Sep 10 11:49:31.888606 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2339/7001] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:31 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:32.398725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-511c1acd-3b27-4c6f-9e9b-d548a6d8def4 req-496c93d5-e0b0-4b8b-a31b-94c2666539a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99dbed2e-1efd-45af-a454-760555c40465", "name": "network-vif-deleted", "tag": "774e2f9b-c115-4819-bcff-9549f283e710"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:32.409870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-511c1acd-3b27-4c6f-9e9b-d548a6d8def4 req-496c93d5-e0b0-4b8b-a31b-94c2666539a6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:32.410399 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-511c1acd-3b27-4c6f-9e9b-d548a6d8def4 req-496c93d5-e0b0-4b8b-a31b-94c2666539a6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:32.410844 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-511c1acd-3b27-4c6f-9e9b-d548a6d8def4 req-496c93d5-e0b0-4b8b-a31b-94c2666539a6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:32.421475 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-511c1acd-3b27-4c6f-9e9b-d548a6d8def4 req-496c93d5-e0b0-4b8b-a31b-94c2666539a6 service nova] Creating event network-vif-deleted:774e2f9b-c115-4819-bcff-9549f283e710 for instance 99dbed2e-1efd-45af-a454-760555c40465 on n-h1-856894-1 Sep 10 11:49:32.426419 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-511c1acd-3b27-4c6f-9e9b-d548a6d8def4 req-496c93d5-e0b0-4b8b-a31b-94c2666539a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032110 Sep 10 11:49:32.427021 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4663/7002] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:32.914025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:32.914581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 99dbed2e-1efd-45af-a454-760555c40465] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:32.921393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:32.921885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:32.922321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:32.923002 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:32.923548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:32.923981 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:32.938019 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] HTTP exception thrown: Instance 99dbed2e-1efd-45af-a454-760555c40465 could not be found. Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Request method failure captured: Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 HTTP/1.1 Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHhRyltnowTOB2igHay_0zljRnORjtCrqWTIMoFWA849Bp0w1HZKNF3ywind08ohEU6rRGOqTJ5W4r6nubhdqDgB4vAjNmUKmMdSQK12yO6639vPMn2vRvSSntI0B-Oxm3ks9hZX6oTyyXyRHnzbHZoORrizqS1OtvpDVt0FLCF7W0A Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: 9972c52da6144ebcaa81a0fde66ca255 Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9972c52da6144ebcaa81a0fde66ca255", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: 9972c52da6144ebcaa81a0fde66ca255 Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestNetworkAdvancedServerOps-344189195-project Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: e085bc75f0c54299a24a5252d0a26dc0 Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestNetworkAdvancedServerOps-344189195-project Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 99dbed2e-1efd-45af-a454-760555c40465 could not be found. Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '99dbed2e-1efd-45af-a454-760555c40465'} Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99dbed2e-1efd-45af-a454-760555c40465 could not be found. Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99dbed2e-1efd-45af-a454-760555c40465 could not be found. Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:49:32.939646 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99dbed2e-1efd-45af-a454-760555c40465 could not be found. Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Returning 404 to user: Instance 99dbed2e-1efd-45af-a454-760555c40465 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-16b3c3a7-d3b7-44b5-8735-6e7e50acd1d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465" status: 404 len: 111 microversion: 2.1 time: 0.031671 Sep 10 11:49:32.944576 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2340/7003] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:32 2022] GET /compute/v2.1/servers/99dbed2e-1efd-45af-a454-760555c40465 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:36.180278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fb7c4fed-166a-4efa-8430-448887a294d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '.version_select at 0x7efcae665310>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:36.206992 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fb7c4fed-166a-4efa-8430-448887a294d7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1063940620" status: 202 len: 0 microversion: 2.1 time: 0.031532 Sep 10 11:49:36.207647 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4664/7004] 10.222.0.20 () {58 vars in 1284 bytes} [Sat Sep 10 11:49:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1063940620 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:49:36.231913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9a3d20b3-f803-45ec-84dd-4b3651b7ca11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'create', calling method: .version_select at 0x7efcae9beca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1665783150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzT6MCDVvO+NDzmiarAd33zPMHry/FY2kk43TYTjFIjcE1NvPL2erfXgX975dtlrEHACnfG7zWvSWGbHqH2DMdirWi/6ovLFHQGyqRkIT5ie+fvgZrKb2StKYU5VL+W8A=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:36.250906 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-9a3d20b3-f803-45ec-84dd-4b3651b7ca11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:49:36.256619 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-9a3d20b3-f803-45ec-84dd-4b3651b7ca11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for user e085bc75f0c54299a24a5252d0a26dc0 and project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:49:36.281139 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9a3d20b3-f803-45ec-84dd-4b3651b7ca11 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053432 Sep 10 11:49:36.281750 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2341/7005] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:49:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:41.796718 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-194216536", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "networks": [{"uuid": "39fab8b8-4f4b-4f9b-935a-5b809b86a452"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1665783150", "security_groups": [{"name": "tempest-secgroup-smoke-558874963"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:41.929231 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] validate_networks() for [('39fab8b8-4f4b-4f9b-935a-5b809b86a452', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:49:42.365109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:49:42.365961 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:49:42.366798 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:49:42.367321 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:49:42.367755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:49:42.376984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.377507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.378138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.379022 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.379487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.380306 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.403388 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:49:42.410887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Getting quotas for user e085bc75f0c54299a24a5252d0a26dc0 and project 9972c52da6144ebcaa81a0fde66ca255. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:49:42.424803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:49:42.431753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:49:42.482622 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7fa99c85-8795-4ab3-a3f1-5059cc62ae17 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691391 Sep 10 11:49:42.484084 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4665/7006] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:49:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:49:42.495953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-94e5c986-0712-4ca9-84e0-ab7c5f89e810 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:42.497335 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-94e5c986-0712-4ca9-84e0-ab7c5f89e810 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:42.612621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-94e5c986-0712-4ca9-84e0-ab7c5f89e810 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:42.620332 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-94e5c986-0712-4ca9-84e0-ab7c5f89e810 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1266 microversion: 2.1 time: 0.128720 Sep 10 11:49:42.620922 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2342/7007] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:42 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:43.644541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-36f692f6-1fbb-4a43-9af4-5647caade11a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:43.645110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-36f692f6-1fbb-4a43-9af4-5647caade11a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:43.651752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f692f6-1fbb-4a43-9af4-5647caade11a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:43.652581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f692f6-1fbb-4a43-9af4-5647caade11a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:43.653339 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f692f6-1fbb-4a43-9af4-5647caade11a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:43.654365 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f692f6-1fbb-4a43-9af4-5647caade11a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:43.655068 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f692f6-1fbb-4a43-9af4-5647caade11a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:43.655725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-36f692f6-1fbb-4a43-9af4-5647caade11a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:43.771524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-36f692f6-1fbb-4a43-9af4-5647caade11a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:43.786430 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-36f692f6-1fbb-4a43-9af4-5647caade11a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1326 microversion: 2.1 time: 0.147088 Sep 10 11:49:43.787032 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4666/7008] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:43 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:44.814158 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-998fed4a-1099-4066-99c5-2c513daa0922 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:44.815629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-998fed4a-1099-4066-99c5-2c513daa0922 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:44.818819 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:44.827748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-998fed4a-1099-4066-99c5-2c513daa0922 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:44.828730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-998fed4a-1099-4066-99c5-2c513daa0922 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:44.828730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-998fed4a-1099-4066-99c5-2c513daa0922 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:44.829487 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-998fed4a-1099-4066-99c5-2c513daa0922 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:44.829952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-998fed4a-1099-4066-99c5-2c513daa0922 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:44.830394 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-998fed4a-1099-4066-99c5-2c513daa0922 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:45.086114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-998fed4a-1099-4066-99c5-2c513daa0922 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:45.093887 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-998fed4a-1099-4066-99c5-2c513daa0922 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1391 microversion: 2.1 time: 0.283893 Sep 10 11:49:45.094480 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2343/7009] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:44 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1391 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:45.336996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-0e82ee51-2850-4520-a100-30a3d81c57b5 req-ff6f2408-4724-43b1-89b4-6350ba3964ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662116c5-23e1-4ee7-aa4e-6f5a82c19580", "tag": "e265beb4-085a-477e-a6b4-de0da0e93fe1"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:45.352833 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0e82ee51-2850-4520-a100-30a3d81c57b5 req-ff6f2408-4724-43b1-89b4-6350ba3964ed service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:45.353525 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0e82ee51-2850-4520-a100-30a3d81c57b5 req-ff6f2408-4724-43b1-89b4-6350ba3964ed service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:45.366565 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-0e82ee51-2850-4520-a100-30a3d81c57b5 req-ff6f2408-4724-43b1-89b4-6350ba3964ed service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:45.378921 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-0e82ee51-2850-4520-a100-30a3d81c57b5 req-ff6f2408-4724-43b1-89b4-6350ba3964ed service nova] Creating event network-changed:e265beb4-085a-477e-a6b4-de0da0e93fe1 for instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 on n-h2-856894-1 Sep 10 11:49:45.385508 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-0e82ee51-2850-4520-a100-30a3d81c57b5 req-ff6f2408-4724-43b1-89b4-6350ba3964ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053919 Sep 10 11:49:45.386694 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4667/7010] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:46.117613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-015aa560-1215-4fbd-91b8-a65963332653 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:46.118230 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-015aa560-1215-4fbd-91b8-a65963332653 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:46.125260 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-015aa560-1215-4fbd-91b8-a65963332653 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:46.125751 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-015aa560-1215-4fbd-91b8-a65963332653 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:46.126224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-015aa560-1215-4fbd-91b8-a65963332653 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:46.126946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-015aa560-1215-4fbd-91b8-a65963332653 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:46.127405 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-015aa560-1215-4fbd-91b8-a65963332653 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:46.127834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-015aa560-1215-4fbd-91b8-a65963332653 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:46.264307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-015aa560-1215-4fbd-91b8-a65963332653 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:46.272075 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-015aa560-1215-4fbd-91b8-a65963332653 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1391 microversion: 2.1 time: 0.158941 Sep 10 11:49:46.272684 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2344/7011] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:46 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:47.294897 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-90a848e9-b88a-4ccc-bf4f-189e4fb991cc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:47.295622 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-90a848e9-b88a-4ccc-bf4f-189e4fb991cc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:47.303371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90a848e9-b88a-4ccc-bf4f-189e4fb991cc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:47.304044 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90a848e9-b88a-4ccc-bf4f-189e4fb991cc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:47.304715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90a848e9-b88a-4ccc-bf4f-189e4fb991cc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:47.305465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90a848e9-b88a-4ccc-bf4f-189e4fb991cc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:47.306101 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90a848e9-b88a-4ccc-bf4f-189e4fb991cc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:47.306552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-90a848e9-b88a-4ccc-bf4f-189e4fb991cc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:47.539043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-90a848e9-b88a-4ccc-bf4f-189e4fb991cc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:47.546964 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-90a848e9-b88a-4ccc-bf4f-189e4fb991cc tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1391 microversion: 2.1 time: 0.256421 Sep 10 11:49:47.547594 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4668/7012] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:47 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:48.570032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ca89875e-5be0-4088-ba9e-8d16591b313b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.570717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ca89875e-5be0-4088-ba9e-8d16591b313b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:48.577582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca89875e-5be0-4088-ba9e-8d16591b313b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.578080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca89875e-5be0-4088-ba9e-8d16591b313b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.578556 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca89875e-5be0-4088-ba9e-8d16591b313b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.579252 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca89875e-5be0-4088-ba9e-8d16591b313b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.579715 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca89875e-5be0-4088-ba9e-8d16591b313b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.580146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ca89875e-5be0-4088-ba9e-8d16591b313b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.714307 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ca89875e-5be0-4088-ba9e-8d16591b313b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:48.722052 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ca89875e-5be0-4088-ba9e-8d16591b313b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1391 microversion: 2.1 time: 0.155956 Sep 10 11:49:48.722633 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2345/7013] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:48 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:49.744916 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-82650146-8a16-4794-ab51-204039803486 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:49.745592 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-82650146-8a16-4794-ab51-204039803486 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:49.752516 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82650146-8a16-4794-ab51-204039803486 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:49.753014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82650146-8a16-4794-ab51-204039803486 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:49.753540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82650146-8a16-4794-ab51-204039803486 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:49.754234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82650146-8a16-4794-ab51-204039803486 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:49.754704 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82650146-8a16-4794-ab51-204039803486 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:49.755139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-82650146-8a16-4794-ab51-204039803486 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:49.888529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-82650146-8a16-4794-ab51-204039803486 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:49.898423 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-82650146-8a16-4794-ab51-204039803486 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1391 microversion: 2.1 time: 0.157380 Sep 10 11:49:49.899232 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4669/7014] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:49 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:50.921959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-35af16d0-779f-4d48-99f8-d7bd0aa4283b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:50.922571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-35af16d0-779f-4d48-99f8-d7bd0aa4283b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:50.929717 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35af16d0-779f-4d48-99f8-d7bd0aa4283b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:50.930201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35af16d0-779f-4d48-99f8-d7bd0aa4283b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:50.930637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35af16d0-779f-4d48-99f8-d7bd0aa4283b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:50.931323 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35af16d0-779f-4d48-99f8-d7bd0aa4283b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:50.931776 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35af16d0-779f-4d48-99f8-d7bd0aa4283b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:50.932201 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-35af16d0-779f-4d48-99f8-d7bd0aa4283b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:51.061236 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-35af16d0-779f-4d48-99f8-d7bd0aa4283b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:51.068946 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-35af16d0-779f-4d48-99f8-d7bd0aa4283b tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1391 microversion: 2.1 time: 0.151014 Sep 10 11:49:51.069545 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2346/7015] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:50 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:51.479244 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a346dcb5-a1ec-49b8-a15e-c81e6cfc2a8a req-378a3910-fe11-4c97-98a4-a6a67797d989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662116c5-23e1-4ee7-aa4e-6f5a82c19580", "name": "network-vif-plugged", "status": "completed", "tag": "e265beb4-085a-477e-a6b4-de0da0e93fe1"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:51.489810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a346dcb5-a1ec-49b8-a15e-c81e6cfc2a8a req-378a3910-fe11-4c97-98a4-a6a67797d989 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:51.490317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a346dcb5-a1ec-49b8-a15e-c81e6cfc2a8a req-378a3910-fe11-4c97-98a4-a6a67797d989 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:51.490750 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a346dcb5-a1ec-49b8-a15e-c81e6cfc2a8a req-378a3910-fe11-4c97-98a4-a6a67797d989 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:51.502093 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a346dcb5-a1ec-49b8-a15e-c81e6cfc2a8a req-378a3910-fe11-4c97-98a4-a6a67797d989 service nova] Creating event network-vif-plugged:e265beb4-085a-477e-a6b4-de0da0e93fe1 for instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 on n-h2-856894-1 Sep 10 11:49:51.507011 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a346dcb5-a1ec-49b8-a15e-c81e6cfc2a8a req-378a3910-fe11-4c97-98a4-a6a67797d989 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031643 Sep 10 11:49:51.507780 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4670/7016] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:52.091417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d2dd8e7b-7fdc-477b-a34c-78b203e3a1f6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:52.091960 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d2dd8e7b-7fdc-477b-a34c-78b203e3a1f6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:52.098996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2dd8e7b-7fdc-477b-a34c-78b203e3a1f6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:52.099489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2dd8e7b-7fdc-477b-a34c-78b203e3a1f6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:52.099934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2dd8e7b-7fdc-477b-a34c-78b203e3a1f6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:52.100633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2dd8e7b-7fdc-477b-a34c-78b203e3a1f6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:52.101147 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2dd8e7b-7fdc-477b-a34c-78b203e3a1f6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:52.101576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d2dd8e7b-7fdc-477b-a34c-78b203e3a1f6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:52.229485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d2dd8e7b-7fdc-477b-a34c-78b203e3a1f6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:52.237108 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d2dd8e7b-7fdc-477b-a34c-78b203e3a1f6 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1391 microversion: 2.1 time: 0.149780 Sep 10 11:49:52.238179 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2347/7017] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:52 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:53.257878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:53.258675 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:53.263595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8f2cd50f-3bd6-4b48-81dc-ea5e92eb132d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:53.264317 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8f2cd50f-3bd6-4b48-81dc-ea5e92eb132d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:53.272571 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2cd50f-3bd6-4b48-81dc-ea5e92eb132d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:53.273102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2cd50f-3bd6-4b48-81dc-ea5e92eb132d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:53.273573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2cd50f-3bd6-4b48-81dc-ea5e92eb132d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:53.274301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2cd50f-3bd6-4b48-81dc-ea5e92eb132d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:53.274751 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2cd50f-3bd6-4b48-81dc-ea5e92eb132d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:53.275196 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8f2cd50f-3bd6-4b48-81dc-ea5e92eb132d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:53.408542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8f2cd50f-3bd6-4b48-81dc-ea5e92eb132d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:53.410819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=43 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:53.417619 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8f2cd50f-3bd6-4b48-81dc-ea5e92eb132d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1563 microversion: 2.1 time: 0.160740 Sep 10 11:49:53.418206 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4671/7018] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:53 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:53.440623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3c56df90-0e38-40cc-91e0-94106c7d1c27 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:53.441775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3c56df90-0e38-40cc-91e0-94106c7d1c27 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:53.443716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:53.449845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c56df90-0e38-40cc-91e0-94106c7d1c27 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:53.450290 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c56df90-0e38-40cc-91e0-94106c7d1c27 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:53.450731 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c56df90-0e38-40cc-91e0-94106c7d1c27 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:53.451429 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c56df90-0e38-40cc-91e0-94106c7d1c27 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:53.451886 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c56df90-0e38-40cc-91e0-94106c7d1c27 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:53.452314 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3c56df90-0e38-40cc-91e0-94106c7d1c27 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:53.582783 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3c56df90-0e38-40cc-91e0-94106c7d1c27 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:53.590540 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3c56df90-0e38-40cc-91e0-94106c7d1c27 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1563 microversion: 2.1 time: 0.153901 Sep 10 11:49:53.591123 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2348/7019] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:53 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:55.139435 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b07f793c-4694-419b-a6b2-0cd846d78d4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:55.140066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b07f793c-4694-419b-a6b2-0cd846d78d4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:55.142428 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-de7d2f04-04a8-4941-b7ae-e13698041c50 req-a312b04c-d254-4944-b421-bcb8e4a67b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662116c5-23e1-4ee7-aa4e-6f5a82c19580", "tag": "e265beb4-085a-477e-a6b4-de0da0e93fe1"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:55.143072 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:55.150155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b07f793c-4694-419b-a6b2-0cd846d78d4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.150671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b07f793c-4694-419b-a6b2-0cd846d78d4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.151123 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b07f793c-4694-419b-a6b2-0cd846d78d4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.151869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b07f793c-4694-419b-a6b2-0cd846d78d4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.152529 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b07f793c-4694-419b-a6b2-0cd846d78d4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.152973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b07f793c-4694-419b-a6b2-0cd846d78d4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.155243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-de7d2f04-04a8-4941-b7ae-e13698041c50 req-a312b04c-d254-4944-b421-bcb8e4a67b98 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.155813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-de7d2f04-04a8-4941-b7ae-e13698041c50 req-a312b04c-d254-4944-b421-bcb8e4a67b98 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.156326 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-de7d2f04-04a8-4941-b7ae-e13698041c50 req-a312b04c-d254-4944-b421-bcb8e4a67b98 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.170511 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-de7d2f04-04a8-4941-b7ae-e13698041c50 req-a312b04c-d254-4944-b421-bcb8e4a67b98 service nova] Creating event network-changed:e265beb4-085a-477e-a6b4-de0da0e93fe1 for instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 on n-h2-856894-1 Sep 10 11:49:55.175944 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-de7d2f04-04a8-4941-b7ae-e13698041c50 req-a312b04c-d254-4944-b421-bcb8e4a67b98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038442 Sep 10 11:49:55.176671 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2349/7020] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:49:55.388258 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b07f793c-4694-419b-a6b2-0cd846d78d4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:55.396395 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b07f793c-4694-419b-a6b2-0cd846d78d4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1563 microversion: 2.1 time: 0.261487 Sep 10 11:49:55.397015 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4672/7021] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:55 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1563 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:18.676746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:18.677543 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=38 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:18.681690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e74e2819-700c-4c5e-95ef-cbb3831e2018 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:18.684232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e74e2819-700c-4c5e-95ef-cbb3831e2018 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:18.692598 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e74e2819-700c-4c5e-95ef-cbb3831e2018 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:18.693446 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e74e2819-700c-4c5e-95ef-cbb3831e2018 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:18.693657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e74e2819-700c-4c5e-95ef-cbb3831e2018 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:18.695014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e74e2819-700c-4c5e-95ef-cbb3831e2018 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:18.695014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e74e2819-700c-4c5e-95ef-cbb3831e2018 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:18.695222 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e74e2819-700c-4c5e-95ef-cbb3831e2018 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:18.751542 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e74e2819-700c-4c5e-95ef-cbb3831e2018 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580/action" status: 200 len: 24567 microversion: 2.1 time: 0.076709 Sep 10 11:50:18.752186 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2350/7022] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:50:18 2022] POST /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580/action => generated 24567 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:50:29.710341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a36052f-c6c0-4192-b0fe-42b740fa6c57 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:29.710924 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a36052f-c6c0-4192-b0fe-42b740fa6c57 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:29.713268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:29.713957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=7 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:29.719902 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a36052f-c6c0-4192-b0fe-42b740fa6c57 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:29.720402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a36052f-c6c0-4192-b0fe-42b740fa6c57 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:29.720964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a36052f-c6c0-4192-b0fe-42b740fa6c57 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:29.721581 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a36052f-c6c0-4192-b0fe-42b740fa6c57 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:29.722056 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a36052f-c6c0-4192-b0fe-42b740fa6c57 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:29.722499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a36052f-c6c0-4192-b0fe-42b740fa6c57 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:29.745567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-5a36052f-c6c0-4192-b0fe-42b740fa6c57 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lazy-loading 'flavor' on Instance uuid 662116c5-23e1-4ee7-aa4e-6f5a82c19580 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:50:29.809932 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a36052f-c6c0-4192-b0fe-42b740fa6c57 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580/action" status: 202 len: 0 microversion: 2.1 time: 0.103369 Sep 10 11:50:29.810581 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4673/7023] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:50:29 2022] POST /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:50:29.819996 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a85806f9-abb6-4c9d-af1d-5c2d001e2e9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:29.820703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a85806f9-abb6-4c9d-af1d-5c2d001e2e9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:29.823672 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:50:29.823817 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 11:50:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 (ip 10.222.0.20) !!! Sep 10 11:50:29.824830 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:29.825775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=4 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:29.834118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a85806f9-abb6-4c9d-af1d-5c2d001e2e9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:29.834607 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a85806f9-abb6-4c9d-af1d-5c2d001e2e9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:29.835047 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a85806f9-abb6-4c9d-af1d-5c2d001e2e9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:29.835775 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a85806f9-abb6-4c9d-af1d-5c2d001e2e9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:29.836234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a85806f9-abb6-4c9d-af1d-5c2d001e2e9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:29.836660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a85806f9-abb6-4c9d-af1d-5c2d001e2e9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:29.975081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a85806f9-abb6-4c9d-af1d-5c2d001e2e9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:29.982883 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a85806f9-abb6-4c9d-af1d-5c2d001e2e9a tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1690 microversion: 2.1 time: 0.167753 Sep 10 11:50:29.983458 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2351/7024] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:29 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:31.010005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-20367acc-b20d-4528-ad14-00baf27da5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:31.010724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-20367acc-b20d-4528-ad14-00baf27da5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:31.016927 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20367acc-b20d-4528-ad14-00baf27da5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.017460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20367acc-b20d-4528-ad14-00baf27da5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.017915 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20367acc-b20d-4528-ad14-00baf27da5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.018614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20367acc-b20d-4528-ad14-00baf27da5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.019082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20367acc-b20d-4528-ad14-00baf27da5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.019522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-20367acc-b20d-4528-ad14-00baf27da5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.152797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-20367acc-b20d-4528-ad14-00baf27da5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:31.160626 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-20367acc-b20d-4528-ad14-00baf27da5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1673 microversion: 2.1 time: 0.156516 Sep 10 11:50:31.161223 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4674/7025] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:31 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:32.255344 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0820bc0b-e7ed-4ae9-bbd9-d43a7de7d04d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:32.257576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0820bc0b-e7ed-4ae9-bbd9-d43a7de7d04d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:32.264349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0820bc0b-e7ed-4ae9-bbd9-d43a7de7d04d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.264828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0820bc0b-e7ed-4ae9-bbd9-d43a7de7d04d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.265300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0820bc0b-e7ed-4ae9-bbd9-d43a7de7d04d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.265982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0820bc0b-e7ed-4ae9-bbd9-d43a7de7d04d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.266432 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0820bc0b-e7ed-4ae9-bbd9-d43a7de7d04d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.266853 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0820bc0b-e7ed-4ae9-bbd9-d43a7de7d04d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.330514 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0820bc0b-e7ed-4ae9-bbd9-d43a7de7d04d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580/action" status: 200 len: 37969 microversion: 2.1 time: 0.079474 Sep 10 11:50:32.331800 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2352/7026] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:50:32 2022] POST /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580/action => generated 37969 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:50:32.343522 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-954f8c6a-a5a3-4c08-b143-228473cc9f07 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:32.344113 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-954f8c6a-a5a3-4c08-b143-228473cc9f07 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:32.350993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954f8c6a-a5a3-4c08-b143-228473cc9f07 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.351495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954f8c6a-a5a3-4c08-b143-228473cc9f07 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.351951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954f8c6a-a5a3-4c08-b143-228473cc9f07 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.352653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954f8c6a-a5a3-4c08-b143-228473cc9f07 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.353165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954f8c6a-a5a3-4c08-b143-228473cc9f07 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.353610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-954f8c6a-a5a3-4c08-b143-228473cc9f07 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.417962 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-954f8c6a-a5a3-4c08-b143-228473cc9f07 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580/action" status: 202 len: 0 microversion: 2.1 time: 0.078237 Sep 10 11:50:32.418810 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4675/7027] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:50:32 2022] POST /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:50:32.428032 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9a28f47-8e01-4221-b84c-26bfb9201e95 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:32.428748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9a28f47-8e01-4221-b84c-26bfb9201e95 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:32.436007 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a28f47-8e01-4221-b84c-26bfb9201e95 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.436492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a28f47-8e01-4221-b84c-26bfb9201e95 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.436927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a28f47-8e01-4221-b84c-26bfb9201e95 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.437636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a28f47-8e01-4221-b84c-26bfb9201e95 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.438089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a28f47-8e01-4221-b84c-26bfb9201e95 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.438509 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9a28f47-8e01-4221-b84c-26bfb9201e95 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.662745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9a28f47-8e01-4221-b84c-26bfb9201e95 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:32.670724 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9a28f47-8e01-4221-b84c-26bfb9201e95 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1679 microversion: 2.1 time: 0.247473 Sep 10 11:50:32.671312 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2353/7028] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:32 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:33.697269 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7933dc08-2e22-444d-b94a-cf9830986811 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:33.697993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7933dc08-2e22-444d-b94a-cf9830986811 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:33.704307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7933dc08-2e22-444d-b94a-cf9830986811 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:33.704810 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7933dc08-2e22-444d-b94a-cf9830986811 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:33.705319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7933dc08-2e22-444d-b94a-cf9830986811 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:33.706685 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7933dc08-2e22-444d-b94a-cf9830986811 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:33.707165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7933dc08-2e22-444d-b94a-cf9830986811 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:33.707608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7933dc08-2e22-444d-b94a-cf9830986811 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:33.840760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7933dc08-2e22-444d-b94a-cf9830986811 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:33.848540 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7933dc08-2e22-444d-b94a-cf9830986811 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1679 microversion: 2.1 time: 0.156672 Sep 10 11:50:33.849140 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4676/7029] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:33 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:50:34.871878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d4a1f39e-19ac-47f1-8205-52fbc7d8fc4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:34.872533 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d4a1f39e-19ac-47f1-8205-52fbc7d8fc4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:34.879766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4a1f39e-19ac-47f1-8205-52fbc7d8fc4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.880246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4a1f39e-19ac-47f1-8205-52fbc7d8fc4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.880681 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4a1f39e-19ac-47f1-8205-52fbc7d8fc4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.881399 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4a1f39e-19ac-47f1-8205-52fbc7d8fc4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.881852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4a1f39e-19ac-47f1-8205-52fbc7d8fc4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.882277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d4a1f39e-19ac-47f1-8205-52fbc7d8fc4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.011496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d4a1f39e-19ac-47f1-8205-52fbc7d8fc4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:35.019738 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d4a1f39e-19ac-47f1-8205-52fbc7d8fc4e tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1682 microversion: 2.1 time: 0.151830 Sep 10 11:50:35.020305 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2354/7030] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:34 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:35.116314 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb8e7853-4273-498c-a625-0cbccca6b333 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:35.118556 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb8e7853-4273-498c-a625-0cbccca6b333 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:35.125445 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb8e7853-4273-498c-a625-0cbccca6b333 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.125947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb8e7853-4273-498c-a625-0cbccca6b333 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.126428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb8e7853-4273-498c-a625-0cbccca6b333 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.127137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb8e7853-4273-498c-a625-0cbccca6b333 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.128139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb8e7853-4273-498c-a625-0cbccca6b333 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.128588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb8e7853-4273-498c-a625-0cbccca6b333 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.169312 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb8e7853-4273-498c-a625-0cbccca6b333 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "POST /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580/action" status: 200 len: 37969 microversion: 2.1 time: 0.056863 Sep 10 11:50:35.169956 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4677/7031] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:50:35 2022] POST /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580/action => generated 37969 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:50:36.141192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-05ea964d-e080-4dc8-add8-4ab071add5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:36.141697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-05ea964d-e080-4dc8-add8-4ab071add5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:36.143865 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-96c75c69-f60c-4b86-b4a8-993ff2229c04 req-ab03c9d6-f135-4e1e-81f8-d2652b25b17d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662116c5-23e1-4ee7-aa4e-6f5a82c19580", "tag": "e265beb4-085a-477e-a6b4-de0da0e93fe1"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:36.149202 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ea964d-e080-4dc8-add8-4ab071add5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.149915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ea964d-e080-4dc8-add8-4ab071add5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.150359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ea964d-e080-4dc8-add8-4ab071add5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.151071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ea964d-e080-4dc8-add8-4ab071add5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.151527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ea964d-e080-4dc8-add8-4ab071add5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.151959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-05ea964d-e080-4dc8-add8-4ab071add5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.155803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-96c75c69-f60c-4b86-b4a8-993ff2229c04 req-ab03c9d6-f135-4e1e-81f8-d2652b25b17d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.156539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-96c75c69-f60c-4b86-b4a8-993ff2229c04 req-ab03c9d6-f135-4e1e-81f8-d2652b25b17d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.157193 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-96c75c69-f60c-4b86-b4a8-993ff2229c04 req-ab03c9d6-f135-4e1e-81f8-d2652b25b17d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.170555 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-96c75c69-f60c-4b86-b4a8-993ff2229c04 req-ab03c9d6-f135-4e1e-81f8-d2652b25b17d service nova] Creating event network-changed:e265beb4-085a-477e-a6b4-de0da0e93fe1 for instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 on n-h2-856894-1 Sep 10 11:50:36.176408 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-96c75c69-f60c-4b86-b4a8-993ff2229c04 req-ab03c9d6-f135-4e1e-81f8-d2652b25b17d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036662 Sep 10 11:50:36.177024 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4678/7032] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:36.179739 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-05ea964d-e080-4dc8-add8-4ab071add5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:50:36.266968 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-05ea964d-e080-4dc8-add8-4ab071add5ee tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "DELETE /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 204 len: 0 microversion: 2.1 time: 0.129559 Sep 10 11:50:36.268453 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2355/7033] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:50:36 2022] DELETE /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:50:36.282605 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1534e24-5208-4256-87a9-ed9a039a4e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:36.284380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1534e24-5208-4256-87a9-ed9a039a4e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:36.292755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1534e24-5208-4256-87a9-ed9a039a4e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.293345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1534e24-5208-4256-87a9-ed9a039a4e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.293803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1534e24-5208-4256-87a9-ed9a039a4e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.294679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1534e24-5208-4256-87a9-ed9a039a4e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.295201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1534e24-5208-4256-87a9-ed9a039a4e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.295642 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1534e24-5208-4256-87a9-ed9a039a4e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.453059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b1534e24-5208-4256-87a9-ed9a039a4e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:36.461426 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1534e24-5208-4256-87a9-ed9a039a4e3d tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1688 microversion: 2.1 time: 0.186993 Sep 10 11:50:36.462016 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4679/7034] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:36 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:37.486224 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-2d747c2c-2479-47ae-bf22-dbb5a0b25933 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:37.487562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-2d747c2c-2479-47ae-bf22-dbb5a0b25933 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:37.494216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d747c2c-2479-47ae-bf22-dbb5a0b25933 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.494703 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d747c2c-2479-47ae-bf22-dbb5a0b25933 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.495148 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d747c2c-2479-47ae-bf22-dbb5a0b25933 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:37.495844 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d747c2c-2479-47ae-bf22-dbb5a0b25933 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.496297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d747c2c-2479-47ae-bf22-dbb5a0b25933 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.496722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-2d747c2c-2479-47ae-bf22-dbb5a0b25933 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:37.632130 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-2d747c2c-2479-47ae-bf22-dbb5a0b25933 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:37.639831 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-2d747c2c-2479-47ae-bf22-dbb5a0b25933 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1688 microversion: 2.1 time: 0.157951 Sep 10 11:50:37.640400 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2356/7035] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:37 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:38.529869 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-cf72e4e4-42bf-456e-b8f6-27c002dd29ab req-e6436ce7-fa0b-4a5d-88fb-8adfef0d9f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662116c5-23e1-4ee7-aa4e-6f5a82c19580", "name": "network-vif-deleted", "tag": "e265beb4-085a-477e-a6b4-de0da0e93fe1"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:38.542041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf72e4e4-42bf-456e-b8f6-27c002dd29ab req-e6436ce7-fa0b-4a5d-88fb-8adfef0d9f0f service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.542536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf72e4e4-42bf-456e-b8f6-27c002dd29ab req-e6436ce7-fa0b-4a5d-88fb-8adfef0d9f0f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.542976 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-cf72e4e4-42bf-456e-b8f6-27c002dd29ab req-e6436ce7-fa0b-4a5d-88fb-8adfef0d9f0f service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.555669 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-cf72e4e4-42bf-456e-b8f6-27c002dd29ab req-e6436ce7-fa0b-4a5d-88fb-8adfef0d9f0f service nova] Creating event network-vif-deleted:e265beb4-085a-477e-a6b4-de0da0e93fe1 for instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 on n-h2-856894-1 Sep 10 11:50:38.561018 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-cf72e4e4-42bf-456e-b8f6-27c002dd29ab req-e6436ce7-fa0b-4a5d-88fb-8adfef0d9f0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035159 Sep 10 11:50:38.561667 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4680/7036] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:38.665027 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:38.665662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:38.672868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.673379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.673825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.674562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.675011 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.675436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.709240 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.709726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.710160 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.710606 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lazy-loading 'fault' on Instance uuid 662116c5-23e1-4ee7-aa4e-6f5a82c19580 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:50:38.751257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085bc75f0c54299a24a5252d0a26dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9972c52da6144ebcaa81a0fde66ca255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:38.759282 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6ed67a0d-b2ef-4186-8b07-16843cbfea7c tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 200 len: 1356 microversion: 2.1 time: 0.098511 Sep 10 11:50:38.759858 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2357/7037] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:38 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:39.784995 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:39.785744 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] [instance: 662116c5-23e1-4ee7-aa4e-6f5a82c19580] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:39.791996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:39.792507 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:39.792959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:39.793687 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:39.794159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:39.794598 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:39.808610 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] HTTP exception thrown: Instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 could not be found. Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Request method failure captured: Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 HTTP/1.1 Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHhRyltnowTOB2igHay_0zljRnORjtCrqWTIMoFWA849Bp0w1HZKNF3ywind08ohEU6rRGOqTJ5W4r6nubhdqDgB4vAjNmUKmMdSQK12yO6639vPMn2vRvSSntI0B-Oxm3ks9hZX6oTyyXyRHnzbHZoORrizqS1OtvpDVt0FLCF7W0A Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 9972c52da6144ebcaa81a0fde66ca255 Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9972c52da6144ebcaa81a0fde66ca255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9972c52da6144ebcaa81a0fde66ca255", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 9972c52da6144ebcaa81a0fde66ca255 Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-344189195 Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestNetworkAdvancedServerOps-344189195-project Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: e085bc75f0c54299a24a5252d0a26dc0 Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestNetworkAdvancedServerOps-344189195-project Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 could not be found. Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '662116c5-23e1-4ee7-aa4e-6f5a82c19580'} Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 could not be found. Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 could not be found. Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.810252 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 could not be found. Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Returning 404 to user: Instance 662116c5-23e1-4ee7-aa4e-6f5a82c19580 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a935c820-2864-418d-b118-56c180236697 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580" status: 404 len: 111 microversion: 2.1 time: 0.032490 Sep 10 11:50:39.815255 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4681/7038] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:39 2022] GET /compute/v2.1/servers/662116c5-23e1-4ee7-aa4e-6f5a82c19580 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:50:42.789863 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-936920f2-6ec3-4531-8f98-63727c0102a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] Calling method '.version_select at 0x7efcaec57b80>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:42.812958 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-936920f2-6ec3-4531-8f98-63727c0102a7 tempest-TestNetworkAdvancedServerOps-344189195 tempest-TestNetworkAdvancedServerOps-344189195-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1665783150" status: 202 len: 0 microversion: 2.1 time: 0.026173 Sep 10 11:50:42.818511 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2358/7039] 10.222.0.20 () {58 vars in 1284 bytes} [Sat Sep 10 11:50:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1665783150 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:50:53.777831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=18 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:53.778610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:53.990218 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d4adc7cd-73b6-40ce-abb3-671df0be2b6b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Action: 'create', calling method: .version_select at 0x7efcad8a2310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1136249330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsokTWtzvzKjYSUGqoILOTDbcWpPOu/LEfa93d1RIRG0fZ59TCJDGu5Vi4yeo0jTZFfjHk309XyW2QNwbO6zy7TIP0tYIg8NduBa3ZMuAwzFh0KirnzdM+PkW033iJMxQ=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:54.006860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d4adc7cd-73b6-40ce-abb3-671df0be2b6b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Getting quotas for project c660f1f8d71a46d9bcb9661f56b2a88f. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:50:54.012497 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-d4adc7cd-73b6-40ce-abb3-671df0be2b6b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Getting quotas for user 9e981f02179043da99a961c716ccc1c5 and project c660f1f8d71a46d9bcb9661f56b2a88f. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:50:54.044237 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d4adc7cd-73b6-40ce-abb3-671df0be2b6b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.274212 Sep 10 11:50:54.045024 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4682/7040] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:50:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:55.166281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:55.167165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:55.171322 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-927370257", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1136249330", "security_groups": [{"name": "tempest-secgroup-smoke-1167911799"}], "networks": [{"uuid": "384067c8-8eb6-4d31-8763-e36ef7f06b9e"}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:55.278833 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] validate_networks() for [('384067c8-8eb6-4d31-8763-e36ef7f06b9e', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:50:55.801055 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:50:55.801452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:50:55.801934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:50:55.802583 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:50:55.803005 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:50:55.812604 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:55.813126 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:55.813704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:55.814491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:55.814953 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:55.815388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:55.833475 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Getting quotas for project c660f1f8d71a46d9bcb9661f56b2a88f. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:50:55.839244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Getting quotas for user 9e981f02179043da99a961c716ccc1c5 and project c660f1f8d71a46d9bcb9661f56b2a88f. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:50:55.854732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:50:55.857084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:50:55.908088 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-49bb306b-f8c0-4fa3-b711-6d1be3eadc79 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742902 Sep 10 11:50:55.909099 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2359/7041] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:50:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:50:55.920510 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-890ee5b2-c319-434a-b4e6-37171e549186 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:55.921318 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-890ee5b2-c319-434a-b4e6-37171e549186 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:55.983840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-890ee5b2-c319-434a-b4e6-37171e549186 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:55.991332 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-890ee5b2-c319-434a-b4e6-37171e549186 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1246 microversion: 2.1 time: 0.074938 Sep 10 11:50:55.992019 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4683/7042] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:55 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:57.016505 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-775ba0c2-71cb-479b-bacc-e3157a3afbc1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:57.017401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-775ba0c2-71cb-479b-bacc-e3157a3afbc1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:57.023719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-775ba0c2-71cb-479b-bacc-e3157a3afbc1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:57.024216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-775ba0c2-71cb-479b-bacc-e3157a3afbc1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:57.024647 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-775ba0c2-71cb-479b-bacc-e3157a3afbc1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:57.025363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-775ba0c2-71cb-479b-bacc-e3157a3afbc1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:57.025816 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-775ba0c2-71cb-479b-bacc-e3157a3afbc1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:57.026359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-775ba0c2-71cb-479b-bacc-e3157a3afbc1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:57.100114 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-775ba0c2-71cb-479b-bacc-e3157a3afbc1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:57.109293 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-775ba0c2-71cb-479b-bacc-e3157a3afbc1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1306 microversion: 2.1 time: 0.098681 Sep 10 11:50:57.110213 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2360/7043] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:57 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:58.133870 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d7604de0-86fd-4d21-8d77-2acec0880ac2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:58.135274 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d7604de0-86fd-4d21-8d77-2acec0880ac2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:58.142982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7604de0-86fd-4d21-8d77-2acec0880ac2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:58.143483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7604de0-86fd-4d21-8d77-2acec0880ac2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:58.143944 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7604de0-86fd-4d21-8d77-2acec0880ac2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:58.144825 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7604de0-86fd-4d21-8d77-2acec0880ac2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:58.145342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7604de0-86fd-4d21-8d77-2acec0880ac2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:58.145794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d7604de0-86fd-4d21-8d77-2acec0880ac2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:58.295241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d7604de0-86fd-4d21-8d77-2acec0880ac2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:58.304600 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d7604de0-86fd-4d21-8d77-2acec0880ac2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1372 microversion: 2.1 time: 0.174363 Sep 10 11:50:58.304720 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4684/7044] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:58 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:50:58.599452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-527cb8ae-9a5b-4afe-b72f-e660855e5c93 req-2300773f-c685-4e97-a0e6-a24499c8ae97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db8af93-7dce-45dd-b8f8-3cec86951ea7", "tag": "72df7298-a6f4-498f-9bd8-dc7b5db74f9a"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:58.611710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-527cb8ae-9a5b-4afe-b72f-e660855e5c93 req-2300773f-c685-4e97-a0e6-a24499c8ae97 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:58.612423 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-527cb8ae-9a5b-4afe-b72f-e660855e5c93 req-2300773f-c685-4e97-a0e6-a24499c8ae97 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:58.613014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-527cb8ae-9a5b-4afe-b72f-e660855e5c93 req-2300773f-c685-4e97-a0e6-a24499c8ae97 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:58.628263 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-527cb8ae-9a5b-4afe-b72f-e660855e5c93 req-2300773f-c685-4e97-a0e6-a24499c8ae97 service nova] Creating event network-changed:72df7298-a6f4-498f-9bd8-dc7b5db74f9a for instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 on n-h1-856894-1 Sep 10 11:50:58.633930 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-527cb8ae-9a5b-4afe-b72f-e660855e5c93 req-2300773f-c685-4e97-a0e6-a24499c8ae97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120923 Sep 10 11:50:58.634934 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2361/7045] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:59.334098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-090a7fbd-d194-40e5-98ed-12cde8947d06 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:59.335615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-090a7fbd-d194-40e5-98ed-12cde8947d06 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:59.343488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-090a7fbd-d194-40e5-98ed-12cde8947d06 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:59.344228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-090a7fbd-d194-40e5-98ed-12cde8947d06 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:59.344707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-090a7fbd-d194-40e5-98ed-12cde8947d06 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:59.345467 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-090a7fbd-d194-40e5-98ed-12cde8947d06 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:59.345945 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-090a7fbd-d194-40e5-98ed-12cde8947d06 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:59.346547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-090a7fbd-d194-40e5-98ed-12cde8947d06 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:59.497410 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-090a7fbd-d194-40e5-98ed-12cde8947d06 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:59.506708 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-090a7fbd-d194-40e5-98ed-12cde8947d06 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1372 microversion: 2.1 time: 0.180620 Sep 10 11:50:59.507329 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4685/7046] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:59 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:00.529925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5746edfc-60e4-4bee-87f8-d71caba09db5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:00.530627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5746edfc-60e4-4bee-87f8-d71caba09db5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:00.538302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5746edfc-60e4-4bee-87f8-d71caba09db5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:00.538719 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5746edfc-60e4-4bee-87f8-d71caba09db5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:00.539156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5746edfc-60e4-4bee-87f8-d71caba09db5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:00.539866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5746edfc-60e4-4bee-87f8-d71caba09db5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:00.540319 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5746edfc-60e4-4bee-87f8-d71caba09db5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:00.540747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-5746edfc-60e4-4bee-87f8-d71caba09db5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:00.673438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5746edfc-60e4-4bee-87f8-d71caba09db5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:00.681545 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5746edfc-60e4-4bee-87f8-d71caba09db5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1372 microversion: 2.1 time: 0.155548 Sep 10 11:51:00.682117 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2362/7047] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:00 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:01.705523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-99c906e0-0a10-4e68-a1c1-3fb230ef7e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:01.706158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-99c906e0-0a10-4e68-a1c1-3fb230ef7e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:01.714474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99c906e0-0a10-4e68-a1c1-3fb230ef7e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:01.714982 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99c906e0-0a10-4e68-a1c1-3fb230ef7e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:01.715442 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99c906e0-0a10-4e68-a1c1-3fb230ef7e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:01.716162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99c906e0-0a10-4e68-a1c1-3fb230ef7e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:01.716637 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99c906e0-0a10-4e68-a1c1-3fb230ef7e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:01.717129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-99c906e0-0a10-4e68-a1c1-3fb230ef7e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:01.856663 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-99c906e0-0a10-4e68-a1c1-3fb230ef7e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:01.865062 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-99c906e0-0a10-4e68-a1c1-3fb230ef7e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1372 microversion: 2.1 time: 0.163859 Sep 10 11:51:01.875310 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4686/7048] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:01 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:02.887829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c1df9350-b8fb-402b-888e-f54ba7cb95d9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:02.888452 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c1df9350-b8fb-402b-888e-f54ba7cb95d9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:02.895391 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1df9350-b8fb-402b-888e-f54ba7cb95d9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:02.896019 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1df9350-b8fb-402b-888e-f54ba7cb95d9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:02.896357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1df9350-b8fb-402b-888e-f54ba7cb95d9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:02.897057 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1df9350-b8fb-402b-888e-f54ba7cb95d9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:02.897592 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1df9350-b8fb-402b-888e-f54ba7cb95d9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:02.898083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c1df9350-b8fb-402b-888e-f54ba7cb95d9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:03.042983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c1df9350-b8fb-402b-888e-f54ba7cb95d9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.052563 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c1df9350-b8fb-402b-888e-f54ba7cb95d9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1372 microversion: 2.1 time: 0.168637 Sep 10 11:51:03.053167 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2363/7049] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:02 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:04.026659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-1e06717f-175e-479e-a4f3-11501bf9097e req-fc8104b6-9bc3-463e-bde3-f5407dc19280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db8af93-7dce-45dd-b8f8-3cec86951ea7", "name": "network-vif-plugged", "status": "completed", "tag": "72df7298-a6f4-498f-9bd8-dc7b5db74f9a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:04.037627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1e06717f-175e-479e-a4f3-11501bf9097e req-fc8104b6-9bc3-463e-bde3-f5407dc19280 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.038180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1e06717f-175e-479e-a4f3-11501bf9097e req-fc8104b6-9bc3-463e-bde3-f5407dc19280 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.038589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-1e06717f-175e-479e-a4f3-11501bf9097e req-fc8104b6-9bc3-463e-bde3-f5407dc19280 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.051073 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-1e06717f-175e-479e-a4f3-11501bf9097e req-fc8104b6-9bc3-463e-bde3-f5407dc19280 service nova] Creating event network-vif-plugged:72df7298-a6f4-498f-9bd8-dc7b5db74f9a for instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 on n-h1-856894-1 Sep 10 11:51:04.056439 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-1e06717f-175e-479e-a4f3-11501bf9097e req-fc8104b6-9bc3-463e-bde3-f5407dc19280 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033336 Sep 10 11:51:04.057065 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4687/7050] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:51:04.075928 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c907210c-7ce0-43e0-a0fc-a0a582d5b67e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:04.076296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c907210c-7ce0-43e0-a0fc-a0a582d5b67e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:04.083328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c907210c-7ce0-43e0-a0fc-a0a582d5b67e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.083827 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c907210c-7ce0-43e0-a0fc-a0a582d5b67e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.084271 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c907210c-7ce0-43e0-a0fc-a0a582d5b67e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.084971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c907210c-7ce0-43e0-a0fc-a0a582d5b67e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.085633 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c907210c-7ce0-43e0-a0fc-a0a582d5b67e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.086226 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c907210c-7ce0-43e0-a0fc-a0a582d5b67e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.221613 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c907210c-7ce0-43e0-a0fc-a0a582d5b67e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:04.229339 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c907210c-7ce0-43e0-a0fc-a0a582d5b67e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1372 microversion: 2.1 time: 0.157705 Sep 10 11:51:04.229921 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2364/7051] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:04 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:05.253607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1765654a-1b63-41f2-99f7-eef2d9b70adc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:05.254485 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1765654a-1b63-41f2-99f7-eef2d9b70adc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:05.264015 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1765654a-1b63-41f2-99f7-eef2d9b70adc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:05.264668 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1765654a-1b63-41f2-99f7-eef2d9b70adc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:05.265289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1765654a-1b63-41f2-99f7-eef2d9b70adc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:05.266312 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1765654a-1b63-41f2-99f7-eef2d9b70adc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:05.266847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1765654a-1b63-41f2-99f7-eef2d9b70adc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:05.267335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1765654a-1b63-41f2-99f7-eef2d9b70adc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:05.404428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1765654a-1b63-41f2-99f7-eef2d9b70adc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:05.412818 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1765654a-1b63-41f2-99f7-eef2d9b70adc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1372 microversion: 2.1 time: 0.164736 Sep 10 11:51:05.424588 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4688/7052] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:05 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:06.443749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-15865d8f-3385-4493-8761-534ea21835e9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:06.444357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-15865d8f-3385-4493-8761-534ea21835e9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:06.447453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:06.448686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:06.454747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15865d8f-3385-4493-8761-534ea21835e9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:06.455327 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15865d8f-3385-4493-8761-534ea21835e9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:06.455764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15865d8f-3385-4493-8761-534ea21835e9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:06.456506 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15865d8f-3385-4493-8761-534ea21835e9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:06.456970 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15865d8f-3385-4493-8761-534ea21835e9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:06.457481 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-15865d8f-3385-4493-8761-534ea21835e9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:06.590179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-15865d8f-3385-4493-8761-534ea21835e9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.598711 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-15865d8f-3385-4493-8761-534ea21835e9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1556 microversion: 2.1 time: 0.159174 Sep 10 11:51:06.599287 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2365/7053] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:06 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:06.621361 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-74854f4a-2254-4de3-99c8-664e5d2dd749 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:06.621990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-74854f4a-2254-4de3-99c8-664e5d2dd749 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:06.624023 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:06.630459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74854f4a-2254-4de3-99c8-664e5d2dd749 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:06.630959 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74854f4a-2254-4de3-99c8-664e5d2dd749 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:06.631413 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74854f4a-2254-4de3-99c8-664e5d2dd749 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:06.632117 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74854f4a-2254-4de3-99c8-664e5d2dd749 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:06.632623 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74854f4a-2254-4de3-99c8-664e5d2dd749 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:06.633062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-74854f4a-2254-4de3-99c8-664e5d2dd749 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:06.771694 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-74854f4a-2254-4de3-99c8-664e5d2dd749 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.780861 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-74854f4a-2254-4de3-99c8-664e5d2dd749 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1556 microversion: 2.1 time: 0.163438 Sep 10 11:51:06.781510 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4689/7054] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:06 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:08.657834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-69f5ed99-7d71-4003-ae15-8f79c65d72cc req-ffa90150-9727-4d80-91ca-1349f613eec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db8af93-7dce-45dd-b8f8-3cec86951ea7", "tag": "72df7298-a6f4-498f-9bd8-dc7b5db74f9a"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:08.668042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-69f5ed99-7d71-4003-ae15-8f79c65d72cc req-ffa90150-9727-4d80-91ca-1349f613eec8 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:08.668521 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-69f5ed99-7d71-4003-ae15-8f79c65d72cc req-ffa90150-9727-4d80-91ca-1349f613eec8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:08.669040 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-69f5ed99-7d71-4003-ae15-8f79c65d72cc req-ffa90150-9727-4d80-91ca-1349f613eec8 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:08.681672 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-69f5ed99-7d71-4003-ae15-8f79c65d72cc req-ffa90150-9727-4d80-91ca-1349f613eec8 service nova] Creating event network-changed:72df7298-a6f4-498f-9bd8-dc7b5db74f9a for instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 on n-h1-856894-1 Sep 10 11:51:08.686849 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-69f5ed99-7d71-4003-ae15-8f79c65d72cc req-ffa90150-9727-4d80-91ca-1349f613eec8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032892 Sep 10 11:51:08.687784 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2366/7055] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:04.163734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:04.164555 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=32 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:04.165398 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:53:04.165540 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 11:53:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7/action (ip 10.222.0.20) !!! Sep 10 11:53:04.170528 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0697821d-94a4-4226-9312-495fc1358fd4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:04.171082 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0697821d-94a4-4226-9312-495fc1358fd4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:04.181129 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0697821d-94a4-4226-9312-495fc1358fd4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.181633 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0697821d-94a4-4226-9312-495fc1358fd4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.182094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0697821d-94a4-4226-9312-495fc1358fd4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.182802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0697821d-94a4-4226-9312-495fc1358fd4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.183276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0697821d-94a4-4226-9312-495fc1358fd4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.183722 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0697821d-94a4-4226-9312-495fc1358fd4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.207515 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.objects.instance [None req-0697821d-94a4-4226-9312-495fc1358fd4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lazy-loading 'flavor' on Instance uuid 3db8af93-7dce-45dd-b8f8-3cec86951ea7 {{(pid=128788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:53:04.515361 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0697821d-94a4-4226-9312-495fc1358fd4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "POST /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7/action" status: 202 len: 0 microversion: 2.1 time: 0.353561 Sep 10 11:53:04.516127 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4690/7056] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:53:04 2022] POST /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:53:04.523070 n-d-856894-1 devstack@n-api.service[128787]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82f59b2c-52ef-4de0-bd4e-b551a69003cb] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 11:53:04.523689 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:04.524460 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=36 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:04.530134 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d856b73a-83e6-4d1a-b1f9-4e5862a0a20e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:04.531074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d856b73a-83e6-4d1a-b1f9-4e5862a0a20e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:04.540109 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d856b73a-83e6-4d1a-b1f9-4e5862a0a20e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.540611 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d856b73a-83e6-4d1a-b1f9-4e5862a0a20e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.541048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d856b73a-83e6-4d1a-b1f9-4e5862a0a20e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.541781 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d856b73a-83e6-4d1a-b1f9-4e5862a0a20e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.542237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d856b73a-83e6-4d1a-b1f9-4e5862a0a20e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.542674 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d856b73a-83e6-4d1a-b1f9-4e5862a0a20e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.765242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d856b73a-83e6-4d1a-b1f9-4e5862a0a20e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:04.774295 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d856b73a-83e6-4d1a-b1f9-4e5862a0a20e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.253737 Sep 10 11:53:04.775079 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2367/7057] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:04 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:05.799650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1c141042-a48e-4da5-a018-8a76d29f06ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:05.800963 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1c141042-a48e-4da5-a018-8a76d29f06ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:05.808477 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c141042-a48e-4da5-a018-8a76d29f06ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.808983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c141042-a48e-4da5-a018-8a76d29f06ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.809466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c141042-a48e-4da5-a018-8a76d29f06ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.810175 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c141042-a48e-4da5-a018-8a76d29f06ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.810648 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c141042-a48e-4da5-a018-8a76d29f06ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.811095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1c141042-a48e-4da5-a018-8a76d29f06ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.947025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1c141042-a48e-4da5-a018-8a76d29f06ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:05.955183 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1c141042-a48e-4da5-a018-8a76d29f06ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.160956 Sep 10 11:53:05.955778 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4691/7058] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:05 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:06.979570 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-658cf499-ecc0-4fdc-bd7d-b9ea0589f5ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:06.980116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-658cf499-ecc0-4fdc-bd7d-b9ea0589f5ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:06.989220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-658cf499-ecc0-4fdc-bd7d-b9ea0589f5ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.989710 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-658cf499-ecc0-4fdc-bd7d-b9ea0589f5ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.990153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-658cf499-ecc0-4fdc-bd7d-b9ea0589f5ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.990846 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-658cf499-ecc0-4fdc-bd7d-b9ea0589f5ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.991304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-658cf499-ecc0-4fdc-bd7d-b9ea0589f5ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.991733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-658cf499-ecc0-4fdc-bd7d-b9ea0589f5ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.997006 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] [82f59b2c-52ef-4de0-bd4e-b551a69003cb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51044. Sep 10 11:53:07.120861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-658cf499-ecc0-4fdc-bd7d-b9ea0589f5ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:07.128653 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-658cf499-ecc0-4fdc-bd7d-b9ea0589f5ce tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.153163 Sep 10 11:53:07.129263 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2368/7059] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:06 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:08.152993 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0d84dedd-0db9-4240-b823-e47e8a053a3f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:08.153655 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0d84dedd-0db9-4240-b823-e47e8a053a3f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:08.160815 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d84dedd-0db9-4240-b823-e47e8a053a3f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:08.161344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d84dedd-0db9-4240-b823-e47e8a053a3f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:08.161804 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d84dedd-0db9-4240-b823-e47e8a053a3f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:08.162533 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d84dedd-0db9-4240-b823-e47e8a053a3f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:08.163011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d84dedd-0db9-4240-b823-e47e8a053a3f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:08.163451 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0d84dedd-0db9-4240-b823-e47e8a053a3f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:08.290785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0d84dedd-0db9-4240-b823-e47e8a053a3f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:08.301219 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0d84dedd-0db9-4240-b823-e47e8a053a3f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.152257 Sep 10 11:53:08.301810 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4692/7060] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:08 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:09.324425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-506e981f-59c2-4ae8-a37e-20885e0d72ee tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:09.324971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-506e981f-59c2-4ae8-a37e-20885e0d72ee tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:09.332398 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506e981f-59c2-4ae8-a37e-20885e0d72ee tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.332885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506e981f-59c2-4ae8-a37e-20885e0d72ee tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.333350 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506e981f-59c2-4ae8-a37e-20885e0d72ee tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:09.334039 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506e981f-59c2-4ae8-a37e-20885e0d72ee tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.334495 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506e981f-59c2-4ae8-a37e-20885e0d72ee tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.334925 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-506e981f-59c2-4ae8-a37e-20885e0d72ee tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:09.468156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-506e981f-59c2-4ae8-a37e-20885e0d72ee tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:09.476647 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-506e981f-59c2-4ae8-a37e-20885e0d72ee tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.156202 Sep 10 11:53:09.477264 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2369/7061] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:09 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:10.499790 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-35a16d8e-caa4-46dd-9ac1-92ddc3c49ad4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:10.500424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-35a16d8e-caa4-46dd-9ac1-92ddc3c49ad4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:10.507304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a16d8e-caa4-46dd-9ac1-92ddc3c49ad4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:10.507805 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a16d8e-caa4-46dd-9ac1-92ddc3c49ad4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:10.508260 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a16d8e-caa4-46dd-9ac1-92ddc3c49ad4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:10.508966 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a16d8e-caa4-46dd-9ac1-92ddc3c49ad4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:10.509466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a16d8e-caa4-46dd-9ac1-92ddc3c49ad4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:10.509908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-35a16d8e-caa4-46dd-9ac1-92ddc3c49ad4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:10.638651 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-35a16d8e-caa4-46dd-9ac1-92ddc3c49ad4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:10.646663 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-35a16d8e-caa4-46dd-9ac1-92ddc3c49ad4 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.150699 Sep 10 11:53:10.647626 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4693/7062] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:10 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:11.671075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-32568ea3-4d63-469d-a3ef-540093069ead tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:11.671632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-32568ea3-4d63-469d-a3ef-540093069ead tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:11.679274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32568ea3-4d63-469d-a3ef-540093069ead tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:11.679758 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32568ea3-4d63-469d-a3ef-540093069ead tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:11.680190 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32568ea3-4d63-469d-a3ef-540093069ead tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:11.680873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32568ea3-4d63-469d-a3ef-540093069ead tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:11.681346 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32568ea3-4d63-469d-a3ef-540093069ead tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:11.681767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32568ea3-4d63-469d-a3ef-540093069ead tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:11.818142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-32568ea3-4d63-469d-a3ef-540093069ead tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:11.825912 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-32568ea3-4d63-469d-a3ef-540093069ead tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.158821 Sep 10 11:53:11.826478 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2370/7063] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:11 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:12.848843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-42461824-703d-4c0d-9693-b872f389dbf5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:12.849495 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-42461824-703d-4c0d-9693-b872f389dbf5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:12.856294 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42461824-703d-4c0d-9693-b872f389dbf5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:12.856788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42461824-703d-4c0d-9693-b872f389dbf5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:12.857271 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42461824-703d-4c0d-9693-b872f389dbf5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:12.857970 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42461824-703d-4c0d-9693-b872f389dbf5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:12.858431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42461824-703d-4c0d-9693-b872f389dbf5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:12.858867 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-42461824-703d-4c0d-9693-b872f389dbf5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:12.990349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-42461824-703d-4c0d-9693-b872f389dbf5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:12.998287 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-42461824-703d-4c0d-9693-b872f389dbf5 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.153353 Sep 10 11:53:12.998872 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4694/7064] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:12 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:14.022666 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f0f45c5e-b703-48d2-8732-c312db692c6c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:14.023287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f0f45c5e-b703-48d2-8732-c312db692c6c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:14.030225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0f45c5e-b703-48d2-8732-c312db692c6c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.030744 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0f45c5e-b703-48d2-8732-c312db692c6c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.031187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0f45c5e-b703-48d2-8732-c312db692c6c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.031879 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0f45c5e-b703-48d2-8732-c312db692c6c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.032341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0f45c5e-b703-48d2-8732-c312db692c6c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.032772 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f0f45c5e-b703-48d2-8732-c312db692c6c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.165051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f0f45c5e-b703-48d2-8732-c312db692c6c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:14.172908 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f0f45c5e-b703-48d2-8732-c312db692c6c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.154740 Sep 10 11:53:14.173519 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2371/7065] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:14 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:15.195760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-eb938108-d422-4acd-bffa-fce5bf92dad9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:15.196381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-eb938108-d422-4acd-bffa-fce5bf92dad9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:15.203423 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb938108-d422-4acd-bffa-fce5bf92dad9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:15.203918 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb938108-d422-4acd-bffa-fce5bf92dad9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:15.204367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb938108-d422-4acd-bffa-fce5bf92dad9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:15.205066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb938108-d422-4acd-bffa-fce5bf92dad9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:15.205627 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb938108-d422-4acd-bffa-fce5bf92dad9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:15.206065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-eb938108-d422-4acd-bffa-fce5bf92dad9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:15.345412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-eb938108-d422-4acd-bffa-fce5bf92dad9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:15.354123 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-eb938108-d422-4acd-bffa-fce5bf92dad9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1701 microversion: 2.1 time: 0.162193 Sep 10 11:53:15.357155 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4695/7066] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:15 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:16.379977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e451147f-9087-46ec-9aa6-4e5bedcca4a2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:16.380597 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e451147f-9087-46ec-9aa6-4e5bedcca4a2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:16.387975 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e451147f-9087-46ec-9aa6-4e5bedcca4a2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:16.388536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e451147f-9087-46ec-9aa6-4e5bedcca4a2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:16.389013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e451147f-9087-46ec-9aa6-4e5bedcca4a2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:16.389745 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e451147f-9087-46ec-9aa6-4e5bedcca4a2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:16.390200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e451147f-9087-46ec-9aa6-4e5bedcca4a2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:16.390629 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e451147f-9087-46ec-9aa6-4e5bedcca4a2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:16.524276 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e451147f-9087-46ec-9aa6-4e5bedcca4a2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:16.532135 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e451147f-9087-46ec-9aa6-4e5bedcca4a2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1701 microversion: 2.1 time: 0.156298 Sep 10 11:53:16.532881 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2372/7067] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:16 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:17.556514 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a1d4caea-ccbb-43c4-a694-172a79e338ec tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:17.557086 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a1d4caea-ccbb-43c4-a694-172a79e338ec tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:17.564106 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1d4caea-ccbb-43c4-a694-172a79e338ec tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:17.564645 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1d4caea-ccbb-43c4-a694-172a79e338ec tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:17.565207 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1d4caea-ccbb-43c4-a694-172a79e338ec tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:17.566038 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1d4caea-ccbb-43c4-a694-172a79e338ec tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:17.566575 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1d4caea-ccbb-43c4-a694-172a79e338ec tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:17.567073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a1d4caea-ccbb-43c4-a694-172a79e338ec tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:17.726923 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a1d4caea-ccbb-43c4-a694-172a79e338ec tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:17.742494 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a1d4caea-ccbb-43c4-a694-172a79e338ec tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1696 microversion: 2.1 time: 0.190062 Sep 10 11:53:17.743373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4696/7068] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:17 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:18.528351 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-c50af24f-e9c7-44ad-a093-4c47bb732310 req-5a079bfd-1eed-444f-abf2-ebe07c6daa91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db8af93-7dce-45dd-b8f8-3cec86951ea7", "name": "network-vif-plugged", "status": "completed", "tag": "72df7298-a6f4-498f-9bd8-dc7b5db74f9a"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:18.540288 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c50af24f-e9c7-44ad-a093-4c47bb732310 req-5a079bfd-1eed-444f-abf2-ebe07c6daa91 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:18.540972 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c50af24f-e9c7-44ad-a093-4c47bb732310 req-5a079bfd-1eed-444f-abf2-ebe07c6daa91 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:18.541558 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-c50af24f-e9c7-44ad-a093-4c47bb732310 req-5a079bfd-1eed-444f-abf2-ebe07c6daa91 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:18.554001 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-c50af24f-e9c7-44ad-a093-4c47bb732310 req-5a079bfd-1eed-444f-abf2-ebe07c6daa91 service nova] Creating event network-vif-plugged:72df7298-a6f4-498f-9bd8-dc7b5db74f9a for instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 on n-h1-856894-1 Sep 10 11:53:18.559615 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-c50af24f-e9c7-44ad-a093-4c47bb732310 req-5a079bfd-1eed-444f-abf2-ebe07c6daa91 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106162 Sep 10 11:53:18.561166 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2373/7069] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:18.770384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0b0c8742-e57b-49a7-9aca-f5385770ac10 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:18.771115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0b0c8742-e57b-49a7-9aca-f5385770ac10 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:18.778878 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0c8742-e57b-49a7-9aca-f5385770ac10 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:18.779508 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0c8742-e57b-49a7-9aca-f5385770ac10 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:18.780074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0c8742-e57b-49a7-9aca-f5385770ac10 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:18.780892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0c8742-e57b-49a7-9aca-f5385770ac10 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:18.781639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0c8742-e57b-49a7-9aca-f5385770ac10 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:18.782479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0b0c8742-e57b-49a7-9aca-f5385770ac10 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:18.933114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0b0c8742-e57b-49a7-9aca-f5385770ac10 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:18.941551 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0b0c8742-e57b-49a7-9aca-f5385770ac10 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1696 microversion: 2.1 time: 0.175647 Sep 10 11:53:18.960155 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4697/7070] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:18 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:19.968492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-b8c53acf-0499-487f-abd8-75b030056fc2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:19.969256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-b8c53acf-0499-487f-abd8-75b030056fc2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:19.978614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8c53acf-0499-487f-abd8-75b030056fc2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:19.979103 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8c53acf-0499-487f-abd8-75b030056fc2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:19.979546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8c53acf-0499-487f-abd8-75b030056fc2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:19.980255 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8c53acf-0499-487f-abd8-75b030056fc2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:19.980713 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8c53acf-0499-487f-abd8-75b030056fc2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:19.981172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-b8c53acf-0499-487f-abd8-75b030056fc2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:20.128283 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-b8c53acf-0499-487f-abd8-75b030056fc2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:20.136306 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-b8c53acf-0499-487f-abd8-75b030056fc2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1696 microversion: 2.1 time: 0.172257 Sep 10 11:53:20.136889 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2374/7071] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:19 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:21.161319 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b5059bd3-99bb-42ca-b460-527738d38ff1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:21.162719 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b5059bd3-99bb-42ca-b460-527738d38ff1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:21.170594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5059bd3-99bb-42ca-b460-527738d38ff1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:21.171201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5059bd3-99bb-42ca-b460-527738d38ff1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:21.171723 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5059bd3-99bb-42ca-b460-527738d38ff1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:21.172518 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5059bd3-99bb-42ca-b460-527738d38ff1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:21.173126 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5059bd3-99bb-42ca-b460-527738d38ff1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:21.173619 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b5059bd3-99bb-42ca-b460-527738d38ff1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:21.318089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b5059bd3-99bb-42ca-b460-527738d38ff1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:21.330576 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b5059bd3-99bb-42ca-b460-527738d38ff1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1696 microversion: 2.1 time: 0.173371 Sep 10 11:53:21.345707 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4698/7072] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:21 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:22.358618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a8c902aa-9e6b-4369-9f44-8aeb72bb4ebc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:22.360012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a8c902aa-9e6b-4369-9f44-8aeb72bb4ebc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:22.368048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c902aa-9e6b-4369-9f44-8aeb72bb4ebc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:22.368539 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c902aa-9e6b-4369-9f44-8aeb72bb4ebc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:22.368971 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c902aa-9e6b-4369-9f44-8aeb72bb4ebc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:22.369700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c902aa-9e6b-4369-9f44-8aeb72bb4ebc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:22.370149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c902aa-9e6b-4369-9f44-8aeb72bb4ebc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:22.370567 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a8c902aa-9e6b-4369-9f44-8aeb72bb4ebc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:22.511677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a8c902aa-9e6b-4369-9f44-8aeb72bb4ebc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:22.518928 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a8c902aa-9e6b-4369-9f44-8aeb72bb4ebc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1696 microversion: 2.1 time: 0.164244 Sep 10 11:53:22.519862 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2375/7073] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:22 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:23.543788 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-46b723a3-8dbc-43f7-bfe9-254c899ace95 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:23.544424 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-46b723a3-8dbc-43f7-bfe9-254c899ace95 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:23.551761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46b723a3-8dbc-43f7-bfe9-254c899ace95 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:23.552400 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46b723a3-8dbc-43f7-bfe9-254c899ace95 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:23.553139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46b723a3-8dbc-43f7-bfe9-254c899ace95 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:23.553871 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46b723a3-8dbc-43f7-bfe9-254c899ace95 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:23.554350 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46b723a3-8dbc-43f7-bfe9-254c899ace95 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:23.554794 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-46b723a3-8dbc-43f7-bfe9-254c899ace95 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:23.723481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-46b723a3-8dbc-43f7-bfe9-254c899ace95 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:23.731764 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-46b723a3-8dbc-43f7-bfe9-254c899ace95 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1696 microversion: 2.1 time: 0.192219 Sep 10 11:53:23.732560 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4699/7074] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:23 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:24.756698 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-931aa6b7-b01b-4a7f-9869-f5eff16d9ac8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:24.757349 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-931aa6b7-b01b-4a7f-9869-f5eff16d9ac8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:24.764214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-931aa6b7-b01b-4a7f-9869-f5eff16d9ac8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:24.764755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-931aa6b7-b01b-4a7f-9869-f5eff16d9ac8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:24.765172 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-931aa6b7-b01b-4a7f-9869-f5eff16d9ac8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:24.765869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-931aa6b7-b01b-4a7f-9869-f5eff16d9ac8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:24.770034 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-931aa6b7-b01b-4a7f-9869-f5eff16d9ac8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:24.771697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-931aa6b7-b01b-4a7f-9869-f5eff16d9ac8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:24.923259 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-931aa6b7-b01b-4a7f-9869-f5eff16d9ac8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:24.935322 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-931aa6b7-b01b-4a7f-9869-f5eff16d9ac8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1696 microversion: 2.1 time: 0.183572 Sep 10 11:53:24.936288 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2376/7075] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:24 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:25.961089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-edacc27b-f922-41d7-b5ce-5df01c7e5e14 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:25.961802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-edacc27b-f922-41d7-b5ce-5df01c7e5e14 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:25.969886 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edacc27b-f922-41d7-b5ce-5df01c7e5e14 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:25.970391 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edacc27b-f922-41d7-b5ce-5df01c7e5e14 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:25.970847 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edacc27b-f922-41d7-b5ce-5df01c7e5e14 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:25.971574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edacc27b-f922-41d7-b5ce-5df01c7e5e14 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:25.972031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edacc27b-f922-41d7-b5ce-5df01c7e5e14 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:25.972465 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-edacc27b-f922-41d7-b5ce-5df01c7e5e14 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:26.126247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-edacc27b-f922-41d7-b5ce-5df01c7e5e14 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:26.135474 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-edacc27b-f922-41d7-b5ce-5df01c7e5e14 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1696 microversion: 2.1 time: 0.178714 Sep 10 11:53:26.149344 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4700/7076] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:25 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:27.158834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-645dec3a-95db-45c0-8262-c61cb03b4d03 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:27.160199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-645dec3a-95db-45c0-8262-c61cb03b4d03 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:27.167124 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-645dec3a-95db-45c0-8262-c61cb03b4d03 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:27.167612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-645dec3a-95db-45c0-8262-c61cb03b4d03 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:27.168056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-645dec3a-95db-45c0-8262-c61cb03b4d03 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:27.168752 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-645dec3a-95db-45c0-8262-c61cb03b4d03 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:27.169242 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-645dec3a-95db-45c0-8262-c61cb03b4d03 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:27.169669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-645dec3a-95db-45c0-8262-c61cb03b4d03 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:27.301636 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-645dec3a-95db-45c0-8262-c61cb03b4d03 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:27.312206 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-645dec3a-95db-45c0-8262-c61cb03b4d03 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1678 microversion: 2.1 time: 0.157255 Sep 10 11:53:27.312810 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2377/7077] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:27 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:28.335930 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec862ce6-ad41-4564-be19-71ef25ce3eff tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:28.336568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec862ce6-ad41-4564-be19-71ef25ce3eff tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:28.343595 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec862ce6-ad41-4564-be19-71ef25ce3eff tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:28.344096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec862ce6-ad41-4564-be19-71ef25ce3eff tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:28.344550 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec862ce6-ad41-4564-be19-71ef25ce3eff tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:28.345280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec862ce6-ad41-4564-be19-71ef25ce3eff tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:28.345753 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec862ce6-ad41-4564-be19-71ef25ce3eff tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:28.346198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec862ce6-ad41-4564-be19-71ef25ce3eff tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:28.483500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec862ce6-ad41-4564-be19-71ef25ce3eff tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:28.491929 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec862ce6-ad41-4564-be19-71ef25ce3eff tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1678 microversion: 2.1 time: 0.159946 Sep 10 11:53:28.492509 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4701/7078] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:28 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:29.515149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8f4ae065-292e-49a1-9ef5-6a158e20a40a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:29.515767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8f4ae065-292e-49a1-9ef5-6a158e20a40a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:29.523253 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f4ae065-292e-49a1-9ef5-6a158e20a40a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:29.523732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f4ae065-292e-49a1-9ef5-6a158e20a40a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:29.524165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f4ae065-292e-49a1-9ef5-6a158e20a40a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:29.524851 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f4ae065-292e-49a1-9ef5-6a158e20a40a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:29.525334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f4ae065-292e-49a1-9ef5-6a158e20a40a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:29.525757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8f4ae065-292e-49a1-9ef5-6a158e20a40a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:29.654464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8f4ae065-292e-49a1-9ef5-6a158e20a40a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:29.662378 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8f4ae065-292e-49a1-9ef5-6a158e20a40a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1621 microversion: 2.1 time: 0.151146 Sep 10 11:53:29.662944 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2378/7079] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:29 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1621 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:29.685951 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b1ae41e0-8f50-4aff-b3e3-47f0106d6c50 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:29.687225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1ae41e0-8f50-4aff-b3e3-47f0106d6c50 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:29.694781 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ae41e0-8f50-4aff-b3e3-47f0106d6c50 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:29.695302 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ae41e0-8f50-4aff-b3e3-47f0106d6c50 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:29.695737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ae41e0-8f50-4aff-b3e3-47f0106d6c50 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:29.696443 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ae41e0-8f50-4aff-b3e3-47f0106d6c50 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:29.696905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ae41e0-8f50-4aff-b3e3-47f0106d6c50 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:29.697378 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b1ae41e0-8f50-4aff-b3e3-47f0106d6c50 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:29.780789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b1ae41e0-8f50-4aff-b3e3-47f0106d6c50 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128788) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 11:53:29.850122 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b1ae41e0-8f50-4aff-b3e3-47f0106d6c50 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "POST /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7/action" status: 202 len: 0 microversion: 2.1 time: 0.167807 Sep 10 11:53:29.850746 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4702/7080] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:53:29 2022] POST /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:53:29.858829 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-18c0618b-e723-4d97-a0e8-025134796a7a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:29.859444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-18c0618b-e723-4d97-a0e8-025134796a7a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:29.866012 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18c0618b-e723-4d97-a0e8-025134796a7a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:29.866498 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18c0618b-e723-4d97-a0e8-025134796a7a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:29.866938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18c0618b-e723-4d97-a0e8-025134796a7a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:29.867627 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18c0618b-e723-4d97-a0e8-025134796a7a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:29.868083 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18c0618b-e723-4d97-a0e8-025134796a7a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:29.868510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-18c0618b-e723-4d97-a0e8-025134796a7a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:30.007494 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-18c0618b-e723-4d97-a0e8-025134796a7a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:30.015420 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-18c0618b-e723-4d97-a0e8-025134796a7a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1629 microversion: 2.1 time: 0.160468 Sep 10 11:53:30.016008 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2379/7081] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:29 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1629 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:30.468972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-5f75632a-5723-4f15-9646-b1c796276499 req-f6227e36-f378-4ab4-99bb-10a7559f8fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db8af93-7dce-45dd-b8f8-3cec86951ea7", "name": "network-vif-unplugged", "status": "completed", "tag": "72df7298-a6f4-498f-9bd8-dc7b5db74f9a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:30.483484 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5f75632a-5723-4f15-9646-b1c796276499 req-f6227e36-f378-4ab4-99bb-10a7559f8fc0 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:30.483999 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5f75632a-5723-4f15-9646-b1c796276499 req-f6227e36-f378-4ab4-99bb-10a7559f8fc0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:30.484453 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-5f75632a-5723-4f15-9646-b1c796276499 req-f6227e36-f378-4ab4-99bb-10a7559f8fc0 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:30.497952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.compute.server_external_events [req-5f75632a-5723-4f15-9646-b1c796276499 req-f6227e36-f378-4ab4-99bb-10a7559f8fc0 service nova] Unable to find a host for instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7. Dropping event network-vif-unplugged {{(pid=128788) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 11:53:30.499087 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-5f75632a-5723-4f15-9646-b1c796276499 req-f6227e36-f378-4ab4-99bb-10a7559f8fc0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034443 Sep 10 11:53:30.499702 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4703/7082] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 11:53:31.040341 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9f12b14-7cd0-4601-a3a4-8b1a179410e6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:31.040963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9f12b14-7cd0-4601-a3a4-8b1a179410e6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:31.047823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9f12b14-7cd0-4601-a3a4-8b1a179410e6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:31.048308 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9f12b14-7cd0-4601-a3a4-8b1a179410e6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:31.048746 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9f12b14-7cd0-4601-a3a4-8b1a179410e6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:31.050117 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9f12b14-7cd0-4601-a3a4-8b1a179410e6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:31.050580 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9f12b14-7cd0-4601-a3a4-8b1a179410e6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:31.051025 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9f12b14-7cd0-4601-a3a4-8b1a179410e6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:31.187009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9f12b14-7cd0-4601-a3a4-8b1a179410e6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:31.195257 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9f12b14-7cd0-4601-a3a4-8b1a179410e6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.158826 Sep 10 11:53:31.209766 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2380/7083] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:31 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:32.058384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-dd36a6ed-5c38-4fae-986c-7fc5518d3ac9 req-d7e7c0ce-865b-41bd-b85e-c24e2febb3de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db8af93-7dce-45dd-b8f8-3cec86951ea7", "tag": "72df7298-a6f4-498f-9bd8-dc7b5db74f9a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:32.069672 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dd36a6ed-5c38-4fae-986c-7fc5518d3ac9 req-d7e7c0ce-865b-41bd-b85e-c24e2febb3de service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:32.070178 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dd36a6ed-5c38-4fae-986c-7fc5518d3ac9 req-d7e7c0ce-865b-41bd-b85e-c24e2febb3de service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:32.070628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-dd36a6ed-5c38-4fae-986c-7fc5518d3ac9 req-d7e7c0ce-865b-41bd-b85e-c24e2febb3de service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:32.074786 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:32.083089 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-dd36a6ed-5c38-4fae-986c-7fc5518d3ac9 req-d7e7c0ce-865b-41bd-b85e-c24e2febb3de service nova] Creating event network-changed:72df7298-a6f4-498f-9bd8-dc7b5db74f9a for instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 on n-h2-856894-1 Sep 10 11:53:32.088490 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-dd36a6ed-5c38-4fae-986c-7fc5518d3ac9 req-d7e7c0ce-865b-41bd-b85e-c24e2febb3de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033797 Sep 10 11:53:32.089505 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4704/7084] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:53:32.222232 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5c1c091-08b2-4f3f-bb47-3930008f9ed7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:32.222848 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a5c1c091-08b2-4f3f-bb47-3930008f9ed7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:32.229764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5c1c091-08b2-4f3f-bb47-3930008f9ed7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:32.230251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5c1c091-08b2-4f3f-bb47-3930008f9ed7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:32.230691 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5c1c091-08b2-4f3f-bb47-3930008f9ed7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:32.231386 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5c1c091-08b2-4f3f-bb47-3930008f9ed7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:32.231839 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5c1c091-08b2-4f3f-bb47-3930008f9ed7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:32.232270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5c1c091-08b2-4f3f-bb47-3930008f9ed7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:32.365382 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a5c1c091-08b2-4f3f-bb47-3930008f9ed7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:32.373500 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a5c1c091-08b2-4f3f-bb47-3930008f9ed7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.155084 Sep 10 11:53:32.374088 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2381/7085] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:32 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:33.398960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c400b274-a425-4270-a31a-b1313d17d997 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:33.399692 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c400b274-a425-4270-a31a-b1313d17d997 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:33.407820 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c400b274-a425-4270-a31a-b1313d17d997 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:33.408639 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c400b274-a425-4270-a31a-b1313d17d997 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:33.409345 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c400b274-a425-4270-a31a-b1313d17d997 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:33.410301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c400b274-a425-4270-a31a-b1313d17d997 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:33.411147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c400b274-a425-4270-a31a-b1313d17d997 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:33.411818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c400b274-a425-4270-a31a-b1313d17d997 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:33.569818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c400b274-a425-4270-a31a-b1313d17d997 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:33.578184 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c400b274-a425-4270-a31a-b1313d17d997 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.183728 Sep 10 11:53:33.581791 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4705/7086] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:33 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:34.603482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6e08f5ff-03ac-469e-973f-ae2aab703878 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:34.604096 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6e08f5ff-03ac-469e-973f-ae2aab703878 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:34.607200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=31 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:34.612977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e08f5ff-03ac-469e-973f-ae2aab703878 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:34.613488 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e08f5ff-03ac-469e-973f-ae2aab703878 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:34.613927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e08f5ff-03ac-469e-973f-ae2aab703878 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:34.614624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e08f5ff-03ac-469e-973f-ae2aab703878 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:34.615073 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e08f5ff-03ac-469e-973f-ae2aab703878 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:34.615496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6e08f5ff-03ac-469e-973f-ae2aab703878 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:34.620965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=87 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:34.761353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6e08f5ff-03ac-469e-973f-ae2aab703878 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:34.770205 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6e08f5ff-03ac-469e-973f-ae2aab703878 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.171053 Sep 10 11:53:34.770879 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2382/7087] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:34 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:35.796267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4d9ea636-8670-4185-b970-eeaefd5a5429 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:35.797169 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4d9ea636-8670-4185-b970-eeaefd5a5429 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:35.801157 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:35.808005 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d9ea636-8670-4185-b970-eeaefd5a5429 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:35.808734 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d9ea636-8670-4185-b970-eeaefd5a5429 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:35.809304 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d9ea636-8670-4185-b970-eeaefd5a5429 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:35.810368 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d9ea636-8670-4185-b970-eeaefd5a5429 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:35.810948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d9ea636-8670-4185-b970-eeaefd5a5429 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:35.811474 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4d9ea636-8670-4185-b970-eeaefd5a5429 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:35.970634 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4d9ea636-8670-4185-b970-eeaefd5a5429 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:35.979417 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4d9ea636-8670-4185-b970-eeaefd5a5429 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.187222 Sep 10 11:53:35.980007 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4706/7088] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:35 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:37.003623 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f39353dc-6db1-4af2-a2a6-175c462b481b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:37.004281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f39353dc-6db1-4af2-a2a6-175c462b481b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:37.011015 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39353dc-6db1-4af2-a2a6-175c462b481b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:37.011523 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39353dc-6db1-4af2-a2a6-175c462b481b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:37.011963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39353dc-6db1-4af2-a2a6-175c462b481b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:37.012668 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39353dc-6db1-4af2-a2a6-175c462b481b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:37.013146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39353dc-6db1-4af2-a2a6-175c462b481b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:37.013574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f39353dc-6db1-4af2-a2a6-175c462b481b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:37.169385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f39353dc-6db1-4af2-a2a6-175c462b481b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:37.178030 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f39353dc-6db1-4af2-a2a6-175c462b481b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.178888 Sep 10 11:53:37.178697 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2383/7089] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:36 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:38.202610 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ec507708-0e5d-49cb-a349-91a9df396c05 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:38.204411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ec507708-0e5d-49cb-a349-91a9df396c05 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:38.213049 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec507708-0e5d-49cb-a349-91a9df396c05 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:38.213589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec507708-0e5d-49cb-a349-91a9df396c05 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:38.214254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec507708-0e5d-49cb-a349-91a9df396c05 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:38.215210 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec507708-0e5d-49cb-a349-91a9df396c05 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:38.215691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec507708-0e5d-49cb-a349-91a9df396c05 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:38.216144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ec507708-0e5d-49cb-a349-91a9df396c05 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:38.363429 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ec507708-0e5d-49cb-a349-91a9df396c05 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:38.371817 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ec507708-0e5d-49cb-a349-91a9df396c05 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.173478 Sep 10 11:53:38.375512 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4707/7090] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:38 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:39.396519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6fcd78b5-a340-464d-b8e8-95a025b46426 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:39.397168 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6fcd78b5-a340-464d-b8e8-95a025b46426 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:39.404321 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fcd78b5-a340-464d-b8e8-95a025b46426 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:39.404813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fcd78b5-a340-464d-b8e8-95a025b46426 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:39.405278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fcd78b5-a340-464d-b8e8-95a025b46426 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:39.405983 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fcd78b5-a340-464d-b8e8-95a025b46426 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:39.406436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fcd78b5-a340-464d-b8e8-95a025b46426 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:39.406895 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6fcd78b5-a340-464d-b8e8-95a025b46426 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:39.565510 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6fcd78b5-a340-464d-b8e8-95a025b46426 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:39.577638 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6fcd78b5-a340-464d-b8e8-95a025b46426 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.185549 Sep 10 11:53:39.578292 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2384/7091] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:39 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:40.600532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-63936931-cebb-4101-b898-3189dfc53085 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:40.601186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-63936931-cebb-4101-b898-3189dfc53085 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:40.608047 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63936931-cebb-4101-b898-3189dfc53085 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:40.608541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63936931-cebb-4101-b898-3189dfc53085 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:40.608990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63936931-cebb-4101-b898-3189dfc53085 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:40.609713 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63936931-cebb-4101-b898-3189dfc53085 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:40.610180 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63936931-cebb-4101-b898-3189dfc53085 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:40.610615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-63936931-cebb-4101-b898-3189dfc53085 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:40.741564 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-63936931-cebb-4101-b898-3189dfc53085 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:40.749342 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-63936931-cebb-4101-b898-3189dfc53085 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.152704 Sep 10 11:53:40.749924 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4708/7092] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:40 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:41.773438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-ba73b8ed-a133-4d26-8409-fc057fdbfb6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:41.774059 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-ba73b8ed-a133-4d26-8409-fc057fdbfb6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:41.780963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba73b8ed-a133-4d26-8409-fc057fdbfb6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:41.781480 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba73b8ed-a133-4d26-8409-fc057fdbfb6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:41.781914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba73b8ed-a133-4d26-8409-fc057fdbfb6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:41.782600 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba73b8ed-a133-4d26-8409-fc057fdbfb6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:41.783058 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba73b8ed-a133-4d26-8409-fc057fdbfb6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:41.783511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-ba73b8ed-a133-4d26-8409-fc057fdbfb6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:41.926553 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-ba73b8ed-a133-4d26-8409-fc057fdbfb6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:41.934745 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-ba73b8ed-a133-4d26-8409-fc057fdbfb6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.165234 Sep 10 11:53:41.935316 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2385/7093] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:41 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:42.957759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fcd832b1-7b69-4e29-b32e-de4d5a83d131 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:42.958363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fcd832b1-7b69-4e29-b32e-de4d5a83d131 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:42.965158 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcd832b1-7b69-4e29-b32e-de4d5a83d131 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:42.965657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcd832b1-7b69-4e29-b32e-de4d5a83d131 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:42.966107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcd832b1-7b69-4e29-b32e-de4d5a83d131 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:42.966803 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcd832b1-7b69-4e29-b32e-de4d5a83d131 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:42.967268 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcd832b1-7b69-4e29-b32e-de4d5a83d131 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:42.967707 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fcd832b1-7b69-4e29-b32e-de4d5a83d131 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.099832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fcd832b1-7b69-4e29-b32e-de4d5a83d131 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:43.107565 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fcd832b1-7b69-4e29-b32e-de4d5a83d131 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.154305 Sep 10 11:53:43.108148 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4709/7094] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:42 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:44.131068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96eb9a0f-c27a-4645-ac0b-830150985a99 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:44.131682 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-96eb9a0f-c27a-4645-ac0b-830150985a99 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:44.138880 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96eb9a0f-c27a-4645-ac0b-830150985a99 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:44.139365 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96eb9a0f-c27a-4645-ac0b-830150985a99 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:44.139802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96eb9a0f-c27a-4645-ac0b-830150985a99 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:44.140490 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96eb9a0f-c27a-4645-ac0b-830150985a99 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:44.140937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96eb9a0f-c27a-4645-ac0b-830150985a99 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:44.141389 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96eb9a0f-c27a-4645-ac0b-830150985a99 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:44.274212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-96eb9a0f-c27a-4645-ac0b-830150985a99 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:44.281877 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-96eb9a0f-c27a-4645-ac0b-830150985a99 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.154779 Sep 10 11:53:44.282448 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2386/7095] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:44 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:45.305676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a65e481b-8f89-4f97-9649-d6b84ac44d1e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:45.306254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a65e481b-8f89-4f97-9649-d6b84ac44d1e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:45.313323 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a65e481b-8f89-4f97-9649-d6b84ac44d1e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:45.313831 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a65e481b-8f89-4f97-9649-d6b84ac44d1e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:45.314355 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a65e481b-8f89-4f97-9649-d6b84ac44d1e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:45.315604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a65e481b-8f89-4f97-9649-d6b84ac44d1e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:45.316075 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a65e481b-8f89-4f97-9649-d6b84ac44d1e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:45.316544 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a65e481b-8f89-4f97-9649-d6b84ac44d1e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:45.457948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a65e481b-8f89-4f97-9649-d6b84ac44d1e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:45.465912 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a65e481b-8f89-4f97-9649-d6b84ac44d1e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.164560 Sep 10 11:53:45.466536 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4710/7096] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:45 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:46.441869 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-0bf26f2d-a477-4228-aab4-d97ef41daae2 req-39dd4cfa-e4ed-436a-ad97-4466e5b97dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db8af93-7dce-45dd-b8f8-3cec86951ea7", "name": "network-vif-plugged", "status": "completed", "tag": "72df7298-a6f4-498f-9bd8-dc7b5db74f9a"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:46.454014 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0bf26f2d-a477-4228-aab4-d97ef41daae2 req-39dd4cfa-e4ed-436a-ad97-4466e5b97dc5 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.454406 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0bf26f2d-a477-4228-aab4-d97ef41daae2 req-39dd4cfa-e4ed-436a-ad97-4466e5b97dc5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.455353 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-0bf26f2d-a477-4228-aab4-d97ef41daae2 req-39dd4cfa-e4ed-436a-ad97-4466e5b97dc5 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.466841 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-0bf26f2d-a477-4228-aab4-d97ef41daae2 req-39dd4cfa-e4ed-436a-ad97-4466e5b97dc5 service nova] Creating event network-vif-plugged:72df7298-a6f4-498f-9bd8-dc7b5db74f9a for instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 on n-h2-856894-1 Sep 10 11:53:46.473292 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-0bf26f2d-a477-4228-aab4-d97ef41daae2 req-39dd4cfa-e4ed-436a-ad97-4466e5b97dc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035135 Sep 10 11:53:46.474478 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2387/7097] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:46.489289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f1fc4580-53a1-47fc-a229-4cad74699415 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:46.490239 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f1fc4580-53a1-47fc-a229-4cad74699415 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:46.497287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1fc4580-53a1-47fc-a229-4cad74699415 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.497802 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1fc4580-53a1-47fc-a229-4cad74699415 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.498342 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1fc4580-53a1-47fc-a229-4cad74699415 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.499067 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1fc4580-53a1-47fc-a229-4cad74699415 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.499611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1fc4580-53a1-47fc-a229-4cad74699415 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.500093 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f1fc4580-53a1-47fc-a229-4cad74699415 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.642327 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f1fc4580-53a1-47fc-a229-4cad74699415 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:46.651127 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f1fc4580-53a1-47fc-a229-4cad74699415 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.166095 Sep 10 11:53:46.651720 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4711/7098] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:46 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:47.675178 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-32729e01-c43e-4017-bca1-4c2146dcee35 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:47.675873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-32729e01-c43e-4017-bca1-4c2146dcee35 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:47.683185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32729e01-c43e-4017-bca1-4c2146dcee35 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:47.683656 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32729e01-c43e-4017-bca1-4c2146dcee35 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:47.684088 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32729e01-c43e-4017-bca1-4c2146dcee35 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:47.689081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32729e01-c43e-4017-bca1-4c2146dcee35 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:47.689081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32729e01-c43e-4017-bca1-4c2146dcee35 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:47.689081 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-32729e01-c43e-4017-bca1-4c2146dcee35 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:47.831378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-32729e01-c43e-4017-bca1-4c2146dcee35 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:47.839570 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-32729e01-c43e-4017-bca1-4c2146dcee35 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1687 microversion: 2.1 time: 0.169001 Sep 10 11:53:47.840268 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2388/7099] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:47 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:48.863630 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b32b51d-c251-46ef-b56d-0fcf247c918c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:48.864293 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b32b51d-c251-46ef-b56d-0fcf247c918c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:48.871228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b32b51d-c251-46ef-b56d-0fcf247c918c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:48.871735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b32b51d-c251-46ef-b56d-0fcf247c918c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:48.872194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b32b51d-c251-46ef-b56d-0fcf247c918c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:48.872909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b32b51d-c251-46ef-b56d-0fcf247c918c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:48.873411 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b32b51d-c251-46ef-b56d-0fcf247c918c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:48.873868 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b32b51d-c251-46ef-b56d-0fcf247c918c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:49.003325 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b32b51d-c251-46ef-b56d-0fcf247c918c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:49.011220 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b32b51d-c251-46ef-b56d-0fcf247c918c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1674 microversion: 2.1 time: 0.152346 Sep 10 11:53:49.011807 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4712/7100] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:48 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:05.314345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=13 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:05.315727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=37 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:05.318385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=13 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:05.318897 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:55:05.318897 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 11:55:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 (ip 10.222.0.20) !!! Sep 10 11:55:05.319234 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=48 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:05.320316 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:55:05.320461 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 11:55:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 10 11:55:05.323374 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:55:05.323500 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 11:55:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 (ip 10.222.0.20) !!! Sep 10 11:55:05.325500 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-59437d0a-8c04-49d7-b3be-33feda0988b1 req-805d5b82-8923-462e-832d-6961e00185d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db8af93-7dce-45dd-b8f8-3cec86951ea7", "tag": "72df7298-a6f4-498f-9bd8-dc7b5db74f9a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:05.334455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-56c6f912-2920-4c39-8b2b-91a1c04a6e0f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:05.334904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-56c6f912-2920-4c39-8b2b-91a1c04a6e0f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:05.343406 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-59437d0a-8c04-49d7-b3be-33feda0988b1 req-805d5b82-8923-462e-832d-6961e00185d3 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:05.344040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-59437d0a-8c04-49d7-b3be-33feda0988b1 req-805d5b82-8923-462e-832d-6961e00185d3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:05.344709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-59437d0a-8c04-49d7-b3be-33feda0988b1 req-805d5b82-8923-462e-832d-6961e00185d3 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:05.349555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56c6f912-2920-4c39-8b2b-91a1c04a6e0f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:05.350042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56c6f912-2920-4c39-8b2b-91a1c04a6e0f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:05.350736 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56c6f912-2920-4c39-8b2b-91a1c04a6e0f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:05.351436 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56c6f912-2920-4c39-8b2b-91a1c04a6e0f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:05.351890 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56c6f912-2920-4c39-8b2b-91a1c04a6e0f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:05.352312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-56c6f912-2920-4c39-8b2b-91a1c04a6e0f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:05.357637 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-59437d0a-8c04-49d7-b3be-33feda0988b1 req-805d5b82-8923-462e-832d-6961e00185d3 service nova] Creating event network-changed:72df7298-a6f4-498f-9bd8-dc7b5db74f9a for instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 on n-h2-856894-1 Sep 10 11:55:05.363103 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-59437d0a-8c04-49d7-b3be-33feda0988b1 req-805d5b82-8923-462e-832d-6961e00185d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047150 Sep 10 11:55:05.363834 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4713/7101] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:55:05.384279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-56c6f912-2920-4c39-8b2b-91a1c04a6e0f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:55:05.480947 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-56c6f912-2920-4c39-8b2b-91a1c04a6e0f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 204 len: 0 microversion: 2.1 time: 0.167897 Sep 10 11:55:05.482340 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2389/7102] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:55:05 2022] DELETE /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:55:05.492760 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1593c7b9-901c-4e0c-ae7b-d7ca4ab939d3 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:05.493972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1593c7b9-901c-4e0c-ae7b-d7ca4ab939d3 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:05.500363 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1593c7b9-901c-4e0c-ae7b-d7ca4ab939d3 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:05.500859 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1593c7b9-901c-4e0c-ae7b-d7ca4ab939d3 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:05.501354 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1593c7b9-901c-4e0c-ae7b-d7ca4ab939d3 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:05.502064 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1593c7b9-901c-4e0c-ae7b-d7ca4ab939d3 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:05.502532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1593c7b9-901c-4e0c-ae7b-d7ca4ab939d3 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:05.502968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1593c7b9-901c-4e0c-ae7b-d7ca4ab939d3 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:05.651545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1593c7b9-901c-4e0c-ae7b-d7ca4ab939d3 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:05.659603 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1593c7b9-901c-4e0c-ae7b-d7ca4ab939d3 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.172613 Sep 10 11:55:05.660206 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4714/7103] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:05 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:06.683806 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-bf147eaf-4638-4c79-a8e6-3e1848b2dfe2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:06.684552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-bf147eaf-4638-4c79-a8e6-3e1848b2dfe2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:06.692237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf147eaf-4638-4c79-a8e6-3e1848b2dfe2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:06.692716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf147eaf-4638-4c79-a8e6-3e1848b2dfe2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:06.693180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf147eaf-4638-4c79-a8e6-3e1848b2dfe2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:06.693907 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf147eaf-4638-4c79-a8e6-3e1848b2dfe2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:06.694343 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf147eaf-4638-4c79-a8e6-3e1848b2dfe2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:06.694764 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-bf147eaf-4638-4c79-a8e6-3e1848b2dfe2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:06.826786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-bf147eaf-4638-4c79-a8e6-3e1848b2dfe2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:06.835366 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-bf147eaf-4638-4c79-a8e6-3e1848b2dfe2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1680 microversion: 2.1 time: 0.155884 Sep 10 11:55:06.850583 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2390/7104] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:06 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:07.511300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-b00b333e-e6ea-4f40-96da-7e36f4fbd708 req-2e8dd02f-3b4c-481a-89fb-6035737a23da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db8af93-7dce-45dd-b8f8-3cec86951ea7", "name": "network-vif-deleted", "tag": "72df7298-a6f4-498f-9bd8-dc7b5db74f9a"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:07.520891 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b00b333e-e6ea-4f40-96da-7e36f4fbd708 req-2e8dd02f-3b4c-481a-89fb-6035737a23da service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:07.521417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b00b333e-e6ea-4f40-96da-7e36f4fbd708 req-2e8dd02f-3b4c-481a-89fb-6035737a23da service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:07.521862 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-b00b333e-e6ea-4f40-96da-7e36f4fbd708 req-2e8dd02f-3b4c-481a-89fb-6035737a23da service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:07.533436 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-b00b333e-e6ea-4f40-96da-7e36f4fbd708 req-2e8dd02f-3b4c-481a-89fb-6035737a23da service nova] Creating event network-vif-deleted:72df7298-a6f4-498f-9bd8-dc7b5db74f9a for instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 on n-h2-856894-1 Sep 10 11:55:07.539338 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-b00b333e-e6ea-4f40-96da-7e36f4fbd708 req-2e8dd02f-3b4c-481a-89fb-6035737a23da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145495 Sep 10 11:55:07.540095 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4715/7105] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:07.861300 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:07.861914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:07.868574 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:07.869051 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:07.869512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:07.870192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:07.870641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:07.871093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:07.909041 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:07.909522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:07.909956 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:07.910409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lazy-loading 'fault' on Instance uuid 3db8af93-7dce-45dd-b8f8-3cec86951ea7 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:55:07.953418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:07.962130 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f5c6be4f-da5e-45db-adb7-0afb4d9bd565 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 200 len: 1336 microversion: 2.1 time: 0.104911 Sep 10 11:55:07.962727 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2391/7106] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:07 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:08.987765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:08.988509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3db8af93-7dce-45dd-b8f8-3cec86951ea7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:08.994843 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:08.995341 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:08.995797 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:08.996503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:08.996979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:08.997454 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:09.012323 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] HTTP exception thrown: Instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 could not be found. Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Request method failure captured: Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 HTTP/1.1 Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHoYCODTK4w5m7QiiSecf7X6qDNNe68VWJ-2vJOd5y1h7tgSxsvQWuMToiJGExhg7WydlG-PqkmSrckbR9_-YaCpm3Hs6blOX6B1ZvPlY0s_EZf90-8ElnqpklBN43hw9WvkAK2ILcjmJgOyv6k4quVO6FCTx1iSqq02swLjlmZy13U Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: c660f1f8d71a46d9bcb9661f56b2a88f Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestShelveInstance-1586732419 Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c660f1f8d71a46d9bcb9661f56b2a88f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c660f1f8d71a46d9bcb9661f56b2a88f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c660f1f8d71a46d9bcb9661f56b2a88f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c660f1f8d71a46d9bcb9661f56b2a88f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestShelveInstance-1586732419 Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: c660f1f8d71a46d9bcb9661f56b2a88f Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestShelveInstance-1586732419 Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestShelveInstance-1586732419-project Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 9e981f02179043da99a961c716ccc1c5 Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestShelveInstance-1586732419-project Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 could not be found. Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '3db8af93-7dce-45dd-b8f8-3cec86951ea7'} Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 could not be found. Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 could not be found. Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:09.013990 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:55:09.020043 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:09.020043 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:09.020043 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:09.020043 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:55:09.020043 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:55:09.020043 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 could not be found. Sep 10 11:55:09.020043 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 11:55:09.020043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Returning 404 to user: Instance 3db8af93-7dce-45dd-b8f8-3cec86951ea7 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:55:09.020043 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6fbd58b4-243f-4f28-b652-b6efecd19a7c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7" status: 404 len: 111 microversion: 2.1 time: 0.032994 Sep 10 11:55:09.020043 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4716/7107] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:08 2022] GET /compute/v2.1/servers/3db8af93-7dce-45dd-b8f8-3cec86951ea7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:55:09.175778 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7327626f-a33f-427d-b43a-0eb13daa1232 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '.version_select at 0x7efcaebc33a0>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:09.201441 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7327626f-a33f-427d-b43a-0eb13daa1232 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1136249330" status: 202 len: 0 microversion: 2.1 time: 0.029484 Sep 10 11:55:09.202122 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2392/7108] 10.222.0.20 () {58 vars in 1254 bytes} [Sat Sep 10 11:55:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1136249330 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:55:09.225684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e9a8f995-14c7-44cb-9595-7a52f4b2bb38 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Action: 'create', calling method: .version_select at 0x7efcaee0f280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1335641194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKU5nzX5Lbxjm9Ja5msG+Bi5+6UjQFDkaVM7l7nHOC1qkDbA0JcJ8fPcxrpLXaLJk24FmS2KQH8XPdVaxYaNdt8FoTQxf4txSncq35UTzYs4FwIpuC+saj+Hxi8+008Q0w=="}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:09.241549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e9a8f995-14c7-44cb-9595-7a52f4b2bb38 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Getting quotas for project c660f1f8d71a46d9bcb9661f56b2a88f. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:55:09.246557 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e9a8f995-14c7-44cb-9595-7a52f4b2bb38 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Getting quotas for user 9e981f02179043da99a961c716ccc1c5 and project c660f1f8d71a46d9bcb9661f56b2a88f. Resources: {'key_pairs'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:55:09.273270 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e9a8f995-14c7-44cb-9595-7a52f4b2bb38 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.051463 Sep 10 11:55:09.273866 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4717/7109] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:55:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:55:25.491026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:25.491763 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:25.496284 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-745175225", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1335641194", "security_groups": [{"name": "tempest-secgroup-smoke-1324506103"}], "networks": [{"uuid": "384067c8-8eb6-4d31-8763-e36ef7f06b9e"}], "block_device_mapping_v2": [{"uuid": "710e67a6-8efd-42d2-99e3-f0935db12b8f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:25.607963 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.network.neutron [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] validate_networks() for [('384067c8-8eb6-4d31-8763-e36ef7f06b9e', None, None, None, None, None)] {{(pid=128787) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:55:25.966990 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Flavor limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:55:25.967412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Image limits 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:55:25.967912 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Flavor pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:55:25.968347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Image pref 0:0:0 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:55:25.968786 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.virt.hardware [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:55:25.978071 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.978549 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.978982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.979704 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.980152 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.980576 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.998575 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Getting quotas for project c660f1f8d71a46d9bcb9661f56b2a88f. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:55:26.005962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Getting quotas for user 9e981f02179043da99a961c716ccc1c5 and project c660f1f8d71a46d9bcb9661f56b2a88f. Resources: {'instances', 'ram', 'cores'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:55:26.064749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Going to run 1 instances... {{(pid=128787) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:55:26.067427 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='710e67a6-8efd-42d2-99e3-f0935db12b8f',volume_size=None,volume_type=None)] {{(pid=128787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:55:26.196760 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3fc100b0-3c6a-4826-bc09-f3ceb045d50f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.707475 Sep 10 11:55:26.197648 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2393/7110] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:55:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:55:26.207362 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=12 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:26.208594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=4 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:26.209420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:26.215845 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-194f0073-6537-4960-99a9-e2a7b90157bf tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:26.216475 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-194f0073-6537-4960-99a9-e2a7b90157bf tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:26.276310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-194f0073-6537-4960-99a9-e2a7b90157bf tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:26.283284 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-194f0073-6537-4960-99a9-e2a7b90157bf tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1088 microversion: 2.1 time: 0.078325 Sep 10 11:55:26.283913 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4718/7111] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:26 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:27.307899 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fb82d168-9a98-430a-9825-de790c89e9a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:27.308528 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fb82d168-9a98-430a-9825-de790c89e9a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:27.315676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb82d168-9a98-430a-9825-de790c89e9a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.316385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb82d168-9a98-430a-9825-de790c89e9a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.316795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb82d168-9a98-430a-9825-de790c89e9a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.317527 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb82d168-9a98-430a-9825-de790c89e9a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.317993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb82d168-9a98-430a-9825-de790c89e9a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.318416 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fb82d168-9a98-430a-9825-de790c89e9a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.390837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fb82d168-9a98-430a-9825-de790c89e9a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:27.400410 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fb82d168-9a98-430a-9825-de790c89e9a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1204 microversion: 2.1 time: 0.097680 Sep 10 11:55:27.401402 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2394/7112] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:27 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:28.425547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9266b180-aa6d-4af0-aec8-fac7d3fd156d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:28.427270 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9266b180-aa6d-4af0-aec8-fac7d3fd156d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:28.434221 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9266b180-aa6d-4af0-aec8-fac7d3fd156d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.434926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9266b180-aa6d-4af0-aec8-fac7d3fd156d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.435385 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9266b180-aa6d-4af0-aec8-fac7d3fd156d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.436100 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9266b180-aa6d-4af0-aec8-fac7d3fd156d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.436609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9266b180-aa6d-4af0-aec8-fac7d3fd156d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.437364 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9266b180-aa6d-4af0-aec8-fac7d3fd156d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.576998 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9266b180-aa6d-4af0-aec8-fac7d3fd156d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:28.587057 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9266b180-aa6d-4af0-aec8-fac7d3fd156d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1272 microversion: 2.1 time: 0.165540 Sep 10 11:55:28.587860 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4719/7113] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:28 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:28.651834 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-5b634d8e-c527-4f38-9f7d-7159f9487502 req-9cc2a719-c81b-4b2e-afb3-e954b03f0ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c98801f-9943-464e-8c0a-cd88062c2ee7", "tag": "0e146e7f-8a34-46ed-ba66-dd3d9610241c"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:28.663006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5b634d8e-c527-4f38-9f7d-7159f9487502 req-9cc2a719-c81b-4b2e-afb3-e954b03f0ffc service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.663814 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5b634d8e-c527-4f38-9f7d-7159f9487502 req-9cc2a719-c81b-4b2e-afb3-e954b03f0ffc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.673724 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-5b634d8e-c527-4f38-9f7d-7159f9487502 req-9cc2a719-c81b-4b2e-afb3-e954b03f0ffc service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.686318 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-5b634d8e-c527-4f38-9f7d-7159f9487502 req-9cc2a719-c81b-4b2e-afb3-e954b03f0ffc service nova] Creating event network-changed:0e146e7f-8a34-46ed-ba66-dd3d9610241c for instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 on n-h1-856894-1 Sep 10 11:55:28.692514 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-5b634d8e-c527-4f38-9f7d-7159f9487502 req-9cc2a719-c81b-4b2e-afb3-e954b03f0ffc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044088 Sep 10 11:55:28.693790 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2395/7114] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:29.612456 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-17c004b8-1be2-4482-bfce-4b8a1ce393cb tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:29.613266 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-17c004b8-1be2-4482-bfce-4b8a1ce393cb tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:29.619866 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17c004b8-1be2-4482-bfce-4b8a1ce393cb tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:29.620373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17c004b8-1be2-4482-bfce-4b8a1ce393cb tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:29.620848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17c004b8-1be2-4482-bfce-4b8a1ce393cb tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:29.621568 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17c004b8-1be2-4482-bfce-4b8a1ce393cb tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:29.622043 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17c004b8-1be2-4482-bfce-4b8a1ce393cb tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:29.622487 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-17c004b8-1be2-4482-bfce-4b8a1ce393cb tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:29.761775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-17c004b8-1be2-4482-bfce-4b8a1ce393cb tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:29.770590 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-17c004b8-1be2-4482-bfce-4b8a1ce393cb tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1272 microversion: 2.1 time: 0.163275 Sep 10 11:55:29.771330 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4720/7115] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:29 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:30.795220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6c204df1-4de3-4a92-ac91-4e8c8b022da6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:30.795918 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6c204df1-4de3-4a92-ac91-4e8c8b022da6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:30.803984 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c204df1-4de3-4a92-ac91-4e8c8b022da6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.804796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c204df1-4de3-4a92-ac91-4e8c8b022da6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.805270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c204df1-4de3-4a92-ac91-4e8c8b022da6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.805965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c204df1-4de3-4a92-ac91-4e8c8b022da6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.806418 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c204df1-4de3-4a92-ac91-4e8c8b022da6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.806838 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6c204df1-4de3-4a92-ac91-4e8c8b022da6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.969662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6c204df1-4de3-4a92-ac91-4e8c8b022da6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:30.977710 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6c204df1-4de3-4a92-ac91-4e8c8b022da6 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1272 microversion: 2.1 time: 0.187141 Sep 10 11:55:30.978289 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2396/7116] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:30 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:32.001335 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f29ba922-f7b2-4705-883c-9ecad4420c2f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:32.001972 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f29ba922-f7b2-4705-883c-9ecad4420c2f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:32.008818 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f29ba922-f7b2-4705-883c-9ecad4420c2f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:32.009353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f29ba922-f7b2-4705-883c-9ecad4420c2f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:32.009811 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f29ba922-f7b2-4705-883c-9ecad4420c2f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:32.010521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f29ba922-f7b2-4705-883c-9ecad4420c2f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:32.010996 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f29ba922-f7b2-4705-883c-9ecad4420c2f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:32.011439 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f29ba922-f7b2-4705-883c-9ecad4420c2f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:32.147338 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f29ba922-f7b2-4705-883c-9ecad4420c2f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:32.155209 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f29ba922-f7b2-4705-883c-9ecad4420c2f tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1272 microversion: 2.1 time: 0.157844 Sep 10 11:55:32.155798 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4721/7117] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:31 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:33.178680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-01ad7cc9-8ada-4db9-8ee0-0d73743df432 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:33.179328 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-01ad7cc9-8ada-4db9-8ee0-0d73743df432 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:33.186192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01ad7cc9-8ada-4db9-8ee0-0d73743df432 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.186680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01ad7cc9-8ada-4db9-8ee0-0d73743df432 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.187118 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01ad7cc9-8ada-4db9-8ee0-0d73743df432 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.187801 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01ad7cc9-8ada-4db9-8ee0-0d73743df432 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.188256 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01ad7cc9-8ada-4db9-8ee0-0d73743df432 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.188679 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-01ad7cc9-8ada-4db9-8ee0-0d73743df432 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.320458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-01ad7cc9-8ada-4db9-8ee0-0d73743df432 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:33.328277 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-01ad7cc9-8ada-4db9-8ee0-0d73743df432 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1260 microversion: 2.1 time: 0.154404 Sep 10 11:55:33.328852 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2397/7118] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:33 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:34.352466 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-38c28283-e674-4781-95ac-01e57654b903 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:34.353151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-38c28283-e674-4781-95ac-01e57654b903 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:34.360076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38c28283-e674-4781-95ac-01e57654b903 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:34.360580 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38c28283-e674-4781-95ac-01e57654b903 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:34.361039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38c28283-e674-4781-95ac-01e57654b903 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.362481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38c28283-e674-4781-95ac-01e57654b903 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:34.362956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38c28283-e674-4781-95ac-01e57654b903 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:34.363404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-38c28283-e674-4781-95ac-01e57654b903 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.492745 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-38c28283-e674-4781-95ac-01e57654b903 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:34.500702 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-38c28283-e674-4781-95ac-01e57654b903 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1260 microversion: 2.1 time: 0.152143 Sep 10 11:55:34.501314 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4722/7119] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:34 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:35.523324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-760f1f3a-7c73-4923-b750-e723783ec3a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:35.523939 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-760f1f3a-7c73-4923-b750-e723783ec3a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:35.531334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-760f1f3a-7c73-4923-b750-e723783ec3a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.531934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-760f1f3a-7c73-4923-b750-e723783ec3a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.532379 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-760f1f3a-7c73-4923-b750-e723783ec3a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.533209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-760f1f3a-7c73-4923-b750-e723783ec3a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.533845 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-760f1f3a-7c73-4923-b750-e723783ec3a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.534293 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-760f1f3a-7c73-4923-b750-e723783ec3a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.667385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-760f1f3a-7c73-4923-b750-e723783ec3a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:35.678056 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-760f1f3a-7c73-4923-b750-e723783ec3a1 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1260 microversion: 2.1 time: 0.157997 Sep 10 11:55:35.678705 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2398/7120] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:35 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:36.703948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9a33445e-6d51-409e-a872-066fc006d1a8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:36.704671 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9a33445e-6d51-409e-a872-066fc006d1a8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:36.709295 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:36.714968 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a33445e-6d51-409e-a872-066fc006d1a8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.715479 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a33445e-6d51-409e-a872-066fc006d1a8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.715938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a33445e-6d51-409e-a872-066fc006d1a8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.716657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a33445e-6d51-409e-a872-066fc006d1a8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.717163 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a33445e-6d51-409e-a872-066fc006d1a8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.717618 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9a33445e-6d51-409e-a872-066fc006d1a8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.854020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9a33445e-6d51-409e-a872-066fc006d1a8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:36.862012 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9a33445e-6d51-409e-a872-066fc006d1a8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1260 microversion: 2.1 time: 0.164159 Sep 10 11:55:36.862610 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4723/7121] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:36 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:37.885056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-64e7b737-4c2b-4dbb-96e9-13ebc0931e51 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:37.885729 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-64e7b737-4c2b-4dbb-96e9-13ebc0931e51 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:37.887977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:37.888637 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:37.895156 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e7b737-4c2b-4dbb-96e9-13ebc0931e51 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:37.895641 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e7b737-4c2b-4dbb-96e9-13ebc0931e51 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:37.896080 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e7b737-4c2b-4dbb-96e9-13ebc0931e51 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:37.896767 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e7b737-4c2b-4dbb-96e9-13ebc0931e51 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:37.897246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e7b737-4c2b-4dbb-96e9-13ebc0931e51 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:37.897671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-64e7b737-4c2b-4dbb-96e9-13ebc0931e51 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:38.027957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-64e7b737-4c2b-4dbb-96e9-13ebc0931e51 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:38.036323 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-64e7b737-4c2b-4dbb-96e9-13ebc0931e51 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1260 microversion: 2.1 time: 0.155159 Sep 10 11:55:38.036890 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2399/7122] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:37 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:39.059436 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-1a87bb41-9337-4bcf-a435-a77ee53e9a7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:39.060103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-1a87bb41-9337-4bcf-a435-a77ee53e9a7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:39.066991 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a87bb41-9337-4bcf-a435-a77ee53e9a7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:39.067498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a87bb41-9337-4bcf-a435-a77ee53e9a7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:39.067956 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a87bb41-9337-4bcf-a435-a77ee53e9a7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:39.068670 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a87bb41-9337-4bcf-a435-a77ee53e9a7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:39.069174 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a87bb41-9337-4bcf-a435-a77ee53e9a7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:39.069624 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-1a87bb41-9337-4bcf-a435-a77ee53e9a7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:39.202988 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-1a87bb41-9337-4bcf-a435-a77ee53e9a7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:39.211607 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-1a87bb41-9337-4bcf-a435-a77ee53e9a7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1260 microversion: 2.1 time: 0.156148 Sep 10 11:55:39.212195 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4724/7123] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:39 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:40.235078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c8babf29-3c00-46a0-a2d3-912fc1ccc244 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:40.235632 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c8babf29-3c00-46a0-a2d3-912fc1ccc244 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:40.243298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8babf29-3c00-46a0-a2d3-912fc1ccc244 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:40.243777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8babf29-3c00-46a0-a2d3-912fc1ccc244 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:40.244218 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8babf29-3c00-46a0-a2d3-912fc1ccc244 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:40.244896 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8babf29-3c00-46a0-a2d3-912fc1ccc244 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:40.245373 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8babf29-3c00-46a0-a2d3-912fc1ccc244 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:40.245799 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c8babf29-3c00-46a0-a2d3-912fc1ccc244 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:40.374948 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c8babf29-3c00-46a0-a2d3-912fc1ccc244 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:40.382780 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c8babf29-3c00-46a0-a2d3-912fc1ccc244 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1260 microversion: 2.1 time: 0.151680 Sep 10 11:55:40.383354 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2400/7124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:40 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:41.405473 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0fb2cd0d-41d4-43f9-a60e-429744eae91a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:41.406110 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0fb2cd0d-41d4-43f9-a60e-429744eae91a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:41.413007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fb2cd0d-41d4-43f9-a60e-429744eae91a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:41.413552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fb2cd0d-41d4-43f9-a60e-429744eae91a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:41.414007 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fb2cd0d-41d4-43f9-a60e-429744eae91a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:41.414714 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fb2cd0d-41d4-43f9-a60e-429744eae91a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:41.415432 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fb2cd0d-41d4-43f9-a60e-429744eae91a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:41.415628 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0fb2cd0d-41d4-43f9-a60e-429744eae91a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:41.554558 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0fb2cd0d-41d4-43f9-a60e-429744eae91a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:41.562355 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0fb2cd0d-41d4-43f9-a60e-429744eae91a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1260 microversion: 2.1 time: 0.160875 Sep 10 11:55:41.562945 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4725/7125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:41 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:42.584614 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f8d17c46-d7cc-4c4c-8a23-fbb60be4de5d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:42.585246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f8d17c46-d7cc-4c4c-8a23-fbb60be4de5d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:42.592053 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8d17c46-d7cc-4c4c-8a23-fbb60be4de5d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:42.592530 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8d17c46-d7cc-4c4c-8a23-fbb60be4de5d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:42.592962 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8d17c46-d7cc-4c4c-8a23-fbb60be4de5d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:42.593694 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8d17c46-d7cc-4c4c-8a23-fbb60be4de5d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:42.594141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8d17c46-d7cc-4c4c-8a23-fbb60be4de5d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:42.594562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f8d17c46-d7cc-4c4c-8a23-fbb60be4de5d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:42.722454 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f8d17c46-d7cc-4c4c-8a23-fbb60be4de5d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:42.730161 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f8d17c46-d7cc-4c4c-8a23-fbb60be4de5d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1260 microversion: 2.1 time: 0.149504 Sep 10 11:55:42.730729 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2401/7126] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:42 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:43.135926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-52af1660-3c9d-4a73-b641-97cdc057158a req-5ecabc1d-37c9-44b4-afcc-b6a34ae69bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c98801f-9943-464e-8c0a-cd88062c2ee7", "name": "network-vif-plugged", "status": "completed", "tag": "0e146e7f-8a34-46ed-ba66-dd3d9610241c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:43.147155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-52af1660-3c9d-4a73-b641-97cdc057158a req-5ecabc1d-37c9-44b4-afcc-b6a34ae69bc7 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:43.147653 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-52af1660-3c9d-4a73-b641-97cdc057158a req-5ecabc1d-37c9-44b4-afcc-b6a34ae69bc7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:43.148095 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-52af1660-3c9d-4a73-b641-97cdc057158a req-5ecabc1d-37c9-44b4-afcc-b6a34ae69bc7 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:43.160115 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-52af1660-3c9d-4a73-b641-97cdc057158a req-5ecabc1d-37c9-44b4-afcc-b6a34ae69bc7 service nova] Creating event network-vif-plugged:0e146e7f-8a34-46ed-ba66-dd3d9610241c for instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 on n-h1-856894-1 Sep 10 11:55:43.165016 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-52af1660-3c9d-4a73-b641-97cdc057158a req-5ecabc1d-37c9-44b4-afcc-b6a34ae69bc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033135 Sep 10 11:55:43.165655 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4726/7127] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:43.754456 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d9cb7522-a24b-4f9a-a6ee-9e682048e76d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:43.755074 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d9cb7522-a24b-4f9a-a6ee-9e682048e76d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:43.761997 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9cb7522-a24b-4f9a-a6ee-9e682048e76d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:43.762482 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9cb7522-a24b-4f9a-a6ee-9e682048e76d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:43.762921 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9cb7522-a24b-4f9a-a6ee-9e682048e76d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:43.763670 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9cb7522-a24b-4f9a-a6ee-9e682048e76d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:43.764123 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9cb7522-a24b-4f9a-a6ee-9e682048e76d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:43.764550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d9cb7522-a24b-4f9a-a6ee-9e682048e76d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:43.896187 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d9cb7522-a24b-4f9a-a6ee-9e682048e76d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:43.903919 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d9cb7522-a24b-4f9a-a6ee-9e682048e76d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1260 microversion: 2.1 time: 0.154116 Sep 10 11:55:43.904497 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2402/7128] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:43 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:44.929371 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0cfb77a2-ccc4-44f6-8088-0ce68f723c2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:44.930094 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0cfb77a2-ccc4-44f6-8088-0ce68f723c2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:44.936360 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfb77a2-ccc4-44f6-8088-0ce68f723c2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:44.936864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfb77a2-ccc4-44f6-8088-0ce68f723c2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:44.937346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfb77a2-ccc4-44f6-8088-0ce68f723c2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:44.938059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfb77a2-ccc4-44f6-8088-0ce68f723c2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:44.938537 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfb77a2-ccc4-44f6-8088-0ce68f723c2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:44.939017 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0cfb77a2-ccc4-44f6-8088-0ce68f723c2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:45.072573 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0cfb77a2-ccc4-44f6-8088-0ce68f723c2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:45.080592 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0cfb77a2-ccc4-44f6-8088-0ce68f723c2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1445 microversion: 2.1 time: 0.157363 Sep 10 11:55:45.081210 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4727/7129] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:44 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:45.103916 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-03f30e8f-5477-4748-b6b9-83cbffb0d084 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:45.104537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-03f30e8f-5477-4748-b6b9-83cbffb0d084 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:45.111413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-03f30e8f-5477-4748-b6b9-83cbffb0d084 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:45.111904 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-03f30e8f-5477-4748-b6b9-83cbffb0d084 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:45.112393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-03f30e8f-5477-4748-b6b9-83cbffb0d084 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:45.113667 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-03f30e8f-5477-4748-b6b9-83cbffb0d084 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:45.114129 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-03f30e8f-5477-4748-b6b9-83cbffb0d084 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:45.114562 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-03f30e8f-5477-4748-b6b9-83cbffb0d084 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:45.243732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-03f30e8f-5477-4748-b6b9-83cbffb0d084 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:45.251579 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-03f30e8f-5477-4748-b6b9-83cbffb0d084 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1445 microversion: 2.1 time: 0.151629 Sep 10 11:55:45.252162 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2403/7130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:45 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:47.103188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3d41ce4d-9137-48d9-b973-320783acce62 req-7ccfe474-c1ca-42f9-bdf7-898a17137a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c98801f-9943-464e-8c0a-cd88062c2ee7", "tag": "0e146e7f-8a34-46ed-ba66-dd3d9610241c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:47.116579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d41ce4d-9137-48d9-b973-320783acce62 req-7ccfe474-c1ca-42f9-bdf7-898a17137a0d service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:47.116579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d41ce4d-9137-48d9-b973-320783acce62 req-7ccfe474-c1ca-42f9-bdf7-898a17137a0d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:47.116579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d41ce4d-9137-48d9-b973-320783acce62 req-7ccfe474-c1ca-42f9-bdf7-898a17137a0d service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:47.128674 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3d41ce4d-9137-48d9-b973-320783acce62 req-7ccfe474-c1ca-42f9-bdf7-898a17137a0d service nova] Creating event network-changed:0e146e7f-8a34-46ed-ba66-dd3d9610241c for instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 on n-h1-856894-1 Sep 10 11:55:47.135072 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3d41ce4d-9137-48d9-b973-320783acce62 req-7ccfe474-c1ca-42f9-bdf7-898a17137a0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035142 Sep 10 11:55:47.136014 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4728/7131] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:42.331385 n-d-856894-1 devstack@n-api.service[128787]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2d8a82b-a259-4271-b6a0-0b311d4f5a8a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 11:57:42.332296 n-d-856894-1 devstack@n-api.service[128787]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82f59b2c-52ef-4de0-bd4e-b551a69003cb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 11:57:42.333136 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:42.333878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=58 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:42.390732 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0f4afba8-be24-4e95-9de3-6af9cf742fe7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:42.391270 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0f4afba8-be24-4e95-9de3-6af9cf742fe7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:42.397367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f4afba8-be24-4e95-9de3-6af9cf742fe7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:42.397847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f4afba8-be24-4e95-9de3-6af9cf742fe7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:42.398282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f4afba8-be24-4e95-9de3-6af9cf742fe7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:42.398959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f4afba8-be24-4e95-9de3-6af9cf742fe7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:42.399412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f4afba8-be24-4e95-9de3-6af9cf742fe7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:42.399832 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0f4afba8-be24-4e95-9de3-6af9cf742fe7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:42.422542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-0f4afba8-be24-4e95-9de3-6af9cf742fe7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lazy-loading 'flavor' on Instance uuid 3c98801f-9943-464e-8c0a-cd88062c2ee7 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:57:42.496565 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0f4afba8-be24-4e95-9de3-6af9cf742fe7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "POST /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7/action" status: 202 len: 0 microversion: 2.1 time: 0.166786 Sep 10 11:57:42.497180 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2404/7132] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:57:42 2022] POST /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:57:42.503638 n-d-856894-1 devstack@n-api.service[128788]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff958037-a840-4114-b8eb-6b314978ef69] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 11:57:42.507864 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-8fb2cc9b-21b8-4a89-be26-c4701bffe654 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:42.508620 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-8fb2cc9b-21b8-4a89-be26-c4701bffe654 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:42.511213 n-d-856894-1 devstack@n-api.service[128788]: ERROR oslo.messaging._drivers.impl_rabbit [-] [692a762d-1b37-42dd-b4f2-d39ae0d79f32] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 11:57:42.511755 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=24 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:42.512542 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=52 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:42.513583 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:57:42.513753 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 11:57:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 (ip 10.222.0.20) !!! Sep 10 11:57:42.522162 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fb2cc9b-21b8-4a89-be26-c4701bffe654 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:42.522669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fb2cc9b-21b8-4a89-be26-c4701bffe654 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:42.523131 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fb2cc9b-21b8-4a89-be26-c4701bffe654 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:42.523855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fb2cc9b-21b8-4a89-be26-c4701bffe654 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:42.524404 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fb2cc9b-21b8-4a89-be26-c4701bffe654 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:42.524860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-8fb2cc9b-21b8-4a89-be26-c4701bffe654 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:42.668795 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-8fb2cc9b-21b8-4a89-be26-c4701bffe654 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:42.677041 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-8fb2cc9b-21b8-4a89-be26-c4701bffe654 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.175414 Sep 10 11:57:42.677641 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4729/7133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:42 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:43.701572 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fff59312-133c-4d33-baf0-1b0d28db1c8e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:43.702278 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fff59312-133c-4d33-baf0-1b0d28db1c8e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:43.716603 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fff59312-133c-4d33-baf0-1b0d28db1c8e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:43.717478 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fff59312-133c-4d33-baf0-1b0d28db1c8e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:43.718248 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fff59312-133c-4d33-baf0-1b0d28db1c8e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:43.719397 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fff59312-133c-4d33-baf0-1b0d28db1c8e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:43.720196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fff59312-133c-4d33-baf0-1b0d28db1c8e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:43.720696 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fff59312-133c-4d33-baf0-1b0d28db1c8e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:43.727153 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2d8a82b-a259-4271-b6a0-0b311d4f5a8a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51588. Sep 10 11:57:43.727975 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] [82f59b2c-52ef-4de0-bd4e-b551a69003cb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51590. Sep 10 11:57:43.857837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fff59312-133c-4d33-baf0-1b0d28db1c8e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:43.865714 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fff59312-133c-4d33-baf0-1b0d28db1c8e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.168458 Sep 10 11:57:43.866292 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2405/7134] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:43 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:44.888947 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a38f6898-c3ac-4525-9575-4543b1d07c89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:44.889611 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a38f6898-c3ac-4525-9575-4543b1d07c89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:44.899256 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a38f6898-c3ac-4525-9575-4543b1d07c89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:44.899759 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a38f6898-c3ac-4525-9575-4543b1d07c89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:44.900212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a38f6898-c3ac-4525-9575-4543b1d07c89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:44.900919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a38f6898-c3ac-4525-9575-4543b1d07c89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:44.901417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a38f6898-c3ac-4525-9575-4543b1d07c89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:44.901860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a38f6898-c3ac-4525-9575-4543b1d07c89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:44.908474 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] [692a762d-1b37-42dd-b4f2-d39ae0d79f32] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51596. Sep 10 11:57:44.909235 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff958037-a840-4114-b8eb-6b314978ef69] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51594. Sep 10 11:57:45.037310 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a38f6898-c3ac-4525-9575-4543b1d07c89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:45.045829 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a38f6898-c3ac-4525-9575-4543b1d07c89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.160840 Sep 10 11:57:45.046414 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4730/7135] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:44 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:46.070805 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-4b181feb-4881-4e13-a846-57bd822fbf5e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:46.071420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-4b181feb-4881-4e13-a846-57bd822fbf5e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:46.078219 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b181feb-4881-4e13-a846-57bd822fbf5e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:46.078697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b181feb-4881-4e13-a846-57bd822fbf5e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:46.079133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b181feb-4881-4e13-a846-57bd822fbf5e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:46.079811 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b181feb-4881-4e13-a846-57bd822fbf5e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:46.080265 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b181feb-4881-4e13-a846-57bd822fbf5e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:46.080686 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-4b181feb-4881-4e13-a846-57bd822fbf5e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:46.217831 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-4b181feb-4881-4e13-a846-57bd822fbf5e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:46.230546 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-4b181feb-4881-4e13-a846-57bd822fbf5e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.164108 Sep 10 11:57:46.231156 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2406/7136] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:46 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:47.259532 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-2659f495-3c4e-4d31-ab9f-b288a4701721 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:47.260166 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-2659f495-3c4e-4d31-ab9f-b288a4701721 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:47.267069 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2659f495-3c4e-4d31-ab9f-b288a4701721 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:47.267569 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2659f495-3c4e-4d31-ab9f-b288a4701721 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:47.268018 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2659f495-3c4e-4d31-ab9f-b288a4701721 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:47.268715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2659f495-3c4e-4d31-ab9f-b288a4701721 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:47.269215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2659f495-3c4e-4d31-ab9f-b288a4701721 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:47.269682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-2659f495-3c4e-4d31-ab9f-b288a4701721 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:47.397014 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-2659f495-3c4e-4d31-ab9f-b288a4701721 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:47.406393 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-2659f495-3c4e-4d31-ab9f-b288a4701721 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.150818 Sep 10 11:57:47.406976 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4731/7137] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:47 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:48.430195 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-46be1aad-a2bd-4643-b3ae-a600d56707c0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:48.430813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-46be1aad-a2bd-4643-b3ae-a600d56707c0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:48.437733 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46be1aad-a2bd-4643-b3ae-a600d56707c0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:48.438220 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46be1aad-a2bd-4643-b3ae-a600d56707c0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:48.438660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46be1aad-a2bd-4643-b3ae-a600d56707c0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:48.439352 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46be1aad-a2bd-4643-b3ae-a600d56707c0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:48.439809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46be1aad-a2bd-4643-b3ae-a600d56707c0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:48.440234 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-46be1aad-a2bd-4643-b3ae-a600d56707c0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:48.568409 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-46be1aad-a2bd-4643-b3ae-a600d56707c0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:48.576615 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-46be1aad-a2bd-4643-b3ae-a600d56707c0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.150407 Sep 10 11:57:48.577204 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2407/7138] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:48 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:49.600983 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a48f3445-87dd-4fd2-a2ed-c0e214e99f2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:49.601649 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a48f3445-87dd-4fd2-a2ed-c0e214e99f2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:49.608589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a48f3445-87dd-4fd2-a2ed-c0e214e99f2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:49.609115 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a48f3445-87dd-4fd2-a2ed-c0e214e99f2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:49.609574 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a48f3445-87dd-4fd2-a2ed-c0e214e99f2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:49.610276 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a48f3445-87dd-4fd2-a2ed-c0e214e99f2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:49.610752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a48f3445-87dd-4fd2-a2ed-c0e214e99f2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:49.611198 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a48f3445-87dd-4fd2-a2ed-c0e214e99f2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:49.747369 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a48f3445-87dd-4fd2-a2ed-c0e214e99f2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:49.757099 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a48f3445-87dd-4fd2-a2ed-c0e214e99f2d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.159744 Sep 10 11:57:49.757696 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4732/7139] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:49 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:50.780766 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-6d1e02b9-5453-4a2b-9da8-8e5562a2a8ac tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:50.781404 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-6d1e02b9-5453-4a2b-9da8-8e5562a2a8ac tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:50.788237 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1e02b9-5453-4a2b-9da8-8e5562a2a8ac tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:50.788716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1e02b9-5453-4a2b-9da8-8e5562a2a8ac tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:50.789170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1e02b9-5453-4a2b-9da8-8e5562a2a8ac tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:50.789855 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1e02b9-5453-4a2b-9da8-8e5562a2a8ac tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:50.790299 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1e02b9-5453-4a2b-9da8-8e5562a2a8ac tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:50.790716 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-6d1e02b9-5453-4a2b-9da8-8e5562a2a8ac tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:50.931060 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-6d1e02b9-5453-4a2b-9da8-8e5562a2a8ac tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:50.939056 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-6d1e02b9-5453-4a2b-9da8-8e5562a2a8ac tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.162150 Sep 10 11:57:50.939669 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2408/7140] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:50 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:51.963185 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-f038dfe9-d162-49a2-ab11-0ba393a4c486 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:51.963733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-f038dfe9-d162-49a2-ab11-0ba393a4c486 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:51.971159 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f038dfe9-d162-49a2-ab11-0ba393a4c486 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:51.971680 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f038dfe9-d162-49a2-ab11-0ba393a4c486 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:51.972146 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f038dfe9-d162-49a2-ab11-0ba393a4c486 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:51.972875 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f038dfe9-d162-49a2-ab11-0ba393a4c486 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:51.973476 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f038dfe9-d162-49a2-ab11-0ba393a4c486 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:51.973926 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-f038dfe9-d162-49a2-ab11-0ba393a4c486 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:52.111128 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-f038dfe9-d162-49a2-ab11-0ba393a4c486 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:52.119682 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-f038dfe9-d162-49a2-ab11-0ba393a4c486 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.160602 Sep 10 11:57:52.120269 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4733/7141] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:51 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:53.142825 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a1448729-b0d1-4aec-804d-f96717a93b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:53.143568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a1448729-b0d1-4aec-804d-f96717a93b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:53.152642 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1448729-b0d1-4aec-804d-f96717a93b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:53.153287 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1448729-b0d1-4aec-804d-f96717a93b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:53.154166 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1448729-b0d1-4aec-804d-f96717a93b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:53.155056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1448729-b0d1-4aec-804d-f96717a93b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:53.155685 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1448729-b0d1-4aec-804d-f96717a93b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:53.156163 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a1448729-b0d1-4aec-804d-f96717a93b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:53.298938 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a1448729-b0d1-4aec-804d-f96717a93b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:53.307856 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a1448729-b0d1-4aec-804d-f96717a93b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.168850 Sep 10 11:57:53.308448 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2409/7142] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:53 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:54.331984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-738271d2-b25b-4f71-8139-dbe1ab94fe7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:54.332696 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-738271d2-b25b-4f71-8139-dbe1ab94fe7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:54.339716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-738271d2-b25b-4f71-8139-dbe1ab94fe7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:54.340215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-738271d2-b25b-4f71-8139-dbe1ab94fe7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:54.340664 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-738271d2-b25b-4f71-8139-dbe1ab94fe7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:54.341478 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-738271d2-b25b-4f71-8139-dbe1ab94fe7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:54.341957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-738271d2-b25b-4f71-8139-dbe1ab94fe7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:54.342397 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-738271d2-b25b-4f71-8139-dbe1ab94fe7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:54.471390 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-738271d2-b25b-4f71-8139-dbe1ab94fe7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:54.480704 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-738271d2-b25b-4f71-8139-dbe1ab94fe7d tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.152952 Sep 10 11:57:54.481317 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4734/7143] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:54 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:55.504357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-465b0eef-b854-4c5a-86b3-52e8c4767a7e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:55.505092 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-465b0eef-b854-4c5a-86b3-52e8c4767a7e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:55.512374 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-465b0eef-b854-4c5a-86b3-52e8c4767a7e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:55.512866 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-465b0eef-b854-4c5a-86b3-52e8c4767a7e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:55.513336 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-465b0eef-b854-4c5a-86b3-52e8c4767a7e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:55.514035 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-465b0eef-b854-4c5a-86b3-52e8c4767a7e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:55.514491 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-465b0eef-b854-4c5a-86b3-52e8c4767a7e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:55.514915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-465b0eef-b854-4c5a-86b3-52e8c4767a7e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:55.655085 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-465b0eef-b854-4c5a-86b3-52e8c4767a7e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:55.663039 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-465b0eef-b854-4c5a-86b3-52e8c4767a7e tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.162709 Sep 10 11:57:55.663616 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2410/7144] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:55 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:56.687059 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4c1a607c-de57-4ad6-a47f-18a8d1383dd7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:56.687626 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4c1a607c-de57-4ad6-a47f-18a8d1383dd7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:56.694534 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1a607c-de57-4ad6-a47f-18a8d1383dd7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:56.695033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1a607c-de57-4ad6-a47f-18a8d1383dd7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:56.695483 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1a607c-de57-4ad6-a47f-18a8d1383dd7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:56.696186 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1a607c-de57-4ad6-a47f-18a8d1383dd7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:56.696650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1a607c-de57-4ad6-a47f-18a8d1383dd7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:56.697112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4c1a607c-de57-4ad6-a47f-18a8d1383dd7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:56.829243 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4c1a607c-de57-4ad6-a47f-18a8d1383dd7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:56.837283 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4c1a607c-de57-4ad6-a47f-18a8d1383dd7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1570 microversion: 2.1 time: 0.154137 Sep 10 11:57:56.837878 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4735/7145] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:56 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:56.860512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f6127faa-cf96-4b79-ad3a-fe2078fae133 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:56.861137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f6127faa-cf96-4b79-ad3a-fe2078fae133 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:56.868737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6127faa-cf96-4b79-ad3a-fe2078fae133 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:56.869438 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6127faa-cf96-4b79-ad3a-fe2078fae133 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:56.869878 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6127faa-cf96-4b79-ad3a-fe2078fae133 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:56.870571 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6127faa-cf96-4b79-ad3a-fe2078fae133 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:56.871214 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6127faa-cf96-4b79-ad3a-fe2078fae133 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:56.871662 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f6127faa-cf96-4b79-ad3a-fe2078fae133 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:56.952789 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f6127faa-cf96-4b79-ad3a-fe2078fae133 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128787) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 11:57:57.018399 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f6127faa-cf96-4b79-ad3a-fe2078fae133 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "POST /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7/action" status: 202 len: 0 microversion: 2.1 time: 0.161929 Sep 10 11:57:57.019050 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2411/7146] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 11:57:56 2022] POST /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:57:57.027909 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7a9928a7-5184-4004-ad10-14dbf409adc8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:57.028538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7a9928a7-5184-4004-ad10-14dbf409adc8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:57.034907 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9928a7-5184-4004-ad10-14dbf409adc8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:57.035407 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9928a7-5184-4004-ad10-14dbf409adc8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:57.035857 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9928a7-5184-4004-ad10-14dbf409adc8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:57.036593 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9928a7-5184-4004-ad10-14dbf409adc8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:57.037066 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9928a7-5184-4004-ad10-14dbf409adc8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:57.037717 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7a9928a7-5184-4004-ad10-14dbf409adc8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:57.180425 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7a9928a7-5184-4004-ad10-14dbf409adc8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:57.188815 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7a9928a7-5184-4004-ad10-14dbf409adc8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1518 microversion: 2.1 time: 0.164910 Sep 10 11:57:57.189381 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4736/7147] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:57 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:58.212622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c6fce81b-947e-4613-a960-940e0c8f1599 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:58.213296 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c6fce81b-947e-4613-a960-940e0c8f1599 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:58.220578 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6fce81b-947e-4613-a960-940e0c8f1599 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:58.221089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6fce81b-947e-4613-a960-940e0c8f1599 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:58.221536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6fce81b-947e-4613-a960-940e0c8f1599 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:58.222244 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6fce81b-947e-4613-a960-940e0c8f1599 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:58.222697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6fce81b-947e-4613-a960-940e0c8f1599 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:58.223122 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c6fce81b-947e-4613-a960-940e0c8f1599 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:58.364882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c6fce81b-947e-4613-a960-940e0c8f1599 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:58.372785 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c6fce81b-947e-4613-a960-940e0c8f1599 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1520 microversion: 2.1 time: 0.164783 Sep 10 11:57:58.385093 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2412/7148] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:58 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:59.397255 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-83bece4e-ae81-4d56-b23a-986056e009aa tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:59.398133 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-83bece4e-ae81-4d56-b23a-986056e009aa tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:59.405826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83bece4e-ae81-4d56-b23a-986056e009aa tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:59.406449 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83bece4e-ae81-4d56-b23a-986056e009aa tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:59.407024 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83bece4e-ae81-4d56-b23a-986056e009aa tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:59.407948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83bece4e-ae81-4d56-b23a-986056e009aa tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:59.408600 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83bece4e-ae81-4d56-b23a-986056e009aa tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:59.409241 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-83bece4e-ae81-4d56-b23a-986056e009aa tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:59.550206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-83bece4e-ae81-4d56-b23a-986056e009aa tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:59.558804 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-83bece4e-ae81-4d56-b23a-986056e009aa tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1520 microversion: 2.1 time: 0.165645 Sep 10 11:57:59.559674 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4737/7149] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:59 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:59.885885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-d32a9ffd-19a9-47f1-b87c-28575c9208d9 req-956b1d5c-12b0-4cea-855c-7c7a52286249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c98801f-9943-464e-8c0a-cd88062c2ee7", "name": "network-vif-unplugged", "status": "completed", "tag": "0e146e7f-8a34-46ed-ba66-dd3d9610241c"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:59.898621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d32a9ffd-19a9-47f1-b87c-28575c9208d9 req-956b1d5c-12b0-4cea-855c-7c7a52286249 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:59.898621 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d32a9ffd-19a9-47f1-b87c-28575c9208d9 req-956b1d5c-12b0-4cea-855c-7c7a52286249 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:59.899029 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-d32a9ffd-19a9-47f1-b87c-28575c9208d9 req-956b1d5c-12b0-4cea-855c-7c7a52286249 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:59.911090 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.compute.server_external_events [req-d32a9ffd-19a9-47f1-b87c-28575c9208d9 req-956b1d5c-12b0-4cea-855c-7c7a52286249 service nova] Unable to find a host for instance 3c98801f-9943-464e-8c0a-cd88062c2ee7. Dropping event network-vif-unplugged {{(pid=128787) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 11:57:59.911978 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-d32a9ffd-19a9-47f1-b87c-28575c9208d9 req-956b1d5c-12b0-4cea-855c-7c7a52286249 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030776 Sep 10 11:57:59.912566 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2413/7150] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 11:58:00.583887 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-509d3e7d-cc64-423e-9fb2-732e1d7a11c2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:00.585247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-509d3e7d-cc64-423e-9fb2-732e1d7a11c2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:00.592608 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509d3e7d-cc64-423e-9fb2-732e1d7a11c2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:00.593288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509d3e7d-cc64-423e-9fb2-732e1d7a11c2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:00.593577 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509d3e7d-cc64-423e-9fb2-732e1d7a11c2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:00.594297 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509d3e7d-cc64-423e-9fb2-732e1d7a11c2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:00.594765 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509d3e7d-cc64-423e-9fb2-732e1d7a11c2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:00.595272 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-509d3e7d-cc64-423e-9fb2-732e1d7a11c2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:00.729814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-509d3e7d-cc64-423e-9fb2-732e1d7a11c2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:00.737883 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-509d3e7d-cc64-423e-9fb2-732e1d7a11c2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1520 microversion: 2.1 time: 0.158354 Sep 10 11:58:00.738745 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4738/7151] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:00 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:01.762062 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-57220764-91d5-4fcc-b513-31d3b4c36806 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:01.762669 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-57220764-91d5-4fcc-b513-31d3b4c36806 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:01.769555 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57220764-91d5-4fcc-b513-31d3b4c36806 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:01.770079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57220764-91d5-4fcc-b513-31d3b4c36806 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:01.770467 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57220764-91d5-4fcc-b513-31d3b4c36806 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:01.771149 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57220764-91d5-4fcc-b513-31d3b4c36806 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:01.772128 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57220764-91d5-4fcc-b513-31d3b4c36806 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:01.772548 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-57220764-91d5-4fcc-b513-31d3b4c36806 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:01.902078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-57220764-91d5-4fcc-b513-31d3b4c36806 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:01.909953 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-57220764-91d5-4fcc-b513-31d3b4c36806 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1520 microversion: 2.1 time: 0.151784 Sep 10 11:58:01.910535 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2414/7152] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:01 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:02.935085 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-53f9d169-58ec-4d1e-ad37-9f95f4cc7986 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:02.935808 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-53f9d169-58ec-4d1e-ad37-9f95f4cc7986 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:02.942969 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f9d169-58ec-4d1e-ad37-9f95f4cc7986 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:02.944011 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f9d169-58ec-4d1e-ad37-9f95f4cc7986 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:02.944469 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f9d169-58ec-4d1e-ad37-9f95f4cc7986 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:02.945215 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f9d169-58ec-4d1e-ad37-9f95f4cc7986 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:02.945710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f9d169-58ec-4d1e-ad37-9f95f4cc7986 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:02.946156 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-53f9d169-58ec-4d1e-ad37-9f95f4cc7986 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:03.077992 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-53f9d169-58ec-4d1e-ad37-9f95f4cc7986 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:03.085941 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-53f9d169-58ec-4d1e-ad37-9f95f4cc7986 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.155519 Sep 10 11:58:03.086532 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4739/7153] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:02 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:04.109317 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d5bd365f-dc97-4e08-aa46-df75830a06cc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:04.109965 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d5bd365f-dc97-4e08-aa46-df75830a06cc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:04.117584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5bd365f-dc97-4e08-aa46-df75830a06cc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:04.118068 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5bd365f-dc97-4e08-aa46-df75830a06cc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:04.118507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5bd365f-dc97-4e08-aa46-df75830a06cc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:04.119196 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5bd365f-dc97-4e08-aa46-df75830a06cc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:04.119652 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5bd365f-dc97-4e08-aa46-df75830a06cc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:04.120077 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d5bd365f-dc97-4e08-aa46-df75830a06cc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:04.252563 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-d5bd365f-dc97-4e08-aa46-df75830a06cc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:04.260363 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d5bd365f-dc97-4e08-aa46-df75830a06cc tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.155017 Sep 10 11:58:04.260947 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2415/7154] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:04 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:05.282679 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6b6a4e2b-cab4-4b2e-bebc-7daab81b34a0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:05.283450 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6b6a4e2b-cab4-4b2e-bebc-7daab81b34a0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:05.291587 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e2b-cab4-4b2e-bebc-7daab81b34a0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:05.292091 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e2b-cab4-4b2e-bebc-7daab81b34a0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:05.292541 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e2b-cab4-4b2e-bebc-7daab81b34a0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:05.293278 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e2b-cab4-4b2e-bebc-7daab81b34a0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:05.293747 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e2b-cab4-4b2e-bebc-7daab81b34a0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:05.294182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b6a4e2b-cab4-4b2e-bebc-7daab81b34a0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:05.476098 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6b6a4e2b-cab4-4b2e-bebc-7daab81b34a0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:05.484175 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6b6a4e2b-cab4-4b2e-bebc-7daab81b34a0 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.205462 Sep 10 11:58:05.484799 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4740/7155] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:05 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:06.507777 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0dbdd6ad-fe09-47d1-9cdc-3a33574aa998 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:06.508385 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0dbdd6ad-fe09-47d1-9cdc-3a33574aa998 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:06.515254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dbdd6ad-fe09-47d1-9cdc-3a33574aa998 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:06.515737 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dbdd6ad-fe09-47d1-9cdc-3a33574aa998 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:06.516177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dbdd6ad-fe09-47d1-9cdc-3a33574aa998 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:06.516862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dbdd6ad-fe09-47d1-9cdc-3a33574aa998 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:06.517364 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dbdd6ad-fe09-47d1-9cdc-3a33574aa998 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:06.517793 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0dbdd6ad-fe09-47d1-9cdc-3a33574aa998 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:06.693993 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0dbdd6ad-fe09-47d1-9cdc-3a33574aa998 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:06.701844 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0dbdd6ad-fe09-47d1-9cdc-3a33574aa998 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.198011 Sep 10 11:58:06.702417 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2416/7156] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:06 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:07.724412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4ece2e47-1745-4f01-b99c-8f64793165c8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:07.725615 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4ece2e47-1745-4f01-b99c-8f64793165c8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:07.732540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ece2e47-1745-4f01-b99c-8f64793165c8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:07.733041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ece2e47-1745-4f01-b99c-8f64793165c8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:07.733531 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ece2e47-1745-4f01-b99c-8f64793165c8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:07.734236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ece2e47-1745-4f01-b99c-8f64793165c8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:07.734710 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ece2e47-1745-4f01-b99c-8f64793165c8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:07.735153 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4ece2e47-1745-4f01-b99c-8f64793165c8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:07.867770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4ece2e47-1745-4f01-b99c-8f64793165c8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:07.875639 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4ece2e47-1745-4f01-b99c-8f64793165c8 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.155257 Sep 10 11:58:07.876221 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4741/7157] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:07 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:08.899826 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fbe5cf3d-427a-4032-8de6-593f2fbf3e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:08.900472 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fbe5cf3d-427a-4032-8de6-593f2fbf3e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:08.907367 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbe5cf3d-427a-4032-8de6-593f2fbf3e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:08.907854 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbe5cf3d-427a-4032-8de6-593f2fbf3e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:08.908292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbe5cf3d-427a-4032-8de6-593f2fbf3e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:08.908977 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbe5cf3d-427a-4032-8de6-593f2fbf3e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:08.909458 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbe5cf3d-427a-4032-8de6-593f2fbf3e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:08.909885 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fbe5cf3d-427a-4032-8de6-593f2fbf3e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:09.038419 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fbe5cf3d-427a-4032-8de6-593f2fbf3e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:09.046211 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fbe5cf3d-427a-4032-8de6-593f2fbf3e9c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.150951 Sep 10 11:58:09.046788 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2417/7158] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:08 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:10.071512 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ba1c233f-9b4d-4262-90cf-e9b6db4d1bb7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:10.072150 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ba1c233f-9b4d-4262-90cf-e9b6db4d1bb7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:10.079414 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba1c233f-9b4d-4262-90cf-e9b6db4d1bb7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:10.079940 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba1c233f-9b4d-4262-90cf-e9b6db4d1bb7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:10.080393 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba1c233f-9b4d-4262-90cf-e9b6db4d1bb7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:10.081112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba1c233f-9b4d-4262-90cf-e9b6db4d1bb7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:10.081785 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba1c233f-9b4d-4262-90cf-e9b6db4d1bb7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:10.082226 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ba1c233f-9b4d-4262-90cf-e9b6db4d1bb7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:10.219669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-ba1c233f-9b4d-4262-90cf-e9b6db4d1bb7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:10.227657 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ba1c233f-9b4d-4262-90cf-e9b6db4d1bb7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.160882 Sep 10 11:58:10.228253 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4742/7159] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:10 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:11.250892 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a9d4614f-8456-48e1-9257-eebcd081b77a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:11.251503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a9d4614f-8456-48e1-9257-eebcd081b77a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:11.258257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d4614f-8456-48e1-9257-eebcd081b77a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:11.258743 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d4614f-8456-48e1-9257-eebcd081b77a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:11.259199 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d4614f-8456-48e1-9257-eebcd081b77a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:11.259882 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d4614f-8456-48e1-9257-eebcd081b77a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:11.260334 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d4614f-8456-48e1-9257-eebcd081b77a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:11.260756 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a9d4614f-8456-48e1-9257-eebcd081b77a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:11.264718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:11.391708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a9d4614f-8456-48e1-9257-eebcd081b77a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:11.400375 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a9d4614f-8456-48e1-9257-eebcd081b77a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.153421 Sep 10 11:58:11.400961 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2418/7160] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:11 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:12.423994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0bfcaf63-8cff-4a98-8c3a-ab2c7354f83b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:12.425141 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0bfcaf63-8cff-4a98-8c3a-ab2c7354f83b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:12.433145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0bfcaf63-8cff-4a98-8c3a-ab2c7354f83b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:12.433656 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0bfcaf63-8cff-4a98-8c3a-ab2c7354f83b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:12.434201 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0bfcaf63-8cff-4a98-8c3a-ab2c7354f83b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:12.435025 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0bfcaf63-8cff-4a98-8c3a-ab2c7354f83b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:12.435567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0bfcaf63-8cff-4a98-8c3a-ab2c7354f83b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:12.436016 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0bfcaf63-8cff-4a98-8c3a-ab2c7354f83b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:12.571290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-0bfcaf63-8cff-4a98-8c3a-ab2c7354f83b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:12.573585 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=89 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:12.580370 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0bfcaf63-8cff-4a98-8c3a-ab2c7354f83b tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.160515 Sep 10 11:58:12.580955 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4743/7161] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:12 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:13.604137 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-cec77d2d-87cf-4ff8-9325-ee5e25eab2b7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:13.604753 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-cec77d2d-87cf-4ff8-9325-ee5e25eab2b7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:13.607466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:13.612978 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec77d2d-87cf-4ff8-9325-ee5e25eab2b7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.613496 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec77d2d-87cf-4ff8-9325-ee5e25eab2b7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.613935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec77d2d-87cf-4ff8-9325-ee5e25eab2b7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.614644 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec77d2d-87cf-4ff8-9325-ee5e25eab2b7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.615101 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec77d2d-87cf-4ff8-9325-ee5e25eab2b7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.615524 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-cec77d2d-87cf-4ff8-9325-ee5e25eab2b7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.752298 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-cec77d2d-87cf-4ff8-9325-ee5e25eab2b7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:13.760125 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-cec77d2d-87cf-4ff8-9325-ee5e25eab2b7 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.160464 Sep 10 11:58:13.760718 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2419/7162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:13 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:14.022662 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-2c7451e3-3497-487f-8561-e15aa032dcfd req-e980357c-a91a-4a01-8d9f-ce0fc78f83e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c98801f-9943-464e-8c0a-cd88062c2ee7", "name": "network-vif-plugged", "status": "completed", "tag": "0e146e7f-8a34-46ed-ba66-dd3d9610241c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:14.028420 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=31 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:14.034240 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2c7451e3-3497-487f-8561-e15aa032dcfd req-e980357c-a91a-4a01-8d9f-ce0fc78f83e1 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:14.034737 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2c7451e3-3497-487f-8561-e15aa032dcfd req-e980357c-a91a-4a01-8d9f-ce0fc78f83e1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:14.035188 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-2c7451e3-3497-487f-8561-e15aa032dcfd req-e980357c-a91a-4a01-8d9f-ce0fc78f83e1 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:14.046456 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-2c7451e3-3497-487f-8561-e15aa032dcfd req-e980357c-a91a-4a01-8d9f-ce0fc78f83e1 service nova] Creating event network-vif-plugged:0e146e7f-8a34-46ed-ba66-dd3d9610241c for instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 on n-h1-856894-1 Sep 10 11:58:14.051783 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-2c7451e3-3497-487f-8561-e15aa032dcfd req-e980357c-a91a-4a01-8d9f-ce0fc78f83e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033568 Sep 10 11:58:14.052420 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4744/7163] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:14.783550 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-597c3913-7fb1-4178-b186-26f41b2c2b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:14.784170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-597c3913-7fb1-4178-b186-26f41b2c2b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:14.791727 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-597c3913-7fb1-4178-b186-26f41b2c2b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:14.792212 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-597c3913-7fb1-4178-b186-26f41b2c2b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:14.792650 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-597c3913-7fb1-4178-b186-26f41b2c2b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:14.793368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-597c3913-7fb1-4178-b186-26f41b2c2b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:14.793828 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-597c3913-7fb1-4178-b186-26f41b2c2b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:14.794251 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-597c3913-7fb1-4178-b186-26f41b2c2b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:14.930797 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-597c3913-7fb1-4178-b186-26f41b2c2b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:14.939307 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-597c3913-7fb1-4178-b186-26f41b2c2b89 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1576 microversion: 2.1 time: 0.159532 Sep 10 11:58:14.940053 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2420/7164] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:14 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:15.964725 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-4b0380fa-735f-42f5-9509-2cd5df1e7e01 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:15.965372 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-4b0380fa-735f-42f5-9509-2cd5df1e7e01 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:15.971848 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b0380fa-735f-42f5-9509-2cd5df1e7e01 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:15.972353 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b0380fa-735f-42f5-9509-2cd5df1e7e01 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:15.972840 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b0380fa-735f-42f5-9509-2cd5df1e7e01 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:15.973601 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b0380fa-735f-42f5-9509-2cd5df1e7e01 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:15.974657 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b0380fa-735f-42f5-9509-2cd5df1e7e01 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:15.975102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-4b0380fa-735f-42f5-9509-2cd5df1e7e01 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:16.108247 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-4b0380fa-735f-42f5-9509-2cd5df1e7e01 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:16.116135 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-4b0380fa-735f-42f5-9509-2cd5df1e7e01 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1563 microversion: 2.1 time: 0.157469 Sep 10 11:58:16.116707 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4745/7165] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:15 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:30.401730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=3 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:30.402485 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=16 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:30.404110 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:59:30.404253 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 11:59:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 (ip 10.222.0.20) !!! Sep 10 11:59:30.412792 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:30.413579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=9 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:30.414808 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:59:30.414959 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 11:59:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 10 11:59:30.419504 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-41b5456e-71f6-40d6-82b1-9fac35d41770 req-b15799c8-c9e5-4c3d-bd71-b4dc26dc844b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c98801f-9943-464e-8c0a-cd88062c2ee7", "tag": "0e146e7f-8a34-46ed-ba66-dd3d9610241c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:30.421330 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-9c5934b0-201e-4392-898b-6eb749614b94 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:30.421935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9c5934b0-201e-4392-898b-6eb749614b94 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:30.434893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c5934b0-201e-4392-898b-6eb749614b94 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:30.435649 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c5934b0-201e-4392-898b-6eb749614b94 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:30.436089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c5934b0-201e-4392-898b-6eb749614b94 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:30.436790 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c5934b0-201e-4392-898b-6eb749614b94 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:30.437513 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c5934b0-201e-4392-898b-6eb749614b94 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:30.437718 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-9c5934b0-201e-4392-898b-6eb749614b94 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:30.438139 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41b5456e-71f6-40d6-82b1-9fac35d41770 req-b15799c8-c9e5-4c3d-bd71-b4dc26dc844b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:30.438834 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41b5456e-71f6-40d6-82b1-9fac35d41770 req-b15799c8-c9e5-4c3d-bd71-b4dc26dc844b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:30.439523 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-41b5456e-71f6-40d6-82b1-9fac35d41770 req-b15799c8-c9e5-4c3d-bd71-b4dc26dc844b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:30.452211 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-41b5456e-71f6-40d6-82b1-9fac35d41770 req-b15799c8-c9e5-4c3d-bd71-b4dc26dc844b service nova] Creating event network-changed:0e146e7f-8a34-46ed-ba66-dd3d9610241c for instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 on n-h1-856894-1 Sep 10 11:59:30.461264 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-41b5456e-71f6-40d6-82b1-9fac35d41770 req-b15799c8-c9e5-4c3d-bd71-b4dc26dc844b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049369 Sep 10 11:59:30.461906 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4746/7166] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:30.472093 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-9c5934b0-201e-4392-898b-6eb749614b94 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:59:30.569394 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-9c5934b0-201e-4392-898b-6eb749614b94 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 204 len: 0 microversion: 2.1 time: 0.169190 Sep 10 11:59:30.570178 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2421/7167] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 11:59:30 2022] DELETE /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:59:30.579458 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fc171cc1-5503-415a-b0da-58a72475c322 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:30.580543 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fc171cc1-5503-415a-b0da-58a72475c322 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:30.587412 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc171cc1-5503-415a-b0da-58a72475c322 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:30.588114 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc171cc1-5503-415a-b0da-58a72475c322 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:30.588860 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc171cc1-5503-415a-b0da-58a72475c322 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:30.589721 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc171cc1-5503-415a-b0da-58a72475c322 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:30.591384 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc171cc1-5503-415a-b0da-58a72475c322 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:30.591967 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fc171cc1-5503-415a-b0da-58a72475c322 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:30.735358 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fc171cc1-5503-415a-b0da-58a72475c322 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:30.743252 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fc171cc1-5503-415a-b0da-58a72475c322 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.168391 Sep 10 11:59:30.743850 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4747/7168] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:30 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:59:31.767401 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-e4673d18-42f0-469e-8d47-d6a52ec6cb3c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:31.768111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-e4673d18-42f0-469e-8d47-d6a52ec6cb3c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:31.775079 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4673d18-42f0-469e-8d47-d6a52ec6cb3c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:31.775569 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4673d18-42f0-469e-8d47-d6a52ec6cb3c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:31.776006 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4673d18-42f0-469e-8d47-d6a52ec6cb3c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:31.776700 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4673d18-42f0-469e-8d47-d6a52ec6cb3c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:31.777179 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4673d18-42f0-469e-8d47-d6a52ec6cb3c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:31.777612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-e4673d18-42f0-469e-8d47-d6a52ec6cb3c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:31.912229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-e4673d18-42f0-469e-8d47-d6a52ec6cb3c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:31.920110 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-e4673d18-42f0-469e-8d47-d6a52ec6cb3c tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1569 microversion: 2.1 time: 0.157035 Sep 10 11:59:31.920689 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2422/7169] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:31 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:32.524457 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-335b610e-3afe-4c90-bd9b-d78b9b4bf80f req-b86d48e3-260a-438a-bf7b-aa9af9ba19e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c98801f-9943-464e-8c0a-cd88062c2ee7", "name": "network-vif-deleted", "tag": "0e146e7f-8a34-46ed-ba66-dd3d9610241c"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:32.536919 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-335b610e-3afe-4c90-bd9b-d78b9b4bf80f req-b86d48e3-260a-438a-bf7b-aa9af9ba19e6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:32.537549 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-335b610e-3afe-4c90-bd9b-d78b9b4bf80f req-b86d48e3-260a-438a-bf7b-aa9af9ba19e6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:32.537892 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-335b610e-3afe-4c90-bd9b-d78b9b4bf80f req-b86d48e3-260a-438a-bf7b-aa9af9ba19e6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:32.550304 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-335b610e-3afe-4c90-bd9b-d78b9b4bf80f req-b86d48e3-260a-438a-bf7b-aa9af9ba19e6 service nova] Creating event network-vif-deleted:0e146e7f-8a34-46ed-ba66-dd3d9610241c for instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 on n-h1-856894-1 Sep 10 11:59:32.555174 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-335b610e-3afe-4c90-bd9b-d78b9b4bf80f req-b86d48e3-260a-438a-bf7b-aa9af9ba19e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034551 Sep 10 11:59:32.555771 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4748/7170] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:32.946408 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8a02c292-b178-4610-9d84-0d30ad701ad2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:32.947076 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-8a02c292-b178-4610-9d84-0d30ad701ad2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:32.954125 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a02c292-b178-4610-9d84-0d30ad701ad2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:32.954677 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a02c292-b178-4610-9d84-0d30ad701ad2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:32.955177 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a02c292-b178-4610-9d84-0d30ad701ad2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:32.955945 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a02c292-b178-4610-9d84-0d30ad701ad2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:32.956468 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a02c292-b178-4610-9d84-0d30ad701ad2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:32.956952 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-8a02c292-b178-4610-9d84-0d30ad701ad2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:33.021795 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-8a02c292-b178-4610-9d84-0d30ad701ad2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:33.029626 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8a02c292-b178-4610-9d84-0d30ad701ad2 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1219 microversion: 2.1 time: 0.087652 Sep 10 11:59:33.030188 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2423/7171] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:32 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:34.058145 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-7b5a6c7f-ff89-4580-8307-1f2271d02c6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:34.058854 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-7b5a6c7f-ff89-4580-8307-1f2271d02c6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:34.067567 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5a6c7f-ff89-4580-8307-1f2271d02c6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:34.068088 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5a6c7f-ff89-4580-8307-1f2271d02c6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:34.068545 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5a6c7f-ff89-4580-8307-1f2271d02c6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:34.069299 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5a6c7f-ff89-4580-8307-1f2271d02c6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:34.069775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5a6c7f-ff89-4580-8307-1f2271d02c6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:34.070220 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-7b5a6c7f-ff89-4580-8307-1f2271d02c6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:34.135280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-7b5a6c7f-ff89-4580-8307-1f2271d02c6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:34.143751 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-7b5a6c7f-ff89-4580-8307-1f2271d02c6a tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1219 microversion: 2.1 time: 0.095127 Sep 10 11:59:34.144425 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4749/7172] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:34 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:35.167875 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0cdbb9a3-3188-4895-8d29-8232b06fe660 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:35.168417 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0cdbb9a3-3188-4895-8d29-8232b06fe660 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:35.176084 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0cdbb9a3-3188-4895-8d29-8232b06fe660 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:35.176585 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0cdbb9a3-3188-4895-8d29-8232b06fe660 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:35.177009 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0cdbb9a3-3188-4895-8d29-8232b06fe660 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:35.177726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0cdbb9a3-3188-4895-8d29-8232b06fe660 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:35.178180 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0cdbb9a3-3188-4895-8d29-8232b06fe660 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:35.178605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0cdbb9a3-3188-4895-8d29-8232b06fe660 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:35.240412 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0cdbb9a3-3188-4895-8d29-8232b06fe660 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:35.248323 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0cdbb9a3-3188-4895-8d29-8232b06fe660 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1219 microversion: 2.1 time: 0.084427 Sep 10 11:59:35.248900 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2424/7173] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:35 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:36.272427 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-a814cbfe-dca8-43e3-b779-aeefa1a158fd tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:36.273062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-a814cbfe-dca8-43e3-b779-aeefa1a158fd tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:36.280033 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a814cbfe-dca8-43e3-b779-aeefa1a158fd tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:36.280540 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a814cbfe-dca8-43e3-b779-aeefa1a158fd tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:36.281000 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a814cbfe-dca8-43e3-b779-aeefa1a158fd tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:36.281735 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a814cbfe-dca8-43e3-b779-aeefa1a158fd tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:36.282211 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a814cbfe-dca8-43e3-b779-aeefa1a158fd tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:36.282659 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-a814cbfe-dca8-43e3-b779-aeefa1a158fd tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:36.348743 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-a814cbfe-dca8-43e3-b779-aeefa1a158fd tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e981f02179043da99a961c716ccc1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c660f1f8d71a46d9bcb9661f56b2a88f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:36.356805 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-a814cbfe-dca8-43e3-b779-aeefa1a158fd tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 200 len: 1219 microversion: 2.1 time: 0.088866 Sep 10 11:59:36.357500 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4750/7174] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:36 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:37.380400 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:37.381086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] [instance: 3c98801f-9943-464e-8c0a-cd88062c2ee7] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:37.388464 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:37.388959 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:37.389420 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:37.390133 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:37.390582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:37.391031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:37.406111 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.wsgi [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] HTTP exception thrown: Instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 could not be found. Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Request method failure captured: Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: request: GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 HTTP/1.1 Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: Accept: application/json Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: Accept-Encoding: identity Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: Connection: close Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: Content-Length: 0 Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: Content-Type: application/json Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: Host: 10.222.0.20 Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: Openstack-System-Scope: None Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Auth-Token: gAAAAABjHHoYCODTK4w5m7QiiSecf7X6qDNNe68VWJ-2vJOd5y1h7tgSxsvQWuMToiJGExhg7WydlG-PqkmSrckbR9_-YaCpm3Hs6blOX6B1ZvPlY0s_EZf90-8ElnqpklBN43hw9WvkAK2ILcjmJgOyv6k4quVO6FCTx1iSqq02swLjlmZy13U Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Id: None Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Domain-Name: None Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Identity-Status: Confirmed Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Is-Admin-Project: True Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Id: default Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Domain-Name: Default Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Id: c660f1f8d71a46d9bcb9661f56b2a88f Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Project-Name: tempest-TestShelveInstance-1586732419 Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Role: member,reader Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Roles: member,reader Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c660f1f8d71a46d9bcb9661f56b2a88f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c660f1f8d71a46d9bcb9661f56b2a88f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c660f1f8d71a46d9bcb9661f56b2a88f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c660f1f8d71a46d9bcb9661f56b2a88f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant: tempest-TestShelveInstance-1586732419 Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Id: c660f1f8d71a46d9bcb9661f56b2a88f Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-Tenant-Name: tempest-TestShelveInstance-1586732419 Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-User: tempest-TestShelveInstance-1586732419-project Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Id: default Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-User-Domain-Name: Default Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-User-Id: 9e981f02179043da99a961c716ccc1c5 Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: X-User-Name: tempest-TestShelveInstance-1586732419-project Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: method: > Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: exception: Instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 could not be found. Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: action_args: {'id': '3c98801f-9943-464e-8c0a-cd88062c2ee7'} Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 could not be found. Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 could not be found. Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:37.407779 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:59:37.413809 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:37.413809 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:37.413809 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:37.413809 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:37.413809 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:37.413809 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 could not be found. Sep 10 11:59:37.413809 n-d-856894-1 devstack@n-api.service[128787]: ERROR nova.api.openstack.wsgi Sep 10 11:59:37.413809 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Returning 404 to user: Instance 3c98801f-9943-464e-8c0a-cd88062c2ee7 could not be found. {{(pid=128787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:37.413809 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-d6aa228d-d7ac-41fe-ae88-47b6f1ba28b9 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7" status: 404 len: 111 microversion: 2.1 time: 0.033302 Sep 10 11:59:37.413809 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2425/7175] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:37 2022] GET /compute/v2.1/servers/3c98801f-9943-464e-8c0a-cd88062c2ee7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:37.577666 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-73b6488a-0f3b-4cc8-afda-a7181d1a7954 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] Calling method '.version_select at 0x7efcadd11b80>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:37.603571 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-73b6488a-0f3b-4cc8-afda-a7181d1a7954 tempest-TestShelveInstance-1586732419 tempest-TestShelveInstance-1586732419-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1335641194" status: 202 len: 0 microversion: 2.1 time: 0.030128 Sep 10 11:59:37.604175 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4751/7176] 10.222.0.20 () {58 vars in 1254 bytes} [Sat Sep 10 11:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1335641194 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:59:55.029748 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:55.031443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:55.233695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fcab2f35-f291-449c-bbda-d4ca205929b6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Action: 'create', calling method: .version_select at 0x7efcae6cc280>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1914489250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnZvBSoJxgZ5DVQPA+ieOqzaWEPfalFHpRQpLXrt3lal3vC8mZKAqJB+Ds/TgG0DfDck2lwroiEKJm7/GFLz+bRAHJI2V1cvqJPL8Az8TdEW6yvW60E6fnieX/TdiYPAw=="}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:55.249622 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-fcab2f35-f291-449c-bbda-d4ca205929b6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Getting quotas for project 4e0a2190350041fa9b4825962b223a20. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:59:55.255612 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.quota [None req-fcab2f35-f291-449c-bbda-d4ca205929b6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Getting quotas for user 8f7d6914e3804d1795c53e43d60f691d and project 4e0a2190350041fa9b4825962b223a20. Resources: {'key_pairs'} {{(pid=128787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:59:55.286339 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fcab2f35-f291-449c-bbda-d4ca205929b6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.261810 Sep 10 11:59:55.287058 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2426/7177] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Sep 10 11:59:55 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:56.370001 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=22 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:56.371349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:56.375570 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-987267722", "imageRef": "df822980-bfab-4f6c-b4bc-2e31dca2c2a5", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1914489250", "security_groups": [{"name": "tempest-secgroup-smoke-151105398"}], "networks": [{"uuid": "704b645b-9c5d-4c93-b446-314a450295af"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:56.483855 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] validate_networks() for [('704b645b-9c5d-4c93-b446-314a450295af', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:59:56.967431 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:59:56.967874 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:59:56.968612 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:59:56.969099 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:59:56.969579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:59:56.978538 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:56.979074 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:56.979559 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:56.980301 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:56.980767 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:56.981250 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:57.000165 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Getting quotas for project 4e0a2190350041fa9b4825962b223a20. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:59:57.006194 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Getting quotas for user 8f7d6914e3804d1795c53e43d60f691d and project 4e0a2190350041fa9b4825962b223a20. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:59:57.019839 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:59:57.022289 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df822980-bfab-4f6c-b4bc-2e31dca2c2a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:59:57.071635 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e16176e3-2cb0-4767-90e9-f2f3dcd1da73 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703566 Sep 10 11:59:57.072302 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4752/7178] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 11:59:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:59:57.093935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-5e882e0b-5fff-4e27-b78f-5c106c8b9cba tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:57.095229 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-5e882e0b-5fff-4e27-b78f-5c106c8b9cba tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:57.167559 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-5e882e0b-5fff-4e27-b78f-5c106c8b9cba tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:57.175486 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-5e882e0b-5fff-4e27-b78f-5c106c8b9cba tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1248 microversion: 2.1 time: 0.095011 Sep 10 11:59:57.175991 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2427/7179] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:57 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1248 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:59:58.199715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b88246b2-00e1-42f6-9606-17c3e73fe4ff tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:58.201579 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b88246b2-00e1-42f6-9606-17c3e73fe4ff tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:58.209380 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88246b2-00e1-42f6-9606-17c3e73fe4ff tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.210147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88246b2-00e1-42f6-9606-17c3e73fe4ff tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.210770 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88246b2-00e1-42f6-9606-17c3e73fe4ff tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.211676 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88246b2-00e1-42f6-9606-17c3e73fe4ff tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.212305 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88246b2-00e1-42f6-9606-17c3e73fe4ff tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.212908 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b88246b2-00e1-42f6-9606-17c3e73fe4ff tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.281246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b88246b2-00e1-42f6-9606-17c3e73fe4ff tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:58.289548 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b88246b2-00e1-42f6-9606-17c3e73fe4ff tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1300 microversion: 2.1 time: 0.094139 Sep 10 11:59:58.290387 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4753/7180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:58 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:59.313699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-943ee42f-4d26-4bd3-a589-ddd29a1869ea tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:59.314216 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-943ee42f-4d26-4bd3-a589-ddd29a1869ea tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:59.328818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-943ee42f-4d26-4bd3-a589-ddd29a1869ea tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:59.329722 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-943ee42f-4d26-4bd3-a589-ddd29a1869ea tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:59.330935 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-943ee42f-4d26-4bd3-a589-ddd29a1869ea tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:59.332052 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-943ee42f-4d26-4bd3-a589-ddd29a1869ea tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:59.332757 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-943ee42f-4d26-4bd3-a589-ddd29a1869ea tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:59.333529 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-943ee42f-4d26-4bd3-a589-ddd29a1869ea tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:59.548089 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-943ee42f-4d26-4bd3-a589-ddd29a1869ea tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:59.556638 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-943ee42f-4d26-4bd3-a589-ddd29a1869ea tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1373 microversion: 2.1 time: 0.246748 Sep 10 11:59:59.558065 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2428/7181] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:59 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1373 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:59.937206 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-01cb0bca-dcff-489b-8e3f-e09d843d824a req-c2c525d0-4e7b-424e-a761-caacd07a672c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d0ab72-b531-47ea-9e3b-cdc0571383e1", "tag": "71d52059-a9f7-4ca2-bcca-01ea0235634e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:59.954702 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-01cb0bca-dcff-489b-8e3f-e09d843d824a req-c2c525d0-4e7b-424e-a761-caacd07a672c service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:59.955560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-01cb0bca-dcff-489b-8e3f-e09d843d824a req-c2c525d0-4e7b-424e-a761-caacd07a672c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:59.956096 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-01cb0bca-dcff-489b-8e3f-e09d843d824a req-c2c525d0-4e7b-424e-a761-caacd07a672c service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:59.968303 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-01cb0bca-dcff-489b-8e3f-e09d843d824a req-c2c525d0-4e7b-424e-a761-caacd07a672c service nova] Creating event network-changed:71d52059-a9f7-4ca2-bcca-01ea0235634e for instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 on n-h1-856894-1 Sep 10 11:59:59.973781 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-01cb0bca-dcff-489b-8e3f-e09d843d824a req-c2c525d0-4e7b-424e-a761-caacd07a672c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041681 Sep 10 11:59:59.975108 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4754/7182] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:00.581111 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-88a28353-424c-4033-af6f-8495b8760032 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:00.581730 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-88a28353-424c-4033-af6f-8495b8760032 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:00.588596 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88a28353-424c-4033-af6f-8495b8760032 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:00.589116 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88a28353-424c-4033-af6f-8495b8760032 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:00.589565 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88a28353-424c-4033-af6f-8495b8760032 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:00.590263 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88a28353-424c-4033-af6f-8495b8760032 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:00.590726 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88a28353-424c-4033-af6f-8495b8760032 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:00.591155 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-88a28353-424c-4033-af6f-8495b8760032 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:00.728560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-88a28353-424c-4033-af6f-8495b8760032 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:00.736264 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-88a28353-424c-4033-af6f-8495b8760032 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1373 microversion: 2.1 time: 0.159149 Sep 10 12:00:00.736845 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2429/7183] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:00 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:01.760775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cf191e90-c868-4cf4-84ce-ae18fb2b6627 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:01.761526 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cf191e90-c868-4cf4-84ce-ae18fb2b6627 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:01.767777 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf191e90-c868-4cf4-84ce-ae18fb2b6627 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:01.768237 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf191e90-c868-4cf4-84ce-ae18fb2b6627 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:01.768700 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf191e90-c868-4cf4-84ce-ae18fb2b6627 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:01.769447 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf191e90-c868-4cf4-84ce-ae18fb2b6627 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:01.769922 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf191e90-c868-4cf4-84ce-ae18fb2b6627 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:01.770441 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cf191e90-c868-4cf4-84ce-ae18fb2b6627 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:01.905505 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cf191e90-c868-4cf4-84ce-ae18fb2b6627 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:01.914976 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cf191e90-c868-4cf4-84ce-ae18fb2b6627 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1373 microversion: 2.1 time: 0.159243 Sep 10 12:00:01.915567 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4755/7184] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:01 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:02.937883 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-1932946c-fbfb-47c0-b5dd-e7e5df5713d6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:02.938536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-1932946c-fbfb-47c0-b5dd-e7e5df5713d6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:02.945927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1932946c-fbfb-47c0-b5dd-e7e5df5713d6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:02.946676 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1932946c-fbfb-47c0-b5dd-e7e5df5713d6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:02.947113 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1932946c-fbfb-47c0-b5dd-e7e5df5713d6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:02.947823 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1932946c-fbfb-47c0-b5dd-e7e5df5713d6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:02.948281 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1932946c-fbfb-47c0-b5dd-e7e5df5713d6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:02.948706 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-1932946c-fbfb-47c0-b5dd-e7e5df5713d6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:03.079056 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-1932946c-fbfb-47c0-b5dd-e7e5df5713d6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:03.087364 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-1932946c-fbfb-47c0-b5dd-e7e5df5713d6 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1373 microversion: 2.1 time: 0.153423 Sep 10 12:00:03.087941 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2430/7185] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:02 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:04.110832 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-e8e383ad-f9f2-43fa-96af-c9a52362d22e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:04.112112 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-e8e383ad-f9f2-43fa-96af-c9a52362d22e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:04.119108 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8e383ad-f9f2-43fa-96af-c9a52362d22e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:04.119617 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8e383ad-f9f2-43fa-96af-c9a52362d22e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:04.120073 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8e383ad-f9f2-43fa-96af-c9a52362d22e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:04.120778 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8e383ad-f9f2-43fa-96af-c9a52362d22e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:04.121288 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8e383ad-f9f2-43fa-96af-c9a52362d22e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:04.121733 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-e8e383ad-f9f2-43fa-96af-c9a52362d22e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:04.252650 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-e8e383ad-f9f2-43fa-96af-c9a52362d22e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:04.260375 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-e8e383ad-f9f2-43fa-96af-c9a52362d22e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1373 microversion: 2.1 time: 0.153580 Sep 10 12:00:04.260964 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4756/7186] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:04 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:04.646413 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-06494e38-0718-4e30-95a9-5d7f2d90f4f8 req-e2415ded-b6f6-40f5-932d-b3ca2ea85afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d0ab72-b531-47ea-9e3b-cdc0571383e1", "name": "network-vif-plugged", "status": "completed", "tag": "71d52059-a9f7-4ca2-bcca-01ea0235634e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:04.656618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-06494e38-0718-4e30-95a9-5d7f2d90f4f8 req-e2415ded-b6f6-40f5-932d-b3ca2ea85afb service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:04.657132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-06494e38-0718-4e30-95a9-5d7f2d90f4f8 req-e2415ded-b6f6-40f5-932d-b3ca2ea85afb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:04.657568 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-06494e38-0718-4e30-95a9-5d7f2d90f4f8 req-e2415ded-b6f6-40f5-932d-b3ca2ea85afb service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:04.669676 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-06494e38-0718-4e30-95a9-5d7f2d90f4f8 req-e2415ded-b6f6-40f5-932d-b3ca2ea85afb service nova] Creating event network-vif-plugged:71d52059-a9f7-4ca2-bcca-01ea0235634e for instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 on n-h1-856894-1 Sep 10 12:00:04.675027 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-06494e38-0718-4e30-95a9-5d7f2d90f4f8 req-e2415ded-b6f6-40f5-932d-b3ca2ea85afb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091408 Sep 10 12:00:04.675629 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2431/7187] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:05.282942 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-9fbfec09-49a1-4e24-a0b1-a8be9ad77971 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:05.283606 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-9fbfec09-49a1-4e24-a0b1-a8be9ad77971 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:05.290701 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbfec09-49a1-4e24-a0b1-a8be9ad77971 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.291212 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbfec09-49a1-4e24-a0b1-a8be9ad77971 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.291669 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbfec09-49a1-4e24-a0b1-a8be9ad77971 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.292386 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbfec09-49a1-4e24-a0b1-a8be9ad77971 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.292858 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbfec09-49a1-4e24-a0b1-a8be9ad77971 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.293417 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-9fbfec09-49a1-4e24-a0b1-a8be9ad77971 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.433851 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-9fbfec09-49a1-4e24-a0b1-a8be9ad77971 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:05.442180 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-9fbfec09-49a1-4e24-a0b1-a8be9ad77971 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1373 microversion: 2.1 time: 0.163212 Sep 10 12:00:05.442765 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4757/7188] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:05 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:06.466366 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-96c2fb7c-b40a-4593-84fa-f70671e7cffa tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:06.467078 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-96c2fb7c-b40a-4593-84fa-f70671e7cffa tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:06.473347 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c2fb7c-b40a-4593-84fa-f70671e7cffa tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:06.473836 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c2fb7c-b40a-4593-84fa-f70671e7cffa tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:06.474277 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c2fb7c-b40a-4593-84fa-f70671e7cffa tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:06.474973 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c2fb7c-b40a-4593-84fa-f70671e7cffa tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:06.475433 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c2fb7c-b40a-4593-84fa-f70671e7cffa tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:06.475864 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-96c2fb7c-b40a-4593-84fa-f70671e7cffa tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:06.635755 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-96c2fb7c-b40a-4593-84fa-f70671e7cffa tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:06.644074 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-96c2fb7c-b40a-4593-84fa-f70671e7cffa tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1558 microversion: 2.1 time: 0.182954 Sep 10 12:00:06.644652 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2432/7189] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:06 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:06.666349 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-13b9ef63-076e-4f22-8c72-46843ed7feec tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:06.667147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-13b9ef63-076e-4f22-8c72-46843ed7feec tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:06.674981 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13b9ef63-076e-4f22-8c72-46843ed7feec tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:06.675481 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13b9ef63-076e-4f22-8c72-46843ed7feec tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:06.675938 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13b9ef63-076e-4f22-8c72-46843ed7feec tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:06.676636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13b9ef63-076e-4f22-8c72-46843ed7feec tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:06.677116 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13b9ef63-076e-4f22-8c72-46843ed7feec tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:06.677816 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-13b9ef63-076e-4f22-8c72-46843ed7feec tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:06.890089 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-13b9ef63-076e-4f22-8c72-46843ed7feec tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:06.899169 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-13b9ef63-076e-4f22-8c72-46843ed7feec tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1558 microversion: 2.1 time: 0.236622 Sep 10 12:00:06.913307 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4758/7190] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:06 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1558 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:00:08.851552 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=6 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:08.904788 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-ab841955-6ca9-47ed-81ad-c47dad334f0b req-24964113-66e6-446c-9ad6-b8b7c07a8efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d0ab72-b531-47ea-9e3b-cdc0571383e1", "tag": "71d52059-a9f7-4ca2-bcca-01ea0235634e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:08.915345 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ab841955-6ca9-47ed-81ad-c47dad334f0b req-24964113-66e6-446c-9ad6-b8b7c07a8efd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:08.915824 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ab841955-6ca9-47ed-81ad-c47dad334f0b req-24964113-66e6-446c-9ad6-b8b7c07a8efd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:08.916254 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-ab841955-6ca9-47ed-81ad-c47dad334f0b req-24964113-66e6-446c-9ad6-b8b7c07a8efd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:08.929044 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-ab841955-6ca9-47ed-81ad-c47dad334f0b req-24964113-66e6-446c-9ad6-b8b7c07a8efd service nova] Creating event network-changed:71d52059-a9f7-4ca2-bcca-01ea0235634e for instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 on n-h1-856894-1 Sep 10 12:00:08.934513 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-ab841955-6ca9-47ed-81ad-c47dad334f0b req-24964113-66e6-446c-9ad6-b8b7c07a8efd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087437 Sep 10 12:00:08.935143 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2433/7191] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:03.655837 n-d-856894-1 devstack@n-api.service[128788]: ERROR oslo.messaging._drivers.impl_rabbit [-] [692a762d-1b37-42dd-b4f2-d39ae0d79f32] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 12:02:03.657012 n-d-856894-1 devstack@n-api.service[128788]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff958037-a840-4114-b8eb-6b314978ef69] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 12:02:03.657403 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:03.658236 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:03.659539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:03.661151 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=34 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:03.667032 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-ad3b40dc-0b84-4899-af1e-f567c246eeca tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1833246331"}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:03.669382 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-ad3b40dc-0b84-4899-af1e-f567c246eeca tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:03.679195 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad3b40dc-0b84-4899-af1e-f567c246eeca tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:03.679691 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad3b40dc-0b84-4899-af1e-f567c246eeca tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:03.680138 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad3b40dc-0b84-4899-af1e-f567c246eeca tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:03.680846 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad3b40dc-0b84-4899-af1e-f567c246eeca tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:03.681616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad3b40dc-0b84-4899-af1e-f567c246eeca tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:03.682076 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-ad3b40dc-0b84-4899-af1e-f567c246eeca tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:03.881719 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-ad3b40dc-0b84-4899-af1e-f567c246eeca tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "POST /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1/action" status: 202 len: 0 microversion: 2.1 time: 0.227623 Sep 10 12:02:03.882373 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4759/7192] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 12:02:03 2022] POST /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 12:02:09.262762 n-d-856894-1 devstack@n-api.service[128787]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82f59b2c-52ef-4de0-bd4e-b551a69003cb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 12:02:09.264309 n-d-856894-1 devstack@n-api.service[128787]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2d8a82b-a259-4271-b6a0-0b311d4f5a8a] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 12:02:09.265310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:09.266337 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=28 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:09.267423 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:02:09.267728 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 12:02:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 10 12:02:09.274445 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [req-aab824dc-dc72-42e6-aae8-7787fcebe10b req-54e9594a-acb2-4e43-bcf3-d4756a29f40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d0ab72-b531-47ea-9e3b-cdc0571383e1", "name": "network-vif-plugged", "status": "completed", "tag": "71d52059-a9f7-4ca2-bcca-01ea0235634e"}]} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:09.287934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-aab824dc-dc72-42e6-aae8-7787fcebe10b req-54e9594a-acb2-4e43-bcf3-d4756a29f40b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:09.288512 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-aab824dc-dc72-42e6-aae8-7787fcebe10b req-54e9594a-acb2-4e43-bcf3-d4756a29f40b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:09.289013 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [req-aab824dc-dc72-42e6-aae8-7787fcebe10b req-54e9594a-acb2-4e43-bcf3-d4756a29f40b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:09.302961 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.compute.server_external_events [req-aab824dc-dc72-42e6-aae8-7787fcebe10b req-54e9594a-acb2-4e43-bcf3-d4756a29f40b service nova] Creating event network-vif-plugged:71d52059-a9f7-4ca2-bcca-01ea0235634e for instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 on n-h1-856894-1 Sep 10 12:02:09.309498 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [req-aab824dc-dc72-42e6-aae8-7787fcebe10b req-54e9594a-acb2-4e43-bcf3-d4756a29f40b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048568 Sep 10 12:02:09.310453 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2434/7193] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:02:17.464254 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:17.465588 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:17.470228 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-964008592", "imageRef": "b231f0ab-b97a-4795-88d3-5d75c05177d1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1914489250", "security_groups": [{"name": "tempest-secgroup-smoke-151105398"}], "networks": [{"uuid": "704b645b-9c5d-4c93-b446-314a450295af"}]}} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:17.498666 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] [692a762d-1b37-42dd-b4f2-d39ae0d79f32] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52080. Sep 10 12:02:17.499536 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff958037-a840-4114-b8eb-6b314978ef69] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52082. Sep 10 12:02:17.599984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.network.neutron [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] validate_networks() for [('704b645b-9c5d-4c93-b446-314a450295af', None, None, None, None, None)] {{(pid=128788) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:02:17.988771 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Flavor limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:02:17.989280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Image limits 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:02:17.989775 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Flavor pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:02:17.990225 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Image pref 0:0:0 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:02:17.990652 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.virt.hardware [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:02:17.999381 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:17.999877 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:18.000324 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:18.001062 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:18.001560 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:18.001994 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:18.018373 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Getting quotas for project 4e0a2190350041fa9b4825962b223a20. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:18.024065 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.quota [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Getting quotas for user 8f7d6914e3804d1795c53e43d60f691d and project 4e0a2190350041fa9b4825962b223a20. Resources: {'instances', 'ram', 'cores'} {{(pid=128788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:18.037460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Going to run 1 instances... {{(pid=128788) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:02:18.039948 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b231f0ab-b97a-4795-88d3-5d75c05177d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:02:18.087627 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-31eb6bcc-6cdc-43a4-ba6d-dafd939f4220 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.625454 Sep 10 12:02:18.088295 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4760/7194] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Sep 10 12:02:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:02:18.103581 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-68fa61ad-c060-4e24-9578-412a4705d726 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:18.104292 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-68fa61ad-c060-4e24-9578-412a4705d726 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:18.123844 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2d8a82b-a259-4271-b6a0-0b311d4f5a8a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52096. Sep 10 12:02:18.124639 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] [82f59b2c-52ef-4de0-bd4e-b551a69003cb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52094. Sep 10 12:02:18.173294 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-68fa61ad-c060-4e24-9578-412a4705d726 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:18.180997 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-68fa61ad-c060-4e24-9578-412a4705d726 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1248 microversion: 2.1 time: 0.085283 Sep 10 12:02:18.181586 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2435/7195] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:18 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:19.204819 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-c7f1178e-69bd-4d01-b308-7e03d0ff7d33 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:19.205402 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-c7f1178e-69bd-4d01-b308-7e03d0ff7d33 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:19.211801 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7f1178e-69bd-4d01-b308-7e03d0ff7d33 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:19.212307 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7f1178e-69bd-4d01-b308-7e03d0ff7d33 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:19.212764 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7f1178e-69bd-4d01-b308-7e03d0ff7d33 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:19.213503 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7f1178e-69bd-4d01-b308-7e03d0ff7d33 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:19.213985 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7f1178e-69bd-4d01-b308-7e03d0ff7d33 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:19.214430 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-c7f1178e-69bd-4d01-b308-7e03d0ff7d33 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:19.276334 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-c7f1178e-69bd-4d01-b308-7e03d0ff7d33 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:19.284462 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-c7f1178e-69bd-4d01-b308-7e03d0ff7d33 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1300 microversion: 2.1 time: 0.084559 Sep 10 12:02:19.285279 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4761/7196] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:19 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:20.308175 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-a5aa05da-5f3e-45da-a677-535ba53a9ef7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:20.309415 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-a5aa05da-5f3e-45da-a677-535ba53a9ef7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:20.321501 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:20.330120 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa05da-5f3e-45da-a677-535ba53a9ef7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:20.331225 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa05da-5f3e-45da-a677-535ba53a9ef7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:20.331915 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa05da-5f3e-45da-a677-535ba53a9ef7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:20.333463 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa05da-5f3e-45da-a677-535ba53a9ef7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:20.334145 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa05da-5f3e-45da-a677-535ba53a9ef7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:20.347942 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-a5aa05da-5f3e-45da-a677-535ba53a9ef7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:20.551969 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-a5aa05da-5f3e-45da-a677-535ba53a9ef7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:20.560104 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-a5aa05da-5f3e-45da-a677-535ba53a9ef7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.256174 Sep 10 12:02:20.560686 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2436/7197] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:20 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:21.227300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-9b4934ea-178a-406d-a1a2-381ce64bd5dd req-1fb5c6f1-ba6d-4f58-a9d5-72cb1488fafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d0ab72-b531-47ea-9e3b-cdc0571383e1", "name": "network-vif-unplugged", "status": "completed", "tag": "71d52059-a9f7-4ca2-bcca-01ea0235634e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:21.240246 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b4934ea-178a-406d-a1a2-381ce64bd5dd req-1fb5c6f1-ba6d-4f58-a9d5-72cb1488fafd service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:21.241028 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b4934ea-178a-406d-a1a2-381ce64bd5dd req-1fb5c6f1-ba6d-4f58-a9d5-72cb1488fafd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:21.241706 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-9b4934ea-178a-406d-a1a2-381ce64bd5dd req-1fb5c6f1-ba6d-4f58-a9d5-72cb1488fafd service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:21.265025 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-9b4934ea-178a-406d-a1a2-381ce64bd5dd req-1fb5c6f1-ba6d-4f58-a9d5-72cb1488fafd service nova] Creating event network-vif-unplugged:71d52059-a9f7-4ca2-bcca-01ea0235634e for instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 on n-h1-856894-1 Sep 10 12:02:21.271046 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-9b4934ea-178a-406d-a1a2-381ce64bd5dd req-1fb5c6f1-ba6d-4f58-a9d5-72cb1488fafd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048819 Sep 10 12:02:21.271911 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4762/7198] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:21.584203 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-fe1f4b5d-afb3-4d24-ad53-f04a1fb78beb tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:21.587304 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-fe1f4b5d-afb3-4d24-ad53-f04a1fb78beb tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:21.593742 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe1f4b5d-afb3-4d24-ad53-f04a1fb78beb tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:21.594247 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe1f4b5d-afb3-4d24-ad53-f04a1fb78beb tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:21.594690 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe1f4b5d-afb3-4d24-ad53-f04a1fb78beb tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:21.595393 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe1f4b5d-afb3-4d24-ad53-f04a1fb78beb tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:21.595850 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe1f4b5d-afb3-4d24-ad53-f04a1fb78beb tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:21.596274 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-fe1f4b5d-afb3-4d24-ad53-f04a1fb78beb tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:21.743913 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-fe1f4b5d-afb3-4d24-ad53-f04a1fb78beb tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:21.752024 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-fe1f4b5d-afb3-4d24-ad53-f04a1fb78beb tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.172534 Sep 10 12:02:21.752743 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2437/7199] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:21 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:22.776408 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-5a3dab98-8dd7-48b2-9209-9aa24c927601 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:22.777167 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-5a3dab98-8dd7-48b2-9209-9aa24c927601 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:22.783594 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3dab98-8dd7-48b2-9209-9aa24c927601 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:22.784103 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3dab98-8dd7-48b2-9209-9aa24c927601 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:22.784576 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3dab98-8dd7-48b2-9209-9aa24c927601 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:22.785883 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3dab98-8dd7-48b2-9209-9aa24c927601 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:22.786609 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3dab98-8dd7-48b2-9209-9aa24c927601 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:22.787170 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-5a3dab98-8dd7-48b2-9209-9aa24c927601 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:22.942387 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-5a3dab98-8dd7-48b2-9209-9aa24c927601 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:22.952662 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-5a3dab98-8dd7-48b2-9209-9aa24c927601 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.181318 Sep 10 12:02:22.954582 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4763/7200] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:22 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:23.976610 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-45b72226-89f0-4e8f-91fa-4f6998ad2b87 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:23.977257 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-45b72226-89f0-4e8f-91fa-4f6998ad2b87 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:23.984302 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45b72226-89f0-4e8f-91fa-4f6998ad2b87 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:23.984802 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45b72226-89f0-4e8f-91fa-4f6998ad2b87 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:23.985282 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45b72226-89f0-4e8f-91fa-4f6998ad2b87 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:23.985982 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45b72226-89f0-4e8f-91fa-4f6998ad2b87 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:23.986444 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45b72226-89f0-4e8f-91fa-4f6998ad2b87 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:23.986873 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45b72226-89f0-4e8f-91fa-4f6998ad2b87 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:24.132927 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-45b72226-89f0-4e8f-91fa-4f6998ad2b87 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:24.141406 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-45b72226-89f0-4e8f-91fa-4f6998ad2b87 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.168813 Sep 10 12:02:24.142030 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2438/7201] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:23 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:25.164879 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6b9baf10-eb73-4788-919d-d0bf99e50255 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:25.165566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6b9baf10-eb73-4788-919d-d0bf99e50255 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:25.172499 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b9baf10-eb73-4788-919d-d0bf99e50255 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:25.173283 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b9baf10-eb73-4788-919d-d0bf99e50255 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:25.173740 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b9baf10-eb73-4788-919d-d0bf99e50255 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:25.174444 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b9baf10-eb73-4788-919d-d0bf99e50255 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:25.174920 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b9baf10-eb73-4788-919d-d0bf99e50255 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:25.175347 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6b9baf10-eb73-4788-919d-d0bf99e50255 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:25.326524 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6b9baf10-eb73-4788-919d-d0bf99e50255 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:25.334777 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6b9baf10-eb73-4788-919d-d0bf99e50255 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.174619 Sep 10 12:02:25.335616 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4764/7202] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:25 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:26.357661 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c3c34efb-d419-40d5-9c98-cd21234141c7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:26.358279 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c3c34efb-d419-40d5-9c98-cd21234141c7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:26.366624 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c3c34efb-d419-40d5-9c98-cd21234141c7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:26.367141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c3c34efb-d419-40d5-9c98-cd21234141c7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:26.367599 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c3c34efb-d419-40d5-9c98-cd21234141c7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:26.368312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c3c34efb-d419-40d5-9c98-cd21234141c7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:26.368773 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c3c34efb-d419-40d5-9c98-cd21234141c7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:26.369378 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c3c34efb-d419-40d5-9c98-cd21234141c7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:26.514388 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c3c34efb-d419-40d5-9c98-cd21234141c7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:26.522630 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c3c34efb-d419-40d5-9c98-cd21234141c7 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.168880 Sep 10 12:02:26.523243 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2439/7203] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:26 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:27.546300 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-6e99186a-9097-4e49-a7a1-55f79cca3390 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:27.547055 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-6e99186a-9097-4e49-a7a1-55f79cca3390 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:27.554536 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e99186a-9097-4e49-a7a1-55f79cca3390 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.555041 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e99186a-9097-4e49-a7a1-55f79cca3390 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.555496 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e99186a-9097-4e49-a7a1-55f79cca3390 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.556340 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e99186a-9097-4e49-a7a1-55f79cca3390 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.556814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e99186a-9097-4e49-a7a1-55f79cca3390 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.557280 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-6e99186a-9097-4e49-a7a1-55f79cca3390 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.709636 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-6e99186a-9097-4e49-a7a1-55f79cca3390 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:27.717681 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-6e99186a-9097-4e49-a7a1-55f79cca3390 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.175348 Sep 10 12:02:27.718277 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4765/7204] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:27 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:28.742086 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0412c3f8-3aa8-448e-b8cf-bb56777708c5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:28.742796 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0412c3f8-3aa8-448e-b8cf-bb56777708c5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:28.745503 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell0:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:28.750946 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0412c3f8-3aa8-448e-b8cf-bb56777708c5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:28.751443 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0412c3f8-3aa8-448e-b8cf-bb56777708c5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:28.751884 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0412c3f8-3aa8-448e-b8cf-bb56777708c5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:28.752582 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0412c3f8-3aa8-448e-b8cf-bb56777708c5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:28.753037 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0412c3f8-3aa8-448e-b8cf-bb56777708c5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:28.753492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0412c3f8-3aa8-448e-b8cf-bb56777708c5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:28.995310 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0412c3f8-3aa8-448e-b8cf-bb56777708c5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:29.003339 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0412c3f8-3aa8-448e-b8cf-bb56777708c5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.265922 Sep 10 12:02:29.004236 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2440/7205] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:28 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:29.395287 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=2 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:29.396344 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell0:SELECT=6 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:29.459459 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-62474ad0-7fb5-400a-a9eb-5e12e2c2618d req-e8a670a0-5da4-4f7e-973a-93561fe3162a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430270f4-1d97-4901-9e34-a8d8b29712b6", "tag": "0bd86798-b96d-4db1-955c-1da2d580ca8e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:29.470604 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-62474ad0-7fb5-400a-a9eb-5e12e2c2618d req-e8a670a0-5da4-4f7e-973a-93561fe3162a service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:29.471107 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-62474ad0-7fb5-400a-a9eb-5e12e2c2618d req-e8a670a0-5da4-4f7e-973a-93561fe3162a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:29.471561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-62474ad0-7fb5-400a-a9eb-5e12e2c2618d req-e8a670a0-5da4-4f7e-973a-93561fe3162a service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:29.483293 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-62474ad0-7fb5-400a-a9eb-5e12e2c2618d req-e8a670a0-5da4-4f7e-973a-93561fe3162a service nova] Creating event network-changed:0bd86798-b96d-4db1-955c-1da2d580ca8e for instance 430270f4-1d97-4901-9e34-a8d8b29712b6 on n-h2-856894-1 Sep 10 12:02:29.488144 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-62474ad0-7fb5-400a-a9eb-5e12e2c2618d req-e8a670a0-5da4-4f7e-973a-93561fe3162a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098036 Sep 10 12:02:29.489389 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4766/7206] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:30.029312 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-45a12201-4b6c-4e1e-8e36-5cdc8da5d720 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:30.029929 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-45a12201-4b6c-4e1e-8e36-5cdc8da5d720 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:30.037469 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a12201-4b6c-4e1e-8e36-5cdc8da5d720 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:30.037901 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a12201-4b6c-4e1e-8e36-5cdc8da5d720 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:30.038340 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a12201-4b6c-4e1e-8e36-5cdc8da5d720 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:30.039031 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a12201-4b6c-4e1e-8e36-5cdc8da5d720 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:30.039489 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a12201-4b6c-4e1e-8e36-5cdc8da5d720 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:30.039914 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-45a12201-4b6c-4e1e-8e36-5cdc8da5d720 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:30.172422 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-45a12201-4b6c-4e1e-8e36-5cdc8da5d720 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:30.180701 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-45a12201-4b6c-4e1e-8e36-5cdc8da5d720 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.155374 Sep 10 12:02:30.181328 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2441/7207] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:30 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:31.205566 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-14c07df3-df1e-4c1d-ae56-75aabec1878a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:31.206333 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-14c07df3-df1e-4c1d-ae56-75aabec1878a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:31.212498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c07df3-df1e-4c1d-ae56-75aabec1878a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:31.213031 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c07df3-df1e-4c1d-ae56-75aabec1878a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:31.213552 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c07df3-df1e-4c1d-ae56-75aabec1878a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:31.214275 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c07df3-df1e-4c1d-ae56-75aabec1878a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:31.214752 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c07df3-df1e-4c1d-ae56-75aabec1878a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:31.215203 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-14c07df3-df1e-4c1d-ae56-75aabec1878a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:31.403020 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-14c07df3-df1e-4c1d-ae56-75aabec1878a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:31.411340 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-14c07df3-df1e-4c1d-ae56-75aabec1878a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.211102 Sep 10 12:02:31.411914 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4767/7208] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:31 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:32.435424 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c2e5a63f-4568-4cbb-95a3-b855d293889a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:32.436022 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c2e5a63f-4568-4cbb-95a3-b855d293889a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:32.443042 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2e5a63f-4568-4cbb-95a3-b855d293889a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:32.443522 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2e5a63f-4568-4cbb-95a3-b855d293889a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:32.443957 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2e5a63f-4568-4cbb-95a3-b855d293889a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:32.444640 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2e5a63f-4568-4cbb-95a3-b855d293889a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:32.445108 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2e5a63f-4568-4cbb-95a3-b855d293889a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:32.445536 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c2e5a63f-4568-4cbb-95a3-b855d293889a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:32.574697 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c2e5a63f-4568-4cbb-95a3-b855d293889a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:32.582363 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c2e5a63f-4568-4cbb-95a3-b855d293889a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.150836 Sep 10 12:02:32.582939 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2442/7209] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:32 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:33.605267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-fa7f89e8-3c43-4b94-ae7d-cef921aa9742 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:33.605904 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-fa7f89e8-3c43-4b94-ae7d-cef921aa9742 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:33.612826 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa7f89e8-3c43-4b94-ae7d-cef921aa9742 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:33.613370 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa7f89e8-3c43-4b94-ae7d-cef921aa9742 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:33.613827 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa7f89e8-3c43-4b94-ae7d-cef921aa9742 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:33.614539 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa7f89e8-3c43-4b94-ae7d-cef921aa9742 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:33.615010 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa7f89e8-3c43-4b94-ae7d-cef921aa9742 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:33.615452 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-fa7f89e8-3c43-4b94-ae7d-cef921aa9742 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:33.749807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-fa7f89e8-3c43-4b94-ae7d-cef921aa9742 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:33.757555 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-fa7f89e8-3c43-4b94-ae7d-cef921aa9742 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.156271 Sep 10 12:02:33.758135 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4768/7210] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:33 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:34.780699 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-92d2d7cc-701c-4485-a772-1b1134caa6c4 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:34.781339 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-92d2d7cc-701c-4485-a772-1b1134caa6c4 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:34.788708 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92d2d7cc-701c-4485-a772-1b1134caa6c4 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:34.789231 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92d2d7cc-701c-4485-a772-1b1134caa6c4 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:34.789673 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92d2d7cc-701c-4485-a772-1b1134caa6c4 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:34.790363 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92d2d7cc-701c-4485-a772-1b1134caa6c4 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:34.790818 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92d2d7cc-701c-4485-a772-1b1134caa6c4 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:34.791243 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-92d2d7cc-701c-4485-a772-1b1134caa6c4 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:34.924186 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-92d2d7cc-701c-4485-a772-1b1134caa6c4 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:34.934053 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-92d2d7cc-701c-4485-a772-1b1134caa6c4 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.157238 Sep 10 12:02:34.934846 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2443/7211] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:34 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:35.082290 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-14e8e05d-ce6a-4c29-9ad2-f8f1eea7d09c req-e7b0692c-9b95-4fbc-b82a-c307dabd67f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430270f4-1d97-4901-9e34-a8d8b29712b6", "name": "network-vif-plugged", "status": "completed", "tag": "0bd86798-b96d-4db1-955c-1da2d580ca8e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:35.092716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-14e8e05d-ce6a-4c29-9ad2-f8f1eea7d09c req-e7b0692c-9b95-4fbc-b82a-c307dabd67f4 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:35.093251 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-14e8e05d-ce6a-4c29-9ad2-f8f1eea7d09c req-e7b0692c-9b95-4fbc-b82a-c307dabd67f4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:35.093716 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-14e8e05d-ce6a-4c29-9ad2-f8f1eea7d09c req-e7b0692c-9b95-4fbc-b82a-c307dabd67f4 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:35.105478 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-14e8e05d-ce6a-4c29-9ad2-f8f1eea7d09c req-e7b0692c-9b95-4fbc-b82a-c307dabd67f4 service nova] Creating event network-vif-plugged:0bd86798-b96d-4db1-955c-1da2d580ca8e for instance 430270f4-1d97-4901-9e34-a8d8b29712b6 on n-h2-856894-1 Sep 10 12:02:35.110468 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-14e8e05d-ce6a-4c29-9ad2-f8f1eea7d09c req-e7b0692c-9b95-4fbc-b82a-c307dabd67f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032438 Sep 10 12:02:35.111075 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4769/7212] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:35.958141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-c035e8e7-b22b-4c91-9dc8-3a6f71adc11c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:35.958680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-c035e8e7-b22b-4c91-9dc8-3a6f71adc11c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:35.965657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c035e8e7-b22b-4c91-9dc8-3a6f71adc11c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:35.966146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c035e8e7-b22b-4c91-9dc8-3a6f71adc11c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:35.966584 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c035e8e7-b22b-4c91-9dc8-3a6f71adc11c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:35.967272 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c035e8e7-b22b-4c91-9dc8-3a6f71adc11c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:35.967723 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c035e8e7-b22b-4c91-9dc8-3a6f71adc11c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:35.968146 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-c035e8e7-b22b-4c91-9dc8-3a6f71adc11c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:36.096542 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-c035e8e7-b22b-4c91-9dc8-3a6f71adc11c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:36.104631 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-c035e8e7-b22b-4c91-9dc8-3a6f71adc11c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1373 microversion: 2.1 time: 0.150767 Sep 10 12:02:36.105216 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2444/7213] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:35 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:37.128332 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-b18167df-af45-4f2b-bd11-794e60f877b1 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:37.129054 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-b18167df-af45-4f2b-bd11-794e60f877b1 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:37.135311 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b18167df-af45-4f2b-bd11-794e60f877b1 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:37.135814 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b18167df-af45-4f2b-bd11-794e60f877b1 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:37.136267 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b18167df-af45-4f2b-bd11-794e60f877b1 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:37.136971 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b18167df-af45-4f2b-bd11-794e60f877b1 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:37.137470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b18167df-af45-4f2b-bd11-794e60f877b1 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:37.137913 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-b18167df-af45-4f2b-bd11-794e60f877b1 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:37.272498 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-b18167df-af45-4f2b-bd11-794e60f877b1 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:37.280317 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-b18167df-af45-4f2b-bd11-794e60f877b1 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1558 microversion: 2.1 time: 0.157090 Sep 10 12:02:37.280928 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4770/7214] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:37 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:37.305705 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-dc55c37a-64e3-451b-ad51-0517886d44b5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:37.306835 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-dc55c37a-64e3-451b-ad51-0517886d44b5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:37.316209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc55c37a-64e3-451b-ad51-0517886d44b5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:37.316702 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc55c37a-64e3-451b-ad51-0517886d44b5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:37.317170 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc55c37a-64e3-451b-ad51-0517886d44b5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:37.317868 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc55c37a-64e3-451b-ad51-0517886d44b5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:37.318324 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc55c37a-64e3-451b-ad51-0517886d44b5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:37.318749 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-dc55c37a-64e3-451b-ad51-0517886d44b5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:37.448104 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-dc55c37a-64e3-451b-ad51-0517886d44b5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:37.455750 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-dc55c37a-64e3-451b-ad51-0517886d44b5 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1558 microversion: 2.1 time: 0.156270 Sep 10 12:02:37.456314 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2445/7215] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:37 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:39.327979 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a771ce08-f53c-4af0-a08d-e5e73fc745c7 req-92480f87-ae1a-46a5-addc-9f41b68ff13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430270f4-1d97-4901-9e34-a8d8b29712b6", "tag": "0bd86798-b96d-4db1-955c-1da2d580ca8e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:39.339395 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a771ce08-f53c-4af0-a08d-e5e73fc745c7 req-92480f87-ae1a-46a5-addc-9f41b68ff13b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:39.339910 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a771ce08-f53c-4af0-a08d-e5e73fc745c7 req-92480f87-ae1a-46a5-addc-9f41b68ff13b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:39.340547 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a771ce08-f53c-4af0-a08d-e5e73fc745c7 req-92480f87-ae1a-46a5-addc-9f41b68ff13b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:39.353328 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a771ce08-f53c-4af0-a08d-e5e73fc745c7 req-92480f87-ae1a-46a5-addc-9f41b68ff13b service nova] Creating event network-changed:0bd86798-b96d-4db1-955c-1da2d580ca8e for instance 430270f4-1d97-4901-9e34-a8d8b29712b6 on n-h2-856894-1 Sep 10 12:02:39.359536 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a771ce08-f53c-4af0-a08d-e5e73fc745c7 req-92480f87-ae1a-46a5-addc-9f41b68ff13b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034704 Sep 10 12:02:39.360161 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4771/7216] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:11.601837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=26 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:11.603246 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=60 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:11.604319 n-d-856894-1 devstack@n-api.service[128787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:04:11.604459 n-d-856894-1 devstack@n-api.service[128787]: Sat Sep 10 12:04:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6/action (ip 10.222.0.20) !!! Sep 10 12:04:11.609192 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-daf7fb66-9067-4c84-a9c0-b927d2f8862c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1128257563"}} {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:11.611492 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-daf7fb66-9067-4c84-a9c0-b927d2f8862c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:11.620188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf7fb66-9067-4c84-a9c0-b927d2f8862c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:11.620671 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf7fb66-9067-4c84-a9c0-b927d2f8862c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:11.621142 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf7fb66-9067-4c84-a9c0-b927d2f8862c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:11.621841 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf7fb66-9067-4c84-a9c0-b927d2f8862c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:11.622297 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf7fb66-9067-4c84-a9c0-b927d2f8862c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:11.622725 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-daf7fb66-9067-4c84-a9c0-b927d2f8862c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:12.017839 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-daf7fb66-9067-4c84-a9c0-b927d2f8862c tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "POST /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6/action" status: 202 len: 0 microversion: 2.1 time: 0.417753 Sep 10 12:04:12.018482 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2446/7217] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:11 2022] POST /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 12:04:17.569957 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:17.572182 n-d-856894-1 devstack@n-api.service[128788]: DEBUG dbcounter [-] [128788] Writing DB stats nova_cell1:SELECT=52 {{(pid=128788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:17.574004 n-d-856894-1 devstack@n-api.service[128788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:04:17.574232 n-d-856894-1 devstack@n-api.service[128788]: Sat Sep 10 12:04:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 10 12:04:17.579724 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-a494fb1a-d993-4dc0-a2d3-5f953722bd33 req-5eed6bf6-e404-4f47-88b2-dca75573cf21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430270f4-1d97-4901-9e34-a8d8b29712b6", "name": "network-vif-plugged", "status": "completed", "tag": "0bd86798-b96d-4db1-955c-1da2d580ca8e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:17.606960 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a494fb1a-d993-4dc0-a2d3-5f953722bd33 req-5eed6bf6-e404-4f47-88b2-dca75573cf21 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:17.609589 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a494fb1a-d993-4dc0-a2d3-5f953722bd33 req-5eed6bf6-e404-4f47-88b2-dca75573cf21 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:17.612824 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-a494fb1a-d993-4dc0-a2d3-5f953722bd33 req-5eed6bf6-e404-4f47-88b2-dca75573cf21 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:17.645249 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-a494fb1a-d993-4dc0-a2d3-5f953722bd33 req-5eed6bf6-e404-4f47-88b2-dca75573cf21 service nova] Creating event network-vif-plugged:0bd86798-b96d-4db1-955c-1da2d580ca8e for instance 430270f4-1d97-4901-9e34-a8d8b29712b6 on n-h2-856894-1 Sep 10 12:04:17.653894 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-a494fb1a-d993-4dc0-a2d3-5f953722bd33 req-5eed6bf6-e404-4f47-88b2-dca75573cf21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086148 Sep 10 12:04:17.654756 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4772/7218] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:25.935200 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_api:SELECT=2 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:25.936204 n-d-856894-1 devstack@n-api.service[128787]: DEBUG dbcounter [-] [128787] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:25.940519 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0e1ec193-687f-4fc0-b3dd-d7cc913c5556 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:25.941356 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0e1ec193-687f-4fc0-b3dd-d7cc913c5556 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:25.942137 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-3d4db607-3423-42e3-9242-3d6b95cc132b req-ba52a017-4ca2-4dfc-a47b-05a4e95138a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430270f4-1d97-4901-9e34-a8d8b29712b6", "tag": "0bd86798-b96d-4db1-955c-1da2d580ca8e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:25.948837 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e1ec193-687f-4fc0-b3dd-d7cc913c5556 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:25.949515 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e1ec193-687f-4fc0-b3dd-d7cc913c5556 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:25.949955 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e1ec193-687f-4fc0-b3dd-d7cc913c5556 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:25.950660 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e1ec193-687f-4fc0-b3dd-d7cc913c5556 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:25.951115 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e1ec193-687f-4fc0-b3dd-d7cc913c5556 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:25.951537 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0e1ec193-687f-4fc0-b3dd-d7cc913c5556 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:25.953682 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d4db607-3423-42e3-9242-3d6b95cc132b req-ba52a017-4ca2-4dfc-a47b-05a4e95138a6 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:25.954177 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d4db607-3423-42e3-9242-3d6b95cc132b req-ba52a017-4ca2-4dfc-a47b-05a4e95138a6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:25.954616 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-3d4db607-3423-42e3-9242-3d6b95cc132b req-ba52a017-4ca2-4dfc-a47b-05a4e95138a6 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:25.969597 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-3d4db607-3423-42e3-9242-3d6b95cc132b req-ba52a017-4ca2-4dfc-a47b-05a4e95138a6 service nova] Creating event network-changed:0bd86798-b96d-4db1-955c-1da2d580ca8e for instance 430270f4-1d97-4901-9e34-a8d8b29712b6 on n-h2-856894-1 Sep 10 12:04:25.975040 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-3d4db607-3423-42e3-9242-3d6b95cc132b req-ba52a017-4ca2-4dfc-a47b-05a4e95138a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039617 Sep 10 12:04:25.976233 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4773/7219] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:04:25.983144 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0e1ec193-687f-4fc0-b3dd-d7cc913c5556 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:04:26.082822 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0e1ec193-687f-4fc0-b3dd-d7cc913c5556 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "DELETE /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 204 len: 0 microversion: 2.1 time: 0.149662 Sep 10 12:04:26.084434 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2447/7220] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 12:04:25 2022] DELETE /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:04:26.094040 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-cdc5e21d-647c-4e3f-a189-39f85d509611 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:26.094779 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-cdc5e21d-647c-4e3f-a189-39f85d509611 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:26.101102 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdc5e21d-647c-4e3f-a189-39f85d509611 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.101646 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdc5e21d-647c-4e3f-a189-39f85d509611 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.102761 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdc5e21d-647c-4e3f-a189-39f85d509611 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.103488 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdc5e21d-647c-4e3f-a189-39f85d509611 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.103973 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdc5e21d-647c-4e3f-a189-39f85d509611 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.104428 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-cdc5e21d-647c-4e3f-a189-39f85d509611 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.296807 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-cdc5e21d-647c-4e3f-a189-39f85d509611 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:26.304869 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-cdc5e21d-647c-4e3f-a189-39f85d509611 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1683 microversion: 2.1 time: 0.215340 Sep 10 12:04:26.306086 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4774/7221] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:26 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1683 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:27.329867 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-3aa42b66-084b-4ff2-99e6-4420f0a55a0e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:27.330566 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-3aa42b66-084b-4ff2-99e6-4420f0a55a0e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:27.337546 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa42b66-084b-4ff2-99e6-4420f0a55a0e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:27.338026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa42b66-084b-4ff2-99e6-4420f0a55a0e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:27.338455 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa42b66-084b-4ff2-99e6-4420f0a55a0e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:27.339209 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa42b66-084b-4ff2-99e6-4420f0a55a0e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:27.339657 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa42b66-084b-4ff2-99e6-4420f0a55a0e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:27.340075 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-3aa42b66-084b-4ff2-99e6-4420f0a55a0e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:27.477680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-3aa42b66-084b-4ff2-99e6-4420f0a55a0e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:27.485448 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-3aa42b66-084b-4ff2-99e6-4420f0a55a0e tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1683 microversion: 2.1 time: 0.159872 Sep 10 12:04:27.486020 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2448/7222] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:27 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:28.276952 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c1356ca4-41b4-45c5-8e83-cc32e58e551c req-bf14e9b3-42e2-4ad8-9e18-925aa2f6ab2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430270f4-1d97-4901-9e34-a8d8b29712b6", "name": "network-vif-deleted", "tag": "0bd86798-b96d-4db1-955c-1da2d580ca8e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:28.287509 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c1356ca4-41b4-45c5-8e83-cc32e58e551c req-bf14e9b3-42e2-4ad8-9e18-925aa2f6ab2b service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.288092 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c1356ca4-41b4-45c5-8e83-cc32e58e551c req-bf14e9b3-42e2-4ad8-9e18-925aa2f6ab2b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.288614 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c1356ca4-41b4-45c5-8e83-cc32e58e551c req-bf14e9b3-42e2-4ad8-9e18-925aa2f6ab2b service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:28.301115 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c1356ca4-41b4-45c5-8e83-cc32e58e551c req-bf14e9b3-42e2-4ad8-9e18-925aa2f6ab2b service nova] Creating event network-vif-deleted:0bd86798-b96d-4db1-955c-1da2d580ca8e for instance 430270f4-1d97-4901-9e34-a8d8b29712b6 on n-h2-856894-1 Sep 10 12:04:28.306063 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c1356ca4-41b4-45c5-8e83-cc32e58e551c req-bf14e9b3-42e2-4ad8-9e18-925aa2f6ab2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 Sep 10 12:04:28.306675 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4775/7223] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:28.509329 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:28.509937 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:28.516680 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.517185 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.517618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:28.518295 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.518747 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.519167 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:28.551453 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.551934 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.552368 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:28.552808 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lazy-loading 'fault' on Instance uuid 430270f4-1d97-4901-9e34-a8d8b29712b6 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:04:28.595407 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:28.603769 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-7db1abef-80ed-4f23-ab3c-1a5644acb06f tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 200 len: 1338 microversion: 2.1 time: 0.098538 Sep 10 12:04:28.604356 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2449/7224] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:28 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 1338 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:29.627964 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:29.628684 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 430270f4-1d97-4901-9e34-a8d8b29712b6] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:29.635643 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:29.636144 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:29.636607 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:29.637337 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:29.637812 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:29.638263 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:29.651502 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] HTTP exception thrown: Instance 430270f4-1d97-4901-9e34-a8d8b29712b6 could not be found. Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Request method failure captured: Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 HTTP/1.1 Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHw2Tg-EKDEb9bg0ph0dTRxKWCbAywGOfXzs9HjAzPmvVGuzmgQFyR5xay47JXIirTcKr3wKI5feVe7rw07TncfLRGzUCIKKJ5tC4n63UU5p2r2AmQPwVUkGuDJiybbnuVBjjx1g-FMiLMJ_s26xnM82is4BjKEDrHZeuGgDhKr-8Wo Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 4e0a2190350041fa9b4825962b223a20 Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestSnapshotPattern-1892690091 Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a2190350041fa9b4825962b223a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e0a2190350041fa9b4825962b223a20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a2190350041fa9b4825962b223a20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e0a2190350041fa9b4825962b223a20", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestSnapshotPattern-1892690091 Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 4e0a2190350041fa9b4825962b223a20 Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestSnapshotPattern-1892690091 Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestSnapshotPattern-1892690091-project Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 8f7d6914e3804d1795c53e43d60f691d Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestSnapshotPattern-1892690091-project Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 430270f4-1d97-4901-9e34-a8d8b29712b6 could not be found. Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '430270f4-1d97-4901-9e34-a8d8b29712b6'} Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430270f4-1d97-4901-9e34-a8d8b29712b6 could not be found. Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430270f4-1d97-4901-9e34-a8d8b29712b6 could not be found. Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:29.653060 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 12:04:29.657561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:29.657561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:29.657561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:29.657561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:29.657561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:29.657561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430270f4-1d97-4901-9e34-a8d8b29712b6 could not be found. Sep 10 12:04:29.657561 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 12:04:29.657561 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Returning 404 to user: Instance 430270f4-1d97-4901-9e34-a8d8b29712b6 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:29.657561 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-0708d4cf-d8b4-498a-855b-068c79e44256 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6" status: 404 len: 111 microversion: 2.1 time: 0.031680 Sep 10 12:04:29.657561 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4776/7225] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:29 2022] GET /compute/v2.1/servers/430270f4-1d97-4901-9e34-a8d8b29712b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:30.968894 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-644dbc53-12ad-44d9-8b66-e99e3a61ee21 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:30.969466 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-644dbc53-12ad-44d9-8b66-e99e3a61ee21 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:30.970470 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-c0494bb4-3977-483f-9709-4a85ea0a8ade req-7aaf4a8a-4510-4d96-9f30-322666551f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d0ab72-b531-47ea-9e3b-cdc0571383e1", "tag": "71d52059-a9f7-4ca2-bcca-01ea0235634e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:30.981872 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c0494bb4-3977-483f-9709-4a85ea0a8ade req-7aaf4a8a-4510-4d96-9f30-322666551f87 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:30.982460 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c0494bb4-3977-483f-9709-4a85ea0a8ade req-7aaf4a8a-4510-4d96-9f30-322666551f87 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:30.982984 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-c0494bb4-3977-483f-9709-4a85ea0a8ade req-7aaf4a8a-4510-4d96-9f30-322666551f87 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:30.984861 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-644dbc53-12ad-44d9-8b66-e99e3a61ee21 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:30.985852 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-644dbc53-12ad-44d9-8b66-e99e3a61ee21 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:30.986369 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-644dbc53-12ad-44d9-8b66-e99e3a61ee21 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:30.987141 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-644dbc53-12ad-44d9-8b66-e99e3a61ee21 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:30.987862 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-644dbc53-12ad-44d9-8b66-e99e3a61ee21 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:30.988359 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-644dbc53-12ad-44d9-8b66-e99e3a61ee21 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:30.994620 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-c0494bb4-3977-483f-9709-4a85ea0a8ade req-7aaf4a8a-4510-4d96-9f30-322666551f87 service nova] Creating event network-changed:71d52059-a9f7-4ca2-bcca-01ea0235634e for instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 on n-h1-856894-1 Sep 10 12:04:31.000475 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-c0494bb4-3977-483f-9709-4a85ea0a8ade req-7aaf4a8a-4510-4d96-9f30-322666551f87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037172 Sep 10 12:04:31.001560 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4777/7226] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:31.019847 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-644dbc53-12ad-44d9-8b66-e99e3a61ee21 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Going to try to terminate instance {{(pid=128787) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:04:31.117055 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-644dbc53-12ad-44d9-8b66-e99e3a61ee21 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "DELETE /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 204 len: 0 microversion: 2.1 time: 0.156281 Sep 10 12:04:31.119364 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2450/7227] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Sep 10 12:04:30 2022] DELETE /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:04:31.128933 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-d8f798da-5b2a-4cf3-bb98-d6376ee87891 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:31.129715 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-d8f798da-5b2a-4cf3-bb98-d6376ee87891 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:31.137367 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f798da-5b2a-4cf3-bb98-d6376ee87891 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:31.137893 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f798da-5b2a-4cf3-bb98-d6376ee87891 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:31.138346 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f798da-5b2a-4cf3-bb98-d6376ee87891 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:31.139521 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f798da-5b2a-4cf3-bb98-d6376ee87891 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:31.140184 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f798da-5b2a-4cf3-bb98-d6376ee87891 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:31.140789 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-d8f798da-5b2a-4cf3-bb98-d6376ee87891 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:31.282905 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.policy [None req-d8f798da-5b2a-4cf3-bb98-d6376ee87891 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128788) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:31.291358 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-d8f798da-5b2a-4cf3-bb98-d6376ee87891 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1682 microversion: 2.1 time: 0.167160 Sep 10 12:04:31.291963 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4778/7228] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:31 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:32.316893 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-0d94692c-13bc-43ec-9a3f-ff2c36e7ec6a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:32.317625 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-0d94692c-13bc-43ec-9a3f-ff2c36e7ec6a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:32.325132 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d94692c-13bc-43ec-9a3f-ff2c36e7ec6a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:32.325618 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d94692c-13bc-43ec-9a3f-ff2c36e7ec6a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:32.326048 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d94692c-13bc-43ec-9a3f-ff2c36e7ec6a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:32.326750 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d94692c-13bc-43ec-9a3f-ff2c36e7ec6a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:32.327188 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d94692c-13bc-43ec-9a3f-ff2c36e7ec6a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:32.327617 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-0d94692c-13bc-43ec-9a3f-ff2c36e7ec6a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:32.493560 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-0d94692c-13bc-43ec-9a3f-ff2c36e7ec6a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:32.501257 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-0d94692c-13bc-43ec-9a3f-ff2c36e7ec6a tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1682 microversion: 2.1 time: 0.188598 Sep 10 12:04:32.501827 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2451/7229] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:32 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:33.082939 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [req-fd5f2389-9db4-4376-8137-a764f30538f8 req-8dcb16d6-00b8-4ebc-b7fd-f486a1c21730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d0ab72-b531-47ea-9e3b-cdc0571383e1", "name": "network-vif-deleted", "tag": "71d52059-a9f7-4ca2-bcca-01ea0235634e"}]} {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:33.094147 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd5f2389-9db4-4376-8137-a764f30538f8 req-8dcb16d6-00b8-4ebc-b7fd-f486a1c21730 service nova] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:33.094667 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd5f2389-9db4-4376-8137-a764f30538f8 req-8dcb16d6-00b8-4ebc-b7fd-f486a1c21730 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:33.095109 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [req-fd5f2389-9db4-4376-8137-a764f30538f8 req-8dcb16d6-00b8-4ebc-b7fd-f486a1c21730 service nova] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.107387 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.compute.server_external_events [req-fd5f2389-9db4-4376-8137-a764f30538f8 req-8dcb16d6-00b8-4ebc-b7fd-f486a1c21730 service nova] Creating event network-vif-deleted:71d52059-a9f7-4ca2-bcca-01ea0235634e for instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 on n-h1-856894-1 Sep 10 12:04:33.112585 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [req-fd5f2389-9db4-4376-8137-a764f30538f8 req-8dcb16d6-00b8-4ebc-b7fd-f486a1c21730 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033597 Sep 10 12:04:33.113217 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4779/7230] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:33.525709 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:33.526507 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.compute.api [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128787) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:33.533511 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:33.533991 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:33.534425 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.535153 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:33.535605 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:33.536026 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.573165 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:33.573665 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:33.574813 n-d-856894-1 devstack@n-api.service[128787]: DEBUG oslo_concurrency.lockutils [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.575357 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.objects.instance [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lazy-loading 'fault' on Instance uuid 88d0ab72-b531-47ea-9e3b-cdc0571383e1 {{(pid=128787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:04:33.618064 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.policy [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f7d6914e3804d1795c53e43d60f691d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a2190350041fa9b4825962b223a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128787) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:33.625205 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-f73bb3fb-dd69-4f46-90c6-1c9c5356c318 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 200 len: 1338 microversion: 2.1 time: 0.103899 Sep 10 12:04:33.625775 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2452/7231] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:33 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:34.649486 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '>' {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:34.650219 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.compute.api [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] [instance: 88d0ab72-b531-47ea-9e3b-cdc0571383e1] Fetching instance by UUID {{(pid=128788) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:34.656535 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:34.657039 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:34.657527 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:34.658233 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Acquiring lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:34.658709 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:34.659155 n-d-856894-1 devstack@n-api.service[128788]: DEBUG oslo_concurrency.lockutils [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Lock "de407895-2d2a-4843-aa8e-31011e0cfcb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:34.675591 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.wsgi [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] HTTP exception thrown: Instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 could not be found. Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Request method failure captured: Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: request: GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 HTTP/1.1 Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: Accept: application/json Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: Accept-Encoding: identity Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: Connection: close Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: Content-Length: 0 Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: Content-Type: application/json Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: Host: 10.222.0.20 Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: Openstack-System-Scope: None Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Auth-Token: gAAAAABjHHw2Tg-EKDEb9bg0ph0dTRxKWCbAywGOfXzs9HjAzPmvVGuzmgQFyR5xay47JXIirTcKr3wKI5feVe7rw07TncfLRGzUCIKKJ5tC4n63UU5p2r2AmQPwVUkGuDJiybbnuVBjjx1g-FMiLMJ_s26xnM82is4BjKEDrHZeuGgDhKr-8Wo Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Id: None Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Domain-Name: None Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Identity-Status: Confirmed Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Is-Admin-Project: True Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Id: default Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Domain-Name: Default Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Id: 4e0a2190350041fa9b4825962b223a20 Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Project-Name: tempest-TestSnapshotPattern-1892690091 Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Role: member,reader Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Roles: member,reader Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a2190350041fa9b4825962b223a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e0a2190350041fa9b4825962b223a20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a2190350041fa9b4825962b223a20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e0a2190350041fa9b4825962b223a20", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant: tempest-TestSnapshotPattern-1892690091 Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Id: 4e0a2190350041fa9b4825962b223a20 Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-Tenant-Name: tempest-TestSnapshotPattern-1892690091 Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-User: tempest-TestSnapshotPattern-1892690091-project Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Id: default Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-User-Domain-Name: Default Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-User-Id: 8f7d6914e3804d1795c53e43d60f691d Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: X-User-Name: tempest-TestSnapshotPattern-1892690091-project Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: method: > Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: exception: Instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 could not be found. Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: action_args: {'id': '88d0ab72-b531-47ea-9e3b-cdc0571383e1'} Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: {{(pid=128788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 could not be found. Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 could not be found. Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:34.677296 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 12:04:34.682375 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:34.682375 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:34.682375 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:34.682375 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:34.682375 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:34.682375 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 could not be found. Sep 10 12:04:34.682375 n-d-856894-1 devstack@n-api.service[128788]: ERROR nova.api.openstack.wsgi Sep 10 12:04:34.682375 n-d-856894-1 devstack@n-api.service[128788]: DEBUG nova.api.openstack.wsgi [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Returning 404 to user: Instance 88d0ab72-b531-47ea-9e3b-cdc0571383e1 could not be found. {{(pid=128788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:34.682375 n-d-856894-1 devstack@n-api.service[128788]: INFO nova.api.openstack.requestlog [None req-302578e0-48e0-401f-8c81-030877741540 tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1" status: 404 len: 111 microversion: 2.1 time: 0.034486 Sep 10 12:04:34.682375 n-d-856894-1 devstack@n-api.service[128788]: [pid: 128788|app: 0|req: 4780/7232] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:34 2022] GET /compute/v2.1/servers/88d0ab72-b531-47ea-9e3b-cdc0571383e1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:34.842695 n-d-856894-1 devstack@n-api.service[128787]: DEBUG nova.api.openstack.wsgi [None req-8b7da29d-1f53-425c-8946-bba0a64ea8de tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] Calling method '.version_select at 0x7efcae6cc430>' {{(pid=128787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:34.869388 n-d-856894-1 devstack@n-api.service[128787]: INFO nova.api.openstack.requestlog [None req-8b7da29d-1f53-425c-8946-bba0a64ea8de tempest-TestSnapshotPattern-1892690091 tempest-TestSnapshotPattern-1892690091-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1914489250" status: 202 len: 0 microversion: 2.1 time: 0.030648 Sep 10 12:04:34.870147 n-d-856894-1 devstack@n-api.service[128787]: [pid: 128787|app: 0|req: 2453/7233] 10.222.0.20 () {58 vars in 1257 bytes} [Sat Sep 10 12:04:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1914489250 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)